2024-09-13T18:31:44.748 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:31:44.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:31:44.883 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/multimds_misc} email: null first_in_suite: false job_id: '7904001' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Scrub error on inode sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v2 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_multimds_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:31:44.884 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:31:44.884 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:31:44.885 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:31:44.886 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:31:44.907 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:31:44.907 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:31:44.907 INFO:teuthology.packaging:ref: None 2024-09-13T18:31:44.907 INFO:teuthology.packaging:tag: None 2024-09-13T18:31:44.907 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:31:44.907 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:31:44.907 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:31:45.063 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:31:45.065 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:31:45.070 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:31:45.070 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:31:45.106 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:31:45.121 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:31:45.127 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:31:45.158 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:25:15.517446', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T18:31:45.192 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:25:15.519091', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T18:31:45.192 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:31:45.197 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T18:31:45.197 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T18:31:45.197 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:31:45.327 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa07b377be0>, signals=[15]) 2024-09-13T18:31:45.327 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:31:45.332 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:31:45.332 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:31:45.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:31:45.432 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:31:45.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:31:45.527 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:31:45.534 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-13T18:31:45.540 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-13T18:31:45.541 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="20.04" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:31:45.587 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:31:45.588 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=focal 2024-09-13T18:31:45.588 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=focal 2024-09-13T18:31:45.588 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-13T18:31:45.621 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-09-13T18:31:45.628 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-09-13T18:31:45.629 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-09-13T18:31:45.676 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2024-09-13T18:31:45.676 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T18:31:45.676 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="20.04" 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=focal 2024-09-13T18:31:45.677 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=focal 2024-09-13T18:31:45.678 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-09-13T18:31:45.713 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:31:45.722 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:31:45.726 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:31:45.726 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:31:45.729 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:31:45.734 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:31:45.740 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:31:45.740 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:31:45.775 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:31:45.816 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:31:45.891 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:31:45.905 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:31:45.905 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T18:31:45.905 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T18:31:45.906 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:31:45.906 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:31:45.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:31:45.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T18:31:45.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:31:45.923 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2024-09-13T18:31:46.087 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:31:46.087 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:31:46.087 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-13T18:31:46.092 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:31:46.092 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:31:46.093 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-13T18:31:46.094 INFO:teuthology.orchestra.run.smithi178.stdout:5.4.0-124-generic 2024-09-13T18:31:46.094 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:31:46.095 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:31:46.095 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-13T18:31:46.095 DEBUG:teuthology.orchestra.run.smithi178:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T18:31:46.099 INFO:teuthology.orchestra.run.smithi081.stdout:5.4.0-124-generic 2024-09-13T18:31:46.100 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:31:46.100 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:31:46.101 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-13T18:31:46.101 DEBUG:teuthology.orchestra.run.smithi081:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T18:31:46.152 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T18:31:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2024-09-13T18:31:46.250 INFO:teuthology.orchestra.run.smithi178.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T18:31:46.252 DEBUG:teuthology.orchestra.run.smithi178:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T18:31:46.277 INFO:teuthology.orchestra.run.smithi081.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T18:31:46.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T18:31:46.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T18:31:46.294 DEBUG:teuthology.orchestra.run.smithi178:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T18:31:46.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T18:31:46.332 DEBUG:teuthology.orchestra.run.smithi081:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T18:32:24.751 INFO:teuthology.orchestra.run.smithi081.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T18:32:24.751 INFO:teuthology.orchestra.run.smithi081.stderr: * [new branch] main -> origin/main 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T18:32:24.819 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T18:32:24.820 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T18:32:24.821 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T18:32:24.822 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T18:32:24.823 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T18:32:24.825 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T18:32:24.826 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T18:32:24.827 INFO:teuthology.orchestra.run.smithi081.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T18:32:27.117 INFO:teuthology.orchestra.run.smithi178.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T18:32:27.118 INFO:teuthology.orchestra.run.smithi178.stderr: * [new branch] main -> origin/main 2024-09-13T18:32:27.182 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T18:32:27.183 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T18:32:27.185 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T18:32:27.186 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T18:32:27.186 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T18:32:27.186 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T18:32:27.186 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T18:32:27.186 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T18:32:27.189 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T18:32:27.189 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T18:32:27.189 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T18:32:27.189 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T18:32:27.189 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T18:32:27.189 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T18:32:27.190 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T18:32:27.191 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T18:32:29.378 INFO:teuthology.orchestra.run.smithi081.stderr:Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2081/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2440/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2906/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T18:32:29.383 INFO:teuthology.orchestra.run.smithi081.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T18:32:29.401 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:32:29.402 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:32:29.554 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:32:29.555 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T18:32:29.557 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi081.front.sepia.ceph.com to complete... 2024-09-13T18:32:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13 18:32:30 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T18:32:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:FINISHED --2024-09-13 18:32:30-- 2024-09-13T18:32:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:Total wall clock time: 1.0s 2024-09-13T18:32:30.544 INFO:teuthology.orchestra.run.smithi081.stderr:Downloaded: 1 files, 43M in 0.8s (51.9 MB/s) 2024-09-13T18:32:30.547 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:32:30.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T18:32:30.853 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T18:32:31.739 INFO:teuthology.orchestra.run.smithi178.stderr:Updating files: 44% (1562/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2082/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2440/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2908/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T18:32:31.744 INFO:teuthology.orchestra.run.smithi178.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T18:32:31.761 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T18:32:31.762 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:32:31.907 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:32:31.907 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T18:32:31.910 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi178.front.sepia.ceph.com to complete... 2024-09-13T18:32:32.636 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T18:32:32.640 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T18:32:32.774 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T18:32:32.923 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13 18:32:33 URL:https://2.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/focal/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45355934/45355934] -> "/tmp/linux-image.deb" [1] 2024-09-13T18:32:32.923 INFO:teuthology.orchestra.run.smithi178.stderr:FINISHED --2024-09-13 18:32:33-- 2024-09-13T18:32:32.923 INFO:teuthology.orchestra.run.smithi178.stderr:Total wall clock time: 1.0s 2024-09-13T18:32:32.923 INFO:teuthology.orchestra.run.smithi178.stderr:Downloaded: 1 files, 43M in 0.8s (52.1 MB/s) 2024-09-13T18:32:32.926 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T18:32:32.926 DEBUG:teuthology.orchestra.run.smithi178:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T18:32:33.199 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T18:32:34.922 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... 104373 files and directories currently installed.) 2024-09-13T18:32:34.927 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T18:32:35.074 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T18:32:36.146 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T18:32:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:32:38.386 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T18:32:38.506 INFO:teuthology.orchestra.run.smithi178.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:33:04.404 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:33:04.424 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-13T18:33:04.807 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:04.826 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:05.306 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:33:05.319 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:33:06.275 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:33:06.281 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:33:06.303 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-09-13T18:33:06.644 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:06.667 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.029 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:33:07.041 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:33:07.128 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-13T18:33:07.309 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T18:33:07.318 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T18:33:07.318 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T18:33:07.318 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.340 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.341 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.366 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T18:33:07.366 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T18:33:07.366 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T18:33:07.366 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T18:33:07.366 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T18:33:07.366 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:33:07.367 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:33:07.368 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T18:33:07.369 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:33:07.370 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:33:07.370 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:33:07.466 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:33:07.467 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:33:07.468 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:33:07.469 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:33:07.470 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T18:33:07.471 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:33:07.472 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:33:07.473 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:33:07.474 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:33:07.475 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:33:07.476 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:33:07.477 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:33:07.478 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:33:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T18:33:07.480 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:33:07.480 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T18:33:07.480 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T18:33:07.480 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:33:07.481 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:33:07.482 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T18:33:07.483 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T18:33:07.484 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:33:07.485 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T18:33:07.486 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:33:07.487 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:33:07.488 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T18:33:07.489 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T18:33:07.490 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T18:33:07.491 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:33:07.492 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:33:07.493 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:33:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:33:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:33:07.496 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:33:07.497 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:33:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:33:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:33:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T18:33:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T18:33:07.502 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:33:07.503 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:33:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:33:07.505 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:33:07.506 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:33:07.507 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:33:07.508 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:33:07.509 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:33:07.510 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:33:07.511 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:33:07.512 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:33:07.513 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T18:33:07.514 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:33:07.515 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T18:33:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:33:07.517 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T18:33:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T18:33:07.519 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T18:33:07.520 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T18:33:07.521 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T18:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:33:07.522 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T18:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T18:33:07.524 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T18:33:07.525 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T18:33:07.526 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:33:07.527 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:33:07.528 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T18:33:07.529 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T18:33:07.530 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:33:07.531 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:33:07.532 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:33:07.533 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:33:07.534 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T18:33:07.535 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T18:33:07.536 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T18:33:07.537 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T18:33:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T18:33:07.539 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T18:33:07.540 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T18:33:07.541 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:33:07.542 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:33:07.543 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:33:07.544 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T18:33:07.545 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:33:07.546 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:33:07.547 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:33:07.548 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T18:33:07.549 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T18:33:07.550 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:33:07.687 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T18:33:07.688 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:33:07.689 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T18:33:07.690 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:33:07.691 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:33:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:33:07.693 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T18:33:07.694 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:33:07.695 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T18:33:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T18:33:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:33:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:33:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:33:07.700 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:33:07.701 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:33:07.702 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:33:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:33:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T18:33:07.705 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T18:33:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T18:33:07.707 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T18:33:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:33:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:33:07.710 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:33:07.711 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T18:33:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T18:33:07.713 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T18:33:07.714 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T18:33:07.715 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:33:07.716 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T18:33:07.717 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T18:33:07.718 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:33:07.719 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:33:07.720 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:33:07.721 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T18:33:07.722 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:33:07.723 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:33:07.724 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:33:07.724 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:33:07.724 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:33:07.724 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T18:33:07.724 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:33:07.724 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T18:33:07.725 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T18:33:07.725 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T18:33:07.728 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T18:33:07.728 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:33:07.729 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T18:33:07.730 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:33:07.731 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:33:07.732 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:33:07.733 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T18:33:07.734 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:33:07.735 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:33:07.736 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T18:33:07.737 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:33:07.738 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T18:33:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:33:07.740 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:33:07.741 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:33:07.742 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:33:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:33:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:33:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T18:33:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T18:33:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:33:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T18:33:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:33:07.745 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:33:07.746 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T18:33:07.746 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:33:07.746 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T18:33:07.746 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T18:33:07.746 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T18:33:07.746 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:33:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:33:07.748 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T18:33:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T18:33:07.750 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T18:33:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:33:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:33:07.753 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T18:33:07.754 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T18:33:07.755 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T18:33:07.755 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T18:33:07.755 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T18:33:07.755 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T18:33:07.755 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T18:33:07.755 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T18:33:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T18:33:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T18:33:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:33:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:33:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:33:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T18:33:07.757 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T18:33:07.758 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T18:33:07.759 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T18:33:07.760 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T18:33:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T18:33:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T18:33:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T18:33:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T18:33:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T18:33:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T18:33:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T18:33:07.763 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T18:33:07.764 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T18:33:07.765 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:33:07.766 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:33:07.767 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T18:33:07.768 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:33:07.769 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:33:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:33:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:33:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:33:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:33:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:33:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:33:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:33:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:33:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:33:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:33:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:33:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:33:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:33:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T18:33:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:33:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T18:33:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T18:33:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T18:33:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:33:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:33:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:33:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T18:33:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:33:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T18:33:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:33:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:33:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T18:33:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:33:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T18:33:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:33:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T18:33:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:33:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:33:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:33:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:33:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:33:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:33:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:33:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T18:33:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:33:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T18:33:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:33:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:33:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T18:33:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T18:33:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:33:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T18:33:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T18:33:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:33:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T18:33:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:33:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T18:33:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T18:33:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:33:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:33:07.820 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:33:07.821 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:33:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:33:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T18:33:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T18:33:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:33:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T18:33:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:33:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:33:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:33:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:33:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:33:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T18:33:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:33:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:33:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:33:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:33:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:33:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:33:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:33:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T18:33:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T18:33:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T18:33:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:33:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T18:33:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:33:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:33:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:33:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:33:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:33:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:33:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:33:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:33:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:33:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:33:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:33:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:33:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:33:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:33:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:33:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:33:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:33:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:33:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T18:33:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:33:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:33:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T18:33:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:33:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:33:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:33:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:33:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:33:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:33:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:33:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T18:33:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T18:33:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:33:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T18:33:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T18:33:07.880 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.880 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.880 DEBUG:teuthology.orchestra.run.smithi081:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T18:33:07.890 INFO:teuthology.orchestra.run.smithi081.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:33:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:33:07.890 INFO:teuthology.orchestra.run.smithi081.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:33:07.891 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T18:33:07.891 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:07.892 DEBUG:teuthology.orchestra.run.smithi081:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T18:33:07.895 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi081.front.sepia.ceph.com to complete... 2024-09-13T18:33:08.553 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:33:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:33:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-13T18:33:08.783 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-09-13T18:33:08.898 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:08.910 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:08.957 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T18:33:08.966 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./ 2024-09-13T18:33:08.967 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./boot/ 2024-09-13T18:33:08.967 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:27 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:08.992 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:27 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:08.992 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:27 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postinst.d/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/postrm.d/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/preinst.d/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./etc/kernel/prerm.d/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T18:33:09.018 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:33:09.019 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T18:33:09.020 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T18:33:09.021 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:33:09.021 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:33:09.021 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T18:33:09.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:33:09.039 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:33:09.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:33:09.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:33:09.042 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:33:09.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:33:09.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:33:09.045 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:33:09.046 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T18:33:09.047 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T18:33:09.048 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:33:09.049 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:33:09.049 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:33:09.106 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:33:09.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:33:09.108 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T18:33:09.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T18:33:09.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T18:33:09.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:33:09.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T18:33:09.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T18:33:09.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T18:33:09.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T18:33:09.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:33:09.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T18:33:09.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:33:09.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:33:09.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T18:33:09.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:33:09.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:33:09.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:33:09.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T18:33:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:33:09.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:33:09.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:33:09.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:33:09.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:33:09.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:33:09.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T18:33:09.132 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:33:09.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:33:09.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T18:33:09.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:33:09.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T18:33:09.137 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:33:09.138 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T18:33:09.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T18:33:09.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T18:33:09.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:33:09.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T18:33:09.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T18:33:09.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T18:33:09.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:33:09.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:33:09.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T18:33:09.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T18:33:09.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T18:33:09.150 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T18:33:09.151 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:33:09.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:33:09.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:33:09.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T18:33:09.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:33:09.156 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T18:33:09.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T18:33:09.195 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T18:33:09.196 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T18:33:09.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T18:33:09.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T18:33:09.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:33:09.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T18:33:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:33:09.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T18:33:09.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:33:09.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:33:09.205 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:33:09.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T18:33:09.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:33:09.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:33:09.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:33:09.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:33:09.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T18:33:09.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T18:33:09.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:33:09.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:33:09.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T18:33:09.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T18:33:09.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:33:09.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:33:09.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:33:09.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:33:09.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T18:33:09.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:33:09.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T18:33:09.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:33:09.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T18:33:09.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T18:33:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T18:33:09.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T18:33:09.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:33:09.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:33:09.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:33:09.266 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:33:09.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:33:09.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T18:33:09.269 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T18:33:09.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:33:09.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:33:09.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T18:33:09.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T18:33:09.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T18:33:09.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T18:33:09.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:33:09.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:33:09.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:33:09.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T18:33:09.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:33:09.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:33:09.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:33:09.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:33:09.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:33:09.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T18:33:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T18:33:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T18:33:09.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:33:09.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T18:33:09.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:33:09.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T18:33:09.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:33:09.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:33:09.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T18:33:09.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T18:33:09.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T18:33:09.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T18:33:09.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:33:09.308 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T18:33:09.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:33:09.308 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T18:33:09.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T18:33:09.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:33:09.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:33:09.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:33:09.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:33:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:33:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T18:33:09.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:33:09.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T18:33:09.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:33:09.325 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T18:33:09.325 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T18:33:09.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T18:33:09.325 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T18:33:09.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T18:33:09.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:33:09.326 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T18:33:09.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:33:09.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:33:09.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:33:09.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:33:09.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T18:33:09.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:33:09.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:33:09.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:33:09.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:33:09.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:33:09.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:33:09.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:33:09.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:33:09.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:33:09.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:33:09.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:33:09.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:33:09.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:33:09.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:33:09.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:33:09.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:33:09.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:33:09.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:33:09.377 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:33:09.378 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:33:09.379 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:33:09.380 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T18:33:09.381 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T18:33:09.382 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T18:33:09.383 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:33:09.384 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:33:09.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T18:33:09.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:33:09.387 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:33:09.387 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T18:33:09.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:33:09.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 210 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 879 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:27 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/ 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/ 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/ 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 175 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T18:33:09.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 691 2024-09-06 14:27 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T18:33:09.398 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:09.398 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:09.398 DEBUG:teuthology.orchestra.run.smithi178:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T18:33:09.405 INFO:teuthology.orchestra.run.smithi178.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:33:09.405 INFO:teuthology.orchestra.run.smithi178.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:33:09.405 INFO:teuthology.orchestra.run.smithi178.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2024-09-13T18:33:09.405 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T18:33:09.405 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:09.405 DEBUG:teuthology.orchestra.run.smithi178:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T18:33:09.407 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi178.front.sepia.ceph.com to complete... 2024-09-13T18:33:10.107 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2024-09-13T18:33:10.116 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T18:33:10.124 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-13T18:33:10.127 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-09-13T18:33:10.385 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:10.397 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:33:10.756 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T18:33:10.767 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T18:33:11.498 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-09-13T18:33:41.253 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T18:33:41.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T18:33:41.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:33:42.610 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T18:33:42.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-13T18:33:42.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:34:15.742 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-13T18:34:17.281 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-13T18:34:24.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T18:34:24.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:34:26.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-13T18:34:26.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:34:29.377 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-13T18:34:41.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-13T18:34:41.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:34:56.605 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-13T18:34:57.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T18:34:57.656 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:34:57.657 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-13T18:34:57.714 INFO:teuthology.orchestra.run.smithi081.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:34:57.715 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:34:57.715 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:34:57.715 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:34:58.716 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:13.223 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-13T18:35:13.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-13T18:35:13.965 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:35:13.966 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-13T18:35:14.025 INFO:teuthology.orchestra.run.smithi178.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:35:14.029 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:35:14.029 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:35:14.029 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T18:35:15.031 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:15.032 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:35:15.038 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:35:15.038 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:35:15.044 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:35:15.063 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:35:15.069 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:35:15.075 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:35:15.076 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:35:15.105 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:35:15.141 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:35:15.150 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:35:15.151 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:35:15.169 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:35:15.288 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:35:15.308 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:35:15.321 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:35:15.339 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:35:15.344 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:35:15.352 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:35:15.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:35:15.356 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:35:15.393 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:35:15.402 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:35:15.403 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:35:15.433 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:35:15.453 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:35:15.506 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:35:15.565 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:35:15.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:35:15.650 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:35:15.669 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:35:15.733 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:35:15.733 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:35:15.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-13T18:35:15.827 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-09-13T18:35:15.994 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:35:16.001 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:35:16.001 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:35:16.012 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:35:16.021 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-09-13T18:35:16.021 DEBUG:teuthology.task.selinux:Excluding smithi178: OS 'ubuntu' does not support SELinux 2024-09-13T18:35:16.021 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:35:16.021 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T18:35:16.021 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:35:16.021 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:35:16.030 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T18:35:16.033 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T18:35:16.225 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:35:16.241 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:35:16.243 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:42:32.199 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-09-13T18:42:32.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T18:42:32.202 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:42:32.329 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-13T18:42:32.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-13T18:42:32.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-13T18:42:32.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:42:32.682 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-13T18:42:32.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-13T18:42:32.905 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:42:32.915 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:42:32.916 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:42:32.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:42:32.922 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:42:32.922 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:42:32.991 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:42:32.992 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Command line: ntpd -gq 2024-09-13T18:42:32.993 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: proto: precision = 0.051 usec (-24) 2024-09-13T18:42:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:42:32.994 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:42:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:42:32.995 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:42:32.995 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:42:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:42:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:42:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-09-13T18:42:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listen normally on 4 lo [::1]:123 2024-09-13T18:42:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-09-13T18:42:32.996 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:32 ntpd[13671]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:42:33.019 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:42:33.020 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Command line: ntpd -gq 2024-09-13T18:42:33.021 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: proto: precision = 0.076 usec (-24) 2024-09-13T18:42:33.021 INFO:teuthology.orchestra.run.smithi178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:42:33.022 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:42:33.022 INFO:teuthology.orchestra.run.smithi178.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:42:33.023 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:42:33.023 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:42:33.023 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:42:33.023 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:42:33.023 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listen normally on 3 enp3s0f1 172.21.15.178:123 2024-09-13T18:42:33.024 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listen normally on 4 lo [::1]:123 2024-09-13T18:42:33.024 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ef9%5]:123 2024-09-13T18:42:33.024 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:33 ntpd[13668]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:42:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:33.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:33.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:33 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:34.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:34 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:34.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:34 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:34.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:34 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:34.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:34 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:34.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:34 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:34.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:34 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:35.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:35.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:35 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:35 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:36.020 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:36 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:36.020 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:36 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:36.992 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:36 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:36 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:36 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:36 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:36 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:36.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:36 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:37.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:37.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:37 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:37 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:38.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:38 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:38.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:38 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:38.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:38 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:38.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:38 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:38.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:38 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:38.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:38 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:38 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:38 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:38 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:38 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:38 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:38 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:39.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:39.023 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:39 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout:13 Sep 18:42:39 ntpd[13671]: ntpd: time slew +0.004123 s 2024-09-13T18:42:39.994 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew +0.004123s 2024-09-13T18:42:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:42:39.995 INFO:teuthology.orchestra.run.smithi081.stderr:13 Sep 18:42:39 ntpd[13671]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:42:40.020 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:40 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:40.020 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:40 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:40.020 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:40 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:40.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:40 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:40.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:40 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:40.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:40 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:40.140 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:42:40.140 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-13T18:42:40.140 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:40.141 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:40.141 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:40.141 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:42:41.021 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:42:41.022 INFO:teuthology.orchestra.run.smithi178.stdout:13 Sep 18:42:41 ntpd[13668]: ntpd: time slew +0.000606 s 2024-09-13T18:42:41.022 INFO:teuthology.orchestra.run.smithi178.stdout:ntpd: time slew +0.000606s 2024-09-13T18:42:41.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:42:41.022 INFO:teuthology.orchestra.run.smithi178.stderr:13 Sep 18:42:41 ntpd[13668]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:42:41.173 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:42:41.174 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-09-13T18:42:41.174 INFO:teuthology.orchestra.run.smithi178.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:41.174 INFO:teuthology.orchestra.run.smithi178.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:41.174 INFO:teuthology.orchestra.run.smithi178.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:41.174 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:42:41.175 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:42:41.183 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:42:41.183 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:42:41.183 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:42:41.184 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:42:41.190 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:42:41.190 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:42:41.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-09-13T18:42:41.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-key list | grep Ceph 2024-09-13T18:42:41.406 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:42:41.422 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:42:41.534 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:42:41.535 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:42:41.536 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:42:41.537 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:42:41.537 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:42:41.562 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:42:41.562 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:42:41.564 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:42:41.564 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:42:41.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:42:41.705 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:42:41.705 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:42:41.721 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:42:41.721 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:42:41.829 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:42:41.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:42:41.841 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:42:41.841 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:42:41.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-13T18:42:41.873 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-09-13T18:42:42.132 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:42:42.133 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:42:42.147 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:42:42.159 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:42:42.159 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:42:42.159 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:42:42.175 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:42:42.181 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:42:42.203 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:42:42.209 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:42:42.226 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:42:42.231 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:42:42.241 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:42:42.248 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:42:42.255 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:42:42.276 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:42:42.292 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:42:42.322 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:42:43.515 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.7 kB in 1s (21.9 kB/s) 2024-09-13T18:42:43.516 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 28.7 kB in 1s (22.3 kB/s) 2024-09-13T18:42:44.808 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T18:42:44.820 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-13T18:42:44.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:42:44.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:42:44.968 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T18:42:44.978 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-13T18:42:45.183 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-13T18:42:45.183 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-13T18:42:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-09-13T18:42:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-13T18:42:45.394 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-09-13T18:42:45.405 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:42:45.406 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:42:45.406 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:42:45.406 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-09-13T18:42:45.406 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:42:45.407 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:42:45.407 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:42:45.407 INFO:teuthology.orchestra.run.smithi178.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:42:45.407 INFO:teuthology.orchestra.run.smithi178.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:42:45.408 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:42:45.409 INFO:teuthology.orchestra.run.smithi178.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2024-09-13T18:42:45.410 INFO:teuthology.orchestra.run.smithi178.stdout: btrfs-tools 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:42:45.609 INFO:teuthology.orchestra.run.smithi081.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:42:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:42:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:42:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:42:45.610 INFO:teuthology.orchestra.run.smithi081.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:42:45.611 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:42:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:42:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:42:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:42:45.612 INFO:teuthology.orchestra.run.smithi081.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:42:45.612 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-13T18:42:45.613 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 librbd1 2024-09-13T18:42:45.614 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-09-13T18:42:45.614 INFO:teuthology.orchestra.run.smithi178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:42:45.614 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:42:45.614 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:42:45.614 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:42:45.615 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:42:45.615 INFO:teuthology.orchestra.run.smithi178.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:42:45.615 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:42:45.615 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:42:45.616 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:42:45.617 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2024-09-13T18:42:45.618 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 librbd1 2024-09-13T18:42:45.702 INFO:teuthology.orchestra.run.smithi081.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T18:42:45.702 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 200 MB of archives. 2024-09-13T18:42:45.702 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:42:45.703 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:42:45.722 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:42:45.729 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:42:45.755 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:42:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:2 upgraded, 116 newly installed, 0 to remove and 298 not upgraded. 2024-09-13T18:42:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 200 MB of archives. 2024-09-13T18:42:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:42:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:42:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:42:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:42:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:42:45.897 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:42:45.898 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:42:45.900 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:42:45.901 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:42:45.914 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:42:45.922 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:42:45.922 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:42:45.923 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:42:45.924 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:42:45.924 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:42:45.925 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:42:45.932 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:42:45.933 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:42:45.936 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:42:45.937 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:42:45.949 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:42:45.951 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:42:45.952 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:42:45.953 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:42:45.953 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:42:45.955 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:42:45.958 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:42:45.966 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:42:45.968 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:42:45.970 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:42:45.970 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:42:45.980 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:42:45.983 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:42:45.986 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:42:45.989 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:42:45.990 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:42:45.991 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:42:46.007 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:42:46.084 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:42:46.089 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:42:46.095 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:42:46.110 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:42:46.111 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:42:46.120 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:42:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:42:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:42:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:42:46.126 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:42:46.126 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:42:46.128 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:42:46.128 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:42:46.129 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:42:46.129 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:42:46.138 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:42:46.138 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:42:46.142 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:42:46.143 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:42:46.144 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:42:46.145 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:42:46.148 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:42:46.151 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:42:46.153 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:42:46.161 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:42:46.162 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:42:46.163 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:42:46.168 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:42:46.169 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:42:46.170 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:42:46.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:42:46.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:42:46.174 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:42:46.176 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:42:46.183 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:42:46.195 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:42:46.199 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:42:46.202 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:42:46.214 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:42:46.230 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:42:46.249 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:42:46.250 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:42:46.250 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:42:46.252 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:42:46.266 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:42:46.267 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:42:46.268 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:42:46.268 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:42:46.269 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:42:46.291 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:42:46.379 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:42:46.380 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:42:46.385 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:42:46.415 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:42:46.417 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:42:46.424 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:42:46.488 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:42:46.496 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:42:46.522 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:42:46.531 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:42:46.531 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:42:46.535 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:42:46.536 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:42:46.550 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:42:46.551 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:42:46.571 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:42:46.637 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:42:46.637 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:42:46.638 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:42:46.639 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:42:46.640 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:42:46.640 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:42:46.642 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:42:46.643 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:42:46.654 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:42:46.734 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:42:46.735 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:42:46.745 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:42:46.745 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:42:46.747 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:42:46.747 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:42:46.748 INFO:teuthology.orchestra.run.smithi178.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:42:46.751 INFO:teuthology.orchestra.run.smithi178.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:42:46.816 INFO:teuthology.orchestra.run.smithi178.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:42:46.821 INFO:teuthology.orchestra.run.smithi178.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:42:46.898 INFO:teuthology.orchestra.run.smithi178.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:42:46.902 INFO:teuthology.orchestra.run.smithi178.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:42:46.905 INFO:teuthology.orchestra.run.smithi178.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:42:46.906 INFO:teuthology.orchestra.run.smithi178.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:42:46.907 INFO:teuthology.orchestra.run.smithi178.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:42:46.908 INFO:teuthology.orchestra.run.smithi178.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:42:46.911 INFO:teuthology.orchestra.run.smithi178.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:42:46.911 INFO:teuthology.orchestra.run.smithi178.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:42:46.979 INFO:teuthology.orchestra.run.smithi178.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:42:46.982 INFO:teuthology.orchestra.run.smithi178.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:42:47.061 INFO:teuthology.orchestra.run.smithi178.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:42:47.063 INFO:teuthology.orchestra.run.smithi178.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:42:47.065 INFO:teuthology.orchestra.run.smithi178.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:42:47.067 INFO:teuthology.orchestra.run.smithi178.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:42:47.068 INFO:teuthology.orchestra.run.smithi178.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:42:47.068 INFO:teuthology.orchestra.run.smithi178.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:42:47.240 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:42:47.251 INFO:teuthology.orchestra.run.smithi178.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:42:47.401 INFO:teuthology.orchestra.run.smithi178.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:42:47.423 INFO:teuthology.orchestra.run.smithi178.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:42:47.425 INFO:teuthology.orchestra.run.smithi178.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:42:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:42:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:42:47.500 INFO:teuthology.orchestra.run.smithi178.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:42:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:42:47.501 INFO:teuthology.orchestra.run.smithi178.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:42:47.502 INFO:teuthology.orchestra.run.smithi178.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:42:47.503 INFO:teuthology.orchestra.run.smithi178.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:42:47.540 INFO:teuthology.orchestra.run.smithi178.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:42:47.543 INFO:teuthology.orchestra.run.smithi178.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:42:47.561 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:42:47.562 INFO:teuthology.orchestra.run.smithi178.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:42:47.565 INFO:teuthology.orchestra.run.smithi178.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:42:47.567 INFO:teuthology.orchestra.run.smithi178.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:42:47.570 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:42:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:42:47.611 INFO:teuthology.orchestra.run.smithi178.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:42:47.638 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:42:47.647 INFO:teuthology.orchestra.run.smithi178.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:42:47.653 INFO:teuthology.orchestra.run.smithi178.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:42:47.658 INFO:teuthology.orchestra.run.smithi178.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:42:47.663 INFO:teuthology.orchestra.run.smithi178.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:42:47.665 INFO:teuthology.orchestra.run.smithi178.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:42:47.669 INFO:teuthology.orchestra.run.smithi178.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:42:47.673 INFO:teuthology.orchestra.run.smithi178.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:42:47.673 INFO:teuthology.orchestra.run.smithi178.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:42:47.736 INFO:teuthology.orchestra.run.smithi178.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:42:47.739 INFO:teuthology.orchestra.run.smithi178.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:42:47.810 INFO:teuthology.orchestra.run.smithi178.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:42:47.829 INFO:teuthology.orchestra.run.smithi178.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:42:47.863 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:42:47.978 INFO:teuthology.orchestra.run.smithi178.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:42:47.979 INFO:teuthology.orchestra.run.smithi178.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:42:47.979 INFO:teuthology.orchestra.run.smithi178.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:42:47.980 INFO:teuthology.orchestra.run.smithi178.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:42:47.994 INFO:teuthology.orchestra.run.smithi178.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:42:47.995 INFO:teuthology.orchestra.run.smithi178.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:42:47.996 INFO:teuthology.orchestra.run.smithi178.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:42:47.997 INFO:teuthology.orchestra.run.smithi178.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:42:47.997 INFO:teuthology.orchestra.run.smithi178.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:42:48.620 INFO:teuthology.orchestra.run.smithi178.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:42:48.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:42:48.630 INFO:teuthology.orchestra.run.smithi178.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:42:48.699 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:42:48.699 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:42:48.707 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:42:48.716 INFO:teuthology.orchestra.run.smithi178.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:42:48.723 INFO:teuthology.orchestra.run.smithi178.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:42:48.725 INFO:teuthology.orchestra.run.smithi178.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:42:48.793 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:42:48.798 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:42:48.800 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:42:48.943 INFO:teuthology.orchestra.run.smithi178.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:42:49.029 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:42:49.212 INFO:teuthology.orchestra.run.smithi178.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:42:49.212 INFO:teuthology.orchestra.run.smithi178.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:42:49.302 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:42:49.302 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:42:50.723 INFO:teuthology.orchestra.run.smithi178.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:42:50.724 INFO:teuthology.orchestra.run.smithi178.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:42:50.744 INFO:teuthology.orchestra.run.smithi178.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:42:50.745 INFO:teuthology.orchestra.run.smithi178.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:42:50.746 INFO:teuthology.orchestra.run.smithi178.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:42:50.748 INFO:teuthology.orchestra.run.smithi178.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:42:50.876 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:42:50.877 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:42:50.879 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:42:50.880 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:42:50.880 INFO:teuthology.orchestra.run.smithi081.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:42:50.881 INFO:teuthology.orchestra.run.smithi081.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:42:51.172 INFO:teuthology.orchestra.run.smithi178.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:42:51.253 INFO:teuthology.orchestra.run.smithi081.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:42:52.133 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 200 MB in 6s (36.0 MB/s) 2024-09-13T18:42:52.196 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 200 MB in 6s (35.4 MB/s) 2024-09-13T18:42:52.287 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:42:52.352 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T18:42:52.355 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:42:52.363 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:42:52.430 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107754 files and directories currently installed.) 2024-09-13T18:42:52.432 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:42:52.434 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:42:52.477 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:42:52.753 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:42:52.774 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:42:52.805 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:42:52.823 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:42:52.827 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:42:52.863 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:42:53.205 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:42:53.223 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:42:53.224 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:42:53.242 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:42:53.263 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:42:53.274 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:42:53.632 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:42:53.652 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:42:53.685 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:42:53.704 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:42:53.732 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:42:53.785 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:42:54.128 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:42:54.146 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:42:54.155 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:42:54.175 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:42:54.211 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:42:54.213 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:42:54.597 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:42:54.600 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:42:54.615 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:42:54.619 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:42:54.650 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:42:54.655 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:42:55.092 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:42:55.111 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:42:55.171 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:55.212 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:42:55.230 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:42:55.291 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:55.745 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:42:55.764 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:42:55.803 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:55.815 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:42:55.834 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:42:55.873 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:56.301 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:42:56.319 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:42:56.359 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:42:56.704 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:42:56.744 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:42:56.779 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:42:56.799 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:42:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:42:57.143 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:57.250 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:57.281 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:42:57.365 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:42:58.020 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:58.125 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:58.177 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:42:58.253 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:42:58.989 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:42:59.011 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:59.055 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:59.282 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:42:59.302 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:59.340 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:59.528 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:42:59.540 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:59.716 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:42:59.718 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:42:59.735 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:42:59.776 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:00.094 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:43:00.112 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:00.152 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:00.171 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:43:00.190 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:00.229 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:43:00.468 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:00.505 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:00.515 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:43:00.538 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:00.606 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:00.891 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:43:00.909 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:00.959 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:43:00.965 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:00.981 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:01.050 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:43:01.362 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:43:01.412 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:43:01.423 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:43:01.430 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:43:01.503 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:43:01.718 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:01.796 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:01.798 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:43:01.815 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:01.856 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:02.183 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:43:02.200 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:43:02.240 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:43:02.242 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:43:02.260 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:43:02.292 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:43:02.619 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:43:02.676 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:43:02.678 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:43:02.698 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:43:02.736 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:43:03.063 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:43:03.081 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:43:03.081 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:43:03.099 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:43:03.121 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:43:03.139 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:43:03.499 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:43:03.516 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:03.567 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:43:03.573 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:03.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:03.625 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:04.468 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:43:04.487 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:04.526 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:04.545 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:43:04.566 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:04.636 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:04.929 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:43:04.949 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:43:05.006 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:43:05.012 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:43:05.023 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:43:05.089 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:43:05.364 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:43:05.384 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:05.417 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:43:05.423 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:05.435 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:05.507 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:05.951 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:43:05.969 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:06.012 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:43:06.031 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:06.043 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:06.069 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:08.575 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:43:08.594 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:08.648 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:43:08.670 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:08.678 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:08.736 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:10.196 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:43:10.214 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:43:10.254 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:43:10.367 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:43:10.449 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:43:10.672 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:43:10.690 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:43:10.730 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:43:10.844 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:43:10.862 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:43:10.902 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:43:11.109 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:43:11.127 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:43:11.167 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:43:11.272 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:43:11.290 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:43:11.330 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:43:11.537 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:43:11.555 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:43:11.595 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:43:11.701 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:43:11.719 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:43:11.758 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:43:11.939 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:43:11.959 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:43:11.997 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:43:12.111 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:43:12.124 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:43:12.195 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:43:12.393 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:43:12.405 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:43:12.444 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:43:12.589 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:43:12.609 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:43:12.647 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:43:12.770 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:43:12.784 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:43:12.828 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:43:12.984 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:43:13.003 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:43:13.042 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:43:13.156 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:43:13.173 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:43:13.214 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:43:13.395 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:43:13.415 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:43:13.453 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:43:13.601 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:43:13.620 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:43:13.659 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:43:13.843 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:43:13.861 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:43:13.901 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:43:14.033 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:43:14.051 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:43:14.092 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:43:14.262 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:43:14.278 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:43:14.336 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:43:14.546 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:43:14.563 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:43:14.611 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:43:14.739 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:43:14.752 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:43:14.803 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:43:15.006 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:43:15.064 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:43:15.425 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:43:15.438 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:43:15.484 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:43:15.870 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:43:15.892 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:43:15.937 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:43:15.959 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:43:15.977 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:43:16.017 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:43:16.298 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:43:16.314 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:43:16.356 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:43:16.362 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:43:16.381 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:43:16.419 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:43:16.718 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:43:16.735 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:43:16.776 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:43:16.807 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:43:16.829 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:43:16.873 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:43:17.104 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:43:17.125 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:43:17.187 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:43:17.218 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:43:17.237 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:43:17.276 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:43:17.609 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:43:17.631 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:43:17.645 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:43:17.664 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:43:17.675 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:43:17.720 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:43:17.979 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:43:17.999 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:18.070 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:18.073 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:43:18.092 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:43:18.123 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:43:18.508 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:43:18.527 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:18.528 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:43:18.549 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:43:18.566 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:18.594 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:43:18.945 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:43:18.964 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:43:18.964 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:43:18.986 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:19.002 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:43:19.030 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:19.347 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:43:19.366 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:43:19.422 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:43:19.494 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:43:19.512 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:19.552 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:19.913 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:43:19.929 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:43:19.970 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:43:20.341 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:43:20.360 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:43:20.399 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:43:20.723 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:43:20.735 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:43:20.767 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:43:20.828 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:43:20.846 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:43:20.919 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:43:21.154 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:43:21.171 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:21.211 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:43:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:21.372 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:21.765 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:43:21.784 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:21.823 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:21.961 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:43:21.980 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:22.026 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:22.811 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:43:22.835 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:22.877 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:23.055 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:43:23.072 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:23.112 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:24.964 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-09-13T18:43:24.983 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:25.022 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:25.191 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph. 2024-09-13T18:43:25.211 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:25.249 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:25.425 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:43:25.443 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:25.483 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:25.618 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:43:25.639 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:25.684 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:25.953 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:43:25.975 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:26.019 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:26.213 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:43:26.234 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:26.279 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:26.606 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:43:26.624 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:26.664 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:26.849 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:43:26.867 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:26.932 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:27.025 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:43:27.044 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:43:27.083 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:43:27.276 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:43:27.295 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:43:27.326 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:43:27.495 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:43:27.535 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:43:27.762 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:43:27.780 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:43:27.820 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:43:27.931 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:43:27.951 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:27.989 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:28.215 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:43:28.232 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:28.281 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:28.384 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:43:28.403 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:43:28.441 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:43:28.693 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:43:28.710 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:43:28.751 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:43:28.820 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:43:28.842 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:43:28.886 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:43:29.112 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:43:29.131 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:43:29.170 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:43:29.265 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:43:29.283 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:43:29.322 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:43:29.548 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:43:29.568 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:43:29.615 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:43:29.701 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:43:29.719 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:43:29.758 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:43:29.968 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:43:29.988 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:43:30.025 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:43:30.154 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:43:30.174 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:43:30.211 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:43:30.387 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:43:30.738 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:43:30.738 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:43:30.738 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:43:30.738 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:43:30.738 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:43:30.833 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:43:30.853 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:43:30.891 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:43:31.001 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:43:31.022 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:43:31.067 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:43:31.227 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:43:31.245 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:43:31.285 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:43:31.446 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:43:31.464 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:43:31.504 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:43:31.697 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:43:31.718 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:43:31.763 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:43:31.799 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:43:31.818 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:43:31.857 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:43:32.099 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:43:32.117 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:43:32.176 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:43:32.195 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:43:32.202 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:43:32.234 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:43:32.502 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:43:32.520 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:43:32.577 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:43:32.596 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:43:32.615 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:43:32.653 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:43:32.955 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:43:32.973 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:43:33.012 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:43:33.066 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:43:33.084 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:33.124 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:33.383 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:43:33.401 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:33.440 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:34.563 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:43:34.583 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:43:34.624 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:43:34.942 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:43:34.960 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:43:34.961 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:43:34.980 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:43:34.999 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:43:35.019 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:43:35.336 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:43:35.353 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:43:35.372 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:43:35.392 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:43:35.418 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:43:35.429 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:43:35.779 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:43:35.798 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:43:35.837 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:43:36.914 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:43:36.935 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:43:36.980 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:43:37.275 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:43:37.294 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:43:37.332 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:43:37.610 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:43:37.625 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:43:37.668 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:43:37.941 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:43:37.959 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:43:37.999 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:43:38.088 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:43:38.110 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:43:38.154 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:43:38.411 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:43:38.431 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:43:38.469 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:43:38.925 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:43:38.944 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:38.975 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:39.348 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:43:39.368 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:39.406 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:40.222 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:43:40.239 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:43:40.280 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:43:40.626 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:43:40.644 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:43:40.684 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:43:41.051 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:43:41.064 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:43:41.101 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:43:41.432 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:43:41.453 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:43:41.498 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:43:41.505 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:43:41.523 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:43:41.562 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:43:41.886 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:43:41.905 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:43:41.943 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:43:41.949 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:43:41.968 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:43:42.007 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:43:42.306 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:43:42.325 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:43:42.363 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:43:42.369 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:43:42.387 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:43:42.427 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:43:42.776 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:43:42.794 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:43:42.830 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:43:42.848 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:43:42.867 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:43:42.888 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:43:43.233 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:43:43.246 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:43:43.254 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:43:43.264 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:43:43.299 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:43:43.303 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:43:43.649 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:43:43.669 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:43:43.703 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:43:43.707 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:43:43.722 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:43:43.761 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:43:44.130 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:43:44.131 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:43:44.149 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:43:44.151 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:43:44.189 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:43:44.189 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:43:44.567 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:43:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:43:44.588 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:43:44.589 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:43:44.628 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:43:44.658 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:43:45.046 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:43:45.065 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:43:45.103 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:43:45.292 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:43:45.313 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:45.350 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:45.739 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:43:45.752 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:43:45.779 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:43:45.797 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:43:45.798 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:45.837 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:46.201 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:43:46.220 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:43:46.224 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:43:46.241 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:43:46.258 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:43:46.281 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:43:46.570 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-09-13T18:43:46.590 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:43:46.653 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:43:46.679 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:43:46.700 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:43:46.745 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:43:46.932 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-09-13T18:43:46.946 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:43:46.990 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:43:47.076 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package jq. 2024-09-13T18:43:47.093 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:43:47.175 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:43:47.345 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:43:47.367 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:43:47.410 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:43:47.443 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package socat. 2024-09-13T18:43:47.463 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:43:47.542 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:43:47.832 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:43:47.854 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:47.897 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:43:47.897 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:47.916 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:43:47.954 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:43:48.384 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:43:48.404 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:48.442 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:51.911 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:43:51.928 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:51.960 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:52.413 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:43:52.414 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:43:52.433 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:52.436 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:52.471 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:52.481 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:52.870 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:43:52.884 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:43:52.889 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:43:52.903 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:52.927 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:43:52.950 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:53.264 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:43:53.287 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:53.329 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:43:53.329 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:53.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:43:53.395 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:43:53.650 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:43:53.671 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:53.715 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:53.723 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:43:53.745 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:53.789 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:54.027 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:43:54.050 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:43:54.092 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:43:54.093 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:43:54.112 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:43:54.150 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:54.454 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:43:54.474 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:43:54.520 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:43:54.639 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:43:54.659 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:54.705 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:55.091 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:43:55.109 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:43:55.148 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:43:55.149 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:43:55.163 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:43:55.241 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:43:55.577 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:43:55.597 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:43:55.597 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:43:55.619 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:43:55.663 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:43:55.670 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:43:56.024 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:43:56.044 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:43:56.115 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:43:56.124 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:43:56.145 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:43:56.199 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:43:56.569 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:43:56.590 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:43:56.635 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:43:58.318 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:43:58.340 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:43:58.384 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:43:58.659 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:43:58.679 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:43:58.716 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:43:58.779 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:43:59.085 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:43:59.085 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:43:59.120 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:43:59.138 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:43:59.177 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:43:59.189 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:43:59.204 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:43:59.248 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:43:59.548 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:43:59.566 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:43:59.605 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:43:59.676 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:43:59.696 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:43:59.734 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:44:00.034 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:44:00.057 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:44:00.100 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:44:00.251 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:44:00.273 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:44:00.320 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:44:00.621 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:44:00.641 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:44:00.658 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:44:00.676 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:44:00.678 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:44:00.740 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:44:01.091 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:44:01.112 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:44:01.118 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:44:01.135 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:44:01.157 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:44:01.193 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:44:01.521 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:44:01.527 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:44:01.540 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:44:01.545 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:44:01.584 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:44:01.604 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:44:01.924 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:44:01.944 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:44:01.963 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:44:01.978 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:44:01.990 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:44:02.021 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:44:02.349 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:44:02.369 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:44:02.407 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:44:02.719 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:44:02.738 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:44:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:03.220 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:44:03.241 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:44:03.285 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:04.151 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:44:04.169 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:44:04.213 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:04.615 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:44:04.673 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:44:04.693 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:44:04.752 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:04.968 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:44:05.097 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:44:05.132 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:44:05.229 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:44:05.480 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:05.503 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:44:05.631 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:44:05.757 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:44:06.008 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:06.123 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-09-13T18:44:06.486 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:44:06.612 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:44:06.661 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user cephadm....done 2024-09-13T18:44:07.039 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:44:07.047 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:44:07.173 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:44:07.390 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:44:07.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:44:07.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:44:07.659 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:44:08.035 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:44:08.077 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:44:08.161 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:44:08.287 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:44:08.604 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:44:08.739 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:44:08.956 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:44:09.232 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:44:09.373 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:44:09.566 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:44:09.750 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:44:09.893 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:44:10.101 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:44:10.235 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:44:10.460 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:10.587 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:44:10.836 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:44:10.954 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:10.962 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:44:11.339 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:44:11.465 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:44:11.638 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:44:11.874 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:44:12.039 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:44:12.390 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:44:12.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:44:12.642 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:44:13.001 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:44:13.009 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:44:13.135 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:44:13.386 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:44:13.595 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:44:13.737 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:44:13.963 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:44:14.154 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:44:14.355 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:44:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:44:14.815 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:44:14.923 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:44:15.166 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:44:15.316 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:44:15.584 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:44:15.684 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:44:15.843 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:44:15.943 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:44:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:44:16.311 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:44:16.329 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:44:16.437 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:44:16.596 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:44:16.805 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:44:16.956 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:44:17.190 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:44:17.432 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:44:17.625 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:44:17.791 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:44:18.076 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:44:18.202 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:18.235 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:44:18.596 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:44:18.711 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:44:18.738 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:44:18.854 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:19.181 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:44:19.247 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:44:19.341 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:44:19.431 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:44:19.467 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:44:19.826 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:44:19.849 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:44:19.975 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:44:20.134 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:44:20.228 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:44:20.354 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:44:20.479 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:44:20.486 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:44:20.870 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:44:20.881 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:44:21.005 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:44:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:44:21.215 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:44:21.557 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:44:21.591 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:44:21.717 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:44:21.900 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:44:22.069 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:44:22.251 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:44:22.377 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:44:22.428 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:44:22.728 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:44:22.812 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:44:23.096 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:44:23.264 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:44:23.464 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:44:23.582 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:44:23.708 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:44:23.930 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:44:24.117 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:44:24.249 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:44:24.425 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:44:24.527 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:44:24.662 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:44:24.818 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:44:24.821 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:44:25.230 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:44:25.253 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:44:25.421 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:44:25.538 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:44:25.631 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:44:25.939 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:44:26.290 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:44:27.421 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:44:27.546 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:44:27.998 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:44:28.071 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:44:28.222 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:44:28.366 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:44:28.690 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:44:28.750 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:44:28.876 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:44:29.058 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:44:29.294 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:44:29.417 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:44:29.543 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:44:29.688 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:44:29.986 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:44:30.155 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:44:30.405 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:44:30.548 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:44:30.856 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:44:31.266 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:44:31.804 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:44:31.988 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:44:32.114 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:44:32.240 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:44:32.625 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:44:32.776 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:44:32.857 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:44:32.983 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:44:33.109 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:44:33.144 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:44:33.260 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:44:33.528 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:44:33.645 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:44:33.771 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:44:33.930 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:44:34.139 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:44:34.365 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:34.498 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:44:34.626 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:44:34.752 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:34.866 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:44:34.887 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:35.038 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:35.164 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:44:35.360 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:35.524 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:35.588 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:44:35.650 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:44:35.739 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:35.881 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:36.010 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:36.041 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:36.136 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:36.167 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:44:36.262 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:36.543 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:44:36.563 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:44:36.669 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:44:37.088 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:37.214 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:37.339 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:37.372 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:37.498 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:37.624 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:37.636 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:44:37.636 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:44:37.783 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:44:38.524 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:38.650 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:38.776 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:38.906 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:38.935 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:44:39.057 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:39.183 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:39.300 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:39.426 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:39.586 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.098 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.199 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-09-13T18:44:40.249 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.375 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.500 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.651 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.671 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-09-13T18:44:40.786 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:40.877 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-09-13T18:44:40.908 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:44:41.121 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:44:41.423 INFO:teuthology.orchestra.run.smithi178.stdout:Adding group ceph....done 2024-09-13T18:44:41.674 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:44:41.895 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user ceph....done 2024-09-13T18:44:42.118 INFO:teuthology.orchestra.run.smithi178.stdout:Setting system user ceph properties....done 2024-09-13T18:44:42.152 INFO:teuthology.orchestra.run.smithi178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:44:42.365 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:44:42.513 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:42.789 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:42.790 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:42.911 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:44:43.648 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:43.773 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:43.820 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:44.086 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:44.086 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:44:44.451 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:44.451 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:44.879 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:45.005 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:45.250 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:45.728 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:45.728 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:44:45.803 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:44:46.599 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:46.678 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:46.940 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:44:46.940 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:44:47.108 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:44:47.796 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:48.042 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:48.065 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:48.065 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:48.309 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:44:48.310 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:44:48.905 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:49.177 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:49.438 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:49.439 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:44:49.674 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:44:50.319 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:50.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:50.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:50.827 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:51.082 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:44:51.082 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:44:51.127 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:44:51.127 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:44:51.894 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:51.996 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:52.070 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:52.122 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:52.255 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:52.281 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:52.398 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:52.536 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:44:52.536 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:44:52.868 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:44:53.061 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:44:53.399 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:53.546 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:44:53.550 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:53.701 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:53.852 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:44:54.322 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:44:54.515 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:44:54.982 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:44:58.408 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:44:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:44:59.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:44:59.371 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-13T18:44:59.601 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-13T18:44:59.601 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-13T18:44:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:44:59.823 INFO:teuthology.orchestra.run.smithi081.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:44:59.824 INFO:teuthology.orchestra.run.smithi081.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:44:59.824 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:44:59.824 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:44:59.824 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:44:59.826 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:44:59.826 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:44:59.827 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-13T18:44:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:44:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:44:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:44:59.827 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:44:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:44:59.828 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-13T18:44:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:44:59.828 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:44:59.829 INFO:teuthology.orchestra.run.smithi081.stdout: libengine-pkcs11-openssl 2024-09-13T18:44:59.932 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-13T18:44:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:44:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:44:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:44:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:44:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:44:59.934 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:44:59.936 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:44:59.936 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-13T18:44:59.936 INFO:teuthology.orchestra.run.smithi081.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:45:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T18:45:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:45:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:45:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:45:00.716 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:45:00.723 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:45:00.750 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:45:00.752 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:45:00.753 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:45:00.766 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:45:00.768 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:45:00.843 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-13T18:45:00.866 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:45:00.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:45:00.875 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:45:00.879 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:45:00.880 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:45:00.913 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:45:00.914 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:45:00.918 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:45:00.918 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:45:00.994 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:45:00.995 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:45:01.028 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:45:01.031 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:45:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:45:01.047 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:45:01.069 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-09-13T18:45:01.070 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-09-13T18:45:01.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:45:01.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:45:01.125 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:45:01.159 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:45:01.215 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:45:01.222 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:45:01.223 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:45:01.223 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:45:01.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:45:01.248 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:45:01.251 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:45:01.296 INFO:teuthology.orchestra.run.smithi178.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:45:01.296 INFO:teuthology.orchestra.run.smithi178.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:45:01.296 INFO:teuthology.orchestra.run.smithi178.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:45:01.296 INFO:teuthology.orchestra.run.smithi178.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:45:01.296 INFO:teuthology.orchestra.run.smithi178.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:45:01.296 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:45:01.297 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:45:01.297 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:45:01.297 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-09-13T18:45:01.297 INFO:teuthology.orchestra.run.smithi178.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:45:01.297 INFO:teuthology.orchestra.run.smithi178.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:45:01.298 INFO:teuthology.orchestra.run.smithi178.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:45:01.298 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:45:01.298 INFO:teuthology.orchestra.run.smithi178.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:45:01.299 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-09-13T18:45:01.299 INFO:teuthology.orchestra.run.smithi178.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:45:01.300 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:45:01.300 INFO:teuthology.orchestra.run.smithi178.stdout: libengine-pkcs11-openssl 2024-09-13T18:45:01.409 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-09-13T18:45:01.410 INFO:teuthology.orchestra.run.smithi178.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:45:01.410 INFO:teuthology.orchestra.run.smithi178.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:45:01.410 INFO:teuthology.orchestra.run.smithi178.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:45:01.410 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:45:01.410 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:45:01.410 INFO:teuthology.orchestra.run.smithi178.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:45:01.411 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2024-09-13T18:45:01.412 INFO:teuthology.orchestra.run.smithi178.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:45:01.609 INFO:teuthology.orchestra.run.smithi178.stdout:6 upgraded, 31 newly installed, 0 to remove and 292 not upgraded. 2024-09-13T18:45:01.609 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:45:01.610 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:45:01.610 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:45:01.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:45:01.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:45:01.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:45:01.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:45:01.654 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:45:02.218 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2024-09-13T18:45:02.225 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:45:02.227 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:45:02.227 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:45:02.240 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:45:02.242 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:45:02.340 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:45:02.343 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:45:02.350 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:45:02.354 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:45:02.354 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:45:02.387 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:45:02.389 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:45:02.393 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:45:02.393 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:45:02.460 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 25.4 MB in 2s (14.8 MB/s) 2024-09-13T18:45:02.469 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:45:02.470 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:45:02.479 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:45:02.481 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:45:02.498 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:45:02.498 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:45:02.551 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:45:02.551 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:45:02.573 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:45:02.602 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:45:02.662 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:45:02.670 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:45:02.670 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:45:02.671 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:45:02.672 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:45:02.695 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:45:02.714 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:45:02.799 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:45:02.802 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:45:02.985 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:45:03.108 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:45:03.109 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:45:03.109 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:45:03.109 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:45:03.109 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:45:03.687 INFO:teuthology.orchestra.run.smithi178.stdout:Preconfiguring packages ... 2024-09-13T18:45:03.915 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 25.4 MB in 2s (15.0 MB/s) 2024-09-13T18:45:04.220 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:45:04.223 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:45:04.432 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:45:04.571 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:45:06.126 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:45:06.540 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:45:06.544 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:45:06.668 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:45:07.136 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:45:07.333 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:45:07.880 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:45:08.137 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:45:08.140 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:45:08.374 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:45:08.377 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:45:08.469 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:45:08.517 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:45:08.957 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:45:09.092 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:45:09.125 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:45:09.223 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:45:09.522 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:45:09.739 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:45:09.878 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:45:10.059 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 119133 files and directories currently installed.) 2024-09-13T18:45:10.062 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:45:10.200 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:45:10.440 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:45:10.461 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:45:10.498 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:45:10.733 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:45:10.872 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:45:10.893 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package dump. 2024-09-13T18:45:10.913 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:45:10.951 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:45:11.330 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package indent. 2024-09-13T18:45:11.349 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:11.388 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:45:11.438 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:45:11.568 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:45:11.767 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:45:11.787 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:45:11.825 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:45:12.180 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:45:12.201 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:45:12.228 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:45:12.238 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:45:12.248 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:45:12.286 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:45:12.556 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:45:12.576 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:45:12.606 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:12.625 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package dump. 2024-09-13T18:45:12.645 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:45:12.683 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:45:13.037 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package indent. 2024-09-13T18:45:13.059 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:13.103 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:45:13.486 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:45:13.505 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:13.544 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:13.616 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:45:13.637 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:45:13.682 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:45:13.872 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:45:13.898 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:13.938 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:14.036 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:45:14.056 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:45:14.094 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:45:14.300 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:45:14.320 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:14.358 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:14.413 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:45:14.433 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:45:14.471 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:14.794 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:45:14.813 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:45:14.852 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:45:14.875 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:45:14.897 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:14.973 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:15.223 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:45:15.241 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:45:15.280 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:15.286 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:45:15.306 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:15.352 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:15.692 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:45:15.712 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:15.722 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:45:15.741 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:15.750 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:15.780 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:16.145 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:45:16.164 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:16.203 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:16.216 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:45:16.237 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:45:16.282 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:45:16.606 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:45:16.620 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:16.663 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:45:16.664 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:16.682 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:45:16.754 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:16.967 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:45:16.988 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:45:17.033 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:45:17.165 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:45:17.186 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:17.223 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:17.626 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:45:17.628 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:45:17.646 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:17.648 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:45:17.684 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:17.686 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:45:18.079 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:45:18.098 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:18.162 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:18.199 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:45:18.217 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:18.281 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:18.456 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:45:18.480 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:45:18.531 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:45:18.955 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:45:18.974 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:45:19.014 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:45:19.077 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:45:19.097 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:45:19.134 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:45:19.593 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:45:19.596 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:45:19.613 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:45:19.618 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:45:19.686 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:19.695 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:20.434 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ppp. 2024-09-13T18:45:20.453 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:45:20.519 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:45:20.538 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:45:20.577 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:45:20.932 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:45:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:45:21.194 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:45:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:21.348 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:45:21.368 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:45:21.406 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:45:21.818 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:45:21.837 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:45:21.908 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:45:22.106 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ppp. 2024-09-13T18:45:22.130 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:45:22.271 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:45:22.291 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:45:22.329 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:45:22.633 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:45:22.667 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:45:22.684 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:22.725 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:23.053 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:45:23.067 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:45:23.110 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:45:23.364 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:45:23.384 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:45:23.473 INFO:teuthology.orchestra.run.smithi081.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:45:23.492 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:45:23.539 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:45:23.558 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:45:23.639 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:45:24.017 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:45:24.038 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:45:24.054 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:45:24.073 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:24.083 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:45:24.117 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:24.455 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:45:24.475 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:24.513 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:25.184 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:45:25.204 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:45:25.320 INFO:teuthology.orchestra.run.smithi178.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:45:25.353 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:45:25.841 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:45:25.865 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:45:25.908 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:45:25.915 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:45:25.926 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:45:26.006 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:26.193 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:45:26.212 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:45:26.276 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:45:26.553 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:45:26.570 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:45:26.611 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:45:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:45:26.953 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:45:26.998 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:45:27.426 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:45:27.445 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:45:27.522 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:45:27.552 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:45:27.570 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:45:27.610 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:45:27.908 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:45:27.921 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:45:27.940 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:45:27.978 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:45:28.140 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:45:28.273 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:45:28.296 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:45:28.339 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:45:28.508 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:28.634 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:45:28.650 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:45:28.669 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:45:28.725 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:45:28.760 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:45:28.886 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:45:29.145 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:45:29.165 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:45:29.222 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:45:29.339 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:45:29.339 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:45:29.604 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:45:29.875 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:45:30.231 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:30.252 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:30.420 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:45:30.546 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:45:30.672 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:45:31.159 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:45:32.116 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:32.240 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:45:32.362 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:45:32.520 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:45:32.664 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:45:34.082 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:45:34.341 INFO:teuthology.orchestra.run.smithi081.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:45:34.688 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:45:34.708 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:34.708 INFO:teuthology.orchestra.run.smithi081.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:45:34.814 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:45:34.932 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:45:35.171 INFO:teuthology.orchestra.run.smithi081.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:45:35.171 INFO:teuthology.orchestra.run.smithi081.stdout:Removing obsolete dictionary files: 2024-09-13T18:45:35.713 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:45:36.270 INFO:teuthology.orchestra.run.smithi178.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:45:36.610 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:36.610 INFO:teuthology.orchestra.run.smithi178.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:45:37.075 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:45:37.076 INFO:teuthology.orchestra.run.smithi178.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:45:37.076 INFO:teuthology.orchestra.run.smithi178.stdout:Removing obsolete dictionary files: 2024-09-13T18:45:37.200 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:45:37.327 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:37.486 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:45:37.602 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:45:38.746 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:45:39.008 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:45:39.133 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:45:39.142 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:45:39.243 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:45:39.318 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:39.326 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:39.445 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:45:39.453 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:45:39.578 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:45:39.746 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:45:39.933 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:45:40.059 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:40.579 INFO:teuthology.orchestra.run.smithi081.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:45:40.636 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout:This user must also own the server process. 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout:The default text search configuration will be set to "english". 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout:Data page checksums are disabled. 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi081.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi081.stdout:creating subdirectories ... ok 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi081.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:45:40.748 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default max_connections ... 100 2024-09-13T18:45:40.793 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:45:40.817 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:45:40.818 INFO:teuthology.orchestra.run.smithi081.stdout:creating configuration files ... ok 2024-09-13T18:45:40.996 INFO:teuthology.orchestra.run.smithi081.stdout:running bootstrap script ... ok 2024-09-13T18:45:41.133 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:45:41.243 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:45:41.352 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:41.478 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:45:41.603 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:45:41.612 INFO:teuthology.orchestra.run.smithi081.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:45:41.755 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:45:41.939 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:45:42.090 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:45:42.149 INFO:teuthology.orchestra.run.smithi081.stdout:syncing data to disk ... ok 2024-09-13T18:45:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:42.149 INFO:teuthology.orchestra.run.smithi081.stdout:Success. You can now start the database server using: 2024-09-13T18:45:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: pg_ctlcluster 12 main start 2024-09-13T18:45:42.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:42.595 INFO:teuthology.orchestra.run.smithi178.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:45:42.622 INFO:teuthology.orchestra.run.smithi178.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:45:42.688 INFO:teuthology.orchestra.run.smithi178.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout:This user must also own the server process. 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout:The default text search configuration will be set to "english". 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout:Data page checksums are disabled. 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:42.689 INFO:teuthology.orchestra.run.smithi178.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:45:42.692 INFO:teuthology.orchestra.run.smithi178.stdout:creating subdirectories ... ok 2024-09-13T18:45:42.693 INFO:teuthology.orchestra.run.smithi178.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:45:42.730 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default max_connections ... 100 2024-09-13T18:45:42.736 INFO:teuthology.orchestra.run.smithi081.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:45:42.736 INFO:teuthology.orchestra.run.smithi081.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:45:42.776 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:45:42.798 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:45:42.799 INFO:teuthology.orchestra.run.smithi178.stdout:creating configuration files ... ok 2024-09-13T18:45:42.924 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:45:42.974 INFO:teuthology.orchestra.run.smithi178.stdout:running bootstrap script ... ok 2024-09-13T18:45:43.633 INFO:teuthology.orchestra.run.smithi178.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:45:44.123 INFO:teuthology.orchestra.run.smithi178.stdout:syncing data to disk ... ok 2024-09-13T18:45:44.123 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:44.123 INFO:teuthology.orchestra.run.smithi178.stdout:Success. You can now start the database server using: 2024-09-13T18:45:44.123 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:44.124 INFO:teuthology.orchestra.run.smithi178.stdout: pg_ctlcluster 12 main start 2024-09-13T18:45:44.124 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:44.693 INFO:teuthology.orchestra.run.smithi178.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:45:44.693 INFO:teuthology.orchestra.run.smithi178.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:45:44.891 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:45:46.751 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:46.877 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:47.028 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:45:47.196 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:47.322 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:45:47.490 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:48.573 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout:- enp3s0f1 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:45:48.679 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:45:48.690 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:48.825 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:45:48.904 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:45:49.026 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:49.152 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:45:49.303 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:45:49.425 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:45:50.374 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout:- enp3s0f1 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:45:50.517 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:45:50.745 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:51.290 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:45:51.411 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:45:51.612 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:51.738 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:45:51.865 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:45:52.015 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:52.142 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:52.256 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:45:52.267 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:52.608 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:45:52.608 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:45:53.189 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:45:53.315 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:45:53.500 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:45:53.595 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:45:53.626 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:45:53.729 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:45:53.751 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:45:53.864 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:45:53.903 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:54.028 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:45:54.032 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:45:54.196 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:45:54.500 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:45:54.513 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:45:54.513 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:45:55.540 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:45:55.683 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:45:56.011 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:45:56.512 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:46:07.204 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:46:07.312 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:46:08.575 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:46:08.585 DEBUG:teuthology.parallel:result is None 2024-09-13T18:46:09.090 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:46:09.190 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:46:10.424 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:46:10.431 DEBUG:teuthology.parallel:result is None 2024-09-13T18:46:10.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:46:10.584 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:46:10.621 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:46:10.622 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:46:10.622 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:46:10.624 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:46:10.769 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:46:10.809 INFO:teuthology.orchestra.run.smithi178.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:46:10.809 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:46:10.809 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:46:10.812 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:46:10.812 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:10.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:46:10.845 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:10.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:46:10.883 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:46:10.883 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:10.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:46:10.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:46:11.001 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:11.001 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:46:11.034 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:46:11.109 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:46:11.110 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:11.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:46:11.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:46:11.219 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:11.219 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:46:11.254 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:46:11.334 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:46:11.334 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:11.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:46:11.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:46:11.445 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:11.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:46:11.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:46:11.557 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:46:11.638 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:46:11.639 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-13T18:46:11.644 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2024-09-13T18:46:11.675 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:46:11.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:46:11.716 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:46:11.752 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:46:11.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:46:11.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:46:11.841 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:46:11.841 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:46:11.841 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:46:11.841 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:11.841 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:46:11.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:12.005 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:12.006 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:46:12.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:12.151 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:46:12.151 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:46:12.151 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/multimds_misc}', 'email': None, 'first_in_suite': False, 'job_id': '7904001', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_multimds_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:46:12.152 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:46:12.158 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:46:12.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:46:12.216 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:46:12.250 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:12.250 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:46:12.303 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:46:12.303 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-13T18:46:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:46:12.365 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 493 Links: 1 2024-09-13T18:46:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 18:40:44.922123275 +0000 2024-09-13T18:46:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 18:40:44.630130009 +0000 2024-09-13T18:46:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 18:40:44.630130009 +0000 2024-09-13T18:46:12.366 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T18:46:12.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:46:12.436 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T18:46:12.436 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T18:46:12.437 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000537555 s, 952 kB/s 2024-09-13T18:46:12.439 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:46:12.510 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-13T18:46:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:46:12.568 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:12.568 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 502 Links: 1 2024-09-13T18:46:12.568 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:12.568 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 18:40:45.574108239 +0000 2024-09-13T18:46:12.568 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 18:40:45.262115434 +0000 2024-09-13T18:46:12.569 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 18:40:45.262115434 +0000 2024-09-13T18:46:12.569 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T18:46:12.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T18:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T18:46:12.643 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000652132 s, 785 kB/s 2024-09-13T18:46:12.648 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:46:12.714 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 508 Links: 1 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 18:40:46.186094126 +0000 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 18:40:45.890100951 +0000 2024-09-13T18:46:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 18:40:45.890100951 +0000 2024-09-13T18:46:12.774 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T18:46:12.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T18:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T18:46:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00067794 s, 755 kB/s 2024-09-13T18:46:12.853 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:46:12.918 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-13T18:46:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:46:12.977 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:12.977 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 512 Links: 1 2024-09-13T18:46:12.977 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:12.978 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-13 18:40:46.866078443 +0000 2024-09-13T18:46:12.978 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-13 18:40:46.554085638 +0000 2024-09-13T18:46:12.978 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-13 18:40:46.554085638 +0000 2024-09-13T18:46:12.978 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-13T18:46:12.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:46:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-13T18:46:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-13T18:46:13.050 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.00065698 s, 779 kB/s 2024-09-13T18:46:13.052 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:46:13.121 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:13.121 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:13.121 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:46:13.140 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:46:13.140 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-09-13T18:46:13.198 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 496 Links: 1 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-13 18:40:44.150948845 +0000 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-13 18:40:43.826956317 +0000 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-13 18:40:43.826956317 +0000 2024-09-13T18:46:13.199 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-13T18:46:13.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:46:13.272 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-13T18:46:13.272 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-13T18:46:13.272 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000623866 s, 821 kB/s 2024-09-13T18:46:13.274 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:46:13.337 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-09-13T18:46:13.398 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:46:13.398 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:13.399 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 502 Links: 1 2024-09-13T18:46:13.399 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:13.399 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-13 18:40:44.826933256 +0000 2024-09-13T18:46:13.399 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-13 18:40:44.498940821 +0000 2024-09-13T18:46:13.399 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-13 18:40:44.498940821 +0000 2024-09-13T18:46:13.399 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-13T18:46:13.400 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:46:13.472 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-13T18:46:13.472 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-13T18:46:13.472 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000565395 s, 906 kB/s 2024-09-13T18:46:13.475 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:46:13.543 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 507 Links: 1 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-13 18:40:45.454918773 +0000 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-13 18:40:45.130926246 +0000 2024-09-13T18:46:13.605 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-13 18:40:45.130926246 +0000 2024-09-13T18:46:13.606 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-13T18:46:13.606 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-13T18:46:13.677 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000558644 s, 917 kB/s 2024-09-13T18:46:13.678 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:46:13.741 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 512 Links: 1 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-13 18:40:45.770911487 +0000 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-13 18:40:45.766911578 +0000 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-13 18:40:45.766911578 +0000 2024-09-13T18:46:13.805 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-13T18:46:13.806 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:46:13.881 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-13T18:46:13.881 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-13T18:46:13.881 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000369147 s, 1.4 MB/s 2024-09-13T18:46:13.882 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:46:13.949 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:13.949 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:46:13.949 INFO:tasks.ceph:Generating config... 2024-09-13T18:46:13.950 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:46:13.951 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:46:13.951 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:46:13.951 INFO:tasks.ceph:[client] pid file = 2024-09-13T18:46:13.951 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:46:13.951 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:46:13.951 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T18:46:13.951 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:46:13.951 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:46:13.951 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:46:13.951 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:46:13.951 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:46:13.952 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:46:13.952 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:46:13.952 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:46:13.953 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:46:13.953 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:46:13.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:46:14.020 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:46:14.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:46:14.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:46:14.140 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2024-09-13T18:46:14.141 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:46:14.141 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:14.141 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:46:14.205 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:14.312 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid a8432ea3-e34b-45da-88c0-4120757fcc5d 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:fsid a8432ea3-e34b-45da-88c0-4120757fcc5d 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-13T18:46:14.310302+0000 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-13T18:46:14.310302+0000 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 16 (pacific) 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2024-09-13T18:46:14.313 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:46:14.316 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:46:14.331 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a8432ea3-e34b-45da-88c0-4120757fcc5d... 2024-09-13T18:46:14.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:46:14.376 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.452 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.453 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.454 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.81,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = a8432ea3-e34b-45da-88c0-4120757fcc5d 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.455 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.456 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.457 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:46:14.458 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.459 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:46:14.460 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on pool no app = False 2024-09-13T18:46:14.461 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-09-13T18:46:14.462 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-09-13T18:46:14.463 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-13T18:46:14.464 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-13T18:46:14.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:46:14.466 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2024-09-13T18:46:14.467 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = a8432ea3-e34b-45da-88c0-4120757fcc5d 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-13T18:46:14.468 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.469 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:46:14.470 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.471 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:46:14.472 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on pool no app = False 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:14.473 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-13T18:46:14.474 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2024-09-13T18:46:14.475 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-09-13T18:46:14.476 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-09-13T18:46:14.477 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:46:14.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:46:14.565 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:46:14.565 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:14.565 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:46:14.581 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:14.581 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:46:14.639 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:46:14.639 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:14.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:46:14.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:46:14.740 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:14.740 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:14.803 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:46:14.803 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:14.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:46:14.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:46:14.863 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:14.863 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:14.922 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:46:14.923 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:46:14.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:46:15.017 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:46:15.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:46:15.124 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:46:15.141 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:46:15.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:46:15.240 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:46:15.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:46:15.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:46:15.428 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:46:15.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:46:15.466 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:46:15.565 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:46:15.573 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:46:15.605 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:46:15.740 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:46:15.747 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:46:15.779 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:46:15.779 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:46:15.853 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:46:15.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T18:46:15.950 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T18:46:15.978 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:46:16.049 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T18:46:16.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T18:46:16.144 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T18:46:16.171 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:46:16.171 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:46:16.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:46:16.206 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:16.206 INFO:tasks.ceph:role: osd.0 2024-09-13T18:46:16.206 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:46:16.206 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:46:16.787 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:16.788 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:16.793 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T18:46:16.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:46:16.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:46:16.933 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:16.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:16.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:46:17.011 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:17.011 INFO:tasks.ceph:role: osd.1 2024-09-13T18:46:17.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:46:17.012 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:46:17.542 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:17.543 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:17.545 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T18:46:17.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:46:17.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:46:17.633 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:17.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:17.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:46:17.708 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:17.709 INFO:tasks.ceph:role: osd.2 2024-09-13T18:46:17.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:46:17.709 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:46:18.258 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:18.258 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:18.259 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:18.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T18:46:18.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:46:18.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:46:18.366 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:18.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:18.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:46:18.443 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:18.443 INFO:tasks.ceph:role: osd.3 2024-09-13T18:46:18.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:46:18.443 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:19.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-13T18:46:19.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:46:19.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:46:19.142 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:19.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:19.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:19.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:19.301+0000 7f5556235880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:46:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:19.305+0000 7f5556235880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:46:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:19.305+0000 7f5556235880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:46:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:19.305+0000 7f5556235880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:46:19.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:19.305+0000 7f5556235880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:46:19.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:19.313+0000 7f5556235880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:46:22.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:46:22.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:22.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:22.585+0000 7f5b95d03880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:46:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:22.589+0000 7f5b95d03880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:46:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:22.589+0000 7f5b95d03880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:46:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:22.589+0000 7f5b95d03880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:46:22.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:22.589+0000 7f5b95d03880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:46:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:22.589+0000 7f5b95d03880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:46:25.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:46:25.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:25.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:25.857+0000 7f196868f880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:46:25.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:25.857+0000 7f196868f880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:46:25.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:25.857+0000 7f196868f880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:46:25.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:25.857+0000 7f196868f880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:46:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:25.857+0000 7f196868f880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:46:25.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:25.861+0000 7f196868f880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:46:28.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:46:29.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:29.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:29.132+0000 7f5dc14b4880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:46:29.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:29.136+0000 7f5dc14b4880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:46:29.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:29.136+0000 7f5dc14b4880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:46:29.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:29.136+0000 7f5dc14b4880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:46:29.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:29.136+0000 7f5dc14b4880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:46:29.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:29.136+0000 7f5dc14b4880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:46:32.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:46:32.300 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:46:32.333 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:32.334 INFO:tasks.ceph:role: osd.4 2024-09-13T18:46:32.334 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:46:32.334 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:46:32.442 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:32.442 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:32.442 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:32.443 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:32.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-13T18:46:32.448 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:46:32.481 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:46:32.551 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:32.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:32.552 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:46:32.624 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:32.624 INFO:tasks.ceph:role: osd.5 2024-09-13T18:46:32.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:46:32.624 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:46:32.740 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:32.741 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:32.742 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:32.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-13T18:46:32.744 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:46:32.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:46:32.850 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:32.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:32.851 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:46:32.929 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:32.929 INFO:tasks.ceph:role: osd.6 2024-09-13T18:46:32.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:46:32.930 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:33.039 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:33.040 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:33.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-13T18:46:33.044 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:46:33.080 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:46:33.150 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:33.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:33.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:46:33.232 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:46:33.232 INFO:tasks.ceph:role: osd.7 2024-09-13T18:46:33.232 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:46:33.233 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:46:33.338 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:46:33.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-13T18:46:33.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:46:33.384 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:46:33.448 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:46:33.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:46:33.449 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:33.610 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:33.604+0000 7f48cc73a880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:46:33.611 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:33.608+0000 7f48cc73a880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:46:33.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:33.608+0000 7f48cc73a880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:46:33.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:33.608+0000 7f48cc73a880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:46:33.612 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:33.608+0000 7f48cc73a880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:46:33.614 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:33.612+0000 7f48cc73a880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:46:36.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:46:36.758 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:36.890 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:36.884+0000 7fe58a108880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:46:36.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:36.884+0000 7fe58a108880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:46:36.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:36.884+0000 7fe58a108880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:46:36.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:36.884+0000 7fe58a108880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:46:36.891 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:36.884+0000 7fe58a108880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:46:36.893 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:36.888+0000 7fe58a108880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:46:39.975 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:46:40.011 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:40.147 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:40.144+0000 7f452aab2880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:46:40.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:40.144+0000 7f452aab2880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:46:40.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:40.144+0000 7f452aab2880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:46:40.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:40.144+0000 7f452aab2880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:46:40.148 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:40.144+0000 7f452aab2880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:46:40.150 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:40.144+0000 7f452aab2880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:46:42.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:42.159 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:43.266 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:46:43.299 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:43.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:43.428+0000 7f7e7a356880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:46:43.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:43.428+0000 7f7e7a356880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:46:43.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:43.428+0000 7f7e7a356880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:46:43.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:43.428+0000 7f7e7a356880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:46:43.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:43.428+0000 7f7e7a356880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:46:43.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:43.432+0000 7f7e7a356880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:46:46.540 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:46:46.570 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:46:46.570 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:46.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:46:46.604 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:46.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:46:46.679 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:46.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:46:46.757 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:46.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:46:46.842 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:46.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:46:46.920 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:46.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:46:47.002 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:47.002 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:46:47.075 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.075 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:46:47.106 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.106 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:46:47.178 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:46:47.259 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:46:47.337 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.337 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:46:47.409 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.409 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:46:47.488 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.488 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:46:47.566 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:47.566 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:46:47.585 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:47.585 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T18:46:47.648 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.648 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T18:46:47.664 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:47.664 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T18:46:47.725 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:46:47.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:46:47.731 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:46:47.772 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-13T18:46:47.772 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g== 2024-09-13T18:46:47.772 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-13T18:46:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw== 2024-09-13T18:46:47.773 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-13T18:46:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q== 2024-09-13T18:46:47.773 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-13T18:46:47.773 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g== 2024-09-13T18:46:47.775 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-13T18:46:47.775 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw== 2024-09-13T18:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw== 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A== 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q== 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ== 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg== 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg== 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2024-09-13T18:46:47.777 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng== 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g== 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw== 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q== 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g== 2024-09-13T18:46:47.797 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw== 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA== 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg== 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA== 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw== 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g== 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2024-09-13T18:46:47.798 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[client.2] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg== 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout:[client.3] 2024-09-13T18:46:47.799 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng== 2024-09-13T18:46:47.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:46:47.830 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:46:47.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:47.936 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.207 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.296 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.382 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:46:48.468 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:46:48.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.652 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:46:48.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.739 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.824 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.911 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.993 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:48.998 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:46:49.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.087 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.182 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.357 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:46:49.443 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:46:49.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:46:49.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:46:49.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:46:49.658 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:46:49.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:46:49.864 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:46:49.898 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:46:49.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:46:50.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:46:50.150 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:50.156 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:46:50.212 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:46:50.212 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:46:50.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:46:50.218 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:46:50.218 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:46:50.218 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:46:50.263 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:46:50.264 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:46:50.264 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:46:50.270 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:46:50.270 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:46:50.270 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:46:50.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:46:50.277 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:46:50.277 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:46:50.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:46:50.280 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:46:50.280 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:46:50.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:46:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.435+0000 7fb546a00700 1 Processor -- start 2024-09-13T18:46:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.435+0000 7fb546a00700 1 -- start start 2024-09-13T18:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb546a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 0x7fb54006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb546a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb5400ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb546a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54006d000 con 0x7fb5400cf0b0 2024-09-13T18:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb546a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5400cf540 con 0x7fb540160fc0 2024-09-13T18:46:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb546a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54006c3f0 con 0x7fb5400b3990 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb5400ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb5400ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48356/0 (socket says 172.21.15.81:48356) 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 -- 172.21.15.81:0/622306118 learned_addr learned my addr 172.21.15.81:0/622306118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 -- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 msgr2=0x7fb5400ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 -- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 msgr2=0x7fb5400ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb5400ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53f400700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb5400ceb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53fe00700 1 --2- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 0x7fb54006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53fe00700 1 -- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 msgr2=0x7fb54006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53fe00700 1 -- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 msgr2=0x7fb54006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:46:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53fe00700 1 --2- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 0x7fb54006be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:46:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.439+0000 7fb53fe00700 1 --2- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 0x7fb54006be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:46:50.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.599+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273577270 0 0) 0x7fb54006d000 con 0x7fb5400cf0b0 2024-09-13T18:46:50.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.599+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5240035d0 con 0x7fb5400cf0b0 2024-09-13T18:46:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1036838192 0 0) 0x7fb5240035d0 con 0x7fb5400cf0b0 2024-09-13T18:46:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 msgr2=0x7fb5400ceb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:46:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb5400ceb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 msgr2=0x7fb54006be10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 --2- 172.21.15.81:0/622306118 >> v2:172.21.15.81:3300/0 conn(0x7fb540160fc0 0x7fb54006be10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54006c6d0 con 0x7fb5400cf0b0 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fb5380019f0 con 0x7fb5400cf0b0 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 >> v1:172.21.15.81:6789/0 conn(0x7fb5400cf0b0 legacy=0x7fb54006fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb524003a20 0x7fb524003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb524004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb524005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400cf540 con 0x7fb524004870 2024-09-13T18:46:50.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54006c3f0 con 0x7fb524003a20 2024-09-13T18:46:50.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52400bae0 con 0x7fb5400b3990 2024-09-13T18:46:50.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb524004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53fe00700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb524003a20 0x7fb524003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 -- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 msgr2=0x7fb524005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5400b3990 0x7fb524005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 -- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb524003a20 msgr2=0x7fb524003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb524003a20 0x7fb524003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 -- 172.21.15.81:0/622306118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240035d0 con 0x7fb524004870 2024-09-13T18:46:50.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.603+0000 7fb53f400700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb524004cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5400cb240 tx=0x7fb5240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb88348ac8770fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c00c070 con 0x7fb524004870 2024-09-13T18:46:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c013630 con 0x7fb524004870 2024-09-13T18:46:50.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb53ea00700 1 -- 172.21.15.81:0/622306118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0139e0 con 0x7fb524004870 2024-09-13T18:46:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb546a00700 1 -- 172.21.15.81:0/622306118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 msgr2=0x7fb524004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb546a00700 1 --2- 172.21.15.81:0/622306118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb524004cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb5400cb240 tx=0x7fb5240058a0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb544a00700 1 -- 172.21.15.81:0/622306118 reap_dead start 2024-09-13T18:46:50.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb546a00700 1 -- 172.21.15.81:0/622306118 shutdown_connections 2024-09-13T18:46:50.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb546a00700 1 -- 172.21.15.81:0/622306118 >> 172.21.15.81:0/622306118 conn(0x7fb54006a570 msgr2=0x7fb54006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:50.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb546a00700 1 -- 172.21.15.81:0/622306118 shutdown_connections 2024-09-13T18:46:50.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.607+0000 7fb546a00700 1 -- 172.21.15.81:0/622306118 wait complete. 2024-09-13T18:46:50.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 Processor -- start 2024-09-13T18:46:50.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 -- start start 2024-09-13T18:46:50.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb5401559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb540157700 0x7fb540151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54014f5d0 0x7fb54014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:50.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54014ffc0 con 0x7fb524004870 2024-09-13T18:46:50.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540155f20 con 0x7fb54014f5d0 2024-09-13T18:46:50.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb546a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb540156660 con 0x7fb540157700 2024-09-13T18:46:50.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb5401559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb5401559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56582/0 (socket says 172.21.15.81:56582) 2024-09-13T18:46:50.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 -- 172.21.15.81:0/4235828136 learned_addr learned my addr 172.21.15.81:0/4235828136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:46:50.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53f400700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb540157700 0x7fb540151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb544a00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54014f5d0 0x7fb54014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:50.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 -- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb540157700 msgr2=0x7fb540151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb540157700 0x7fb540151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 -- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54014f5d0 msgr2=0x7fb54014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54014f5d0 0x7fb54014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.611+0000 7fb53fe00700 1 -- 172.21.15.81:0/4235828136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb540156940 con 0x7fb524004870 2024-09-13T18:46:50.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb53fe00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb5401559e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb530004700 tx=0x7fb530009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:50.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530014610 con 0x7fb524004870 2024-09-13T18:46:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb530014770 con 0x7fb524004870 2024-09-13T18:46:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb530014b20 con 0x7fb524004870 2024-09-13T18:46:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb540156c20 con 0x7fb524004870 2024-09-13T18:46:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5401571e0 con 0x7fb524004870 2024-09-13T18:46:50.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb530014c80 con 0x7fb524004870 2024-09-13T18:46:50.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb53001de20 con 0x7fb524004870 2024-09-13T18:46:50.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.615+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54006be10 con 0x7fb524004870 2024-09-13T18:46:50.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.619+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb530018020 con 0x7fb524004870 2024-09-13T18:46:50.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.691+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb54015dc90 con 0x7fb524004870 2024-09-13T18:46:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.695+0000 7fb537e00700 1 -- 172.21.15.81:0/4235828136 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb53002c090 con 0x7fb524004870 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 msgr2=0x7fb5401559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb5401559e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb530004700 tx=0x7fb530009ab0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 shutdown_connections 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb54014f5d0 0x7fb54014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb540157700 0x7fb540151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 --2- 172.21.15.81:0/4235828136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb524004870 0x7fb5401559e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 >> 172.21.15.81:0/4235828136 conn(0x7fb54006a570 msgr2=0x7fb54015e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 shutdown_connections 2024-09-13T18:46:50.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:50.699+0000 7fb546a00700 1 -- 172.21.15.81:0/4235828136 wait complete. 2024-09-13T18:46:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-13T18:46:50.730 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:46:50.730 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:46:50.731 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:50.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:46:50.762 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:50.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:46:50.836 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:50.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:46:50.847 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:50.844+0000 7fd5d725f2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:46:50.869 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:50.859+0000 7f66714732c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:46:50.899 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:46:50.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:46:50.973 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:50.974 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:46:51.005 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:51.006 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:46:51.076 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:51.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:46:51.150 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:46:51.150 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:46:51.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 167aa7b6-9aad-41fc-88da-b10f711eae43 0 2024-09-13T18:46:51.425 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.420+0000 7fa407e00700 1 Processor -- start 2024-09-13T18:46:51.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.420+0000 7fa407e00700 1 -- start start 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa408159920 0x7fa4080b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa40806d070 0x7fa4080cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4080cd2a0 con 0x7fa4080b30d0 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4080ccc90 con 0x7fa40806d070 2024-09-13T18:46:51.428 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080b3580 con 0x7fa408159920 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa40806d070 0x7fa4080cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa406a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa408159920 0x7fa4080b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa40806d070 0x7fa4080cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51106/0 (socket says 172.21.15.178:51106) 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 -- 172.21.15.178:0/3891894668 learned_addr learned my addr 172.21.15.178:0/3891894668 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 -- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa408159920 msgr2=0x7fa4080b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 --2- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa408159920 0x7fa4080b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 -- 172.21.15.178:0/3891894668 >> v1:172.21.15.81:6789/0 conn(0x7fa4080b30d0 legacy=0x7fa40806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.429 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 -- 172.21.15.178:0/3891894668 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4080b3860 con 0x7fa40806d070 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa406a00700 1 --2- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa408159920 0x7fa4080b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa407400700 1 --2- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080cd730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa400009e50 tx=0x7fa40000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76018fdce913afe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa405600700 1 -- 172.21.15.178:0/3891894668 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40000e070 con 0x7fa40806d070 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa405600700 1 -- 172.21.15.178:0/3891894668 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40000b910 con 0x7fa40806d070 2024-09-13T18:46:51.430 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.424+0000 7fa405600700 1 -- 172.21.15.178:0/3891894668 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40000bcc0 con 0x7fa40806d070 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 -- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 msgr2=0x7fa4080cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 --2- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080cd730 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa400009e50 tx=0x7fa40000b330 comp rx=0 tx=0).stop 2024-09-13T18:46:51.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 -- 172.21.15.178:0/3891894668 shutdown_connections 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 --2- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080cd730 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 --2- 172.21.15.178:0/3891894668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa408159920 0x7fa4080b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 -- 172.21.15.178:0/3891894668 >> 172.21.15.178:0/3891894668 conn(0x7fa40806a390 msgr2=0x7fa40806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 -- 172.21.15.178:0/3891894668 shutdown_connections 2024-09-13T18:46:51.432 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.428+0000 7fa407e00700 1 -- 172.21.15.178:0/3891894668 wait complete. 2024-09-13T18:46:51.434 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 Processor -- start 2024-09-13T18:46:51.435 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 -- start start 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080b30d0 0x7fa4081df720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4081dfc60 0x7fa4081e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4081e0d30 con 0x7fa4080b30d0 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4081e0490 con 0x7fa40806d070 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4081e0770 con 0x7fa4081dfc60 2024-09-13T18:46:51.437 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51112/0 (socket says 172.21.15.178:51112) 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 -- 172.21.15.178:0/492186159 learned_addr learned my addr 172.21.15.178:0/492186159 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407400700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4081dfc60 0x7fa4081e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406000700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080b30d0 0x7fa4081df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 -- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4081dfc60 msgr2=0x7fa4081e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4081dfc60 0x7fa4081e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 -- 172.21.15.178:0/492186159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080b30d0 msgr2=0x7fa4081df720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080b30d0 0x7fa4081df720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 -- 172.21.15.178:0/492186159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094b0 con 0x7fa40806d070 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa406a00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080c9f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800ebe0 tx=0x7fa3f800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8009770 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f800c850 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.432+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa400009b30 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.436+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f800cbe0 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.436+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4081e23f0 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.436+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa3f8005a40 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.436+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa3f80137b0 con 0x7fa40806d070 2024-09-13T18:46:51.440 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.436+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4081e2250 con 0x7fa40806d070 2024-09-13T18:46:51.445 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.440+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa4081e2250 con 0x7fa40806d070 2024-09-13T18:46:51.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.524+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "167aa7b6-9aad-41fc-88da-b10f711eae43", "id": 0} v 0) v1 -- 0x7fa40806c960 con 0x7fa40806d070 2024-09-13T18:46:51.538 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.532+0000 7fa3fea00700 1 -- 172.21.15.178:0/492186159 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "167aa7b6-9aad-41fc-88da-b10f711eae43", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3f8029020 con 0x7fa40806d070 2024-09-13T18:46:51.539 INFO:teuthology.orchestra.run.smithi178.stdout:0 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 msgr2=0x7fa4080c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080c9f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa3f800ebe0 tx=0x7fa3f800eef0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 shutdown_connections 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4081dfc60 0x7fa4081e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4080b30d0 0x7fa4081df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 --2- 172.21.15.178:0/492186159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa40806d070 0x7fa4080c9f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 >> 172.21.15.178:0/492186159 conn(0x7fa40806a390 msgr2=0x7fa4081576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 shutdown_connections 2024-09-13T18:46:51.541 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.536+0000 7fa407e00700 1 -- 172.21.15.178:0/492186159 wait complete. 2024-09-13T18:46:51.562 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 57d343ca-dd86-4384-88ea-ffb3a19cb365 1 2024-09-13T18:46:51.669 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:51.663+0000 7f66714732c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:46:51.727 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:51.724+0000 7fd5d725f2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:46:51.731 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.728+0000 7fe293200700 1 Processor -- start 2024-09-13T18:46:51.732 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.728+0000 7fe293200700 1 -- start start 2024-09-13T18:46:51.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe293200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe2940b5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe293200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29406f1a0 con 0x7fe2940afe10 2024-09-13T18:46:51.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe293200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2940b3b00 con 0x7fe29406f630 2024-09-13T18:46:51.737 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe293200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940b3920 con 0x7fe29415ca40 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe2940b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe29406f630 0x7fe2940af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59560/0 (socket says 172.21.15.178:59560) 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291400700 1 -- 172.21.15.178:0/2511548896 learned_addr learned my addr 172.21.15.178:0/2511548896 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe290a00700 1 -- 172.21.15.178:0/2511548896 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407002035 0 0) 0x7fe2940b3b00 con 0x7fe29406f630 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe290a00700 1 -- 172.21.15.178:0/2511548896 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2780035d0 con 0x7fe29406f630 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291e00700 1 -- 172.21.15.178:0/2511548896 >> v1:172.21.15.178:6789/0 conn(0x7fe29406f630 legacy=0x7fe2940af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe290a00700 1 -- 172.21.15.178:0/2511548896 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174841251 0 0) 0x7fe29406f1a0 con 0x7fe2940afe10 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291e00700 1 -- 172.21.15.178:0/2511548896 >> v1:172.21.15.81:6789/0 conn(0x7fe2940afe10 legacy=0x7fe29406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.738 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291e00700 1 -- 172.21.15.178:0/2511548896 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2940b3de0 con 0x7fe29415ca40 2024-09-13T18:46:51.739 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe291e00700 1 --2- 172.21.15.178:0/2511548896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe2940b5620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe284009880 tx=0x7fe284009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ac39bb5753a98b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe290a00700 1 -- 172.21.15.178:0/2511548896 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011830 con 0x7fe29415ca40 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe290a00700 1 -- 172.21.15.178:0/2511548896 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284011990 con 0x7fe29415ca40 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.732+0000 7fe290a00700 1 -- 172.21.15.178:0/2511548896 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284011d00 con 0x7fe29415ca40 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 -- 172.21.15.178:0/2511548896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 msgr2=0x7fe2940b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 --2- 172.21.15.178:0/2511548896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe2940b5620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe284009880 tx=0x7fe284009b90 comp rx=0 tx=0).stop 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 -- 172.21.15.178:0/2511548896 shutdown_connections 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 --2- 172.21.15.178:0/2511548896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe2940b5620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 -- 172.21.15.178:0/2511548896 >> 172.21.15.178:0/2511548896 conn(0x7fe2940b2620 msgr2=0x7fe2940b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 -- 172.21.15.178:0/2511548896 shutdown_connections 2024-09-13T18:46:51.740 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 -- 172.21.15.178:0/2511548896 wait complete. 2024-09-13T18:46:51.741 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 Processor -- start 2024-09-13T18:46:51.742 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.736+0000 7fe293200700 1 -- start start 2024-09-13T18:46:51.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 0x7fe2941f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2940afe10 0x7fe2941531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.744 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe29415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2941548e0 con 0x7fe2940afe10 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe294153c60 con 0x7fe29406f630 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe294153f40 con 0x7fe29415ca40 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 0x7fe2941f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 0x7fe2941f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51124/0 (socket says 172.21.15.178:51124) 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 -- 172.21.15.178:0/3609865994 learned_addr learned my addr 172.21.15.178:0/3609865994 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe292800700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe29415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291400700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2940afe10 0x7fe2941531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 -- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 msgr2=0x7fe29415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe29415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.745 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 -- 172.21.15.178:0/3609865994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2940afe10 msgr2=0x7fe2941531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2940afe10 0x7fe2941531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 -- 172.21.15.178:0/3609865994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2840094b0 con 0x7fe29406f630 2024-09-13T18:46:51.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291400700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2940afe10 0x7fe2941531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:46:51.746 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe291e00700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 0x7fe2941f1c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2840090b0 tx=0x7fe284004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:51.746 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:51.739+0000 7f66714732c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:46:51.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840036c0 con 0x7fe29406f630 2024-09-13T18:46:51.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284003820 con 0x7fe29406f630 2024-09-13T18:46:51.747 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe294154220 con 0x7fe29406f630 2024-09-13T18:46:51.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284003bd0 con 0x7fe29406f630 2024-09-13T18:46:51.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2941f21c0 con 0x7fe29406f630 2024-09-13T18:46:51.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe284025710 con 0x7fe29406f630 2024-09-13T18:46:51.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fe28401b7b0 con 0x7fe29406f630 2024-09-13T18:46:51.748 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.740+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2940704b0 con 0x7fe29406f630 2024-09-13T18:46:51.749 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.744+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe284025b50 con 0x7fe29406f630 2024-09-13T18:46:51.814 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:51.808+0000 7fd5d725f2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:46:51.830 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.824+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "57d343ca-dd86-4384-88ea-ffb3a19cb365", "id": 1} v 0) v1 -- 0x7fe2940cace0 con 0x7fe29406f630 2024-09-13T18:46:51.838 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.832+0000 7fe28a000700 1 -- 172.21.15.178:0/3609865994 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57d343ca-dd86-4384-88ea-ffb3a19cb365", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe284025cf0 con 0x7fe29406f630 2024-09-13T18:46:51.838 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-09-13T18:46:51.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 msgr2=0x7fe2941f1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:51.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 0x7fe2941f1c80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2840090b0 tx=0x7fe284004770 comp rx=0 tx=0).stop 2024-09-13T18:46:51.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 shutdown_connections 2024-09-13T18:46:51.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29415ca40 0x7fe29415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2940afe10 0x7fe2941531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.840 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 --2- 172.21.15.178:0/3609865994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29406f630 0x7fe2941f1c80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:51.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 >> 172.21.15.178:0/3609865994 conn(0x7fe2940b2620 msgr2=0x7fe29406b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:51.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 shutdown_connections 2024-09-13T18:46:51.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:51.836+0000 7fe293200700 1 -- 172.21.15.178:0/3609865994 wait complete. 2024-09-13T18:46:51.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 993f59f2-3b85-4b10-9ec7-44520fc63801 2 2024-09-13T18:46:51.934 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:51.927+0000 7f66714732c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:46:52.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.020+0000 7fe1f7e00700 1 Processor -- start 2024-09-13T18:46:52.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.020+0000 7fe1f7e00700 1 -- start start 2024-09-13T18:46:52.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f8158330 0x7fe1f815ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1f80b4c10 0x7fe1f80b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f815bcf0 con 0x7fe1f80cf350 2024-09-13T18:46:52.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f80b5580 con 0x7fe1f80b4c10 2024-09-13T18:46:52.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815b460 con 0x7fe1f8158330 2024-09-13T18:46:52.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1f80b4c10 0x7fe1f80b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1f80b4c10 0x7fe1f80b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51140/0 (socket says 172.21.15.178:51140) 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 -- 172.21.15.178:0/2141638890 learned_addr learned my addr 172.21.15.178:0/2141638890 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f6a00700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f8158330 0x7fe1f815ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 -- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f8158330 msgr2=0x7fe1f815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f8158330 0x7fe1f815ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 -- 172.21.15.178:0/2141638890 >> v1:172.21.15.81:6789/0 conn(0x7fe1f80cf350 legacy=0x7fe1f815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 -- 172.21.15.178:0/2141638890 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f815b730 con 0x7fe1f80b4c10 2024-09-13T18:46:52.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f6a00700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f8158330 0x7fe1f815ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:52.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f7400700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f80b5040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009e50 tx=0x7fe1f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0d8baad262fd34f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.030 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fd5d725f2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:46:52.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f5600700 1 -- 172.21.15.178:0/2141638890 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000e070 con 0x7fe1f80b4c10 2024-09-13T18:46:52.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f5600700 1 -- 172.21.15.178:0/2141638890 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000b9c0 con 0x7fe1f80b4c10 2024-09-13T18:46:52.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.024+0000 7fe1f5600700 1 -- 172.21.15.178:0/2141638890 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000bd70 con 0x7fe1f80b4c10 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 -- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 msgr2=0x7fe1f80b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f80b5040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009e50 tx=0x7fe1f000b330 comp rx=0 tx=0).stop 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 -- 172.21.15.178:0/2141638890 shutdown_connections 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f80b5040 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/2141638890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f8158330 0x7fe1f815ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 -- 172.21.15.178:0/2141638890 >> 172.21.15.178:0/2141638890 conn(0x7fe1f80b1600 msgr2=0x7fe1f80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 -- 172.21.15.178:0/2141638890 shutdown_connections 2024-09-13T18:46:52.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 -- 172.21.15.178:0/2141638890 wait complete. 2024-09-13T18:46:52.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 Processor -- start 2024-09-13T18:46:52.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.028+0000 7fe1f7e00700 1 -- start start 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f8148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f80cf350 0x7fe1f815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f8158330 0x7fe1f80ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815cca0 con 0x7fe1f8158330 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f8148770 con 0x7fe1f80b4c10 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815c020 con 0x7fe1f80cf350 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f8148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f8148230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51156/0 (socket says 172.21.15.178:51156) 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6a00700 1 -- 172.21.15.178:0/4231039708 learned_addr learned my addr 172.21.15.178:0/4231039708 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f80cf350 0x7fe1f815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 -- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 msgr2=0x7fe1f8148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f8148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 -- 172.21.15.178:0/4231039708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f8158330 msgr2=0x7fe1f80ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f8158330 0x7fe1f80ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 -- 172.21.15.178:0/4231039708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009b30 con 0x7fe1f80cf350 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6a00700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f8148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:52.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f6000700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f80cf350 0x7fe1f815d0c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8070ae0 tx=0x7fe1e400c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40052d0 con 0x7fe1f80cf350 2024-09-13T18:46:52.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4005430 con 0x7fe1f80cf350 2024-09-13T18:46:52.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f815c300 con 0x7fe1f80cf350 2024-09-13T18:46:52.039 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40055a0 con 0x7fe1f80cf350 2024-09-13T18:46:52.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f815c8c0 con 0x7fe1f80cf350 2024-09-13T18:46:52.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe1e4003be0 con 0x7fe1f80cf350 2024-09-13T18:46:52.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.032+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe1e4011d60 con 0x7fe1f80cf350 2024-09-13T18:46:52.040 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.036+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f80b5040 con 0x7fe1f80cf350 2024-09-13T18:46:52.042 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.036+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe1e4017070 con 0x7fe1f80cf350 2024-09-13T18:46:52.118 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.112+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "993f59f2-3b85-4b10-9ec7-44520fc63801", "id": 2} v 0) v1 -- 0x7fe1f8072050 con 0x7fe1f80cf350 2024-09-13T18:46:52.129 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.124+0000 7fe1eea00700 1 -- 172.21.15.178:0/4231039708 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "993f59f2-3b85-4b10-9ec7-44520fc63801", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe1e4011590 con 0x7fe1f80cf350 2024-09-13T18:46:52.129 INFO:teuthology.orchestra.run.smithi178.stdout:2 2024-09-13T18:46:52.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f80cf350 msgr2=0x7fe1f815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f80cf350 0x7fe1f815d0c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe1f8070ae0 tx=0x7fe1e400c760 comp rx=0 tx=0).stop 2024-09-13T18:46:52.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 shutdown_connections 2024-09-13T18:46:52.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1f8158330 0x7fe1f80ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.131 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f80cf350 0x7fe1f815d0c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 --2- 172.21.15.178:0/4231039708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f80b4c10 0x7fe1f8148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 >> 172.21.15.178:0/4231039708 conn(0x7fe1f80b1600 msgr2=0x7fe1f80af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 shutdown_connections 2024-09-13T18:46:52.132 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.128+0000 7fe1f7e00700 1 -- 172.21.15.178:0/4231039708 wait complete. 2024-09-13T18:46:52.153 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 348901a1-54b4-4010-9689-6ef1283134d7 3 2024-09-13T18:46:52.210 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:52.203+0000 7f66714732c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:46:52.280 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:52.271+0000 7f66714732c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:46:52.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.316+0000 7f62c5000700 1 Processor -- start 2024-09-13T18:46:52.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.320+0000 7f62c5000700 1 -- start start 2024-09-13T18:46:52.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.320+0000 7f62c5000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62c0146490 0x7f62c0145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.320+0000 7f62c5000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62c0066090 0x7f62c00664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.320+0000 7f62c5000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c00aed70 con 0x7f62c0145ac0 2024-09-13T18:46:52.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.320+0000 7f62c5000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c006a390 con 0x7f62c0066090 2024-09-13T18:46:52.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.320+0000 7f62c5000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c0066a00 con 0x7f62c0146490 2024-09-13T18:46:52.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62c0146490 0x7f62c0145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62c0066090 0x7f62c00664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62c0146490 0x7f62c0145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51164/0 (socket says 172.21.15.178:51164) 2024-09-13T18:46:52.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bf400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f62c0145ac0 0x7f62c006b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.178:49836/0 (socket says 172.21.15.178:49836) 2024-09-13T18:46:52.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 -- 172.21.15.178:0/3623726877 learned_addr learned my addr 172.21.15.178:0/3623726877 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 -- 172.21.15.178:0/3623726877 >> v2:172.21.15.81:3300/0 conn(0x7f62c0066090 msgr2=0x7f62c00664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:52.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 --2- 172.21.15.178:0/3623726877 >> v2:172.21.15.81:3300/0 conn(0x7f62c0066090 0x7f62c00664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 -- 172.21.15.178:0/3623726877 >> v1:172.21.15.81:6789/0 conn(0x7f62c0145ac0 legacy=0x7f62c006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 -- 172.21.15.178:0/3623726877 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c006bc00 con 0x7f62c0146490 2024-09-13T18:46:52.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bfe00700 1 --2- 172.21.15.178:0/3623726877 >> v2:172.21.15.81:3300/0 conn(0x7f62c0066090 0x7f62c00664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:52.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62bea00700 1 --2- 172.21.15.178:0/3623726877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0146490 0x7f62c0145ea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62c006d8f0 tx=0x7f62ac009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b8ecf2d6b5de95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62be000700 1 -- 172.21.15.178:0/3623726877 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac011830 con 0x7f62c0146490 2024-09-13T18:46:52.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62be000700 1 -- 172.21.15.178:0/3623726877 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac011990 con 0x7f62c0146490 2024-09-13T18:46:52.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62be000700 1 -- 172.21.15.178:0/3623726877 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac011d20 con 0x7f62c0146490 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 -- 172.21.15.178:0/3623726877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0146490 msgr2=0x7f62c0145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 --2- 172.21.15.178:0/3623726877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0146490 0x7f62c0145ea0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f62c006d8f0 tx=0x7f62ac009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 -- 172.21.15.178:0/3623726877 shutdown_connections 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 --2- 172.21.15.178:0/3623726877 >> v2:172.21.15.81:3300/0 conn(0x7f62c0066090 0x7f62c00664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 --2- 172.21.15.178:0/3623726877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0146490 0x7f62c0145ea0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 -- 172.21.15.178:0/3623726877 >> 172.21.15.178:0/3623726877 conn(0x7f62c0070d10 msgr2=0x7f62c00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 -- 172.21.15.178:0/3623726877 shutdown_connections 2024-09-13T18:46:52.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.324+0000 7f62c5000700 1 -- 172.21.15.178:0/3623726877 wait complete. 2024-09-13T18:46:52.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.328+0000 7f62c5000700 1 Processor -- start 2024-09-13T18:46:52.334 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.328+0000 7f62c5000700 1 -- start start 2024-09-13T18:46:52.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0066090 0x7f62c015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.335 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 0x7f62c015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c0146490 0x7f62c00ce380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00cc180 con 0x7f62c0146490 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00cc460 con 0x7f62c0145ac0 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c00cc740 con 0x7f62c0066090 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 0x7f62c015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 0x7f62c015b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51174/0 (socket says 172.21.15.178:51174) 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 -- 172.21.15.178:0/1951535675 learned_addr learned my addr 172.21.15.178:0/1951535675 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bf400700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0066090 0x7f62c015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bfe00700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c0146490 0x7f62c00ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 -- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0066090 msgr2=0x7f62c015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0066090 0x7f62c015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 -- 172.21.15.178:0/1951535675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c0146490 msgr2=0x7f62c00ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c0146490 0x7f62c00ce380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 -- 172.21.15.178:0/1951535675 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b8009a70 con 0x7f62c0145ac0 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bfe00700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c0146490 0x7f62c00ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62bea00700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 0x7f62c015b730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f62ac000c00 tx=0x7f62ac004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac004520 con 0x7f62c0145ac0 2024-09-13T18:46:52.338 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac01e070 con 0x7f62c0145ac0 2024-09-13T18:46:52.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac009570 con 0x7f62c0145ac0 2024-09-13T18:46:52.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0038c0 con 0x7f62c0145ac0 2024-09-13T18:46:52.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c00ccd00 con 0x7f62c0145ac0 2024-09-13T18:46:52.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f62ac003d20 con 0x7f62c0145ac0 2024-09-13T18:46:52.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.332+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f62ac020070 con 0x7f62c0145ac0 2024-09-13T18:46:52.339 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.336+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c00ccf20 con 0x7f62c0145ac0 2024-09-13T18:46:52.343 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.340+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f62ac044e30 con 0x7f62c0145ac0 2024-09-13T18:46:52.346 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:52.340+0000 7fd5d725f2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:46:52.425 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:52.420+0000 7fd5d725f2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:46:52.426 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.420+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "348901a1-54b4-4010-9689-6ef1283134d7", "id": 3} v 0) v1 -- 0x7f62c006b810 con 0x7f62c0145ac0 2024-09-13T18:46:52.436 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62b7400700 1 -- 172.21.15.178:0/1951535675 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "348901a1-54b4-4010-9689-6ef1283134d7", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f62ac033030 con 0x7f62c0145ac0 2024-09-13T18:46:52.436 INFO:teuthology.orchestra.run.smithi178.stdout:3 2024-09-13T18:46:52.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 msgr2=0x7f62c015b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 0x7f62c015b730 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f62ac000c00 tx=0x7f62ac004770 comp rx=0 tx=0).stop 2024-09-13T18:46:52.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 shutdown_connections 2024-09-13T18:46:52.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c0146490 0x7f62c00ce380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c0145ac0 0x7f62c015b730 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.438 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 --2- 172.21.15.178:0/1951535675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c0066090 0x7f62c015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 >> 172.21.15.178:0/1951535675 conn(0x7f62c0070d10 msgr2=0x7f62c00b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 shutdown_connections 2024-09-13T18:46:52.439 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.432+0000 7f62c5000700 1 -- 172.21.15.178:0/1951535675 wait complete. 2024-09-13T18:46:52.459 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 6bb5d485-7450-4d97-a335-523aa57a09e2 4 2024-09-13T18:46:52.527 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:52.519+0000 7f66714732c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:46:52.613 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:52.607+0000 7f66714732c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:46:52.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.668+0000 7f453d800700 1 Processor -- start 2024-09-13T18:46:52.674 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.668+0000 7f453d800700 1 -- start start 2024-09-13T18:46:52.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453d800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f453806d070 0x7f45381657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453d800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380b1980 con 0x7f453806d620 2024-09-13T18:46:52.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453d800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45380b2500 con 0x7f4538143b70 2024-09-13T18:46:52.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453d800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45380b1bd0 con 0x7f453806d070 2024-09-13T18:46:52.676 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4537e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4538143b70 0x7f45380cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59570/0 (socket says 172.21.15.178:59570) 2024-09-13T18:46:52.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4537e00700 1 -- 172.21.15.178:0/2258777373 learned_addr learned my addr 172.21.15.178:0/2258777373 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-13T18:46:52.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453ce00700 1 --2- 172.21.15.178:0/2258777373 >> v2:172.21.15.81:3300/0 conn(0x7f453806d070 0x7f45381657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683897195 0 0) 0x7f45380b1980 con 0x7f453806d620 2024-09-13T18:46:52.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f451c0035d0 con 0x7f453806d620 2024-09-13T18:46:52.677 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190292023 0 0) 0x7f45380b2500 con 0x7f4538143b70 2024-09-13T18:46:52.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45380b1980 con 0x7f4538143b70 2024-09-13T18:46:52.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453ce00700 1 -- 172.21.15.178:0/2258777373 >> v1:172.21.15.178:6789/0 conn(0x7f4538143b70 legacy=0x7f45380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453ce00700 1 -- 172.21.15.178:0/2258777373 >> v1:172.21.15.81:6789/0 conn(0x7f453806d620 legacy=0x7f453806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453ce00700 1 -- 172.21.15.178:0/2258777373 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45380b1eb0 con 0x7f453806d070 2024-09-13T18:46:52.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f453ce00700 1 --2- 172.21.15.178:0/2258777373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453806d070 0x7f45381657b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4530009d90 tx=0x7f453000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724c9aedbd6e5049 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.678 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.672+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000e070 con 0x7f453806d070 2024-09-13T18:46:52.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453000bb20 con 0x7f453806d070 2024-09-13T18:46:52.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f4536a00700 1 -- 172.21.15.178:0/2258777373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000be90 con 0x7f453806d070 2024-09-13T18:46:52.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 -- 172.21.15.178:0/2258777373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453806d070 msgr2=0x7f45381657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.679 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 --2- 172.21.15.178:0/2258777373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453806d070 0x7f45381657b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4530009d90 tx=0x7f453000b330 comp rx=0 tx=0).stop 2024-09-13T18:46:52.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 -- 172.21.15.178:0/2258777373 shutdown_connections 2024-09-13T18:46:52.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 --2- 172.21.15.178:0/2258777373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453806d070 0x7f45381657b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 -- 172.21.15.178:0/2258777373 >> 172.21.15.178:0/2258777373 conn(0x7f453806a390 msgr2=0x7f453806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 -- 172.21.15.178:0/2258777373 shutdown_connections 2024-09-13T18:46:52.680 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 -- 172.21.15.178:0/2258777373 wait complete. 2024-09-13T18:46:52.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 Processor -- start 2024-09-13T18:46:52.682 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.676+0000 7f453d800700 1 -- start start 2024-09-13T18:46:52.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f453806d070 0x7f45381e4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 0x7f453813ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4538143b70 0x7f453813ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45381f3970 con 0x7f4538143b70 2024-09-13T18:46:52.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45381f3040 con 0x7f453806d070 2024-09-13T18:46:52.683 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45381f3320 con 0x7f453806d620 2024-09-13T18:46:52.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 0x7f453813ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f453806d070 0x7f45381e4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 0x7f453813ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38842/0 (socket says 172.21.15.178:38842) 2024-09-13T18:46:52.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 -- 172.21.15.178:0/914183330 learned_addr learned my addr 172.21.15.178:0/914183330 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453ce00700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4538143b70 0x7f453813ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.685 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 -- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f453806d070 msgr2=0x7f45381e4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f453806d070 0x7f45381e4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 -- 172.21.15.178:0/914183330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4538143b70 msgr2=0x7f453813ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4538143b70 0x7f453813ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 -- 172.21.15.178:0/914183330 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4530009a70 con 0x7f453806d620 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453ce00700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4538143b70 0x7f453813ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f4537400700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 0x7f453813ea00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f452400c4f0 tx=0x7f452400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45240052d0 con 0x7f453806d620 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4524005430 con 0x7f453806d620 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45381f3600 con 0x7f453806d620 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45240055a0 con 0x7f453806d620 2024-09-13T18:46:52.686 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45381f2d30 con 0x7f453806d620 2024-09-13T18:46:52.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4524003ba0 con 0x7f453806d620 2024-09-13T18:46:52.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.680+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f452401c440 con 0x7f453806d620 2024-09-13T18:46:52.687 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.684+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45380cd990 con 0x7f453806d620 2024-09-13T18:46:52.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.688+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4524021060 con 0x7f453806d620 2024-09-13T18:46:52.703 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:52.695+0000 7f66714732c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:46:52.733 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:52.728+0000 7fd5d725f2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:46:52.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.764+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6bb5d485-7450-4d97-a335-523aa57a09e2", "id": 4} v 0) v1 -- 0x7f45380ccb30 con 0x7f453806d620 2024-09-13T18:46:52.778 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.772+0000 7f452fe00700 1 -- 172.21.15.178:0/914183330 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6bb5d485-7450-4d97-a335-523aa57a09e2", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4524017070 con 0x7f453806d620 2024-09-13T18:46:52.778 INFO:teuthology.orchestra.run.smithi178.stdout:4 2024-09-13T18:46:52.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 msgr2=0x7f453813ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.780 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 0x7f453813ea00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f452400c4f0 tx=0x7f452400c800 comp rx=0 tx=0).stop 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 shutdown_connections 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4538143b70 0x7f453813ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f453806d620 0x7f453813ea00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 --2- 172.21.15.178:0/914183330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f453806d070 0x7f45381e4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 >> 172.21.15.178:0/914183330 conn(0x7f453806a390 msgr2=0x7f45380cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 shutdown_connections 2024-09-13T18:46:52.781 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.776+0000 7f453d800700 1 -- 172.21.15.178:0/914183330 wait complete. 2024-09-13T18:46:52.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 57334a11-3b8c-481e-8e49-59a71ab4d1e9 5 2024-09-13T18:46:52.821 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:52.816+0000 7fd5d725f2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:46:52.923 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:52.920+0000 7fd5d725f2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:46:52.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.964+0000 7fbc6de00700 1 Processor -- start 2024-09-13T18:46:52.969 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.964+0000 7fbc6de00700 1 -- start start 2024-09-13T18:46:52.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.964+0000 7fbc6de00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc6815b460 0x7fbc6815b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.964+0000 7fbc6de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc6815bd80 0x7fbc680b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.970 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc680b52e0 con 0x7fbc680b4d70 2024-09-13T18:46:52.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680d06e0 con 0x7fbc6815bd80 2024-09-13T18:46:52.971 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680b55c0 con 0x7fbc6815b460 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc6815b460 0x7fbc6815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc6815b460 0x7fbc6815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51196/0 (socket says 172.21.15.178:51196) 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 -- 172.21.15.178:0/1339061669 learned_addr learned my addr 172.21.15.178:0/1339061669 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66000700 1 --2- 172.21.15.178:0/1339061669 >> v2:172.21.15.81:3300/0 conn(0x7fbc6815bd80 0x7fbc680b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 -- 172.21.15.178:0/1339061669 >> v2:172.21.15.81:3300/0 conn(0x7fbc6815bd80 msgr2=0x7fbc680b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 --2- 172.21.15.178:0/1339061669 >> v2:172.21.15.81:3300/0 conn(0x7fbc6815bd80 0x7fbc680b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 -- 172.21.15.178:0/1339061669 >> v1:172.21.15.81:6789/0 conn(0x7fbc680b4d70 legacy=0x7fbc6806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 -- 172.21.15.178:0/1339061669 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc680b58a0 con 0x7fbc6815b460 2024-09-13T18:46:52.972 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc65600700 1 -- 172.21.15.178:0/1339061669 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290832507 0 0) 0x7fbc680b52e0 con 0x7fbc680b4d70 2024-09-13T18:46:52.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc66a00700 1 --2- 172.21.15.178:0/1339061669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6815b840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc68072b70 tx=0x7fbc58009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10972ce927ae8905 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc65600700 1 -- 172.21.15.178:0/1339061669 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58011830 con 0x7fbc6815b460 2024-09-13T18:46:52.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc65600700 1 -- 172.21.15.178:0/1339061669 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc58011990 con 0x7fbc6815b460 2024-09-13T18:46:52.973 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc65600700 1 -- 172.21.15.178:0/1339061669 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58011d20 con 0x7fbc6815b460 2024-09-13T18:46:52.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- 172.21.15.178:0/1339061669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 msgr2=0x7fbc6815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 --2- 172.21.15.178:0/1339061669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6815b840 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbc68072b70 tx=0x7fbc58009bf0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- 172.21.15.178:0/1339061669 shutdown_connections 2024-09-13T18:46:52.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 --2- 172.21.15.178:0/1339061669 >> v2:172.21.15.81:3300/0 conn(0x7fbc6815bd80 0x7fbc680b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.974 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 --2- 172.21.15.178:0/1339061669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6815b840 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- 172.21.15.178:0/1339061669 >> 172.21.15.178:0/1339061669 conn(0x7fbc6806e660 msgr2=0x7fbc6806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:52.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- 172.21.15.178:0/1339061669 shutdown_connections 2024-09-13T18:46:52.975 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.968+0000 7fbc6de00700 1 -- 172.21.15.178:0/1339061669 wait complete. 2024-09-13T18:46:52.977 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.972+0000 7fbc6de00700 1 Processor -- start 2024-09-13T18:46:52.978 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.972+0000 7fbc6de00700 1 -- start start 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 0x7fbc6814e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6814ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6815bd80 0x7fbc6813cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6814c300 con 0x7fbc6815bd80 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6814a200 con 0x7fbc6815b460 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6814a4e0 con 0x7fbc680b4d70 2024-09-13T18:46:52.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6814ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 0x7fbc6814e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 0x7fbc6814e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38854/0 (socket says 172.21.15.178:38854) 2024-09-13T18:46:52.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 -- 172.21.15.178:0/3562497635 learned_addr learned my addr 172.21.15.178:0/3562497635 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:52.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc67400700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6815bd80 0x7fbc6813cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:52.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 -- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 msgr2=0x7fbc6814ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6814ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 -- 172.21.15.178:0/3562497635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6815bd80 msgr2=0x7fbc6813cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:52.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6815bd80 0x7fbc6813cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:52.982 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 -- 172.21.15.178:0/3562497635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc58009570 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc66a00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 0x7fbc6814e820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbc680b5700 tx=0x7fbc58004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58004550 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5801f070 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6814a7c0 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58003900 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc68148b90 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbc5801a430 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.976+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbc58021070 con 0x7fbc680b4d70 2024-09-13T18:46:52.983 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.980+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6815b840 con 0x7fbc680b4d70 2024-09-13T18:46:52.985 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:52.980+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbc5802a020 con 0x7fbc680b4d70 2024-09-13T18:46:53.066 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.060+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "57334a11-3b8c-481e-8e49-59a71ab4d1e9", "id": 5} v 0) v1 -- 0x7fbc6814c5e0 con 0x7fbc680b4d70 2024-09-13T18:46:53.076 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc5f400700 1 -- 172.21.15.178:0/3562497635 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "57334a11-3b8c-481e-8e49-59a71ab4d1e9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbc58015020 con 0x7fbc680b4d70 2024-09-13T18:46:53.076 INFO:teuthology.orchestra.run.smithi178.stdout:5 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 msgr2=0x7fbc6814e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 0x7fbc6814e820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbc680b5700 tx=0x7fbc58004770 comp rx=0 tx=0).stop 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 shutdown_connections 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc6815bd80 0x7fbc6813cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc6815b460 0x7fbc6814ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 --2- 172.21.15.178:0/3562497635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc680b4d70 0x7fbc6814e820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 >> 172.21.15.178:0/3562497635 conn(0x7fbc6806e660 msgr2=0x7fbc681490b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 shutdown_connections 2024-09-13T18:46:53.078 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.072+0000 7fbc6de00700 1 -- 172.21.15.178:0/3562497635 wait complete. 2024-09-13T18:46:53.101 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new e338156d-44b8-487f-8b42-2e4836f87f65 6 2024-09-13T18:46:53.206 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:53.199+0000 7f66714732c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:46:53.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.312+0000 7fa142600700 1 Processor -- start 2024-09-13T18:46:53.317 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.312+0000 7fa142600700 1 -- start start 2024-09-13T18:46:53.319 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa142600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa13c06ed70 0x7fa13c06f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa142600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c06b610 con 0x7fa13c15b120 2024-09-13T18:46:53.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa142600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13c06aa40 con 0x7fa13c15ac10 2024-09-13T18:46:53.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa142600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13c06f690 con 0x7fa13c06ed70 2024-09-13T18:46:53.320 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13aa00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa13c15ac10 0x7fa13c0cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59584/0 (socket says 172.21.15.178:59584) 2024-09-13T18:46:53.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13aa00700 1 -- 172.21.15.178:0/1787071708 learned_addr learned my addr 172.21.15.178:0/1787071708 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-13T18:46:53.321 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13b400700 1 --2- 172.21.15.178:0/1787071708 >> v2:172.21.15.81:3300/0 conn(0x7fa13c06ed70 0x7fa13c06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744982593 0 0) 0x7fa13c06aa40 con 0x7fa13c15ac10 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1200035d0 con 0x7fa13c15ac10 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2517019996 0 0) 0x7fa1200035d0 con 0x7fa13c15ac10 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 >> v2:172.21.15.81:3300/0 conn(0x7fa13c06ed70 msgr2=0x7fa13c06f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 --2- 172.21.15.178:0/1787071708 >> v2:172.21.15.81:3300/0 conn(0x7fa13c06ed70 0x7fa13c06f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 >> v1:172.21.15.81:6789/0 conn(0x7fa13c15b120 legacy=0x7fa13c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 --> v1:172.21.15.178:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c06ace0 con 0x7fa13c15ac10 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 <== mon.1 v1:172.21.15.178:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fa128001670 con 0x7fa13c15ac10 2024-09-13T18:46:53.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 >> v1:172.21.15.178:6789/0 conn(0x7fa13c15ac10 legacy=0x7fa13c0cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa120003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120004870 0x7fa120004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa120005230 0x7fa12000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c06f690 con 0x7fa120004870 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c1d0 con 0x7fa120003a20 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c390 con 0x7fa120005230 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13b400700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa120003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13be00700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa120005230 0x7fa12000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.323 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.316+0000 7fa13aa00700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120004870 0x7fa120004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13b400700 1 -- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa120005230 msgr2=0x7fa12000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13b400700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa120005230 0x7fa12000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13b400700 1 -- 172.21.15.178:0/1787071708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120004870 msgr2=0x7fa120004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13b400700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa120004870 0x7fa120004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13b400700 1 -- 172.21.15.178:0/1787071708 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1200035d0 con 0x7fa120003a20 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13be00700 1 -- 172.21.15.178:0/1787071708 reap_dead start 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13b400700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa120003e40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009b70 tx=0x7fa1200058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa52ce459baa3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00e6c0 con 0x7fa120003a20 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c00e820 con 0x7fa120003a20 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa13a000700 1 -- 172.21.15.178:0/1787071708 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00eb90 con 0x7fa120003a20 2024-09-13T18:46:53.325 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 -- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 msgr2=0x7fa120003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa120003e40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009b70 tx=0x7fa1200058a0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 -- 172.21.15.178:0/1787071708 shutdown_connections 2024-09-13T18:46:53.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 --2- 172.21.15.178:0/1787071708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa120003e40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 -- 172.21.15.178:0/1787071708 >> 172.21.15.178:0/1787071708 conn(0x7fa13c06d530 msgr2=0x7fa13c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 -- 172.21.15.178:0/1787071708 shutdown_connections 2024-09-13T18:46:53.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.320+0000 7fa142600700 1 -- 172.21.15.178:0/1787071708 wait complete. 2024-09-13T18:46:53.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 Processor -- start 2024-09-13T18:46:53.327 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 -- start start 2024-09-13T18:46:53.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa13c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 0x7fa13c1500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c066780 0x7fa13c150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c15baf0 con 0x7fa13c066780 2024-09-13T18:46:53.329 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c153490 con 0x7fa120003a20 2024-09-13T18:46:53.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa142600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c15b500 con 0x7fa13c066300 2024-09-13T18:46:53.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 0x7fa13c1500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa13c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 0x7fa13c1500d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38858/0 (socket says 172.21.15.178:38858) 2024-09-13T18:46:53.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13aa00700 1 -- 172.21.15.178:0/949514990 learned_addr learned my addr 172.21.15.178:0/949514990 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:53.330 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13be00700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c066780 0x7fa13c150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.331 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 -- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 msgr2=0x7fa13c1500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 0x7fa13c1500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 -- 172.21.15.178:0/949514990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c066780 msgr2=0x7fa13c150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c066780 0x7fa13c150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 -- 172.21.15.178:0/949514990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c0b4910 con 0x7fa120003a20 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13aa00700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 0x7fa13c1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.324+0000 7fa13b400700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa13c152f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa12c019000 tx=0x7fa12c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.332 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00e6c0 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c003b10 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0045a0 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c0b4bf0 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c15b710 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa12c013770 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa12c028a90 con 0x7fa120003a20 2024-09-13T18:46:53.333 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.328+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c06f150 con 0x7fa120003a20 2024-09-13T18:46:53.336 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.332+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa12c02d020 con 0x7fa120003a20 2024-09-13T18:46:53.375 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:53.367+0000 7f66714732c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:46:53.420 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.416+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e338156d-44b8-487f-8b42-2e4836f87f65", "id": 6} v 0) v1 -- 0x7fa13c0b14d0 con 0x7fa120003a20 2024-09-13T18:46:53.426 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:53.420+0000 7fd5d725f2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:46:53.431 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa133400700 1 -- 172.21.15.178:0/949514990 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e338156d-44b8-487f-8b42-2e4836f87f65", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa12c017070 con 0x7fa120003a20 2024-09-13T18:46:53.431 INFO:teuthology.orchestra.run.smithi178.stdout:6 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 msgr2=0x7fa13c152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa13c152f50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa12c019000 tx=0x7fa12c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 shutdown_connections 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa13c066780 0x7fa13c150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa13c066300 0x7fa13c1500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 --2- 172.21.15.178:0/949514990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa120003a20 0x7fa13c152f50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 >> 172.21.15.178:0/949514990 conn(0x7fa13c06d530 msgr2=0x7fa13c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 shutdown_connections 2024-09-13T18:46:53.433 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.428+0000 7fa142600700 1 -- 172.21.15.178:0/949514990 wait complete. 2024-09-13T18:46:53.455 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new a84fab1f-403b-4f03-b474-0a2f131b25f4 7 2024-09-13T18:46:53.614 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:53.608+0000 7fd5d725f2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:46:53.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 Processor -- start 2024-09-13T18:46:53.616 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 -- start start 2024-09-13T18:46:53.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c2415cca0 0x7f8c2406a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.618 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c24066090 0x7f8c24066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2406ae20 con 0x7f8c240b3860 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c24066a60 con 0x7f8c2415cca0 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c29e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2406bca0 con 0x7f8c24066090 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c22000700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f8c240b3860 0x7f8c2406b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:59598/0 (socket says 172.21.15.178:59598) 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c22000700 1 -- 172.21.15.178:0/3088113069 learned_addr learned my addr 172.21.15.178:0/3088113069 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c23400700 1 --2- 172.21.15.178:0/3088113069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c24066090 0x7f8c24066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.619 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.612+0000 7f8c22a00700 1 --2- 172.21.15.178:0/3088113069 >> v2:172.21.15.81:3300/0 conn(0x7f8c2415cca0 0x7f8c2406a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c21600700 1 -- 172.21.15.178:0/3088113069 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666151454 0 0) 0x7f8c2406ae20 con 0x7f8c240b3860 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c21600700 1 -- 172.21.15.178:0/3088113069 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c080035d0 con 0x7f8c240b3860 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c23400700 1 -- 172.21.15.178:0/3088113069 >> v2:172.21.15.81:3300/0 conn(0x7f8c2415cca0 msgr2=0x7f8c2406a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c23400700 1 --2- 172.21.15.178:0/3088113069 >> v2:172.21.15.81:3300/0 conn(0x7f8c2415cca0 0x7f8c2406a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c23400700 1 -- 172.21.15.178:0/3088113069 >> v1:172.21.15.178:6789/0 conn(0x7f8c240b3860 legacy=0x7f8c2406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c23400700 1 -- 172.21.15.178:0/3088113069 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240b3ca0 con 0x7f8c24066090 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c22a00700 1 --2- 172.21.15.178:0/3088113069 >> v2:172.21.15.81:3300/0 conn(0x7f8c2415cca0 0x7f8c2406a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:53.621 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c23400700 1 --2- 172.21.15.178:0/3088113069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c24066090 0x7f8c24066520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009d90 tx=0x7f8c1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe7683b133a9bcf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c21600700 1 -- 172.21.15.178:0/3088113069 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00e070 con 0x7f8c24066090 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c21600700 1 -- 172.21.15.178:0/3088113069 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00bb20 con 0x7f8c24066090 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c21600700 1 -- 172.21.15.178:0/3088113069 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c00be90 con 0x7f8c24066090 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 -- 172.21.15.178:0/3088113069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c24066090 msgr2=0x7f8c24066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 --2- 172.21.15.178:0/3088113069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c24066090 0x7f8c24066520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009d90 tx=0x7f8c1c00b330 comp rx=0 tx=0).stop 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 -- 172.21.15.178:0/3088113069 shutdown_connections 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 --2- 172.21.15.178:0/3088113069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c24066090 0x7f8c24066520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 --2- 172.21.15.178:0/3088113069 >> v2:172.21.15.81:3300/0 conn(0x7f8c2415cca0 0x7f8c2406a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 -- 172.21.15.178:0/3088113069 >> 172.21.15.178:0/3088113069 conn(0x7f8c2406e660 msgr2=0x7f8c2406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 -- 172.21.15.178:0/3088113069 shutdown_connections 2024-09-13T18:46:53.622 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.616+0000 7f8c29e00700 1 -- 172.21.15.178:0/3088113069 wait complete. 2024-09-13T18:46:53.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 Processor -- start 2024-09-13T18:46:53.623 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 -- start start 2024-09-13T18:46:53.625 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c24066090 0x7f8c24147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 0x7f8c241547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c2415cca0 0x7f8c241f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24152d60 con 0x7f8c24066090 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24153040 con 0x7f8c240b3860 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c29e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24153320 con 0x7f8c2415cca0 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 0x7f8c241547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c23400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c2415cca0 0x7f8c241f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c24066090 0x7f8c24147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 0x7f8c241547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:51234/0 (socket says 172.21.15.178:51234) 2024-09-13T18:46:53.626 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 -- 172.21.15.178:0/1928361645 learned_addr learned my addr 172.21.15.178:0/1928361645 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 -- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c2415cca0 msgr2=0x7f8c241f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c2415cca0 0x7f8c241f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 -- 172.21.15.178:0/1928361645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c24066090 msgr2=0x7f8c24147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c24066090 0x7f8c24147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 -- 172.21.15.178:0/1928361645 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c009a70 con 0x7f8c240b3860 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.620+0000 7f8c22000700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 0x7f8c241547e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000c4d0 tx=0x7f8c1000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10005d90 con 0x7f8c240b3860 2024-09-13T18:46:53.628 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c100070d0 con 0x7f8c240b3860 2024-09-13T18:46:53.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c24153600 con 0x7f8c240b3860 2024-09-13T18:46:53.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10007480 con 0x7f8c240b3860 2024-09-13T18:46:53.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c24154d20 con 0x7f8c240b3860 2024-09-13T18:46:53.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8c10012400 con 0x7f8c240b3860 2024-09-13T18:46:53.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8c10012d10 con 0x7f8c240b3860 2024-09-13T18:46:53.629 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.624+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c24153b20 con 0x7f8c240b3860 2024-09-13T18:46:53.633 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.628+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8c24153b20 con 0x7f8c240b3860 2024-09-13T18:46:53.715 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.712+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a84fab1f-403b-4f03-b474-0a2f131b25f4", "id": 7} v 0) v1 -- 0x7f8c2406d0d0 con 0x7f8c240b3860 2024-09-13T18:46:53.723 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c1b400700 1 -- 172.21.15.178:0/1928361645 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a84fab1f-403b-4f03-b474-0a2f131b25f4", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c10021060 con 0x7f8c240b3860 2024-09-13T18:46:53.724 INFO:teuthology.orchestra.run.smithi178.stdout:7 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 msgr2=0x7f8c241547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 0x7f8c241547e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8c1000c4d0 tx=0x7f8c1000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 shutdown_connections 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c2415cca0 0x7f8c241f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c240b3860 0x7f8c241547e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 --2- 172.21.15.178:0/1928361645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c24066090 0x7f8c24147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 >> 172.21.15.178:0/1928361645 conn(0x7f8c2406e660 msgr2=0x7f8c240ad1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 shutdown_connections 2024-09-13T18:46:53.726 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-13T18:46:53.720+0000 7f8c29e00700 1 -- 172.21.15.178:0/1928361645 wait complete. 2024-09-13T18:46:53.744 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:46:53.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:46:53.750 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:46:53.750 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:46:53.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:46:53.756 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:46:53.756 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:46:53.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:46:53.759 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:46:53.760 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:46:53.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:46:53.764 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:46:53.764 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:46:53.764 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:46:53.770 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:46:53.770 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:46:53.770 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:46:53.776 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:46:53.776 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:46:53.776 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:46:53.780 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:46:53.780 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:46:53.781 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:46:53.786 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:46:53.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:46:53.788 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:53.779+0000 7f66714732c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:46:53.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712ec00700 1 Processor -- start 2024-09-13T18:46:53.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712ec00700 1 -- start start 2024-09-13T18:46:53.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f712815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712ec00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280b2ad0 con 0x7f71280cb020 2024-09-13T18:46:53.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712ec00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71280ccb10 con 0x7f712806aaa0 2024-09-13T18:46:53.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712815b960 con 0x7f71280cc6f0 2024-09-13T18:46:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712d800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71280cb020 0x7f712815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38850/0 (socket says 172.21.15.81:38850) 2024-09-13T18:46:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.967+0000 7f712d800700 1 -- 172.21.15.81:0/1541789826 learned_addr learned my addr 172.21.15.81:0/1541789826 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:46:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f712815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709146275 0 0) 0x7f71280b2ad0 con 0x7f71280cb020 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71100035d0 con 0x7f71280cb020 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749936852 0 0) 0x7f71280ccb10 con 0x7f712806aaa0 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71280b2ad0 con 0x7f712806aaa0 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829911887 0 0) 0x7f71100035d0 con 0x7f71280cb020 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 msgr2=0x7f712815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f712815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 >> v1:172.21.15.178:6789/0 conn(0x7f712806aaa0 legacy=0x7f71280b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712815bc40 con 0x7f71280cb020 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f711c001670 con 0x7f71280cb020 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 >> v1:172.21.15.81:6789/0 conn(0x7f71280cb020 legacy=0x7f712815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f7110003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71100041b0 0x7f7110004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7110004db0 0x7f7110005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712815b960 con 0x7f71100041b0 2024-09-13T18:46:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711000bb70 con 0x7f7110004db0 2024-09-13T18:46:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711000bd30 con 0x7f71280cc6f0 2024-09-13T18:46:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71100041b0 0x7f7110004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712e200700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7110004db0 0x7f7110005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712d800700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f7110003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 -- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 msgr2=0x7f7110003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f7110003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 -- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7110004db0 msgr2=0x7f7110005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7110004db0 0x7f7110005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 -- 172.21.15.81:0/1541789826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100035d0 con 0x7f71100041b0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712d800700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71280cc6f0 0x7f7110003c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f712ce00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71100041b0 0x7f7110004870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7118009b40 tx=0x7f71100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f7b25e5be5b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800e6c0 con 0x7f71100041b0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800e820 con 0x7f71100041b0 2024-09-13T18:46:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.971+0000 7f7127e00700 1 -- 172.21.15.81:0/1541789826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800eb90 con 0x7f71100041b0 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 -- 172.21.15.81:0/1541789826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71100041b0 msgr2=0x7f7110004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 --2- 172.21.15.81:0/1541789826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71100041b0 0x7f7110004870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7118009b40 tx=0x7f71100058a0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712e200700 1 -- 172.21.15.81:0/1541789826 reap_dead start 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 -- 172.21.15.81:0/1541789826 shutdown_connections 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 -- 172.21.15.81:0/1541789826 >> 172.21.15.81:0/1541789826 conn(0x7f71280b0c40 msgr2=0x7f712806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 -- 172.21.15.81:0/1541789826 shutdown_connections 2024-09-13T18:46:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 -- 172.21.15.81:0/1541789826 wait complete. 2024-09-13T18:46:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 Processor -- start 2024-09-13T18:46:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.975+0000 7f712ec00700 1 -- start start 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71100041b0 0x7f71280719a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 0x7f712813b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f712813d9b0 0x7f712813de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712813e370 con 0x7f712813bff0 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71280710b0 con 0x7f71100041b0 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712813bda0 con 0x7f712813d9b0 2024-09-13T18:46:53.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 0x7f712813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 0x7f712813b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56598/0 (socket says 172.21.15.81:56598) 2024-09-13T18:46:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 -- 172.21.15.81:0/1402907490 learned_addr learned my addr 172.21.15.81:0/1402907490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:46:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712e200700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f712813d9b0 0x7f712813de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712d800700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71100041b0 0x7f71280719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 -- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f712813d9b0 msgr2=0x7f712813de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f712813d9b0 0x7f712813de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 -- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71100041b0 msgr2=0x7f71280719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71100041b0 0x7f71280719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:53.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 -- 172.21.15.81:0/1402907490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71280708d0 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712d800700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71100041b0 0x7f71280719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ce00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 0x7f712813b860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f711000bb40 tx=0x7f71180047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7118013d60 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7118009eb0 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71280ca0a0 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711801c670 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71280ca660 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f711801cad0 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.979+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f711802fde0 con 0x7f712813bff0 2024-09-13T18:46:53.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.983+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71280ca880 con 0x7f712813bff0 2024-09-13T18:46:53.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:53.987+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7118034060 con 0x7f712813bff0 2024-09-13T18:46:54.080 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:54.076+0000 7fd5d725f2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:46:54.110 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:54.099+0000 7f66714732c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:46:54.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.107+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71280b3d30 con 0x7f712813bff0 2024-09-13T18:46:54.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f7125600700 1 -- 172.21.15.81:0/1402907490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7118017070 con 0x7f712813bff0 2024-09-13T18:46:54.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:46:54.119 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:46:53.713140+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 msgr2=0x7f712813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 0x7f712813b860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f711000bb40 tx=0x7f71180047e0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 shutdown_connections 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f712813d9b0 0x7f712813de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f712813bff0 0x7f712813b860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 --2- 172.21.15.81:0/1402907490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71100041b0 0x7f71280719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 >> 172.21.15.81:0/1402907490 conn(0x7f71280b0c40 msgr2=0x7f71280cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 shutdown_connections 2024-09-13T18:46:54.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:46:54.111+0000 7f712ec00700 1 -- 172.21.15.81:0/1402907490 wait complete. 2024-09-13T18:46:54.145 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:46:54.145 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:46:54.210 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:54.203+0000 7f66714732c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:46:54.323 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:54.316+0000 7fd5d725f2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:46:54.414 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:54.407+0000 7f66714732c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:46:54.417 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:54.412+0000 7fd5d725f2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:46:54.436 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T18:46:54.427+0000 7fd9f77cd880 -1 Falling back to public interface 2024-09-13T18:46:54.437 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-13T18:46:54.432+0000 7f7ae4a26880 -1 Falling back to public interface 2024-09-13T18:46:54.437 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-13T18:46:54.432+0000 7f7b3e4ba880 -1 Falling back to public interface 2024-09-13T18:46:54.440 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T18:46:54.431+0000 7f9fdbba2880 -1 Falling back to public interface 2024-09-13T18:46:54.447 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-13T18:46:54.444+0000 7f0f3342a880 -1 Falling back to public interface 2024-09-13T18:46:54.454 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T18:46:54.447+0000 7f231b264880 -1 Falling back to public interface 2024-09-13T18:46:54.468 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-13T18:46:54.464+0000 7eff27358880 -1 Falling back to public interface 2024-09-13T18:46:54.478 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T18:46:54.471+0000 7f40f5588880 -1 Falling back to public interface 2024-09-13T18:46:54.625 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:54.620+0000 7fd5d725f2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:46:54.951 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:46:55.093 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.083+0000 7f5885400700 1 Processor -- start 2024-09-13T18:46:55.093 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f5885400700 1 -- start start 2024-09-13T18:46:55.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f5885400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 0x7f58800714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:55.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f5885400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5880070dc0 0x7f588006c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:55.096 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f5885400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880156ef0 con 0x7f58800b2530 2024-09-13T18:46:55.097 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f5885400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588015da30 con 0x7f5880070dc0 2024-09-13T18:46:55.097 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f5885400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588006cce0 con 0x7f588006c3c0 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f587fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 0x7f58800714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f587fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 0x7f58800714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48426/0 (socket says 172.21.15.81:48426) 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f587fe00700 1 -- 172.21.15.81:0/1023215753 learned_addr learned my addr 172.21.15.81:0/1023215753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.087+0000 7f587f400700 1 --2- 172.21.15.81:0/1023215753 >> v2:172.21.15.81:3300/0 conn(0x7f5880070dc0 0x7f588006c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587fe00700 1 -- 172.21.15.81:0/1023215753 >> v2:172.21.15.81:3300/0 conn(0x7f5880070dc0 msgr2=0x7f588006c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587fe00700 1 --2- 172.21.15.81:0/1023215753 >> v2:172.21.15.81:3300/0 conn(0x7f5880070dc0 0x7f588006c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587fe00700 1 -- 172.21.15.81:0/1023215753 >> v1:172.21.15.178:6789/0 conn(0x7f58800b2530 legacy=0x7f58800b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587fe00700 1 -- 172.21.15.81:0/1023215753 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588015ceb0 con 0x7f588006c3c0 2024-09-13T18:46:55.098 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587fe00700 1 --2- 172.21.15.81:0/1023215753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 0x7f58800714e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5870009910 tx=0x7f5870009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4d74e8a9370edef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:55.099 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587ea00700 1 -- 172.21.15.81:0/1023215753 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000ba60 con 0x7f588006c3c0 2024-09-13T18:46:55.099 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587ea00700 1 -- 172.21.15.81:0/1023215753 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587000bbc0 con 0x7f588006c3c0 2024-09-13T18:46:55.099 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f587ea00700 1 -- 172.21.15.81:0/1023215753 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870009e60 con 0x7f588006c3c0 2024-09-13T18:46:55.099 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 -- 172.21.15.81:0/1023215753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 msgr2=0x7f58800714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 --2- 172.21.15.81:0/1023215753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 0x7f58800714e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5870009910 tx=0x7f5870009c20 comp rx=0 tx=0).stop 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 -- 172.21.15.81:0/1023215753 shutdown_connections 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 --2- 172.21.15.81:0/1023215753 >> v2:172.21.15.81:3300/0 conn(0x7f5880070dc0 0x7f588006c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 --2- 172.21.15.81:0/1023215753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f588006c3c0 0x7f58800714e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 -- 172.21.15.81:0/1023215753 >> 172.21.15.81:0/1023215753 conn(0x7f588006a390 msgr2=0x7f588006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 -- 172.21.15.81:0/1023215753 shutdown_connections 2024-09-13T18:46:55.100 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 -- 172.21.15.81:0/1023215753 wait complete. 2024-09-13T18:46:55.101 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.091+0000 7f5885400700 1 Processor -- start 2024-09-13T18:46:55.101 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 -- start start 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f588006c3c0 0x7f58800cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5880070dc0 0x7f5880151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58800b2530 0x7f5880151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800acd70 con 0x7f5880070dc0 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800ad050 con 0x7f588006c3c0 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800ad330 con 0x7f58800b2530 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f587f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5880070dc0 0x7f5880151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f587f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5880070dc0 0x7f5880151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56608/0 (socket says 172.21.15.81:56608) 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f587f400700 1 -- 172.21.15.81:0/305209027 learned_addr learned my addr 172.21.15.81:0/305209027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58800b2530 0x7f5880151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:55.103 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f587fe00700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f588006c3c0 0x7f58800cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 -- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f588006c3c0 msgr2=0x7f58800cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f588006c3c0 0x7f58800cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 -- 172.21.15.81:0/305209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5880070dc0 msgr2=0x7f5880151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5880070dc0 0x7f5880151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 -- 172.21.15.81:0/305209027 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870009570 con 0x7f58800b2530 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5884a00700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58800b2530 0x7f5880151c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f587800cae0 tx=0x7f587800cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878003c20 con 0x7f58800b2530 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878003d80 con 0x7f58800b2530 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587800aa20 con 0x7f58800b2530 2024-09-13T18:46:55.105 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58800ad610 con 0x7f58800b2530 2024-09-13T18:46:55.106 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58800ce1e0 con 0x7f58800b2530 2024-09-13T18:46:55.106 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f58780050d0 con 0x7f58800b2530 2024-09-13T18:46:55.106 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.095+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f58780124c0 con 0x7f58800b2530 2024-09-13T18:46:55.106 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.099+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58800705e0 con 0x7f58800b2530 2024-09-13T18:46:55.110 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.103+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f58800ce1e0 con 0x7f58800b2530 2024-09-13T18:46:55.181 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:55.171+0000 7f66714732c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:46:55.181 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.175+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58800cee50 con 0x7f58800b2530 2024-09-13T18:46:55.183 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.175+0000 7f5877e00700 1 -- 172.21.15.81:0/305209027 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5880156ef0 con 0x7f58800b2530 2024-09-13T18:46:55.183 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-13T18:46:55.183 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:46:53.713140+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:46:55.185 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.175+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58800b2530 msgr2=0x7f5880151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:55.185 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.175+0000 7f5885400700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58800b2530 0x7f5880151c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f587800cae0 tx=0x7f587800cdf0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.185 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 shutdown_connections 2024-09-13T18:46:55.185 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58800b2530 0x7f5880151c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.186 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5880070dc0 0x7f5880151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.186 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 --2- 172.21.15.81:0/305209027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f588006c3c0 0x7f58800cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:55.186 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 >> 172.21.15.81:0/305209027 conn(0x7f588006a390 msgr2=0x7f58800b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:55.186 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 shutdown_connections 2024-09-13T18:46:55.186 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:46:55.179+0000 7f5885400700 1 -- 172.21.15.81:0/305209027 wait complete. 2024-09-13T18:46:55.206 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:46:55.271 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:55.263+0000 7f66714732c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:46:55.271 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:55.268+0000 7fd5d725f2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:46:55.360 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:55.356+0000 7fd5d725f2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:46:55.466 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:55.459+0000 7f66714732c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:46:55.534 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:55.528+0000 7fd5d725f2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:46:55.558 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:55.551+0000 7f66714732c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:46:55.621 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:55.616+0000 7fd5d725f2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:46:55.651 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:55.643+0000 7f66714732c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:46:55.717 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:55.712+0000 7fd5d725f2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:46:56.030 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:56.023+0000 7f66714732c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:46:56.079 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:56.072+0000 7fd5d725f2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:46:56.125 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:56.115+0000 7f66714732c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:46:56.172 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:56.168+0000 7fd5d725f2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:46:56.947 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:56.939+0000 7f66714732c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:46:56.992 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-13T18:46:56.988+0000 7fd5d725f2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:46:57.981 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:57.975+0000 7f6657c00700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:46:57.983 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-13T18:46:57.975+0000 7f6657c00700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:46:58.394 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-13T18:46:58.392+0000 7f7ae4a26880 -1 osd.6 0 log_to_monitors true 2024-09-13T18:46:58.449 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T18:46:58.443+0000 7f9fdbba2880 -1 osd.2 0 log_to_monitors true 2024-09-13T18:46:58.473 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T18:46:58.463+0000 7f231b264880 -1 osd.3 0 log_to_monitors true 2024-09-13T18:46:58.473 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T18:46:58.463+0000 7fd9f77cd880 -1 osd.0 0 log_to_monitors true 2024-09-13T18:46:58.526 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-13T18:46:58.520+0000 7f0f3342a880 -1 osd.7 0 log_to_monitors true 2024-09-13T18:46:58.579 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T18:46:58.571+0000 7f40f5588880 -1 osd.1 0 log_to_monitors true 2024-09-13T18:46:58.708 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-13T18:46:58.700+0000 7f7b3e4ba880 -1 osd.4 0 log_to_monitors true 2024-09-13T18:46:58.752 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-13T18:46:58.748+0000 7eff27358880 -1 osd.5 0 log_to_monitors true 2024-09-13T18:47:01.750 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-13T18:47:01.744+0000 7f7b39400700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:47:01.761 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-13T18:47:01.756+0000 7f7b2f000700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:01.779 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-13T18:47:01.772+0000 7eff22200700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:47:01.782 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-13T18:47:01.780+0000 7f7adf800700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:47:01.784 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-13T18:47:01.780+0000 7eff17e00700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:01.787 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-13T18:47:01.784+0000 7f0f2e200700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:47:01.791 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-13T18:47:01.788+0000 7f7ad5400700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:01.794 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-13T18:47:01.788+0000 7f0f23e00700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:02.013 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:02.216 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.207+0000 7f00a9e00700 1 Processor -- start 2024-09-13T18:47:02.216 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.207+0000 7f00a9e00700 1 -- start start 2024-09-13T18:47:02.219 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a9e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f009c03ab20 0x7f009c00b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.219 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a9e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f009c056380 0x7f009c008190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.219 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a9e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c008e20 con 0x7f009c0dfa70 2024-09-13T18:47:02.219 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a9e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c03b2c0 con 0x7f009c03ab20 2024-09-13T18:47:02.220 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a9e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c00ce40 con 0x7f009c056380 2024-09-13T18:47:02.220 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f009c0dfa70 0x7f009c03a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:51500/0 (socket says 172.21.15.81:51500) 2024-09-13T18:47:02.220 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2a00700 1 -- 172.21.15.81:0/683336587 learned_addr learned my addr 172.21.15.81:0/683336587 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:02.220 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2000700 1 --2- 172.21.15.81:0/683336587 >> v2:172.21.15.81:3300/0 conn(0x7f009c03ab20 0x7f009c00b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.220 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a3400700 1 --2- 172.21.15.81:0/683336587 >> v2:172.21.15.178:3300/0 conn(0x7f009c056380 0x7f009c008190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.220 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a1600700 1 -- 172.21.15.81:0/683336587 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242394826 0 0) 0x7f009c008e20 con 0x7f009c0dfa70 2024-09-13T18:47:02.221 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a1600700 1 -- 172.21.15.81:0/683336587 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00880035d0 con 0x7f009c0dfa70 2024-09-13T18:47:02.221 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2000700 1 -- 172.21.15.81:0/683336587 >> v2:172.21.15.178:3300/0 conn(0x7f009c056380 msgr2=0x7f009c008190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:02.221 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2000700 1 --2- 172.21.15.81:0/683336587 >> v2:172.21.15.178:3300/0 conn(0x7f009c056380 0x7f009c008190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.221 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2000700 1 -- 172.21.15.81:0/683336587 >> v1:172.21.15.178:6789/0 conn(0x7f009c0dfa70 legacy=0x7f009c03a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.221 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.211+0000 7f00a2000700 1 -- 172.21.15.81:0/683336587 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c03afe0 con 0x7f009c03ab20 2024-09-13T18:47:02.221 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a2000700 1 --2- 172.21.15.81:0/683336587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c03ab20 0x7f009c00b130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f009c00b6a0 tx=0x7f0090009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab7aba555f3602 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:02.222 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a1600700 1 -- 172.21.15.81:0/683336587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00940017f0 con 0x7f009c03ab20 2024-09-13T18:47:02.222 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a1600700 1 -- 172.21.15.81:0/683336587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0090010590 con 0x7f009c03ab20 2024-09-13T18:47:02.222 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a1600700 1 -- 172.21.15.81:0/683336587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00940017f0 con 0x7f009c03ab20 2024-09-13T18:47:02.223 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 -- 172.21.15.81:0/683336587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c03ab20 msgr2=0x7f009c00b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.223 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 --2- 172.21.15.81:0/683336587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c03ab20 0x7f009c00b130 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f009c00b6a0 tx=0x7f0090009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:02.225 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 -- 172.21.15.81:0/683336587 shutdown_connections 2024-09-13T18:47:02.225 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 --2- 172.21.15.81:0/683336587 >> v2:172.21.15.178:3300/0 conn(0x7f009c056380 0x7f009c008190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.225 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 --2- 172.21.15.81:0/683336587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c03ab20 0x7f009c00b130 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.225 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 -- 172.21.15.81:0/683336587 >> 172.21.15.81:0/683336587 conn(0x7f009c01eaf0 msgr2=0x7f009c055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:02.225 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 -- 172.21.15.81:0/683336587 shutdown_connections 2024-09-13T18:47:02.225 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.215+0000 7f00a9e00700 1 -- 172.21.15.81:0/683336587 wait complete. 2024-09-13T18:47:02.227 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.219+0000 7f00a9e00700 1 Processor -- start 2024-09-13T18:47:02.228 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.219+0000 7f00a9e00700 1 -- start start 2024-09-13T18:47:02.229 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a9e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 0x7f009c0487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.229 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c056380 0x7f009c0db910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.230 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f009c0dfa70 0x7f009c054720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.230 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a9e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c04cb80 con 0x7f009c056380 2024-09-13T18:47:02.230 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a9e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0dbe50 con 0x7f009c0dfa70 2024-09-13T18:47:02.230 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a9e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0dc250 con 0x7f009c03ab20 2024-09-13T18:47:02.230 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 0x7f009c0487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.230 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c056380 0x7f009c0db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.231 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 0x7f009c0487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48988/0 (socket says 172.21.15.81:48988) 2024-09-13T18:47:02.231 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 -- 172.21.15.81:0/878996947 learned_addr learned my addr 172.21.15.81:0/878996947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:02.231 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a3400700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f009c0dfa70 0x7f009c054720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.231 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 -- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f009c0dfa70 msgr2=0x7f009c054720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.231 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f009c0dfa70 0x7f009c054720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.232 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 -- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c056380 msgr2=0x7f009c0db910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.232 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c056380 0x7f009c0db910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.232 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 -- 172.21.15.81:0/878996947 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00900094b0 con 0x7f009c03ab20 2024-09-13T18:47:02.232 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a3400700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f009c0dfa70 0x7f009c054720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:02.232 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.223+0000 7f00a2a00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 0x7f009c0487d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f009400c750 tx=0x7f009400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:02.236 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.227+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00940074e0 con 0x7f009c03ab20 2024-09-13T18:47:02.236 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.227+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0094007660 con 0x7f009c03ab20 2024-09-13T18:47:02.236 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.227+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094005a90 con 0x7f009c03ab20 2024-09-13T18:47:02.236 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.227+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c037a70 con 0x7f009c03ab20 2024-09-13T18:47:02.236 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.227+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c038030 con 0x7f009c03ab20 2024-09-13T18:47:02.237 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.227+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c01f250 con 0x7f009c03ab20 2024-09-13T18:47:02.239 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.231+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f0094005bf0 con 0x7f009c03ab20 2024-09-13T18:47:02.240 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.231+0000 7f009b400700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0084066770 0x7f0084068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:02.241 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.231+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f0094082df0 con 0x7f009c03ab20 2024-09-13T18:47:02.241 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.235+0000 7f00a2000700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0084066770 0x7f0084068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:02.243 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.235+0000 7f00a2000700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0084066770 0x7f0084068c30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0090013040 tx=0x7f0090008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:02.248 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.239+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0094051040 con 0x7f009c03ab20 2024-09-13T18:47:02.375 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T18:47:02.367+0000 7f9fd7400700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:47:02.393 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-13T18:47:02.383+0000 7f9fcc600700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:02.529 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T18:47:02.519+0000 7f2316200700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:47:02.533 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T18:47:02.523+0000 7fd9f2600700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:47:02.538 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-13T18:47:02.531+0000 7f230be00700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:02.538 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-13T18:47:02.531+0000 7fd9e8200700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:02.564 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.555+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f009c034ea0 con 0x7f009c03ab20 2024-09-13T18:47:02.564 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T18:47:02.555+0000 7f40f0e00700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:47:02.565 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.555+0000 7f009b400700 1 -- 172.21.15.81:0/878996947 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0094017030 con 0x7f009c03ab20 2024-09-13T18:47:02.565 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-13T18:47:02.565 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:00.016825+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:02.567 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0084066770 msgr2=0x7f0084068c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.568 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0084066770 0x7f0084068c30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0090013040 tx=0x7f0090008000 comp rx=0 tx=0).stop 2024-09-13T18:47:02.568 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 msgr2=0x7f009c0487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:02.568 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 0x7f009c0487d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f009400c750 tx=0x7f009400ca60 comp rx=0 tx=0).stop 2024-09-13T18:47:02.568 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 shutdown_connections 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0084066770 0x7f0084068c30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f009c0dfa70 0x7f009c054720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009c056380 0x7f009c0db910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 --2- 172.21.15.81:0/878996947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f009c03ab20 0x7f009c0487d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 >> 172.21.15.81:0/878996947 conn(0x7f009c01eaf0 msgr2=0x7f009c032d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 shutdown_connections 2024-09-13T18:47:02.569 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:02.559+0000 7f00a9e00700 1 -- 172.21.15.81:0/878996947 wait complete. 2024-09-13T18:47:02.574 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-13T18:47:02.567+0000 7f40e6000700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:47:02.584 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:47:09.391 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:09.544 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 Processor -- start 2024-09-13T18:47:09.544 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 -- start start 2024-09-13T18:47:09.545 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5e7c15dca0 0x7f5e7c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.545 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06cbe0 0x7f5e7c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.545 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7c0ce120 con 0x7f5e7c0cc290 2024-09-13T18:47:09.545 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0b25b0 con 0x7f5e7c06cbe0 2024-09-13T18:47:09.545 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.534+0000 7f5e82a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0cc6d0 con 0x7f5e7c15dca0 2024-09-13T18:47:09.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e80c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5e7c0cc290 0x7f5e7c06c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32870/0 (socket says 172.21.15.81:32870) 2024-09-13T18:47:09.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e80c00700 1 -- 172.21.15.81:0/1735275183 learned_addr learned my addr 172.21.15.81:0/1735275183 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:09.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e81600700 1 --2- 172.21.15.81:0/1735275183 >> v2:172.21.15.178:3300/0 conn(0x7f5e7c15dca0 0x7f5e7c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e82000700 1 --2- 172.21.15.81:0/1735275183 >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06cbe0 0x7f5e7c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e7be00700 1 -- 172.21.15.81:0/1735275183 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175740797 0 0) 0x7f5e7c0ce120 con 0x7f5e7c0cc290 2024-09-13T18:47:09.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e7be00700 1 -- 172.21.15.81:0/1735275183 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e640035d0 con 0x7f5e7c0cc290 2024-09-13T18:47:09.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e81600700 1 -- 172.21.15.81:0/1735275183 >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06cbe0 msgr2=0x7f5e7c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:09.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e81600700 1 --2- 172.21.15.81:0/1735275183 >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06cbe0 0x7f5e7c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e81600700 1 -- 172.21.15.81:0/1735275183 >> v1:172.21.15.81:6789/0 conn(0x7f5e7c0cc290 legacy=0x7f5e7c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e81600700 1 -- 172.21.15.81:0/1735275183 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c06d100 con 0x7f5e7c15dca0 2024-09-13T18:47:09.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e82000700 1 --2- 172.21.15.81:0/1735275183 >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06cbe0 0x7f5e7c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:09.548 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e81600700 1 --2- 172.21.15.81:0/1735275183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0cbd50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0b1e50 tx=0x7f5e70009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b3059b579e322b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.549 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e7be00700 1 -- 172.21.15.81:0/1735275183 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70011830 con 0x7f5e7c15dca0 2024-09-13T18:47:09.549 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e7be00700 1 -- 172.21.15.81:0/1735275183 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e70011990 con 0x7f5e7c15dca0 2024-09-13T18:47:09.549 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.538+0000 7f5e7be00700 1 -- 172.21.15.81:0/1735275183 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70011d20 con 0x7f5e7c15dca0 2024-09-13T18:47:09.549 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 -- 172.21.15.81:0/1735275183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c15dca0 msgr2=0x7f5e7c0cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.549 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 --2- 172.21.15.81:0/1735275183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0cbd50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0b1e50 tx=0x7f5e70009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:09.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 -- 172.21.15.81:0/1735275183 shutdown_connections 2024-09-13T18:47:09.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 --2- 172.21.15.81:0/1735275183 >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06cbe0 0x7f5e7c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 --2- 172.21.15.81:0/1735275183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0cbd50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 -- 172.21.15.81:0/1735275183 >> 172.21.15.81:0/1735275183 conn(0x7f5e7c06a390 msgr2=0x7f5e7c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:09.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 -- 172.21.15.81:0/1735275183 shutdown_connections 2024-09-13T18:47:09.550 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 -- 172.21.15.81:0/1735275183 wait complete. 2024-09-13T18:47:09.552 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 Processor -- start 2024-09-13T18:47:09.553 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.542+0000 7f5e82a00700 1 -- start start 2024-09-13T18:47:09.554 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c06cbe0 0x7f5e7c071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.554 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0cc290 0x7f5e7c0ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.554 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.554 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c14e5d0 con 0x7f5e7c15dca0 2024-09-13T18:47:09.555 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c070090 con 0x7f5e7c06cbe0 2024-09-13T18:47:09.555 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c070370 con 0x7f5e7c0cc290 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53172/0 (socket says 172.21.15.81:53172) 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 -- 172.21.15.81:0/2577416257 learned_addr learned my addr 172.21.15.81:0/2577416257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e81600700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c06cbe0 0x7f5e7c071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e80c00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0cc290 0x7f5e7c0ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 -- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0cc290 msgr2=0x7f5e7c0ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0cc290 0x7f5e7c0ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 -- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c06cbe0 msgr2=0x7f5e7c071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c06cbe0 0x7f5e7c071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.556 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 -- 172.21.15.81:0/2577416257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74009a70 con 0x7f5e7c15dca0 2024-09-13T18:47:09.557 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82000700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0c7d00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400efb0 tx=0x7f5e7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.561 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400cd40 con 0x7f5e7c15dca0 2024-09-13T18:47:09.561 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400f040 con 0x7f5e7c15dca0 2024-09-13T18:47:09.561 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e700094b0 con 0x7f5e7c15dca0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7400cea0 con 0x7f5e7c15dca0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.546+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c070930 con 0x7f5e7c15dca0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.550+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c0cbd50 con 0x7f5e7c15dca0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.550+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e740146a0 con 0x7f5e7c15dca0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.550+0000 7f5e79600700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e5c066730 0x7f5e5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.550+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e74084f70 con 0x7f5e7c15dca0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.550+0000 7f5e81600700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e5c066730 0x7f5e5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.562 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.554+0000 7f5e81600700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e5c066730 0x7f5e5c068bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000c00 tx=0x7f5e70008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.568 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.558+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e740526a0 con 0x7f5e7c15dca0 2024-09-13T18:47:09.754 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.746+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e7c15ab50 con 0x7f5e7c15dca0 2024-09-13T18:47:09.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.746+0000 7f5e79600700 1 -- 172.21.15.81:0/2577416257 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f5e74018090 con 0x7f5e7c15dca0 2024-09-13T18:47:09.757 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-13T18:47:09.757 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:05.768791+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e5c066730 msgr2=0x7f5e5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e5c066730 0x7f5e5c068bf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000c00 tx=0x7f5e70008030 comp rx=0 tx=0).stop 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 msgr2=0x7f5e7c0c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0c7d00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5e7400efb0 tx=0x7f5e7400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 shutdown_connections 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e5c066730 0x7f5e5c068bf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c15dca0 0x7f5e7c0c7d00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.761 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0cc290 0x7f5e7c0ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.761 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 --2- 172.21.15.81:0/2577416257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c06cbe0 0x7f5e7c071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.761 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 >> 172.21.15.81:0/2577416257 conn(0x7f5e7c06a390 msgr2=0x7f5e7c0ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:09.761 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 shutdown_connections 2024-09-13T18:47:09.761 INFO:teuthology.misc.health.smithi081.stderr:2024-09-13T18:47:09.750+0000 7f5e82a00700 1 -- 172.21.15.81:0/2577416257 wait complete. 2024-09-13T18:47:09.780 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:47:09.781 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:47:09.781 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:47:09.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:47:09.787 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:47:09.788 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:47:09.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:47:09.791 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:47:09.792 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:47:09.792 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:47:09.797 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:47:09.797 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:47:09.798 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:47:09.803 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:47:09.803 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:47:09.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:09.906 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:47:09.914 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:47:09.916 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:47:09.918 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:47:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 Processor -- start 2024-09-13T18:47:09.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 -- start start 2024-09-13T18:47:09.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c806aaa0 0x7fb1c815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c815e9f0 0x7fb1c815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c815e560 con 0x7fb1c80b3980 2024-09-13T18:47:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80adf90 con 0x7fb1c815e9f0 2024-09-13T18:47:09.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1ce200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c815d920 con 0x7fb1c806aaa0 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c815e9f0 0x7fb1c815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1c815e9f0 0x7fb1c815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53226/0 (socket says 172.21.15.81:53226) 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 -- 172.21.15.81:0/2724666272 learned_addr learned my addr 172.21.15.81:0/2724666272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cce00700 1 --2- 172.21.15.81:0/2724666272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c806aaa0 0x7fb1c815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 -- 172.21.15.81:0/2724666272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c806aaa0 msgr2=0x7fb1c815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 --2- 172.21.15.81:0/2724666272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c806aaa0 0x7fb1c815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 -- 172.21.15.81:0/2724666272 >> v1:172.21.15.178:6789/0 conn(0x7fb1c80b3980 legacy=0x7fb1c806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.954+0000 7fb1cd800700 1 -- 172.21.15.81:0/2724666272 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c815dc00 con 0x7fb1c815e9f0 2024-09-13T18:47:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1cd800700 1 --2- 172.21.15.81:0/2724666272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c815e9f0 0x7fb1c815eea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009e80 tx=0x7fb1c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0527963ebf8a915 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1c7400700 1 -- 172.21.15.81:0/2724666272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000e070 con 0x7fb1c815e9f0 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1c7400700 1 -- 172.21.15.81:0/2724666272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000b980 con 0x7fb1c815e9f0 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1c7400700 1 -- 172.21.15.81:0/2724666272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000bd30 con 0x7fb1c815e9f0 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 -- 172.21.15.81:0/2724666272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c815e9f0 msgr2=0x7fb1c815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 --2- 172.21.15.81:0/2724666272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c815e9f0 0x7fb1c815eea0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009e80 tx=0x7fb1c000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 -- 172.21.15.81:0/2724666272 shutdown_connections 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 --2- 172.21.15.81:0/2724666272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c815e9f0 0x7fb1c815eea0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 --2- 172.21.15.81:0/2724666272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c806aaa0 0x7fb1c815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 -- 172.21.15.81:0/2724666272 >> 172.21.15.81:0/2724666272 conn(0x7fb1c80b0c40 msgr2=0x7fb1c806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 -- 172.21.15.81:0/2724666272 shutdown_connections 2024-09-13T18:47:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.958+0000 7fb1ce200700 1 -- 172.21.15.81:0/2724666272 wait complete. 2024-09-13T18:47:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 Processor -- start 2024-09-13T18:47:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 -- start start 2024-09-13T18:47:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1c806aaa0 0x7fb1c80cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 0x7fb1c806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c815e9f0 0x7fb1c812df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c812ef50 con 0x7fb1c80b3980 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80ce210 con 0x7fb1c806aaa0 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1ce200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80ccf50 con 0x7fb1c815e9f0 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 0x7fb1c806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 0x7fb1c806c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53236/0 (socket says 172.21.15.81:53236) 2024-09-13T18:47:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 -- 172.21.15.81:0/609149768 learned_addr learned my addr 172.21.15.81:0/609149768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1cd800700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c815e9f0 0x7fb1c812df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1cce00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1c806aaa0 0x7fb1c80cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 -- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c815e9f0 msgr2=0x7fb1c812df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c815e9f0 0x7fb1c812df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 -- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1c806aaa0 msgr2=0x7fb1c80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1c806aaa0 0x7fb1c80cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1c7e00700 1 -- 172.21.15.81:0/609149768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c0009b30 con 0x7fb1c80b3980 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.962+0000 7fb1cd800700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c815e9f0 0x7fb1c812df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1c7e00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 0x7fb1c806c7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800c4d0 tx=0x7fb1b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80052d0 con 0x7fb1c80b3980 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8005430 con 0x7fb1c80b3980 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80055a0 con 0x7fb1c80b3980 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c80cd1f0 con 0x7fb1c80b3980 2024-09-13T18:47:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80cd7b0 con 0x7fb1c80b3980 2024-09-13T18:47:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c812ecd0 con 0x7fb1c80b3980 2024-09-13T18:47:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.966+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1b80038c0 con 0x7fb1c80b3980 2024-09-13T18:47:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.970+0000 7fb1c4c00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1ac066730 0x7fb1ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.970+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb1b8083490 con 0x7fb1c80b3980 2024-09-13T18:47:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.970+0000 7fb1cce00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1ac066730 0x7fb1ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.970+0000 7fb1cce00700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1ac066730 0x7fb1ac068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009950 tx=0x7fb1bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:09.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:09.974+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1b80509a0 con 0x7fb1c80b3980 2024-09-13T18:47:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.158+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1c815d310 con 0x7fb1c80b3980 2024-09-13T18:47:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.162+0000 7fb1c4c00700 1 -- 172.21.15.81:0/609149768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fb1b8053fc0 con 0x7fb1c80b3980 2024-09-13T18:47:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:10.782 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:05.768791+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1ac066730 msgr2=0x7fb1ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1ac066730 0x7fb1ac068bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009950 tx=0x7fb1bc008040 comp rx=0 tx=0).stop 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 msgr2=0x7fb1c806c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 0x7fb1c806c7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800c4d0 tx=0x7fb1b800c890 comp rx=0 tx=0).stop 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 shutdown_connections 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1ac066730 0x7fb1ac068bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1c815e9f0 0x7fb1c812df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1c80b3980 0x7fb1c806c7c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 --2- 172.21.15.81:0/609149768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1c806aaa0 0x7fb1c80cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 >> 172.21.15.81:0/609149768 conn(0x7fb1c80b0c40 msgr2=0x7fb1c80ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 shutdown_connections 2024-09-13T18:47:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.166+0000 7fb1ce200700 1 -- 172.21.15.81:0/609149768 wait complete. 2024-09-13T18:47:10.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:10.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 Processor -- start 2024-09-13T18:47:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 -- start start 2024-09-13T18:47:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33ac161150 0x7f33ac06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0ce900 0x7f33ac0cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:10.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0b3a70 con 0x7f33ac0cb900 2024-09-13T18:47:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0cbd40 con 0x7f33ac161150 2024-09-13T18:47:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33abe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0cee70 con 0x7f33ac0ce900 2024-09-13T18:47:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33ab400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33ac0cb900 0x7f33ac0cd080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32886/0 (socket says 172.21.15.81:32886) 2024-09-13T18:47:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33ab400700 1 -- 172.21.15.81:0/2810979787 learned_addr learned my addr 172.21.15.81:0/2810979787 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33aa000700 1 --2- 172.21.15.81:0/2810979787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0ce900 0x7f33ac0cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:10.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.954+0000 7f33aaa00700 1 --2- 172.21.15.81:0/2810979787 >> v2:172.21.15.178:3300/0 conn(0x7f33ac161150 0x7f33ac06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33a9600700 1 -- 172.21.15.81:0/2810979787 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652357083 0 0) 0x7f33ac0b3a70 con 0x7f33ac0cb900 2024-09-13T18:47:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33a9600700 1 -- 172.21.15.81:0/2810979787 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33900035d0 con 0x7f33ac0cb900 2024-09-13T18:47:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33aa000700 1 -- 172.21.15.81:0/2810979787 >> v2:172.21.15.178:3300/0 conn(0x7f33ac161150 msgr2=0x7f33ac06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33aa000700 1 --2- 172.21.15.81:0/2810979787 >> v2:172.21.15.178:3300/0 conn(0x7f33ac161150 0x7f33ac06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33aa000700 1 -- 172.21.15.81:0/2810979787 >> v1:172.21.15.81:6789/0 conn(0x7f33ac0cb900 legacy=0x7f33ac0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:10.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33aa000700 1 -- 172.21.15.81:0/2810979787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0cf150 con 0x7f33ac0ce900 2024-09-13T18:47:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33aa000700 1 --2- 172.21.15.81:0/2810979787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0ce900 0x7f33ac0cb3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3398009850 tx=0x7f3398009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff5750837d844ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33a9600700 1 -- 172.21.15.81:0/2810979787 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398011830 con 0x7f33ac0ce900 2024-09-13T18:47:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33a9600700 1 -- 172.21.15.81:0/2810979787 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398011990 con 0x7f33ac0ce900 2024-09-13T18:47:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33a9600700 1 -- 172.21.15.81:0/2810979787 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398011d40 con 0x7f33ac0ce900 2024-09-13T18:47:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 -- 172.21.15.81:0/2810979787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0ce900 msgr2=0x7f33ac0cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 --2- 172.21.15.81:0/2810979787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0ce900 0x7f33ac0cb3c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3398009850 tx=0x7f3398009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 -- 172.21.15.81:0/2810979787 shutdown_connections 2024-09-13T18:47:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 --2- 172.21.15.81:0/2810979787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0ce900 0x7f33ac0cb3c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 --2- 172.21.15.81:0/2810979787 >> v2:172.21.15.178:3300/0 conn(0x7f33ac161150 0x7f33ac06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 -- 172.21.15.81:0/2810979787 >> 172.21.15.81:0/2810979787 conn(0x7f33ac072530 msgr2=0x7f33ac0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 -- 172.21.15.81:0/2810979787 shutdown_connections 2024-09-13T18:47:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.958+0000 7f33abe00700 1 -- 172.21.15.81:0/2810979787 wait complete. 2024-09-13T18:47:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 Processor -- start 2024-09-13T18:47:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 -- start start 2024-09-13T18:47:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0cb900 0x7f33ac157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac0ce900 0x7f33ac148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 0x7f33ac159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac163050 con 0x7f33ac161150 2024-09-13T18:47:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1623d0 con 0x7f33ac0ce900 2024-09-13T18:47:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33abe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1626b0 con 0x7f33ac0cb900 2024-09-13T18:47:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 0x7f33ac159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 0x7f33ac159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53246/0 (socket says 172.21.15.81:53246) 2024-09-13T18:47:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33ab400700 1 -- 172.21.15.81:0/2279309868 learned_addr learned my addr 172.21.15.81:0/2279309868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33aaa00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0cb900 0x7f33ac157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.962+0000 7f33aa000700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac0ce900 0x7f33ac148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33ab400700 1 -- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0cb900 msgr2=0x7f33ac157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33ab400700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0cb900 0x7f33ac157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33ab400700 1 -- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac0ce900 msgr2=0x7f33ac148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33ab400700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac0ce900 0x7f33ac148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33ab400700 1 -- 172.21.15.81:0/2279309868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980094b0 con 0x7f33ac161150 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33ab400700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 0x7f33ac159890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33a400cb40 tx=0x7f33a400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4007500 con 0x7f33ac161150 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac162990 con 0x7f33ac161150 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4007660 con 0x7f33ac161150 2024-09-13T18:47:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a40079f0 con 0x7f33ac161150 2024-09-13T18:47:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac158300 con 0x7f33ac161150 2024-09-13T18:47:10.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.966+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac163190 con 0x7f33ac161150 2024-09-13T18:47:10.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.970+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33a401b3b0 con 0x7f33ac161150 2024-09-13T18:47:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.970+0000 7f33a2a00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f338c066730 0x7f338c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.970+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f33a4083810 con 0x7f33ac161150 2024-09-13T18:47:10.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.970+0000 7f33aaa00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f338c066730 0x7f338c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:10.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.970+0000 7f33aaa00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f338c066730 0x7f338c068bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f339c009b50 tx=0x7f339c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:10.978+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33ac163190 con 0x7f33ac161150 2024-09-13T18:47:11.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.158+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33ac163190 con 0x7f33ac161150 2024-09-13T18:47:11.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.158+0000 7f33a2a00700 1 -- 172.21.15.81:0/2279309868 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33ac163190 con 0x7f33ac161150 2024-09-13T18:47:11.168 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:47:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f338c066730 msgr2=0x7f338c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f338c066730 0x7f338c068bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f339c009b50 tx=0x7f339c009240 comp rx=0 tx=0).stop 2024-09-13T18:47:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 msgr2=0x7f33ac159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 0x7f33ac159890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f33a400cb40 tx=0x7f33a400cb70 comp rx=0 tx=0).stop 2024-09-13T18:47:11.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 shutdown_connections 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f338c066730 0x7f338c068bf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33ac161150 0x7f33ac159890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33ac0ce900 0x7f33ac148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 --2- 172.21.15.81:0/2279309868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33ac0cb900 0x7f33ac157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 >> 172.21.15.81:0/2279309868 conn(0x7f33ac072530 msgr2=0x7f33ac06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 shutdown_connections 2024-09-13T18:47:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.162+0000 7f33abe00700 1 -- 172.21.15.81:0/2279309868 wait complete. 2024-09-13T18:47:11.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.358+0000 7f50f3e00700 1 Processor -- start 2024-09-13T18:47:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.358+0000 7f50f3e00700 1 -- start start 2024-09-13T18:47:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.358+0000 7f50f3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f40cb020 0x7f50f40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.358+0000 7f50f3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f40b2ad0 con 0x7f50f406aaa0 2024-09-13T18:47:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.358+0000 7f50f3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f415b960 con 0x7f50f415c2a0 2024-09-13T18:47:11.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.358+0000 7f50f3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f415bc40 con 0x7f50f40cb020 2024-09-13T18:47:11.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f3400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f50f406aaa0 0x7f50f40b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32894/0 (socket says 172.21.15.81:32894) 2024-09-13T18:47:11.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f3400700 1 -- 172.21.15.81:0/2023959302 learned_addr learned my addr 172.21.15.81:0/2023959302 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:11.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2a00700 1 --2- 172.21.15.81:0/2023959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f40cb020 0x7f50f40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2000700 1 -- 172.21.15.81:0/2023959302 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773213253 0 0) 0x7f50f40b2ad0 con 0x7f50f406aaa0 2024-09-13T18:47:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2000700 1 -- 172.21.15.81:0/2023959302 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50d80035d0 con 0x7f50f406aaa0 2024-09-13T18:47:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2a00700 1 -- 172.21.15.81:0/2023959302 >> v1:172.21.15.178:6789/0 conn(0x7f50f415c2a0 legacy=0x7f50f415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2000700 1 -- 172.21.15.81:0/2023959302 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200577474 0 0) 0x7f50f415b960 con 0x7f50f415c2a0 2024-09-13T18:47:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2a00700 1 -- 172.21.15.81:0/2023959302 >> v1:172.21.15.81:6789/0 conn(0x7f50f406aaa0 legacy=0x7f50f40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2a00700 1 -- 172.21.15.81:0/2023959302 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f415bf20 con 0x7f50f40cb020 2024-09-13T18:47:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2a00700 1 --2- 172.21.15.81:0/2023959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f40cb020 0x7f50f40cc6f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009dc0 tx=0x7f50e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d94deca1b0c2129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2000700 1 -- 172.21.15.81:0/2023959302 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400e070 con 0x7f50f40cb020 2024-09-13T18:47:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2000700 1 -- 172.21.15.81:0/2023959302 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e400bb20 con 0x7f50f40cb020 2024-09-13T18:47:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f2000700 1 -- 172.21.15.81:0/2023959302 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e400bed0 con 0x7f50f40cb020 2024-09-13T18:47:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f3e00700 1 -- 172.21.15.81:0/2023959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f40cb020 msgr2=0x7f50f40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.362+0000 7f50f3e00700 1 --2- 172.21.15.81:0/2023959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f40cb020 0x7f50f40cc6f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009dc0 tx=0x7f50e400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 -- 172.21.15.81:0/2023959302 shutdown_connections 2024-09-13T18:47:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 --2- 172.21.15.81:0/2023959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f40cb020 0x7f50f40cc6f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 -- 172.21.15.81:0/2023959302 >> 172.21.15.81:0/2023959302 conn(0x7f50f40b0c40 msgr2=0x7f50f406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 -- 172.21.15.81:0/2023959302 shutdown_connections 2024-09-13T18:47:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 -- 172.21.15.81:0/2023959302 wait complete. 2024-09-13T18:47:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 Processor -- start 2024-09-13T18:47:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.366+0000 7f50f3e00700 1 -- start start 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50f406aaa0 0x7f50f4156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 0x7f50f4157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f415c2a0 0x7f50f41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f413f6a0 con 0x7f50f40cb020 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f41f14d0 con 0x7f50f406aaa0 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f413ea90 con 0x7f50f415c2a0 2024-09-13T18:47:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 0x7f50f4157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 0x7f50f4157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53262/0 (socket says 172.21.15.81:53262) 2024-09-13T18:47:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 -- 172.21.15.81:0/4265190113 learned_addr learned my addr 172.21.15.81:0/4265190113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f2a00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50f406aaa0 0x7f50f4156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3400700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f415c2a0 0x7f50f41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 -- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f415c2a0 msgr2=0x7f50f41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f415c2a0 0x7f50f41408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 -- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50f406aaa0 msgr2=0x7f50f4156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50f406aaa0 0x7f50f4156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 -- 172.21.15.81:0/4265190113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4009a70 con 0x7f50f40cb020 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ea000700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 0x7f50f4157e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00c480 tx=0x7f50dc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0054e0 con 0x7f50f40cb020 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc00ce50 con 0x7f50f40cb020 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f413ed70 con 0x7f50f40cb020 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0038e0 con 0x7f50f40cb020 2024-09-13T18:47:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.370+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f413f330 con 0x7f50f40cb020 2024-09-13T18:47:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.374+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f413f850 con 0x7f50f40cb020 2024-09-13T18:47:11.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.374+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50dc003a40 con 0x7f50f40cb020 2024-09-13T18:47:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.378+0000 7f50ebe00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f50d0066760 0x7f50d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.378+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f50dc082cc0 con 0x7f50f40cb020 2024-09-13T18:47:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.378+0000 7f50f2a00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f50d0066760 0x7f50d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.378+0000 7f50f2a00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f50d0066760 0x7f50d0068c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f50e4014040 tx=0x7f50e401e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.382+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50f413f850 con 0x7f50f40cb020 2024-09-13T18:47:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.602+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50f415b960 con 0x7f50f40cb020 2024-09-13T18:47:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50ebe00700 1 -- 172.21.15.81:0/4265190113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f50dc017de0 con 0x7f50f40cb020 2024-09-13T18:47:11.614 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:11.615 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:47:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f50d0066760 msgr2=0x7f50d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f50d0066760 0x7f50d0068c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f50e4014040 tx=0x7f50e401e040 comp rx=0 tx=0).stop 2024-09-13T18:47:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 msgr2=0x7f50f4157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 0x7f50f4157e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00c480 tx=0x7f50dc00c790 comp rx=0 tx=0).stop 2024-09-13T18:47:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 shutdown_connections 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f50d0066760 0x7f50d0068c20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50f415c2a0 0x7f50f41408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50f40cb020 0x7f50f4157e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 --2- 172.21.15.81:0/4265190113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50f406aaa0 0x7f50f4156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 >> 172.21.15.81:0/4265190113 conn(0x7f50f40b0c40 msgr2=0x7f50f4159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.606+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 shutdown_connections 2024-09-13T18:47:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.610+0000 7f50f3e00700 1 -- 172.21.15.81:0/4265190113 wait complete. 2024-09-13T18:47:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-13T18:47:11.640 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.794+0000 7fd2d9400700 1 Processor -- start 2024-09-13T18:47:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.794+0000 7fd2d9400700 1 -- start start 2024-09-13T18:47:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d9400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d40719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d9400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd2d406aaa0 0x7fd2d406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d9400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d40b3560 con 0x7fd2d40b2670 2024-09-13T18:47:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d9400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d4070b30 con 0x7fd2d406aaa0 2024-09-13T18:47:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d9400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d406b420 con 0x7fd2d41610b0 2024-09-13T18:47:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd2d406aaa0 0x7fd2d406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d40719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd2d406aaa0 0x7fd2d406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:41122/0 (socket says 172.21.15.81:41122) 2024-09-13T18:47:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 -- 172.21.15.81:0/955030671 learned_addr learned my addr 172.21.15.81:0/955030671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 -- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 msgr2=0x7fd2d40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 --2- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d40719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 -- 172.21.15.81:0/955030671 >> v1:172.21.15.178:6789/0 conn(0x7fd2d40b2670 legacy=0x7fd2d40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 -- 172.21.15.81:0/955030671 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40b3280 con 0x7fd2d406aaa0 2024-09-13T18:47:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2cb400700 1 --2- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406aee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009910 tx=0x7fd2bc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794a0c80f3cf64f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d3400700 1 -- 172.21.15.81:0/955030671 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc011830 con 0x7fd2d406aaa0 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d3400700 1 -- 172.21.15.81:0/955030671 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc011990 con 0x7fd2d406aaa0 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.798+0000 7fd2d3400700 1 -- 172.21.15.81:0/955030671 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc011d40 con 0x7fd2d406aaa0 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 -- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d406aaa0 msgr2=0x7fd2d406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 --2- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406aee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009910 tx=0x7fd2bc009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 -- 172.21.15.81:0/955030671 shutdown_connections 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 --2- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406aee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 --2- 172.21.15.81:0/955030671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d40719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 -- 172.21.15.81:0/955030671 >> 172.21.15.81:0/955030671 conn(0x7fd2d40b0c40 msgr2=0x7fd2d406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 -- 172.21.15.81:0/955030671 shutdown_connections 2024-09-13T18:47:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 -- 172.21.15.81:0/955030671 wait complete. 2024-09-13T18:47:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 Processor -- start 2024-09-13T18:47:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.802+0000 7fd2d9400700 1 -- start start 2024-09-13T18:47:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d40b2670 0x7fd2d415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d415ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d415b260 con 0x7fd2d406aaa0 2024-09-13T18:47:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d41f6eb0 con 0x7fd2d40b2670 2024-09-13T18:47:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d41f7190 con 0x7fd2d41610b0 2024-09-13T18:47:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53266/0 (socket says 172.21.15.81:53266) 2024-09-13T18:47:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 -- 172.21.15.81:0/667954516 learned_addr learned my addr 172.21.15.81:0/667954516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2cb400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d40b2670 0x7fd2d415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d8a00700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d415ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 -- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 msgr2=0x7fd2d415ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d415ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 -- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d40b2670 msgr2=0x7fd2d415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d40b2670 0x7fd2d415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 -- 172.21.15.81:0/667954516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc009570 con 0x7fd2d406aaa0 2024-09-13T18:47:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2cb400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d40b2670 0x7fd2d415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d8a00700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:11.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d3e00700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406cf50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400ebe0 tx=0x7fd2c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4009740 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400c850 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.806+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d41f7470 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.810+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400cbe0 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.810+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d41f6bb0 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.810+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d4161570 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.810+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2c400cd40 con 0x7fd2d406aaa0 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.814+0000 7fd2d0c00700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd2b0066730 0x7fd2b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.814+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2c4083ed0 con 0x7fd2d406aaa0 2024-09-13T18:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.814+0000 7fd2cb400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd2b0066730 0x7fd2b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.814+0000 7fd2cb400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd2b0066730 0x7fd2b0068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009910 tx=0x7fd2bc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:11.818+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2c40514f0 con 0x7fd2d406aaa0 2024-09-13T18:47:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.006+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2d40b00c0 con 0x7fd2d406aaa0 2024-09-13T18:47:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.006+0000 7fd2d0c00700 1 -- 172.21.15.81:0/667954516 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fd2c4054b10 con 0x7fd2d406aaa0 2024-09-13T18:47:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:12.018 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:05.768791+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd2b0066730 msgr2=0x7fd2b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd2b0066730 0x7fd2b0068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009910 tx=0x7fd2bc008030 comp rx=0 tx=0).stop 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 msgr2=0x7fd2d406cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406cf50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd2c400ebe0 tx=0x7fd2c400eef0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 shutdown_connections 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd2b0066730 0x7fd2b0068bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d41610b0 0x7fd2d415ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d40b2670 0x7fd2d415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 --2- 172.21.15.81:0/667954516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2d406aaa0 0x7fd2d406cf50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 >> 172.21.15.81:0/667954516 conn(0x7fd2d40b0c40 msgr2=0x7fd2d415f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 shutdown_connections 2024-09-13T18:47:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.010+0000 7fd2d9400700 1 -- 172.21.15.81:0/667954516 wait complete. 2024-09-13T18:47:12.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:12.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:12.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.202+0000 7f94bf400700 1 Processor -- start 2024-09-13T18:47:12.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.202+0000 7f94bf400700 1 -- start start 2024-09-13T18:47:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bf400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94b8143b60 0x7f94b80d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94b80cf3b0 0x7f94b80cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bf400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b815e720 0x7f94b815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bf400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b815f710 con 0x7f94b80cf3b0 2024-09-13T18:47:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bf400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80d19e0 con 0x7f94b8143b60 2024-09-13T18:47:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bf400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80cfd60 con 0x7f94b815e720 2024-09-13T18:47:12.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94b80cf3b0 0x7f94b80cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f94b80cf3b0 0x7f94b80cf820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53282/0 (socket says 172.21.15.81:53282) 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 -- 172.21.15.81:0/1248803270 learned_addr learned my addr 172.21.15.81:0/1248803270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bca00700 1 --2- 172.21.15.81:0/1248803270 >> v2:172.21.15.178:3300/0 conn(0x7f94b8143b60 0x7f94b80d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94bd400700 1 --2- 172.21.15.81:0/1248803270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b815e720 0x7f94b815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 -- 172.21.15.81:0/1248803270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b815e720 msgr2=0x7f94b815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 --2- 172.21.15.81:0/1248803270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b815e720 0x7f94b815ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 -- 172.21.15.81:0/1248803270 >> v2:172.21.15.178:3300/0 conn(0x7f94b8143b60 msgr2=0x7f94b80d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 --2- 172.21.15.81:0/1248803270 >> v2:172.21.15.178:3300/0 conn(0x7f94b8143b60 0x7f94b80d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 -- 172.21.15.81:0/1248803270 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80d0780 con 0x7f94b80cf3b0 2024-09-13T18:47:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7e00700 1 --2- 172.21.15.81:0/1248803270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b80cf820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009970 tx=0x7f94a4009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc63d2a589abb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7400700 1 -- 172.21.15.81:0/1248803270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a400b9e0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7400700 1 -- 172.21.15.81:0/1248803270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a400bb40 con 0x7f94b80cf3b0 2024-09-13T18:47:12.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.206+0000 7f94b7400700 1 -- 172.21.15.81:0/1248803270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a400bed0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 -- 172.21.15.81:0/1248803270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 msgr2=0x7f94b80cf820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 --2- 172.21.15.81:0/1248803270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b80cf820 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009970 tx=0x7f94a4009c80 comp rx=0 tx=0).stop 2024-09-13T18:47:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 -- 172.21.15.81:0/1248803270 shutdown_connections 2024-09-13T18:47:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 --2- 172.21.15.81:0/1248803270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b815e720 0x7f94b815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 --2- 172.21.15.81:0/1248803270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b80cf820 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 --2- 172.21.15.81:0/1248803270 >> v2:172.21.15.178:3300/0 conn(0x7f94b8143b60 0x7f94b80d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 -- 172.21.15.81:0/1248803270 >> 172.21.15.81:0/1248803270 conn(0x7f94b806e660 msgr2=0x7f94b806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 -- 172.21.15.81:0/1248803270 shutdown_connections 2024-09-13T18:47:12.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 -- 172.21.15.81:0/1248803270 wait complete. 2024-09-13T18:47:12.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 Processor -- start 2024-09-13T18:47:12.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.210+0000 7f94bf400700 1 -- start start 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b8137240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b8143b60 0x7f94b815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94b815e720 0x7f94b806ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80c6ac0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8137780 con 0x7f94b815e720 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80c5f40 con 0x7f94b8143b60 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b8137240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b8137240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53286/0 (socket says 172.21.15.81:53286) 2024-09-13T18:47:12.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 -- 172.21.15.81:0/1354005308 learned_addr learned my addr 172.21.15.81:0/1354005308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:12.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bd400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94b815e720 0x7f94b806ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94b7e00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b8143b60 0x7f94b815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 -- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b8143b60 msgr2=0x7f94b815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b8143b60 0x7f94b815c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 -- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94b815e720 msgr2=0x7f94b806ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94b815e720 0x7f94b806ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 -- 172.21.15.81:0/1354005308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a4009570 con 0x7f94b80cf3b0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bca00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b8137240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00d800 tx=0x7f94ac00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac0125f0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ac012750 con 0x7f94b80cf3b0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80c6220 con 0x7f94b80cf3b0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ac012ac0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.214+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b80c67e0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.218+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b80cf820 con 0x7f94b80cf3b0 2024-09-13T18:47:12.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.218+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94ac012c20 con 0x7f94b80cf3b0 2024-09-13T18:47:12.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.218+0000 7f94b4c00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9498066760 0x7f9498068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.218+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94ac084250 con 0x7f94b80cf3b0 2024-09-13T18:47:12.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.222+0000 7f94b7e00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9498066760 0x7f9498068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.222+0000 7f94b7e00700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9498066760 0x7f9498068c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94a4014040 tx=0x7f94a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.226+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94ac051870 con 0x7f94b80cf3b0 2024-09-13T18:47:12.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:12.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.402+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94b81347f0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.402+0000 7f94b4c00700 1 -- 172.21.15.81:0/1354005308 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94ac012ed0 con 0x7f94b80cf3b0 2024-09-13T18:47:12.411 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9498066760 msgr2=0x7f9498068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9498066760 0x7f9498068c20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f94a4014040 tx=0x7f94a4008030 comp rx=0 tx=0).stop 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 msgr2=0x7f94b8137240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b8137240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f94ac00d800 tx=0x7f94ac00dbc0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 shutdown_connections 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9498066760 0x7f9498068c20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94b815e720 0x7f94b806ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94b8143b60 0x7f94b815c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 --2- 172.21.15.81:0/1354005308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94b80cf3b0 0x7f94b8137240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 >> 172.21.15.81:0/1354005308 conn(0x7f94b806e660 msgr2=0x7f94b80b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 shutdown_connections 2024-09-13T18:47:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.406+0000 7f94bf400700 1 -- 172.21.15.81:0/1354005308 wait complete. 2024-09-13T18:47:12.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:47:12.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.594+0000 7f76f1800700 1 Processor -- start 2024-09-13T18:47:12.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.594+0000 7f76f1800700 1 -- start start 2024-09-13T18:47:12.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76f1800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76ec071d20 0x7f76ec0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76f1800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0ce140 con 0x7f76ec06a5d0 2024-09-13T18:47:12.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76f1800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0cde60 con 0x7f76ec0cd610 2024-09-13T18:47:12.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76f1800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec06c3b0 con 0x7f76ec071d20 2024-09-13T18:47:12.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76ec071d20 0x7f76ec0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76ec071d20 0x7f76ec0b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53302/0 (socket says 172.21.15.81:53302) 2024-09-13T18:47:12.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 -- 172.21.15.81:0/1649824926 learned_addr learned my addr 172.21.15.81:0/1649824926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:12.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 -- 172.21.15.81:0/1649824926 >> v1:172.21.15.178:6789/0 conn(0x7f76ec0cd610 legacy=0x7f76ec06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:12.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 -- 172.21.15.81:0/1649824926 >> v1:172.21.15.81:6789/0 conn(0x7f76ec06a5d0 legacy=0x7f76ec06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 -- 172.21.15.81:0/1649824926 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec06c690 con 0x7f76ec071d20 2024-09-13T18:47:12.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76e2000700 1 --2- 172.21.15.81:0/1649824926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec071d20 0x7f76ec0b19f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009910 tx=0x7f76d4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4a4d8e3f2dd781 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76ea000700 1 -- 172.21.15.81:0/1649824926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4004230 con 0x7f76ec071d20 2024-09-13T18:47:12.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76ea000700 1 -- 172.21.15.81:0/1649824926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4004390 con 0x7f76ec071d20 2024-09-13T18:47:12.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.598+0000 7f76ea000700 1 -- 172.21.15.81:0/1649824926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4009e60 con 0x7f76ec071d20 2024-09-13T18:47:12.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 -- 172.21.15.81:0/1649824926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec071d20 msgr2=0x7f76ec0b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 --2- 172.21.15.81:0/1649824926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec071d20 0x7f76ec0b19f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009910 tx=0x7f76d4009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:12.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 -- 172.21.15.81:0/1649824926 shutdown_connections 2024-09-13T18:47:12.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 --2- 172.21.15.81:0/1649824926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec071d20 0x7f76ec0b19f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 -- 172.21.15.81:0/1649824926 >> 172.21.15.81:0/1649824926 conn(0x7f76ec0b08d0 msgr2=0x7f76ec0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 -- 172.21.15.81:0/1649824926 shutdown_connections 2024-09-13T18:47:12.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.602+0000 7f76f1800700 1 -- 172.21.15.81:0/1649824926 wait complete. 2024-09-13T18:47:12.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 Processor -- start 2024-09-13T18:47:12.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 -- start start 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 0x7f76ec1610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec071d20 0x7f76ec1466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0cd610 0x7f76ec1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec146290 con 0x7f76ec06a5d0 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec1ec710 con 0x7f76ec071d20 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76f1800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec145610 con 0x7f76ec0cd610 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 0x7f76ec1610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 0x7f76ec1610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53306/0 (socket says 172.21.15.81:53306) 2024-09-13T18:47:12.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 -- 172.21.15.81:0/2667163788 learned_addr learned my addr 172.21.15.81:0/2667163788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76e2000700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec071d20 0x7f76ec1466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eb400700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0cd610 0x7f76ec1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 -- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0cd610 msgr2=0x7f76ec1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0cd610 0x7f76ec1618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 -- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec071d20 msgr2=0x7f76ec1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec071d20 0x7f76ec1466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 -- 172.21.15.81:0/2667163788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4009570 con 0x7f76ec06a5d0 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eb400700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0cd610 0x7f76ec1618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.606+0000 7f76eaa00700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 0x7f76ec1610c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c500 tx=0x7f76dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0052d0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc005430 con 0x7f76ec06a5d0 2024-09-13T18:47:12.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec1458f0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0055a0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec145eb0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec1463d0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.610+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76dc0036a0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.614+0000 7f76e3400700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f76c8066730 0x7f76c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:12.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.614+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76dc083260 con 0x7f76ec06a5d0 2024-09-13T18:47:12.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.614+0000 7f76e2000700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f76c8066730 0x7f76c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:12.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.614+0000 7f76e2000700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f76c8066730 0x7f76c8068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009910 tx=0x7f76d4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:12.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.622+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76dc050800 con 0x7f76ec06a5d0 2024-09-13T18:47:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.806+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f76ec0b19f0 con 0x7f76ec06a5d0 2024-09-13T18:47:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.810+0000 7f76e3400700 1 -- 172.21.15.81:0/2667163788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f76dc081e60 con 0x7f76ec06a5d0 2024-09-13T18:47:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:12.818 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:47:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:47:12.818 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:47:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:47:12.819 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:47:12.819 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:47:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f76c8066730 msgr2=0x7f76c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f76c8066730 0x7f76c8068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f76d4009910 tx=0x7f76d4008030 comp rx=0 tx=0).stop 2024-09-13T18:47:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 msgr2=0x7f76ec1610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 0x7f76ec1610c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c500 tx=0x7f76dc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 shutdown_connections 2024-09-13T18:47:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f76c8066730 0x7f76c8068bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0cd610 0x7f76ec1618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec071d20 0x7f76ec1466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 --2- 172.21.15.81:0/2667163788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76ec06a5d0 0x7f76ec1610c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 >> 172.21.15.81:0/2667163788 conn(0x7f76ec0b08d0 msgr2=0x7f76ec149f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 shutdown_connections 2024-09-13T18:47:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:12.814+0000 7f76f1800700 1 -- 172.21.15.81:0/2667163788 wait complete. 2024-09-13T18:47:12.849 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:47:12.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:47:13.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.014+0000 7fb57d800700 1 Processor -- start 2024-09-13T18:47:13.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.014+0000 7fb57d800700 1 -- start start 2024-09-13T18:47:13.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.014+0000 7fb57d800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb57806c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb57d800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57806d920 con 0x7fb5780ccb20 2024-09-13T18:47:13.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb57d800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5780b1300 con 0x7fb5781586a0 2024-09-13T18:47:13.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb57d800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57806db90 con 0x7fb5780cc6f0 2024-09-13T18:47:13.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb57ce00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb5780ccb20 0x7fb57815af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32920/0 (socket says 172.21.15.81:32920) 2024-09-13T18:47:13.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb57ce00700 1 -- 172.21.15.81:0/952180260 learned_addr learned my addr 172.21.15.81:0/952180260 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:13.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb577400700 1 --2- 172.21.15.81:0/952180260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb57806c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780620820 0 0) 0x7fb57806d920 con 0x7fb5780ccb20 2024-09-13T18:47:13.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c0035d0 con 0x7fb5780ccb20 2024-09-13T18:47:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632509816 0 0) 0x7fb5780b1300 con 0x7fb5781586a0 2024-09-13T18:47:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb57806d920 con 0x7fb5781586a0 2024-09-13T18:47:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb577400700 1 -- 172.21.15.81:0/952180260 >> v1:172.21.15.178:6789/0 conn(0x7fb5781586a0 legacy=0x7fb57806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb577400700 1 -- 172.21.15.81:0/952180260 >> v1:172.21.15.81:6789/0 conn(0x7fb5780ccb20 legacy=0x7fb57815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2579059723 0 0) 0x7fb55c0035d0 con 0x7fb5780ccb20 2024-09-13T18:47:13.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb577400700 1 -- 172.21.15.81:0/952180260 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57806bc30 con 0x7fb5780cc6f0 2024-09-13T18:47:13.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb577400700 1 --2- 172.21.15.81:0/952180260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb57806c430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb564009880 tx=0x7fb564009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=697d55a821116f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011830 con 0x7fb5780cc6f0 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564011990 con 0x7fb5780cc6f0 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.018+0000 7fb576a00700 1 -- 172.21.15.81:0/952180260 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011d20 con 0x7fb5780cc6f0 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- 172.21.15.81:0/952180260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 msgr2=0x7fb57806c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 --2- 172.21.15.81:0/952180260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb57806c430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb564009880 tx=0x7fb564009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- 172.21.15.81:0/952180260 shutdown_connections 2024-09-13T18:47:13.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 --2- 172.21.15.81:0/952180260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb57806c430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- 172.21.15.81:0/952180260 >> 172.21.15.81:0/952180260 conn(0x7fb5780b05a0 msgr2=0x7fb5780b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:13.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- 172.21.15.81:0/952180260 shutdown_connections 2024-09-13T18:47:13.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- 172.21.15.81:0/952180260 wait complete. 2024-09-13T18:47:13.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 Processor -- start 2024-09-13T18:47:13.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- start start 2024-09-13T18:47:13.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb578151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5780ccb20 0x7fb5781f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 0x7fb5780ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5781f3a20 con 0x7fb5781586a0 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5780b27e0 con 0x7fb5780ccb20 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.022+0000 7fb57d800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5780b2ac0 con 0x7fb5780cc6f0 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 0x7fb5780ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 0x7fb5780ac890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53318/0 (socket says 172.21.15.81:53318) 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 -- 172.21.15.81:0/740028482 learned_addr learned my addr 172.21.15.81:0/740028482 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb577400700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5780ccb20 0x7fb5781f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb577e00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb578151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 -- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 msgr2=0x7fb578151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb578151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 -- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5780ccb20 msgr2=0x7fb5781f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5780ccb20 0x7fb5781f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 -- 172.21.15.81:0/740028482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640094b0 con 0x7fb5781586a0 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57ce00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 0x7fb5780ac890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb57000cc10 tx=0x7fb57000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570007480 con 0x7fb5781586a0 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5700075e0 con 0x7fb5781586a0 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570007990 con 0x7fb5781586a0 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5780c38b0 con 0x7fb5781586a0 2024-09-13T18:47:13.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5780c3e70 con 0x7fb5781586a0 2024-09-13T18:47:13.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.026+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57806c430 con 0x7fb5781586a0 2024-09-13T18:47:13.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.030+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb57001b400 con 0x7fb5781586a0 2024-09-13T18:47:13.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.030+0000 7fb56fe00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb558066730 0x7fb558068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:13.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.030+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb570083e50 con 0x7fb5781586a0 2024-09-13T18:47:13.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.030+0000 7fb577e00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb558066730 0x7fb558068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:13.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.030+0000 7fb577e00700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb558066730 0x7fb558068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5680011e0 tx=0x7fb568009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:13.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.038+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb570054f00 con 0x7fb5781586a0 2024-09-13T18:47:13.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.230+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb57806d3e0 con 0x7fb5781586a0 2024-09-13T18:47:13.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.950+0000 7fb56fe00700 1 -- 172.21.15.81:0/740028482 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb570054a90 con 0x7fb5781586a0 2024-09-13T18:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb558066730 msgr2=0x7fb558068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb558066730 0x7fb558068bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb5680011e0 tx=0x7fb568009040 comp rx=0 tx=0).stop 2024-09-13T18:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 msgr2=0x7fb5780ac890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:13.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 0x7fb5780ac890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb57000cc10 tx=0x7fb57000cc40 comp rx=0 tx=0).stop 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 shutdown_connections 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb558066730 0x7fb558068bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5781586a0 0x7fb5780ac890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5780ccb20 0x7fb5781f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 --2- 172.21.15.81:0/740028482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5780cc6f0 0x7fb578151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 >> 172.21.15.81:0/740028482 conn(0x7fb5780b05a0 msgr2=0x7fb5780ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 shutdown_connections 2024-09-13T18:47:13.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:13.958+0000 7fb57d800700 1 -- 172.21.15.81:0/740028482 wait complete. 2024-09-13T18:47:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:47:13.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T18:47:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.158+0000 7f7045000700 1 Processor -- start 2024-09-13T18:47:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.158+0000 7f7045000700 1 -- start start 2024-09-13T18:47:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f7045000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f704015ad00 0x7f704015df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f7045000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70400ac890 0x7f7040066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f7045000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7040066a20 con 0x7f70400665d0 2024-09-13T18:47:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f7045000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400b5690 con 0x7f70400ac890 2024-09-13T18:47:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f7045000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704015e490 con 0x7f704015ad00 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f703d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70400ac890 0x7f7040066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f703d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70400ac890 0x7f7040066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53330/0 (socket says 172.21.15.81:53330) 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.162+0000 7f703d400700 1 -- 172.21.15.81:0/1262820433 learned_addr learned my addr 172.21.15.81:0/1262820433 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703de00700 1 --2- 172.21.15.81:0/1262820433 >> v2:172.21.15.178:3300/0 conn(0x7f704015ad00 0x7f704015df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703d400700 1 -- 172.21.15.81:0/1262820433 >> v2:172.21.15.178:3300/0 conn(0x7f704015ad00 msgr2=0x7f704015df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703d400700 1 --2- 172.21.15.81:0/1262820433 >> v2:172.21.15.178:3300/0 conn(0x7f704015ad00 0x7f704015df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703d400700 1 -- 172.21.15.81:0/1262820433 >> v1:172.21.15.81:6789/0 conn(0x7f70400665d0 legacy=0x7f70400ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703d400700 1 -- 172.21.15.81:0/1262820433 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704006a390 con 0x7f70400ac890 2024-09-13T18:47:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703d400700 1 --2- 172.21.15.81:0/1262820433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400ac890 0x7f7040066090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70400721c0 tx=0x7f702c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af198fc8b201dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703ca00700 1 -- 172.21.15.81:0/1262820433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00b8a0 con 0x7f70400ac890 2024-09-13T18:47:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703ca00700 1 -- 172.21.15.81:0/1262820433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c00ba00 con 0x7f70400ac890 2024-09-13T18:47:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f703ca00700 1 -- 172.21.15.81:0/1262820433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00bd90 con 0x7f70400ac890 2024-09-13T18:47:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 -- 172.21.15.81:0/1262820433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400ac890 msgr2=0x7f7040066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 --2- 172.21.15.81:0/1262820433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400ac890 0x7f7040066090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f70400721c0 tx=0x7f702c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 -- 172.21.15.81:0/1262820433 shutdown_connections 2024-09-13T18:47:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 --2- 172.21.15.81:0/1262820433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400ac890 0x7f7040066090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 --2- 172.21.15.81:0/1262820433 >> v2:172.21.15.178:3300/0 conn(0x7f704015ad00 0x7f704015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 -- 172.21.15.81:0/1262820433 >> 172.21.15.81:0/1262820433 conn(0x7f70400b19d0 msgr2=0x7f70400b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 -- 172.21.15.81:0/1262820433 shutdown_connections 2024-09-13T18:47:14.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.166+0000 7f7045000700 1 -- 172.21.15.81:0/1262820433 wait complete. 2024-09-13T18:47:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 Processor -- start 2024-09-13T18:47:14.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 -- start start 2024-09-13T18:47:14.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 0x7f70401511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70400ac890 0x7f7040152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400cec20 0x7f7040156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401564c0 con 0x7f70400665d0 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401521c0 con 0x7f70400cec20 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f7045000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70401524a0 con 0x7f70400ac890 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 0x7f70401511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 0x7f70401511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53344/0 (socket says 172.21.15.81:53344) 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 -- 172.21.15.81:0/1851558506 learned_addr learned my addr 172.21.15.81:0/1851558506 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703d400700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70400ac890 0x7f7040152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703e800700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400cec20 0x7f7040156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 -- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70400ac890 msgr2=0x7f7040152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70400ac890 0x7f7040152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 -- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400cec20 msgr2=0x7f7040156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400cec20 0x7f7040156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 -- 172.21.15.81:0/1851558506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009570 con 0x7f70400665d0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703e800700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400cec20 0x7f7040156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.170+0000 7f703de00700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 0x7f70401511d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f703000d800 tx=0x7f703000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.174+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300125f0 con 0x7f70400665d0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.174+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7030012750 con 0x7f70400665d0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.174+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040152780 con 0x7f70400665d0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.174+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030012b00 con 0x7f70400665d0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.174+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7040151710 con 0x7f70400665d0 2024-09-13T18:47:14.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.174+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70400ad980 con 0x7f70400665d0 2024-09-13T18:47:14.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.178+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7030012c60 con 0x7f70400665d0 2024-09-13T18:47:14.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.178+0000 7f7036000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7020066760 0x7f7020068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:14.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.178+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7030084e50 con 0x7f70400665d0 2024-09-13T18:47:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.178+0000 7f703d400700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7020066760 0x7f7020068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:14.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.178+0000 7f703d400700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7020066760 0x7f7020068c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f702c009860 tx=0x7f702c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:14.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.182+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7030052300 con 0x7f70400665d0 2024-09-13T18:47:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.358+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f704015d950 con 0x7f70400665d0 2024-09-13T18:47:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.962+0000 7f7036000700 1 -- 172.21.15.81:0/1851558506 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7030055920 con 0x7f70400665d0 2024-09-13T18:47:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7020066760 msgr2=0x7f7020068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7020066760 0x7f7020068c20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f702c009860 tx=0x7f702c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 msgr2=0x7f70401511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:14.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 0x7f70401511d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f703000d800 tx=0x7f703000db10 comp rx=0 tx=0).stop 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 shutdown_connections 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7020066760 0x7f7020068c20 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f702c009860 tx=0x7f702c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70400cec20 0x7f7040156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70400ac890 0x7f7040152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 --2- 172.21.15.81:0/1851558506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70400665d0 0x7f70401511d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 >> 172.21.15.81:0/1851558506 conn(0x7f70400b19d0 msgr2=0x7f7040158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:14.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 shutdown_connections 2024-09-13T18:47:14.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:14.974+0000 7f7045000700 1 -- 172.21.15.81:0/1851558506 wait complete. 2024-09-13T18:47:14.986 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:47:15.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:47:15.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.186+0000 7f6552e00700 1 Processor -- start 2024-09-13T18:47:15.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.186+0000 7f6552e00700 1 -- start start 2024-09-13T18:47:15.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.186+0000 7f6552e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f654c15aa90 0x7f654c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.186+0000 7f6552e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f654c0cf830 0x7f654c0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.186+0000 7f6552e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0b4680 con 0x7f654c06c5a0 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c15aee0 con 0x7f654c0cf830 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0b4960 con 0x7f654c15aa90 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f654c0cf830 0x7f654c0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f654c06c5a0 0x7f654c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:32934/0 (socket says 172.21.15.81:32934) 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551a00700 1 -- 172.21.15.81:0/514473063 learned_addr learned my addr 172.21.15.81:0/514473063 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:15.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551000700 1 --2- 172.21.15.81:0/514473063 >> v2:172.21.15.178:3300/0 conn(0x7f654c15aa90 0x7f654c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f654be00700 1 -- 172.21.15.81:0/514473063 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214123139 0 0) 0x7f654c0b4680 con 0x7f654c06c5a0 2024-09-13T18:47:15.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f654be00700 1 -- 172.21.15.81:0/514473063 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65340035d0 con 0x7f654c06c5a0 2024-09-13T18:47:15.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551000700 1 -- 172.21.15.81:0/514473063 >> v2:172.21.15.81:3300/0 conn(0x7f654c0cf830 msgr2=0x7f654c0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:15.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551000700 1 --2- 172.21.15.81:0/514473063 >> v2:172.21.15.81:3300/0 conn(0x7f654c0cf830 0x7f654c0cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551000700 1 -- 172.21.15.81:0/514473063 >> v1:172.21.15.81:6789/0 conn(0x7f654c06c5a0 legacy=0x7f654c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551000700 1 -- 172.21.15.81:0/514473063 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0cf030 con 0x7f654c15aa90 2024-09-13T18:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552400700 1 --2- 172.21.15.81:0/514473063 >> v2:172.21.15.81:3300/0 conn(0x7f654c0cf830 0x7f654c0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6551000700 1 --2- 172.21.15.81:0/514473063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c15aa90 0x7f654c0b56c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f654c06d160 tx=0x7f6538009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64db9b870812b9b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f654be00700 1 -- 172.21.15.81:0/514473063 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538011830 con 0x7f654c15aa90 2024-09-13T18:47:15.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f654be00700 1 -- 172.21.15.81:0/514473063 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538011990 con 0x7f654c15aa90 2024-09-13T18:47:15.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f654be00700 1 -- 172.21.15.81:0/514473063 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538011d20 con 0x7f654c15aa90 2024-09-13T18:47:15.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 -- 172.21.15.81:0/514473063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c15aa90 msgr2=0x7f654c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 --2- 172.21.15.81:0/514473063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c15aa90 0x7f654c0b56c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f654c06d160 tx=0x7f6538009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 -- 172.21.15.81:0/514473063 shutdown_connections 2024-09-13T18:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 --2- 172.21.15.81:0/514473063 >> v2:172.21.15.81:3300/0 conn(0x7f654c0cf830 0x7f654c0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 --2- 172.21.15.81:0/514473063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c15aa90 0x7f654c0b56c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.190+0000 7f6552e00700 1 -- 172.21.15.81:0/514473063 >> 172.21.15.81:0/514473063 conn(0x7f654c071d20 msgr2=0x7f654c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 -- 172.21.15.81:0/514473063 shutdown_connections 2024-09-13T18:47:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 -- 172.21.15.81:0/514473063 wait complete. 2024-09-13T18:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 Processor -- start 2024-09-13T18:47:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 -- start start 2024-09-13T18:47:15.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 0x7f654c13f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f654c0cf830 0x7f654c13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c1403d0 0x7f654c158000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c157b70 con 0x7f654c06c5a0 2024-09-13T18:47:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c156f60 con 0x7f654c1403d0 2024-09-13T18:47:15.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c157240 con 0x7f654c0cf830 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6551a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 0x7f654c13f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6551a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 0x7f654c13f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53360/0 (socket says 172.21.15.81:53360) 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6551a00700 1 -- 172.21.15.81:0/4188250501 learned_addr learned my addr 172.21.15.81:0/4188250501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6551000700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f654c0cf830 0x7f654c13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.194+0000 7f6552400700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c1403d0 0x7f654c158000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6551a00700 1 -- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f654c0cf830 msgr2=0x7f654c13fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6551a00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f654c0cf830 0x7f654c13fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6551a00700 1 -- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c1403d0 msgr2=0x7f654c158000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6551a00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c1403d0 0x7f654c158000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6551a00700 1 -- 172.21.15.81:0/4188250501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6544009a70 con 0x7f654c06c5a0 2024-09-13T18:47:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6551a00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 0x7f654c13f3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f654000c700 tx=0x7f654000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540005d90 con 0x7f654c06c5a0 2024-09-13T18:47:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65400070d0 con 0x7f654c06c5a0 2024-09-13T18:47:15.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65380094b0 con 0x7f654c06c5a0 2024-09-13T18:47:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540007480 con 0x7f654c06c5a0 2024-09-13T18:47:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c157800 con 0x7f654c06c5a0 2024-09-13T18:47:15.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.198+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c06c980 con 0x7f654c06c5a0 2024-09-13T18:47:15.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.202+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65400075e0 con 0x7f654c06c5a0 2024-09-13T18:47:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.202+0000 7f6549600700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f652c066730 0x7f652c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.202+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f65400838d0 con 0x7f654c06c5a0 2024-09-13T18:47:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.202+0000 7f6551000700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f652c066730 0x7f652c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.202+0000 7f6551000700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f652c066730 0x7f652c068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f654c15ae70 tx=0x7f6538008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.206+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6540050e10 con 0x7f654c06c5a0 2024-09-13T18:47:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.430+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f654c15c8a0 con 0x7f654c06c5a0 2024-09-13T18:47:15.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.450+0000 7f6549600700 1 -- 172.21.15.81:0/4188250501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6540054430 con 0x7f654c06c5a0 2024-09-13T18:47:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f652c066730 msgr2=0x7f652c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f652c066730 0x7f652c068bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f654c15ae70 tx=0x7f6538008030 comp rx=0 tx=0).stop 2024-09-13T18:47:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 msgr2=0x7f654c13f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 0x7f654c13f3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f654000c700 tx=0x7f654000ca10 comp rx=0 tx=0).stop 2024-09-13T18:47:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 shutdown_connections 2024-09-13T18:47:15.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f652c066730 0x7f652c068bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f654c1403d0 0x7f654c158000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f654c0cf830 0x7f654c13fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 --2- 172.21.15.81:0/4188250501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f654c06c5a0 0x7f654c13f3b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 >> 172.21.15.81:0/4188250501 conn(0x7f654c071d20 msgr2=0x7f654c15b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 shutdown_connections 2024-09-13T18:47:15.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.458+0000 7f6552e00700 1 -- 172.21.15.81:0/4188250501 wait complete. 2024-09-13T18:47:15.470 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:47:15.494 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T18:47:15.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.654+0000 7f9d42c00700 1 Processor -- start 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.654+0000 7f9d42c00700 1 -- start start 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d42c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d42c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d3c0b1b00 0x7f9d3c0b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d42c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c0729c0 con 0x7f9d3c0cfce0 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d42c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3c165700 con 0x7f9d3c0b1b00 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d42c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c14ac00 con 0x7f9d3c0ce500 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d3c0b1b00 0x7f9d3c0b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d3be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d3c0b1b00 0x7f9d3c0b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:41224/0 (socket says 172.21.15.81:41224) 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 -- 172.21.15.81:0/2528972630 learned_addr learned my addr 172.21.15.81:0/2528972630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 -- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 msgr2=0x7f9d3c0723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 --2- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 -- 172.21.15.81:0/2528972630 >> v1:172.21.15.178:6789/0 conn(0x7f9d3c0cfce0 legacy=0x7f9d3c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 -- 172.21.15.81:0/2528972630 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c165b90 con 0x7f9d3c0b1b00 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d3be00700 1 --2- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d40c00700 1 --2- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c0b2300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009e50 tx=0x7f9d3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2ad48d9d261617c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d3aa00700 1 -- 172.21.15.81:0/2528972630 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400e070 con 0x7f9d3c0b1b00 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d3aa00700 1 -- 172.21.15.81:0/2528972630 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3400b910 con 0x7f9d3c0b1b00 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.658+0000 7f9d3aa00700 1 -- 172.21.15.81:0/2528972630 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400bcc0 con 0x7f9d3c0b1b00 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 -- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0b1b00 msgr2=0x7f9d3c0b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c0b2300 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009e50 tx=0x7f9d3400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 -- 172.21.15.81:0/2528972630 shutdown_connections 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c0b2300 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2528972630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 -- 172.21.15.81:0/2528972630 >> 172.21.15.81:0/2528972630 conn(0x7f9d3c0b4a00 msgr2=0x7f9d3c0b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 -- 172.21.15.81:0/2528972630 shutdown_connections 2024-09-13T18:47:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.662+0000 7f9d42c00700 1 -- 172.21.15.81:0/2528972630 wait complete. 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 Processor -- start 2024-09-13T18:47:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 -- start start 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c1605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0cfce0 0x7f9d3c13abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c1633f0 con 0x7f9d3c0b1b00 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c1627e0 con 0x7f9d3c0cfce0 2024-09-13T18:47:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d42c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c162ac0 con 0x7f9d3c0ce500 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d3be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c1605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d3be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c1605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53376/0 (socket says 172.21.15.81:53376) 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d3b400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d3be00700 1 -- 172.21.15.81:0/2099780047 learned_addr learned my addr 172.21.15.81:0/2099780047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.666+0000 7f9d40c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0cfce0 0x7f9d3c13abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d3b400700 1 -- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0cfce0 msgr2=0x7f9d3c13abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d3b400700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0cfce0 0x7f9d3c13abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d3b400700 1 -- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d3c0b1b00 msgr2=0x7f9d3c1605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d3b400700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c1605f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d3b400700 1 -- 172.21.15.81:0/2099780047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0094b0 con 0x7f9d3c0ce500 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d3b400700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0ae300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c073680 tx=0x7f9d2800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280052d0 con 0x7f9d3c0ce500 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d28005430 con 0x7f9d3c0ce500 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d34009b30 con 0x7f9d3c0ce500 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d280055a0 con 0x7f9d3c0ce500 2024-09-13T18:47:15.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c163080 con 0x7f9d3c0ce500 2024-09-13T18:47:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.670+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c0677c0 con 0x7f9d3c0ce500 2024-09-13T18:47:15.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.674+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d280038e0 con 0x7f9d3c0ce500 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.674+0000 7f9d33e00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d1c066730 0x7f9d1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.678+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d28083410 con 0x7f9d3c0ce500 2024-09-13T18:47:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.678+0000 7f9d3be00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d1c066730 0x7f9d1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.678+0000 7f9d3be00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d1c066730 0x7f9d1c068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009e80 tx=0x7f9d2c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.686+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d28050770 con 0x7f9d3c0ce500 2024-09-13T18:47:15.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:15.878+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9d3c163560 con 0x7f9d3c0ce500 2024-09-13T18:47:16.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.454+0000 7f9d33e00700 1 -- 172.21.15.81:0/2099780047 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9d28053d90 con 0x7f9d3c0ce500 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d1c066730 msgr2=0x7f9d1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d1c066730 0x7f9d1c068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009e80 tx=0x7f9d2c009240 comp rx=0 tx=0).stop 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 msgr2=0x7f9d3c0ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0ae300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c073680 tx=0x7f9d2800c760 comp rx=0 tx=0).stop 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 shutdown_connections 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d1c066730 0x7f9d1c068bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d3c0cfce0 0x7f9d3c13abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d3c0ce500 0x7f9d3c0ae300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 --2- 172.21.15.81:0/2099780047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d3c0b1b00 0x7f9d3c1605f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 >> 172.21.15.81:0/2099780047 conn(0x7f9d3c0b4a00 msgr2=0x7f9d3c0b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 shutdown_connections 2024-09-13T18:47:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.462+0000 7f9d42c00700 1 -- 172.21.15.81:0/2099780047 wait complete. 2024-09-13T18:47:16.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:47:16.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.670+0000 7f747c600700 1 Processor -- start 2024-09-13T18:47:16.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.670+0000 7f747c600700 1 -- start start 2024-09-13T18:47:16.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.674+0000 7f747c600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74740cee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.674+0000 7f747c600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747406ae60 con 0x7f7474140050 2024-09-13T18:47:16.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.674+0000 7f747c600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747413d9e0 con 0x7f74740b5ba0 2024-09-13T18:47:16.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.674+0000 7f747c600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740cf7a0 con 0x7f74740b57c0 2024-09-13T18:47:16.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.674+0000 7f7479200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7474140050 0x7f747413d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48738/0 (socket says 172.21.15.81:48738) 2024-09-13T18:47:16.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.674+0000 7f7479200700 1 -- 172.21.15.81:0/1443307699 learned_addr learned my addr 172.21.15.81:0/1443307699 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:16.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7479c00700 1 --2- 172.21.15.81:0/1443307699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74740cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314456800 0 0) 0x7f747406ae60 con 0x7f7474140050 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c0035d0 con 0x7f7474140050 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716226942 0 0) 0x7f747413d9e0 con 0x7f74740b5ba0 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f747406ae60 con 0x7f74740b5ba0 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7479c00700 1 -- 172.21.15.81:0/1443307699 >> v1:172.21.15.178:6789/0 conn(0x7f74740b5ba0 legacy=0x7f747413f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7479c00700 1 -- 172.21.15.81:0/1443307699 >> v1:172.21.15.81:6789/0 conn(0x7f7474140050 legacy=0x7f747413d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4119674164 0 0) 0x7f745c0035d0 con 0x7f7474140050 2024-09-13T18:47:16.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7479c00700 1 -- 172.21.15.81:0/1443307699 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747406a530 con 0x7f74740b57c0 2024-09-13T18:47:16.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7479c00700 1 --2- 172.21.15.81:0/1443307699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74740cee30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7468009880 tx=0x7f7468009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaa1cac81d8bb207 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468011830 con 0x7f74740b57c0 2024-09-13T18:47:16.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7468011990 con 0x7f74740b57c0 2024-09-13T18:47:16.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f7473e00700 1 -- 172.21.15.81:0/1443307699 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468011d20 con 0x7f74740b57c0 2024-09-13T18:47:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f747c600700 1 -- 172.21.15.81:0/1443307699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 msgr2=0x7f74740cee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f747c600700 1 --2- 172.21.15.81:0/1443307699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74740cee30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7468009880 tx=0x7f7468009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f747c600700 1 -- 172.21.15.81:0/1443307699 shutdown_connections 2024-09-13T18:47:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f747c600700 1 --2- 172.21.15.81:0/1443307699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74740cee30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f747c600700 1 -- 172.21.15.81:0/1443307699 >> 172.21.15.81:0/1443307699 conn(0x7f74740b19d0 msgr2=0x7f74740b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.678+0000 7f747c600700 1 -- 172.21.15.81:0/1443307699 shutdown_connections 2024-09-13T18:47:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 -- 172.21.15.81:0/1443307699 wait complete. 2024-09-13T18:47:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 Processor -- start 2024-09-13T18:47:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 -- start start 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74741f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74740b5ba0 0x7f747413c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 0x7f74741538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474150910 con 0x7f7474140050 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747413ce00 con 0x7f74740b5ba0 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.682+0000 7f747c600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7474155540 con 0x7f74740b57c0 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 0x7f74741538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 0x7f74741538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33086/0 (socket says 172.21.15.81:33086) 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 -- 172.21.15.81:0/228917144 learned_addr learned my addr 172.21.15.81:0/228917144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f7479200700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74740b5ba0 0x7f747413c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f7479c00700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74741f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 -- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 msgr2=0x7f74741f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74741f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 -- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74740b5ba0 msgr2=0x7f747413c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74740b5ba0 0x7f747413c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 -- 172.21.15.81:0/228917144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680094b0 con 0x7f7474140050 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f7479c00700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74741f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747a600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 0x7f74741538b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f746c00cc20 tx=0x7f746c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c003c20 con 0x7f7474140050 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c003d80 con 0x7f7474140050 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7474153df0 con 0x7f7474140050 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c00ab90 con 0x7f7474140050 2024-09-13T18:47:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74741f6c40 con 0x7f7474140050 2024-09-13T18:47:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.686+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74741553a0 con 0x7f7474140050 2024-09-13T18:47:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.690+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f746c00acf0 con 0x7f7474140050 2024-09-13T18:47:16.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.690+0000 7f7471600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7454066730 0x7f7454068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.690+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f746c0843d0 con 0x7f7474140050 2024-09-13T18:47:16.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.690+0000 7f7479c00700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7454066730 0x7f7454068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.690+0000 7f7479c00700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7454066730 0x7f7454068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74680090b0 tx=0x7f746801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.698+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74741553a0 con 0x7f7474140050 2024-09-13T18:47:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:16.886+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f74741553a0 con 0x7f7474140050 2024-09-13T18:47:18.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.466+0000 7f7471600700 1 -- 172.21.15.81:0/228917144 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7f74741553a0 con 0x7f7474140050 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7454066730 msgr2=0x7f7454068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7454066730 0x7f7454068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f74680090b0 tx=0x7f746801c040 comp rx=0 tx=0).stop 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 msgr2=0x7f74741538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 0x7f74741538b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f746c00cc20 tx=0x7f746c00cf30 comp rx=0 tx=0).stop 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 shutdown_connections 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7454066730 0x7f7454068bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7474140050 0x7f74741538b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74740b5ba0 0x7f747413c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 --2- 172.21.15.81:0/228917144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74740b57c0 0x7f74741f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 >> 172.21.15.81:0/228917144 conn(0x7f74740b19d0 msgr2=0x7f747413f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 shutdown_connections 2024-09-13T18:47:18.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.482+0000 7f747c600700 1 -- 172.21.15.81:0/228917144 wait complete. 2024-09-13T18:47:18.492 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' created 2024-09-13T18:47:18.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T18:47:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.678+0000 7f4022e00700 1 Processor -- start 2024-09-13T18:47:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.678+0000 7f4022e00700 1 -- start start 2024-09-13T18:47:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f4022e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 0x7f401c071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f4022e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c15ea30 con 0x7f401c06c4c0 2024-09-13T18:47:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f4022e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c070670 con 0x7f401c146720 2024-09-13T18:47:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f4022e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c070950 con 0x7f401c0cf280 2024-09-13T18:47:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f401c06c4c0 0x7f401c0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48750/0 (socket says 172.21.15.81:48750) 2024-09-13T18:47:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401b400700 1 -- 172.21.15.81:0/2788537876 learned_addr learned my addr 172.21.15.81:0/2788537876 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312378322 0 0) 0x7f401c15ea30 con 0x7f401c06c4c0 2024-09-13T18:47:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40000035d0 con 0x7f401c06c4c0 2024-09-13T18:47:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f4020e00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 0x7f401c071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314848061 0 0) 0x7f40000035d0 con 0x7f401c06c4c0 2024-09-13T18:47:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 msgr2=0x7f401c071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 0x7f401c071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 >> v1:172.21.15.178:6789/0 conn(0x7f401c146720 legacy=0x7f401c15e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c070c30 con 0x7f401c06c4c0 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f4008001670 con 0x7f401c06c4c0 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 >> v1:172.21.15.81:6789/0 conn(0x7f401c06c4c0 legacy=0x7f401c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4000003a50 0x7f4000003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4000004870 0x7f4000004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 0x7f4000005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c070950 con 0x7f4000003a50 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400000bb70 con 0x7f4000004870 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400000bd30 con 0x7f401c0cf280 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401be00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4000003a50 0x7f4000003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401b400700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4000004870 0x7f4000004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f4020e00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 0x7f4000005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401be00700 1 -- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 msgr2=0x7f4000005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401be00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f401c0cf280 0x7f4000005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401be00700 1 -- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4000004870 msgr2=0x7f4000004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401be00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4000004870 0x7f4000004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.682+0000 7f401be00700 1 -- 172.21.15.81:0/2788537876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40000035d0 con 0x7f4000003a50 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f401be00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4000003a50 0x7f4000003e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f400c003ef0 tx=0x7f40000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27ad0f5d071c1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c016070 con 0x7f4000003a50 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c006880 con 0x7f4000003a50 2024-09-13T18:47:18.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f401aa00700 1 -- 172.21.15.81:0/2788537876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c003990 con 0x7f4000003a50 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 -- 172.21.15.81:0/2788537876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4000003a50 msgr2=0x7f4000003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 --2- 172.21.15.81:0/2788537876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4000003a50 0x7f4000003e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f400c003ef0 tx=0x7f40000058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4020e00700 1 -- 172.21.15.81:0/2788537876 reap_dead start 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 -- 172.21.15.81:0/2788537876 shutdown_connections 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 -- 172.21.15.81:0/2788537876 >> 172.21.15.81:0/2788537876 conn(0x7f401c06a570 msgr2=0x7f401c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 -- 172.21.15.81:0/2788537876 shutdown_connections 2024-09-13T18:47:18.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 -- 172.21.15.81:0/2788537876 wait complete. 2024-09-13T18:47:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.686+0000 7f4022e00700 1 Processor -- start 2024-09-13T18:47:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 -- start start 2024-09-13T18:47:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4000003a50 0x7f401c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 0x7f401c1e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f401c1e7cf0 0x7f401c132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c15aae0 con 0x7f401c1e7350 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0b0910 con 0x7f401c1e7cf0 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c1e81a0 con 0x7f4000003a50 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 0x7f401c1e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 0x7f401c1e77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33100/0 (socket says 172.21.15.81:33100) 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 -- 172.21.15.81:0/4158333797 learned_addr learned my addr 172.21.15.81:0/4158333797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401be00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4000003a50 0x7f401c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4020e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f401c1e7cf0 0x7f401c132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 -- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4000003a50 msgr2=0x7f401c157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4000003a50 0x7f401c157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 -- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f401c1e7cf0 msgr2=0x7f401c132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f401c1e7cf0 0x7f401c132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 -- 172.21.15.81:0/4158333797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c0b0da0 con 0x7f401c1e7350 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401be00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4000003a50 0x7f401c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f401b400700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 0x7f401c1e77b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40080017a0 tx=0x7f4008007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4008007800 con 0x7f401c1e7350 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400800f870 con 0x7f401c1e7350 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c0affe0 con 0x7f401c1e7350 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400800fc00 con 0x7f401c1e7350 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.690+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c0b05a0 con 0x7f401c1e7350 2024-09-13T18:47:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.694+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c0b0730 con 0x7f401c1e7350 2024-09-13T18:47:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.694+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f400800fd60 con 0x7f401c1e7350 2024-09-13T18:47:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.698+0000 7f4013e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ffc066760 0x7f3ffc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.698+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4008084500 con 0x7f401c1e7350 2024-09-13T18:47:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.698+0000 7f401be00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ffc066760 0x7f3ffc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.698+0000 7f401be00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ffc066760 0x7f3ffc068c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f400c014040 tx=0x7f400c009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.702+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4008051470 con 0x7f401c1e7350 2024-09-13T18:47:18.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:18.886+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f401c06c8c0 con 0x7f401c1e7350 2024-09-13T18:47:19.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.478+0000 7f4013e00700 1 -- 172.21.15.81:0/4158333797 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4008054a90 con 0x7f401c1e7350 2024-09-13T18:47:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ffc066760 msgr2=0x7f3ffc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ffc066760 0x7f3ffc068c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f400c014040 tx=0x7f400c009030 comp rx=0 tx=0).stop 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 msgr2=0x7f401c1e77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 0x7f401c1e77b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f40080017a0 tx=0x7f4008007620 comp rx=0 tx=0).stop 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 shutdown_connections 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ffc066760 0x7f3ffc068c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f401c1e7cf0 0x7f401c132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401c1e7350 0x7f401c1e77b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 --2- 172.21.15.81:0/4158333797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4000003a50 0x7f401c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.490+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 >> 172.21.15.81:0/4158333797 conn(0x7f401c06a570 msgr2=0x7f401c15ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.494+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 shutdown_connections 2024-09-13T18:47:19.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.494+0000 7f4022e00700 1 -- 172.21.15.81:0/4158333797 wait complete. 2024-09-13T18:47:19.510 INFO:teuthology.orchestra.run.smithi081.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T18:47:19.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T18:47:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 Processor -- start 2024-09-13T18:47:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 -- start start 2024-09-13T18:47:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b6c143b70 0x7f0b6c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c06d070 0x7f0b6c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c0b1980 con 0x7f0b6c06d620 2024-09-13T18:47:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b2500 con 0x7f0b6c143b70 2024-09-13T18:47:19.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.702+0000 7f0b71200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0b1bd0 con 0x7f0b6c06d070 2024-09-13T18:47:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b6c06d620 0x7f0b6c06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48752/0 (socket says 172.21.15.81:48752) 2024-09-13T18:47:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6aa00700 1 -- 172.21.15.81:0/1186432311 learned_addr learned my addr 172.21.15.81:0/1186432311 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6b400700 1 --2- 172.21.15.81:0/1186432311 >> v2:172.21.15.178:3300/0 conn(0x7f0b6c143b70 0x7f0b6c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6be00700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c06d070 0x7f0b6c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6a000700 1 -- 172.21.15.81:0/1186432311 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426535171 0 0) 0x7f0b6c0b1980 con 0x7f0b6c06d620 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6a000700 1 -- 172.21.15.81:0/1186432311 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b500035d0 con 0x7f0b6c06d620 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6b400700 1 -- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c06d070 msgr2=0x7f0b6c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6b400700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c06d070 0x7f0b6c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6b400700 1 -- 172.21.15.81:0/1186432311 >> v1:172.21.15.81:6789/0 conn(0x7f0b6c06d620 legacy=0x7f0b6c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6b400700 1 -- 172.21.15.81:0/1186432311 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0b1eb0 con 0x7f0b6c143b70 2024-09-13T18:47:19.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6be00700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c06d070 0x7f0b6c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6b400700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c143b70 0x7f0b6c0cde20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009850 tx=0x7f0b5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb42fec5e9e4f39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6a000700 1 -- 172.21.15.81:0/1186432311 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011830 con 0x7f0b6c143b70 2024-09-13T18:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6a000700 1 -- 172.21.15.81:0/1186432311 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c011990 con 0x7f0b6c143b70 2024-09-13T18:47:19.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b6a000700 1 -- 172.21.15.81:0/1186432311 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c011d40 con 0x7f0b6c143b70 2024-09-13T18:47:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 -- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c143b70 msgr2=0x7f0b6c0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c143b70 0x7f0b6c0cde20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009850 tx=0x7f0b5c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 -- 172.21.15.81:0/1186432311 shutdown_connections 2024-09-13T18:47:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c06d070 0x7f0b6c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 --2- 172.21.15.81:0/1186432311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c143b70 0x7f0b6c0cde20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 -- 172.21.15.81:0/1186432311 >> 172.21.15.81:0/1186432311 conn(0x7f0b6c06a390 msgr2=0x7f0b6c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 -- 172.21.15.81:0/1186432311 shutdown_connections 2024-09-13T18:47:19.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.706+0000 7f0b71200700 1 -- 172.21.15.81:0/1186432311 wait complete. 2024-09-13T18:47:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.710+0000 7f0b71200700 1 Processor -- start 2024-09-13T18:47:19.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.710+0000 7f0b71200700 1 -- start start 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c06d070 0x7f0b6c159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 0x7f0b6c13e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c143b70 0x7f0b6c154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c15a4e0 con 0x7f0b6c06d620 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c15a7c0 con 0x7f0b6c06d070 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c1566c0 con 0x7f0b6c143b70 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 0x7f0b6c13e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 0x7f0b6c13e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33104/0 (socket says 172.21.15.81:33104) 2024-09-13T18:47:19.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 -- 172.21.15.81:0/2383070940 learned_addr learned my addr 172.21.15.81:0/2383070940 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:19.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6b400700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c06d070 0x7f0b6c159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6be00700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c143b70 0x7f0b6c154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 -- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c143b70 msgr2=0x7f0b6c154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c143b70 0x7f0b6c154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 -- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c06d070 msgr2=0x7f0b6c159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c06d070 0x7f0b6c159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 -- 172.21.15.81:0/2383070940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64009a70 con 0x7f0b6c06d620 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b6aa00700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 0x7f0b6c13e700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c700 tx=0x7f0b5800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58005d90 con 0x7f0b6c06d620 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580070d0 con 0x7f0b6c06d620 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0094b0 con 0x7f0b6c06d620 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58007480 con 0x7f0b6c06d620 2024-09-13T18:47:19.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.714+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c156c80 con 0x7f0b6c06d620 2024-09-13T18:47:19.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.718+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c156520 con 0x7f0b6c06d620 2024-09-13T18:47:19.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.718+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b580075e0 con 0x7f0b6c06d620 2024-09-13T18:47:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.722+0000 7f0b63400700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0b4c066730 0x7f0b4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.722+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f0b580839f0 con 0x7f0b6c06d620 2024-09-13T18:47:19.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.722+0000 7f0b6b400700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0b4c066730 0x7f0b4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.722+0000 7f0b6b400700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0b4c066730 0x7f0b4c068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0090b0 tx=0x7f0b5c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.726+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b6c156520 con 0x7f0b6c06d620 2024-09-13T18:47:19.927 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:47:19.918+0000 7f34c9800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:47:19.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.946+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0b6c156520 con 0x7f0b6c06d620 2024-09-13T18:47:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.954+0000 7f0b63400700 1 -- 172.21.15.81:0/2383070940 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0b6c156520 con 0x7f0b6c06d620 2024-09-13T18:47:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0b4c066730 msgr2=0x7f0b4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0b4c066730 0x7f0b4c068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0090b0 tx=0x7f0b5c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 msgr2=0x7f0b6c13e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 0x7f0b6c13e700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800c700 tx=0x7f0b5800ca10 comp rx=0 tx=0).stop 2024-09-13T18:47:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 shutdown_connections 2024-09-13T18:47:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0b4c066730 0x7f0b4c068bf0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0090b0 tx=0x7f0b5c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b6c143b70 0x7f0b6c154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b6c06d620 0x7f0b6c13e700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 --2- 172.21.15.81:0/2383070940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b6c06d070 0x7f0b6c159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 >> 172.21.15.81:0/2383070940 conn(0x7f0b6c06a390 msgr2=0x7f0b6c0cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 shutdown_connections 2024-09-13T18:47:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:19.958+0000 7f0b71200700 1 -- 172.21.15.81:0/2383070940 wait complete. 2024-09-13T18:47:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:added data pool 4 to fsmap 2024-09-13T18:47:19.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.146+0000 7fbe78e00700 1 Processor -- start 2024-09-13T18:47:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.146+0000 7fbe78e00700 1 -- start start 2024-09-13T18:47:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe78e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe740cc160 0x7fbe7406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe78e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe741541c0 con 0x7fbe740cf700 2024-09-13T18:47:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe78e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe740cc710 con 0x7fbe74153de0 2024-09-13T18:47:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe78e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe740cc9f0 con 0x7fbe740cc160 2024-09-13T18:47:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe6aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe740cf700 0x7fbe740cba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48756/0 (socket says 172.21.15.81:48756) 2024-09-13T18:47:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe6aa00700 1 -- 172.21.15.81:0/3259998472 learned_addr learned my addr 172.21.15.81:0/3259998472 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe73e00700 1 --2- 172.21.15.81:0/3259998472 >> v2:172.21.15.81:3300/0 conn(0x7fbe740cc160 0x7fbe7406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe72a00700 1 -- 172.21.15.81:0/3259998472 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332061212 0 0) 0x7fbe5c001110 con 0x7fbe740cf700 2024-09-13T18:47:20.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe72a00700 1 -- 172.21.15.81:0/3259998472 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe580035d0 con 0x7fbe740cf700 2024-09-13T18:47:20.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe73e00700 1 -- 172.21.15.81:0/3259998472 >> v1:172.21.15.178:6789/0 conn(0x7fbe74153de0 legacy=0x7fbe740ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe73e00700 1 -- 172.21.15.81:0/3259998472 >> v1:172.21.15.81:6789/0 conn(0x7fbe740cf700 legacy=0x7fbe740cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe73e00700 1 -- 172.21.15.81:0/3259998472 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7406c5c0 con 0x7fbe740cc160 2024-09-13T18:47:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe73e00700 1 --2- 172.21.15.81:0/3259998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cc160 0x7fbe7406d0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009850 tx=0x7fbe6c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceae660efca691d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe72a00700 1 -- 172.21.15.81:0/3259998472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c011830 con 0x7fbe740cc160 2024-09-13T18:47:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe72a00700 1 -- 172.21.15.81:0/3259998472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c011990 con 0x7fbe740cc160 2024-09-13T18:47:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.150+0000 7fbe72a00700 1 -- 172.21.15.81:0/3259998472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c011d00 con 0x7fbe740cc160 2024-09-13T18:47:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 -- 172.21.15.81:0/3259998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cc160 msgr2=0x7fbe7406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 --2- 172.21.15.81:0/3259998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cc160 0x7fbe7406d0a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009850 tx=0x7fbe6c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 -- 172.21.15.81:0/3259998472 shutdown_connections 2024-09-13T18:47:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 --2- 172.21.15.81:0/3259998472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cc160 0x7fbe7406d0a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 -- 172.21.15.81:0/3259998472 >> 172.21.15.81:0/3259998472 conn(0x7fbe7406a390 msgr2=0x7fbe7406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 -- 172.21.15.81:0/3259998472 shutdown_connections 2024-09-13T18:47:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 -- 172.21.15.81:0/3259998472 wait complete. 2024-09-13T18:47:20.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 Processor -- start 2024-09-13T18:47:20.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.154+0000 7fbe78e00700 1 -- start start 2024-09-13T18:47:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe740cc160 0x7fbe74145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 0x7fbe741562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe74153de0 0x7fbe741567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74142880 con 0x7fbe740cf700 2024-09-13T18:47:20.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741464f0 con 0x7fbe740cc160 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74156d20 con 0x7fbe74153de0 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 0x7fbe741562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 0x7fbe741562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33126/0 (socket says 172.21.15.81:33126) 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 -- 172.21.15.81:0/1125410367 learned_addr learned my addr 172.21.15.81:0/1125410367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe73400700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe740cc160 0x7fbe74145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe73e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe74153de0 0x7fbe741567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 -- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe74153de0 msgr2=0x7fbe741567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe74153de0 0x7fbe741567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 -- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe740cc160 msgr2=0x7fbe74145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe740cc160 0x7fbe74145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 -- 172.21.15.81:0/1125410367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0094b0 con 0x7fbe740cf700 2024-09-13T18:47:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe73400700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe740cc160 0x7fbe74145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6aa00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 0x7fbe741562a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00c700 tx=0x7fbe5c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c005d90 con 0x7fbe740cf700 2024-09-13T18:47:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c0070d0 con 0x7fbe740cf700 2024-09-13T18:47:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe74142c40 con 0x7fbe740cf700 2024-09-13T18:47:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c007460 con 0x7fbe740cf700 2024-09-13T18:47:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.158+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe74143200 con 0x7fbe740cf700 2024-09-13T18:47:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.162+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7406d0a0 con 0x7fbe740cf700 2024-09-13T18:47:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.162+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe5c0075c0 con 0x7fbe740cf700 2024-09-13T18:47:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.162+0000 7fbe6be00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe50066730 0x7fbe50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.162+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe5c083850 con 0x7fbe740cf700 2024-09-13T18:47:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.162+0000 7fbe73400700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe50066730 0x7fbe50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.166+0000 7fbe73400700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe50066730 0x7fbe50068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe640021f0 tx=0x7fbe64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.170+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbe5c050830 con 0x7fbe740cf700 2024-09-13T18:47:20.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.402+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe741541c0 con 0x7fbe740cf700 2024-09-13T18:47:20.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.402+0000 7fbe6be00700 1 -- 172.21.15.81:0/1125410367 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4730 (secure 0 0 0) 0x7fbe741541c0 con 0x7fbe740cf700 2024-09-13T18:47:20.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:20.414 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:19.951473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe50066730 msgr2=0x7fbe50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe50066730 0x7fbe50068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbe640021f0 tx=0x7fbe64009040 comp rx=0 tx=0).stop 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 msgr2=0x7fbe741562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 0x7fbe741562a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00c700 tx=0x7fbe5c00cac0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 shutdown_connections 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe50066730 0x7fbe50068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe74153de0 0x7fbe741567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe740cf700 0x7fbe741562a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 --2- 172.21.15.81:0/1125410367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe740cc160 0x7fbe74145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 >> 172.21.15.81:0/1125410367 conn(0x7fbe7406a390 msgr2=0x7fbe7415ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 shutdown_connections 2024-09-13T18:47:20.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.406+0000 7fbe78e00700 1 -- 172.21.15.81:0/1125410367 wait complete. 2024-09-13T18:47:20.421 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-13T18:47:20.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 Processor -- start 2024-09-13T18:47:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 -- start start 2024-09-13T18:47:20.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5ec0cb020 0x7fa5ec0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa5ec06aaa0 0x7fa5ec06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec06b430 con 0x7fa5ec15c2a0 2024-09-13T18:47:20.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec0b2ad0 con 0x7fa5ec0cb020 2024-09-13T18:47:20.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5eb200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec15b960 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5ec0cb020 0x7fa5ec0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa5ec0cb020 0x7fa5ec0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33138/0 (socket says 172.21.15.81:33138) 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 -- 172.21.15.81:0/1120350620 learned_addr learned my addr 172.21.15.81:0/1120350620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9400700 1 --1- 172.21.15.81:0/1120350620 >> v1:172.21.15.81:6789/0 conn(0x7fa5ec15c2a0 0x7fa5ec15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48766/0 (socket says 172.21.15.81:48766) 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5ea800700 1 --2- 172.21.15.81:0/1120350620 >> v2:172.21.15.178:3300/0 conn(0x7fa5ec06aaa0 0x7fa5ec06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 -- 172.21.15.81:0/1120350620 >> v2:172.21.15.178:3300/0 conn(0x7fa5ec06aaa0 msgr2=0x7fa5ec06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:20.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 --2- 172.21.15.81:0/1120350620 >> v2:172.21.15.178:3300/0 conn(0x7fa5ec06aaa0 0x7fa5ec06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 -- 172.21.15.81:0/1120350620 >> v1:172.21.15.81:6789/0 conn(0x7fa5ec15c2a0 legacy=0x7fa5ec15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.602+0000 7fa5e9e00700 1 -- 172.21.15.81:0/1120350620 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec15bc40 con 0x7fa5ec0cb020 2024-09-13T18:47:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5e9e00700 1 --2- 172.21.15.81:0/1120350620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec0cb020 0x7fa5ec0cc6f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0cd7e0 tx=0x7fa5dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6d6e220cfdebac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5e8a00700 1 -- 172.21.15.81:0/1120350620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc011830 con 0x7fa5ec0cb020 2024-09-13T18:47:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5e8a00700 1 -- 172.21.15.81:0/1120350620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc011990 con 0x7fa5ec0cb020 2024-09-13T18:47:20.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5e8a00700 1 -- 172.21.15.81:0/1120350620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc011d20 con 0x7fa5ec0cb020 2024-09-13T18:47:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 -- 172.21.15.81:0/1120350620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec0cb020 msgr2=0x7fa5ec0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 --2- 172.21.15.81:0/1120350620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec0cb020 0x7fa5ec0cc6f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0cd7e0 tx=0x7fa5dc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 -- 172.21.15.81:0/1120350620 shutdown_connections 2024-09-13T18:47:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 --2- 172.21.15.81:0/1120350620 >> v2:172.21.15.178:3300/0 conn(0x7fa5ec06aaa0 0x7fa5ec06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 --2- 172.21.15.81:0/1120350620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec0cb020 0x7fa5ec0cc6f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 -- 172.21.15.81:0/1120350620 >> 172.21.15.81:0/1120350620 conn(0x7fa5ec0b0c40 msgr2=0x7fa5ec06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 -- 172.21.15.81:0/1120350620 shutdown_connections 2024-09-13T18:47:20.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.606+0000 7fa5eb200700 1 -- 172.21.15.81:0/1120350620 wait complete. 2024-09-13T18:47:20.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 Processor -- start 2024-09-13T18:47:20.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 -- start start 2024-09-13T18:47:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 0x7fa5ec144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5ec0cb020 0x7fa5ec1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5ec15c2a0 0x7fa5ec150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec156de0 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec155d40 con 0x7fa5ec15c2a0 2024-09-13T18:47:20.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec156020 con 0x7fa5ec0cb020 2024-09-13T18:47:20.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 0x7fa5ec144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 0x7fa5ec144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33152/0 (socket says 172.21.15.81:33152) 2024-09-13T18:47:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 -- 172.21.15.81:0/4095826805 learned_addr learned my addr 172.21.15.81:0/4095826805 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9400700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5ec0cb020 0x7fa5ec1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5ea800700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5ec15c2a0 0x7fa5ec150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 -- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5ec0cb020 msgr2=0x7fa5ec1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5ec0cb020 0x7fa5ec1578b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 -- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5ec15c2a0 msgr2=0x7fa5ec150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5ec15c2a0 0x7fa5ec150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 -- 172.21.15.81:0/4095826805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009570 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e9e00700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 0x7fa5ec144330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0b1690 tx=0x7fa5dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc004450 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc01f070 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec156300 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.610+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc003900 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.614+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1568c0 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.614+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ec06aef0 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.614+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5dc003a60 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.618+0000 7fa5e2000700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa5cc066730 0x7fa5cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.618+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5dc021070 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.618+0000 7fa5e9400700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa5cc066730 0x7fa5cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.618+0000 7fa5e9400700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa5cc066730 0x7fa5cc068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0cb860 tx=0x7fa5d8007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.622+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa5dc052990 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.814+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5ec073660 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5e2000700 1 -- 172.21.15.81:0/4095826805 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa5dc0045d0 con 0x7fa5ec06aaa0 2024-09-13T18:47:20.827 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:20.827 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa5cc066730 msgr2=0x7fa5cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa5cc066730 0x7fa5cc068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0cb860 tx=0x7fa5d8007ef0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 msgr2=0x7fa5ec144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 0x7fa5ec144330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec0b1690 tx=0x7fa5dc004770 comp rx=0 tx=0).stop 2024-09-13T18:47:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 shutdown_connections 2024-09-13T18:47:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa5cc066730 0x7fa5cc068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5ec15c2a0 0x7fa5ec150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5ec0cb020 0x7fa5ec1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 --2- 172.21.15.81:0/4095826805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5ec06aaa0 0x7fa5ec144330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 >> 172.21.15.81:0/4095826805 conn(0x7fa5ec0b0c40 msgr2=0x7fa5ec15b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 shutdown_connections 2024-09-13T18:47:20.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:20.818+0000 7fa5eb200700 1 -- 172.21.15.81:0/4095826805 wait complete. 2024-09-13T18:47:20.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:21.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.018+0000 7f6c55400700 1 Processor -- start 2024-09-13T18:47:21.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.018+0000 7f6c55400700 1 -- start start 2024-09-13T18:47:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.018+0000 7f6c55400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 0x7f6c5006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.018+0000 7f6c55400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500ccb40 con 0x7f6c500cb020 2024-09-13T18:47:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.018+0000 7f6c55400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5006b430 con 0x7f6c500cc6f0 2024-09-13T18:47:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.018+0000 7f6c55400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b2ad0 con 0x7f6c5006aaa0 2024-09-13T18:47:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6c500cb020 0x7f6c5015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48782/0 (socket says 172.21.15.81:48782) 2024-09-13T18:47:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4fe00700 1 -- 172.21.15.81:0/3527050695 learned_addr learned my addr 172.21.15.81:0/3527050695 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c54a00700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 0x7f6c5006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822861861 0 0) 0x7f6c500ccb40 con 0x7f6c500cb020 2024-09-13T18:47:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c340035d0 con 0x7f6c500cb020 2024-09-13T18:47:21.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047318089 0 0) 0x7f6c38001490 con 0x7f6c500cc6f0 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c500ccb40 con 0x7f6c500cc6f0 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283106515 0 0) 0x7f6c340035d0 con 0x7f6c500cb020 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 msgr2=0x7f6c5006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 0x7f6c5006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 >> v1:172.21.15.178:6789/0 conn(0x7f6c500cc6f0 legacy=0x7f6c5015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5015b960 con 0x7f6c500cb020 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f6c40001670 con 0x7f6c500cb020 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 >> v1:172.21.15.81:6789/0 conn(0x7f6c500cb020 legacy=0x7f6c5015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c34003c50 0x7f6c34004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c34004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 0x7f6c34005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b2ad0 con 0x7f6c34004870 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3400bb60 con 0x7f6c34003c50 2024-09-13T18:47:21.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3400bd20 con 0x7f6c5006aaa0 2024-09-13T18:47:21.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c34004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c54a00700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 0x7f6c34005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4fe00700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c34003c50 0x7f6c34004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 -- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 msgr2=0x7f6c34005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c5006aaa0 0x7f6c34005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 -- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c34003c50 msgr2=0x7f6c34004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c34003c50 0x7f6c34004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 -- 172.21.15.81:0/3527050695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340035d0 con 0x7f6c34004870 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c4fe00700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c34003c50 0x7f6c34004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.022+0000 7f6c47400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c34004cf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c320 tx=0x7f6c340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac630f04858b854 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380020c0 con 0x7f6c34004870 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3800ce80 con 0x7f6c34004870 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c4f400700 1 -- 172.21.15.81:0/3527050695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003c60 con 0x7f6c34004870 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c55400700 1 -- 172.21.15.81:0/3527050695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 msgr2=0x7f6c34004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c55400700 1 --2- 172.21.15.81:0/3527050695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c34004cf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c320 tx=0x7f6c340058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c54a00700 1 -- 172.21.15.81:0/3527050695 reap_dead start 2024-09-13T18:47:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c55400700 1 -- 172.21.15.81:0/3527050695 shutdown_connections 2024-09-13T18:47:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c55400700 1 -- 172.21.15.81:0/3527050695 >> 172.21.15.81:0/3527050695 conn(0x7f6c500b0c40 msgr2=0x7f6c5006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c55400700 1 -- 172.21.15.81:0/3527050695 shutdown_connections 2024-09-13T18:47:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.026+0000 7f6c55400700 1 -- 172.21.15.81:0/3527050695 wait complete. 2024-09-13T18:47:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 Processor -- start 2024-09-13T18:47:21.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 -- start start 2024-09-13T18:47:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c5013aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c50150a80 0x7f6c5013d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c5013d820 0x7f6c5013dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c501511f0 con 0x7f6c34004870 2024-09-13T18:47:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50153e10 con 0x7f6c5013d820 2024-09-13T18:47:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c55400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5013afd0 con 0x7f6c50150a80 2024-09-13T18:47:21.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c5013aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c5013aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33180/0 (socket says 172.21.15.81:33180) 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 -- 172.21.15.81:0/3134490835 learned_addr learned my addr 172.21.15.81:0/3134490835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c47400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c50150a80 0x7f6c5013d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c54a00700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c5013d820 0x7f6c5013dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 -- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c50150a80 msgr2=0x7f6c5013d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c50150a80 0x7f6c5013d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 -- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c5013d820 msgr2=0x7f6c5013dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c5013d820 0x7f6c5013dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 -- 172.21.15.81:0/3134490835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c50153980 con 0x7f6c34004870 2024-09-13T18:47:21.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c54a00700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c5013d820 0x7f6c5013dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4fe00700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c5013aa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000e7b0 tx=0x7f6c4000eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40010510 con 0x7f6c34004870 2024-09-13T18:47:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c40010670 con 0x7f6c34004870 2024-09-13T18:47:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.030+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c400109e0 con 0x7f6c34004870 2024-09-13T18:47:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.034+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c50150f10 con 0x7f6c34004870 2024-09-13T18:47:21.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.034+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c50153610 con 0x7f6c34004870 2024-09-13T18:47:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.034+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5006aef0 con 0x7f6c34004870 2024-09-13T18:47:21.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.034+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c40010b40 con 0x7f6c34004870 2024-09-13T18:47:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.038+0000 7f6c4cc00700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6c2c066730 0x7f6c2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.038+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c40083c60 con 0x7f6c34004870 2024-09-13T18:47:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.038+0000 7f6c47400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6c2c066730 0x7f6c2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.038+0000 7f6c47400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6c2c066730 0x7f6c2c068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c38015040 tx=0x7f6c3800a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.042+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6c40050cf0 con 0x7f6c34004870 2024-09-13T18:47:21.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.230+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c501584d0 con 0x7f6c34004870 2024-09-13T18:47:21.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.234+0000 7f6c4cc00700 1 -- 172.21.15.81:0/3134490835 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6c40019070 con 0x7f6c34004870 2024-09-13T18:47:21.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:21.243 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.234+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6c2c066730 msgr2=0x7f6c2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.234+0000 7f6c55400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6c2c066730 0x7f6c2c068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c38015040 tx=0x7f6c3800a000 comp rx=0 tx=0).stop 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.234+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 msgr2=0x7f6c5013aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.234+0000 7f6c55400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c5013aa90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c4000e7b0 tx=0x7f6c4000eb70 comp rx=0 tx=0).stop 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 shutdown_connections 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6c2c066730 0x7f6c2c068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c5013d820 0x7f6c5013dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c50150a80 0x7f6c5013d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 --2- 172.21.15.81:0/3134490835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c34004870 0x7f6c5013aa90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 >> 172.21.15.81:0/3134490835 conn(0x7f6c500b0c40 msgr2=0x7f6c500b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 shutdown_connections 2024-09-13T18:47:21.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.238+0000 7f6c55400700 1 -- 172.21.15.81:0/3134490835 wait complete. 2024-09-13T18:47:21.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:21.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 Processor -- start 2024-09-13T18:47:21.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 -- start start 2024-09-13T18:47:21.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1980cb020 0x7fb1980cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb19815c2a0 0x7fb19815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980b2ad0 con 0x7fb19806aaa0 2024-09-13T18:47:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19815b960 con 0x7fb19815c2a0 2024-09-13T18:47:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19e000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19815bc40 con 0x7fb1980cb020 2024-09-13T18:47:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb19815c2a0 0x7fb19815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb19815c2a0 0x7fb19815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33186/0 (socket says 172.21.15.81:33186) 2024-09-13T18:47:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 -- 172.21.15.81:0/728826525 learned_addr learned my addr 172.21.15.81:0/728826525 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb19cc00700 1 --2- 172.21.15.81:0/728826525 >> v2:172.21.15.178:3300/0 conn(0x7fb1980cb020 0x7fb1980cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 -- 172.21.15.81:0/728826525 >> v2:172.21.15.178:3300/0 conn(0x7fb1980cb020 msgr2=0x7fb1980cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 --2- 172.21.15.81:0/728826525 >> v2:172.21.15.178:3300/0 conn(0x7fb1980cb020 0x7fb1980cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 -- 172.21.15.81:0/728826525 >> v1:172.21.15.178:6789/0 conn(0x7fb19806aaa0 legacy=0x7fb1980b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.438+0000 7fb197e00700 1 -- 172.21.15.81:0/728826525 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19815bf20 con 0x7fb19815c2a0 2024-09-13T18:47:21.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb197e00700 1 --2- 172.21.15.81:0/728826525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb19815c2a0 0x7fb19815b0e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb19806b660 tx=0x7fb184009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f1375a11107afb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb197400700 1 -- 172.21.15.81:0/728826525 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400b8a0 con 0x7fb19815c2a0 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb197400700 1 -- 172.21.15.81:0/728826525 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18400ba00 con 0x7fb19815c2a0 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb197400700 1 -- 172.21.15.81:0/728826525 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18400bd90 con 0x7fb19815c2a0 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 -- 172.21.15.81:0/728826525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb19815c2a0 msgr2=0x7fb19815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 --2- 172.21.15.81:0/728826525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb19815c2a0 0x7fb19815b0e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb19806b660 tx=0x7fb184009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 -- 172.21.15.81:0/728826525 shutdown_connections 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 --2- 172.21.15.81:0/728826525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb19815c2a0 0x7fb19815b0e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 --2- 172.21.15.81:0/728826525 >> v2:172.21.15.178:3300/0 conn(0x7fb1980cb020 0x7fb1980cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 -- 172.21.15.81:0/728826525 >> 172.21.15.81:0/728826525 conn(0x7fb1980b0c40 msgr2=0x7fb19806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 -- 172.21.15.81:0/728826525 shutdown_connections 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 -- 172.21.15.81:0/728826525 wait complete. 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 Processor -- start 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.442+0000 7fb19e000700 1 -- start start 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19806aaa0 0x7fb1980aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 0x7fb198142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19815c2a0 0x7fb1980c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980ca030 con 0x7fb1980cb020 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980aa420 con 0x7fb19806aaa0 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1980a9af0 con 0x7fb19815c2a0 2024-09-13T18:47:21.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 0x7fb198142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 0x7fb198142ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33196/0 (socket says 172.21.15.81:33196) 2024-09-13T18:47:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 -- 172.21.15.81:0/4204073311 learned_addr learned my addr 172.21.15.81:0/4204073311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19cc00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19806aaa0 0x7fb1980aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19d600700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19815c2a0 0x7fb1980c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 -- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19815c2a0 msgr2=0x7fb1980c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19815c2a0 0x7fb1980c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 -- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19806aaa0 msgr2=0x7fb1980aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19806aaa0 0x7fb1980aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 -- 172.21.15.81:0/4204073311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009570 con 0x7fb1980cb020 2024-09-13T18:47:21.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb197e00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 0x7fb198142ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1980b1690 tx=0x7fb184004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840038c0 con 0x7fb1980cb020 2024-09-13T18:47:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1980a9dd0 con 0x7fb1980cb020 2024-09-13T18:47:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18401e070 con 0x7fb1980cb020 2024-09-13T18:47:21.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184003c80 con 0x7fb1980cb020 2024-09-13T18:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb198143430 con 0x7fb1980cb020 2024-09-13T18:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.446+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19804e700 con 0x7fb1980cb020 2024-09-13T18:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.450+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb184025480 con 0x7fb1980cb020 2024-09-13T18:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.450+0000 7fb194c00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb178066730 0x7fb178068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.450+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb184020070 con 0x7fb1980cb020 2024-09-13T18:47:21.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.450+0000 7fb19cc00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb178066730 0x7fb178068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.450+0000 7fb19cc00700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb178066730 0x7fb178068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009950 tx=0x7fb18c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.454+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb184052ce0 con 0x7fb1980cb020 2024-09-13T18:47:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.686+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1980cdb30 con 0x7fb1980cb020 2024-09-13T18:47:22.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.686+0000 7fb194c00700 1 -- 172.21.15.81:0/4204073311 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4730 (secure 0 0 0) 0x7fb184056300 con 0x7fb1980cb020 2024-09-13T18:47:22.056 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:22.056 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:19.951473+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb178066730 msgr2=0x7fb178068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb178066730 0x7fb178068bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb18c009950 tx=0x7fb18c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 msgr2=0x7fb198142ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 0x7fb198142ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb1980b1690 tx=0x7fb184004770 comp rx=0 tx=0).stop 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 shutdown_connections 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb178066730 0x7fb178068bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19815c2a0 0x7fb1980c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1980cb020 0x7fb198142ef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 --2- 172.21.15.81:0/4204073311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19806aaa0 0x7fb1980aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 >> 172.21.15.81:0/4204073311 conn(0x7fb1980b0c40 msgr2=0x7fb19806ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 shutdown_connections 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:21.690+0000 7fb19e000700 1 -- 172.21.15.81:0/4204073311 wait complete. 2024-09-13T18:47:22.058 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-13T18:47:22.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.226+0000 7fcdacc00700 1 Processor -- start 2024-09-13T18:47:22.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.226+0000 7fcdacc00700 1 -- start start 2024-09-13T18:47:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcda815e070 0x7fcda80cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d10f0 0x7fcda80b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda80cd970 con 0x7fcda80d1540 2024-09-13T18:47:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda815e450 con 0x7fcda815e070 2024-09-13T18:47:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80d0050 con 0x7fcda80d10f0 2024-09-13T18:47:22.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcda815e070 0x7fcda80cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcda815e070 0x7fcda80cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33200/0 (socket says 172.21.15.81:33200) 2024-09-13T18:47:22.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 -- 172.21.15.81:0/3551607764 learned_addr learned my addr 172.21.15.81:0/3551607764 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:22.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/3551607764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d10f0 0x7fcda80b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 -- 172.21.15.81:0/3551607764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d10f0 msgr2=0x7fcda80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 --2- 172.21.15.81:0/3551607764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d10f0 0x7fcda80b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 -- 172.21.15.81:0/3551607764 >> v1:172.21.15.178:6789/0 conn(0x7fcda80d1540 legacy=0x7fcda80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 -- 172.21.15.81:0/3551607764 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80d0330 con 0x7fcda815e070 2024-09-13T18:47:22.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda7400700 1 --2- 172.21.15.81:0/3551607764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda815e070 0x7fcda80cd430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009910 tx=0x7fcd98009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1009de3e2f944a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda6a00700 1 -- 172.21.15.81:0/3551607764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800ba60 con 0x7fcda815e070 2024-09-13T18:47:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda6a00700 1 -- 172.21.15.81:0/3551607764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9800bbc0 con 0x7fcda815e070 2024-09-13T18:47:22.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcda6a00700 1 -- 172.21.15.81:0/3551607764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98009e60 con 0x7fcda815e070 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 -- 172.21.15.81:0/3551607764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda815e070 msgr2=0x7fcda80cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.230+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3551607764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda815e070 0x7fcda80cd430 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009910 tx=0x7fcd98009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 -- 172.21.15.81:0/3551607764 shutdown_connections 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3551607764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d10f0 0x7fcda80b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3551607764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda815e070 0x7fcda80cd430 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 -- 172.21.15.81:0/3551607764 >> 172.21.15.81:0/3551607764 conn(0x7fcda8071f00 msgr2=0x7fcda80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 -- 172.21.15.81:0/3551607764 shutdown_connections 2024-09-13T18:47:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 -- 172.21.15.81:0/3551607764 wait complete. 2024-09-13T18:47:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 Processor -- start 2024-09-13T18:47:22.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.234+0000 7fcdacc00700 1 -- start start 2024-09-13T18:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 0x7fcda81f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d1540 0x7fcda80b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda815e070 0x7fcda80b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda81f2080 con 0x7fcda80d10f0 2024-09-13T18:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda806bd70 con 0x7fcda815e070 2024-09-13T18:47:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80ada80 con 0x7fcda80d1540 2024-09-13T18:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 0x7fcda81f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 0x7fcda81f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33206/0 (socket says 172.21.15.81:33206) 2024-09-13T18:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 -- 172.21.15.81:0/3303612142 learned_addr learned my addr 172.21.15.81:0/3303612142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d1540 0x7fcda80b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7e00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda815e070 0x7fcda80b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 -- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d1540 msgr2=0x7fcda80b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d1540 0x7fcda80b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 -- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda815e070 msgr2=0x7fcda80b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda815e070 0x7fcda80b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 -- 172.21.15.81:0/3303612142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd98009570 con 0x7fcda80d10f0 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d1540 0x7fcda80b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7e00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda815e070 0x7fcda80b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:22.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcda7400700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 0x7fcda81f1b40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcd98000c00 tx=0x7fcd98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98004610 con 0x7fcda80d10f0 2024-09-13T18:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9801e070 con 0x7fcda80d10f0 2024-09-13T18:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98003920 con 0x7fcda80d10f0 2024-09-13T18:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda80ad150 con 0x7fcda80d10f0 2024-09-13T18:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.238+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda80ad710 con 0x7fcda80d10f0 2024-09-13T18:47:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.242+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda80afdc0 con 0x7fcda80d10f0 2024-09-13T18:47:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.242+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd98003a80 con 0x7fcda80d10f0 2024-09-13T18:47:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.246+0000 7fcd9fe00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcd84066730 0x7fcd84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.246+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd98020070 con 0x7fcda80d10f0 2024-09-13T18:47:22.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.246+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcd84066730 0x7fcd84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.246+0000 7fcd9ea00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcd84066730 0x7fcd84068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcda81f5650 tx=0x7fcd90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.250+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd980529e0 con 0x7fcda80d10f0 2024-09-13T18:47:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.442+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcda80ad8a0 con 0x7fcda80d10f0 2024-09-13T18:47:22.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.446+0000 7fcd9fe00700 1 -- 172.21.15.81:0/3303612142 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fcd98056000 con 0x7fcda80d10f0 2024-09-13T18:47:22.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:22.455 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcd84066730 msgr2=0x7fcd84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcd84066730 0x7fcd84068bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcda81f5650 tx=0x7fcd90008040 comp rx=0 tx=0).stop 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 msgr2=0x7fcda81f1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 0x7fcda81f1b40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcd98000c00 tx=0x7fcd98004770 comp rx=0 tx=0).stop 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 shutdown_connections 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcd84066730 0x7fcd84068bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda815e070 0x7fcda80b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda80d1540 0x7fcda80b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 --2- 172.21.15.81:0/3303612142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcda80d10f0 0x7fcda81f1b40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 >> 172.21.15.81:0/3303612142 conn(0x7fcda8071f00 msgr2=0x7fcda80c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 shutdown_connections 2024-09-13T18:47:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:22.450+0000 7fcdacc00700 1 -- 172.21.15.81:0/3303612142 wait complete. 2024-09-13T18:47:22.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:47:15.438108+0000', 'modified': '2024-09-13T18:47:19.951473+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/968984617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 968984617}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 968984617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T18:47:22.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:47:22.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:47:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 Processor -- start 2024-09-13T18:47:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 -- start start 2024-09-13T18:47:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f079c033ac0 0x7f079c009ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c0eb420 0x7f079c04ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c01cfa0 con 0x7f079c007260 2024-09-13T18:47:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c01c670 con 0x7f079c033ac0 2024-09-13T18:47:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c01c950 con 0x7f079c0eb420 2024-09-13T18:47:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.046+0000 7f07a3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f079c033ac0 0x7f079c009ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f079c033ac0 0x7f079c009ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33214/0 (socket says 172.21.15.81:33214) 2024-09-13T18:47:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 -- 172.21.15.81:0/3706138312 learned_addr learned my addr 172.21.15.81:0/3706138312 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3706138312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c0eb420 0x7f079c04ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 -- 172.21.15.81:0/3706138312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c0eb420 msgr2=0x7f079c04ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 --2- 172.21.15.81:0/3706138312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c0eb420 0x7f079c04ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 -- 172.21.15.81:0/3706138312 >> v1:172.21.15.178:6789/0 conn(0x7f079c007260 legacy=0x7f079c01d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 -- 172.21.15.81:0/3706138312 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c01cc30 con 0x7f079c033ac0 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a3400700 1 --2- 172.21.15.81:0/3706138312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c033ac0 0x7f079c009ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0798009900 tx=0x7f0798009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f4dc139d6744dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a2000700 1 -- 172.21.15.81:0/3706138312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800ba60 con 0x7f079c033ac0 2024-09-13T18:47:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a2000700 1 -- 172.21.15.81:0/3706138312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800bbc0 con 0x7f079c033ac0 2024-09-13T18:47:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a2000700 1 -- 172.21.15.81:0/3706138312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798009e50 con 0x7f079c033ac0 2024-09-13T18:47:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 -- 172.21.15.81:0/3706138312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c033ac0 msgr2=0x7f079c009ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 --2- 172.21.15.81:0/3706138312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c033ac0 0x7f079c009ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0798009900 tx=0x7f0798009c10 comp rx=0 tx=0).stop 2024-09-13T18:47:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 -- 172.21.15.81:0/3706138312 shutdown_connections 2024-09-13T18:47:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 --2- 172.21.15.81:0/3706138312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c0eb420 0x7f079c04ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 --2- 172.21.15.81:0/3706138312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c033ac0 0x7f079c009ba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 -- 172.21.15.81:0/3706138312 >> 172.21.15.81:0/3706138312 conn(0x7f079c036140 msgr2=0x7f079c036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 -- 172.21.15.81:0/3706138312 shutdown_connections 2024-09-13T18:47:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.050+0000 7f07a9000700 1 -- 172.21.15.81:0/3706138312 wait complete. 2024-09-13T18:47:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 Processor -- start 2024-09-13T18:47:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 -- start start 2024-09-13T18:47:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c007260 0x7f079c039e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c033ac0 0x7f079c0de7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 0x7f079c048580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c03a5a0 con 0x7f079c0480f0 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c03a390 con 0x7f079c033ac0 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c04ad90 con 0x7f079c007260 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 0x7f079c048580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 0x7f079c048580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33226/0 (socket says 172.21.15.81:33226) 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a3e00700 1 -- 172.21.15.81:0/3826951921 learned_addr learned my addr 172.21.15.81:0/3826951921 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a3400700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c007260 0x7f079c039e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.054+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c033ac0 0x7f079c0de7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a3e00700 1 -- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c007260 msgr2=0x7f079c039e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c007260 0x7f079c039e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a3e00700 1 -- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c033ac0 msgr2=0x7f079c0de7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c033ac0 0x7f079c0de7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a3e00700 1 -- 172.21.15.81:0/3826951921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798009510 con 0x7f079c0480f0 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 0x7f079c048580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07a4000b60 tx=0x7f07a4073330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f0797400700 1 -- 172.21.15.81:0/3826951921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40680d0 con 0x7f079c0480f0 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f0797400700 1 -- 172.21.15.81:0/3826951921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4068230 con 0x7f079c0480f0 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f0797400700 1 -- 172.21.15.81:0/3826951921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4068600 con 0x7f079c0480f0 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c04a460 con 0x7f079c0480f0 2024-09-13T18:47:23.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.058+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c04aa20 con 0x7f079c0480f0 2024-09-13T18:47:23.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.062+0000 7f0797400700 1 -- 172.21.15.81:0/3826951921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07a4090070 con 0x7f079c0480f0 2024-09-13T18:47:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.062+0000 7f0797400700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0784066730 0x7f0784068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.062+0000 7f0797400700 1 -- 172.21.15.81:0/3826951921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07a40fd730 con 0x7f079c0480f0 2024-09-13T18:47:23.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.062+0000 7f07a3400700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0784066730 0x7f0784068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.062+0000 7f07a3400700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0784066730 0x7f0784068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0798009c50 tx=0x7f0798008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 Processor -- start 2024-09-13T18:47:23.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 -- start start 2024-09-13T18:47:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c6c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c34890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c34dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4b93d80 con 0x4c4ae90 2024-09-13T18:47:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x4b91510 con 0x4c6c230 2024-09-13T18:47:23.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4b8ce00 con 0x4c6cb50 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c34890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c34890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33228/0 (socket says 172.21.15.81:33228) 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 -- 172.21.15.81:0/804945250 learned_addr learned my addr 172.21.15.81:0/804945250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a3e00700 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c34dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a3400700 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c6c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 -- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 msgr2=0x4c34dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c34dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 -- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 msgr2=0x4c6c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c6c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 -- 172.21.15.81:0/804945250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x49ff960 con 0x4c4ae90 2024-09-13T18:47:23.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f07a2a00700 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c34890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f079c008190 tx=0x7f0790009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b305396b6be76065 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.066+0000 7f078be00700 1 -- 172.21.15.81:0/804945250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790010ac0 con 0x4c4ae90 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f078be00700 1 -- 172.21.15.81:0/804945250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079000c050 con 0x4c4ae90 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f078be00700 1 -- 172.21.15.81:0/804945250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790010e20 con 0x4c4ae90 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 -- 172.21.15.81:0/804945250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 msgr2=0x4c34890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c34890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f079c008190 tx=0x7f0790009d60 comp rx=0 tx=0).stop 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 -- 172.21.15.81:0/804945250 shutdown_connections 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c34dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c34890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 --2- 172.21.15.81:0/804945250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c6c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 -- 172.21.15.81:0/804945250 >> 172.21.15.81:0/804945250 conn(0x49b44d0 msgr2=0x4c4de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 -- 172.21.15.81:0/804945250 shutdown_connections 2024-09-13T18:47:23.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 -- 172.21.15.81:0/804945250 wait complete. 2024-09-13T18:47:23.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 -- start start 2024-09-13T18:47:23.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.070+0000 7f07ada45740 1 Processor -- start 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c23ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c26930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c26e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4b4a730 con 0x4c4ae90 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x4b505b0 con 0x4c6c230 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4a38aa0 con 0x4c6cb50 2024-09-13T18:47:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 10 client.0 _ll_register_callbacks cb 0x4b86610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:47:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c23ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c23ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33242/0 (socket says 172.21.15.81:33242) 2024-09-13T18:47:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 -- 172.21.15.81:0/3552484166 learned_addr learned my addr 172.21.15.81:0/3552484166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c26e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c26930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 -- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 msgr2=0x4c26e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c26e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 -- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 msgr2=0x4c26930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c26930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 -- 172.21.15.81:0/3552484166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07900096e0 con 0x4c4ae90 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c26930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07a3400700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c23ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f079c053250 tx=0x7f07980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9184c42900c40fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f0788c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f0788c00700 1 -- 172.21.15.81:0/3552484166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798020070 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x49c11e0 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f0788c00700 1 -- 172.21.15.81:0/3552484166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0798003a90 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f0788c00700 1 -- 172.21.15.81:0/3552484166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0798003c50 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 10 client.4422 fetch_fsmap learned FSMap version 7 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x4b53220 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.074+0000 7f0788c00700 1 -- 172.21.15.81:0/3552484166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x49c11e0 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f0788c00700 1 -- 172.21.15.81:0/3552484166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0798033440 con 0x4c4ae90 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 10 client.4422 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 20 client.4422 populate_metadata read hostname 'smithi081' 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4c72ea0 0x4c7fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 4 client.4422 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:47:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 --> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x4a0b460 con 0x4c72ea0 2024-09-13T18:47:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4c72ea0 0x4c7fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4c72ea0 0x4c7fda0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27fde7cd7d03d639 server_cookie=f262d151a1b100d2 in_seq=0 out_seq=0 2024-09-13T18:47:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f0788c00700 10 client.4422 ms_handle_connect on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f0788c00700 1 -- 172.21.15.81:0/3552484166 <== mds.0 v2:172.21.15.81:6834/968984617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x4a0b460 con 0x4c72ea0 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f0788c00700 10 client.4422 handle_command_reply: tid=0 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 client.4422 shutdown 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 msgr2=0x4c23ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c23ce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f079c053250 tx=0x7f07980047e0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 shutdown_connections 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4c72ea0 0x4c7fda0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c26e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f0788c00700 0 client.4422 ms_handle_reset on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c6c230 0x4c26930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 --2- 172.21.15.81:0/3552484166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c4ae90 0x4c23ce0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 >> 172.21.15.81:0/3552484166 conn(0x49b44d0 msgr2=0x4c47470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 shutdown_connections 2024-09-13T18:47:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 1 -- 172.21.15.81:0/3552484166 wait complete. 2024-09-13T18:47:23.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.078+0000 7f07ada45740 20 client.4422 trim_cache size 0 max 16384 2024-09-13T18:47:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 Processor -- start 2024-09-13T18:47:23.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 -- start start 2024-09-13T18:47:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c6b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 0x4c6a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c6ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4b574f0 con 0x4c6c230 2024-09-13T18:47:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x4bbbec0 con 0x4c4ae90 2024-09-13T18:47:23.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4b51a40 con 0x4c6cb50 2024-09-13T18:47:23.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 0x4c6a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 0x4c6a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33244/0 (socket says 172.21.15.81:33244) 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 -- 172.21.15.81:0/3813759246 learned_addr learned my addr 172.21.15.81:0/3813759246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a3400700 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c6b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c6ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 -- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 msgr2=0x4c6ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c6ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 -- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 msgr2=0x4c6b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c6b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 -- 172.21.15.81:0/3813759246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x4b39450 con 0x4c6c230 2024-09-13T18:47:23.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a3400700 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c6b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.102+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 0x4c6a650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0790009da0 tx=0x7f0790015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835ba146dc060429 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f0794c00700 1 -- 172.21.15.81:0/3813759246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790010c40 con 0x4c6c230 2024-09-13T18:47:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f0794c00700 1 -- 172.21.15.81:0/3813759246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0790010da0 con 0x4c6c230 2024-09-13T18:47:23.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f0794c00700 1 -- 172.21.15.81:0/3813759246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0790004260 con 0x4c6c230 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- 172.21.15.81:0/3813759246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 msgr2=0x4c6a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 0x4c6a650 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0790009da0 tx=0x7f0790015000 comp rx=0 tx=0).stop 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- 172.21.15.81:0/3813759246 shutdown_connections 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4c6ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6c230 0x4c6a650 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- 172.21.15.81:0/3813759246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c6b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- 172.21.15.81:0/3813759246 >> 172.21.15.81:0/3813759246 conn(0x49b44d0 msgr2=0x4c23930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- 172.21.15.81:0/3813759246 shutdown_connections 2024-09-13T18:47:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- 172.21.15.81:0/3813759246 wait complete. 2024-09-13T18:47:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- start start 2024-09-13T18:47:23.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 Processor -- start 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c89820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4cb31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 0x4c6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4b85f30 con 0x4c6f0d0 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x4cb6250 con 0x4c4ae90 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4cb64b0 con 0x4c6cb50 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07ada45740 10 client.0 _ll_register_callbacks cb 0x4b3ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:47:23.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 0x4c6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 0x4c6f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33254/0 (socket says 172.21.15.81:33254) 2024-09-13T18:47:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.106+0000 7f07a3e00700 1 -- 172.21.15.81:0/3872502306 learned_addr learned my addr 172.21.15.81:0/3872502306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a2a00700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4cb31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3400700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c89820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3e00700 1 -- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 msgr2=0x4cb31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4cb31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3e00700 1 -- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 msgr2=0x4c89820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c89820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3e00700 1 -- 172.21.15.81:0/3872502306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x49ff960 con 0x4c6f0d0 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3e00700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 0x4c6f4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07a40ca970 tx=0x7f07a406a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd17eb91a679417b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:47:23.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 1 -- 172.21.15.81:0/3872502306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40cdb60 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 1 -- 172.21.15.81:0/3872502306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f07a40ceb70 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f079000c050 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 1 -- 172.21.15.81:0/3872502306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07a40ce470 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 10 client.4428 fetch_fsmap learned FSMap version 7 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x4b2d720 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 1 -- 172.21.15.81:0/3872502306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079000c050 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 1 -- 172.21.15.81:0/3872502306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f07a40e3070 con 0x4c6f0d0 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 10 client.4428 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 20 client.4428 populate_metadata read hostname 'smithi081' 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4cb3c60 0x4cb4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 4 client.4428 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 --> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] -- command(tid 0: {"prefix": "status"}) v1 -- 0x4a301e0 con 0x4cb3c60 2024-09-13T18:47:23.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3400700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4cb3c60 0x4cb4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f0788c00700 10 client.4428 ms_handle_connect on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.110+0000 7f07a3400700 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4cb3c60 0x4cb4040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e384b558ad4301b server_cookie=96c0d453c066c276 in_seq=0 out_seq=0 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f0788c00700 1 -- 172.21.15.81:0/3872502306 <== mds.0 v2:172.21.15.81:6834/968984617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x4a301e0 con 0x4cb3c60 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f0788c00700 10 client.4428 handle_command_reply: tid=0 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 client.4428 shutdown 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 msgr2=0x4c6f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 0x4c6f4b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07a40ca970 tx=0x7f07a406a1e0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 shutdown_connections 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x4cb3c60 0x4cb4040 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x4c6f0d0 0x4c6f4b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x4c6cb50 0x4cb31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 --2- 172.21.15.81:0/3872502306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x4c4ae90 0x4c89820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 >> 172.21.15.81:0/3872502306 conn(0x49b44d0 msgr2=0x4c261d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f0788c00700 0 client.4428 ms_handle_reset on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 shutdown_connections 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 1 -- 172.21.15.81:0/3872502306 wait complete. 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07ada45740 20 client.4428 trim_cache size 0 max 16384 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4278, 2024-09-13T18:47:23.124 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 7.6734290730000003, 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 23, 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.209870930999999 2024-09-13T18:47:23.125 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0784066730 msgr2=0x7f0784068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0784066730 0x7f0784068bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0798009c50 tx=0x7f0798008030 comp rx=0 tx=0).stop 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 msgr2=0x7f079c048580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 0x7f079c048580 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f07a4000b60 tx=0x7f07a4073330 comp rx=0 tx=0).stop 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 shutdown_connections 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0784066730 0x7f0784068bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c0480f0 0x7f079c048580 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c033ac0 0x7f079c0de7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 --2- 172.21.15.81:0/3826951921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c007260 0x7f079c039e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 >> 172.21.15.81:0/3826951921 conn(0x7f079c036140 msgr2=0x7f079c0358a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 shutdown_connections 2024-09-13T18:47:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.114+0000 7f07a9000700 1 -- 172.21.15.81:0/3826951921 wait complete. 2024-09-13T18:47:23.148 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:47:23.148 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:23.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.314+0000 7f2041c00700 1 Processor -- start 2024-09-13T18:47:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.314+0000 7f2041c00700 1 -- start start 2024-09-13T18:47:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f203c06aaa0 0x7f203c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0ccb40 con 0x7f203c0cc6f0 2024-09-13T18:47:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c06b430 con 0x7f203c0cb020 2024-09-13T18:47:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c0b2ad0 con 0x7f203c06aaa0 2024-09-13T18:47:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f203b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f203c0cc6f0 0x7f203c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:48794/0 (socket says 172.21.15.81:48794) 2024-09-13T18:47:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f203b400700 1 -- 172.21.15.81:0/2101820209 learned_addr learned my addr 172.21.15.81:0/2101820209 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041200700 1 --2- 172.21.15.81:0/2101820209 >> v2:172.21.15.178:3300/0 conn(0x7f203c06aaa0 0x7f203c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f203aa00700 1 -- 172.21.15.81:0/2101820209 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448774438 0 0) 0x7f203c0ccb40 con 0x7f203c0cc6f0 2024-09-13T18:47:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f203aa00700 1 -- 172.21.15.81:0/2101820209 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20200035d0 con 0x7f203c0cc6f0 2024-09-13T18:47:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041200700 1 -- 172.21.15.81:0/2101820209 >> v1:172.21.15.178:6789/0 conn(0x7f203c0cb020 legacy=0x7f203c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041200700 1 -- 172.21.15.81:0/2101820209 >> v1:172.21.15.81:6789/0 conn(0x7f203c0cc6f0 legacy=0x7f203c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041200700 1 -- 172.21.15.81:0/2101820209 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c15b960 con 0x7f203c06aaa0 2024-09-13T18:47:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.318+0000 7f2041200700 1 --2- 172.21.15.81:0/2101820209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c06aef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2034009d90 tx=0x7f203400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25b6997b578c69d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f203aa00700 1 -- 172.21.15.81:0/2101820209 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400e070 con 0x7f203c06aaa0 2024-09-13T18:47:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f203aa00700 1 -- 172.21.15.81:0/2101820209 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400bb20 con 0x7f203c06aaa0 2024-09-13T18:47:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f203aa00700 1 -- 172.21.15.81:0/2101820209 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034012430 con 0x7f203c06aaa0 2024-09-13T18:47:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 -- 172.21.15.81:0/2101820209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 msgr2=0x7f203c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 --2- 172.21.15.81:0/2101820209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c06aef0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2034009d90 tx=0x7f203400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 -- 172.21.15.81:0/2101820209 shutdown_connections 2024-09-13T18:47:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 --2- 172.21.15.81:0/2101820209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c06aef0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 -- 172.21.15.81:0/2101820209 >> 172.21.15.81:0/2101820209 conn(0x7f203c0b0c40 msgr2=0x7f203c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 -- 172.21.15.81:0/2101820209 shutdown_connections 2024-09-13T18:47:23.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 -- 172.21.15.81:0/2101820209 wait complete. 2024-09-13T18:47:23.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.322+0000 7f2041c00700 1 Processor -- start 2024-09-13T18:47:23.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 -- start start 2024-09-13T18:47:23.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 0x7f203c070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cc6f0 0x7f203c070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1572a0 con 0x7f203c0cb020 2024-09-13T18:47:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0c8d30 con 0x7f203c06aaa0 2024-09-13T18:47:23.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c1526f0 con 0x7f203c0cc6f0 2024-09-13T18:47:23.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 0x7f203c070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 0x7f203c070940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33262/0 (socket says 172.21.15.81:33262) 2024-09-13T18:47:23.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 -- 172.21.15.81:0/473442109 learned_addr learned my addr 172.21.15.81:0/473442109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:23.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041200700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cc6f0 0x7f203c070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203be00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 -- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cc6f0 msgr2=0x7f203c070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cc6f0 0x7f203c070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 -- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 msgr2=0x7f203c155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 -- 172.21.15.81:0/473442109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2034009a70 con 0x7f203c0cb020 2024-09-13T18:47:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f203b400700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 0x7f203c070940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f202800c500 tx=0x7f202800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028005d90 con 0x7f203c0cb020 2024-09-13T18:47:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280070d0 con 0x7f203c0cb020 2024-09-13T18:47:23.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c14d0b0 con 0x7f203c0cb020 2024-09-13T18:47:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028007480 con 0x7f203c0cb020 2024-09-13T18:47:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.326+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c0c8390 con 0x7f203c0cb020 2024-09-13T18:47:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.330+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c06aef0 con 0x7f203c0cb020 2024-09-13T18:47:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.330+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20280075e0 con 0x7f203c0cb020 2024-09-13T18:47:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.334+0000 7f2033e00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f201c066730 0x7f201c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.334+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2028083920 con 0x7f203c0cb020 2024-09-13T18:47:23.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.334+0000 7f203be00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f201c066730 0x7f201c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.334+0000 7f203be00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f201c066730 0x7f201c068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f202c000f60 tx=0x7f202c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.338+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2028050880 con 0x7f203c0cb020 2024-09-13T18:47:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.570+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f203c0ca6a0 con 0x7f203c0cb020 2024-09-13T18:47:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.570+0000 7f2033e00700 1 -- 172.21.15.81:0/473442109 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2028053ea0 con 0x7f203c0cb020 2024-09-13T18:47:23.581 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:47:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f201c066730 msgr2=0x7f201c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f201c066730 0x7f201c068bf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f202c000f60 tx=0x7f202c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 msgr2=0x7f203c070940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 0x7f203c070940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f202800c500 tx=0x7f202800c810 comp rx=0 tx=0).stop 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 shutdown_connections 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f201c066730 0x7f201c068bf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f203c0cc6f0 0x7f203c070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f203c0cb020 0x7f203c070940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 --2- 172.21.15.81:0/473442109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f203c06aaa0 0x7f203c155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 >> 172.21.15.81:0/473442109 conn(0x7f203c0b0c40 msgr2=0x7f203c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 shutdown_connections 2024-09-13T18:47:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:23.574+0000 7f2041c00700 1 -- 172.21.15.81:0/473442109 wait complete. 2024-09-13T18:47:23.606 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:47:23.606 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:23.606 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:47:23.606 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T18:47:23.606 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:23.607 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:47:23.607 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:47:23.607 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:23.607 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:47:23.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:23.607 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:47:23.626 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:23.626 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42449sec preferred_lft 42449sec 2024-09-13T18:47:23.627 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:47:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:23.628 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:47:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:47:23.628 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:23.629 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:47:23.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:47:23.630 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:23.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:23.779 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:23.812 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:47:23.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:23.815 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:47:23.902 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:47:23.902 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:23.902 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:47:23.902 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:23.902 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:47:23.903 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:47:23.903 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:47:23.903 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:23.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:23.904 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:23.904 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:23.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:23.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:23.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:23.905 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:24.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.037 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:47:24.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.057 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-13T18:47:24.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.114 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:24.114 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:24.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:47:24.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T18:47:24.114 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:24.230 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T18:47:24.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T18:47:24.231 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:24.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.400 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:24.400 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:24.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:47:24.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:47:24.401 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:24.467 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T18:47:24.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:24.467 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:24.482 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T18:47:24.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:24.483 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:24.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-13T18:47:24.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:47:24.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:47:24.700 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:47:24.702 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:47:24.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.704 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-13T18:47:24.769 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:47:24.770 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T18:47:24.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-13T18:47:24.854 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:47:24.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:47:24.928 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:47:24.932 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:47:24.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:24.933 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-13T18:47:24.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:2024-09-13T18:47:24.946+0000 7f424980a640 -1 init, newargv = 0x55b5043d20d0 newargc=15 2024-09-13T18:47:24.957 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[32380]: starting ceph client 2024-09-13T18:47:24.974 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[32380]: starting fuse 2024-09-13T18:47:26.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-13T18:47:26.107 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:47:26.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:47:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:47:26.190 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:47:26.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:26.191 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-13T18:47:26.255 INFO:teuthology.orchestra.run.smithi081.stdout:50 2024-09-13T18:47:26.255 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2024-09-13T18:47:26.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:47:26.255 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-13T18:47:26.255 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-13T18:47:26.256 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:47:26.257 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.admin")) 2024-09-13T18:47:26.258 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:47:26.421 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.admin.32380.asok 2024-09-13T18:47:26.602 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32380.asok 2024-09-13T18:47:26.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:26.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32380.asok status 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "admin", 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "32380", 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-13T18:47:26.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4443, 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4443 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 4050313824 2024-09-13T18:47:26.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 4050313824 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4443 192.168.0.1:0/4050313824", 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/4050313824", 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 24, 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:47:26.806 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-13T18:47:26.807 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-13T18:47:26.807 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:47:26.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:26.822 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-13T18:47:26.822 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:26.839 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-13T18:47:26.839 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:26.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:26.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:26.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:26.914 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T18:47:27.434 INFO:teuthology.orchestra.run.smithi081.stdout:# file: . 2024-09-13T18:47:27.434 INFO:teuthology.orchestra.run.smithi081.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T18:47:27.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:27.436 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:47:27.436 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:27.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.642+0000 7f5ccb000700 1 Processor -- start 2024-09-13T18:47:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.642+0000 7f5ccb000700 1 -- start start 2024-09-13T18:47:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5ccb000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5cc4159bd0 0x7f5cc40cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5ccb000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc4071870 0x7f5cc406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5ccb000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5cc406afe0 0x7f5cc40b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5ccb000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc406b490 con 0x7f5cc406afe0 2024-09-13T18:47:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5ccb000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40720a0 con 0x7f5cc4159bd0 2024-09-13T18:47:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5ccb000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40707d0 con 0x7f5cc4071870 2024-09-13T18:47:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5cc406afe0 0x7f5cc40b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5cc406afe0 0x7f5cc40b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47400/0 (socket says 172.21.15.81:47400) 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 -- 172.21.15.81:0/925155770 learned_addr learned my addr 172.21.15.81:0/925155770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cc9200700 1 --2- 172.21.15.81:0/925155770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc4071870 0x7f5cc406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cc9c00700 1 --2- 172.21.15.81:0/925155770 >> v2:172.21.15.178:3300/0 conn(0x7f5cc4159bd0 0x7f5cc40cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 -- 172.21.15.81:0/925155770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc4071870 msgr2=0x7f5cc406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 --2- 172.21.15.81:0/925155770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc4071870 0x7f5cc406aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 -- 172.21.15.81:0/925155770 >> v2:172.21.15.178:3300/0 conn(0x7f5cc4159bd0 msgr2=0x7f5cc40cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 --2- 172.21.15.81:0/925155770 >> v2:172.21.15.178:3300/0 conn(0x7f5cc4159bd0 0x7f5cc40cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 -- 172.21.15.81:0/925155770 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc406fee0 con 0x7f5cc406afe0 2024-09-13T18:47:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cc9c00700 1 --2- 172.21.15.81:0/925155770 >> v2:172.21.15.178:3300/0 conn(0x7f5cc4159bd0 0x7f5cc40cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cca600700 1 --2- 172.21.15.81:0/925155770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc406afe0 0x7f5cc40b1ee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4071150 tx=0x7f5cbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a70c438d90346d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cc3e00700 1 -- 172.21.15.81:0/925155770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00e070 con 0x7f5cc406afe0 2024-09-13T18:47:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cc3e00700 1 -- 172.21.15.81:0/925155770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00b8d0 con 0x7f5cc406afe0 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.646+0000 7f5cc3e00700 1 -- 172.21.15.81:0/925155770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00bc80 con 0x7f5cc406afe0 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 -- 172.21.15.81:0/925155770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc406afe0 msgr2=0x7f5cc40b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 --2- 172.21.15.81:0/925155770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc406afe0 0x7f5cc40b1ee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4071150 tx=0x7f5cbc00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 -- 172.21.15.81:0/925155770 shutdown_connections 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 --2- 172.21.15.81:0/925155770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc406afe0 0x7f5cc40b1ee0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 --2- 172.21.15.81:0/925155770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc4071870 0x7f5cc406aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 --2- 172.21.15.81:0/925155770 >> v2:172.21.15.178:3300/0 conn(0x7f5cc4159bd0 0x7f5cc40cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 -- 172.21.15.81:0/925155770 >> 172.21.15.81:0/925155770 conn(0x7f5cc40b0c40 msgr2=0x7f5cc406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 -- 172.21.15.81:0/925155770 shutdown_connections 2024-09-13T18:47:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 -- 172.21.15.81:0/925155770 wait complete. 2024-09-13T18:47:27.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 Processor -- start 2024-09-13T18:47:27.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.650+0000 7f5ccb000700 1 -- start start 2024-09-13T18:47:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc406afe0 0x7f5cc40cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 0x7f5cc40c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc4159bd0 0x7f5cc40c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4148d50 con 0x7f5cc4071870 2024-09-13T18:47:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415c970 con 0x7f5cc4159bd0 2024-09-13T18:47:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc4149080 con 0x7f5cc406afe0 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 0x7f5cc40c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 0x7f5cc40c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47410/0 (socket says 172.21.15.81:47410) 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 -- 172.21.15.81:0/3795290075 learned_addr learned my addr 172.21.15.81:0/3795290075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9c00700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc406afe0 0x7f5cc40cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cca600700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc4159bd0 0x7f5cc40c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 -- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc406afe0 msgr2=0x7f5cc40cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc406afe0 0x7f5cc40cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 -- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc4159bd0 msgr2=0x7f5cc40c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc4159bd0 0x7f5cc40c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 -- 172.21.15.81:0/3795290075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc009b30 con 0x7f5cc4071870 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cca600700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc4159bd0 0x7f5cc40c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc9200700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 0x7f5cc40c6190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000e980 tx=0x7f5cb000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000ee70 con 0x7f5cc4071870 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0004020 con 0x7f5cc4071870 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb00043d0 con 0x7f5cc4071870 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc4149360 con 0x7f5cc4071870 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.654+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc4149920 con 0x7f5cc4071870 2024-09-13T18:47:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.658+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4149b40 con 0x7f5cc4071870 2024-09-13T18:47:27.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.658+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5cb000c850 con 0x7f5cc4071870 2024-09-13T18:47:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.662+0000 7f5cc1600700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ca4066730 0x7f5ca4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.662+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5cb0084130 con 0x7f5cc4071870 2024-09-13T18:47:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.662+0000 7f5cc9c00700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ca4066730 0x7f5ca4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.662+0000 7f5cc9c00700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ca4066730 0x7f5ca4068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800c960 tx=0x7f5cb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.670+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5cb00511a0 con 0x7f5cc4071870 2024-09-13T18:47:27.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.854+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cc406aaa0 con 0x7f5cc4071870 2024-09-13T18:47:27.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.858+0000 7f5cc1600700 1 -- 172.21.15.81:0/3795290075 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f5cb00547c0 con 0x7f5cc4071870 2024-09-13T18:47:27.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:27.869 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ca4066730 msgr2=0x7f5ca4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ca4066730 0x7f5ca4068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800c960 tx=0x7f5cb8008040 comp rx=0 tx=0).stop 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 msgr2=0x7f5cc40c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 0x7f5cc40c6190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000e980 tx=0x7f5cb000ec90 comp rx=0 tx=0).stop 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 shutdown_connections 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ca4066730 0x7f5ca4068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cc4159bd0 0x7f5cc40c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cc4071870 0x7f5cc40c6190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 --2- 172.21.15.81:0/3795290075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cc406afe0 0x7f5cc40cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 >> 172.21.15.81:0/3795290075 conn(0x7f5cc40b0c40 msgr2=0x7f5cc40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 shutdown_connections 2024-09-13T18:47:27.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:27.862+0000 7f5ccb000700 1 -- 172.21.15.81:0/3795290075 wait complete. 2024-09-13T18:47:27.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:47:27.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.054+0000 7fa41fe00700 1 Processor -- start 2024-09-13T18:47:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.054+0000 7fa41fe00700 1 -- start start 2024-09-13T18:47:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa420143b70 0x7fa4200cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42006d070 0x7fa4200b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4200b1980 con 0x7fa42006d620 2024-09-13T18:47:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4200b2500 con 0x7fa420143b70 2024-09-13T18:47:28.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4200b1bd0 con 0x7fa42006d070 2024-09-13T18:47:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa417e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa42006d620 0x7fa42006c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43648/0 (socket says 172.21.15.81:43648) 2024-09-13T18:47:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa417e00700 1 -- 172.21.15.81:0/1140050019 learned_addr learned my addr 172.21.15.81:0/1140050019 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1140050019 >> v2:172.21.15.178:3300/0 conn(0x7fa420143b70 0x7fa4200cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41f400700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42006d070 0x7fa4200b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41e000700 1 -- 172.21.15.81:0/1140050019 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365931515 0 0) 0x7fa4200b1980 con 0x7fa42006d620 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41e000700 1 -- 172.21.15.81:0/1140050019 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4040035d0 con 0x7fa42006d620 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41ea00700 1 -- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42006d070 msgr2=0x7fa4200b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42006d070 0x7fa4200b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41ea00700 1 -- 172.21.15.81:0/1140050019 >> v1:172.21.15.81:6789/0 conn(0x7fa42006d620 legacy=0x7fa42006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41ea00700 1 -- 172.21.15.81:0/1140050019 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200b1eb0 con 0x7fa420143b70 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41f400700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42006d070 0x7fa4200b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa420143b70 0x7fa4200cde20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa410009850 tx=0x7fa410009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf1d373951b7c80f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.058+0000 7fa41e000700 1 -- 172.21.15.81:0/1140050019 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410011830 con 0x7fa420143b70 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41e000700 1 -- 172.21.15.81:0/1140050019 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa410011990 con 0x7fa420143b70 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41e000700 1 -- 172.21.15.81:0/1140050019 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410011d40 con 0x7fa420143b70 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 -- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa420143b70 msgr2=0x7fa4200cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa420143b70 0x7fa4200cde20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa410009850 tx=0x7fa410009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 -- 172.21.15.81:0/1140050019 shutdown_connections 2024-09-13T18:47:28.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42006d070 0x7fa4200b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1140050019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa420143b70 0x7fa4200cde20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 -- 172.21.15.81:0/1140050019 >> 172.21.15.81:0/1140050019 conn(0x7fa42006a390 msgr2=0x7fa42006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 -- 172.21.15.81:0/1140050019 shutdown_connections 2024-09-13T18:47:28.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 -- 172.21.15.81:0/1140050019 wait complete. 2024-09-13T18:47:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.062+0000 7fa41fe00700 1 Processor -- start 2024-09-13T18:47:28.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 -- start start 2024-09-13T18:47:28.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 0x7fa42013cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006d620 0x7fa42015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa420143b70 0x7fa42013c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42013d4d0 con 0x7fa42006d070 2024-09-13T18:47:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015d240 con 0x7fa42006d620 2024-09-13T18:47:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42013d710 con 0x7fa420143b70 2024-09-13T18:47:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 0x7fa42013cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 0x7fa42013cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47414/0 (socket says 172.21.15.81:47414) 2024-09-13T18:47:28.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 -- 172.21.15.81:0/1413329408 learned_addr learned my addr 172.21.15.81:0/1413329408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa417e00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006d620 0x7fa42015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41f400700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa420143b70 0x7fa42013c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 -- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa420143b70 msgr2=0x7fa42013c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa420143b70 0x7fa42013c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 -- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006d620 msgr2=0x7fa42015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006d620 0x7fa42015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 -- 172.21.15.81:0/1413329408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa418009a70 con 0x7fa42006d070 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41f400700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa420143b70 0x7fa42013c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa417e00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006d620 0x7fa42015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 0x7fa42013cf90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa410014040 tx=0x7fa410004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100036c0 con 0x7fa42006d070 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41001e070 con 0x7fa42006d070 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4100094b0 con 0x7fa42006d070 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410003a80 con 0x7fa42006d070 2024-09-13T18:47:28.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.066+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42013b540 con 0x7fa42006d070 2024-09-13T18:47:28.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.070+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4200cde20 con 0x7fa42006d070 2024-09-13T18:47:28.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.070+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa410003be0 con 0x7fa42006d070 2024-09-13T18:47:28.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.074+0000 7fa416a00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa3fc066730 0x7fa3fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.074+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa410020070 con 0x7fa42006d070 2024-09-13T18:47:28.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.074+0000 7fa417e00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa3fc066730 0x7fa3fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.074+0000 7fa417e00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa3fc066730 0x7fa3fc068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa420140af0 tx=0x7fa408009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.078+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa410052ae0 con 0x7fa42006d070 2024-09-13T18:47:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.254+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa420071f60 con 0x7fa42006d070 2024-09-13T18:47:28.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.254+0000 7fa416a00700 1 -- 172.21.15.81:0/1413329408 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa410006ce0 con 0x7fa42006d070 2024-09-13T18:47:28.265 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:47:28.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa3fc066730 msgr2=0x7fa3fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa3fc066730 0x7fa3fc068bf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa420140af0 tx=0x7fa408009040 comp rx=0 tx=0).stop 2024-09-13T18:47:28.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 msgr2=0x7fa42013cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 0x7fa42013cf90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa410014040 tx=0x7fa410004770 comp rx=0 tx=0).stop 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 shutdown_connections 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa3fc066730 0x7fa3fc068bf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa420143b70 0x7fa42013c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006d620 0x7fa42015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 --2- 172.21.15.81:0/1413329408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42006d070 0x7fa42013cf90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 >> 172.21.15.81:0/1413329408 conn(0x7fa42006a390 msgr2=0x7fa4200adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 shutdown_connections 2024-09-13T18:47:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.258+0000 7fa41fe00700 1 -- 172.21.15.81:0/1413329408 wait complete. 2024-09-13T18:47:28.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:28.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.454+0000 7f7ea5800700 1 Processor -- start 2024-09-13T18:47:28.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.454+0000 7f7ea5800700 1 -- start start 2024-09-13T18:47:28.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7ea5800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 0x7f7ea00b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7ea5800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea0160840 0x7f7ea0160c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7ea5800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea00ce1f0 con 0x7f7ea01611c0 2024-09-13T18:47:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7ea5800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea00d0710 con 0x7f7ea01601b0 2024-09-13T18:47:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7ea5800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0161630 con 0x7f7ea0160840 2024-09-13T18:47:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea0160840 0x7f7ea0160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 0x7f7ea00b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 0x7f7ea00b36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:48714/0 (socket says 172.21.15.81:48714) 2024-09-13T18:47:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9fe00700 1 -- 172.21.15.81:0/2526437319 learned_addr learned my addr 172.21.15.81:0/2526437319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:28.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9ea00700 1 -- 172.21.15.81:0/2526437319 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208546831 0 0) 0x7f7ea00ce1f0 con 0x7f7ea01611c0 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9ea00700 1 -- 172.21.15.81:0/2526437319 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e840035d0 con 0x7f7ea01611c0 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9f400700 1 -- 172.21.15.81:0/2526437319 >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 msgr2=0x7f7ea00b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9f400700 1 --2- 172.21.15.81:0/2526437319 >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 0x7f7ea00b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9f400700 1 -- 172.21.15.81:0/2526437319 >> v1:172.21.15.178:6789/0 conn(0x7f7ea01611c0 legacy=0x7f7ea00b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9f400700 1 -- 172.21.15.81:0/2526437319 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea0160590 con 0x7f7ea0160840 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9fe00700 1 --2- 172.21.15.81:0/2526437319 >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 0x7f7ea00b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.458+0000 7f7e9f400700 1 --2- 172.21.15.81:0/2526437319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea0160840 0x7f7ea0160c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009850 tx=0x7f7e8c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e0d91c441842131 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7e9ea00700 1 -- 172.21.15.81:0/2526437319 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c011830 con 0x7f7ea0160840 2024-09-13T18:47:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7e9ea00700 1 -- 172.21.15.81:0/2526437319 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c011990 con 0x7f7ea0160840 2024-09-13T18:47:28.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7e9ea00700 1 -- 172.21.15.81:0/2526437319 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c011d40 con 0x7f7ea0160840 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 -- 172.21.15.81:0/2526437319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea0160840 msgr2=0x7f7ea0160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 --2- 172.21.15.81:0/2526437319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea0160840 0x7f7ea0160c80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009850 tx=0x7f7e8c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 -- 172.21.15.81:0/2526437319 shutdown_connections 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 --2- 172.21.15.81:0/2526437319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea0160840 0x7f7ea0160c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 --2- 172.21.15.81:0/2526437319 >> v2:172.21.15.178:3300/0 conn(0x7f7ea01601b0 0x7f7ea00b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 -- 172.21.15.81:0/2526437319 >> 172.21.15.81:0/2526437319 conn(0x7f7ea00d2b40 msgr2=0x7f7ea00d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 -- 172.21.15.81:0/2526437319 shutdown_connections 2024-09-13T18:47:28.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.462+0000 7f7ea5800700 1 -- 172.21.15.81:0/2526437319 wait complete. 2024-09-13T18:47:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 Processor -- start 2024-09-13T18:47:28.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 -- start start 2024-09-13T18:47:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea01601b0 0x7f7ea0152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 0x7f7ea00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea01611c0 0x7f7ea00cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00cca80 con 0x7f7ea0160840 2024-09-13T18:47:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00ca150 con 0x7f7ea01601b0 2024-09-13T18:47:28.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea5800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea00ca380 con 0x7f7ea01611c0 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 0x7f7ea00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 0x7f7ea00c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47426/0 (socket says 172.21.15.81:47426) 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 -- 172.21.15.81:0/347323219 learned_addr learned my addr 172.21.15.81:0/347323219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9fe00700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea01601b0 0x7f7ea0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea4e00700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea01611c0 0x7f7ea00cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 -- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea01611c0 msgr2=0x7f7ea00cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea01611c0 0x7f7ea00cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 -- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea01601b0 msgr2=0x7f7ea0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea01601b0 0x7f7ea0152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 -- 172.21.15.81:0/347323219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009570 con 0x7f7ea0160840 2024-09-13T18:47:28.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7ea4e00700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea01611c0 0x7f7ea00cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:28.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.466+0000 7f7e9f400700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 0x7f7ea00c9c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0090b0 tx=0x7f7e8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c004590 con 0x7f7ea0160840 2024-09-13T18:47:28.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c01f070 con 0x7f7ea0160840 2024-09-13T18:47:28.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c003900 con 0x7f7ea0160840 2024-09-13T18:47:28.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c0094b0 con 0x7f7ea0160840 2024-09-13T18:47:28.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea00ca940 con 0x7f7ea0160840 2024-09-13T18:47:28.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea00d3840 con 0x7f7ea0160840 2024-09-13T18:47:28.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.470+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e8c003a60 con 0x7f7ea0160840 2024-09-13T18:47:28.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.474+0000 7f7e97e00700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e80066730 0x7f7e80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.474+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e8c021070 con 0x7f7ea0160840 2024-09-13T18:47:28.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.474+0000 7f7e9fe00700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e80066730 0x7f7e80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.474+0000 7f7e9fe00700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e80066730 0x7f7e80068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e90006d50 tx=0x7f7e900092e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.478+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e8c052c10 con 0x7f7ea0160840 2024-09-13T18:47:28.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.662+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ea008cc60 con 0x7f7ea0160840 2024-09-13T18:47:28.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.666+0000 7f7e97e00700 1 -- 172.21.15.81:0/347323219 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e8c015020 con 0x7f7ea0160840 2024-09-13T18:47:28.674 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e80066730 msgr2=0x7f7e80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e80066730 0x7f7e80068bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e90006d50 tx=0x7f7e900092e0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 msgr2=0x7f7ea00c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 0x7f7ea00c9c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0090b0 tx=0x7f7e8c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 shutdown_connections 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e80066730 0x7f7e80068bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea01611c0 0x7f7ea00cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea0160840 0x7f7ea00c9c10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 --2- 172.21.15.81:0/347323219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea01601b0 0x7f7ea0152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 >> 172.21.15.81:0/347323219 conn(0x7f7ea00d2b40 msgr2=0x7f7ea00b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 shutdown_connections 2024-09-13T18:47:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.670+0000 7f7ea5800700 1 -- 172.21.15.81:0/347323219 wait complete. 2024-09-13T18:47:28.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:28.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.866+0000 7f86b9800700 1 Processor -- start 2024-09-13T18:47:28.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.866+0000 7f86b9800700 1 -- start start 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b9800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b9800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86b4144710 0x7f86b40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b9800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86b406bcf0 con 0x7f86b406d760 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b9800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86b40cce10 con 0x7f86b4144710 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b9800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b406cb50 con 0x7f86b4144330 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86b4144710 0x7f86b40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86b4144710 0x7f86b40b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47442/0 (socket says 172.21.15.81:47442) 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b2a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 -- 172.21.15.81:0/576884939 learned_addr learned my addr 172.21.15.81:0/576884939 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b2000700 1 --1- 172.21.15.81:0/576884939 >> v1:172.21.15.178:6789/0 conn(0x7f86b406d760 0x7f86b40b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:42060/0 (socket says 172.21.15.81:42060) 2024-09-13T18:47:28.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 -- 172.21.15.81:0/576884939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 msgr2=0x7f86b40cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 --2- 172.21.15.81:0/576884939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 -- 172.21.15.81:0/576884939 >> v1:172.21.15.178:6789/0 conn(0x7f86b406d760 legacy=0x7f86b40b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.870+0000 7f86b3400700 1 -- 172.21.15.81:0/576884939 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b40cf4b0 con 0x7f86b4144710 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b3400700 1 --2- 172.21.15.81:0/576884939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4144710 0x7f86b40b1b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009e50 tx=0x7f86ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62031adaeba53f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b1600700 1 -- 172.21.15.81:0/576884939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00e070 con 0x7f86b4144710 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b1600700 1 -- 172.21.15.81:0/576884939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac00b910 con 0x7f86b4144710 2024-09-13T18:47:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b1600700 1 -- 172.21.15.81:0/576884939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac00bcc0 con 0x7f86b4144710 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 -- 172.21.15.81:0/576884939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4144710 msgr2=0x7f86b40b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 --2- 172.21.15.81:0/576884939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4144710 0x7f86b40b1b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f86ac009e50 tx=0x7f86ac00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 -- 172.21.15.81:0/576884939 shutdown_connections 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 --2- 172.21.15.81:0/576884939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b4144710 0x7f86b40b1b60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 --2- 172.21.15.81:0/576884939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 -- 172.21.15.81:0/576884939 >> 172.21.15.81:0/576884939 conn(0x7f86b406a570 msgr2=0x7f86b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 -- 172.21.15.81:0/576884939 shutdown_connections 2024-09-13T18:47:28.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.874+0000 7f86b9800700 1 -- 172.21.15.81:0/576884939 wait complete. 2024-09-13T18:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 Processor -- start 2024-09-13T18:47:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 -- start start 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b406d760 0x7f86b40b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 0x7f86b413f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b1530 con 0x7f86b415ba90 2024-09-13T18:47:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40b1250 con 0x7f86b406d760 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b9800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86b40ae690 con 0x7f86b4144330 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 0x7f86b413f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 0x7f86b413f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47444/0 (socket says 172.21.15.81:47444) 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.878+0000 7f86b3400700 1 -- 172.21.15.81:0/1992962302 learned_addr learned my addr 172.21.15.81:0/1992962302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b2a00700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b406d760 0x7f86b40b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b2000700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b3400700 1 -- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 msgr2=0x7f86b40af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b3400700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40af170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b3400700 1 -- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b406d760 msgr2=0x7f86b40b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b3400700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b406d760 0x7f86b40b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b3400700 1 -- 172.21.15.81:0/1992962302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac009b30 con 0x7f86b415ba90 2024-09-13T18:47:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b3400700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 0x7f86b413f900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86b406b360 tx=0x7f86ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac004800 con 0x7f86b415ba90 2024-09-13T18:47:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ac0099b0 con 0x7f86b415ba90 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac01b670 con 0x7f86b415ba90 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b40ae970 con 0x7f86b415ba90 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b40af6b0 con 0x7f86b415ba90 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.882+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b40b3d40 con 0x7f86b415ba90 2024-09-13T18:47:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.886+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86ac01b7d0 con 0x7f86b415ba90 2024-09-13T18:47:28.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.886+0000 7f86aaa00700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8694066730 0x7f8694068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.886+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86ac085c70 con 0x7f86b415ba90 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.886+0000 7f86b2a00700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8694066730 0x7f8694068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.890+0000 7f86b2a00700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8694066730 0x7f8694068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86b4135d10 tx=0x7f86a4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:28.890+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f86ac052c60 con 0x7f86b415ba90 2024-09-13T18:47:29.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.074+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86b40ce510 con 0x7f86b415ba90 2024-09-13T18:47:29.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.074+0000 7f86aaa00700 1 -- 172.21.15.81:0/1992962302 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86ac056280 con 0x7f86b415ba90 2024-09-13T18:47:29.084 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:47:29.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8694066730 msgr2=0x7f8694068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8694066730 0x7f8694068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86b4135d10 tx=0x7f86a4009240 comp rx=0 tx=0).stop 2024-09-13T18:47:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 msgr2=0x7f86b413f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 0x7f86b413f900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86b406b360 tx=0x7f86ac004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 shutdown_connections 2024-09-13T18:47:29.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8694066730 0x7f8694068bf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86b415ba90 0x7f86b413f900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86b4144330 0x7f86b40af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 --2- 172.21.15.81:0/1992962302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86b406d760 0x7f86b40b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 >> 172.21.15.81:0/1992962302 conn(0x7f86b406a570 msgr2=0x7f86b40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 shutdown_connections 2024-09-13T18:47:29.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.078+0000 7f86b9800700 1 -- 172.21.15.81:0/1992962302 wait complete. 2024-09-13T18:47:29.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.274+0000 7fee7ec00700 1 Processor -- start 2024-09-13T18:47:29.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.274+0000 7fee7ec00700 1 -- start start 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee7806be10 0x7fee780ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7ec00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee780cf0b0 0x7fee781618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7ec00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7806d000 con 0x7fee78160fc0 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7ec00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780cf560 con 0x7fee780cf0b0 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7806c3f0 con 0x7fee7806be10 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee77e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee78160fc0 0x7fee780b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43656/0 (socket says 172.21.15.81:43656) 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee77e00700 1 -- 172.21.15.81:0/3798368163 learned_addr learned my addr 172.21.15.81:0/3798368163 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7cc00700 1 --2- 172.21.15.81:0/3798368163 >> v2:172.21.15.178:3300/0 conn(0x7fee780cf0b0 0x7fee781618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee6fe00700 1 --2- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee7806be10 0x7fee780ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee77400700 1 -- 172.21.15.81:0/3798368163 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27167301 0 0) 0x7fee7806d000 con 0x7fee78160fc0 2024-09-13T18:47:29.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee77400700 1 -- 172.21.15.81:0/3798368163 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee5c0035d0 con 0x7fee78160fc0 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7cc00700 1 -- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee7806be10 msgr2=0x7fee780ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7cc00700 1 --2- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee7806be10 0x7fee780ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7cc00700 1 -- 172.21.15.81:0/3798368163 >> v1:172.21.15.81:6789/0 conn(0x7fee78160fc0 legacy=0x7fee780b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7cc00700 1 -- 172.21.15.81:0/3798368163 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7806c6d0 con 0x7fee780cf0b0 2024-09-13T18:47:29.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.278+0000 7fee7cc00700 1 --2- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee780cf0b0 0x7fee781618e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee70009d90 tx=0x7fee7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66872c374eb49e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee77400700 1 -- 172.21.15.81:0/3798368163 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000e070 con 0x7fee780cf0b0 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee77400700 1 -- 172.21.15.81:0/3798368163 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000bb20 con 0x7fee780cf0b0 2024-09-13T18:47:29.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee77400700 1 -- 172.21.15.81:0/3798368163 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70012430 con 0x7fee780cf0b0 2024-09-13T18:47:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 -- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee780cf0b0 msgr2=0x7fee781618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 --2- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee780cf0b0 0x7fee781618e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fee70009d90 tx=0x7fee7000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 -- 172.21.15.81:0/3798368163 shutdown_connections 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 --2- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee780cf0b0 0x7fee781618e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 --2- 172.21.15.81:0/3798368163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee7806be10 0x7fee780ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 -- 172.21.15.81:0/3798368163 >> 172.21.15.81:0/3798368163 conn(0x7fee7806a570 msgr2=0x7fee7806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 -- 172.21.15.81:0/3798368163 shutdown_connections 2024-09-13T18:47:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.282+0000 7fee7ec00700 1 -- 172.21.15.81:0/3798368163 wait complete. 2024-09-13T18:47:29.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 Processor -- start 2024-09-13T18:47:29.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 -- start start 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 0x7fee780cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee780cf0b0 0x7fee78155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee78160fc0 0x7fee780b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cbb70 con 0x7fee7806be10 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cbe50 con 0x7fee78160fc0 2024-09-13T18:47:29.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee780cc130 con 0x7fee780cf0b0 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 0x7fee780cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 0x7fee780cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47456/0 (socket says 172.21.15.81:47456) 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 -- 172.21.15.81:0/1899100367 learned_addr learned my addr 172.21.15.81:0/1899100367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee6fe00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee780cf0b0 0x7fee78155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7cc00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee78160fc0 0x7fee780b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 -- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee780cf0b0 msgr2=0x7fee78155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee780cf0b0 0x7fee78155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 -- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee78160fc0 msgr2=0x7fee780b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee78160fc0 0x7fee780b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 -- 172.21.15.81:0/1899100367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70009a70 con 0x7fee7806be10 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee77e00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 0x7fee780cb270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c4d0 tx=0x7fee6800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68005d90 con 0x7fee7806be10 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee680070d0 con 0x7fee7806be10 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee780cc410 con 0x7fee7806be10 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee68007480 con 0x7fee7806be10 2024-09-13T18:47:29.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.286+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee780ccc10 con 0x7fee7806be10 2024-09-13T18:47:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.290+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee780ccda0 con 0x7fee7806be10 2024-09-13T18:47:29.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.290+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee680075e0 con 0x7fee7806be10 2024-09-13T18:47:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.290+0000 7fee74c00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee54066730 0x7fee54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.290+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fee680839b0 con 0x7fee7806be10 2024-09-13T18:47:29.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.290+0000 7fee6fe00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee54066730 0x7fee54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.294+0000 7fee6fe00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee54066730 0x7fee54068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee780b0e60 tx=0x7fee60009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.298+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee68050990 con 0x7fee7806be10 2024-09-13T18:47:29.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.478+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee780ceb70 con 0x7fee7806be10 2024-09-13T18:47:29.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee74c00700 1 -- 172.21.15.81:0/1899100367 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee68053fb0 con 0x7fee7806be10 2024-09-13T18:47:29.490 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee54066730 msgr2=0x7fee54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee54066730 0x7fee54068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee780b0e60 tx=0x7fee60009240 comp rx=0 tx=0).stop 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 msgr2=0x7fee780cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 0x7fee780cb270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fee6800c4d0 tx=0x7fee6800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 shutdown_connections 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee54066730 0x7fee54068bf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee78160fc0 0x7fee780b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee780cf0b0 0x7fee78155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 --2- 172.21.15.81:0/1899100367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee7806be10 0x7fee780cb270 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 >> 172.21.15.81:0/1899100367 conn(0x7fee7806a570 msgr2=0x7fee780b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 shutdown_connections 2024-09-13T18:47:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.482+0000 7fee7ec00700 1 -- 172.21.15.81:0/1899100367 wait complete. 2024-09-13T18:47:29.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:47:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fbe00700 1 Processor -- start 2024-09-13T18:47:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fbe00700 1 -- start start 2024-09-13T18:47:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69fc06aaa0 0x7f69fc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fbe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0ccb40 con 0x7f69fc0cc6f0 2024-09-13T18:47:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fbe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc06b430 con 0x7f69fc0cb020 2024-09-13T18:47:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fbe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0b2ad0 con 0x7f69fc06aaa0 2024-09-13T18:47:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69f2000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69fc0cc6f0 0x7f69fc15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43658/0 (socket says 172.21.15.81:43658) 2024-09-13T18:47:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69f2000700 1 -- 172.21.15.81:0/2330267231 learned_addr learned my addr 172.21.15.81:0/2330267231 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fb400700 1 --2- 172.21.15.81:0/2330267231 >> v2:172.21.15.81:3300/0 conn(0x7f69fc06aaa0 0x7f69fc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290801994 0 0) 0x7f69fc0ccb40 con 0x7f69fc0cc6f0 2024-09-13T18:47:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e00035d0 con 0x7f69fc0cc6f0 2024-09-13T18:47:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 459597207 0 0) 0x7f69e00035d0 con 0x7f69fc0cc6f0 2024-09-13T18:47:29.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 >> v2:172.21.15.81:3300/0 conn(0x7f69fc06aaa0 msgr2=0x7f69fc06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fa000700 1 --2- 172.21.15.81:0/2330267231 >> v2:172.21.15.81:3300/0 conn(0x7f69fc06aaa0 0x7f69fc06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.666+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 >> v1:172.21.15.178:6789/0 conn(0x7f69fc0cb020 legacy=0x7f69fc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc15b960 con 0x7f69fc0cc6f0 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f69e4001670 con 0x7f69fc0cc6f0 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 --2- 172.21.15.81:0/2330267231 >> v2:172.21.15.81:3300/0 conn(0x7f69fc06aaa0 0x7f69fc06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 >> v1:172.21.15.81:6789/0 conn(0x7f69fc0cc6f0 legacy=0x7f69fc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0003a90 0x7f69e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e0004870 0x7f69e0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e0005230 0x7f69e000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0b2ad0 con 0x7f69e0005230 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e000c0b0 con 0x7f69e0003a90 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e000c270 con 0x7f69e0004870 2024-09-13T18:47:29.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e0005230 0x7f69e000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69f2000700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e0004870 0x7f69e0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69faa00700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0003a90 0x7f69e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 -- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e0004870 msgr2=0x7f69e0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69e0004870 0x7f69e0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 -- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0003a90 msgr2=0x7f69e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0003a90 0x7f69e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 -- 172.21.15.81:0/2330267231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00035d0 con 0x7f69e0005230 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 -- 172.21.15.81:0/2330267231 reap_dead start 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fb400700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e0005230 0x7f69e000ba30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d40 tx=0x7f69e00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937c4448b8df7aee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4009e90 con 0x7f69e0005230 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400e9a0 con 0x7f69e0005230 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fa000700 1 -- 172.21.15.81:0/2330267231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400ed50 con 0x7f69e0005230 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 -- 172.21.15.81:0/2330267231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e0005230 msgr2=0x7f69e000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e0005230 0x7f69e000ba30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d40 tx=0x7f69e00058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 -- 172.21.15.81:0/2330267231 shutdown_connections 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 --2- 172.21.15.81:0/2330267231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69e0005230 0x7f69e000ba30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 -- 172.21.15.81:0/2330267231 >> 172.21.15.81:0/2330267231 conn(0x7f69fc0b0c40 msgr2=0x7f69fc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 -- 172.21.15.81:0/2330267231 shutdown_connections 2024-09-13T18:47:29.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.670+0000 7f69fbe00700 1 -- 172.21.15.81:0/2330267231 wait complete. 2024-09-13T18:47:29.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 Processor -- start 2024-09-13T18:47:29.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 -- start start 2024-09-13T18:47:29.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0005230 0x7f69fc06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69fc1557a0 0x7f69fc0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 0x7f69fc0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc1f2bc0 con 0x7f69fc155c20 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c8dc0 con 0x7f69e0005230 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fbe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc151fa0 con 0x7f69fc1557a0 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.674+0000 7f69fb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 0x7f69fc0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 0x7f69fc0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47480/0 (socket says 172.21.15.81:47480) 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 -- 172.21.15.81:0/215750424 learned_addr learned my addr 172.21.15.81:0/215750424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:29.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69faa00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0005230 0x7f69fc06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69f2000700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69fc1557a0 0x7f69fc0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 -- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69fc1557a0 msgr2=0x7f69fc0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69fc1557a0 0x7f69fc0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 -- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0005230 msgr2=0x7f69fc06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0005230 0x7f69fc06ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 -- 172.21.15.81:0/215750424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc1519d0 con 0x7f69fc155c20 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fb400700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 0x7f69fc0c81d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0cb8d0 tx=0x7f69f40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4009e90 con 0x7f69fc155c20 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4027450 con 0x7f69fc155c20 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4027800 con 0x7f69fc155c20 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc151c70 con 0x7f69fc155c20 2024-09-13T18:47:29.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc0c8ae0 con 0x7f69fc155c20 2024-09-13T18:47:29.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc1520e0 con 0x7f69fc155c20 2024-09-13T18:47:29.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.678+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69f401c450 con 0x7f69fc155c20 2024-09-13T18:47:29.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.682+0000 7f69f3400700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69d8066760 0x7f69d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.682+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f69f4085aa0 con 0x7f69fc155c20 2024-09-13T18:47:29.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.682+0000 7f69faa00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69d8066760 0x7f69d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.682+0000 7f69faa00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69d8066760 0x7f69d8068c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69ec011360 tx=0x7f69ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.686+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69f40566c0 con 0x7f69fc155c20 2024-09-13T18:47:29.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.874+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69fc159310 con 0x7f69fc155c20 2024-09-13T18:47:29.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69f3400700 1 -- 172.21.15.81:0/215750424 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69fc159310 con 0x7f69fc155c20 2024-09-13T18:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69d8066760 msgr2=0x7f69d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69d8066760 0x7f69d8068c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f69ec011360 tx=0x7f69ec009040 comp rx=0 tx=0).stop 2024-09-13T18:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 msgr2=0x7f69fc0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 0x7f69fc0c81d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0cb8d0 tx=0x7f69f40047e0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 shutdown_connections 2024-09-13T18:47:29.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69d8066760 0x7f69d8068c20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69fc155c20 0x7f69fc0c81d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69fc1557a0 0x7f69fc0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 --2- 172.21.15.81:0/215750424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69e0005230 0x7f69fc06ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 >> 172.21.15.81:0/215750424 conn(0x7f69fc0b0c40 msgr2=0x7f69fc0ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.878+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 shutdown_connections 2024-09-13T18:47:29.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:29.882+0000 7f69fbe00700 1 -- 172.21.15.81:0/215750424 wait complete. 2024-09-13T18:47:29.892 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:47:29.911 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:47:29.911 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:29.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.142+0000 7fa2f7200700 1 Processor -- start 2024-09-13T18:47:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.142+0000 7fa2f7200700 1 -- start start 2024-09-13T18:47:30.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f806aaa0 0x7fa2f806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f7200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f80ccb40 con 0x7fa2f80cb020 2024-09-13T18:47:30.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f806b430 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80b2ad0 con 0x7fa2f806aaa0 2024-09-13T18:47:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f5e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2f80cb020 0x7fa2f815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43664/0 (socket says 172.21.15.81:43664) 2024-09-13T18:47:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f5e00700 1 -- 172.21.15.81:0/3212455065 learned_addr learned my addr 172.21.15.81:0/3212455065 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f6800700 1 --2- 172.21.15.81:0/3212455065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f806aaa0 0x7fa2f806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 874132414 0 0) 0x7fa2f80ccb40 con 0x7fa2f80cb020 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2dc0035d0 con 0x7fa2f80cb020 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464282361 0 0) 0x7fa2e4001040 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f80ccb40 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f6800700 1 -- 172.21.15.81:0/3212455065 >> v1:172.21.15.178:6789/0 conn(0x7fa2f80cc6f0 legacy=0x7fa2f815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f6800700 1 -- 172.21.15.81:0/3212455065 >> v1:172.21.15.81:6789/0 conn(0x7fa2f80cb020 legacy=0x7fa2f815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167169029 0 0) 0x7fa2dc0035d0 con 0x7fa2f80cb020 2024-09-13T18:47:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.146+0000 7fa2f6800700 1 -- 172.21.15.81:0/3212455065 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f815b960 con 0x7fa2f806aaa0 2024-09-13T18:47:30.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f6800700 1 --2- 172.21.15.81:0/3212455065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f806aaa0 0x7fa2f806aef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009dc0 tx=0x7fa2f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d9ac4d62177be0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000e070 con 0x7fa2f806aaa0 2024-09-13T18:47:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0003a40 con 0x7fa2f806aaa0 2024-09-13T18:47:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f4a00700 1 -- 172.21.15.81:0/3212455065 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8001670 con 0x7fa2f806aaa0 2024-09-13T18:47:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 -- 172.21.15.81:0/3212455065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f806aaa0 msgr2=0x7fa2f806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 --2- 172.21.15.81:0/3212455065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f806aaa0 0x7fa2f806aef0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009dc0 tx=0x7fa2f000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 -- 172.21.15.81:0/3212455065 shutdown_connections 2024-09-13T18:47:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 --2- 172.21.15.81:0/3212455065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f806aaa0 0x7fa2f806aef0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 -- 172.21.15.81:0/3212455065 >> 172.21.15.81:0/3212455065 conn(0x7fa2f80b0c40 msgr2=0x7fa2f806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 -- 172.21.15.81:0/3212455065 shutdown_connections 2024-09-13T18:47:30.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.150+0000 7fa2f7200700 1 -- 172.21.15.81:0/3212455065 wait complete. 2024-09-13T18:47:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 Processor -- start 2024-09-13T18:47:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 -- start start 2024-09-13T18:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f806aaa0 0x7fa2f813aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cb020 0x7fa2f8139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 0x7fa2f813a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81579e0 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8157140 con 0x7fa2f806aaa0 2024-09-13T18:47:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8157420 con 0x7fa2f80cb020 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 0x7fa2f813a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 0x7fa2f813a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47490/0 (socket says 172.21.15.81:47490) 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 -- 172.21.15.81:0/2490169302 learned_addr learned my addr 172.21.15.81:0/2490169302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f5400700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cb020 0x7fa2f8139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f5e00700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f806aaa0 0x7fa2f813aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 -- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cb020 msgr2=0x7fa2f8139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cb020 0x7fa2f8139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 -- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f806aaa0 msgr2=0x7fa2f813aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f806aaa0 0x7fa2f813aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 -- 172.21.15.81:0/2490169302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009a70 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f6800700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 0x7fa2f813a360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000b370 tx=0x7fa2f0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0004600 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0004760 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f001d470 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f8157700 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.154+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f813af60 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.158+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8070020 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.158+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2f001d5d0 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.158+0000 7fa2ee000700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d8066760 0x7fa2d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.158+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2f0085ad0 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.158+0000 7fa2f5e00700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d8066760 0x7fa2d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.162+0000 7fa2f5e00700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d8066760 0x7fa2d8068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8001eb0 tx=0x7fa2e8001c80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.166+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2f8070020 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.358+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2f8070020 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.362+0000 7fa2ee000700 1 -- 172.21.15.81:0/2490169302 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa2f8070020 con 0x7fa2f80cc6f0 2024-09-13T18:47:30.371 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:30.371 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:30.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d8066760 msgr2=0x7fa2d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d8066760 0x7fa2d8068c20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8001eb0 tx=0x7fa2e8001c80 comp rx=0 tx=0).stop 2024-09-13T18:47:30.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 msgr2=0x7fa2f813a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 0x7fa2f813a360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000b370 tx=0x7fa2f0004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 shutdown_connections 2024-09-13T18:47:30.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d8066760 0x7fa2d8068c20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f80cc6f0 0x7fa2f813a360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cb020 0x7fa2f8139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 --2- 172.21.15.81:0/2490169302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f806aaa0 0x7fa2f813aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 >> 172.21.15.81:0/2490169302 conn(0x7fa2f80b0c40 msgr2=0x7fa2f806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 shutdown_connections 2024-09-13T18:47:30.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.366+0000 7fa2f7200700 1 -- 172.21.15.81:0/2490169302 wait complete. 2024-09-13T18:47:30.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:47:30.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.558+0000 7f00fbe00700 1 Processor -- start 2024-09-13T18:47:30.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.558+0000 7f00fbe00700 1 -- start start 2024-09-13T18:47:30.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.558+0000 7f00fbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00f406a390 0x7f00f415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.558+0000 7f00fbe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f415b300 con 0x7f00f40cf190 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.558+0000 7f00fbe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f415b5e0 con 0x7f00f4066090 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.558+0000 7f00fbe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f415b8c0 con 0x7f00f406a390 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00f406a390 0x7f00f415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f00f406a390 0x7f00f415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47498/0 (socket says 172.21.15.81:47498) 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 -- 172.21.15.81:0/2096859556 learned_addr learned my addr 172.21.15.81:0/2096859556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:30.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 -- 172.21.15.81:0/2096859556 >> v1:172.21.15.178:6789/0 conn(0x7f00f4066090 legacy=0x7f00f4066470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 -- 172.21.15.81:0/2096859556 >> v1:172.21.15.81:6789/0 conn(0x7f00f40cf190 legacy=0x7f00f406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 -- 172.21.15.81:0/2096859556 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f415bba0 con 0x7f00f406a390 2024-09-13T18:47:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f3e00700 1 -- 172.21.15.81:0/2096859556 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151195491 0 0) 0x7f00f415b300 con 0x7f00f40cf190 2024-09-13T18:47:30.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f8a00700 1 --2- 172.21.15.81:0/2096859556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f415abf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009910 tx=0x7f00e0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9311640169360f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f3e00700 1 -- 172.21.15.81:0/2096859556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e000ba60 con 0x7f00f406a390 2024-09-13T18:47:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f3e00700 1 -- 172.21.15.81:0/2096859556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e000bbc0 con 0x7f00f406a390 2024-09-13T18:47:30.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00f3e00700 1 -- 172.21.15.81:0/2096859556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0009e60 con 0x7f00f406a390 2024-09-13T18:47:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 -- 172.21.15.81:0/2096859556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 msgr2=0x7f00f415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2096859556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f415abf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009910 tx=0x7f00e0009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 -- 172.21.15.81:0/2096859556 shutdown_connections 2024-09-13T18:47:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2096859556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f415abf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 -- 172.21.15.81:0/2096859556 >> 172.21.15.81:0/2096859556 conn(0x7f00f406e660 msgr2=0x7f00f406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 -- 172.21.15.81:0/2096859556 shutdown_connections 2024-09-13T18:47:30.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.562+0000 7f00fbe00700 1 -- 172.21.15.81:0/2096859556 wait complete. 2024-09-13T18:47:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.566+0000 7f00fbe00700 1 Processor -- start 2024-09-13T18:47:30.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.566+0000 7f00fbe00700 1 -- start start 2024-09-13T18:47:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f4066090 0x7f00f41572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f41e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f40cf190 0x7f00f40b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415e390 con 0x7f00f406a390 2024-09-13T18:47:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f415de60 con 0x7f00f4066090 2024-09-13T18:47:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41e7510 con 0x7f00f40cf190 2024-09-13T18:47:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f41e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f41e5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47508/0 (socket says 172.21.15.81:47508) 2024-09-13T18:47:30.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 -- 172.21.15.81:0/2776967004 learned_addr learned my addr 172.21.15.81:0/2776967004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f9400700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f4066090 0x7f00f41572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f9e00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f40cf190 0x7f00f40b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 -- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f40cf190 msgr2=0x7f00f40b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f40cf190 0x7f00f40b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 -- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f4066090 msgr2=0x7f00f41572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f4066090 0x7f00f41572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 -- 172.21.15.81:0/2776967004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0009570 con 0x7f00f406a390 2024-09-13T18:47:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f8a00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f41e5b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0011ab0 con 0x7f00f406a390 2024-09-13T18:47:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e001f070 con 0x7f00f406a390 2024-09-13T18:47:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0011e50 con 0x7f00f406a390 2024-09-13T18:47:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40cf890 con 0x7f00f406a390 2024-09-13T18:47:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.570+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f41f67a0 con 0x7f00f406a390 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.574+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f406aaf0 con 0x7f00f406a390 2024-09-13T18:47:30.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.574+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f00e0026480 con 0x7f00f406a390 2024-09-13T18:47:30.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.574+0000 7f00f1600700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d4066730 0x7f00d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.578+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f00e0021070 con 0x7f00f406a390 2024-09-13T18:47:30.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.578+0000 7f00f9400700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d4066730 0x7f00d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.578+0000 7f00f9400700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d4066730 0x7f00d4068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00e8000f60 tx=0x7f00e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.582+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00e0052fd0 con 0x7f00f406a390 2024-09-13T18:47:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.762+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00f41f6490 con 0x7f00f406a390 2024-09-13T18:47:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.762+0000 7f00f1600700 1 -- 172.21.15.81:0/2776967004 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00e002b0a0 con 0x7f00f406a390 2024-09-13T18:47:30.771 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:47:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d4066730 msgr2=0x7f00d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d4066730 0x7f00d4068bf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00e8000f60 tx=0x7f00e8009040 comp rx=0 tx=0).stop 2024-09-13T18:47:30.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 msgr2=0x7f00f41e5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f41e5b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0004770 comp rx=0 tx=0).stop 2024-09-13T18:47:30.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 shutdown_connections 2024-09-13T18:47:30.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d4066730 0x7f00d4068bf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f40cf190 0x7f00f40b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f406a390 0x7f00f41e5b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 --2- 172.21.15.81:0/2776967004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f4066090 0x7f00f41572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 >> 172.21.15.81:0/2776967004 conn(0x7f00f406e660 msgr2=0x7f00f4159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 shutdown_connections 2024-09-13T18:47:30.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.766+0000 7f00fbe00700 1 -- 172.21.15.81:0/2776967004 wait complete. 2024-09-13T18:47:30.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.966+0000 7f8e1d000700 1 Processor -- start 2024-09-13T18:47:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.966+0000 7f8e1d000700 1 -- start start 2024-09-13T18:47:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e1d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e1815aa90 0x7f8e180b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e1d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e180cf830 0x7f8e180cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e1d000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e180b4680 con 0x7f8e1806c5a0 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e1d000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1815aee0 con 0x7f8e1815aa90 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e1d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b4960 con 0x7f8e180cf830 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e1815aa90 0x7f8e180b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e1815aa90 0x7f8e180b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47514/0 (socket says 172.21.15.81:47514) 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 -- 172.21.15.81:0/3795182603 learned_addr learned my addr 172.21.15.81:0/3795182603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e17e00700 1 --2- 172.21.15.81:0/3795182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e180cf830 0x7f8e180cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 -- 172.21.15.81:0/3795182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e180cf830 msgr2=0x7f8e180cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 --2- 172.21.15.81:0/3795182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e180cf830 0x7f8e180cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 -- 172.21.15.81:0/3795182603 >> v1:172.21.15.178:6789/0 conn(0x7f8e1806c5a0 legacy=0x7f8e1806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 -- 172.21.15.81:0/3795182603 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180cf030 con 0x7f8e1815aa90 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16a00700 1 --2- 172.21.15.81:0/3795182603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1815aa90 0x7f8e180b56c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009910 tx=0x7f8e04009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf016d70f323ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16000700 1 -- 172.21.15.81:0/3795182603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400ba60 con 0x7f8e1815aa90 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16000700 1 -- 172.21.15.81:0/3795182603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400bbc0 con 0x7f8e1815aa90 2024-09-13T18:47:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.970+0000 7f8e16000700 1 -- 172.21.15.81:0/3795182603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04009e60 con 0x7f8e1815aa90 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 -- 172.21.15.81:0/3795182603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1815aa90 msgr2=0x7f8e180b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 --2- 172.21.15.81:0/3795182603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1815aa90 0x7f8e180b56c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009910 tx=0x7f8e04009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 -- 172.21.15.81:0/3795182603 shutdown_connections 2024-09-13T18:47:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 --2- 172.21.15.81:0/3795182603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e180cf830 0x7f8e180cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 --2- 172.21.15.81:0/3795182603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1815aa90 0x7f8e180b56c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 -- 172.21.15.81:0/3795182603 >> 172.21.15.81:0/3795182603 conn(0x7f8e18071d20 msgr2=0x7f8e18072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 -- 172.21.15.81:0/3795182603 shutdown_connections 2024-09-13T18:47:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.974+0000 7f8e1d000700 1 -- 172.21.15.81:0/3795182603 wait complete. 2024-09-13T18:47:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 Processor -- start 2024-09-13T18:47:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 -- start start 2024-09-13T18:47:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 0x7f8e18152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e180cf830 0x7f8e1814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1815aa90 0x7f8e1813b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1814f330 con 0x7f8e1806c5a0 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1813a1f0 con 0x7f8e180cf830 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e1d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e18139300 con 0x7f8e1815aa90 2024-09-13T18:47:30.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 0x7f8e18152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 0x7f8e18152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47528/0 (socket says 172.21.15.81:47528) 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e16a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e180cf830 0x7f8e1814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1815aa90 0x7f8e1813b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 -- 172.21.15.81:0/37772595 learned_addr learned my addr 172.21.15.81:0/37772595 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 -- 172.21.15.81:0/37772595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1815aa90 msgr2=0x7f8e1813b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1815aa90 0x7f8e1813b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 -- 172.21.15.81:0/37772595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e180cf830 msgr2=0x7f8e1814ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e180cf830 0x7f8e1814ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.978+0000 7f8e17400700 1 -- 172.21.15.81:0/37772595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e04009570 con 0x7f8e1806c5a0 2024-09-13T18:47:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e17400700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 0x7f8e18152590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c500 tx=0x7f8e0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e080052d0 con 0x7f8e1806c5a0 2024-09-13T18:47:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08005430 con 0x7f8e1806c5a0 2024-09-13T18:47:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e181395e0 con 0x7f8e1806c5a0 2024-09-13T18:47:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e080055a0 con 0x7f8e1806c5a0 2024-09-13T18:47:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18139ba0 con 0x7f8e1806c5a0 2024-09-13T18:47:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.982+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1806c980 con 0x7f8e1806c5a0 2024-09-13T18:47:30.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.986+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e080038e0 con 0x7f8e1806c5a0 2024-09-13T18:47:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.986+0000 7f8e0f400700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8df8066730 0x7f8df8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.986+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e080838b0 con 0x7f8e1806c5a0 2024-09-13T18:47:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.986+0000 7f8e16a00700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8df8066730 0x7f8df8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.986+0000 7f8e16a00700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8df8066730 0x7f8df8068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e04000c00 tx=0x7f8e04008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:30.990+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e08050890 con 0x7f8e1806c5a0 2024-09-13T18:47:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.170+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e18159980 con 0x7f8e1806c5a0 2024-09-13T18:47:31.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e0f400700 1 -- 172.21.15.81:0/37772595 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e08053eb0 con 0x7f8e1806c5a0 2024-09-13T18:47:31.182 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8df8066730 msgr2=0x7f8df8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8df8066730 0x7f8df8068bf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8e04000c00 tx=0x7f8e04008030 comp rx=0 tx=0).stop 2024-09-13T18:47:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 msgr2=0x7f8e18152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 0x7f8e18152590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c500 tx=0x7f8e0800c810 comp rx=0 tx=0).stop 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 shutdown_connections 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8df8066730 0x7f8df8068bf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e1815aa90 0x7f8e1813b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e180cf830 0x7f8e1814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 --2- 172.21.15.81:0/37772595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e1806c5a0 0x7f8e18152590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 >> 172.21.15.81:0/37772595 conn(0x7f8e18071d20 msgr2=0x7f8e1806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 shutdown_connections 2024-09-13T18:47:31.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.174+0000 7f8e1d000700 1 -- 172.21.15.81:0/37772595 wait complete. 2024-09-13T18:47:31.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:31.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 Processor -- start 2024-09-13T18:47:31.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 -- start start 2024-09-13T18:47:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406d620 0x7f0cf406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0cf406cea0 0x7f0cf40b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40b1980 con 0x7f0cf4143b70 2024-09-13T18:47:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40b2500 con 0x7f0cf406cea0 2024-09-13T18:47:31.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.378+0000 7f0cf3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf406d2f0 con 0x7f0cf406d620 2024-09-13T18:47:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0cf4143b70 0x7f0cf40cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:42120/0 (socket says 172.21.15.81:42120) 2024-09-13T18:47:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2a00700 1 -- 172.21.15.81:0/1251262444 learned_addr learned my addr 172.21.15.81:0/1251262444 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3400700 1 --2- 172.21.15.81:0/1251262444 >> v2:172.21.15.178:3300/0 conn(0x7f0cf406cea0 0x7f0cf40b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2000700 1 --2- 172.21.15.81:0/1251262444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406d620 0x7f0cf406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf1600700 1 -- 172.21.15.81:0/1251262444 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163230020 0 0) 0x7f0cf40b1980 con 0x7f0cf4143b70 2024-09-13T18:47:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf1600700 1 -- 172.21.15.81:0/1251262444 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd80035d0 con 0x7f0cf4143b70 2024-09-13T18:47:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2000700 1 -- 172.21.15.81:0/1251262444 >> v2:172.21.15.178:3300/0 conn(0x7f0cf406cea0 msgr2=0x7f0cf40b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2000700 1 --2- 172.21.15.81:0/1251262444 >> v2:172.21.15.178:3300/0 conn(0x7f0cf406cea0 0x7f0cf40b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2000700 1 -- 172.21.15.81:0/1251262444 >> v1:172.21.15.178:6789/0 conn(0x7f0cf4143b70 legacy=0x7f0cf40cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2000700 1 -- 172.21.15.81:0/1251262444 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40b1bd0 con 0x7f0cf406d620 2024-09-13T18:47:31.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf2000700 1 --2- 172.21.15.81:0/1251262444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406d620 0x7f0cf406c960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009850 tx=0x7f0ce0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf01618eeb799b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf1600700 1 -- 172.21.15.81:0/1251262444 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0011830 con 0x7f0cf406d620 2024-09-13T18:47:31.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf1600700 1 -- 172.21.15.81:0/1251262444 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0011990 con 0x7f0cf406d620 2024-09-13T18:47:31.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf1600700 1 -- 172.21.15.81:0/1251262444 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0011d40 con 0x7f0cf406d620 2024-09-13T18:47:31.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1251262444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406d620 msgr2=0x7f0cf406c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1251262444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406d620 0x7f0cf406c960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009850 tx=0x7f0ce0009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1251262444 shutdown_connections 2024-09-13T18:47:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1251262444 >> v2:172.21.15.178:3300/0 conn(0x7f0cf406cea0 0x7f0cf40b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1251262444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406d620 0x7f0cf406c960 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1251262444 >> 172.21.15.81:0/1251262444 conn(0x7f0cf406a390 msgr2=0x7f0cf406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1251262444 shutdown_connections 2024-09-13T18:47:31.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.382+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1251262444 wait complete. 2024-09-13T18:47:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 Processor -- start 2024-09-13T18:47:31.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 -- start start 2024-09-13T18:47:31.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406cea0 0x7f0cf41f0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cf406d620 0x7f0cf413f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 0x7f0cf41562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf413fb60 con 0x7f0cf4143b70 2024-09-13T18:47:31.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f1470 con 0x7f0cf406d620 2024-09-13T18:47:31.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.386+0000 7f0cf3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf413f5b0 con 0x7f0cf406cea0 2024-09-13T18:47:31.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 0x7f0cf41562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 0x7f0cf41562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47530/0 (socket says 172.21.15.81:47530) 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 -- 172.21.15.81:0/1518355729 learned_addr learned my addr 172.21.15.81:0/1518355729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf2a00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406cea0 0x7f0cf41f0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf2000700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cf406d620 0x7f0cf413f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 -- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406cea0 msgr2=0x7f0cf41f0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406cea0 0x7f0cf41f0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 -- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cf406d620 msgr2=0x7f0cf413f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cf406d620 0x7f0cf413f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 -- 172.21.15.81:0/1518355729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00094b0 con 0x7f0cf4143b70 2024-09-13T18:47:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3400700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 0x7f0cf41562e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009dd0 tx=0x7f0cec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec009c40 con 0x7f0cf4143b70 2024-09-13T18:47:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec00f040 con 0x7f0cf4143b70 2024-09-13T18:47:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00ceb0 con 0x7f0cf4143b70 2024-09-13T18:47:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf4159520 con 0x7f0cf4143b70 2024-09-13T18:47:31.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.390+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf413fdb0 con 0x7f0cf4143b70 2024-09-13T18:47:31.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.394+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf406c960 con 0x7f0cf4143b70 2024-09-13T18:47:31.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.394+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0cec014480 con 0x7f0cf4143b70 2024-09-13T18:47:31.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.394+0000 7f0ceaa00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0cd4066730 0x7f0cd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.394+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cec084b30 con 0x7f0cf4143b70 2024-09-13T18:47:31.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.394+0000 7f0cf2a00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0cd4066730 0x7f0cd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.398+0000 7f0cf2a00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0cd4066730 0x7f0cd4068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4007fd0 tx=0x7f0ce4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.402+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0cec051c40 con 0x7f0cf4143b70 2024-09-13T18:47:31.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.586+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0cf4071f60 con 0x7f0cf4143b70 2024-09-13T18:47:31.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.586+0000 7f0ceaa00700 1 -- 172.21.15.81:0/1518355729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0cec018020 con 0x7f0cf4143b70 2024-09-13T18:47:31.596 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0cd4066730 msgr2=0x7f0cd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0cd4066730 0x7f0cd4068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4007fd0 tx=0x7f0ce4007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 msgr2=0x7f0cf41562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 0x7f0cf41562e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009dd0 tx=0x7f0cec00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 shutdown_connections 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0cd4066730 0x7f0cd4068bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf4143b70 0x7f0cf41562e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cf406d620 0x7f0cf413f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 --2- 172.21.15.81:0/1518355729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cf406cea0 0x7f0cf41f0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 >> 172.21.15.81:0/1518355729 conn(0x7f0cf406a390 msgr2=0x7f0cf40b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 shutdown_connections 2024-09-13T18:47:31.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.590+0000 7f0cf3e00700 1 -- 172.21.15.81:0/1518355729 wait complete. 2024-09-13T18:47:31.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:47:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.782+0000 7f8486000700 1 Processor -- start 2024-09-13T18:47:31.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.786+0000 7f8486000700 1 -- start start 2024-09-13T18:47:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.786+0000 7f8486000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8480160f90 0x7f848006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.786+0000 7f8486000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84800b52b0 0x7f84800b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.786+0000 7f8486000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848006b7e0 con 0x7f84800b2e30 2024-09-13T18:47:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.786+0000 7f8486000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84800b3230 con 0x7f8480160f90 2024-09-13T18:47:31.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.786+0000 7f8486000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848006ba10 con 0x7f84800b52b0 2024-09-13T18:47:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8480160f90 0x7f848006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84800b52b0 0x7f84800b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84800b52b0 0x7f84800b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:48822/0 (socket says 172.21.15.81:48822) 2024-09-13T18:47:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 -- 172.21.15.81:0/2157214260 learned_addr learned my addr 172.21.15.81:0/2157214260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:31.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847fe00700 1 --1- 172.21.15.81:0/2157214260 >> v1:172.21.15.81:6789/0 conn(0x7f84800b2e30 0x7f848006f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43676/0 (socket says 172.21.15.81:43676) 2024-09-13T18:47:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 -- 172.21.15.81:0/2157214260 >> v2:172.21.15.81:3300/0 conn(0x7f8480160f90 msgr2=0x7f848006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 --2- 172.21.15.81:0/2157214260 >> v2:172.21.15.81:3300/0 conn(0x7f8480160f90 0x7f848006b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 -- 172.21.15.81:0/2157214260 >> v1:172.21.15.81:6789/0 conn(0x7f84800b2e30 legacy=0x7f848006f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:31.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 -- 172.21.15.81:0/2157214260 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848006bcf0 con 0x7f84800b52b0 2024-09-13T18:47:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847ea00700 1 --2- 172.21.15.81:0/2157214260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f84800b28f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f848006f5c0 tx=0x7f846c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dd7457ac8ca7401 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847e000700 1 -- 172.21.15.81:0/2157214260 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c011830 con 0x7f84800b52b0 2024-09-13T18:47:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847e000700 1 -- 172.21.15.81:0/2157214260 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c011990 con 0x7f84800b52b0 2024-09-13T18:47:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f847e000700 1 -- 172.21.15.81:0/2157214260 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c011d20 con 0x7f84800b52b0 2024-09-13T18:47:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 -- 172.21.15.81:0/2157214260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 msgr2=0x7f84800b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 --2- 172.21.15.81:0/2157214260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f84800b28f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f848006f5c0 tx=0x7f846c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 -- 172.21.15.81:0/2157214260 shutdown_connections 2024-09-13T18:47:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 --2- 172.21.15.81:0/2157214260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f84800b28f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 --2- 172.21.15.81:0/2157214260 >> v2:172.21.15.81:3300/0 conn(0x7f8480160f90 0x7f848006b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 -- 172.21.15.81:0/2157214260 >> 172.21.15.81:0/2157214260 conn(0x7f848006e660 msgr2=0x7f848006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 -- 172.21.15.81:0/2157214260 shutdown_connections 2024-09-13T18:47:31.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.790+0000 7f8486000700 1 -- 172.21.15.81:0/2157214260 wait complete. 2024-09-13T18:47:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 Processor -- start 2024-09-13T18:47:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 -- start start 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84800b2e30 0x7f84800c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f8480153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 0x7f84800ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c7100 con 0x7f8480160f90 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c73e0 con 0x7f84800b52b0 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f8486000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84800c76c0 con 0x7f84800b2e30 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f847fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 0x7f84800ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f847fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 0x7f84800ca640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47552/0 (socket says 172.21.15.81:47552) 2024-09-13T18:47:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f847fe00700 1 -- 172.21.15.81:0/1464117694 learned_addr learned my addr 172.21.15.81:0/1464117694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f847ea00700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f8480153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.794+0000 7f847f400700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84800b2e30 0x7f84800c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f847fe00700 1 -- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84800b2e30 msgr2=0x7f84800c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f847fe00700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84800b2e30 0x7f84800c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f847fe00700 1 -- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 msgr2=0x7f8480153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f847fe00700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f8480153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f847fe00700 1 -- 172.21.15.81:0/1464117694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c009570 con 0x7f8480160f90 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f847fe00700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 0x7f84800ca640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f847800cbd0 tx=0x7f847800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847800abb0 con 0x7f8480160f90 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847800ad10 con 0x7f8480160f90 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84800c79a0 con 0x7f8480160f90 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478007270 con 0x7f8480160f90 2024-09-13T18:47:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8480153ed0 con 0x7f8480160f90 2024-09-13T18:47:31.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.798+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84800c7ec0 con 0x7f8480160f90 2024-09-13T18:47:31.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.802+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84780073d0 con 0x7f8480160f90 2024-09-13T18:47:31.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.802+0000 7f8477400700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8460066730 0x7f8460068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.802+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8478084160 con 0x7f8480160f90 2024-09-13T18:47:31.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.802+0000 7f847f400700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8460066730 0x7f8460068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.806+0000 7f847f400700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8460066730 0x7f8460068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8470009ae0 tx=0x7f8470008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.810+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f84800c7ec0 con 0x7f8480160f90 2024-09-13T18:47:32.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.994+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f84800c7ec0 con 0x7f8480160f90 2024-09-13T18:47:32.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:31.998+0000 7f8477400700 1 -- 172.21.15.81:0/1464117694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f84800c7ec0 con 0x7f8480160f90 2024-09-13T18:47:32.007 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8460066730 msgr2=0x7f8460068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8460066730 0x7f8460068bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8470009ae0 tx=0x7f8470008040 comp rx=0 tx=0).stop 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 msgr2=0x7f84800ca640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 0x7f84800ca640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f847800cbd0 tx=0x7f847800cf90 comp rx=0 tx=0).stop 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 shutdown_connections 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8460066730 0x7f8460068bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8480160f90 0x7f84800ca640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84800b52b0 0x7f8480153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 --2- 172.21.15.81:0/1464117694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84800b2e30 0x7f84800c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 >> 172.21.15.81:0/1464117694 conn(0x7f848006e660 msgr2=0x7f84800b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 shutdown_connections 2024-09-13T18:47:32.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.002+0000 7f8486000700 1 -- 172.21.15.81:0/1464117694 wait complete. 2024-09-13T18:47:32.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:47:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.190+0000 7f2563e00700 1 Processor -- start 2024-09-13T18:47:32.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.190+0000 7f2563e00700 1 -- start start 2024-09-13T18:47:32.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2564159bd0 0x7f25640cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f256406b1b0 0x7f25641636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25640707d0 con 0x7f2564071870 2024-09-13T18:47:32.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640720a0 con 0x7f2564159bd0 2024-09-13T18:47:32.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256406fee0 con 0x7f256406b1b0 2024-09-13T18:47:32.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2564159bd0 0x7f25640cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2564159bd0 0x7f25640cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47554/0 (socket says 172.21.15.81:47554) 2024-09-13T18:47:32.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 -- 172.21.15.81:0/1569936955 learned_addr learned my addr 172.21.15.81:0/1569936955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:32.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563400700 1 --2- 172.21.15.81:0/1569936955 >> v2:172.21.15.178:3300/0 conn(0x7f256406b1b0 0x7f25641636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 -- 172.21.15.81:0/1569936955 >> v2:172.21.15.178:3300/0 conn(0x7f256406b1b0 msgr2=0x7f25641636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 --2- 172.21.15.81:0/1569936955 >> v2:172.21.15.178:3300/0 conn(0x7f256406b1b0 0x7f25641636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 -- 172.21.15.81:0/1569936955 >> v1:172.21.15.178:6789/0 conn(0x7f2564071870 legacy=0x7f256406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 -- 172.21.15.81:0/1569936955 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640b2ef0 con 0x7f2564159bd0 2024-09-13T18:47:32.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2563400700 1 --2- 172.21.15.81:0/1569936955 >> v2:172.21.15.178:3300/0 conn(0x7f256406b1b0 0x7f25641636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562a00700 1 --2- 172.21.15.81:0/1569936955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564159bd0 0x7f25640cb700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2554009e50 tx=0x7f255400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8228ad98739ada server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562000700 1 -- 172.21.15.81:0/1569936955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400e070 con 0x7f2564159bd0 2024-09-13T18:47:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562000700 1 -- 172.21.15.81:0/1569936955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2554003a40 con 0x7f2564159bd0 2024-09-13T18:47:32.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.194+0000 7f2562000700 1 -- 172.21.15.81:0/1569936955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2554003df0 con 0x7f2564159bd0 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 -- 172.21.15.81:0/1569936955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564159bd0 msgr2=0x7f25640cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 --2- 172.21.15.81:0/1569936955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564159bd0 0x7f25640cb700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2554009e50 tx=0x7f255400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 -- 172.21.15.81:0/1569936955 shutdown_connections 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 --2- 172.21.15.81:0/1569936955 >> v2:172.21.15.178:3300/0 conn(0x7f256406b1b0 0x7f25641636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 --2- 172.21.15.81:0/1569936955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564159bd0 0x7f25640cb700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 -- 172.21.15.81:0/1569936955 >> 172.21.15.81:0/1569936955 conn(0x7f25640b0c40 msgr2=0x7f256406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 -- 172.21.15.81:0/1569936955 shutdown_connections 2024-09-13T18:47:32.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 -- 172.21.15.81:0/1569936955 wait complete. 2024-09-13T18:47:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.198+0000 7f2563e00700 1 Processor -- start 2024-09-13T18:47:32.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 -- start start 2024-09-13T18:47:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f256406b1b0 0x7f256415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 0x7f25640ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2564159bd0 0x7f256414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256413d050 con 0x7f2564071870 2024-09-13T18:47:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640afa80 con 0x7f2564159bd0 2024-09-13T18:47:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25640aee00 con 0x7f256406b1b0 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 0x7f25640ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 0x7f25640ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47564/0 (socket says 172.21.15.81:47564) 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 -- 172.21.15.81:0/279580627 learned_addr learned my addr 172.21.15.81:0/279580627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2562a00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f256406b1b0 0x7f256415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563400700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2564159bd0 0x7f256414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 -- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f256406b1b0 msgr2=0x7f256415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f256406b1b0 0x7f256415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 -- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2564159bd0 msgr2=0x7f256414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2564159bd0 0x7f256414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 -- 172.21.15.81:0/279580627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009b30 con 0x7f2564071870 2024-09-13T18:47:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255a000700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 0x7f25640ae5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c4e0 tx=0x7f254c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c011790 con 0x7f2564071870 2024-09-13T18:47:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c011910 con 0x7f2564071870 2024-09-13T18:47:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25640af0e0 con 0x7f2564071870 2024-09-13T18:47:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c011cc0 con 0x7f2564071870 2024-09-13T18:47:32.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.202+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25640af6a0 con 0x7f2564071870 2024-09-13T18:47:32.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.206+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2564070c40 con 0x7f2564071870 2024-09-13T18:47:32.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.206+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f254c01c460 con 0x7f2564071870 2024-09-13T18:47:32.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.210+0000 7f255b400700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2540066730 0x7f2540068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.210+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f254c0841e0 con 0x7f2564071870 2024-09-13T18:47:32.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.210+0000 7f2562a00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2540066730 0x7f2540068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.210+0000 7f2562a00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2540066730 0x7f2540068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2554015040 tx=0x7f2554009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.214+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2564070c40 con 0x7f2564071870 2024-09-13T18:47:32.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.410+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f25640afbc0 con 0x7f2564071870 2024-09-13T18:47:32.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.410+0000 7f255b400700 1 -- 172.21.15.81:0/279580627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f25640afbc0 con 0x7f2564071870 2024-09-13T18:47:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2540066730 msgr2=0x7f2540068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2540066730 0x7f2540068bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2554015040 tx=0x7f2554009000 comp rx=0 tx=0).stop 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 msgr2=0x7f25640ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 0x7f25640ae5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c4e0 tx=0x7f254c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 shutdown_connections 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2540066730 0x7f2540068bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2564159bd0 0x7f256414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2564071870 0x7f25640ae5d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 --2- 172.21.15.81:0/279580627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f256406b1b0 0x7f256415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 >> 172.21.15.81:0/279580627 conn(0x7f25640b0c40 msgr2=0x7f25640cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 shutdown_connections 2024-09-13T18:47:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.414+0000 7f2563e00700 1 -- 172.21.15.81:0/279580627 wait complete. 2024-09-13T18:47:32.425 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:47:32.446 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-13T18:47:32.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:32.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T18:47:32.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi081.stderr:ceph-fuse[32380]: fuse finished with error 0 and tester_r 0 2024-09-13T18:47:32.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:47:32.543 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:47:32.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:32.543 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T18:47:32.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.782+0000 7fb65e800700 1 Processor -- start 2024-09-13T18:47:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.782+0000 7fb65e800700 1 -- start start 2024-09-13T18:47:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65e800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb65806c040 0x7fb65806ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65e800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65806b140 con 0x7fb65806cf90 2024-09-13T18:47:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65e800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580cd7a0 con 0x7fb65806c040 2024-09-13T18:47:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65806d440 con 0x7fb65815cb30 2024-09-13T18:47:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65d400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb65806c040 0x7fb65806ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb65806c040 0x7fb65806ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:48864/0 (socket says 172.21.15.81:48864) 2024-09-13T18:47:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 -- 172.21.15.81:0/1710391255 learned_addr learned my addr 172.21.15.81:0/1710391255 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65d400700 1 --2- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65806bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48366/0 (socket says 172.21.15.81:48366) 2024-09-13T18:47:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 -- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 msgr2=0x7fb65806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 --2- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65806bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 -- 172.21.15.81:0/1710391255 >> v1:172.21.15.178:6789/0 conn(0x7fb65806cf90 legacy=0x7fb6580b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 -- 172.21.15.81:0/1710391255 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65806a530 con 0x7fb65806c040 2024-09-13T18:47:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb65ca00700 1 --2- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb65806ca50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb644009910 tx=0x7fb644009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b18414d666da8cc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb657e00700 1 -- 172.21.15.81:0/1710391255 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644011830 con 0x7fb65806c040 2024-09-13T18:47:32.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb657e00700 1 -- 172.21.15.81:0/1710391255 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644011990 con 0x7fb65806c040 2024-09-13T18:47:32.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.786+0000 7fb657e00700 1 -- 172.21.15.81:0/1710391255 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644011d40 con 0x7fb65806c040 2024-09-13T18:47:32.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 -- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 msgr2=0x7fb65806ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 --2- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb65806ca50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb644009910 tx=0x7fb644009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 -- 172.21.15.81:0/1710391255 shutdown_connections 2024-09-13T18:47:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 --2- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb65806ca50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 --2- 172.21.15.81:0/1710391255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65806bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 -- 172.21.15.81:0/1710391255 >> 172.21.15.81:0/1710391255 conn(0x7fb658071f00 msgr2=0x7fb6580722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 -- 172.21.15.81:0/1710391255 shutdown_connections 2024-09-13T18:47:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 -- 172.21.15.81:0/1710391255 wait complete. 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.790+0000 7fb65e800700 1 Processor -- start 2024-09-13T18:47:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 -- start start 2024-09-13T18:47:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb6581534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65806cf90 0x7fb6580b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65815f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b14b0 con 0x7fb65806cf90 2024-09-13T18:47:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b0ee0 con 0x7fb65806c040 2024-09-13T18:47:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581539e0 con 0x7fb65815cb30 2024-09-13T18:47:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65806cf90 0x7fb6580b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb6581534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb6581534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:48876/0 (socket says 172.21.15.81:48876) 2024-09-13T18:47:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65d400700 1 -- 172.21.15.81:0/2061248127 learned_addr learned my addr 172.21.15.81:0/2061248127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65de00700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65815f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65ca00700 1 -- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 msgr2=0x7fb65815f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65ca00700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65815f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65ca00700 1 -- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 msgr2=0x7fb6581534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65ca00700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb6581534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.794+0000 7fb65ca00700 1 -- 172.21.15.81:0/2061248127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644009570 con 0x7fb65806cf90 2024-09-13T18:47:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb65ca00700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65806cf90 0x7fb6580b1940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb644016000 tx=0x7fb644004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644004510 con 0x7fb65806cf90 2024-09-13T18:47:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64401f070 con 0x7fb65806cf90 2024-09-13T18:47:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644003900 con 0x7fb65806cf90 2024-09-13T18:47:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6580b1e80 con 0x7fb65806cf90 2024-09-13T18:47:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6580b1140 con 0x7fb65806cf90 2024-09-13T18:47:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.798+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6580cabb0 con 0x7fb65806cf90 2024-09-13T18:47:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.802+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb644003a60 con 0x7fb65806cf90 2024-09-13T18:47:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.802+0000 7fb655600700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb638066730 0x7fb638068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.802+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb644021070 con 0x7fb65806cf90 2024-09-13T18:47:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.802+0000 7fb65d400700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb638066730 0x7fb638068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.802+0000 7fb65d400700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb638066730 0x7fb638068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009bf0 tx=0x7fb64c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.810+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6440528c0 con 0x7fb65806cf90 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.994+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6580b12d0 con 0x7fb65806cf90 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb655600700 1 -- 172.21.15.81:0/2061248127 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fb644006da0 con 0x7fb65806cf90 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb638066730 msgr2=0x7fb638068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb638066730 0x7fb638068bf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009bf0 tx=0x7fb64c009240 comp rx=0 tx=0).stop 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65806cf90 msgr2=0x7fb6580b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65806cf90 0x7fb6580b1940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb644016000 tx=0x7fb644004770 comp rx=0 tx=0).stop 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 shutdown_connections 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb638066730 0x7fb638068bf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65815cb30 0x7fb65815f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65806cf90 0x7fb6580b1940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 --2- 172.21.15.81:0/2061248127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65806c040 0x7fb6581534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 >> 172.21.15.81:0/2061248127 conn(0x7fb658071f00 msgr2=0x7fb6580cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 shutdown_connections 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:32.998+0000 7fb65e800700 1 -- 172.21.15.81:0/2061248127 wait complete. 2024-09-13T18:47:33.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 Processor -- start 2024-09-13T18:47:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 -- start start 2024-09-13T18:47:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ef41610b0 0x7f1ef40719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ef406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef40b3560 con 0x7f1ef406aaa0 2024-09-13T18:47:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef4070b30 con 0x7f1ef41610b0 2024-09-13T18:47:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef406b450 con 0x7f1ef40b2d80 2024-09-13T18:47:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef2000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1ef406aaa0 0x7f1ef40b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43690/0 (socket says 172.21.15.81:43690) 2024-09-13T18:47:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef2000700 1 -- 172.21.15.81:0/2549332344 learned_addr learned my addr 172.21.15.81:0/2549332344 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef2a00700 1 --2- 172.21.15.81:0/2549332344 >> v2:172.21.15.178:3300/0 conn(0x7f1ef41610b0 0x7f1ef40719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417468163 0 0) 0x7f1ef40b3560 con 0x7f1ef406aaa0 2024-09-13T18:47:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed80035d0 con 0x7f1ef406aaa0 2024-09-13T18:47:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.190+0000 7f1ef3400700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ef406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003607461 0 0) 0x7f1ed80035d0 con 0x7f1ef406aaa0 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 msgr2=0x7f1ef406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ef406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 >> v2:172.21.15.178:3300/0 conn(0x7f1ef41610b0 msgr2=0x7f1ef40719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 --2- 172.21.15.81:0/2549332344 >> v2:172.21.15.178:3300/0 conn(0x7f1ef41610b0 0x7f1ef40719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef40b3280 con 0x7f1ef406aaa0 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f1edc001670 con 0x7f1ef406aaa0 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 >> v1:172.21.15.81:6789/0 conn(0x7f1ef406aaa0 legacy=0x7f1ef40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ed8003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ed8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ed8004db0 0x7f1ed8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4070b30 con 0x7f1ed8004040 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef406b450 con 0x7f1ed8004db0 2024-09-13T18:47:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800bbc0 con 0x7f1ef40b2d80 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ed8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2a00700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ed8003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef3400700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ed8004db0 0x7f1ed8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 -- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 msgr2=0x7f1ed8003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ed8003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 -- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ed8004db0 msgr2=0x7f1ed8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ed8004db0 0x7f1ed8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 -- 172.21.15.81:0/2549332344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80035d0 con 0x7f1ed8004040 2024-09-13T18:47:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2a00700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef40b2d80 0x7f1ed8003ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef2000700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ed8004870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c320 tx=0x7f1ed80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7401d216f70a3ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc007c30 con 0x7f1ed8004040 2024-09-13T18:47:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1edc00ce80 con 0x7f1ed8004040 2024-09-13T18:47:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.194+0000 7f1ef1600700 1 -- 172.21.15.81:0/2549332344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1edc005bc0 con 0x7f1ed8004040 2024-09-13T18:47:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 -- 172.21.15.81:0/2549332344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 msgr2=0x7f1ed8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/2549332344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ed8004870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00c320 tx=0x7f1ed80058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3400700 1 -- 172.21.15.81:0/2549332344 reap_dead start 2024-09-13T18:47:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 -- 172.21.15.81:0/2549332344 shutdown_connections 2024-09-13T18:47:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 -- 172.21.15.81:0/2549332344 >> 172.21.15.81:0/2549332344 conn(0x7f1ef40b0c40 msgr2=0x7f1ef406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 -- 172.21.15.81:0/2549332344 shutdown_connections 2024-09-13T18:47:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 -- 172.21.15.81:0/2549332344 wait complete. 2024-09-13T18:47:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 Processor -- start 2024-09-13T18:47:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.198+0000 7f1ef3e00700 1 -- start start 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ef4158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef4155e90 0x7f1ef414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef4159a70 0x7f1ef415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef414ef80 con 0x7f1ed8004040 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef415a5a0 con 0x7f1ef4155e90 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef415a2c0 con 0x7f1ef4159a70 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ef4158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ef4158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47586/0 (socket says 172.21.15.81:47586) 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 -- 172.21.15.81:0/1795853506 learned_addr learned my addr 172.21.15.81:0/1795853506 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3400700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef4159a70 0x7f1ef415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2000700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef4155e90 0x7f1ef414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 -- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef4159a70 msgr2=0x7f1ef415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef4159a70 0x7f1ef415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 -- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef4155e90 msgr2=0x7f1ef414ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef4155e90 0x7f1ef414ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 -- 172.21.15.81:0/1795853506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef4162040 con 0x7f1ed8004040 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef2a00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ef4158af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40118d0 tx=0x7f1ee4011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4004220 con 0x7f1ed8004040 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4004380 con 0x7f1ed8004040 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef4162320 con 0x7f1ed8004040 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40036c0 con 0x7f1ed8004040 2024-09-13T18:47:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.202+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef4159ef0 con 0x7f1ed8004040 2024-09-13T18:47:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.206+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef4161490 con 0x7f1ed8004040 2024-09-13T18:47:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.206+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ee4003820 con 0x7f1ed8004040 2024-09-13T18:47:33.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.210+0000 7f1eeaa00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ed0066760 0x7f1ed0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.210+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ee4084970 con 0x7f1ed8004040 2024-09-13T18:47:33.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.210+0000 7f1ef2000700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ed0066760 0x7f1ed0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.210+0000 7f1ef2000700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ed0066760 0x7f1ed0068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1edc000c00 tx=0x7f1edc007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.214+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ee40519e0 con 0x7f1ed8004040 2024-09-13T18:47:33.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.398+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ef406d420 con 0x7f1ed8004040 2024-09-13T18:47:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.398+0000 7f1eeaa00700 1 -- 172.21.15.81:0/1795853506 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f1ee4022090 con 0x7f1ed8004040 2024-09-13T18:47:33.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:33.410 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ed0066760 msgr2=0x7f1ed0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ed0066760 0x7f1ed0068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1edc000c00 tx=0x7f1edc007000 comp rx=0 tx=0).stop 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 msgr2=0x7f1ef4158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ef4158af0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1ee40118d0 tx=0x7f1ee4011c90 comp rx=0 tx=0).stop 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 shutdown_connections 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ed0066760 0x7f1ed0068c20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef4159a70 0x7f1ef415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef4155e90 0x7f1ef414ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 --2- 172.21.15.81:0/1795853506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ed8004040 0x7f1ef4158af0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 >> 172.21.15.81:0/1795853506 conn(0x7f1ef40b0c40 msgr2=0x7f1ef415ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 shutdown_connections 2024-09-13T18:47:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.402+0000 7f1ef3e00700 1 -- 172.21.15.81:0/1795853506 wait complete. 2024-09-13T18:47:33.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.610+0000 7fbe70a00700 1 Processor -- start 2024-09-13T18:47:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.610+0000 7fbe70a00700 1 -- start start 2024-09-13T18:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe70a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 0x7fbe6c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe70a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c06b940 con 0x7fbe6c0b1f50 2024-09-13T18:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe70a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c15e6b0 con 0x7fbe6c15a7e0 2024-09-13T18:47:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe70a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15e990 con 0x7fbe6c15abc0 2024-09-13T18:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe6c0b1f50 0x7fbe6c0cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43692/0 (socket says 172.21.15.81:43692) 2024-09-13T18:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69e00700 1 -- 172.21.15.81:0/4004833832 learned_addr learned my addr 172.21.15.81:0/4004833832 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe6b200700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 0x7fbe6c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072685096 0 0) 0x7fbe6c06b940 con 0x7fbe6c0b1f50 2024-09-13T18:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe500035d0 con 0x7fbe6c0b1f50 2024-09-13T18:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264891664 0 0) 0x7fbe6c15e6b0 con 0x7fbe6c15a7e0 2024-09-13T18:47:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c06b940 con 0x7fbe6c15a7e0 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596082629 0 0) 0x7fbe500035d0 con 0x7fbe6c0b1f50 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 msgr2=0x7fbe6c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 0x7fbe6c0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 >> v1:172.21.15.178:6789/0 conn(0x7fbe6c15a7e0 legacy=0x7fbe6c0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c15ec70 con 0x7fbe6c0b1f50 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fbe58001670 con 0x7fbe6c0b1f50 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 >> v1:172.21.15.81:6789/0 conn(0x7fbe6c0b1f50 legacy=0x7fbe6c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 0x7fbe50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe500051a0 0x7fbe50003810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe50003d50 0x7fbe500041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15e990 con 0x7fbe50003d50 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50010050 con 0x7fbe500051a0 2024-09-13T18:47:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50010210 con 0x7fbe6c15abc0 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe6b200700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe50003d50 0x7fbe500041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.614+0000 7fbe6a800700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 0x7fbe50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe69e00700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe500051a0 0x7fbe50003810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 -- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 msgr2=0x7fbe50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c15abc0 0x7fbe50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 -- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe500051a0 msgr2=0x7fbe50003810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe500051a0 0x7fbe50003810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 -- 172.21.15.81:0/4004833832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500035d0 con 0x7fbe50003d50 2024-09-13T18:47:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe69e00700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe500051a0 0x7fbe50003810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe50003d50 0x7fbe500041d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009f90 tx=0x7fbe500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54d6788045e5311 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400ec30 con 0x7fbe50003d50 2024-09-13T18:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6400f040 con 0x7fbe50003d50 2024-09-13T18:47:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe69400700 1 -- 172.21.15.81:0/4004833832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64014480 con 0x7fbe50003d50 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe70a00700 1 -- 172.21.15.81:0/4004833832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe50003d50 msgr2=0x7fbe500041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe70a00700 1 --2- 172.21.15.81:0/4004833832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe50003d50 0x7fbe500041d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009f90 tx=0x7fbe500058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe6b200700 1 -- 172.21.15.81:0/4004833832 reap_dead start 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe70a00700 1 -- 172.21.15.81:0/4004833832 shutdown_connections 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe70a00700 1 -- 172.21.15.81:0/4004833832 >> 172.21.15.81:0/4004833832 conn(0x7fbe6c06cb90 msgr2=0x7fbe6c06cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe70a00700 1 -- 172.21.15.81:0/4004833832 shutdown_connections 2024-09-13T18:47:33.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.618+0000 7fbe70a00700 1 -- 172.21.15.81:0/4004833832 wait complete. 2024-09-13T18:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 Processor -- start 2024-09-13T18:47:33.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 -- start start 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe50003d50 0x7fbe6c158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c157960 0x7fbe6c14e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 0x7fbe6c15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c1ee5f0 con 0x7fbe6c15cc60 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c15d620 con 0x7fbe50003d50 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe70a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c159a90 con 0x7fbe6c157960 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe6b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 0x7fbe6c15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe6b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 0x7fbe6c15d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47590/0 (socket says 172.21.15.81:47590) 2024-09-13T18:47:33.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.622+0000 7fbe6b200700 1 -- 172.21.15.81:0/3094634200 learned_addr learned my addr 172.21.15.81:0/3094634200 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe69e00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c157960 0x7fbe6c14e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6a800700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe50003d50 0x7fbe6c158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6b200700 1 -- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c157960 msgr2=0x7fbe6c14e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6b200700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c157960 0x7fbe6c14e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6b200700 1 -- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe50003d50 msgr2=0x7fbe6c158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6b200700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe50003d50 0x7fbe6c158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6b200700 1 -- 172.21.15.81:0/3094634200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c158f10 con 0x7fbe6c15cc60 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6a800700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe50003d50 0x7fbe6c158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe69e00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c157960 0x7fbe6c14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe6b200700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 0x7fbe6c15d0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe64016000 tx=0x7fbe64009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64007000 con 0x7fbe6c15cc60 2024-09-13T18:47:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64003e50 con 0x7fbe6c15cc60 2024-09-13T18:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64014b30 con 0x7fbe6c15cc60 2024-09-13T18:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c1591f0 con 0x7fbe6c15cc60 2024-09-13T18:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c1597b0 con 0x7fbe6c15cc60 2024-09-13T18:47:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6c15e6b0 con 0x7fbe6c15cc60 2024-09-13T18:47:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.626+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe64023020 con 0x7fbe6c15cc60 2024-09-13T18:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.630+0000 7fbe62a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe4c066730 0x7fbe4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.630+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe64085910 con 0x7fbe6c15cc60 2024-09-13T18:47:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.630+0000 7fbe6a800700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe4c066730 0x7fbe4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.630+0000 7fbe6a800700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe4c066730 0x7fbe4c068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0010e0 tx=0x7fbe5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.634+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbe64052aa0 con 0x7fbe6c15cc60 2024-09-13T18:47:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:33.858+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbe6c1ee730 con 0x7fbe6c15cc60 2024-09-13T18:47:34.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.554+0000 7fbe62a00700 1 -- 172.21.15.81:0/3094634200 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbe640560c0 con 0x7fbe6c15cc60 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe4c066730 msgr2=0x7fbe4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe4c066730 0x7fbe4c068bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0010e0 tx=0x7fbe5c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 msgr2=0x7fbe6c15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 0x7fbe6c15d0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe64016000 tx=0x7fbe64009750 comp rx=0 tx=0).stop 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 shutdown_connections 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe4c066730 0x7fbe4c068bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c15cc60 0x7fbe6c15d0e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe6c157960 0x7fbe6c14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 --2- 172.21.15.81:0/3094634200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe50003d50 0x7fbe6c158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 >> 172.21.15.81:0/3094634200 conn(0x7fbe6c06cb90 msgr2=0x7fbe6c0af430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 shutdown_connections 2024-09-13T18:47:34.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.558+0000 7fbe70a00700 1 -- 172.21.15.81:0/3094634200 wait complete. 2024-09-13T18:47:34.592 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-13T18:47:34.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:47:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.766+0000 7f98c1e00700 1 Processor -- start 2024-09-13T18:47:34.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.766+0000 7f98c1e00700 1 -- start start 2024-09-13T18:47:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98c1e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f98bc144330 0x7f98bc0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98c1e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc06d760 0x7f98bc0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98c1e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc06bcf0 con 0x7f98bc144710 2024-09-13T18:47:34.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98c1e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98bc0cce10 con 0x7f98bc144330 2024-09-13T18:47:34.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98c1e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc06cb50 con 0x7f98bc06d760 2024-09-13T18:47:34.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98bb400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98bc144710 0x7f98bc15e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43708/0 (socket says 172.21.15.81:43708) 2024-09-13T18:47:34.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98bb400700 1 -- 172.21.15.81:0/104939197 learned_addr learned my addr 172.21.15.81:0/104939197 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:34.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98baa00700 1 --2- 172.21.15.81:0/104939197 >> v2:172.21.15.178:3300/0 conn(0x7f98bc144330 0x7f98bc0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98ba000700 1 --2- 172.21.15.81:0/104939197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc06d760 0x7f98bc0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98b9600700 1 -- 172.21.15.81:0/104939197 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103594389 0 0) 0x7f98bc06bcf0 con 0x7f98bc144710 2024-09-13T18:47:34.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98ba000700 1 -- 172.21.15.81:0/104939197 >> v2:172.21.15.178:3300/0 conn(0x7f98bc144330 msgr2=0x7f98bc0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:34.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98ba000700 1 --2- 172.21.15.81:0/104939197 >> v2:172.21.15.178:3300/0 conn(0x7f98bc144330 0x7f98bc0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98ba000700 1 -- 172.21.15.81:0/104939197 >> v1:172.21.15.81:6789/0 conn(0x7f98bc144710 legacy=0x7f98bc15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98ba000700 1 -- 172.21.15.81:0/104939197 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc0cf4b0 con 0x7f98bc06d760 2024-09-13T18:47:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98ba000700 1 --2- 172.21.15.81:0/104939197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc06d760 0x7f98bc0b35a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009850 tx=0x7f98a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940162d9fdfe8460 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98b9600700 1 -- 172.21.15.81:0/104939197 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8011830 con 0x7f98bc06d760 2024-09-13T18:47:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98b9600700 1 -- 172.21.15.81:0/104939197 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a8011990 con 0x7f98bc06d760 2024-09-13T18:47:34.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.770+0000 7f98b9600700 1 -- 172.21.15.81:0/104939197 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a8011d40 con 0x7f98bc06d760 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- 172.21.15.81:0/104939197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc06d760 msgr2=0x7f98bc0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 --2- 172.21.15.81:0/104939197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc06d760 0x7f98bc0b35a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009850 tx=0x7f98a8009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- 172.21.15.81:0/104939197 shutdown_connections 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 --2- 172.21.15.81:0/104939197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc06d760 0x7f98bc0b35a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 --2- 172.21.15.81:0/104939197 >> v2:172.21.15.178:3300/0 conn(0x7f98bc144330 0x7f98bc0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- 172.21.15.81:0/104939197 >> 172.21.15.81:0/104939197 conn(0x7f98bc06a570 msgr2=0x7f98bc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- 172.21.15.81:0/104939197 shutdown_connections 2024-09-13T18:47:34.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- 172.21.15.81:0/104939197 wait complete. 2024-09-13T18:47:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 Processor -- start 2024-09-13T18:47:34.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- start start 2024-09-13T18:47:34.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 0x7f98bc1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc144330 0x7f98bc0ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98bc154ce0 0x7f98bc0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc152560 con 0x7f98bc06d760 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc152840 con 0x7f98bc154ce0 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.774+0000 7f98c1e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc152b20 con 0x7f98bc144330 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 0x7f98bc1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 0x7f98bc1547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47594/0 (socket says 172.21.15.81:47594) 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 -- 172.21.15.81:0/9594413 learned_addr learned my addr 172.21.15.81:0/9594413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98ba000700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc144330 0x7f98bc0ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98bb400700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98bc154ce0 0x7f98bc0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 -- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc144330 msgr2=0x7f98bc0ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc144330 0x7f98bc0ae560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 -- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98bc154ce0 msgr2=0x7f98bc0aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98bc154ce0 0x7f98bc0aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 -- 172.21.15.81:0/9594413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a80094b0 con 0x7f98bc06d760 2024-09-13T18:47:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98baa00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 0x7f98bc1547a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00e9d0 tx=0x7f98ac00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac009720 con 0x7f98bc06d760 2024-09-13T18:47:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac00c850 con 0x7f98bc06d760 2024-09-13T18:47:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc152e00 con 0x7f98bc06d760 2024-09-13T18:47:34.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00cbc0 con 0x7f98bc06d760 2024-09-13T18:47:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98bc152010 con 0x7f98bc06d760 2024-09-13T18:47:34.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.778+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98bc0b2c00 con 0x7f98bc06d760 2024-09-13T18:47:34.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.782+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98ac00cd20 con 0x7f98bc06d760 2024-09-13T18:47:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.782+0000 7f98b3400700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f989c066730 0x7f989c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.782+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98ac084680 con 0x7f98bc06d760 2024-09-13T18:47:34.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.782+0000 7f98ba000700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f989c066730 0x7f989c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.786+0000 7f98ba000700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f989c066730 0x7f989c068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009ba0 tx=0x7f98a8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:34.790+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98ac051660 con 0x7f98bc06d760 2024-09-13T18:47:35.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.010+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f98bc152290 con 0x7f98bc06d760 2024-09-13T18:47:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.566+0000 7f98b3400700 1 -- 172.21.15.81:0/9594413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98ac054c80 con 0x7f98bc06d760 2024-09-13T18:47:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f989c066730 msgr2=0x7f989c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f989c066730 0x7f989c068bf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009ba0 tx=0x7f98a8008030 comp rx=0 tx=0).stop 2024-09-13T18:47:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 msgr2=0x7f98bc1547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 0x7f98bc1547a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00e9d0 tx=0x7f98ac00ed90 comp rx=0 tx=0).stop 2024-09-13T18:47:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 shutdown_connections 2024-09-13T18:47:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f989c066730 0x7f989c068bf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98bc154ce0 0x7f98bc0aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98bc144330 0x7f98bc0ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 --2- 172.21.15.81:0/9594413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98bc06d760 0x7f98bc1547a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 >> 172.21.15.81:0/9594413 conn(0x7f98bc06a570 msgr2=0x7f98bc15dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 shutdown_connections 2024-09-13T18:47:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.570+0000 7f98c1e00700 1 -- 172.21.15.81:0/9594413 wait complete. 2024-09-13T18:47:35.602 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:47:35.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.754+0000 7ff0c9800700 1 Processor -- start 2024-09-13T18:47:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.754+0000 7ff0c9800700 1 -- start start 2024-09-13T18:47:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c9800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0c40cc6f0 0x7ff0c415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c9800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40ccb40 con 0x7ff0c40cb020 2024-09-13T18:47:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c9800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40b2ad0 con 0x7ff0c406aaa0 2024-09-13T18:47:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c9800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c415b960 con 0x7ff0c40cc6f0 2024-09-13T18:47:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c3e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff0c40cb020 0x7ff0c415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43722/0 (socket says 172.21.15.81:43722) 2024-09-13T18:47:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c3e00700 1 -- 172.21.15.81:0/1779341565 learned_addr learned my addr 172.21.15.81:0/1779341565 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c3400700 1 --2- 172.21.15.81:0/1779341565 >> v2:172.21.15.178:3300/0 conn(0x7ff0c40cc6f0 0x7ff0c415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c2a00700 1 -- 172.21.15.81:0/1779341565 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879096651 0 0) 0x7ff0c40ccb40 con 0x7ff0c40cb020 2024-09-13T18:47:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c2a00700 1 -- 172.21.15.81:0/1779341565 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0a80035d0 con 0x7ff0c40cb020 2024-09-13T18:47:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c3400700 1 -- 172.21.15.81:0/1779341565 >> v1:172.21.15.178:6789/0 conn(0x7ff0c406aaa0 legacy=0x7ff0c40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c3400700 1 -- 172.21.15.81:0/1779341565 >> v1:172.21.15.81:6789/0 conn(0x7ff0c40cb020 legacy=0x7ff0c415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.758+0000 7ff0c3400700 1 -- 172.21.15.81:0/1779341565 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c415bc40 con 0x7ff0c40cc6f0 2024-09-13T18:47:35.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c3400700 1 --2- 172.21.15.81:0/1779341565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c40cc6f0 0x7ff0c415b0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009850 tx=0x7ff0b0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c5f58099d9fd24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c2a00700 1 -- 172.21.15.81:0/1779341565 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0011830 con 0x7ff0c40cc6f0 2024-09-13T18:47:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c2a00700 1 -- 172.21.15.81:0/1779341565 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0011990 con 0x7ff0c40cc6f0 2024-09-13T18:47:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c2a00700 1 -- 172.21.15.81:0/1779341565 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0011d40 con 0x7ff0c40cc6f0 2024-09-13T18:47:35.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 -- 172.21.15.81:0/1779341565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c40cc6f0 msgr2=0x7ff0c415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 --2- 172.21.15.81:0/1779341565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c40cc6f0 0x7ff0c415b0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0009850 tx=0x7ff0b0009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 -- 172.21.15.81:0/1779341565 shutdown_connections 2024-09-13T18:47:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 --2- 172.21.15.81:0/1779341565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c40cc6f0 0x7ff0c415b0e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 -- 172.21.15.81:0/1779341565 >> 172.21.15.81:0/1779341565 conn(0x7ff0c40b0c40 msgr2=0x7ff0c406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 -- 172.21.15.81:0/1779341565 shutdown_connections 2024-09-13T18:47:35.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.762+0000 7ff0c9800700 1 -- 172.21.15.81:0/1779341565 wait complete. 2024-09-13T18:47:35.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 Processor -- start 2024-09-13T18:47:35.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 -- start start 2024-09-13T18:47:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c406aaa0 0x7ff0c40c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 0x7ff0c41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0c40cc6f0 0x7ff0c4149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40c9630 con 0x7ff0c40cb020 2024-09-13T18:47:35.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40c86a0 con 0x7ff0c406aaa0 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c4158130 con 0x7ff0c40cc6f0 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 0x7ff0c41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 0x7ff0c41460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47598/0 (socket says 172.21.15.81:47598) 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 -- 172.21.15.81:0/12088216 learned_addr learned my addr 172.21.15.81:0/12088216 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3e00700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c406aaa0 0x7ff0c40c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c8e00700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0c40cc6f0 0x7ff0c4149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 -- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0c40cc6f0 msgr2=0x7ff0c4149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0c40cc6f0 0x7ff0c4149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 -- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c406aaa0 msgr2=0x7ff0c40c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c406aaa0 0x7ff0c40c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 -- 172.21.15.81:0/12088216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b00094b0 con 0x7ff0c40cb020 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c8e00700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0c40cc6f0 0x7ff0c4149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c3400700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 0x7ff0c41460a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0014040 tx=0x7ff0b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0019ab0 con 0x7ff0c40cb020 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b001e070 con 0x7ff0c40cb020 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c4158410 con 0x7ff0c40cb020 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0019e50 con 0x7ff0c40cb020 2024-09-13T18:47:35.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.766+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c40c8bd0 con 0x7ff0c40cb020 2024-09-13T18:47:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.770+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c40c8dc0 con 0x7ff0c40cb020 2024-09-13T18:47:35.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.770+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0b002d450 con 0x7ff0c40cb020 2024-09-13T18:47:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.770+0000 7ff0bbe00700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0a4066730 0x7ff0a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.770+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0b0085540 con 0x7ff0c40cb020 2024-09-13T18:47:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.774+0000 7ff0c3e00700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0a4066730 0x7ff0a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.774+0000 7ff0c3e00700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0a4066730 0x7ff0a4068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40011e0 tx=0x7ff0b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:35.778+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0b00525b0 con 0x7ff0c40cb020 2024-09-13T18:47:36.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.014+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0c406cf20 con 0x7ff0c40cb020 2024-09-13T18:47:36.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.014+0000 7ff0bbe00700 1 -- 172.21.15.81:0/12088216 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7ff0b0055bd0 con 0x7ff0c40cb020 2024-09-13T18:47:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:36.024 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:47:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0a4066730 msgr2=0x7ff0a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0a4066730 0x7ff0a4068bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff0b40011e0 tx=0x7ff0b4009040 comp rx=0 tx=0).stop 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 msgr2=0x7ff0c41460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 0x7ff0c41460a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0014040 tx=0x7ff0b0004770 comp rx=0 tx=0).stop 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 shutdown_connections 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0a4066730 0x7ff0a4068bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0c40cc6f0 0x7ff0c4149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0c40cb020 0x7ff0c41460a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 --2- 172.21.15.81:0/12088216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0c406aaa0 0x7ff0c40c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 >> 172.21.15.81:0/12088216 conn(0x7ff0c40b0c40 msgr2=0x7ff0c40b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 shutdown_connections 2024-09-13T18:47:36.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.018+0000 7ff0c9800700 1 -- 172.21.15.81:0/12088216 wait complete. 2024-09-13T18:47:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:47:36.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.222+0000 7fdf92000700 1 Processor -- start 2024-09-13T18:47:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf92000700 1 -- start start 2024-09-13T18:47:36.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf92000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf8c0cd430 0x7fdf8c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf92000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdf8c0b2a80 0x7fdf8c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf92000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c0d1800 con 0x7fdf8c15e070 2024-09-13T18:47:36.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf92000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c15e450 con 0x7fdf8c0b2a80 2024-09-13T18:47:36.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf92000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0b2e60 con 0x7fdf8c0cd430 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf90c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdf8c15e070 0x7fdf8c0d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43738/0 (socket says 172.21.15.81:43738) 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf90c00700 1 -- 172.21.15.81:0/3196663226 learned_addr learned my addr 172.21.15.81:0/3196663226 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf91600700 1 --2- 172.21.15.81:0/3196663226 >> v2:172.21.15.81:3300/0 conn(0x7fdf8c0b2a80 0x7fdf8c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.226+0000 7fdf8be00700 1 --2- 172.21.15.81:0/3196663226 >> v2:172.21.15.178:3300/0 conn(0x7fdf8c0cd430 0x7fdf8c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf8b400700 1 -- 172.21.15.81:0/3196663226 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012939958 0 0) 0x7fdf8c0d1800 con 0x7fdf8c15e070 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf8b400700 1 -- 172.21.15.81:0/3196663226 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf740035d0 con 0x7fdf8c15e070 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf91600700 1 -- 172.21.15.81:0/3196663226 >> v2:172.21.15.178:3300/0 conn(0x7fdf8c0cd430 msgr2=0x7fdf8c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf91600700 1 --2- 172.21.15.81:0/3196663226 >> v2:172.21.15.178:3300/0 conn(0x7fdf8c0cd430 0x7fdf8c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf91600700 1 -- 172.21.15.81:0/3196663226 >> v1:172.21.15.81:6789/0 conn(0x7fdf8c15e070 legacy=0x7fdf8c0d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf91600700 1 -- 172.21.15.81:0/3196663226 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0d0050 con 0x7fdf8c0b2a80 2024-09-13T18:47:36.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf91600700 1 --2- 172.21.15.81:0/3196663226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c0b2a80 0x7fdf8c0b38b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0ce350 tx=0x7fdf8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f598b2e821b43d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf8b400700 1 -- 172.21.15.81:0/3196663226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8400e070 con 0x7fdf8c0b2a80 2024-09-13T18:47:36.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf8b400700 1 -- 172.21.15.81:0/3196663226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8400bb20 con 0x7fdf8c0b2a80 2024-09-13T18:47:36.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf8b400700 1 -- 172.21.15.81:0/3196663226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84012430 con 0x7fdf8c0b2a80 2024-09-13T18:47:36.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 -- 172.21.15.81:0/3196663226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c0b2a80 msgr2=0x7fdf8c0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 --2- 172.21.15.81:0/3196663226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c0b2a80 0x7fdf8c0b38b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c0ce350 tx=0x7fdf8400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 -- 172.21.15.81:0/3196663226 shutdown_connections 2024-09-13T18:47:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 --2- 172.21.15.81:0/3196663226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c0b2a80 0x7fdf8c0b38b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 --2- 172.21.15.81:0/3196663226 >> v2:172.21.15.178:3300/0 conn(0x7fdf8c0cd430 0x7fdf8c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 -- 172.21.15.81:0/3196663226 >> 172.21.15.81:0/3196663226 conn(0x7fdf8c071f00 msgr2=0x7fdf8c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 -- 172.21.15.81:0/3196663226 shutdown_connections 2024-09-13T18:47:36.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.230+0000 7fdf92000700 1 -- 172.21.15.81:0/3196663226 wait complete. 2024-09-13T18:47:36.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 Processor -- start 2024-09-13T18:47:36.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 -- start start 2024-09-13T18:47:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf8c0b2a80 0x7fdf8c06be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf8c0cd430 0x7fdf8c1f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 0x7fdf8c0acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1f29c0 con 0x7fdf8c15e070 2024-09-13T18:47:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1f2ca0 con 0x7fdf8c0cd430 2024-09-13T18:47:36.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf92000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1f2f80 con 0x7fdf8c0b2a80 2024-09-13T18:47:36.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf91600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 0x7fdf8c0acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf91600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 0x7fdf8c0acd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47602/0 (socket says 172.21.15.81:47602) 2024-09-13T18:47:36.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.234+0000 7fdf91600700 1 -- 172.21.15.81:0/1066578859 learned_addr learned my addr 172.21.15.81:0/1066578859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf90c00700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf8c0b2a80 0x7fdf8c06be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf8be00700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf8c0cd430 0x7fdf8c1f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf91600700 1 -- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf8c0b2a80 msgr2=0x7fdf8c06be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf91600700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf8c0b2a80 0x7fdf8c06be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf91600700 1 -- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf8c0cd430 msgr2=0x7fdf8c1f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf91600700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf8c0cd430 0x7fdf8c1f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf91600700 1 -- 172.21.15.81:0/1066578859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf84009a70 con 0x7fdf8c15e070 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf90c00700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf8c0b2a80 0x7fdf8c06be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf91600700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 0x7fdf8c0acd30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf84014040 tx=0x7fdf84004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84012430 con 0x7fdf8c15e070 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c1f5a30 con 0x7fdf8c15e070 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf84020070 con 0x7fdf8c15e070 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84004280 con 0x7fdf8c15e070 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c1f6490 con 0x7fdf8c15e070 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.238+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c1f5890 con 0x7fdf8c15e070 2024-09-13T18:47:36.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.242+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf840043e0 con 0x7fdf8c15e070 2024-09-13T18:47:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.242+0000 7fdf88c00700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf6c066730 0x7fdf6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.242+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf84022070 con 0x7fdf8c15e070 2024-09-13T18:47:36.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.242+0000 7fdf90c00700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf6c066730 0x7fdf6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.242+0000 7fdf90c00700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf6c066730 0x7fdf6c068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf800011e0 tx=0x7fdf80009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.250+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf840b7db0 con 0x7fdf8c15e070 2024-09-13T18:47:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.438+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf8c1f5c20 con 0x7fdf8c15e070 2024-09-13T18:47:36.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.438+0000 7fdf88c00700 1 -- 172.21.15.81:0/1066578859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fdf8c1f5890 con 0x7fdf8c15e070 2024-09-13T18:47:36.449 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:36.449 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:36.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf6c066730 msgr2=0x7fdf6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf6c066730 0x7fdf6c068bf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdf800011e0 tx=0x7fdf80009040 comp rx=0 tx=0).stop 2024-09-13T18:47:36.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 msgr2=0x7fdf8c0acd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 0x7fdf8c0acd30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdf84014040 tx=0x7fdf84004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 shutdown_connections 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf6c066730 0x7fdf6c068bf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf8c15e070 0x7fdf8c0acd30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf8c0cd430 0x7fdf8c1f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 --2- 172.21.15.81:0/1066578859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf8c0b2a80 0x7fdf8c06be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 >> 172.21.15.81:0/1066578859 conn(0x7fdf8c071f00 msgr2=0x7fdf8c0ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 shutdown_connections 2024-09-13T18:47:36.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.442+0000 7fdf92000700 1 -- 172.21.15.81:0/1066578859 wait complete. 2024-09-13T18:47:36.474 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:47:36.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.634+0000 7ff236200700 1 Processor -- start 2024-09-13T18:47:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.634+0000 7ff236200700 1 -- start start 2024-09-13T18:47:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.634+0000 7ff236200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff23015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.634+0000 7ff236200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff23006aaa0 0x7ff23006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.634+0000 7ff236200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2300b2ad0 con 0x7ff2300cb020 2024-09-13T18:47:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.634+0000 7ff236200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006b450 con 0x7ff23006aaa0 2024-09-13T18:47:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300ccb10 con 0x7ff2300cc6f0 2024-09-13T18:47:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff234e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2300cb020 0x7ff23015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47034/0 (socket says 172.21.15.81:47034) 2024-09-13T18:47:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff234e00700 1 -- 172.21.15.81:0/790775535 learned_addr learned my addr 172.21.15.81:0/790775535 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff235800700 1 --2- 172.21.15.81:0/790775535 >> v2:172.21.15.178:3300/0 conn(0x7ff23006aaa0 0x7ff23006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff22fe00700 1 --2- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff23015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff22f400700 1 -- 172.21.15.81:0/790775535 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869537004 0 0) 0x7ff2300b2ad0 con 0x7ff2300cb020 2024-09-13T18:47:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff22f400700 1 -- 172.21.15.81:0/790775535 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2180035d0 con 0x7ff2300cb020 2024-09-13T18:47:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff235800700 1 -- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 msgr2=0x7ff23015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff235800700 1 --2- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff23015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff235800700 1 -- 172.21.15.81:0/790775535 >> v1:172.21.15.81:6789/0 conn(0x7ff2300cb020 legacy=0x7ff23015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff235800700 1 -- 172.21.15.81:0/790775535 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23015b960 con 0x7ff23006aaa0 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff235800700 1 --2- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23006aaa0 0x7ff23006af10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff228009d90 tx=0x7ff22800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=282dbe0e857b0834 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff22f400700 1 -- 172.21.15.81:0/790775535 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22800e070 con 0x7ff23006aaa0 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff22f400700 1 -- 172.21.15.81:0/790775535 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22800bb20 con 0x7ff23006aaa0 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff22f400700 1 -- 172.21.15.81:0/790775535 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228012430 con 0x7ff23006aaa0 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 -- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23006aaa0 msgr2=0x7ff23006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 --2- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23006aaa0 0x7ff23006af10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff228009d90 tx=0x7ff22800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 -- 172.21.15.81:0/790775535 shutdown_connections 2024-09-13T18:47:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 --2- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23006aaa0 0x7ff23006af10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 --2- 172.21.15.81:0/790775535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff23015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 -- 172.21.15.81:0/790775535 >> 172.21.15.81:0/790775535 conn(0x7ff2300b0c40 msgr2=0x7ff23006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 -- 172.21.15.81:0/790775535 shutdown_connections 2024-09-13T18:47:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.638+0000 7ff236200700 1 -- 172.21.15.81:0/790775535 wait complete. 2024-09-13T18:47:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 Processor -- start 2024-09-13T18:47:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 -- start start 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 0x7ff230144070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2300cb020 0x7ff230156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff230159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230155760 con 0x7ff23006aaa0 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230156770 con 0x7ff2300cb020 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff236200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301559b0 con 0x7ff2300cc6f0 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 0x7ff230144070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 0x7ff230144070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46938/0 (socket says 172.21.15.81:46938) 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 -- 172.21.15.81:0/754994165 learned_addr learned my addr 172.21.15.81:0/754994165 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff235800700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff230159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff22fe00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2300cb020 0x7ff230156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 -- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 msgr2=0x7ff230159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff230159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 -- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2300cb020 msgr2=0x7ff230156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2300cb020 0x7ff230156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.642+0000 7ff234e00700 1 -- 172.21.15.81:0/754994165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009a70 con 0x7ff23006aaa0 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff235800700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff230159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff234e00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 0x7ff230144070 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c700 tx=0x7ff22400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224005d90 con 0x7ff23006aaa0 2024-09-13T18:47:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2240070d0 con 0x7ff23006aaa0 2024-09-13T18:47:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff230155c90 con 0x7ff23006aaa0 2024-09-13T18:47:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224007480 con 0x7ff23006aaa0 2024-09-13T18:47:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff230156250 con 0x7ff23006aaa0 2024-09-13T18:47:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.646+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2300cb400 con 0x7ff23006aaa0 2024-09-13T18:47:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.650+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2240075e0 con 0x7ff23006aaa0 2024-09-13T18:47:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.650+0000 7ff22cc00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff210066760 0x7ff210068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.650+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff224083ab0 con 0x7ff23006aaa0 2024-09-13T18:47:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.650+0000 7ff22fe00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff210066760 0x7ff210068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.650+0000 7ff22fe00700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff210066760 0x7ff210068c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff230154df0 tx=0x7ff21c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.658+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff224050aa0 con 0x7ff23006aaa0 2024-09-13T18:47:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.842+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2300b2d20 con 0x7ff210066760 2024-09-13T18:47:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.862+0000 7ff22cc00700 1 -- 172.21.15.81:0/754994165 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345119 (secure 0 0 0) 0x7ff21c011720 con 0x7ff210066760 2024-09-13T18:47:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:36.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff210066760 msgr2=0x7ff210068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff210066760 0x7ff210068c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff230154df0 tx=0x7ff21c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:36.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 msgr2=0x7ff230144070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 0x7ff230144070 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c700 tx=0x7ff22400cac0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 shutdown_connections 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff210066760 0x7ff210068c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2300cc6f0 0x7ff230159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2300cb020 0x7ff230156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 --2- 172.21.15.81:0/754994165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23006aaa0 0x7ff230144070 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 >> 172.21.15.81:0/754994165 conn(0x7ff2300b0c40 msgr2=0x7ff23006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 shutdown_connections 2024-09-13T18:47:36.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:36.870+0000 7ff236200700 1 -- 172.21.15.81:0/754994165 wait complete. 2024-09-13T18:47:36.882 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:47:36.903 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-09-13T18:47:34.974586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227568,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747152,"statfs":{"total":773094113280,"available":772861083648,"internally_reserved":0,"allocated":3284992,"data_stored":1987880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003849"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491815+0000","last_change":"2024-09-13T18:47:14.995976+0000","last_active":"2024-09-13T18:47:19.491815+0000","last_peered":"2024-09-13T18:47:19.491815+0000","last_clean":"2024-09-13T18:47:19.491815+0000","last_became_active":"2024-09-13T18:47:14.995706+0000","last_became_peered":"2024-09-13T18:47:14.995706+0000","last_unstale":"2024-09-13T18:47:19.491815+0000","last_undegraded":"2024-09-13T18:47:19.491815+0000","last_fullsized":"2024-09-13T18:47:19.491815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:18.193015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487329+0000","last_change":"2024-09-13T18:47:15.484957+0000","last_active":"2024-09-13T18:47:19.487329+0000","last_peered":"2024-09-13T18:47:19.487329+0000","last_clean":"2024-09-13T18:47:19.487329+0000","last_became_active":"2024-09-13T18:47:15.484720+0000","last_became_peered":"2024-09-13T18:47:15.484720+0000","last_unstale":"2024-09-13T18:47:19.487329+0000","last_undegraded":"2024-09-13T18:47:19.487329+0000","last_fullsized":"2024-09-13T18:47:19.487329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961870+0000","last_change":"2024-09-13T18:47:19.593844+0000","last_active":"2024-09-13T18:47:19.961870+0000","last_peered":"2024-09-13T18:47:19.961870+0000","last_clean":"2024-09-13T18:47:19.961870+0000","last_became_active":"2024-09-13T18:47:19.591052+0000","last_became_peered":"2024-09-13T18:47:19.591052+0000","last_unstale":"2024-09-13T18:47:19.961870+0000","last_undegraded":"2024-09-13T18:47:19.961870+0000","last_fullsized":"2024-09-13T18:47:19.961870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:05.476346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487465+0000","last_change":"2024-09-13T18:47:14.991104+0000","last_active":"2024-09-13T18:47:19.487465+0000","last_peered":"2024-09-13T18:47:19.487465+0000","last_clean":"2024-09-13T18:47:19.487465+0000","last_became_active":"2024-09-13T18:47:14.990785+0000","last_became_peered":"2024-09-13T18:47:14.990785+0000","last_unstale":"2024-09-13T18:47:19.487465+0000","last_undegraded":"2024-09-13T18:47:19.487465+0000","last_fullsized":"2024-09-13T18:47:19.487465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.795074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491728+0000","last_change":"2024-09-13T18:47:15.478881+0000","last_active":"2024-09-13T18:47:19.491728+0000","last_peered":"2024-09-13T18:47:19.491728+0000","last_clean":"2024-09-13T18:47:19.491728+0000","last_became_active":"2024-09-13T18:47:15.478630+0000","last_became_peered":"2024-09-13T18:47:15.478630+0000","last_unstale":"2024-09-13T18:47:19.491728+0000","last_undegraded":"2024-09-13T18:47:19.491728+0000","last_fullsized":"2024-09-13T18:47:19.491728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:13.833360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089448+0000","last_change":"2024-09-13T18:47:19.506466+0000","last_active":"2024-09-13T18:47:20.089448+0000","last_peered":"2024-09-13T18:47:20.089448+0000","last_clean":"2024-09-13T18:47:20.089448+0000","last_became_active":"2024-09-13T18:47:19.505998+0000","last_became_peered":"2024-09-13T18:47:19.505998+0000","last_unstale":"2024-09-13T18:47:20.089448+0000","last_undegraded":"2024-09-13T18:47:20.089448+0000","last_fullsized":"2024-09-13T18:47:20.089448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:12.843575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592163+0000","last_change":"2024-09-13T18:47:15.007303+0000","last_active":"2024-09-13T18:47:19.592163+0000","last_peered":"2024-09-13T18:47:19.592163+0000","last_clean":"2024-09-13T18:47:19.592163+0000","last_became_active":"2024-09-13T18:47:15.006847+0000","last_became_peered":"2024-09-13T18:47:15.006847+0000","last_unstale":"2024-09-13T18:47:19.592163+0000","last_undegraded":"2024-09-13T18:47:19.592163+0000","last_fullsized":"2024-09-13T18:47:19.592163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:41.820844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489015+0000","last_change":"2024-09-13T18:47:15.482116+0000","last_active":"2024-09-13T18:47:19.489015+0000","last_peered":"2024-09-13T18:47:19.489015+0000","last_clean":"2024-09-13T18:47:19.489015+0000","last_became_active":"2024-09-13T18:47:15.481869+0000","last_became_peered":"2024-09-13T18:47:15.481869+0000","last_unstale":"2024-09-13T18:47:19.489015+0000","last_undegraded":"2024-09-13T18:47:19.489015+0000","last_fullsized":"2024-09-13T18:47:19.489015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089608+0000","last_change":"2024-09-13T18:47:19.509850+0000","last_active":"2024-09-13T18:47:20.089608+0000","last_peered":"2024-09-13T18:47:20.089608+0000","last_clean":"2024-09-13T18:47:20.089608+0000","last_became_active":"2024-09-13T18:47:19.509444+0000","last_became_peered":"2024-09-13T18:47:19.509444+0000","last_unstale":"2024-09-13T18:47:20.089608+0000","last_undegraded":"2024-09-13T18:47:20.089608+0000","last_fullsized":"2024-09-13T18:47:20.089608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591632+0000","last_change":"2024-09-13T18:47:15.002453+0000","last_active":"2024-09-13T18:47:19.591632+0000","last_peered":"2024-09-13T18:47:19.591632+0000","last_clean":"2024-09-13T18:47:19.591632+0000","last_became_active":"2024-09-13T18:47:15.002127+0000","last_became_peered":"2024-09-13T18:47:15.002127+0000","last_unstale":"2024-09-13T18:47:19.591632+0000","last_undegraded":"2024-09-13T18:47:19.591632+0000","last_fullsized":"2024-09-13T18:47:19.591632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:18.452266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490093+0000","last_change":"2024-09-13T18:47:15.477221+0000","last_active":"2024-09-13T18:47:19.490093+0000","last_peered":"2024-09-13T18:47:19.490093+0000","last_clean":"2024-09-13T18:47:19.490093+0000","last_became_active":"2024-09-13T18:47:15.475771+0000","last_became_peered":"2024-09-13T18:47:15.475771+0000","last_unstale":"2024-09-13T18:47:19.490093+0000","last_undegraded":"2024-09-13T18:47:19.490093+0000","last_fullsized":"2024-09-13T18:47:19.490093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090621+0000","last_change":"2024-09-13T18:47:19.513245+0000","last_active":"2024-09-13T18:47:20.090621+0000","last_peered":"2024-09-13T18:47:20.090621+0000","last_clean":"2024-09-13T18:47:20.090621+0000","last_became_active":"2024-09-13T18:47:19.512719+0000","last_became_peered":"2024-09-13T18:47:19.512719+0000","last_unstale":"2024-09-13T18:47:20.090621+0000","last_undegraded":"2024-09-13T18:47:20.090621+0000","last_fullsized":"2024-09-13T18:47:20.090621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499018+0000","last_change":"2024-09-13T18:47:15.481298+0000","last_active":"2024-09-13T18:47:19.499018+0000","last_peered":"2024-09-13T18:47:19.499018+0000","last_clean":"2024-09-13T18:47:19.499018+0000","last_became_active":"2024-09-13T18:47:15.481041+0000","last_became_peered":"2024-09-13T18:47:15.481041+0000","last_unstale":"2024-09-13T18:47:19.499018+0000","last_undegraded":"2024-09-13T18:47:19.499018+0000","last_fullsized":"2024-09-13T18:47:19.499018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592125+0000","last_change":"2024-09-13T18:47:15.004858+0000","last_active":"2024-09-13T18:47:19.592125+0000","last_peered":"2024-09-13T18:47:19.592125+0000","last_clean":"2024-09-13T18:47:19.592125+0000","last_became_active":"2024-09-13T18:47:15.004589+0000","last_became_peered":"2024-09-13T18:47:15.004589+0000","last_unstale":"2024-09-13T18:47:19.592125+0000","last_undegraded":"2024-09-13T18:47:19.592125+0000","last_fullsized":"2024-09-13T18:47:19.592125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093955+0000","last_change":"2024-09-13T18:47:19.514214+0000","last_active":"2024-09-13T18:47:20.093955+0000","last_peered":"2024-09-13T18:47:20.093955+0000","last_clean":"2024-09-13T18:47:20.093955+0000","last_became_active":"2024-09-13T18:47:19.513786+0000","last_became_peered":"2024-09-13T18:47:19.513786+0000","last_unstale":"2024-09-13T18:47:20.093955+0000","last_undegraded":"2024-09-13T18:47:20.093955+0000","last_fullsized":"2024-09-13T18:47:20.093955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:47.811667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487784+0000","last_change":"2024-09-13T18:47:15.472641+0000","last_active":"2024-09-13T18:47:19.487784+0000","last_peered":"2024-09-13T18:47:19.487784+0000","last_clean":"2024-09-13T18:47:19.487784+0000","last_became_active":"2024-09-13T18:47:15.472397+0000","last_became_peered":"2024-09-13T18:47:15.472397+0000","last_unstale":"2024-09-13T18:47:19.487784+0000","last_undegraded":"2024-09-13T18:47:19.487784+0000","last_fullsized":"2024-09-13T18:47:19.487784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493540+0000","last_change":"2024-09-13T18:47:14.983697+0000","last_active":"2024-09-13T18:47:19.493540+0000","last_peered":"2024-09-13T18:47:19.493540+0000","last_clean":"2024-09-13T18:47:19.493540+0000","last_became_active":"2024-09-13T18:47:14.983443+0000","last_became_peered":"2024-09-13T18:47:14.983443+0000","last_unstale":"2024-09-13T18:47:19.493540+0000","last_undegraded":"2024-09-13T18:47:19.493540+0000","last_fullsized":"2024-09-13T18:47:19.493540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089265+0000","last_change":"2024-09-13T18:47:19.511041+0000","last_active":"2024-09-13T18:47:20.089265+0000","last_peered":"2024-09-13T18:47:20.089265+0000","last_clean":"2024-09-13T18:47:20.089265+0000","last_became_active":"2024-09-13T18:47:19.510682+0000","last_became_peered":"2024-09-13T18:47:19.510682+0000","last_unstale":"2024-09-13T18:47:20.089265+0000","last_undegraded":"2024-09-13T18:47:20.089265+0000","last_fullsized":"2024-09-13T18:47:20.089265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487319+0000","last_change":"2024-09-13T18:47:15.487483+0000","last_active":"2024-09-13T18:47:19.487319+0000","last_peered":"2024-09-13T18:47:19.487319+0000","last_clean":"2024-09-13T18:47:19.487319+0000","last_became_active":"2024-09-13T18:47:15.481535+0000","last_became_peered":"2024-09-13T18:47:15.481535+0000","last_unstale":"2024-09-13T18:47:19.487319+0000","last_undegraded":"2024-09-13T18:47:19.487319+0000","last_fullsized":"2024-09-13T18:47:19.487319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492990+0000","last_change":"2024-09-13T18:47:14.995731+0000","last_active":"2024-09-13T18:47:19.492990+0000","last_peered":"2024-09-13T18:47:19.492990+0000","last_clean":"2024-09-13T18:47:19.492990+0000","last_became_active":"2024-09-13T18:47:14.995401+0000","last_became_peered":"2024-09-13T18:47:14.995401+0000","last_unstale":"2024-09-13T18:47:19.492990+0000","last_undegraded":"2024-09-13T18:47:19.492990+0000","last_fullsized":"2024-09-13T18:47:19.492990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083631+0000","last_change":"2024-09-13T18:47:19.594879+0000","last_active":"2024-09-13T18:47:20.083631+0000","last_peered":"2024-09-13T18:47:20.083631+0000","last_clean":"2024-09-13T18:47:20.083631+0000","last_became_active":"2024-09-13T18:47:19.594314+0000","last_became_peered":"2024-09-13T18:47:19.594314+0000","last_unstale":"2024-09-13T18:47:20.083631+0000","last_undegraded":"2024-09-13T18:47:20.083631+0000","last_fullsized":"2024-09-13T18:47:20.083631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492372+0000","last_change":"2024-09-13T18:47:15.463467+0000","last_active":"2024-09-13T18:47:19.492372+0000","last_peered":"2024-09-13T18:47:19.492372+0000","last_clean":"2024-09-13T18:47:19.492372+0000","last_became_active":"2024-09-13T18:47:15.463197+0000","last_became_peered":"2024-09-13T18:47:15.463197+0000","last_unstale":"2024-09-13T18:47:19.492372+0000","last_undegraded":"2024-09-13T18:47:19.492372+0000","last_fullsized":"2024-09-13T18:47:19.492372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:05.037494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591200+0000","last_change":"2024-09-13T18:47:15.007100+0000","last_active":"2024-09-13T18:47:19.591200+0000","last_peered":"2024-09-13T18:47:19.591200+0000","last_clean":"2024-09-13T18:47:19.591200+0000","last_became_active":"2024-09-13T18:47:15.002832+0000","last_became_peered":"2024-09-13T18:47:15.002832+0000","last_unstale":"2024-09-13T18:47:19.591200+0000","last_undegraded":"2024-09-13T18:47:19.591200+0000","last_fullsized":"2024-09-13T18:47:19.591200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093085+0000","last_change":"2024-09-13T18:47:19.512627+0000","last_active":"2024-09-13T18:47:20.093085+0000","last_peered":"2024-09-13T18:47:20.093085+0000","last_clean":"2024-09-13T18:47:20.093085+0000","last_became_active":"2024-09-13T18:47:19.512153+0000","last_became_peered":"2024-09-13T18:47:19.512153+0000","last_unstale":"2024-09-13T18:47:20.093085+0000","last_undegraded":"2024-09-13T18:47:20.093085+0000","last_fullsized":"2024-09-13T18:47:20.093085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491322+0000","last_change":"2024-09-13T18:47:15.475389+0000","last_active":"2024-09-13T18:47:19.491322+0000","last_peered":"2024-09-13T18:47:19.491322+0000","last_clean":"2024-09-13T18:47:19.491322+0000","last_became_active":"2024-09-13T18:47:15.475119+0000","last_became_peered":"2024-09-13T18:47:15.475119+0000","last_unstale":"2024-09-13T18:47:19.491322+0000","last_undegraded":"2024-09-13T18:47:19.491322+0000","last_fullsized":"2024-09-13T18:47:19.491322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501582+0000","last_change":"2024-09-13T18:47:15.002258+0000","last_active":"2024-09-13T18:47:19.501582+0000","last_peered":"2024-09-13T18:47:19.501582+0000","last_clean":"2024-09-13T18:47:19.501582+0000","last_became_active":"2024-09-13T18:47:15.001885+0000","last_became_peered":"2024-09-13T18:47:15.001885+0000","last_unstale":"2024-09-13T18:47:19.501582+0000","last_undegraded":"2024-09-13T18:47:19.501582+0000","last_fullsized":"2024-09-13T18:47:19.501582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089874+0000","last_change":"2024-09-13T18:47:19.600283+0000","last_active":"2024-09-13T18:47:20.089874+0000","last_peered":"2024-09-13T18:47:20.089874+0000","last_clean":"2024-09-13T18:47:20.089874+0000","last_became_active":"2024-09-13T18:47:19.598652+0000","last_became_peered":"2024-09-13T18:47:19.598652+0000","last_unstale":"2024-09-13T18:47:20.089874+0000","last_undegraded":"2024-09-13T18:47:20.089874+0000","last_fullsized":"2024-09-13T18:47:20.089874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:29.767904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488008+0000","last_change":"2024-09-13T18:47:15.472100+0000","last_active":"2024-09-13T18:47:19.488008+0000","last_peered":"2024-09-13T18:47:19.488008+0000","last_clean":"2024-09-13T18:47:19.488008+0000","last_became_active":"2024-09-13T18:47:15.470896+0000","last_became_peered":"2024-09-13T18:47:15.470896+0000","last_unstale":"2024-09-13T18:47:19.488008+0000","last_undegraded":"2024-09-13T18:47:19.488008+0000","last_fullsized":"2024-09-13T18:47:19.488008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.915538+0000","last_change":"2024-09-13T18:47:14.993205+0000","last_active":"2024-09-13T18:47:19.915538+0000","last_peered":"2024-09-13T18:47:19.915538+0000","last_clean":"2024-09-13T18:47:19.915538+0000","last_became_active":"2024-09-13T18:47:14.992192+0000","last_became_peered":"2024-09-13T18:47:14.992192+0000","last_unstale":"2024-09-13T18:47:19.915538+0000","last_undegraded":"2024-09-13T18:47:19.915538+0000","last_fullsized":"2024-09-13T18:47:19.915538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961562+0000","last_change":"2024-09-13T18:47:19.591216+0000","last_active":"2024-09-13T18:47:19.961562+0000","last_peered":"2024-09-13T18:47:19.961562+0000","last_clean":"2024-09-13T18:47:19.961562+0000","last_became_active":"2024-09-13T18:47:19.590770+0000","last_became_peered":"2024-09-13T18:47:19.590770+0000","last_unstale":"2024-09-13T18:47:19.961562+0000","last_undegraded":"2024-09-13T18:47:19.961562+0000","last_fullsized":"2024-09-13T18:47:19.961562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:46.641313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496179+0000","last_change":"2024-09-13T18:47:15.460995+0000","last_active":"2024-09-13T18:47:19.496179+0000","last_peered":"2024-09-13T18:47:19.496179+0000","last_clean":"2024-09-13T18:47:19.496179+0000","last_became_active":"2024-09-13T18:47:15.460641+0000","last_became_peered":"2024-09-13T18:47:15.460641+0000","last_unstale":"2024-09-13T18:47:19.496179+0000","last_undegraded":"2024-09-13T18:47:19.496179+0000","last_fullsized":"2024-09-13T18:47:19.496179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592272+0000","last_change":"2024-09-13T18:47:15.010681+0000","last_active":"2024-09-13T18:47:19.592272+0000","last_peered":"2024-09-13T18:47:19.592272+0000","last_clean":"2024-09-13T18:47:19.592272+0000","last_became_active":"2024-09-13T18:47:15.010462+0000","last_became_peered":"2024-09-13T18:47:15.010462+0000","last_unstale":"2024-09-13T18:47:19.592272+0000","last_undegraded":"2024-09-13T18:47:19.592272+0000","last_fullsized":"2024-09-13T18:47:19.592272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961765+0000","last_change":"2024-09-13T18:47:19.592197+0000","last_active":"2024-09-13T18:47:19.961765+0000","last_peered":"2024-09-13T18:47:19.961765+0000","last_clean":"2024-09-13T18:47:19.961765+0000","last_became_active":"2024-09-13T18:47:19.591271+0000","last_became_peered":"2024-09-13T18:47:19.591271+0000","last_unstale":"2024-09-13T18:47:19.961765+0000","last_undegraded":"2024-09-13T18:47:19.961765+0000","last_fullsized":"2024-09-13T18:47:19.961765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489858+0000","last_change":"2024-09-13T18:47:15.477286+0000","last_active":"2024-09-13T18:47:19.489858+0000","last_peered":"2024-09-13T18:47:19.489858+0000","last_clean":"2024-09-13T18:47:19.489858+0000","last_became_active":"2024-09-13T18:47:15.477017+0000","last_became_peered":"2024-09-13T18:47:15.477017+0000","last_unstale":"2024-09-13T18:47:19.489858+0000","last_undegraded":"2024-09-13T18:47:19.489858+0000","last_fullsized":"2024-09-13T18:47:19.489858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496254+0000","last_change":"2024-09-13T18:47:14.979483+0000","last_active":"2024-09-13T18:47:19.496254+0000","last_peered":"2024-09-13T18:47:19.496254+0000","last_clean":"2024-09-13T18:47:19.496254+0000","last_became_active":"2024-09-13T18:47:14.979179+0000","last_became_peered":"2024-09-13T18:47:14.979179+0000","last_unstale":"2024-09-13T18:47:19.496254+0000","last_undegraded":"2024-09-13T18:47:19.496254+0000","last_fullsized":"2024-09-13T18:47:19.496254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.082807+0000","last_change":"2024-09-13T18:47:19.515192+0000","last_active":"2024-09-13T18:47:20.082807+0000","last_peered":"2024-09-13T18:47:20.082807+0000","last_clean":"2024-09-13T18:47:20.082807+0000","last_became_active":"2024-09-13T18:47:19.514784+0000","last_became_peered":"2024-09-13T18:47:19.514784+0000","last_unstale":"2024-09-13T18:47:20.082807+0000","last_undegraded":"2024-09-13T18:47:20.082807+0000","last_fullsized":"2024-09-13T18:47:20.082807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498864+0000","last_change":"2024-09-13T18:47:15.475155+0000","last_active":"2024-09-13T18:47:19.498864+0000","last_peered":"2024-09-13T18:47:19.498864+0000","last_clean":"2024-09-13T18:47:19.498864+0000","last_became_active":"2024-09-13T18:47:15.472919+0000","last_became_peered":"2024-09-13T18:47:15.472919+0000","last_unstale":"2024-09-13T18:47:19.498864+0000","last_undegraded":"2024-09-13T18:47:19.498864+0000","last_fullsized":"2024-09-13T18:47:19.498864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:42.832696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489690+0000","last_change":"2024-09-13T18:47:14.989036+0000","last_active":"2024-09-13T18:47:19.489690+0000","last_peered":"2024-09-13T18:47:19.489690+0000","last_clean":"2024-09-13T18:47:19.489690+0000","last_became_active":"2024-09-13T18:47:14.988570+0000","last_became_peered":"2024-09-13T18:47:14.988570+0000","last_unstale":"2024-09-13T18:47:19.489690+0000","last_undegraded":"2024-09-13T18:47:19.489690+0000","last_fullsized":"2024-09-13T18:47:19.489690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083437+0000","last_change":"2024-09-13T18:47:19.517431+0000","last_active":"2024-09-13T18:47:20.083437+0000","last_peered":"2024-09-13T18:47:20.083437+0000","last_clean":"2024-09-13T18:47:20.083437+0000","last_became_active":"2024-09-13T18:47:19.517085+0000","last_became_peered":"2024-09-13T18:47:19.517085+0000","last_unstale":"2024-09-13T18:47:20.083437+0000","last_undegraded":"2024-09-13T18:47:20.083437+0000","last_fullsized":"2024-09-13T18:47:20.083437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492896+0000","last_change":"2024-09-13T18:47:15.467657+0000","last_active":"2024-09-13T18:47:19.492896+0000","last_peered":"2024-09-13T18:47:19.492896+0000","last_clean":"2024-09-13T18:47:19.492896+0000","last_became_active":"2024-09-13T18:47:15.467436+0000","last_became_peered":"2024-09-13T18:47:15.467436+0000","last_unstale":"2024-09-13T18:47:19.492896+0000","last_undegraded":"2024-09-13T18:47:19.492896+0000","last_fullsized":"2024-09-13T18:47:19.492896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498237+0000","last_change":"2024-09-13T18:47:14.987619+0000","last_active":"2024-09-13T18:47:19.498237+0000","last_peered":"2024-09-13T18:47:19.498237+0000","last_clean":"2024-09-13T18:47:19.498237+0000","last_became_active":"2024-09-13T18:47:14.987294+0000","last_became_peered":"2024-09-13T18:47:14.987294+0000","last_unstale":"2024-09-13T18:47:19.498237+0000","last_undegraded":"2024-09-13T18:47:19.498237+0000","last_fullsized":"2024-09-13T18:47:19.498237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083730+0000","last_change":"2024-09-13T18:47:19.512260+0000","last_active":"2024-09-13T18:47:20.083730+0000","last_peered":"2024-09-13T18:47:20.083730+0000","last_clean":"2024-09-13T18:47:20.083730+0000","last_became_active":"2024-09-13T18:47:19.511869+0000","last_became_peered":"2024-09-13T18:47:19.511869+0000","last_unstale":"2024-09-13T18:47:20.083730+0000","last_undegraded":"2024-09-13T18:47:20.083730+0000","last_fullsized":"2024-09-13T18:47:20.083730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.483967+0000","last_change":"2024-09-13T18:47:15.469232+0000","last_active":"2024-09-13T18:47:19.483967+0000","last_peered":"2024-09-13T18:47:19.483967+0000","last_clean":"2024-09-13T18:47:19.483967+0000","last_became_active":"2024-09-13T18:47:15.469087+0000","last_became_peered":"2024-09-13T18:47:15.469087+0000","last_unstale":"2024-09-13T18:47:19.483967+0000","last_undegraded":"2024-09-13T18:47:19.483967+0000","last_fullsized":"2024-09-13T18:47:19.483967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591340+0000","last_change":"2024-09-13T18:47:15.007648+0000","last_active":"2024-09-13T18:47:19.591340+0000","last_peered":"2024-09-13T18:47:19.591340+0000","last_clean":"2024-09-13T18:47:19.591340+0000","last_became_active":"2024-09-13T18:47:15.006632+0000","last_became_peered":"2024-09-13T18:47:15.006632+0000","last_unstale":"2024-09-13T18:47:19.591340+0000","last_undegraded":"2024-09-13T18:47:19.591340+0000","last_fullsized":"2024-09-13T18:47:19.591340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963378+0000","last_change":"2024-09-13T18:47:19.591686+0000","last_active":"2024-09-13T18:47:19.963378+0000","last_peered":"2024-09-13T18:47:19.963378+0000","last_clean":"2024-09-13T18:47:19.963378+0000","last_became_active":"2024-09-13T18:47:19.590830+0000","last_became_peered":"2024-09-13T18:47:19.590830+0000","last_unstale":"2024-09-13T18:47:19.963378+0000","last_undegraded":"2024-09-13T18:47:19.963378+0000","last_fullsized":"2024-09-13T18:47:19.963378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487530+0000","last_change":"2024-09-13T18:47:15.480640+0000","last_active":"2024-09-13T18:47:19.487530+0000","last_peered":"2024-09-13T18:47:19.487530+0000","last_clean":"2024-09-13T18:47:19.487530+0000","last_became_active":"2024-09-13T18:47:15.480343+0000","last_became_peered":"2024-09-13T18:47:15.480343+0000","last_unstale":"2024-09-13T18:47:19.487530+0000","last_undegraded":"2024-09-13T18:47:19.487530+0000","last_fullsized":"2024-09-13T18:47:19.487530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488746+0000","last_change":"2024-09-13T18:47:14.993847+0000","last_active":"2024-09-13T18:47:19.488746+0000","last_peered":"2024-09-13T18:47:19.488746+0000","last_clean":"2024-09-13T18:47:19.488746+0000","last_became_active":"2024-09-13T18:47:14.993582+0000","last_became_peered":"2024-09-13T18:47:14.993582+0000","last_unstale":"2024-09-13T18:47:19.488746+0000","last_undegraded":"2024-09-13T18:47:19.488746+0000","last_fullsized":"2024-09-13T18:47:19.488746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591343+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:47:19.591343+0000","last_peered":"2024-09-13T18:47:19.591343+0000","last_clean":"2024-09-13T18:47:19.591343+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:47:19.591343+0000","last_undegraded":"2024-09-13T18:47:19.591343+0000","last_fullsized":"2024-09-13T18:47:19.591343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092727+0000","last_change":"2024-09-13T18:47:19.599505+0000","last_active":"2024-09-13T18:47:20.092727+0000","last_peered":"2024-09-13T18:47:20.092727+0000","last_clean":"2024-09-13T18:47:20.092727+0000","last_became_active":"2024-09-13T18:47:19.599105+0000","last_became_peered":"2024-09-13T18:47:19.599105+0000","last_unstale":"2024-09-13T18:47:20.092727+0000","last_undegraded":"2024-09-13T18:47:20.092727+0000","last_fullsized":"2024-09-13T18:47:20.092727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:44.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591948+0000","last_change":"2024-09-13T18:47:15.491819+0000","last_active":"2024-09-13T18:47:19.591948+0000","last_peered":"2024-09-13T18:47:19.591948+0000","last_clean":"2024-09-13T18:47:19.591948+0000","last_became_active":"2024-09-13T18:47:15.491497+0000","last_became_peered":"2024-09-13T18:47:15.491497+0000","last_unstale":"2024-09-13T18:47:19.591948+0000","last_undegraded":"2024-09-13T18:47:19.591948+0000","last_fullsized":"2024-09-13T18:47:19.591948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498674+0000","last_change":"2024-09-13T18:47:14.990404+0000","last_active":"2024-09-13T18:47:19.498674+0000","last_peered":"2024-09-13T18:47:19.498674+0000","last_clean":"2024-09-13T18:47:19.498674+0000","last_became_active":"2024-09-13T18:47:14.990115+0000","last_became_peered":"2024-09-13T18:47:14.990115+0000","last_unstale":"2024-09-13T18:47:19.498674+0000","last_undegraded":"2024-09-13T18:47:19.498674+0000","last_fullsized":"2024-09-13T18:47:19.498674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.088631+0000","last_change":"2024-09-13T18:47:19.594274+0000","last_active":"2024-09-13T18:47:20.088631+0000","last_peered":"2024-09-13T18:47:20.088631+0000","last_clean":"2024-09-13T18:47:20.088631+0000","last_became_active":"2024-09-13T18:47:19.593700+0000","last_became_peered":"2024-09-13T18:47:19.593700+0000","last_unstale":"2024-09-13T18:47:20.088631+0000","last_undegraded":"2024-09-13T18:47:20.088631+0000","last_fullsized":"2024-09-13T18:47:20.088631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489145+0000","last_change":"2024-09-13T18:47:15.478629+0000","last_active":"2024-09-13T18:47:19.489145+0000","last_peered":"2024-09-13T18:47:19.489145+0000","last_clean":"2024-09-13T18:47:19.489145+0000","last_became_active":"2024-09-13T18:47:15.476132+0000","last_became_peered":"2024-09-13T18:47:15.476132+0000","last_unstale":"2024-09-13T18:47:19.489145+0000","last_undegraded":"2024-09-13T18:47:19.489145+0000","last_fullsized":"2024-09-13T18:47:19.489145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493042+0000","last_change":"2024-09-13T18:47:14.995147+0000","last_active":"2024-09-13T18:47:19.493042+0000","last_peered":"2024-09-13T18:47:19.493042+0000","last_clean":"2024-09-13T18:47:19.493042+0000","last_became_active":"2024-09-13T18:47:14.994931+0000","last_became_peered":"2024-09-13T18:47:14.994931+0000","last_unstale":"2024-09-13T18:47:19.493042+0000","last_undegraded":"2024-09-13T18:47:19.493042+0000","last_fullsized":"2024-09-13T18:47:19.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961957+0000","last_change":"2024-09-13T18:47:19.510647+0000","last_active":"2024-09-13T18:47:19.961957+0000","last_peered":"2024-09-13T18:47:19.961957+0000","last_clean":"2024-09-13T18:47:19.961957+0000","last_became_active":"2024-09-13T18:47:19.508746+0000","last_became_peered":"2024-09-13T18:47:19.508746+0000","last_unstale":"2024-09-13T18:47:19.961957+0000","last_undegraded":"2024-09-13T18:47:19.961957+0000","last_fullsized":"2024-09-13T18:47:19.961957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592399+0000","last_change":"2024-09-13T18:47:15.494681+0000","last_active":"2024-09-13T18:47:19.592399+0000","last_peered":"2024-09-13T18:47:19.592399+0000","last_clean":"2024-09-13T18:47:19.592399+0000","last_became_active":"2024-09-13T18:47:15.490395+0000","last_became_peered":"2024-09-13T18:47:15.490395+0000","last_unstale":"2024-09-13T18:47:19.592399+0000","last_undegraded":"2024-09-13T18:47:19.592399+0000","last_fullsized":"2024-09-13T18:47:19.592399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499936+0000","last_change":"2024-09-13T18:47:14.992959+0000","last_active":"2024-09-13T18:47:19.499936+0000","last_peered":"2024-09-13T18:47:19.499936+0000","last_clean":"2024-09-13T18:47:19.499936+0000","last_became_active":"2024-09-13T18:47:14.989696+0000","last_became_peered":"2024-09-13T18:47:14.989696+0000","last_unstale":"2024-09-13T18:47:19.499936+0000","last_undegraded":"2024-09-13T18:47:19.499936+0000","last_fullsized":"2024-09-13T18:47:19.499936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092955+0000","last_change":"2024-09-13T18:47:19.594315+0000","last_active":"2024-09-13T18:47:20.092955+0000","last_peered":"2024-09-13T18:47:20.092955+0000","last_clean":"2024-09-13T18:47:20.092955+0000","last_became_active":"2024-09-13T18:47:19.593856+0000","last_became_peered":"2024-09-13T18:47:19.593856+0000","last_unstale":"2024-09-13T18:47:20.092955+0000","last_undegraded":"2024-09-13T18:47:20.092955+0000","last_fullsized":"2024-09-13T18:47:20.092955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592241+0000","last_change":"2024-09-13T18:47:15.493079+0000","last_active":"2024-09-13T18:47:19.592241+0000","last_peered":"2024-09-13T18:47:19.592241+0000","last_clean":"2024-09-13T18:47:19.592241+0000","last_became_active":"2024-09-13T18:47:15.492647+0000","last_became_peered":"2024-09-13T18:47:15.492647+0000","last_unstale":"2024-09-13T18:47:19.592241+0000","last_undegraded":"2024-09-13T18:47:19.592241+0000","last_fullsized":"2024-09-13T18:47:19.592241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:55.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.494245+0000","last_change":"2024-09-13T18:47:15.001931+0000","last_active":"2024-09-13T18:47:19.494245+0000","last_peered":"2024-09-13T18:47:19.494245+0000","last_clean":"2024-09-13T18:47:19.494245+0000","last_became_active":"2024-09-13T18:47:15.001488+0000","last_became_peered":"2024-09-13T18:47:15.001488+0000","last_unstale":"2024-09-13T18:47:19.494245+0000","last_undegraded":"2024-09-13T18:47:19.494245+0000","last_fullsized":"2024-09-13T18:47:19.494245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.883156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089502+0000","last_change":"2024-09-13T18:47:19.507944+0000","last_active":"2024-09-13T18:47:20.089502+0000","last_peered":"2024-09-13T18:47:20.089502+0000","last_clean":"2024-09-13T18:47:20.089502+0000","last_became_active":"2024-09-13T18:47:19.506708+0000","last_became_peered":"2024-09-13T18:47:19.506708+0000","last_unstale":"2024-09-13T18:47:20.089502+0000","last_undegraded":"2024-09-13T18:47:20.089502+0000","last_fullsized":"2024-09-13T18:47:20.089502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:12.199448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591479+0000","last_change":"2024-09-13T18:47:15.482887+0000","last_active":"2024-09-13T18:47:19.591479+0000","last_peered":"2024-09-13T18:47:19.591479+0000","last_clean":"2024-09-13T18:47:19.591479+0000","last_became_active":"2024-09-13T18:47:15.482616+0000","last_became_peered":"2024-09-13T18:47:15.482616+0000","last_unstale":"2024-09-13T18:47:19.591479+0000","last_undegraded":"2024-09-13T18:47:19.591479+0000","last_fullsized":"2024-09-13T18:47:19.591479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:44.301458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499180+0000","last_change":"2024-09-13T18:47:14.983612+0000","last_active":"2024-09-13T18:47:19.499180+0000","last_peered":"2024-09-13T18:47:19.499180+0000","last_clean":"2024-09-13T18:47:19.499180+0000","last_became_active":"2024-09-13T18:47:14.983354+0000","last_became_peered":"2024-09-13T18:47:14.983354+0000","last_unstale":"2024-09-13T18:47:19.499180+0000","last_undegraded":"2024-09-13T18:47:19.499180+0000","last_fullsized":"2024-09-13T18:47:19.499180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963361+0000","last_change":"2024-09-13T18:47:19.504797+0000","last_active":"2024-09-13T18:47:19.963361+0000","last_peered":"2024-09-13T18:47:19.963361+0000","last_clean":"2024-09-13T18:47:19.963361+0000","last_became_active":"2024-09-13T18:47:19.504472+0000","last_became_peered":"2024-09-13T18:47:19.504472+0000","last_unstale":"2024-09-13T18:47:19.963361+0000","last_undegraded":"2024-09-13T18:47:19.963361+0000","last_fullsized":"2024-09-13T18:47:19.963361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495782+0000","last_change":"2024-09-13T18:47:15.469363+0000","last_active":"2024-09-13T18:47:19.495782+0000","last_peered":"2024-09-13T18:47:19.495782+0000","last_clean":"2024-09-13T18:47:19.495782+0000","last_became_active":"2024-09-13T18:47:15.468718+0000","last_became_peered":"2024-09-13T18:47:15.468718+0000","last_unstale":"2024-09-13T18:47:19.495782+0000","last_undegraded":"2024-09-13T18:47:19.495782+0000","last_fullsized":"2024-09-13T18:47:19.495782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499734+0000","last_change":"2024-09-13T18:47:15.006188+0000","last_active":"2024-09-13T18:47:19.499734+0000","last_peered":"2024-09-13T18:47:19.499734+0000","last_clean":"2024-09-13T18:47:19.499734+0000","last_became_active":"2024-09-13T18:47:15.003764+0000","last_became_peered":"2024-09-13T18:47:15.003764+0000","last_unstale":"2024-09-13T18:47:19.499734+0000","last_undegraded":"2024-09-13T18:47:19.499734+0000","last_fullsized":"2024-09-13T18:47:19.499734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962715+0000","last_change":"2024-09-13T18:47:19.597771+0000","last_active":"2024-09-13T18:47:19.962715+0000","last_peered":"2024-09-13T18:47:19.962715+0000","last_clean":"2024-09-13T18:47:19.962715+0000","last_became_active":"2024-09-13T18:47:19.597144+0000","last_became_peered":"2024-09-13T18:47:19.597144+0000","last_unstale":"2024-09-13T18:47:19.962715+0000","last_undegraded":"2024-09-13T18:47:19.962715+0000","last_fullsized":"2024-09-13T18:47:19.962715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.794670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592050+0000","last_change":"2024-09-13T18:47:15.484848+0000","last_active":"2024-09-13T18:47:19.592050+0000","last_peered":"2024-09-13T18:47:19.592050+0000","last_clean":"2024-09-13T18:47:19.592050+0000","last_became_active":"2024-09-13T18:47:15.484444+0000","last_became_peered":"2024-09-13T18:47:15.484444+0000","last_unstale":"2024-09-13T18:47:19.592050+0000","last_undegraded":"2024-09-13T18:47:19.592050+0000","last_fullsized":"2024-09-13T18:47:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489024+0000","last_change":"2024-09-13T18:47:14.991470+0000","last_active":"2024-09-13T18:47:19.489024+0000","last_peered":"2024-09-13T18:47:19.489024+0000","last_clean":"2024-09-13T18:47:19.489024+0000","last_became_active":"2024-09-13T18:47:14.991135+0000","last_became_peered":"2024-09-13T18:47:14.991135+0000","last_unstale":"2024-09-13T18:47:19.489024+0000","last_undegraded":"2024-09-13T18:47:19.489024+0000","last_fullsized":"2024-09-13T18:47:19.489024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962615+0000","last_change":"2024-09-13T18:47:19.593992+0000","last_active":"2024-09-13T18:47:19.962615+0000","last_peered":"2024-09-13T18:47:19.962615+0000","last_clean":"2024-09-13T18:47:19.962615+0000","last_became_active":"2024-09-13T18:47:19.591585+0000","last_became_peered":"2024-09-13T18:47:19.591585+0000","last_unstale":"2024-09-13T18:47:19.962615+0000","last_undegraded":"2024-09-13T18:47:19.962615+0000","last_fullsized":"2024-09-13T18:47:19.962615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:29.971970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487602+0000","last_change":"2024-09-13T18:47:15.463821+0000","last_active":"2024-09-13T18:47:19.487602+0000","last_peered":"2024-09-13T18:47:19.487602+0000","last_clean":"2024-09-13T18:47:19.487602+0000","last_became_active":"2024-09-13T18:47:15.463563+0000","last_became_peered":"2024-09-13T18:47:15.463563+0000","last_unstale":"2024-09-13T18:47:19.487602+0000","last_undegraded":"2024-09-13T18:47:19.487602+0000","last_fullsized":"2024-09-13T18:47:19.487602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488046+0000","last_change":"2024-09-13T18:47:14.990471+0000","last_active":"2024-09-13T18:47:19.488046+0000","last_peered":"2024-09-13T18:47:19.488046+0000","last_clean":"2024-09-13T18:47:19.488046+0000","last_became_active":"2024-09-13T18:47:14.990222+0000","last_became_peered":"2024-09-13T18:47:14.990222+0000","last_unstale":"2024-09-13T18:47:19.488046+0000","last_undegraded":"2024-09-13T18:47:19.488046+0000","last_fullsized":"2024-09-13T18:47:19.488046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093959+0000","last_change":"2024-09-13T18:47:19.594886+0000","last_active":"2024-09-13T18:47:20.093959+0000","last_peered":"2024-09-13T18:47:20.093959+0000","last_clean":"2024-09-13T18:47:20.093959+0000","last_became_active":"2024-09-13T18:47:19.593831+0000","last_became_peered":"2024-09-13T18:47:19.593831+0000","last_unstale":"2024-09-13T18:47:20.093959+0000","last_undegraded":"2024-09-13T18:47:20.093959+0000","last_fullsized":"2024-09-13T18:47:20.093959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:50.947334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591916+0000","last_change":"2024-09-13T18:47:15.495522+0000","last_active":"2024-09-13T18:47:19.591916+0000","last_peered":"2024-09-13T18:47:19.591916+0000","last_clean":"2024-09-13T18:47:19.591916+0000","last_became_active":"2024-09-13T18:47:15.495212+0000","last_became_peered":"2024-09-13T18:47:15.495212+0000","last_unstale":"2024-09-13T18:47:19.591916+0000","last_undegraded":"2024-09-13T18:47:19.591916+0000","last_fullsized":"2024-09-13T18:47:19.591916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:32.484198+0000","last_change":"2024-09-13T18:47:15.000232+0000","last_active":"2024-09-13T18:47:32.484198+0000","last_peered":"2024-09-13T18:47:32.484198+0000","last_clean":"2024-09-13T18:47:32.484198+0000","last_became_active":"2024-09-13T18:47:14.993720+0000","last_became_peered":"2024-09-13T18:47:14.993720+0000","last_unstale":"2024-09-13T18:47:32.484198+0000","last_undegraded":"2024-09-13T18:47:32.484198+0000","last_fullsized":"2024-09-13T18:47:32.484198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083179+0000","last_change":"2024-09-13T18:47:19.515199+0000","last_active":"2024-09-13T18:47:20.083179+0000","last_peered":"2024-09-13T18:47:20.083179+0000","last_clean":"2024-09-13T18:47:20.083179+0000","last_became_active":"2024-09-13T18:47:19.514767+0000","last_became_peered":"2024-09-13T18:47:19.514767+0000","last_unstale":"2024-09-13T18:47:20.083179+0000","last_undegraded":"2024-09-13T18:47:20.083179+0000","last_fullsized":"2024-09-13T18:47:20.083179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:12.518830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497412+0000","last_change":"2024-09-13T18:47:15.471819+0000","last_active":"2024-09-13T18:47:19.497412+0000","last_peered":"2024-09-13T18:47:19.497412+0000","last_clean":"2024-09-13T18:47:19.497412+0000","last_became_active":"2024-09-13T18:47:15.470912+0000","last_became_peered":"2024-09-13T18:47:15.470912+0000","last_unstale":"2024-09-13T18:47:19.497412+0000","last_undegraded":"2024-09-13T18:47:19.497412+0000","last_fullsized":"2024-09-13T18:47:19.497412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492949+0000","last_change":"2024-09-13T18:47:14.986030+0000","last_active":"2024-09-13T18:47:19.492949+0000","last_peered":"2024-09-13T18:47:19.492949+0000","last_clean":"2024-09-13T18:47:19.492949+0000","last_became_active":"2024-09-13T18:47:14.984931+0000","last_became_peered":"2024-09-13T18:47:14.984931+0000","last_unstale":"2024-09-13T18:47:19.492949+0000","last_undegraded":"2024-09-13T18:47:19.492949+0000","last_fullsized":"2024-09-13T18:47:19.492949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089956+0000","last_change":"2024-09-13T18:47:19.507392+0000","last_active":"2024-09-13T18:47:20.089956+0000","last_peered":"2024-09-13T18:47:20.089956+0000","last_clean":"2024-09-13T18:47:20.089956+0000","last_became_active":"2024-09-13T18:47:19.506702+0000","last_became_peered":"2024-09-13T18:47:19.506702+0000","last_unstale":"2024-09-13T18:47:20.089956+0000","last_undegraded":"2024-09-13T18:47:20.089956+0000","last_fullsized":"2024-09-13T18:47:20.089956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491898+0000","last_change":"2024-09-13T18:47:15.478357+0000","last_active":"2024-09-13T18:47:19.491898+0000","last_peered":"2024-09-13T18:47:19.491898+0000","last_clean":"2024-09-13T18:47:19.491898+0000","last_became_active":"2024-09-13T18:47:15.471984+0000","last_became_peered":"2024-09-13T18:47:15.471984+0000","last_unstale":"2024-09-13T18:47:19.491898+0000","last_undegraded":"2024-09-13T18:47:19.491898+0000","last_fullsized":"2024-09-13T18:47:19.491898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:56.409431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489487+0000","last_change":"2024-09-13T18:47:14.994513+0000","last_active":"2024-09-13T18:47:19.489487+0000","last_peered":"2024-09-13T18:47:19.489487+0000","last_clean":"2024-09-13T18:47:19.489487+0000","last_became_active":"2024-09-13T18:47:14.994172+0000","last_became_peered":"2024-09-13T18:47:14.994172+0000","last_unstale":"2024-09-13T18:47:19.489487+0000","last_undegraded":"2024-09-13T18:47:19.489487+0000","last_fullsized":"2024-09-13T18:47:19.489487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961893+0000","last_change":"2024-09-13T18:47:19.503298+0000","last_active":"2024-09-13T18:47:19.961893+0000","last_peered":"2024-09-13T18:47:19.961893+0000","last_clean":"2024-09-13T18:47:19.961893+0000","last_became_active":"2024-09-13T18:47:19.502791+0000","last_became_peered":"2024-09-13T18:47:19.502791+0000","last_unstale":"2024-09-13T18:47:19.961893+0000","last_undegraded":"2024-09-13T18:47:19.961893+0000","last_fullsized":"2024-09-13T18:47:19.961893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:34.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489361+0000","last_change":"2024-09-13T18:47:15.478250+0000","last_active":"2024-09-13T18:47:19.489361+0000","last_peered":"2024-09-13T18:47:19.489361+0000","last_clean":"2024-09-13T18:47:19.489361+0000","last_became_active":"2024-09-13T18:47:15.477916+0000","last_became_peered":"2024-09-13T18:47:15.477916+0000","last_unstale":"2024-09-13T18:47:19.489361+0000","last_undegraded":"2024-09-13T18:47:19.489361+0000","last_fullsized":"2024-09-13T18:47:19.489361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501456+0000","last_change":"2024-09-13T18:47:14.992683+0000","last_active":"2024-09-13T18:47:19.501456+0000","last_peered":"2024-09-13T18:47:19.501456+0000","last_clean":"2024-09-13T18:47:19.501456+0000","last_became_active":"2024-09-13T18:47:14.992232+0000","last_became_peered":"2024-09-13T18:47:14.992232+0000","last_unstale":"2024-09-13T18:47:19.501456+0000","last_undegraded":"2024-09-13T18:47:19.501456+0000","last_fullsized":"2024-09-13T18:47:19.501456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962042+0000","last_change":"2024-09-13T18:47:19.596501+0000","last_active":"2024-09-13T18:47:19.962042+0000","last_peered":"2024-09-13T18:47:19.962042+0000","last_clean":"2024-09-13T18:47:19.962042+0000","last_became_active":"2024-09-13T18:47:19.590331+0000","last_became_peered":"2024-09-13T18:47:19.590331+0000","last_unstale":"2024-09-13T18:47:19.962042+0000","last_undegraded":"2024-09-13T18:47:19.962042+0000","last_fullsized":"2024-09-13T18:47:19.962042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:10.553259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961696+0000","last_change":"2024-09-13T18:47:19.596767+0000","last_active":"2024-09-13T18:47:19.961696+0000","last_peered":"2024-09-13T18:47:19.961696+0000","last_clean":"2024-09-13T18:47:19.961696+0000","last_became_active":"2024-09-13T18:47:19.595887+0000","last_became_peered":"2024-09-13T18:47:19.595887+0000","last_unstale":"2024-09-13T18:47:19.961696+0000","last_undegraded":"2024-09-13T18:47:19.961696+0000","last_fullsized":"2024-09-13T18:47:19.961696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492575+0000","last_change":"2024-09-13T18:47:15.471603+0000","last_active":"2024-09-13T18:47:19.492575+0000","last_peered":"2024-09-13T18:47:19.492575+0000","last_clean":"2024-09-13T18:47:19.492575+0000","last_became_active":"2024-09-13T18:47:15.471339+0000","last_became_peered":"2024-09-13T18:47:15.471339+0000","last_unstale":"2024-09-13T18:47:19.492575+0000","last_undegraded":"2024-09-13T18:47:19.492575+0000","last_fullsized":"2024-09-13T18:47:19.492575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489486+0000","last_change":"2024-09-13T18:47:14.987617+0000","last_active":"2024-09-13T18:47:19.489486+0000","last_peered":"2024-09-13T18:47:19.489486+0000","last_clean":"2024-09-13T18:47:19.489486+0000","last_became_active":"2024-09-13T18:47:14.987317+0000","last_became_peered":"2024-09-13T18:47:14.987317+0000","last_unstale":"2024-09-13T18:47:19.489486+0000","last_undegraded":"2024-09-13T18:47:19.489486+0000","last_fullsized":"2024-09-13T18:47:19.489486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090892+0000","last_change":"2024-09-13T18:47:19.509912+0000","last_active":"2024-09-13T18:47:20.090892+0000","last_peered":"2024-09-13T18:47:20.090892+0000","last_clean":"2024-09-13T18:47:20.090892+0000","last_became_active":"2024-09-13T18:47:19.509495+0000","last_became_peered":"2024-09-13T18:47:19.509495+0000","last_unstale":"2024-09-13T18:47:20.090892+0000","last_undegraded":"2024-09-13T18:47:20.090892+0000","last_fullsized":"2024-09-13T18:47:20.090892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:47.911959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487233+0000","last_change":"2024-09-13T18:47:15.471151+0000","last_active":"2024-09-13T18:47:19.487233+0000","last_peered":"2024-09-13T18:47:19.487233+0000","last_clean":"2024-09-13T18:47:19.487233+0000","last_became_active":"2024-09-13T18:47:15.470918+0000","last_became_peered":"2024-09-13T18:47:15.470918+0000","last_unstale":"2024-09-13T18:47:19.487233+0000","last_undegraded":"2024-09-13T18:47:19.487233+0000","last_fullsized":"2024-09-13T18:47:19.487233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488692+0000","last_change":"2024-09-13T18:47:14.991806+0000","last_active":"2024-09-13T18:47:19.488692+0000","last_peered":"2024-09-13T18:47:19.488692+0000","last_clean":"2024-09-13T18:47:19.488692+0000","last_became_active":"2024-09-13T18:47:14.991545+0000","last_became_peered":"2024-09-13T18:47:14.991545+0000","last_unstale":"2024-09-13T18:47:19.488692+0000","last_undegraded":"2024-09-13T18:47:19.488692+0000","last_fullsized":"2024-09-13T18:47:19.488692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500273+0000","last_change":"2024-09-13T18:47:14.999437+0000","last_active":"2024-09-13T18:47:19.500273+0000","last_peered":"2024-09-13T18:47:19.500273+0000","last_clean":"2024-09-13T18:47:19.500273+0000","last_became_active":"2024-09-13T18:47:14.993774+0000","last_became_peered":"2024-09-13T18:47:14.993774+0000","last_unstale":"2024-09-13T18:47:19.500273+0000","last_undegraded":"2024-09-13T18:47:19.500273+0000","last_fullsized":"2024-09-13T18:47:19.500273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487997+0000","last_change":"2024-09-13T18:47:15.459688+0000","last_active":"2024-09-13T18:47:19.487997+0000","last_peered":"2024-09-13T18:47:19.487997+0000","last_clean":"2024-09-13T18:47:19.487997+0000","last_became_active":"2024-09-13T18:47:15.459427+0000","last_became_peered":"2024-09-13T18:47:15.459427+0000","last_unstale":"2024-09-13T18:47:19.487997+0000","last_undegraded":"2024-09-13T18:47:19.487997+0000","last_fullsized":"2024-09-13T18:47:19.487997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.960515+0000","last_change":"2024-09-13T18:47:19.509191+0000","last_active":"2024-09-13T18:47:19.960515+0000","last_peered":"2024-09-13T18:47:19.960515+0000","last_clean":"2024-09-13T18:47:19.960515+0000","last_became_active":"2024-09-13T18:47:19.505978+0000","last_became_peered":"2024-09-13T18:47:19.505978+0000","last_unstale":"2024-09-13T18:47:19.960515+0000","last_undegraded":"2024-09-13T18:47:19.960515+0000","last_fullsized":"2024-09-13T18:47:19.960515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:54.531127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487778+0000","last_change":"2024-09-13T18:47:14.996586+0000","last_active":"2024-09-13T18:47:19.487778+0000","last_peered":"2024-09-13T18:47:19.487778+0000","last_clean":"2024-09-13T18:47:19.487778+0000","last_became_active":"2024-09-13T18:47:14.996310+0000","last_became_peered":"2024-09-13T18:47:14.996310+0000","last_unstale":"2024-09-13T18:47:19.487778+0000","last_undegraded":"2024-09-13T18:47:19.487778+0000","last_fullsized":"2024-09-13T18:47:19.487778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497807+0000","last_change":"2024-09-13T18:47:15.478387+0000","last_active":"2024-09-13T18:47:19.497807+0000","last_peered":"2024-09-13T18:47:19.497807+0000","last_clean":"2024-09-13T18:47:19.497807+0000","last_became_active":"2024-09-13T18:47:15.478052+0000","last_became_peered":"2024-09-13T18:47:15.478052+0000","last_unstale":"2024-09-13T18:47:19.497807+0000","last_undegraded":"2024-09-13T18:47:19.497807+0000","last_fullsized":"2024-09-13T18:47:19.497807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:20.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962836+0000","last_change":"2024-09-13T18:47:19.511484+0000","last_active":"2024-09-13T18:47:19.962836+0000","last_peered":"2024-09-13T18:47:19.962836+0000","last_clean":"2024-09-13T18:47:19.962836+0000","last_became_active":"2024-09-13T18:47:19.511269+0000","last_became_peered":"2024-09-13T18:47:19.511269+0000","last_unstale":"2024-09-13T18:47:19.962836+0000","last_undegraded":"2024-09-13T18:47:19.962836+0000","last_fullsized":"2024-09-13T18:47:19.962836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:27.500957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495634+0000","last_change":"2024-09-13T18:47:15.471234+0000","last_active":"2024-09-13T18:47:19.495634+0000","last_peered":"2024-09-13T18:47:19.495634+0000","last_clean":"2024-09-13T18:47:19.495634+0000","last_became_active":"2024-09-13T18:47:15.469073+0000","last_became_peered":"2024-09-13T18:47:15.469073+0000","last_unstale":"2024-09-13T18:47:19.495634+0000","last_undegraded":"2024-09-13T18:47:19.495634+0000","last_fullsized":"2024-09-13T18:47:19.495634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498324+0000","last_change":"2024-09-13T18:47:15.484477+0000","last_active":"2024-09-13T18:47:19.498324+0000","last_peered":"2024-09-13T18:47:19.498324+0000","last_clean":"2024-09-13T18:47:19.498324+0000","last_became_active":"2024-09-13T18:47:15.484155+0000","last_became_peered":"2024-09-13T18:47:15.484155+0000","last_unstale":"2024-09-13T18:47:19.498324+0000","last_undegraded":"2024-09-13T18:47:19.498324+0000","last_fullsized":"2024-09-13T18:47:19.498324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:39.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488918+0000","last_change":"2024-09-13T18:47:15.478632+0000","last_active":"2024-09-13T18:47:19.488918+0000","last_peered":"2024-09-13T18:47:19.488918+0000","last_clean":"2024-09-13T18:47:19.488918+0000","last_became_active":"2024-09-13T18:47:15.477839+0000","last_became_peered":"2024-09-13T18:47:15.477839+0000","last_unstale":"2024-09-13T18:47:19.488918+0000","last_undegraded":"2024-09-13T18:47:19.488918+0000","last_fullsized":"2024-09-13T18:47:19.488918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487900+0000","last_change":"2024-09-13T18:47:15.468102+0000","last_active":"2024-09-13T18:47:19.487900+0000","last_peered":"2024-09-13T18:47:19.487900+0000","last_clean":"2024-09-13T18:47:19.487900+0000","last_became_active":"2024-09-13T18:47:15.467859+0000","last_became_peered":"2024-09-13T18:47:15.467859+0000","last_unstale":"2024-09-13T18:47:19.487900+0000","last_undegraded":"2024-09-13T18:47:19.487900+0000","last_fullsized":"2024-09-13T18:47:19.487900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490262+0000","last_change":"2024-09-13T18:47:15.483966+0000","last_active":"2024-09-13T18:47:19.490262+0000","last_peered":"2024-09-13T18:47:19.490262+0000","last_clean":"2024-09-13T18:47:19.490262+0000","last_became_active":"2024-09-13T18:47:15.483703+0000","last_became_peered":"2024-09-13T18:47:15.483703+0000","last_unstale":"2024-09-13T18:47:19.490262+0000","last_undegraded":"2024-09-13T18:47:19.490262+0000","last_fullsized":"2024-09-13T18:47:19.490262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492839+0000","last_change":"2024-09-13T18:47:15.473022+0000","last_active":"2024-09-13T18:47:19.492839+0000","last_peered":"2024-09-13T18:47:19.492839+0000","last_clean":"2024-09-13T18:47:19.492839+0000","last_became_active":"2024-09-13T18:47:15.472759+0000","last_became_peered":"2024-09-13T18:47:15.472759+0000","last_unstale":"2024-09-13T18:47:19.492839+0000","last_undegraded":"2024-09-13T18:47:19.492839+0000","last_fullsized":"2024-09-13T18:47:19.492839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501045+0000","last_change":"2024-09-13T18:47:15.498630+0000","last_active":"2024-09-13T18:47:19.501045+0000","last_peered":"2024-09-13T18:47:19.501045+0000","last_clean":"2024-09-13T18:47:19.501045+0000","last_became_active":"2024-09-13T18:47:15.489640+0000","last_became_peered":"2024-09-13T18:47:15.489640+0000","last_unstale":"2024-09-13T18:47:19.501045+0000","last_undegraded":"2024-09-13T18:47:19.501045+0000","last_fullsized":"2024-09-13T18:47:19.501045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487931+0000","last_change":"2024-09-13T18:47:15.484677+0000","last_active":"2024-09-13T18:47:19.487931+0000","last_peered":"2024-09-13T18:47:19.487931+0000","last_clean":"2024-09-13T18:47:19.487931+0000","last_became_active":"2024-09-13T18:47:15.484344+0000","last_became_peered":"2024-09-13T18:47:15.484344+0000","last_unstale":"2024-09-13T18:47:19.487931+0000","last_undegraded":"2024-09-13T18:47:19.487931+0000","last_fullsized":"2024-09-13T18:47:19.487931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490604+0000","last_change":"2024-09-13T18:47:15.480276+0000","last_active":"2024-09-13T18:47:19.490604+0000","last_peered":"2024-09-13T18:47:19.490604+0000","last_clean":"2024-09-13T18:47:19.490604+0000","last_became_active":"2024-09-13T18:47:15.477492+0000","last_became_peered":"2024-09-13T18:47:15.477492+0000","last_unstale":"2024-09-13T18:47:19.490604+0000","last_undegraded":"2024-09-13T18:47:19.490604+0000","last_fullsized":"2024-09-13T18:47:19.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488622+0000","last_change":"2024-09-13T18:47:15.484967+0000","last_active":"2024-09-13T18:47:19.488622+0000","last_peered":"2024-09-13T18:47:19.488622+0000","last_clean":"2024-09-13T18:47:19.488622+0000","last_became_active":"2024-09-13T18:47:15.484678+0000","last_became_peered":"2024-09-13T18:47:15.484678+0000","last_unstale":"2024-09-13T18:47:19.488622+0000","last_undegraded":"2024-09-13T18:47:19.488622+0000","last_fullsized":"2024-09-13T18:47:19.488622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488812+0000","last_change":"2024-09-13T18:47:15.486476+0000","last_active":"2024-09-13T18:47:19.488812+0000","last_peered":"2024-09-13T18:47:19.488812+0000","last_clean":"2024-09-13T18:47:19.488812+0000","last_became_active":"2024-09-13T18:47:15.478333+0000","last_became_peered":"2024-09-13T18:47:15.478333+0000","last_unstale":"2024-09-13T18:47:19.488812+0000","last_undegraded":"2024-09-13T18:47:19.488812+0000","last_fullsized":"2024-09-13T18:47:19.488812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487773+0000","last_change":"2024-09-13T18:47:15.465478+0000","last_active":"2024-09-13T18:47:19.487773+0000","last_peered":"2024-09-13T18:47:19.487773+0000","last_clean":"2024-09-13T18:47:19.487773+0000","last_became_active":"2024-09-13T18:47:15.463578+0000","last_became_peered":"2024-09-13T18:47:15.463578+0000","last_unstale":"2024-09-13T18:47:19.487773+0000","last_undegraded":"2024-09-13T18:47:19.487773+0000","last_fullsized":"2024-09-13T18:47:19.487773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500654+0000","last_change":"2024-09-13T18:47:15.480360+0000","last_active":"2024-09-13T18:47:19.500654+0000","last_peered":"2024-09-13T18:47:19.500654+0000","last_clean":"2024-09-13T18:47:19.500654+0000","last_became_active":"2024-09-13T18:47:15.480117+0000","last_became_peered":"2024-09-13T18:47:15.480117+0000","last_unstale":"2024-09-13T18:47:19.500654+0000","last_undegraded":"2024-09-13T18:47:19.500654+0000","last_fullsized":"2024-09-13T18:47:19.500654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592107+0000","last_change":"2024-09-13T18:47:15.480704+0000","last_active":"2024-09-13T18:47:19.592107+0000","last_peered":"2024-09-13T18:47:19.592107+0000","last_clean":"2024-09-13T18:47:19.592107+0000","last_became_active":"2024-09-13T18:47:15.480427+0000","last_became_peered":"2024-09-13T18:47:15.480427+0000","last_unstale":"2024-09-13T18:47:19.592107+0000","last_undegraded":"2024-09-13T18:47:19.592107+0000","last_fullsized":"2024-09-13T18:47:19.592107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499735+0000","last_change":"2024-09-13T18:47:15.483066+0000","last_active":"2024-09-13T18:47:19.499735+0000","last_peered":"2024-09-13T18:47:19.499735+0000","last_clean":"2024-09-13T18:47:19.499735+0000","last_became_active":"2024-09-13T18:47:15.482829+0000","last_became_peered":"2024-09-13T18:47:15.482829+0000","last_unstale":"2024-09-13T18:47:19.499735+0000","last_undegraded":"2024-09-13T18:47:19.499735+0000","last_fullsized":"2024-09-13T18:47:19.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489201+0000","last_change":"2024-09-13T18:47:15.480926+0000","last_active":"2024-09-13T18:47:19.489201+0000","last_peered":"2024-09-13T18:47:19.489201+0000","last_clean":"2024-09-13T18:47:19.489201+0000","last_became_active":"2024-09-13T18:47:15.475793+0000","last_became_peered":"2024-09-13T18:47:15.475793+0000","last_unstale":"2024-09-13T18:47:19.489201+0000","last_undegraded":"2024-09-13T18:47:19.489201+0000","last_fullsized":"2024-09-13T18:47:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489302+0000","last_change":"2024-09-13T18:47:15.476117+0000","last_active":"2024-09-13T18:47:19.489302+0000","last_peered":"2024-09-13T18:47:19.489302+0000","last_clean":"2024-09-13T18:47:19.489302+0000","last_became_active":"2024-09-13T18:47:15.474650+0000","last_became_peered":"2024-09-13T18:47:15.474650+0000","last_unstale":"2024-09-13T18:47:19.489302+0000","last_undegraded":"2024-09-13T18:47:19.489302+0000","last_fullsized":"2024-09-13T18:47:19.489302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492576+0000","last_change":"2024-09-13T18:47:15.462353+0000","last_active":"2024-09-13T18:47:19.492576+0000","last_peered":"2024-09-13T18:47:19.492576+0000","last_clean":"2024-09-13T18:47:19.492576+0000","last_became_active":"2024-09-13T18:47:15.462033+0000","last_became_peered":"2024-09-13T18:47:15.462033+0000","last_unstale":"2024-09-13T18:47:19.492576+0000","last_undegraded":"2024-09-13T18:47:19.492576+0000","last_fullsized":"2024-09-13T18:47:19.492576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487542+0000","last_change":"2024-09-13T18:47:15.476234+0000","last_active":"2024-09-13T18:47:19.487542+0000","last_peered":"2024-09-13T18:47:19.487542+0000","last_clean":"2024-09-13T18:47:19.487542+0000","last_became_active":"2024-09-13T18:47:15.475946+0000","last_became_peered":"2024-09-13T18:47:15.475946+0000","last_unstale":"2024-09-13T18:47:19.487542+0000","last_undegraded":"2024-09-13T18:47:19.487542+0000","last_fullsized":"2024-09-13T18:47:19.487542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487685+0000","last_change":"2024-09-13T18:47:15.467147+0000","last_active":"2024-09-13T18:47:19.487685+0000","last_peered":"2024-09-13T18:47:19.487685+0000","last_clean":"2024-09-13T18:47:19.487685+0000","last_became_active":"2024-09-13T18:47:15.466819+0000","last_became_peered":"2024-09-13T18:47:15.466819+0000","last_unstale":"2024-09-13T18:47:19.487685+0000","last_undegraded":"2024-09-13T18:47:19.487685+0000","last_fullsized":"2024-09-13T18:47:19.487685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497332+0000","last_change":"2024-09-13T18:47:15.465815+0000","last_active":"2024-09-13T18:47:19.497332+0000","last_peered":"2024-09-13T18:47:19.497332+0000","last_clean":"2024-09-13T18:47:19.497332+0000","last_became_active":"2024-09-13T18:47:15.464960+0000","last_became_peered":"2024-09-13T18:47:15.464960+0000","last_unstale":"2024-09-13T18:47:19.497332+0000","last_undegraded":"2024-09-13T18:47:19.497332+0000","last_fullsized":"2024-09-13T18:47:19.497332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.346283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500854+0000","last_change":"2024-09-13T18:47:15.482526+0000","last_active":"2024-09-13T18:47:19.500854+0000","last_peered":"2024-09-13T18:47:19.500854+0000","last_clean":"2024-09-13T18:47:19.500854+0000","last_became_active":"2024-09-13T18:47:15.482236+0000","last_became_peered":"2024-09-13T18:47:15.482236+0000","last_unstale":"2024-09-13T18:47:19.500854+0000","last_undegraded":"2024-09-13T18:47:19.500854+0000","last_fullsized":"2024-09-13T18:47:19.500854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500973+0000","last_change":"2024-09-13T18:47:15.498504+0000","last_active":"2024-09-13T18:47:19.500973+0000","last_peered":"2024-09-13T18:47:19.500973+0000","last_clean":"2024-09-13T18:47:19.500973+0000","last_became_active":"2024-09-13T18:47:15.490041+0000","last_became_peered":"2024-09-13T18:47:15.490041+0000","last_unstale":"2024-09-13T18:47:19.500973+0000","last_undegraded":"2024-09-13T18:47:19.500973+0000","last_fullsized":"2024-09-13T18:47:19.500973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592385+0000","last_change":"2024-09-13T18:47:15.495466+0000","last_active":"2024-09-13T18:47:19.592385+0000","last_peered":"2024-09-13T18:47:19.592385+0000","last_clean":"2024-09-13T18:47:19.592385+0000","last_became_active":"2024-09-13T18:47:15.495197+0000","last_became_peered":"2024-09-13T18:47:15.495197+0000","last_unstale":"2024-09-13T18:47:19.592385+0000","last_undegraded":"2024-09-13T18:47:19.592385+0000","last_fullsized":"2024-09-13T18:47:19.592385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487124+0000","last_change":"2024-09-13T18:47:15.474386+0000","last_active":"2024-09-13T18:47:19.487124+0000","last_peered":"2024-09-13T18:47:19.487124+0000","last_clean":"2024-09-13T18:47:19.487124+0000","last_became_active":"2024-09-13T18:47:15.473414+0000","last_became_peered":"2024-09-13T18:47:15.473414+0000","last_unstale":"2024-09-13T18:47:19.487124+0000","last_undegraded":"2024-09-13T18:47:19.487124+0000","last_fullsized":"2024-09-13T18:47:19.487124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591466+0000","last_change":"2024-09-13T18:47:15.469797+0000","last_active":"2024-09-13T18:47:19.591466+0000","last_peered":"2024-09-13T18:47:19.591466+0000","last_clean":"2024-09-13T18:47:19.591466+0000","last_became_active":"2024-09-13T18:47:15.469460+0000","last_became_peered":"2024-09-13T18:47:15.469460+0000","last_unstale":"2024-09-13T18:47:19.591466+0000","last_undegraded":"2024-09-13T18:47:19.591466+0000","last_fullsized":"2024-09-13T18:47:19.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488705+0000","last_change":"2024-09-13T18:47:15.483840+0000","last_active":"2024-09-13T18:47:19.488705+0000","last_peered":"2024-09-13T18:47:19.488705+0000","last_clean":"2024-09-13T18:47:19.488705+0000","last_became_active":"2024-09-13T18:47:15.478139+0000","last_became_peered":"2024-09-13T18:47:15.478139+0000","last_unstale":"2024-09-13T18:47:19.488705+0000","last_undegraded":"2024-09-13T18:47:19.488705+0000","last_fullsized":"2024-09-13T18:47:19.488705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591973+0000","last_change":"2024-09-13T18:47:15.484385+0000","last_active":"2024-09-13T18:47:19.591973+0000","last_peered":"2024-09-13T18:47:19.591973+0000","last_clean":"2024-09-13T18:47:19.591973+0000","last_became_active":"2024-09-13T18:47:15.477424+0000","last_became_peered":"2024-09-13T18:47:15.477424+0000","last_unstale":"2024-09-13T18:47:19.591973+0000","last_undegraded":"2024-09-13T18:47:19.591973+0000","last_fullsized":"2024-09-13T18:47:19.591973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488909+0000","last_change":"2024-09-13T18:47:15.477871+0000","last_active":"2024-09-13T18:47:19.488909+0000","last_peered":"2024-09-13T18:47:19.488909+0000","last_clean":"2024-09-13T18:47:19.488909+0000","last_became_active":"2024-09-13T18:47:15.474849+0000","last_became_peered":"2024-09-13T18:47:15.474849+0000","last_unstale":"2024-09-13T18:47:19.488909+0000","last_undegraded":"2024-09-13T18:47:19.488909+0000","last_fullsized":"2024-09-13T18:47:19.488909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487837+0000","last_change":"2024-09-13T18:47:15.464724+0000","last_active":"2024-09-13T18:47:19.487837+0000","last_peered":"2024-09-13T18:47:19.487837+0000","last_clean":"2024-09-13T18:47:19.487837+0000","last_became_active":"2024-09-13T18:47:15.463105+0000","last_became_peered":"2024-09-13T18:47:15.463105+0000","last_unstale":"2024-09-13T18:47:19.487837+0000","last_undegraded":"2024-09-13T18:47:19.487837+0000","last_fullsized":"2024-09-13T18:47:19.487837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:15.445388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493023+0000","last_change":"2024-09-13T18:47:15.476846+0000","last_active":"2024-09-13T18:47:19.493023+0000","last_peered":"2024-09-13T18:47:19.493023+0000","last_clean":"2024-09-13T18:47:19.493023+0000","last_became_active":"2024-09-13T18:47:15.476551+0000","last_became_peered":"2024-09-13T18:47:15.476551+0000","last_unstale":"2024-09-13T18:47:19.493023+0000","last_undegraded":"2024-09-13T18:47:19.493023+0000","last_fullsized":"2024-09-13T18:47:19.493023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592316+0000","last_change":"2024-09-13T18:47:15.496912+0000","last_active":"2024-09-13T18:47:19.592316+0000","last_peered":"2024-09-13T18:47:19.592316+0000","last_clean":"2024-09-13T18:47:19.592316+0000","last_became_active":"2024-09-13T18:47:15.496644+0000","last_became_peered":"2024-09-13T18:47:15.496644+0000","last_unstale":"2024-09-13T18:47:19.592316+0000","last_undegraded":"2024-09-13T18:47:19.592316+0000","last_fullsized":"2024-09-13T18:47:19.592316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:36.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:37.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f6862200700 1 Processor -- start 2024-09-13T18:47:37.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f6862200700 1 -- start start 2024-09-13T18:47:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f6862200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f685c0b19f0 0x7f685c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f6862200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0ce140 con 0x7f685c06a5d0 2024-09-13T18:47:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f6862200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0b1e40 con 0x7f685c071d20 2024-09-13T18:47:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f6862200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f685c0cde60 con 0x7f685c0b19f0 2024-09-13T18:47:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f685be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f685c0b19f0 0x7f685c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f685be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f685c0b19f0 0x7f685c06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46946/0 (socket says 172.21.15.81:46946) 2024-09-13T18:47:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f685be00700 1 -- 172.21.15.81:0/2061696487 learned_addr learned my addr 172.21.15.81:0/2061696487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f685be00700 1 -- 172.21.15.81:0/2061696487 >> v1:172.21.15.178:6789/0 conn(0x7f685c071d20 legacy=0x7f685c0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f685be00700 1 -- 172.21.15.81:0/2061696487 >> v1:172.21.15.81:6789/0 conn(0x7f685c06a5d0 legacy=0x7f685c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.114+0000 7f685be00700 1 -- 172.21.15.81:0/2061696487 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c06c3b0 con 0x7f685c0b19f0 2024-09-13T18:47:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f685be00700 1 --2- 172.21.15.81:0/2061696487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c0b19f0 0x7f685c06ce90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6854009e50 tx=0x7f685400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6be3e4ccd12fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f685a000700 1 -- 172.21.15.81:0/2061696487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400e070 con 0x7f685c0b19f0 2024-09-13T18:47:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f685a000700 1 -- 172.21.15.81:0/2061696487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685400b9c0 con 0x7f685c0b19f0 2024-09-13T18:47:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f685a000700 1 -- 172.21.15.81:0/2061696487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400bd70 con 0x7f685c0b19f0 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 -- 172.21.15.81:0/2061696487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c0b19f0 msgr2=0x7f685c06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 --2- 172.21.15.81:0/2061696487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c0b19f0 0x7f685c06ce90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6854009e50 tx=0x7f685400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 -- 172.21.15.81:0/2061696487 shutdown_connections 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 --2- 172.21.15.81:0/2061696487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c0b19f0 0x7f685c06ce90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 -- 172.21.15.81:0/2061696487 >> 172.21.15.81:0/2061696487 conn(0x7f685c0b08d0 msgr2=0x7f685c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 -- 172.21.15.81:0/2061696487 shutdown_connections 2024-09-13T18:47:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.118+0000 7f6862200700 1 -- 172.21.15.81:0/2061696487 wait complete. 2024-09-13T18:47:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 Processor -- start 2024-09-13T18:47:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 -- start start 2024-09-13T18:47:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f685c06a5d0 0x7f685c1f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 0x7f685c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f685c0b19f0 0x7f685c1e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1416b0 con 0x7f685c071d20 2024-09-13T18:47:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1ebf50 con 0x7f685c06a5d0 2024-09-13T18:47:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f6862200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c1f7a20 con 0x7f685c0b19f0 2024-09-13T18:47:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 0x7f685c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 0x7f685c160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46956/0 (socket says 172.21.15.81:46956) 2024-09-13T18:47:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 -- 172.21.15.81:0/2278882097 learned_addr learned my addr 172.21.15.81:0/2278882097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685be00700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f685c0b19f0 0x7f685c1e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685b400700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f685c06a5d0 0x7f685c1f74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 -- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f685c0b19f0 msgr2=0x7f685c1e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f685c0b19f0 0x7f685c1e9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 -- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f685c06a5d0 msgr2=0x7f685c1f74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f685c06a5d0 0x7f685c1f74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.122+0000 7f685aa00700 1 -- 172.21.15.81:0/2278882097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009b30 con 0x7f685c071d20 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f685aa00700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 0x7f685c160ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f684800c500 tx=0x7f684800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480052d0 con 0x7f685c071d20 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848005430 con 0x7f685c071d20 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480055a0 con 0x7f685c071d20 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f685c1ec660 con 0x7f685c071d20 2024-09-13T18:47:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c1412d0 con 0x7f685c071d20 2024-09-13T18:47:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c1417f0 con 0x7f685c071d20 2024-09-13T18:47:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.126+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68480038e0 con 0x7f685c071d20 2024-09-13T18:47:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.130+0000 7f6853400700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f683c066730 0x7f683c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.130+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6848083960 con 0x7f685c071d20 2024-09-13T18:47:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.130+0000 7f685b400700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f683c066730 0x7f683c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.130+0000 7f685b400700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f683c066730 0x7f683c068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f684c000f60 tx=0x7f684c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.138+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f685c1417f0 con 0x7f685c071d20 2024-09-13T18:47:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.322+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f685c14afb0 con 0x7f683c066730 2024-09-13T18:47:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.334+0000 7f6853400700 1 -- 172.21.15.81:0/2278882097 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345119 (secure 0 0 0) 0x7f684c0050d0 con 0x7f683c066730 2024-09-13T18:47:37.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:37.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f683c066730 msgr2=0x7f683c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f683c066730 0x7f683c068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f684c000f60 tx=0x7f684c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:37.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 msgr2=0x7f685c160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 0x7f685c160ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f684800c500 tx=0x7f684800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 shutdown_connections 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f683c066730 0x7f683c068bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f685c0b19f0 0x7f685c1e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f685c071d20 0x7f685c160ae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 --2- 172.21.15.81:0/2278882097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f685c06a5d0 0x7f685c1f74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 >> 172.21.15.81:0/2278882097 conn(0x7f685c0b08d0 msgr2=0x7f685c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 shutdown_connections 2024-09-13T18:47:37.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.342+0000 7f6862200700 1 -- 172.21.15.81:0/2278882097 wait complete. 2024-09-13T18:47:37.355 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:47:37.375 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-13T18:47:36.975572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227568,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747152,"statfs":{"total":773094113280,"available":772861083648,"internally_reserved":0,"allocated":3284992,"data_stored":1987880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004297"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491815+0000","last_change":"2024-09-13T18:47:14.995976+0000","last_active":"2024-09-13T18:47:19.491815+0000","last_peered":"2024-09-13T18:47:19.491815+0000","last_clean":"2024-09-13T18:47:19.491815+0000","last_became_active":"2024-09-13T18:47:14.995706+0000","last_became_peered":"2024-09-13T18:47:14.995706+0000","last_unstale":"2024-09-13T18:47:19.491815+0000","last_undegraded":"2024-09-13T18:47:19.491815+0000","last_fullsized":"2024-09-13T18:47:19.491815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:18.193015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487329+0000","last_change":"2024-09-13T18:47:15.484957+0000","last_active":"2024-09-13T18:47:19.487329+0000","last_peered":"2024-09-13T18:47:19.487329+0000","last_clean":"2024-09-13T18:47:19.487329+0000","last_became_active":"2024-09-13T18:47:15.484720+0000","last_became_peered":"2024-09-13T18:47:15.484720+0000","last_unstale":"2024-09-13T18:47:19.487329+0000","last_undegraded":"2024-09-13T18:47:19.487329+0000","last_fullsized":"2024-09-13T18:47:19.487329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961870+0000","last_change":"2024-09-13T18:47:19.593844+0000","last_active":"2024-09-13T18:47:19.961870+0000","last_peered":"2024-09-13T18:47:19.961870+0000","last_clean":"2024-09-13T18:47:19.961870+0000","last_became_active":"2024-09-13T18:47:19.591052+0000","last_became_peered":"2024-09-13T18:47:19.591052+0000","last_unstale":"2024-09-13T18:47:19.961870+0000","last_undegraded":"2024-09-13T18:47:19.961870+0000","last_fullsized":"2024-09-13T18:47:19.961870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:05.476346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487465+0000","last_change":"2024-09-13T18:47:14.991104+0000","last_active":"2024-09-13T18:47:19.487465+0000","last_peered":"2024-09-13T18:47:19.487465+0000","last_clean":"2024-09-13T18:47:19.487465+0000","last_became_active":"2024-09-13T18:47:14.990785+0000","last_became_peered":"2024-09-13T18:47:14.990785+0000","last_unstale":"2024-09-13T18:47:19.487465+0000","last_undegraded":"2024-09-13T18:47:19.487465+0000","last_fullsized":"2024-09-13T18:47:19.487465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.795074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491728+0000","last_change":"2024-09-13T18:47:15.478881+0000","last_active":"2024-09-13T18:47:19.491728+0000","last_peered":"2024-09-13T18:47:19.491728+0000","last_clean":"2024-09-13T18:47:19.491728+0000","last_became_active":"2024-09-13T18:47:15.478630+0000","last_became_peered":"2024-09-13T18:47:15.478630+0000","last_unstale":"2024-09-13T18:47:19.491728+0000","last_undegraded":"2024-09-13T18:47:19.491728+0000","last_fullsized":"2024-09-13T18:47:19.491728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:13.833360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089448+0000","last_change":"2024-09-13T18:47:19.506466+0000","last_active":"2024-09-13T18:47:20.089448+0000","last_peered":"2024-09-13T18:47:20.089448+0000","last_clean":"2024-09-13T18:47:20.089448+0000","last_became_active":"2024-09-13T18:47:19.505998+0000","last_became_peered":"2024-09-13T18:47:19.505998+0000","last_unstale":"2024-09-13T18:47:20.089448+0000","last_undegraded":"2024-09-13T18:47:20.089448+0000","last_fullsized":"2024-09-13T18:47:20.089448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:12.843575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592163+0000","last_change":"2024-09-13T18:47:15.007303+0000","last_active":"2024-09-13T18:47:19.592163+0000","last_peered":"2024-09-13T18:47:19.592163+0000","last_clean":"2024-09-13T18:47:19.592163+0000","last_became_active":"2024-09-13T18:47:15.006847+0000","last_became_peered":"2024-09-13T18:47:15.006847+0000","last_unstale":"2024-09-13T18:47:19.592163+0000","last_undegraded":"2024-09-13T18:47:19.592163+0000","last_fullsized":"2024-09-13T18:47:19.592163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:41.820844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489015+0000","last_change":"2024-09-13T18:47:15.482116+0000","last_active":"2024-09-13T18:47:19.489015+0000","last_peered":"2024-09-13T18:47:19.489015+0000","last_clean":"2024-09-13T18:47:19.489015+0000","last_became_active":"2024-09-13T18:47:15.481869+0000","last_became_peered":"2024-09-13T18:47:15.481869+0000","last_unstale":"2024-09-13T18:47:19.489015+0000","last_undegraded":"2024-09-13T18:47:19.489015+0000","last_fullsized":"2024-09-13T18:47:19.489015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089608+0000","last_change":"2024-09-13T18:47:19.509850+0000","last_active":"2024-09-13T18:47:20.089608+0000","last_peered":"2024-09-13T18:47:20.089608+0000","last_clean":"2024-09-13T18:47:20.089608+0000","last_became_active":"2024-09-13T18:47:19.509444+0000","last_became_peered":"2024-09-13T18:47:19.509444+0000","last_unstale":"2024-09-13T18:47:20.089608+0000","last_undegraded":"2024-09-13T18:47:20.089608+0000","last_fullsized":"2024-09-13T18:47:20.089608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591632+0000","last_change":"2024-09-13T18:47:15.002453+0000","last_active":"2024-09-13T18:47:19.591632+0000","last_peered":"2024-09-13T18:47:19.591632+0000","last_clean":"2024-09-13T18:47:19.591632+0000","last_became_active":"2024-09-13T18:47:15.002127+0000","last_became_peered":"2024-09-13T18:47:15.002127+0000","last_unstale":"2024-09-13T18:47:19.591632+0000","last_undegraded":"2024-09-13T18:47:19.591632+0000","last_fullsized":"2024-09-13T18:47:19.591632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:18.452266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490093+0000","last_change":"2024-09-13T18:47:15.477221+0000","last_active":"2024-09-13T18:47:19.490093+0000","last_peered":"2024-09-13T18:47:19.490093+0000","last_clean":"2024-09-13T18:47:19.490093+0000","last_became_active":"2024-09-13T18:47:15.475771+0000","last_became_peered":"2024-09-13T18:47:15.475771+0000","last_unstale":"2024-09-13T18:47:19.490093+0000","last_undegraded":"2024-09-13T18:47:19.490093+0000","last_fullsized":"2024-09-13T18:47:19.490093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090621+0000","last_change":"2024-09-13T18:47:19.513245+0000","last_active":"2024-09-13T18:47:20.090621+0000","last_peered":"2024-09-13T18:47:20.090621+0000","last_clean":"2024-09-13T18:47:20.090621+0000","last_became_active":"2024-09-13T18:47:19.512719+0000","last_became_peered":"2024-09-13T18:47:19.512719+0000","last_unstale":"2024-09-13T18:47:20.090621+0000","last_undegraded":"2024-09-13T18:47:20.090621+0000","last_fullsized":"2024-09-13T18:47:20.090621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499018+0000","last_change":"2024-09-13T18:47:15.481298+0000","last_active":"2024-09-13T18:47:19.499018+0000","last_peered":"2024-09-13T18:47:19.499018+0000","last_clean":"2024-09-13T18:47:19.499018+0000","last_became_active":"2024-09-13T18:47:15.481041+0000","last_became_peered":"2024-09-13T18:47:15.481041+0000","last_unstale":"2024-09-13T18:47:19.499018+0000","last_undegraded":"2024-09-13T18:47:19.499018+0000","last_fullsized":"2024-09-13T18:47:19.499018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592125+0000","last_change":"2024-09-13T18:47:15.004858+0000","last_active":"2024-09-13T18:47:19.592125+0000","last_peered":"2024-09-13T18:47:19.592125+0000","last_clean":"2024-09-13T18:47:19.592125+0000","last_became_active":"2024-09-13T18:47:15.004589+0000","last_became_peered":"2024-09-13T18:47:15.004589+0000","last_unstale":"2024-09-13T18:47:19.592125+0000","last_undegraded":"2024-09-13T18:47:19.592125+0000","last_fullsized":"2024-09-13T18:47:19.592125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093955+0000","last_change":"2024-09-13T18:47:19.514214+0000","last_active":"2024-09-13T18:47:20.093955+0000","last_peered":"2024-09-13T18:47:20.093955+0000","last_clean":"2024-09-13T18:47:20.093955+0000","last_became_active":"2024-09-13T18:47:19.513786+0000","last_became_peered":"2024-09-13T18:47:19.513786+0000","last_unstale":"2024-09-13T18:47:20.093955+0000","last_undegraded":"2024-09-13T18:47:20.093955+0000","last_fullsized":"2024-09-13T18:47:20.093955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:47.811667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487784+0000","last_change":"2024-09-13T18:47:15.472641+0000","last_active":"2024-09-13T18:47:19.487784+0000","last_peered":"2024-09-13T18:47:19.487784+0000","last_clean":"2024-09-13T18:47:19.487784+0000","last_became_active":"2024-09-13T18:47:15.472397+0000","last_became_peered":"2024-09-13T18:47:15.472397+0000","last_unstale":"2024-09-13T18:47:19.487784+0000","last_undegraded":"2024-09-13T18:47:19.487784+0000","last_fullsized":"2024-09-13T18:47:19.487784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493540+0000","last_change":"2024-09-13T18:47:14.983697+0000","last_active":"2024-09-13T18:47:19.493540+0000","last_peered":"2024-09-13T18:47:19.493540+0000","last_clean":"2024-09-13T18:47:19.493540+0000","last_became_active":"2024-09-13T18:47:14.983443+0000","last_became_peered":"2024-09-13T18:47:14.983443+0000","last_unstale":"2024-09-13T18:47:19.493540+0000","last_undegraded":"2024-09-13T18:47:19.493540+0000","last_fullsized":"2024-09-13T18:47:19.493540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089265+0000","last_change":"2024-09-13T18:47:19.511041+0000","last_active":"2024-09-13T18:47:20.089265+0000","last_peered":"2024-09-13T18:47:20.089265+0000","last_clean":"2024-09-13T18:47:20.089265+0000","last_became_active":"2024-09-13T18:47:19.510682+0000","last_became_peered":"2024-09-13T18:47:19.510682+0000","last_unstale":"2024-09-13T18:47:20.089265+0000","last_undegraded":"2024-09-13T18:47:20.089265+0000","last_fullsized":"2024-09-13T18:47:20.089265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487319+0000","last_change":"2024-09-13T18:47:15.487483+0000","last_active":"2024-09-13T18:47:19.487319+0000","last_peered":"2024-09-13T18:47:19.487319+0000","last_clean":"2024-09-13T18:47:19.487319+0000","last_became_active":"2024-09-13T18:47:15.481535+0000","last_became_peered":"2024-09-13T18:47:15.481535+0000","last_unstale":"2024-09-13T18:47:19.487319+0000","last_undegraded":"2024-09-13T18:47:19.487319+0000","last_fullsized":"2024-09-13T18:47:19.487319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492990+0000","last_change":"2024-09-13T18:47:14.995731+0000","last_active":"2024-09-13T18:47:19.492990+0000","last_peered":"2024-09-13T18:47:19.492990+0000","last_clean":"2024-09-13T18:47:19.492990+0000","last_became_active":"2024-09-13T18:47:14.995401+0000","last_became_peered":"2024-09-13T18:47:14.995401+0000","last_unstale":"2024-09-13T18:47:19.492990+0000","last_undegraded":"2024-09-13T18:47:19.492990+0000","last_fullsized":"2024-09-13T18:47:19.492990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083631+0000","last_change":"2024-09-13T18:47:19.594879+0000","last_active":"2024-09-13T18:47:20.083631+0000","last_peered":"2024-09-13T18:47:20.083631+0000","last_clean":"2024-09-13T18:47:20.083631+0000","last_became_active":"2024-09-13T18:47:19.594314+0000","last_became_peered":"2024-09-13T18:47:19.594314+0000","last_unstale":"2024-09-13T18:47:20.083631+0000","last_undegraded":"2024-09-13T18:47:20.083631+0000","last_fullsized":"2024-09-13T18:47:20.083631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492372+0000","last_change":"2024-09-13T18:47:15.463467+0000","last_active":"2024-09-13T18:47:19.492372+0000","last_peered":"2024-09-13T18:47:19.492372+0000","last_clean":"2024-09-13T18:47:19.492372+0000","last_became_active":"2024-09-13T18:47:15.463197+0000","last_became_peered":"2024-09-13T18:47:15.463197+0000","last_unstale":"2024-09-13T18:47:19.492372+0000","last_undegraded":"2024-09-13T18:47:19.492372+0000","last_fullsized":"2024-09-13T18:47:19.492372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:05.037494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591200+0000","last_change":"2024-09-13T18:47:15.007100+0000","last_active":"2024-09-13T18:47:19.591200+0000","last_peered":"2024-09-13T18:47:19.591200+0000","last_clean":"2024-09-13T18:47:19.591200+0000","last_became_active":"2024-09-13T18:47:15.002832+0000","last_became_peered":"2024-09-13T18:47:15.002832+0000","last_unstale":"2024-09-13T18:47:19.591200+0000","last_undegraded":"2024-09-13T18:47:19.591200+0000","last_fullsized":"2024-09-13T18:47:19.591200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093085+0000","last_change":"2024-09-13T18:47:19.512627+0000","last_active":"2024-09-13T18:47:20.093085+0000","last_peered":"2024-09-13T18:47:20.093085+0000","last_clean":"2024-09-13T18:47:20.093085+0000","last_became_active":"2024-09-13T18:47:19.512153+0000","last_became_peered":"2024-09-13T18:47:19.512153+0000","last_unstale":"2024-09-13T18:47:20.093085+0000","last_undegraded":"2024-09-13T18:47:20.093085+0000","last_fullsized":"2024-09-13T18:47:20.093085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491322+0000","last_change":"2024-09-13T18:47:15.475389+0000","last_active":"2024-09-13T18:47:19.491322+0000","last_peered":"2024-09-13T18:47:19.491322+0000","last_clean":"2024-09-13T18:47:19.491322+0000","last_became_active":"2024-09-13T18:47:15.475119+0000","last_became_peered":"2024-09-13T18:47:15.475119+0000","last_unstale":"2024-09-13T18:47:19.491322+0000","last_undegraded":"2024-09-13T18:47:19.491322+0000","last_fullsized":"2024-09-13T18:47:19.491322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501582+0000","last_change":"2024-09-13T18:47:15.002258+0000","last_active":"2024-09-13T18:47:19.501582+0000","last_peered":"2024-09-13T18:47:19.501582+0000","last_clean":"2024-09-13T18:47:19.501582+0000","last_became_active":"2024-09-13T18:47:15.001885+0000","last_became_peered":"2024-09-13T18:47:15.001885+0000","last_unstale":"2024-09-13T18:47:19.501582+0000","last_undegraded":"2024-09-13T18:47:19.501582+0000","last_fullsized":"2024-09-13T18:47:19.501582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089874+0000","last_change":"2024-09-13T18:47:19.600283+0000","last_active":"2024-09-13T18:47:20.089874+0000","last_peered":"2024-09-13T18:47:20.089874+0000","last_clean":"2024-09-13T18:47:20.089874+0000","last_became_active":"2024-09-13T18:47:19.598652+0000","last_became_peered":"2024-09-13T18:47:19.598652+0000","last_unstale":"2024-09-13T18:47:20.089874+0000","last_undegraded":"2024-09-13T18:47:20.089874+0000","last_fullsized":"2024-09-13T18:47:20.089874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:29.767904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488008+0000","last_change":"2024-09-13T18:47:15.472100+0000","last_active":"2024-09-13T18:47:19.488008+0000","last_peered":"2024-09-13T18:47:19.488008+0000","last_clean":"2024-09-13T18:47:19.488008+0000","last_became_active":"2024-09-13T18:47:15.470896+0000","last_became_peered":"2024-09-13T18:47:15.470896+0000","last_unstale":"2024-09-13T18:47:19.488008+0000","last_undegraded":"2024-09-13T18:47:19.488008+0000","last_fullsized":"2024-09-13T18:47:19.488008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.915538+0000","last_change":"2024-09-13T18:47:14.993205+0000","last_active":"2024-09-13T18:47:19.915538+0000","last_peered":"2024-09-13T18:47:19.915538+0000","last_clean":"2024-09-13T18:47:19.915538+0000","last_became_active":"2024-09-13T18:47:14.992192+0000","last_became_peered":"2024-09-13T18:47:14.992192+0000","last_unstale":"2024-09-13T18:47:19.915538+0000","last_undegraded":"2024-09-13T18:47:19.915538+0000","last_fullsized":"2024-09-13T18:47:19.915538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961562+0000","last_change":"2024-09-13T18:47:19.591216+0000","last_active":"2024-09-13T18:47:19.961562+0000","last_peered":"2024-09-13T18:47:19.961562+0000","last_clean":"2024-09-13T18:47:19.961562+0000","last_became_active":"2024-09-13T18:47:19.590770+0000","last_became_peered":"2024-09-13T18:47:19.590770+0000","last_unstale":"2024-09-13T18:47:19.961562+0000","last_undegraded":"2024-09-13T18:47:19.961562+0000","last_fullsized":"2024-09-13T18:47:19.961562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:46.641313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496179+0000","last_change":"2024-09-13T18:47:15.460995+0000","last_active":"2024-09-13T18:47:19.496179+0000","last_peered":"2024-09-13T18:47:19.496179+0000","last_clean":"2024-09-13T18:47:19.496179+0000","last_became_active":"2024-09-13T18:47:15.460641+0000","last_became_peered":"2024-09-13T18:47:15.460641+0000","last_unstale":"2024-09-13T18:47:19.496179+0000","last_undegraded":"2024-09-13T18:47:19.496179+0000","last_fullsized":"2024-09-13T18:47:19.496179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592272+0000","last_change":"2024-09-13T18:47:15.010681+0000","last_active":"2024-09-13T18:47:19.592272+0000","last_peered":"2024-09-13T18:47:19.592272+0000","last_clean":"2024-09-13T18:47:19.592272+0000","last_became_active":"2024-09-13T18:47:15.010462+0000","last_became_peered":"2024-09-13T18:47:15.010462+0000","last_unstale":"2024-09-13T18:47:19.592272+0000","last_undegraded":"2024-09-13T18:47:19.592272+0000","last_fullsized":"2024-09-13T18:47:19.592272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961765+0000","last_change":"2024-09-13T18:47:19.592197+0000","last_active":"2024-09-13T18:47:19.961765+0000","last_peered":"2024-09-13T18:47:19.961765+0000","last_clean":"2024-09-13T18:47:19.961765+0000","last_became_active":"2024-09-13T18:47:19.591271+0000","last_became_peered":"2024-09-13T18:47:19.591271+0000","last_unstale":"2024-09-13T18:47:19.961765+0000","last_undegraded":"2024-09-13T18:47:19.961765+0000","last_fullsized":"2024-09-13T18:47:19.961765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489858+0000","last_change":"2024-09-13T18:47:15.477286+0000","last_active":"2024-09-13T18:47:19.489858+0000","last_peered":"2024-09-13T18:47:19.489858+0000","last_clean":"2024-09-13T18:47:19.489858+0000","last_became_active":"2024-09-13T18:47:15.477017+0000","last_became_peered":"2024-09-13T18:47:15.477017+0000","last_unstale":"2024-09-13T18:47:19.489858+0000","last_undegraded":"2024-09-13T18:47:19.489858+0000","last_fullsized":"2024-09-13T18:47:19.489858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496254+0000","last_change":"2024-09-13T18:47:14.979483+0000","last_active":"2024-09-13T18:47:19.496254+0000","last_peered":"2024-09-13T18:47:19.496254+0000","last_clean":"2024-09-13T18:47:19.496254+0000","last_became_active":"2024-09-13T18:47:14.979179+0000","last_became_peered":"2024-09-13T18:47:14.979179+0000","last_unstale":"2024-09-13T18:47:19.496254+0000","last_undegraded":"2024-09-13T18:47:19.496254+0000","last_fullsized":"2024-09-13T18:47:19.496254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.082807+0000","last_change":"2024-09-13T18:47:19.515192+0000","last_active":"2024-09-13T18:47:20.082807+0000","last_peered":"2024-09-13T18:47:20.082807+0000","last_clean":"2024-09-13T18:47:20.082807+0000","last_became_active":"2024-09-13T18:47:19.514784+0000","last_became_peered":"2024-09-13T18:47:19.514784+0000","last_unstale":"2024-09-13T18:47:20.082807+0000","last_undegraded":"2024-09-13T18:47:20.082807+0000","last_fullsized":"2024-09-13T18:47:20.082807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498864+0000","last_change":"2024-09-13T18:47:15.475155+0000","last_active":"2024-09-13T18:47:19.498864+0000","last_peered":"2024-09-13T18:47:19.498864+0000","last_clean":"2024-09-13T18:47:19.498864+0000","last_became_active":"2024-09-13T18:47:15.472919+0000","last_became_peered":"2024-09-13T18:47:15.472919+0000","last_unstale":"2024-09-13T18:47:19.498864+0000","last_undegraded":"2024-09-13T18:47:19.498864+0000","last_fullsized":"2024-09-13T18:47:19.498864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:42.832696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489690+0000","last_change":"2024-09-13T18:47:14.989036+0000","last_active":"2024-09-13T18:47:19.489690+0000","last_peered":"2024-09-13T18:47:19.489690+0000","last_clean":"2024-09-13T18:47:19.489690+0000","last_became_active":"2024-09-13T18:47:14.988570+0000","last_became_peered":"2024-09-13T18:47:14.988570+0000","last_unstale":"2024-09-13T18:47:19.489690+0000","last_undegraded":"2024-09-13T18:47:19.489690+0000","last_fullsized":"2024-09-13T18:47:19.489690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083437+0000","last_change":"2024-09-13T18:47:19.517431+0000","last_active":"2024-09-13T18:47:20.083437+0000","last_peered":"2024-09-13T18:47:20.083437+0000","last_clean":"2024-09-13T18:47:20.083437+0000","last_became_active":"2024-09-13T18:47:19.517085+0000","last_became_peered":"2024-09-13T18:47:19.517085+0000","last_unstale":"2024-09-13T18:47:20.083437+0000","last_undegraded":"2024-09-13T18:47:20.083437+0000","last_fullsized":"2024-09-13T18:47:20.083437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492896+0000","last_change":"2024-09-13T18:47:15.467657+0000","last_active":"2024-09-13T18:47:19.492896+0000","last_peered":"2024-09-13T18:47:19.492896+0000","last_clean":"2024-09-13T18:47:19.492896+0000","last_became_active":"2024-09-13T18:47:15.467436+0000","last_became_peered":"2024-09-13T18:47:15.467436+0000","last_unstale":"2024-09-13T18:47:19.492896+0000","last_undegraded":"2024-09-13T18:47:19.492896+0000","last_fullsized":"2024-09-13T18:47:19.492896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498237+0000","last_change":"2024-09-13T18:47:14.987619+0000","last_active":"2024-09-13T18:47:19.498237+0000","last_peered":"2024-09-13T18:47:19.498237+0000","last_clean":"2024-09-13T18:47:19.498237+0000","last_became_active":"2024-09-13T18:47:14.987294+0000","last_became_peered":"2024-09-13T18:47:14.987294+0000","last_unstale":"2024-09-13T18:47:19.498237+0000","last_undegraded":"2024-09-13T18:47:19.498237+0000","last_fullsized":"2024-09-13T18:47:19.498237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083730+0000","last_change":"2024-09-13T18:47:19.512260+0000","last_active":"2024-09-13T18:47:20.083730+0000","last_peered":"2024-09-13T18:47:20.083730+0000","last_clean":"2024-09-13T18:47:20.083730+0000","last_became_active":"2024-09-13T18:47:19.511869+0000","last_became_peered":"2024-09-13T18:47:19.511869+0000","last_unstale":"2024-09-13T18:47:20.083730+0000","last_undegraded":"2024-09-13T18:47:20.083730+0000","last_fullsized":"2024-09-13T18:47:20.083730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.483967+0000","last_change":"2024-09-13T18:47:15.469232+0000","last_active":"2024-09-13T18:47:19.483967+0000","last_peered":"2024-09-13T18:47:19.483967+0000","last_clean":"2024-09-13T18:47:19.483967+0000","last_became_active":"2024-09-13T18:47:15.469087+0000","last_became_peered":"2024-09-13T18:47:15.469087+0000","last_unstale":"2024-09-13T18:47:19.483967+0000","last_undegraded":"2024-09-13T18:47:19.483967+0000","last_fullsized":"2024-09-13T18:47:19.483967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591340+0000","last_change":"2024-09-13T18:47:15.007648+0000","last_active":"2024-09-13T18:47:19.591340+0000","last_peered":"2024-09-13T18:47:19.591340+0000","last_clean":"2024-09-13T18:47:19.591340+0000","last_became_active":"2024-09-13T18:47:15.006632+0000","last_became_peered":"2024-09-13T18:47:15.006632+0000","last_unstale":"2024-09-13T18:47:19.591340+0000","last_undegraded":"2024-09-13T18:47:19.591340+0000","last_fullsized":"2024-09-13T18:47:19.591340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963378+0000","last_change":"2024-09-13T18:47:19.591686+0000","last_active":"2024-09-13T18:47:19.963378+0000","last_peered":"2024-09-13T18:47:19.963378+0000","last_clean":"2024-09-13T18:47:19.963378+0000","last_became_active":"2024-09-13T18:47:19.590830+0000","last_became_peered":"2024-09-13T18:47:19.590830+0000","last_unstale":"2024-09-13T18:47:19.963378+0000","last_undegraded":"2024-09-13T18:47:19.963378+0000","last_fullsized":"2024-09-13T18:47:19.963378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487530+0000","last_change":"2024-09-13T18:47:15.480640+0000","last_active":"2024-09-13T18:47:19.487530+0000","last_peered":"2024-09-13T18:47:19.487530+0000","last_clean":"2024-09-13T18:47:19.487530+0000","last_became_active":"2024-09-13T18:47:15.480343+0000","last_became_peered":"2024-09-13T18:47:15.480343+0000","last_unstale":"2024-09-13T18:47:19.487530+0000","last_undegraded":"2024-09-13T18:47:19.487530+0000","last_fullsized":"2024-09-13T18:47:19.487530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488746+0000","last_change":"2024-09-13T18:47:14.993847+0000","last_active":"2024-09-13T18:47:19.488746+0000","last_peered":"2024-09-13T18:47:19.488746+0000","last_clean":"2024-09-13T18:47:19.488746+0000","last_became_active":"2024-09-13T18:47:14.993582+0000","last_became_peered":"2024-09-13T18:47:14.993582+0000","last_unstale":"2024-09-13T18:47:19.488746+0000","last_undegraded":"2024-09-13T18:47:19.488746+0000","last_fullsized":"2024-09-13T18:47:19.488746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591343+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:47:19.591343+0000","last_peered":"2024-09-13T18:47:19.591343+0000","last_clean":"2024-09-13T18:47:19.591343+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:47:19.591343+0000","last_undegraded":"2024-09-13T18:47:19.591343+0000","last_fullsized":"2024-09-13T18:47:19.591343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092727+0000","last_change":"2024-09-13T18:47:19.599505+0000","last_active":"2024-09-13T18:47:20.092727+0000","last_peered":"2024-09-13T18:47:20.092727+0000","last_clean":"2024-09-13T18:47:20.092727+0000","last_became_active":"2024-09-13T18:47:19.599105+0000","last_became_peered":"2024-09-13T18:47:19.599105+0000","last_unstale":"2024-09-13T18:47:20.092727+0000","last_undegraded":"2024-09-13T18:47:20.092727+0000","last_fullsized":"2024-09-13T18:47:20.092727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:44.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591948+0000","last_change":"2024-09-13T18:47:15.491819+0000","last_active":"2024-09-13T18:47:19.591948+0000","last_peered":"2024-09-13T18:47:19.591948+0000","last_clean":"2024-09-13T18:47:19.591948+0000","last_became_active":"2024-09-13T18:47:15.491497+0000","last_became_peered":"2024-09-13T18:47:15.491497+0000","last_unstale":"2024-09-13T18:47:19.591948+0000","last_undegraded":"2024-09-13T18:47:19.591948+0000","last_fullsized":"2024-09-13T18:47:19.591948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498674+0000","last_change":"2024-09-13T18:47:14.990404+0000","last_active":"2024-09-13T18:47:19.498674+0000","last_peered":"2024-09-13T18:47:19.498674+0000","last_clean":"2024-09-13T18:47:19.498674+0000","last_became_active":"2024-09-13T18:47:14.990115+0000","last_became_peered":"2024-09-13T18:47:14.990115+0000","last_unstale":"2024-09-13T18:47:19.498674+0000","last_undegraded":"2024-09-13T18:47:19.498674+0000","last_fullsized":"2024-09-13T18:47:19.498674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.088631+0000","last_change":"2024-09-13T18:47:19.594274+0000","last_active":"2024-09-13T18:47:20.088631+0000","last_peered":"2024-09-13T18:47:20.088631+0000","last_clean":"2024-09-13T18:47:20.088631+0000","last_became_active":"2024-09-13T18:47:19.593700+0000","last_became_peered":"2024-09-13T18:47:19.593700+0000","last_unstale":"2024-09-13T18:47:20.088631+0000","last_undegraded":"2024-09-13T18:47:20.088631+0000","last_fullsized":"2024-09-13T18:47:20.088631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489145+0000","last_change":"2024-09-13T18:47:15.478629+0000","last_active":"2024-09-13T18:47:19.489145+0000","last_peered":"2024-09-13T18:47:19.489145+0000","last_clean":"2024-09-13T18:47:19.489145+0000","last_became_active":"2024-09-13T18:47:15.476132+0000","last_became_peered":"2024-09-13T18:47:15.476132+0000","last_unstale":"2024-09-13T18:47:19.489145+0000","last_undegraded":"2024-09-13T18:47:19.489145+0000","last_fullsized":"2024-09-13T18:47:19.489145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493042+0000","last_change":"2024-09-13T18:47:14.995147+0000","last_active":"2024-09-13T18:47:19.493042+0000","last_peered":"2024-09-13T18:47:19.493042+0000","last_clean":"2024-09-13T18:47:19.493042+0000","last_became_active":"2024-09-13T18:47:14.994931+0000","last_became_peered":"2024-09-13T18:47:14.994931+0000","last_unstale":"2024-09-13T18:47:19.493042+0000","last_undegraded":"2024-09-13T18:47:19.493042+0000","last_fullsized":"2024-09-13T18:47:19.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961957+0000","last_change":"2024-09-13T18:47:19.510647+0000","last_active":"2024-09-13T18:47:19.961957+0000","last_peered":"2024-09-13T18:47:19.961957+0000","last_clean":"2024-09-13T18:47:19.961957+0000","last_became_active":"2024-09-13T18:47:19.508746+0000","last_became_peered":"2024-09-13T18:47:19.508746+0000","last_unstale":"2024-09-13T18:47:19.961957+0000","last_undegraded":"2024-09-13T18:47:19.961957+0000","last_fullsized":"2024-09-13T18:47:19.961957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592399+0000","last_change":"2024-09-13T18:47:15.494681+0000","last_active":"2024-09-13T18:47:19.592399+0000","last_peered":"2024-09-13T18:47:19.592399+0000","last_clean":"2024-09-13T18:47:19.592399+0000","last_became_active":"2024-09-13T18:47:15.490395+0000","last_became_peered":"2024-09-13T18:47:15.490395+0000","last_unstale":"2024-09-13T18:47:19.592399+0000","last_undegraded":"2024-09-13T18:47:19.592399+0000","last_fullsized":"2024-09-13T18:47:19.592399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499936+0000","last_change":"2024-09-13T18:47:14.992959+0000","last_active":"2024-09-13T18:47:19.499936+0000","last_peered":"2024-09-13T18:47:19.499936+0000","last_clean":"2024-09-13T18:47:19.499936+0000","last_became_active":"2024-09-13T18:47:14.989696+0000","last_became_peered":"2024-09-13T18:47:14.989696+0000","last_unstale":"2024-09-13T18:47:19.499936+0000","last_undegraded":"2024-09-13T18:47:19.499936+0000","last_fullsized":"2024-09-13T18:47:19.499936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092955+0000","last_change":"2024-09-13T18:47:19.594315+0000","last_active":"2024-09-13T18:47:20.092955+0000","last_peered":"2024-09-13T18:47:20.092955+0000","last_clean":"2024-09-13T18:47:20.092955+0000","last_became_active":"2024-09-13T18:47:19.593856+0000","last_became_peered":"2024-09-13T18:47:19.593856+0000","last_unstale":"2024-09-13T18:47:20.092955+0000","last_undegraded":"2024-09-13T18:47:20.092955+0000","last_fullsized":"2024-09-13T18:47:20.092955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592241+0000","last_change":"2024-09-13T18:47:15.493079+0000","last_active":"2024-09-13T18:47:19.592241+0000","last_peered":"2024-09-13T18:47:19.592241+0000","last_clean":"2024-09-13T18:47:19.592241+0000","last_became_active":"2024-09-13T18:47:15.492647+0000","last_became_peered":"2024-09-13T18:47:15.492647+0000","last_unstale":"2024-09-13T18:47:19.592241+0000","last_undegraded":"2024-09-13T18:47:19.592241+0000","last_fullsized":"2024-09-13T18:47:19.592241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:55.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.494245+0000","last_change":"2024-09-13T18:47:15.001931+0000","last_active":"2024-09-13T18:47:19.494245+0000","last_peered":"2024-09-13T18:47:19.494245+0000","last_clean":"2024-09-13T18:47:19.494245+0000","last_became_active":"2024-09-13T18:47:15.001488+0000","last_became_peered":"2024-09-13T18:47:15.001488+0000","last_unstale":"2024-09-13T18:47:19.494245+0000","last_undegraded":"2024-09-13T18:47:19.494245+0000","last_fullsized":"2024-09-13T18:47:19.494245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.883156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089502+0000","last_change":"2024-09-13T18:47:19.507944+0000","last_active":"2024-09-13T18:47:20.089502+0000","last_peered":"2024-09-13T18:47:20.089502+0000","last_clean":"2024-09-13T18:47:20.089502+0000","last_became_active":"2024-09-13T18:47:19.506708+0000","last_became_peered":"2024-09-13T18:47:19.506708+0000","last_unstale":"2024-09-13T18:47:20.089502+0000","last_undegraded":"2024-09-13T18:47:20.089502+0000","last_fullsized":"2024-09-13T18:47:20.089502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:12.199448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591479+0000","last_change":"2024-09-13T18:47:15.482887+0000","last_active":"2024-09-13T18:47:19.591479+0000","last_peered":"2024-09-13T18:47:19.591479+0000","last_clean":"2024-09-13T18:47:19.591479+0000","last_became_active":"2024-09-13T18:47:15.482616+0000","last_became_peered":"2024-09-13T18:47:15.482616+0000","last_unstale":"2024-09-13T18:47:19.591479+0000","last_undegraded":"2024-09-13T18:47:19.591479+0000","last_fullsized":"2024-09-13T18:47:19.591479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:44.301458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499180+0000","last_change":"2024-09-13T18:47:14.983612+0000","last_active":"2024-09-13T18:47:19.499180+0000","last_peered":"2024-09-13T18:47:19.499180+0000","last_clean":"2024-09-13T18:47:19.499180+0000","last_became_active":"2024-09-13T18:47:14.983354+0000","last_became_peered":"2024-09-13T18:47:14.983354+0000","last_unstale":"2024-09-13T18:47:19.499180+0000","last_undegraded":"2024-09-13T18:47:19.499180+0000","last_fullsized":"2024-09-13T18:47:19.499180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963361+0000","last_change":"2024-09-13T18:47:19.504797+0000","last_active":"2024-09-13T18:47:19.963361+0000","last_peered":"2024-09-13T18:47:19.963361+0000","last_clean":"2024-09-13T18:47:19.963361+0000","last_became_active":"2024-09-13T18:47:19.504472+0000","last_became_peered":"2024-09-13T18:47:19.504472+0000","last_unstale":"2024-09-13T18:47:19.963361+0000","last_undegraded":"2024-09-13T18:47:19.963361+0000","last_fullsized":"2024-09-13T18:47:19.963361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495782+0000","last_change":"2024-09-13T18:47:15.469363+0000","last_active":"2024-09-13T18:47:19.495782+0000","last_peered":"2024-09-13T18:47:19.495782+0000","last_clean":"2024-09-13T18:47:19.495782+0000","last_became_active":"2024-09-13T18:47:15.468718+0000","last_became_peered":"2024-09-13T18:47:15.468718+0000","last_unstale":"2024-09-13T18:47:19.495782+0000","last_undegraded":"2024-09-13T18:47:19.495782+0000","last_fullsized":"2024-09-13T18:47:19.495782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499734+0000","last_change":"2024-09-13T18:47:15.006188+0000","last_active":"2024-09-13T18:47:19.499734+0000","last_peered":"2024-09-13T18:47:19.499734+0000","last_clean":"2024-09-13T18:47:19.499734+0000","last_became_active":"2024-09-13T18:47:15.003764+0000","last_became_peered":"2024-09-13T18:47:15.003764+0000","last_unstale":"2024-09-13T18:47:19.499734+0000","last_undegraded":"2024-09-13T18:47:19.499734+0000","last_fullsized":"2024-09-13T18:47:19.499734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962715+0000","last_change":"2024-09-13T18:47:19.597771+0000","last_active":"2024-09-13T18:47:19.962715+0000","last_peered":"2024-09-13T18:47:19.962715+0000","last_clean":"2024-09-13T18:47:19.962715+0000","last_became_active":"2024-09-13T18:47:19.597144+0000","last_became_peered":"2024-09-13T18:47:19.597144+0000","last_unstale":"2024-09-13T18:47:19.962715+0000","last_undegraded":"2024-09-13T18:47:19.962715+0000","last_fullsized":"2024-09-13T18:47:19.962715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.794670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592050+0000","last_change":"2024-09-13T18:47:15.484848+0000","last_active":"2024-09-13T18:47:19.592050+0000","last_peered":"2024-09-13T18:47:19.592050+0000","last_clean":"2024-09-13T18:47:19.592050+0000","last_became_active":"2024-09-13T18:47:15.484444+0000","last_became_peered":"2024-09-13T18:47:15.484444+0000","last_unstale":"2024-09-13T18:47:19.592050+0000","last_undegraded":"2024-09-13T18:47:19.592050+0000","last_fullsized":"2024-09-13T18:47:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489024+0000","last_change":"2024-09-13T18:47:14.991470+0000","last_active":"2024-09-13T18:47:19.489024+0000","last_peered":"2024-09-13T18:47:19.489024+0000","last_clean":"2024-09-13T18:47:19.489024+0000","last_became_active":"2024-09-13T18:47:14.991135+0000","last_became_peered":"2024-09-13T18:47:14.991135+0000","last_unstale":"2024-09-13T18:47:19.489024+0000","last_undegraded":"2024-09-13T18:47:19.489024+0000","last_fullsized":"2024-09-13T18:47:19.489024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962615+0000","last_change":"2024-09-13T18:47:19.593992+0000","last_active":"2024-09-13T18:47:19.962615+0000","last_peered":"2024-09-13T18:47:19.962615+0000","last_clean":"2024-09-13T18:47:19.962615+0000","last_became_active":"2024-09-13T18:47:19.591585+0000","last_became_peered":"2024-09-13T18:47:19.591585+0000","last_unstale":"2024-09-13T18:47:19.962615+0000","last_undegraded":"2024-09-13T18:47:19.962615+0000","last_fullsized":"2024-09-13T18:47:19.962615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:29.971970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487602+0000","last_change":"2024-09-13T18:47:15.463821+0000","last_active":"2024-09-13T18:47:19.487602+0000","last_peered":"2024-09-13T18:47:19.487602+0000","last_clean":"2024-09-13T18:47:19.487602+0000","last_became_active":"2024-09-13T18:47:15.463563+0000","last_became_peered":"2024-09-13T18:47:15.463563+0000","last_unstale":"2024-09-13T18:47:19.487602+0000","last_undegraded":"2024-09-13T18:47:19.487602+0000","last_fullsized":"2024-09-13T18:47:19.487602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488046+0000","last_change":"2024-09-13T18:47:14.990471+0000","last_active":"2024-09-13T18:47:19.488046+0000","last_peered":"2024-09-13T18:47:19.488046+0000","last_clean":"2024-09-13T18:47:19.488046+0000","last_became_active":"2024-09-13T18:47:14.990222+0000","last_became_peered":"2024-09-13T18:47:14.990222+0000","last_unstale":"2024-09-13T18:47:19.488046+0000","last_undegraded":"2024-09-13T18:47:19.488046+0000","last_fullsized":"2024-09-13T18:47:19.488046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093959+0000","last_change":"2024-09-13T18:47:19.594886+0000","last_active":"2024-09-13T18:47:20.093959+0000","last_peered":"2024-09-13T18:47:20.093959+0000","last_clean":"2024-09-13T18:47:20.093959+0000","last_became_active":"2024-09-13T18:47:19.593831+0000","last_became_peered":"2024-09-13T18:47:19.593831+0000","last_unstale":"2024-09-13T18:47:20.093959+0000","last_undegraded":"2024-09-13T18:47:20.093959+0000","last_fullsized":"2024-09-13T18:47:20.093959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:50.947334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591916+0000","last_change":"2024-09-13T18:47:15.495522+0000","last_active":"2024-09-13T18:47:19.591916+0000","last_peered":"2024-09-13T18:47:19.591916+0000","last_clean":"2024-09-13T18:47:19.591916+0000","last_became_active":"2024-09-13T18:47:15.495212+0000","last_became_peered":"2024-09-13T18:47:15.495212+0000","last_unstale":"2024-09-13T18:47:19.591916+0000","last_undegraded":"2024-09-13T18:47:19.591916+0000","last_fullsized":"2024-09-13T18:47:19.591916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:32.484198+0000","last_change":"2024-09-13T18:47:15.000232+0000","last_active":"2024-09-13T18:47:32.484198+0000","last_peered":"2024-09-13T18:47:32.484198+0000","last_clean":"2024-09-13T18:47:32.484198+0000","last_became_active":"2024-09-13T18:47:14.993720+0000","last_became_peered":"2024-09-13T18:47:14.993720+0000","last_unstale":"2024-09-13T18:47:32.484198+0000","last_undegraded":"2024-09-13T18:47:32.484198+0000","last_fullsized":"2024-09-13T18:47:32.484198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083179+0000","last_change":"2024-09-13T18:47:19.515199+0000","last_active":"2024-09-13T18:47:20.083179+0000","last_peered":"2024-09-13T18:47:20.083179+0000","last_clean":"2024-09-13T18:47:20.083179+0000","last_became_active":"2024-09-13T18:47:19.514767+0000","last_became_peered":"2024-09-13T18:47:19.514767+0000","last_unstale":"2024-09-13T18:47:20.083179+0000","last_undegraded":"2024-09-13T18:47:20.083179+0000","last_fullsized":"2024-09-13T18:47:20.083179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:12.518830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497412+0000","last_change":"2024-09-13T18:47:15.471819+0000","last_active":"2024-09-13T18:47:19.497412+0000","last_peered":"2024-09-13T18:47:19.497412+0000","last_clean":"2024-09-13T18:47:19.497412+0000","last_became_active":"2024-09-13T18:47:15.470912+0000","last_became_peered":"2024-09-13T18:47:15.470912+0000","last_unstale":"2024-09-13T18:47:19.497412+0000","last_undegraded":"2024-09-13T18:47:19.497412+0000","last_fullsized":"2024-09-13T18:47:19.497412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492949+0000","last_change":"2024-09-13T18:47:14.986030+0000","last_active":"2024-09-13T18:47:19.492949+0000","last_peered":"2024-09-13T18:47:19.492949+0000","last_clean":"2024-09-13T18:47:19.492949+0000","last_became_active":"2024-09-13T18:47:14.984931+0000","last_became_peered":"2024-09-13T18:47:14.984931+0000","last_unstale":"2024-09-13T18:47:19.492949+0000","last_undegraded":"2024-09-13T18:47:19.492949+0000","last_fullsized":"2024-09-13T18:47:19.492949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089956+0000","last_change":"2024-09-13T18:47:19.507392+0000","last_active":"2024-09-13T18:47:20.089956+0000","last_peered":"2024-09-13T18:47:20.089956+0000","last_clean":"2024-09-13T18:47:20.089956+0000","last_became_active":"2024-09-13T18:47:19.506702+0000","last_became_peered":"2024-09-13T18:47:19.506702+0000","last_unstale":"2024-09-13T18:47:20.089956+0000","last_undegraded":"2024-09-13T18:47:20.089956+0000","last_fullsized":"2024-09-13T18:47:20.089956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491898+0000","last_change":"2024-09-13T18:47:15.478357+0000","last_active":"2024-09-13T18:47:19.491898+0000","last_peered":"2024-09-13T18:47:19.491898+0000","last_clean":"2024-09-13T18:47:19.491898+0000","last_became_active":"2024-09-13T18:47:15.471984+0000","last_became_peered":"2024-09-13T18:47:15.471984+0000","last_unstale":"2024-09-13T18:47:19.491898+0000","last_undegraded":"2024-09-13T18:47:19.491898+0000","last_fullsized":"2024-09-13T18:47:19.491898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:56.409431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489487+0000","last_change":"2024-09-13T18:47:14.994513+0000","last_active":"2024-09-13T18:47:19.489487+0000","last_peered":"2024-09-13T18:47:19.489487+0000","last_clean":"2024-09-13T18:47:19.489487+0000","last_became_active":"2024-09-13T18:47:14.994172+0000","last_became_peered":"2024-09-13T18:47:14.994172+0000","last_unstale":"2024-09-13T18:47:19.489487+0000","last_undegraded":"2024-09-13T18:47:19.489487+0000","last_fullsized":"2024-09-13T18:47:19.489487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961893+0000","last_change":"2024-09-13T18:47:19.503298+0000","last_active":"2024-09-13T18:47:19.961893+0000","last_peered":"2024-09-13T18:47:19.961893+0000","last_clean":"2024-09-13T18:47:19.961893+0000","last_became_active":"2024-09-13T18:47:19.502791+0000","last_became_peered":"2024-09-13T18:47:19.502791+0000","last_unstale":"2024-09-13T18:47:19.961893+0000","last_undegraded":"2024-09-13T18:47:19.961893+0000","last_fullsized":"2024-09-13T18:47:19.961893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:34.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489361+0000","last_change":"2024-09-13T18:47:15.478250+0000","last_active":"2024-09-13T18:47:19.489361+0000","last_peered":"2024-09-13T18:47:19.489361+0000","last_clean":"2024-09-13T18:47:19.489361+0000","last_became_active":"2024-09-13T18:47:15.477916+0000","last_became_peered":"2024-09-13T18:47:15.477916+0000","last_unstale":"2024-09-13T18:47:19.489361+0000","last_undegraded":"2024-09-13T18:47:19.489361+0000","last_fullsized":"2024-09-13T18:47:19.489361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501456+0000","last_change":"2024-09-13T18:47:14.992683+0000","last_active":"2024-09-13T18:47:19.501456+0000","last_peered":"2024-09-13T18:47:19.501456+0000","last_clean":"2024-09-13T18:47:19.501456+0000","last_became_active":"2024-09-13T18:47:14.992232+0000","last_became_peered":"2024-09-13T18:47:14.992232+0000","last_unstale":"2024-09-13T18:47:19.501456+0000","last_undegraded":"2024-09-13T18:47:19.501456+0000","last_fullsized":"2024-09-13T18:47:19.501456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962042+0000","last_change":"2024-09-13T18:47:19.596501+0000","last_active":"2024-09-13T18:47:19.962042+0000","last_peered":"2024-09-13T18:47:19.962042+0000","last_clean":"2024-09-13T18:47:19.962042+0000","last_became_active":"2024-09-13T18:47:19.590331+0000","last_became_peered":"2024-09-13T18:47:19.590331+0000","last_unstale":"2024-09-13T18:47:19.962042+0000","last_undegraded":"2024-09-13T18:47:19.962042+0000","last_fullsized":"2024-09-13T18:47:19.962042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:10.553259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961696+0000","last_change":"2024-09-13T18:47:19.596767+0000","last_active":"2024-09-13T18:47:19.961696+0000","last_peered":"2024-09-13T18:47:19.961696+0000","last_clean":"2024-09-13T18:47:19.961696+0000","last_became_active":"2024-09-13T18:47:19.595887+0000","last_became_peered":"2024-09-13T18:47:19.595887+0000","last_unstale":"2024-09-13T18:47:19.961696+0000","last_undegraded":"2024-09-13T18:47:19.961696+0000","last_fullsized":"2024-09-13T18:47:19.961696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492575+0000","last_change":"2024-09-13T18:47:15.471603+0000","last_active":"2024-09-13T18:47:19.492575+0000","last_peered":"2024-09-13T18:47:19.492575+0000","last_clean":"2024-09-13T18:47:19.492575+0000","last_became_active":"2024-09-13T18:47:15.471339+0000","last_became_peered":"2024-09-13T18:47:15.471339+0000","last_unstale":"2024-09-13T18:47:19.492575+0000","last_undegraded":"2024-09-13T18:47:19.492575+0000","last_fullsized":"2024-09-13T18:47:19.492575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489486+0000","last_change":"2024-09-13T18:47:14.987617+0000","last_active":"2024-09-13T18:47:19.489486+0000","last_peered":"2024-09-13T18:47:19.489486+0000","last_clean":"2024-09-13T18:47:19.489486+0000","last_became_active":"2024-09-13T18:47:14.987317+0000","last_became_peered":"2024-09-13T18:47:14.987317+0000","last_unstale":"2024-09-13T18:47:19.489486+0000","last_undegraded":"2024-09-13T18:47:19.489486+0000","last_fullsized":"2024-09-13T18:47:19.489486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090892+0000","last_change":"2024-09-13T18:47:19.509912+0000","last_active":"2024-09-13T18:47:20.090892+0000","last_peered":"2024-09-13T18:47:20.090892+0000","last_clean":"2024-09-13T18:47:20.090892+0000","last_became_active":"2024-09-13T18:47:19.509495+0000","last_became_peered":"2024-09-13T18:47:19.509495+0000","last_unstale":"2024-09-13T18:47:20.090892+0000","last_undegraded":"2024-09-13T18:47:20.090892+0000","last_fullsized":"2024-09-13T18:47:20.090892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:47.911959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487233+0000","last_change":"2024-09-13T18:47:15.471151+0000","last_active":"2024-09-13T18:47:19.487233+0000","last_peered":"2024-09-13T18:47:19.487233+0000","last_clean":"2024-09-13T18:47:19.487233+0000","last_became_active":"2024-09-13T18:47:15.470918+0000","last_became_peered":"2024-09-13T18:47:15.470918+0000","last_unstale":"2024-09-13T18:47:19.487233+0000","last_undegraded":"2024-09-13T18:47:19.487233+0000","last_fullsized":"2024-09-13T18:47:19.487233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488692+0000","last_change":"2024-09-13T18:47:14.991806+0000","last_active":"2024-09-13T18:47:19.488692+0000","last_peered":"2024-09-13T18:47:19.488692+0000","last_clean":"2024-09-13T18:47:19.488692+0000","last_became_active":"2024-09-13T18:47:14.991545+0000","last_became_peered":"2024-09-13T18:47:14.991545+0000","last_unstale":"2024-09-13T18:47:19.488692+0000","last_undegraded":"2024-09-13T18:47:19.488692+0000","last_fullsized":"2024-09-13T18:47:19.488692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500273+0000","last_change":"2024-09-13T18:47:14.999437+0000","last_active":"2024-09-13T18:47:19.500273+0000","last_peered":"2024-09-13T18:47:19.500273+0000","last_clean":"2024-09-13T18:47:19.500273+0000","last_became_active":"2024-09-13T18:47:14.993774+0000","last_became_peered":"2024-09-13T18:47:14.993774+0000","last_unstale":"2024-09-13T18:47:19.500273+0000","last_undegraded":"2024-09-13T18:47:19.500273+0000","last_fullsized":"2024-09-13T18:47:19.500273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487997+0000","last_change":"2024-09-13T18:47:15.459688+0000","last_active":"2024-09-13T18:47:19.487997+0000","last_peered":"2024-09-13T18:47:19.487997+0000","last_clean":"2024-09-13T18:47:19.487997+0000","last_became_active":"2024-09-13T18:47:15.459427+0000","last_became_peered":"2024-09-13T18:47:15.459427+0000","last_unstale":"2024-09-13T18:47:19.487997+0000","last_undegraded":"2024-09-13T18:47:19.487997+0000","last_fullsized":"2024-09-13T18:47:19.487997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.960515+0000","last_change":"2024-09-13T18:47:19.509191+0000","last_active":"2024-09-13T18:47:19.960515+0000","last_peered":"2024-09-13T18:47:19.960515+0000","last_clean":"2024-09-13T18:47:19.960515+0000","last_became_active":"2024-09-13T18:47:19.505978+0000","last_became_peered":"2024-09-13T18:47:19.505978+0000","last_unstale":"2024-09-13T18:47:19.960515+0000","last_undegraded":"2024-09-13T18:47:19.960515+0000","last_fullsized":"2024-09-13T18:47:19.960515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:54.531127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487778+0000","last_change":"2024-09-13T18:47:14.996586+0000","last_active":"2024-09-13T18:47:19.487778+0000","last_peered":"2024-09-13T18:47:19.487778+0000","last_clean":"2024-09-13T18:47:19.487778+0000","last_became_active":"2024-09-13T18:47:14.996310+0000","last_became_peered":"2024-09-13T18:47:14.996310+0000","last_unstale":"2024-09-13T18:47:19.487778+0000","last_undegraded":"2024-09-13T18:47:19.487778+0000","last_fullsized":"2024-09-13T18:47:19.487778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497807+0000","last_change":"2024-09-13T18:47:15.478387+0000","last_active":"2024-09-13T18:47:19.497807+0000","last_peered":"2024-09-13T18:47:19.497807+0000","last_clean":"2024-09-13T18:47:19.497807+0000","last_became_active":"2024-09-13T18:47:15.478052+0000","last_became_peered":"2024-09-13T18:47:15.478052+0000","last_unstale":"2024-09-13T18:47:19.497807+0000","last_undegraded":"2024-09-13T18:47:19.497807+0000","last_fullsized":"2024-09-13T18:47:19.497807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:20.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962836+0000","last_change":"2024-09-13T18:47:19.511484+0000","last_active":"2024-09-13T18:47:19.962836+0000","last_peered":"2024-09-13T18:47:19.962836+0000","last_clean":"2024-09-13T18:47:19.962836+0000","last_became_active":"2024-09-13T18:47:19.511269+0000","last_became_peered":"2024-09-13T18:47:19.511269+0000","last_unstale":"2024-09-13T18:47:19.962836+0000","last_undegraded":"2024-09-13T18:47:19.962836+0000","last_fullsized":"2024-09-13T18:47:19.962836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:27.500957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495634+0000","last_change":"2024-09-13T18:47:15.471234+0000","last_active":"2024-09-13T18:47:19.495634+0000","last_peered":"2024-09-13T18:47:19.495634+0000","last_clean":"2024-09-13T18:47:19.495634+0000","last_became_active":"2024-09-13T18:47:15.469073+0000","last_became_peered":"2024-09-13T18:47:15.469073+0000","last_unstale":"2024-09-13T18:47:19.495634+0000","last_undegraded":"2024-09-13T18:47:19.495634+0000","last_fullsized":"2024-09-13T18:47:19.495634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498324+0000","last_change":"2024-09-13T18:47:15.484477+0000","last_active":"2024-09-13T18:47:19.498324+0000","last_peered":"2024-09-13T18:47:19.498324+0000","last_clean":"2024-09-13T18:47:19.498324+0000","last_became_active":"2024-09-13T18:47:15.484155+0000","last_became_peered":"2024-09-13T18:47:15.484155+0000","last_unstale":"2024-09-13T18:47:19.498324+0000","last_undegraded":"2024-09-13T18:47:19.498324+0000","last_fullsized":"2024-09-13T18:47:19.498324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:39.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488918+0000","last_change":"2024-09-13T18:47:15.478632+0000","last_active":"2024-09-13T18:47:19.488918+0000","last_peered":"2024-09-13T18:47:19.488918+0000","last_clean":"2024-09-13T18:47:19.488918+0000","last_became_active":"2024-09-13T18:47:15.477839+0000","last_became_peered":"2024-09-13T18:47:15.477839+0000","last_unstale":"2024-09-13T18:47:19.488918+0000","last_undegraded":"2024-09-13T18:47:19.488918+0000","last_fullsized":"2024-09-13T18:47:19.488918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487900+0000","last_change":"2024-09-13T18:47:15.468102+0000","last_active":"2024-09-13T18:47:19.487900+0000","last_peered":"2024-09-13T18:47:19.487900+0000","last_clean":"2024-09-13T18:47:19.487900+0000","last_became_active":"2024-09-13T18:47:15.467859+0000","last_became_peered":"2024-09-13T18:47:15.467859+0000","last_unstale":"2024-09-13T18:47:19.487900+0000","last_undegraded":"2024-09-13T18:47:19.487900+0000","last_fullsized":"2024-09-13T18:47:19.487900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490262+0000","last_change":"2024-09-13T18:47:15.483966+0000","last_active":"2024-09-13T18:47:19.490262+0000","last_peered":"2024-09-13T18:47:19.490262+0000","last_clean":"2024-09-13T18:47:19.490262+0000","last_became_active":"2024-09-13T18:47:15.483703+0000","last_became_peered":"2024-09-13T18:47:15.483703+0000","last_unstale":"2024-09-13T18:47:19.490262+0000","last_undegraded":"2024-09-13T18:47:19.490262+0000","last_fullsized":"2024-09-13T18:47:19.490262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492839+0000","last_change":"2024-09-13T18:47:15.473022+0000","last_active":"2024-09-13T18:47:19.492839+0000","last_peered":"2024-09-13T18:47:19.492839+0000","last_clean":"2024-09-13T18:47:19.492839+0000","last_became_active":"2024-09-13T18:47:15.472759+0000","last_became_peered":"2024-09-13T18:47:15.472759+0000","last_unstale":"2024-09-13T18:47:19.492839+0000","last_undegraded":"2024-09-13T18:47:19.492839+0000","last_fullsized":"2024-09-13T18:47:19.492839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501045+0000","last_change":"2024-09-13T18:47:15.498630+0000","last_active":"2024-09-13T18:47:19.501045+0000","last_peered":"2024-09-13T18:47:19.501045+0000","last_clean":"2024-09-13T18:47:19.501045+0000","last_became_active":"2024-09-13T18:47:15.489640+0000","last_became_peered":"2024-09-13T18:47:15.489640+0000","last_unstale":"2024-09-13T18:47:19.501045+0000","last_undegraded":"2024-09-13T18:47:19.501045+0000","last_fullsized":"2024-09-13T18:47:19.501045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487931+0000","last_change":"2024-09-13T18:47:15.484677+0000","last_active":"2024-09-13T18:47:19.487931+0000","last_peered":"2024-09-13T18:47:19.487931+0000","last_clean":"2024-09-13T18:47:19.487931+0000","last_became_active":"2024-09-13T18:47:15.484344+0000","last_became_peered":"2024-09-13T18:47:15.484344+0000","last_unstale":"2024-09-13T18:47:19.487931+0000","last_undegraded":"2024-09-13T18:47:19.487931+0000","last_fullsized":"2024-09-13T18:47:19.487931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490604+0000","last_change":"2024-09-13T18:47:15.480276+0000","last_active":"2024-09-13T18:47:19.490604+0000","last_peered":"2024-09-13T18:47:19.490604+0000","last_clean":"2024-09-13T18:47:19.490604+0000","last_became_active":"2024-09-13T18:47:15.477492+0000","last_became_peered":"2024-09-13T18:47:15.477492+0000","last_unstale":"2024-09-13T18:47:19.490604+0000","last_undegraded":"2024-09-13T18:47:19.490604+0000","last_fullsized":"2024-09-13T18:47:19.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488622+0000","last_change":"2024-09-13T18:47:15.484967+0000","last_active":"2024-09-13T18:47:19.488622+0000","last_peered":"2024-09-13T18:47:19.488622+0000","last_clean":"2024-09-13T18:47:19.488622+0000","last_became_active":"2024-09-13T18:47:15.484678+0000","last_became_peered":"2024-09-13T18:47:15.484678+0000","last_unstale":"2024-09-13T18:47:19.488622+0000","last_undegraded":"2024-09-13T18:47:19.488622+0000","last_fullsized":"2024-09-13T18:47:19.488622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488812+0000","last_change":"2024-09-13T18:47:15.486476+0000","last_active":"2024-09-13T18:47:19.488812+0000","last_peered":"2024-09-13T18:47:19.488812+0000","last_clean":"2024-09-13T18:47:19.488812+0000","last_became_active":"2024-09-13T18:47:15.478333+0000","last_became_peered":"2024-09-13T18:47:15.478333+0000","last_unstale":"2024-09-13T18:47:19.488812+0000","last_undegraded":"2024-09-13T18:47:19.488812+0000","last_fullsized":"2024-09-13T18:47:19.488812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487773+0000","last_change":"2024-09-13T18:47:15.465478+0000","last_active":"2024-09-13T18:47:19.487773+0000","last_peered":"2024-09-13T18:47:19.487773+0000","last_clean":"2024-09-13T18:47:19.487773+0000","last_became_active":"2024-09-13T18:47:15.463578+0000","last_became_peered":"2024-09-13T18:47:15.463578+0000","last_unstale":"2024-09-13T18:47:19.487773+0000","last_undegraded":"2024-09-13T18:47:19.487773+0000","last_fullsized":"2024-09-13T18:47:19.487773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500654+0000","last_change":"2024-09-13T18:47:15.480360+0000","last_active":"2024-09-13T18:47:19.500654+0000","last_peered":"2024-09-13T18:47:19.500654+0000","last_clean":"2024-09-13T18:47:19.500654+0000","last_became_active":"2024-09-13T18:47:15.480117+0000","last_became_peered":"2024-09-13T18:47:15.480117+0000","last_unstale":"2024-09-13T18:47:19.500654+0000","last_undegraded":"2024-09-13T18:47:19.500654+0000","last_fullsized":"2024-09-13T18:47:19.500654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592107+0000","last_change":"2024-09-13T18:47:15.480704+0000","last_active":"2024-09-13T18:47:19.592107+0000","last_peered":"2024-09-13T18:47:19.592107+0000","last_clean":"2024-09-13T18:47:19.592107+0000","last_became_active":"2024-09-13T18:47:15.480427+0000","last_became_peered":"2024-09-13T18:47:15.480427+0000","last_unstale":"2024-09-13T18:47:19.592107+0000","last_undegraded":"2024-09-13T18:47:19.592107+0000","last_fullsized":"2024-09-13T18:47:19.592107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499735+0000","last_change":"2024-09-13T18:47:15.483066+0000","last_active":"2024-09-13T18:47:19.499735+0000","last_peered":"2024-09-13T18:47:19.499735+0000","last_clean":"2024-09-13T18:47:19.499735+0000","last_became_active":"2024-09-13T18:47:15.482829+0000","last_became_peered":"2024-09-13T18:47:15.482829+0000","last_unstale":"2024-09-13T18:47:19.499735+0000","last_undegraded":"2024-09-13T18:47:19.499735+0000","last_fullsized":"2024-09-13T18:47:19.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489201+0000","last_change":"2024-09-13T18:47:15.480926+0000","last_active":"2024-09-13T18:47:19.489201+0000","last_peered":"2024-09-13T18:47:19.489201+0000","last_clean":"2024-09-13T18:47:19.489201+0000","last_became_active":"2024-09-13T18:47:15.475793+0000","last_became_peered":"2024-09-13T18:47:15.475793+0000","last_unstale":"2024-09-13T18:47:19.489201+0000","last_undegraded":"2024-09-13T18:47:19.489201+0000","last_fullsized":"2024-09-13T18:47:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489302+0000","last_change":"2024-09-13T18:47:15.476117+0000","last_active":"2024-09-13T18:47:19.489302+0000","last_peered":"2024-09-13T18:47:19.489302+0000","last_clean":"2024-09-13T18:47:19.489302+0000","last_became_active":"2024-09-13T18:47:15.474650+0000","last_became_peered":"2024-09-13T18:47:15.474650+0000","last_unstale":"2024-09-13T18:47:19.489302+0000","last_undegraded":"2024-09-13T18:47:19.489302+0000","last_fullsized":"2024-09-13T18:47:19.489302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492576+0000","last_change":"2024-09-13T18:47:15.462353+0000","last_active":"2024-09-13T18:47:19.492576+0000","last_peered":"2024-09-13T18:47:19.492576+0000","last_clean":"2024-09-13T18:47:19.492576+0000","last_became_active":"2024-09-13T18:47:15.462033+0000","last_became_peered":"2024-09-13T18:47:15.462033+0000","last_unstale":"2024-09-13T18:47:19.492576+0000","last_undegraded":"2024-09-13T18:47:19.492576+0000","last_fullsized":"2024-09-13T18:47:19.492576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487542+0000","last_change":"2024-09-13T18:47:15.476234+0000","last_active":"2024-09-13T18:47:19.487542+0000","last_peered":"2024-09-13T18:47:19.487542+0000","last_clean":"2024-09-13T18:47:19.487542+0000","last_became_active":"2024-09-13T18:47:15.475946+0000","last_became_peered":"2024-09-13T18:47:15.475946+0000","last_unstale":"2024-09-13T18:47:19.487542+0000","last_undegraded":"2024-09-13T18:47:19.487542+0000","last_fullsized":"2024-09-13T18:47:19.487542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487685+0000","last_change":"2024-09-13T18:47:15.467147+0000","last_active":"2024-09-13T18:47:19.487685+0000","last_peered":"2024-09-13T18:47:19.487685+0000","last_clean":"2024-09-13T18:47:19.487685+0000","last_became_active":"2024-09-13T18:47:15.466819+0000","last_became_peered":"2024-09-13T18:47:15.466819+0000","last_unstale":"2024-09-13T18:47:19.487685+0000","last_undegraded":"2024-09-13T18:47:19.487685+0000","last_fullsized":"2024-09-13T18:47:19.487685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497332+0000","last_change":"2024-09-13T18:47:15.465815+0000","last_active":"2024-09-13T18:47:19.497332+0000","last_peered":"2024-09-13T18:47:19.497332+0000","last_clean":"2024-09-13T18:47:19.497332+0000","last_became_active":"2024-09-13T18:47:15.464960+0000","last_became_peered":"2024-09-13T18:47:15.464960+0000","last_unstale":"2024-09-13T18:47:19.497332+0000","last_undegraded":"2024-09-13T18:47:19.497332+0000","last_fullsized":"2024-09-13T18:47:19.497332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.346283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500854+0000","last_change":"2024-09-13T18:47:15.482526+0000","last_active":"2024-09-13T18:47:19.500854+0000","last_peered":"2024-09-13T18:47:19.500854+0000","last_clean":"2024-09-13T18:47:19.500854+0000","last_became_active":"2024-09-13T18:47:15.482236+0000","last_became_peered":"2024-09-13T18:47:15.482236+0000","last_unstale":"2024-09-13T18:47:19.500854+0000","last_undegraded":"2024-09-13T18:47:19.500854+0000","last_fullsized":"2024-09-13T18:47:19.500854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500973+0000","last_change":"2024-09-13T18:47:15.498504+0000","last_active":"2024-09-13T18:47:19.500973+0000","last_peered":"2024-09-13T18:47:19.500973+0000","last_clean":"2024-09-13T18:47:19.500973+0000","last_became_active":"2024-09-13T18:47:15.490041+0000","last_became_peered":"2024-09-13T18:47:15.490041+0000","last_unstale":"2024-09-13T18:47:19.500973+0000","last_undegraded":"2024-09-13T18:47:19.500973+0000","last_fullsized":"2024-09-13T18:47:19.500973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592385+0000","last_change":"2024-09-13T18:47:15.495466+0000","last_active":"2024-09-13T18:47:19.592385+0000","last_peered":"2024-09-13T18:47:19.592385+0000","last_clean":"2024-09-13T18:47:19.592385+0000","last_became_active":"2024-09-13T18:47:15.495197+0000","last_became_peered":"2024-09-13T18:47:15.495197+0000","last_unstale":"2024-09-13T18:47:19.592385+0000","last_undegraded":"2024-09-13T18:47:19.592385+0000","last_fullsized":"2024-09-13T18:47:19.592385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487124+0000","last_change":"2024-09-13T18:47:15.474386+0000","last_active":"2024-09-13T18:47:19.487124+0000","last_peered":"2024-09-13T18:47:19.487124+0000","last_clean":"2024-09-13T18:47:19.487124+0000","last_became_active":"2024-09-13T18:47:15.473414+0000","last_became_peered":"2024-09-13T18:47:15.473414+0000","last_unstale":"2024-09-13T18:47:19.487124+0000","last_undegraded":"2024-09-13T18:47:19.487124+0000","last_fullsized":"2024-09-13T18:47:19.487124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591466+0000","last_change":"2024-09-13T18:47:15.469797+0000","last_active":"2024-09-13T18:47:19.591466+0000","last_peered":"2024-09-13T18:47:19.591466+0000","last_clean":"2024-09-13T18:47:19.591466+0000","last_became_active":"2024-09-13T18:47:15.469460+0000","last_became_peered":"2024-09-13T18:47:15.469460+0000","last_unstale":"2024-09-13T18:47:19.591466+0000","last_undegraded":"2024-09-13T18:47:19.591466+0000","last_fullsized":"2024-09-13T18:47:19.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488705+0000","last_change":"2024-09-13T18:47:15.483840+0000","last_active":"2024-09-13T18:47:19.488705+0000","last_peered":"2024-09-13T18:47:19.488705+0000","last_clean":"2024-09-13T18:47:19.488705+0000","last_became_active":"2024-09-13T18:47:15.478139+0000","last_became_peered":"2024-09-13T18:47:15.478139+0000","last_unstale":"2024-09-13T18:47:19.488705+0000","last_undegraded":"2024-09-13T18:47:19.488705+0000","last_fullsized":"2024-09-13T18:47:19.488705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591973+0000","last_change":"2024-09-13T18:47:15.484385+0000","last_active":"2024-09-13T18:47:19.591973+0000","last_peered":"2024-09-13T18:47:19.591973+0000","last_clean":"2024-09-13T18:47:19.591973+0000","last_became_active":"2024-09-13T18:47:15.477424+0000","last_became_peered":"2024-09-13T18:47:15.477424+0000","last_unstale":"2024-09-13T18:47:19.591973+0000","last_undegraded":"2024-09-13T18:47:19.591973+0000","last_fullsized":"2024-09-13T18:47:19.591973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488909+0000","last_change":"2024-09-13T18:47:15.477871+0000","last_active":"2024-09-13T18:47:19.488909+0000","last_peered":"2024-09-13T18:47:19.488909+0000","last_clean":"2024-09-13T18:47:19.488909+0000","last_became_active":"2024-09-13T18:47:15.474849+0000","last_became_peered":"2024-09-13T18:47:15.474849+0000","last_unstale":"2024-09-13T18:47:19.488909+0000","last_undegraded":"2024-09-13T18:47:19.488909+0000","last_fullsized":"2024-09-13T18:47:19.488909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487837+0000","last_change":"2024-09-13T18:47:15.464724+0000","last_active":"2024-09-13T18:47:19.487837+0000","last_peered":"2024-09-13T18:47:19.487837+0000","last_clean":"2024-09-13T18:47:19.487837+0000","last_became_active":"2024-09-13T18:47:15.463105+0000","last_became_peered":"2024-09-13T18:47:15.463105+0000","last_unstale":"2024-09-13T18:47:19.487837+0000","last_undegraded":"2024-09-13T18:47:19.487837+0000","last_fullsized":"2024-09-13T18:47:19.487837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:15.445388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493023+0000","last_change":"2024-09-13T18:47:15.476846+0000","last_active":"2024-09-13T18:47:19.493023+0000","last_peered":"2024-09-13T18:47:19.493023+0000","last_clean":"2024-09-13T18:47:19.493023+0000","last_became_active":"2024-09-13T18:47:15.476551+0000","last_became_peered":"2024-09-13T18:47:15.476551+0000","last_unstale":"2024-09-13T18:47:19.493023+0000","last_undegraded":"2024-09-13T18:47:19.493023+0000","last_fullsized":"2024-09-13T18:47:19.493023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592316+0000","last_change":"2024-09-13T18:47:15.496912+0000","last_active":"2024-09-13T18:47:19.592316+0000","last_peered":"2024-09-13T18:47:19.592316+0000","last_clean":"2024-09-13T18:47:19.592316+0000","last_became_active":"2024-09-13T18:47:15.496644+0000","last_became_peered":"2024-09-13T18:47:15.496644+0000","last_unstale":"2024-09-13T18:47:19.592316+0000","last_undegraded":"2024-09-13T18:47:19.592316+0000","last_fullsized":"2024-09-13T18:47:19.592316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.284}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:37.382 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:47:37.383 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:47:37.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:47:37.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:47:37.384 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:47:37.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 Processor -- start 2024-09-13T18:47:37.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 -- start start 2024-09-13T18:47:37.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61b41573b0 0x7f61b40cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b40ce2f0 0x7f61b406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61b406ab10 0x7f61b4160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b40ce750 con 0x7f61b41573b0 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b406af80 con 0x7f61b406ab10 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b8e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b40ad480 con 0x7f61b40ce2f0 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.574+0000 7f61b1e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61b41573b0 0x7f61b40cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f61b41573b0 0x7f61b40cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46962/0 (socket says 172.21.15.81:46962) 2024-09-13T18:47:37.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 -- 172.21.15.81:0/423736223 learned_addr learned my addr 172.21.15.81:0/423736223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1400700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b40ce2f0 0x7f61b406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b2800700 1 --2- 172.21.15.81:0/423736223 >> v2:172.21.15.178:3300/0 conn(0x7f61b406ab10 0x7f61b4160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 -- 172.21.15.81:0/423736223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b40ce2f0 msgr2=0x7f61b406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b40ce2f0 0x7f61b406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 -- 172.21.15.81:0/423736223 >> v2:172.21.15.178:3300/0 conn(0x7f61b406ab10 msgr2=0x7f61b4160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 --2- 172.21.15.81:0/423736223 >> v2:172.21.15.178:3300/0 conn(0x7f61b406ab10 0x7f61b4160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 -- 172.21.15.81:0/423736223 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4157790 con 0x7f61b41573b0 2024-09-13T18:47:37.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b2800700 1 --2- 172.21.15.81:0/423736223 >> v2:172.21.15.178:3300/0 conn(0x7f61b406ab10 0x7f61b4160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1400700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b40ce2f0 0x7f61b406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b1e00700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b41573b0 0x7f61b40cddb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61b40b1790 tx=0x7f61a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475a75a96a5d0f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b0a00700 1 -- 172.21.15.81:0/423736223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400b8a0 con 0x7f61b41573b0 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b0a00700 1 -- 172.21.15.81:0/423736223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a400ba00 con 0x7f61b41573b0 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b0a00700 1 -- 172.21.15.81:0/423736223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400bd90 con 0x7f61b41573b0 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 -- 172.21.15.81:0/423736223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b41573b0 msgr2=0x7f61b40cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b41573b0 0x7f61b40cddb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f61b40b1790 tx=0x7f61a4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 -- 172.21.15.81:0/423736223 shutdown_connections 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 --2- 172.21.15.81:0/423736223 >> v2:172.21.15.178:3300/0 conn(0x7f61b406ab10 0x7f61b4160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b40ce2f0 0x7f61b406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 --2- 172.21.15.81:0/423736223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b41573b0 0x7f61b40cddb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 -- 172.21.15.81:0/423736223 >> 172.21.15.81:0/423736223 conn(0x7f61b40b08d0 msgr2=0x7f61b40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 -- 172.21.15.81:0/423736223 shutdown_connections 2024-09-13T18:47:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.578+0000 7f61b8e00700 1 -- 172.21.15.81:0/423736223 wait complete. 2024-09-13T18:47:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 Processor -- start 2024-09-13T18:47:37.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 -- start start 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b406ab10 0x7f61b41f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 0x7f61b414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b41573b0 0x7f61b415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41f2b70 con 0x7f61b40ce2f0 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b41591a0 con 0x7f61b406ab10 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b8e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4159480 con 0x7f61b41573b0 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 0x7f61b414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 0x7f61b414d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46976/0 (socket says 172.21.15.81:46976) 2024-09-13T18:47:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b1400700 1 -- 172.21.15.81:0/2695823624 learned_addr learned my addr 172.21.15.81:0/2695823624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b1e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b406ab10 0x7f61b41f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b2800700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b41573b0 0x7f61b415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.582+0000 7f61b1400700 1 -- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b41573b0 msgr2=0x7f61b415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b1400700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b41573b0 0x7f61b415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b1400700 1 -- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b406ab10 msgr2=0x7f61b41f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b1400700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b406ab10 0x7f61b41f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b1400700 1 -- 172.21.15.81:0/2695823624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009570 con 0x7f61b40ce2f0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b1e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b406ab10 0x7f61b41f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b1400700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 0x7f61b414d5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c770 tx=0x7f61a000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011800 con 0x7f61b40ce2f0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0011960 con 0x7f61b40ce2f0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0011d10 con 0x7f61b40ce2f0 2024-09-13T18:47:37.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b4159760 con 0x7f61b40ce2f0 2024-09-13T18:47:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b415c530 con 0x7f61b40ce2f0 2024-09-13T18:47:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.586+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b40ae250 con 0x7f61b40ce2f0 2024-09-13T18:47:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.590+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61a0018360 con 0x7f61b40ce2f0 2024-09-13T18:47:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.590+0000 7f61aa000700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6194066730 0x7f6194068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.590+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61a0084400 con 0x7f61b40ce2f0 2024-09-13T18:47:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.590+0000 7f61b1e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6194066730 0x7f6194068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.590+0000 7f61b1e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6194066730 0x7f6194068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000c00 tx=0x7f61a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.598+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61a00513f0 con 0x7f61b40ce2f0 2024-09-13T18:47:37.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.826+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f61b40b0460 con 0x7f61b40ce2f0 2024-09-13T18:47:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.830+0000 7f61aa000700 1 -- 172.21.15.81:0/2695823624 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164900 (secure 0 0 0) 0x7f61a0054a10 con 0x7f61b40ce2f0 2024-09-13T18:47:37.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6194066730 msgr2=0x7f6194068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6194066730 0x7f6194068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f61a4000c00 tx=0x7f61a4008030 comp rx=0 tx=0).stop 2024-09-13T18:47:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 msgr2=0x7f61b414d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 0x7f61b414d5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f61a000c770 tx=0x7f61a000ca80 comp rx=0 tx=0).stop 2024-09-13T18:47:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 shutdown_connections 2024-09-13T18:47:37.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6194066730 0x7f6194068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61b41573b0 0x7f61b415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61b40ce2f0 0x7f61b414d5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 --2- 172.21.15.81:0/2695823624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61b406ab10 0x7f61b41f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 >> 172.21.15.81:0/2695823624 conn(0x7f61b40b08d0 msgr2=0x7f61b40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 shutdown_connections 2024-09-13T18:47:37.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:37.834+0000 7f61b8e00700 1 -- 172.21.15.81:0/2695823624 wait complete. 2024-09-13T18:47:37.866 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3385480382},{"type":"v1","addr":"172.21.15.81:6833","nonce":3385480382}]},"active_addr":"172.21.15.81:6833/3385480382","active_change":"2024-09-13T18:46:56.946780+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2375349917}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2046732603}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1828238882}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1304696262}]}]} 2024-09-13T18:47:37.870 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:47:37.871 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:47:37.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:38.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.026+0000 7f3667200700 1 Processor -- start 2024-09-13T18:47:38.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.026+0000 7f3667200700 1 -- start start 2024-09-13T18:47:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3667200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f36680b3980 0x7f366815f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3667200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366815e560 con 0x7f366815d310 2024-09-13T18:47:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3667200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36680b3e10 con 0x7f366806aaa0 2024-09-13T18:47:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3667200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36680adf90 con 0x7f36680b3980 2024-09-13T18:47:38.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f365d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f366815d310 0x7f366815e9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47062/0 (socket says 172.21.15.81:47062) 2024-09-13T18:47:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f365d400700 1 -- 172.21.15.81:0/1780424130 learned_addr learned my addr 172.21.15.81:0/1780424130 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3666800700 1 --2- 172.21.15.81:0/1780424130 >> v2:172.21.15.178:3300/0 conn(0x7f36680b3980 0x7f366815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235916782 0 0) 0x7f366815e560 con 0x7f366815d310 2024-09-13T18:47:38.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f364c0035d0 con 0x7f366815d310 2024-09-13T18:47:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822673335 0 0) 0x7f36680b3e10 con 0x7f366806aaa0 2024-09-13T18:47:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366815e560 con 0x7f366806aaa0 2024-09-13T18:47:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947837055 0 0) 0x7f364c0035d0 con 0x7f366815d310 2024-09-13T18:47:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 >> v2:172.21.15.178:3300/0 conn(0x7f36680b3980 msgr2=0x7f366815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 --2- 172.21.15.81:0/1780424130 >> v2:172.21.15.178:3300/0 conn(0x7f36680b3980 0x7f366815f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 >> v1:172.21.15.178:6789/0 conn(0x7f366806aaa0 legacy=0x7f366806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366815d920 con 0x7f366815d310 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f3650001670 con 0x7f366815d310 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.030+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 >> v1:172.21.15.81:6789/0 conn(0x7f366815d310 legacy=0x7f366815e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c003c20 0x7f364c004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c004870 0x7f364c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364c005230 0x7f364c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680adf90 con 0x7f364c004870 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364c00c130 con 0x7f364c005230 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364c00c2f0 con 0x7f364c003c20 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3666800700 1 --2- 172.21.15.81:0/1780424130 >> v2:172.21.15.178:3300/0 conn(0x7f36680b3980 0x7f366815f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c004870 0x7f364c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665e00700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c003c20 0x7f364c004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3666800700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364c005230 0x7f364c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 -- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c003c20 msgr2=0x7f364c004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c003c20 0x7f364c004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 -- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364c005230 msgr2=0x7f364c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364c005230 0x7f364c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 -- 172.21.15.81:0/1780424130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364c0035d0 con 0x7f364c004870 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3666800700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f364c005230 0x7f364c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3666800700 1 -- 172.21.15.81:0/1780424130 reap_dead start 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f365d400700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c004870 0x7f364c004cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f365000c210 tx=0x7f364c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9b82aa02d31ff0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000cd50 con 0x7f364c004870 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3650005980 con 0x7f364c004870 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3665400700 1 -- 172.21.15.81:0/1780424130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650005d30 con 0x7f364c004870 2024-09-13T18:47:38.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 -- 172.21.15.81:0/1780424130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c004870 msgr2=0x7f364c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c004870 0x7f364c004cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f365000c210 tx=0x7f364c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 -- 172.21.15.81:0/1780424130 shutdown_connections 2024-09-13T18:47:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 --2- 172.21.15.81:0/1780424130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f364c004870 0x7f364c004cf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 -- 172.21.15.81:0/1780424130 >> 172.21.15.81:0/1780424130 conn(0x7f36680b0c40 msgr2=0x7f366806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 -- 172.21.15.81:0/1780424130 shutdown_connections 2024-09-13T18:47:38.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.034+0000 7f3667200700 1 -- 172.21.15.81:0/1780424130 wait complete. 2024-09-13T18:47:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 Processor -- start 2024-09-13T18:47:38.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 -- start start 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c004870 0x7f36680cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 0x7f366814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f366814ead0 0x7f366813f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680ce2e0 con 0x7f36680cb710 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366814f100 con 0x7f366814ead0 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f3667200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366814f3e0 con 0x7f364c004870 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f365d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 0x7f366814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f365d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 0x7f366814e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46996/0 (socket says 172.21.15.81:46996) 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.038+0000 7f365d400700 1 -- 172.21.15.81:0/4039955941 learned_addr learned my addr 172.21.15.81:0/4039955941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f3666800700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f366814ead0 0x7f366813f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f3665e00700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c004870 0x7f36680cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365d400700 1 -- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c004870 msgr2=0x7f36680cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365d400700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c004870 0x7f36680cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365d400700 1 -- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f366814ead0 msgr2=0x7f366813f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365d400700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f366814ead0 0x7f366813f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365d400700 1 -- 172.21.15.81:0/4039955941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680cd5a0 con 0x7f36680cb710 2024-09-13T18:47:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f3665e00700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c004870 0x7f36680cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:38.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365d400700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 0x7f366814e590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36500018b0 tx=0x7f3650001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650004890 con 0x7f36680cb710 2024-09-13T18:47:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36500049f0 con 0x7f36680cb710 2024-09-13T18:47:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36680cd880 con 0x7f36680cb710 2024-09-13T18:47:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3650004da0 con 0x7f36680cb710 2024-09-13T18:47:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36680cd1c0 con 0x7f36680cb710 2024-09-13T18:47:38.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.042+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36680cda40 con 0x7f36680cb710 2024-09-13T18:47:38.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.046+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3650007070 con 0x7f36680cb710 2024-09-13T18:47:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.046+0000 7f365ea00700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3644066730 0x7f3644068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.046+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3650084ae0 con 0x7f36680cb710 2024-09-13T18:47:38.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.046+0000 7f3665e00700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3644066730 0x7f3644068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.046+0000 7f3665e00700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3644066730 0x7f3644068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3658000c00 tx=0x7f3658009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.050+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3650051b50 con 0x7f36680cb710 2024-09-13T18:47:38.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.234+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f366814eeb0 con 0x7f36680cb710 2024-09-13T18:47:38.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.238+0000 7f365ea00700 1 -- 172.21.15.81:0/4039955941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f3650055170 con 0x7f36680cb710 2024-09-13T18:47:38.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:38.248 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:38.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3644066730 msgr2=0x7f3644068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3644066730 0x7f3644068bf0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3658000c00 tx=0x7f3658009040 comp rx=0 tx=0).stop 2024-09-13T18:47:38.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 msgr2=0x7f366814e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 0x7f366814e590 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36500018b0 tx=0x7f3650001980 comp rx=0 tx=0).stop 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 shutdown_connections 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3644066730 0x7f3644068bf0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f366814ead0 0x7f366813f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36680cb710 0x7f366814e590 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 --2- 172.21.15.81:0/4039955941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364c004870 0x7f36680cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 >> 172.21.15.81:0/4039955941 conn(0x7f36680b0c40 msgr2=0x7f366806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 shutdown_connections 2024-09-13T18:47:38.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.242+0000 7f3667200700 1 -- 172.21.15.81:0/4039955941 wait complete. 2024-09-13T18:47:38.276 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:47:38.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.442+0000 7fe427200700 1 Processor -- start 2024-09-13T18:47:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.442+0000 7fe427200700 1 -- start start 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe427200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe42806aaa0 0x7fe42806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe427200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4280b2670 0x7fe4280b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe427200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4280b3560 con 0x7fe4281610b0 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe427200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe428070b30 con 0x7fe42806aaa0 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe427200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42806b450 con 0x7fe4280b2670 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe425e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4281610b0 0x7fe4280719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47068/0 (socket says 172.21.15.81:47068) 2024-09-13T18:47:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe425e00700 1 -- 172.21.15.81:0/1993333690 learned_addr learned my addr 172.21.15.81:0/1993333690 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe41d400700 1 --2- 172.21.15.81:0/1993333690 >> v2:172.21.15.81:3300/0 conn(0x7fe42806aaa0 0x7fe42806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe426800700 1 --2- 172.21.15.81:0/1993333690 >> v2:172.21.15.178:3300/0 conn(0x7fe4280b2670 0x7fe4280b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe425400700 1 -- 172.21.15.81:0/1993333690 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253518834 0 0) 0x7fe4280b3560 con 0x7fe4281610b0 2024-09-13T18:47:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe425400700 1 -- 172.21.15.81:0/1993333690 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe40c0035d0 con 0x7fe4281610b0 2024-09-13T18:47:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe41d400700 1 -- 172.21.15.81:0/1993333690 >> v2:172.21.15.178:3300/0 conn(0x7fe4280b2670 msgr2=0x7fe4280b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe41d400700 1 --2- 172.21.15.81:0/1993333690 >> v2:172.21.15.178:3300/0 conn(0x7fe4280b2670 0x7fe4280b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe425400700 1 -- 172.21.15.81:0/1993333690 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182607769 0 0) 0x7fe40c0035d0 con 0x7fe4281610b0 2024-09-13T18:47:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe41d400700 1 -- 172.21.15.81:0/1993333690 >> v1:172.21.15.81:6789/0 conn(0x7fe4281610b0 legacy=0x7fe4280719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.446+0000 7fe41d400700 1 -- 172.21.15.81:0/1993333690 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280b3000 con 0x7fe42806aaa0 2024-09-13T18:47:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe41d400700 1 --2- 172.21.15.81:0/1993333690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42806af10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe410009880 tx=0x7fe410009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8f2037fcdeb975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe425400700 1 -- 172.21.15.81:0/1993333690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418001670 con 0x7fe42806aaa0 2024-09-13T18:47:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe425400700 1 -- 172.21.15.81:0/1993333690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe410010590 con 0x7fe42806aaa0 2024-09-13T18:47:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe425400700 1 -- 172.21.15.81:0/1993333690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe410010900 con 0x7fe42806aaa0 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 -- 172.21.15.81:0/1993333690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 msgr2=0x7fe42806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 --2- 172.21.15.81:0/1993333690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42806af10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe410009880 tx=0x7fe410009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 -- 172.21.15.81:0/1993333690 shutdown_connections 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 --2- 172.21.15.81:0/1993333690 >> v2:172.21.15.178:3300/0 conn(0x7fe4280b2670 0x7fe4280b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 --2- 172.21.15.81:0/1993333690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42806af10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 -- 172.21.15.81:0/1993333690 >> 172.21.15.81:0/1993333690 conn(0x7fe4280b0c40 msgr2=0x7fe42806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 -- 172.21.15.81:0/1993333690 shutdown_connections 2024-09-13T18:47:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.450+0000 7fe427200700 1 -- 172.21.15.81:0/1993333690 wait complete. 2024-09-13T18:47:38.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 Processor -- start 2024-09-13T18:47:38.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 -- start start 2024-09-13T18:47:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42814d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4280b2670 0x7fe4280ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4281610b0 0x7fe4280aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42814e5a0 con 0x7fe42806aaa0 2024-09-13T18:47:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42814e7b0 con 0x7fe4280b2670 2024-09-13T18:47:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe427200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42814ea90 con 0x7fe4281610b0 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42814d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42814d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47018/0 (socket says 172.21.15.81:47018) 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 -- 172.21.15.81:0/1686692137 learned_addr learned my addr 172.21.15.81:0/1686692137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe41d400700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4280b2670 0x7fe4280ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe426800700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4281610b0 0x7fe4280aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 -- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4281610b0 msgr2=0x7fe4280aca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4281610b0 0x7fe4280aca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 -- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4280b2670 msgr2=0x7fe4280ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4280b2670 0x7fe4280ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 -- 172.21.15.81:0/1686692137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4100094b0 con 0x7fe42806aaa0 2024-09-13T18:47:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.454+0000 7fe425e00700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42814d0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c780 tx=0x7fe41800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418004ca0 con 0x7fe42806aaa0 2024-09-13T18:47:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe418004e20 con 0x7fe42806aaa0 2024-09-13T18:47:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe418007310 con 0x7fe42806aaa0 2024-09-13T18:47:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42814ed70 con 0x7fe42806aaa0 2024-09-13T18:47:38.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42814f330 con 0x7fe42806aaa0 2024-09-13T18:47:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe428161490 con 0x7fe42806aaa0 2024-09-13T18:47:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.458+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe418007470 con 0x7fe42806aaa0 2024-09-13T18:47:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.462+0000 7fe41ea00700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe404066730 0x7fe404068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.462+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe4180836d0 con 0x7fe42806aaa0 2024-09-13T18:47:38.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.462+0000 7fe41d400700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe404066730 0x7fe404068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.462+0000 7fe41d400700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe404066730 0x7fe404068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe4100097d0 tx=0x7fe410010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.466+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4180507e0 con 0x7fe42806aaa0 2024-09-13T18:47:38.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.662+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4280b2090 con 0x7fe42806aaa0 2024-09-13T18:47:38.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.666+0000 7fe41ea00700 1 -- 172.21.15.81:0/1686692137 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fe418007720 con 0x7fe42806aaa0 2024-09-13T18:47:38.676 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:38.677 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:38.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe404066730 msgr2=0x7fe404068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe404066730 0x7fe404068bf0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe4100097d0 tx=0x7fe410010000 comp rx=0 tx=0).stop 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 msgr2=0x7fe42814d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42814d0d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe41800c780 tx=0x7fe41800cb40 comp rx=0 tx=0).stop 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 shutdown_connections 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe404066730 0x7fe404068bf0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4281610b0 0x7fe4280aca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4280b2670 0x7fe4280ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 --2- 172.21.15.81:0/1686692137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe42806aaa0 0x7fe42814d0d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 >> 172.21.15.81:0/1686692137 conn(0x7fe4280b0c40 msgr2=0x7fe4280cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 shutdown_connections 2024-09-13T18:47:38.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.670+0000 7fe427200700 1 -- 172.21.15.81:0/1686692137 wait complete. 2024-09-13T18:47:38.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:47:38.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:47:38.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:47:38.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:47:38.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:47:38.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:47:38.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:47:38.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:47:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 Processor -- start 2024-09-13T18:47:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 -- start start 2024-09-13T18:47:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b00ccb40 0x7ff2b00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2b0159a70 0x7ff2b00ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b00cf020 con 0x7ff2b0159690 2024-09-13T18:47:38.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b015d530 con 0x7ff2b0159a70 2024-09-13T18:47:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.926+0000 7ff2afe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b015d810 con 0x7ff2b00ccb40 2024-09-13T18:47:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2b0159a70 0x7ff2b00ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2b0159a70 0x7ff2b00ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47026/0 (socket says 172.21.15.81:47026) 2024-09-13T18:47:38.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 -- 172.21.15.81:0/2307843763 learned_addr learned my addr 172.21.15.81:0/2307843763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f9608a00700 1 Processor -- start 2024-09-13T18:47:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2ae000700 1 --2- 172.21.15.81:0/2307843763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b00ccb40 0x7ff2b00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 -- 172.21.15.81:0/2307843763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b00ccb40 msgr2=0x7ff2b00ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 --2- 172.21.15.81:0/2307843763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b00ccb40 0x7ff2b00ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 -- 172.21.15.81:0/2307843763 >> v1:172.21.15.178:6789/0 conn(0x7ff2b0159690 legacy=0x7ff2b00cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 -- 172.21.15.81:0/2307843763 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b015daf0 con 0x7ff2b0159a70 2024-09-13T18:47:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7fd0ad000700 1 Processor -- start 2024-09-13T18:47:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7fd0ad000700 1 -- start start 2024-09-13T18:47:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2af400700 1 --2- 172.21.15.81:0/2307843763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b0159a70 0x7ff2b00ceae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8007490 tx=0x7ff2a80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1412699b395d6fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f9608a00700 1 -- start start 2024-09-13T18:47:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2ad600700 1 -- 172.21.15.81:0/2307843763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800b4e0 con 0x7ff2b0159a70 2024-09-13T18:47:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2ad600700 1 -- 172.21.15.81:0/2307843763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a8007e30 con 0x7ff2b0159a70 2024-09-13T18:47:38.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7ff2ad600700 1 -- 172.21.15.81:0/2307843763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8009840 con 0x7ff2b0159a70 2024-09-13T18:47:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f1159600700 1 Processor -- start 2024-09-13T18:47:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f9608a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9604153390 0x7f9604159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f9608a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960415a230 con 0x7f960406ae80 2024-09-13T18:47:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f9608a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040b2800 con 0x7f960406bba0 2024-09-13T18:47:38.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f9608a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040b1a40 con 0x7f9604153390 2024-09-13T18:47:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7fd0ad000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0a806dc30 0x7fd0a814fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.930+0000 7f1159600700 1 -- start start 2024-09-13T18:47:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9604153390 0x7f9604159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9603400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f960406ae80 0x7f9604159490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47076/0 (socket says 172.21.15.81:47076) 2024-09-13T18:47:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9603400700 1 -- 172.21.15.81:0/3483874395 learned_addr learned my addr 172.21.15.81:0/3483874395 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 -- 172.21.15.81:0/2307843763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b0159a70 msgr2=0x7ff2b00ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 --2- 172.21.15.81:0/2307843763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b0159a70 0x7ff2b00ceae0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8007490 tx=0x7ff2a80077a0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a7400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0a806dc30 0x7fd0a814fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a6a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd0a815a030 0x7fd0a80ada00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33790/0 (socket says 172.21.15.81:33790) 2024-09-13T18:47:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a7400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd0a806dc30 0x7fd0a814fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:50918/0 (socket says 172.21.15.81:50918) 2024-09-13T18:47:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a6a00700 1 -- 172.21.15.81:0/2201403267 learned_addr learned my addr 172.21.15.81:0/2201403267 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 -- 172.21.15.81:0/2307843763 shutdown_connections 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 --2- 172.21.15.81:0/2307843763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b0159a70 0x7ff2b00ceae0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 --2- 172.21.15.81:0/2307843763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b00ccb40 0x7ff2b00ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 -- 172.21.15.81:0/2307843763 >> 172.21.15.81:0/2307843763 conn(0x7ff2b006ca10 msgr2=0x7ff2b006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a81502c0 con 0x7fd0a80ae110 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a8159ba0 con 0x7fd0a815a030 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a815d920 con 0x7fd0a806dc30 2024-09-13T18:47:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983122644 0 0) 0x7f960415a230 con 0x7f960406ae80 2024-09-13T18:47:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e80035d0 con 0x7f960406ae80 2024-09-13T18:47:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958692428 0 0) 0x7f96040b2800 con 0x7f960406bba0 2024-09-13T18:47:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960415a230 con 0x7f960406bba0 2024-09-13T18:47:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1159600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11540b2d80 0x7f115406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901964626 0 0) 0x7fd0a8159ba0 con 0x7fd0a815a030 2024-09-13T18:47:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0035d0 con 0x7fd0a815a030 2024-09-13T18:47:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff764a00700 1 Processor -- start 2024-09-13T18:47:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff764a00700 1 -- start start 2024-09-13T18:47:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 -- 172.21.15.81:0/2307843763 shutdown_connections 2024-09-13T18:47:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1159600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11540b3560 con 0x7f115406aaa0 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1159600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11540b3280 con 0x7f11541610b0 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1159600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154070b30 con 0x7f11540b2d80 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1153e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f11541610b0 0x7f11540719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33806/0 (socket says 172.21.15.81:33806) 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1153e00700 1 -- 172.21.15.81:0/2869491402 learned_addr learned my addr 172.21.15.81:0/2869491402 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7ff2afe00700 1 -- 172.21.15.81:0/2307843763 wait complete. 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980394545 0 0) 0x7fd0a0001490 con 0x7fd0a80ae110 2024-09-13T18:47:38.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0038f0 con 0x7fd0a80ae110 2024-09-13T18:47:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1601704612 0 0) 0x7f95e80035d0 con 0x7f960406ae80 2024-09-13T18:47:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 >> v2:172.21.15.178:3300/0 conn(0x7f9604153390 msgr2=0x7f9604159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 --2- 172.21.15.81:0/3483874395 >> v2:172.21.15.178:3300/0 conn(0x7f9604153390 0x7f9604159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 >> v1:172.21.15.178:6789/0 conn(0x7f960406bba0 legacy=0x7f960406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1158c00700 1 --2- 172.21.15.81:0/2869491402 >> v2:172.21.15.81:3300/0 conn(0x7f11540b2d80 0x7f115406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a7400700 1 -- 172.21.15.81:0/2201403267 >> v1:172.21.15.178:6789/0 conn(0x7fd0a815a030 legacy=0x7fd0a80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a7400700 1 -- 172.21.15.81:0/2201403267 >> v1:172.21.15.81:6789/0 conn(0x7fd0a80ae110 legacy=0x7fd0a815c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a7400700 1 -- 172.21.15.81:0/2201403267 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a815d640 con 0x7fd0a806dc30 2024-09-13T18:47:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7fd0a7400700 1 --2- 172.21.15.81:0/2201403267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a814fd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd098009800 tx=0x7fd098009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced41c6253da425 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f1158c00700 1 -- 172.21.15.81:0/2869491402 >> v1:172.21.15.178:6789/0 conn(0x7f11541610b0 legacy=0x7f11540719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1158c00700 1 -- 172.21.15.81:0/2869491402 >> v1:172.21.15.81:6789/0 conn(0x7f115406aaa0 legacy=0x7f11540b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040b1d20 con 0x7f960406ae80 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f95f0001670 con 0x7f960406ae80 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 >> v1:172.21.15.81:6789/0 conn(0x7f960406ae80 legacy=0x7f9604159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f95e8005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e8003810 0x7f95e8003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e8007c70 0x7f95e80041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0014e0 con 0x7f95e8007c70 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040b1a40 con 0x7f95e8004cb0 2024-09-13T18:47:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.934+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e800a1b0 con 0x7f95e8003810 2024-09-13T18:47:38.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a06400700 1 Processor -- start 2024-09-13T18:47:38.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1158c00700 1 -- 172.21.15.81:0/2869491402 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154070ee0 con 0x7f11540b2d80 2024-09-13T18:47:38.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094001650 con 0x7fd0a806dc30 2024-09-13T18:47:38.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603400700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f95e8005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a06400700 1 -- start start 2024-09-13T18:47:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd098010590 con 0x7fd0a806dc30 2024-09-13T18:47:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0a6000700 1 -- 172.21.15.81:0/2201403267 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098010940 con 0x7fd0a806dc30 2024-09-13T18:47:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff764a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff76013ebc0 0x7ff76006a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1158c00700 1 --2- 172.21.15.81:0/2869491402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 0x7f115406af10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1144009880 tx=0x7f1144009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2233714235d42975 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff764a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76006ab10 0x7ff76006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9602a00700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e8003810 0x7f95e8003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1152a00700 1 -- 172.21.15.81:0/2869491402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144004230 con 0x7f11540b2d80 2024-09-13T18:47:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 msgr2=0x7fd0a814fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 --2- 172.21.15.81:0/2201403267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a814fd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd098009800 tx=0x7fd098009b10 comp rx=0 tx=0).stop 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff2afe00700 1 Processor -- start 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff76013ebc0 0x7ff76006a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff764a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76013fcc0 con 0x7ff7600703d0 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff764a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76006af50 con 0x7ff76013ebc0 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff764a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76013f0f0 con 0x7ff76006ab10 2024-09-13T18:47:38.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff76013ebc0 0x7ff76006a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:50950/0 (socket says 172.21.15.81:50950) 2024-09-13T18:47:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 -- 172.21.15.81:0/1155366528 learned_addr learned my addr 172.21.15.81:0/1155366528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1152a00700 1 -- 172.21.15.81:0/2869491402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1144004390 con 0x7f11540b2d80 2024-09-13T18:47:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1152a00700 1 -- 172.21.15.81:0/2869491402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1144004230 con 0x7f11540b2d80 2024-09-13T18:47:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75d400700 1 --2- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76006ab10 0x7ff76006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 shutdown_connections 2024-09-13T18:47:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 --2- 172.21.15.81:0/2201403267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a814fd80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 >> 172.21.15.81:0/2201403267 conn(0x7fd0a80b0c40 msgr2=0x7fd0a806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603e00700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e8007c70 0x7f95e80041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 shutdown_connections 2024-09-13T18:47:38.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603400700 1 -- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e8003810 msgr2=0x7f95e8003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603400700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e8003810 0x7f95e8003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603400700 1 -- 172.21.15.81:0/3483874395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e8007c70 msgr2=0x7f95e80041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603400700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e8007c70 0x7f95e80041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603400700 1 -- 172.21.15.81:0/3483874395 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040b1d20 con 0x7f95e8004cb0 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff2afe00700 1 -- start start 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7fd0ad000700 1 -- 172.21.15.81:0/2201403267 wait complete. 2024-09-13T18:47:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a06400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8009ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 -- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76006ab10 msgr2=0x7ff76006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 --2- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76006ab10 0x7ff76006fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 -- 172.21.15.81:0/1155366528 >> v1:172.21.15.81:6789/0 conn(0x7ff7600703d0 legacy=0x7ff76015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 -- 172.21.15.81:0/1155366528 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76013f390 con 0x7ff76013ebc0 2024-09-13T18:47:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a06400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69f80eb420 0x7f69f804ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 -- 172.21.15.81:0/2869491402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 msgr2=0x7f115406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 --2- 172.21.15.81:0/2869491402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 0x7f115406af10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1144009880 tx=0x7f1144009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a05000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8009ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 -- 172.21.15.81:0/2869491402 shutdown_connections 2024-09-13T18:47:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff75de00700 1 --2- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76013ebc0 0x7ff76006a5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff75800f370 tx=0x7ff75800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0105be4a3c43585 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a05000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8009ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49052/0 (socket says 172.21.15.81:49052) 2024-09-13T18:47:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a05000700 1 -- 172.21.15.81:0/3707286588 learned_addr learned my addr 172.21.15.81:0/3707286588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a06400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f801cfa0 con 0x7f69f8007260 2024-09-13T18:47:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 --2- 172.21.15.81:0/2869491402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 0x7f115406af10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 -- 172.21.15.81:0/2869491402 >> 172.21.15.81:0/2869491402 conn(0x7f11540b0c40 msgr2=0x7f115406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f69ffe00700 1 --2- 172.21.15.81:0/3707286588 >> v2:172.21.15.178:3300/0 conn(0x7f69f80eb420 0x7f69f804ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 -- 172.21.15.81:0/2869491402 shutdown_connections 2024-09-13T18:47:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f9603e00700 1 -- 172.21.15.81:0/3483874395 reap_dead start 2024-09-13T18:47:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f1159600700 1 -- 172.21.15.81:0/2869491402 wait complete. 2024-09-13T18:47:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff2afe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00ccb40 0x7ff2b0144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7ff2afe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b0159690 0x7ff2b0158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff75ca00700 1 -- 172.21.15.81:0/1155366528 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758012070 con 0x7ff76013ebc0 2024-09-13T18:47:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff75ca00700 1 -- 172.21.15.81:0/1155366528 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800d0d0 con 0x7ff76013ebc0 2024-09-13T18:47:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff75ca00700 1 -- 172.21.15.81:0/1155366528 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800d460 con 0x7ff76013ebc0 2024-09-13T18:47:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9603400700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f95e8005090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c2f0 tx=0x7f95e80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10553bbc56350c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2afe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2b0159a70 0x7ff2b014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2afe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0144780 con 0x7ff2b00ccb40 2024-09-13T18:47:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2afe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01ee580 con 0x7ff2b0159a70 2024-09-13T18:47:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2afe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0156df0 con 0x7ff2b0159690 2024-09-13T18:47:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2aea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00ccb40 0x7ff2b0144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b0159690 0x7ff2b0158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007c50 con 0x7f95e8004cb0 2024-09-13T18:47:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b0159690 0x7ff2b0158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49062/0 (socket says 172.21.15.81:49062) 2024-09-13T18:47:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 -- 172.21.15.81:0/1682194964 learned_addr learned my addr 172.21.15.81:0/1682194964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000ce30 con 0x7f95e8004cb0 2024-09-13T18:47:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9602000700 1 -- 172.21.15.81:0/3483874395 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005bc0 con 0x7f95e8004cb0 2024-09-13T18:47:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.938+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f801c670 con 0x7f69f80eb420 2024-09-13T18:47:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f801c950 con 0x7f69f8033ac0 2024-09-13T18:47:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2af400700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2b0159a70 0x7ff2b014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f69ff400700 1 -- 172.21.15.81:0/3707286588 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316587229 0 0) 0x7f69f801cfa0 con 0x7f69f8007260 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f69ff400700 1 -- 172.21.15.81:0/3707286588 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e80035d0 con 0x7f69f8007260 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f6a05000700 1 -- 172.21.15.81:0/3707286588 >> v2:172.21.15.178:3300/0 conn(0x7f69f80eb420 msgr2=0x7f69f804ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f6a05000700 1 --2- 172.21.15.81:0/3707286588 >> v2:172.21.15.178:3300/0 conn(0x7f69f80eb420 0x7f69f804ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f6a05000700 1 -- 172.21.15.81:0/3707286588 >> v1:172.21.15.178:6789/0 conn(0x7f69f8007260 legacy=0x7f69f801d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f6a05000700 1 -- 172.21.15.81:0/3707286588 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f801cc30 con 0x7f69f8033ac0 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 -- 172.21.15.81:0/1682194964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2b0159a70 msgr2=0x7ff2b014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2b0159a70 0x7ff2b014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 -- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00ccb40 msgr2=0x7ff2b0144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2b00ccb40 0x7ff2b0144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 -- 172.21.15.81:0/1682194964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a800bd40 con 0x7ff2b0159690 2024-09-13T18:47:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7fd0ad000700 1 Processor -- start 2024-09-13T18:47:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 -- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 msgr2=0x7f95e8005090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f95e8005090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f95f000c2f0 tx=0x7f95e80058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 Processor -- start 2024-09-13T18:47:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 -- 172.21.15.81:0/3483874395 shutdown_connections 2024-09-13T18:47:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 --2- 172.21.15.81:0/3483874395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f95e8005090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 -- 172.21.15.81:0/3483874395 >> 172.21.15.81:0/3483874395 conn(0x7f960406a390 msgr2=0x7f960406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7fd0ad000700 1 -- start start 2024-09-13T18:47:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 -- 172.21.15.81:0/3483874395 shutdown_connections 2024-09-13T18:47:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 -- start start 2024-09-13T18:47:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2ae000700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b0159690 0x7ff2b0158850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000e7c0 tx=0x7ff2a000ead0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f1159600700 1 Processor -- start 2024-09-13T18:47:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f9608a00700 1 -- 172.21.15.81:0/3483874395 wait complete. 2024-09-13T18:47:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff764a00700 1 -- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76013ebc0 msgr2=0x7ff76006a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff764a00700 1 --2- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76013ebc0 0x7ff76006a5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff75800f370 tx=0x7ff75800f680 comp rx=0 tx=0).stop 2024-09-13T18:47:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0013610 con 0x7ff2b0159690 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a0013770 con 0x7ff2b0159690 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a0013ae0 con 0x7ff2b0159690 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b01570d0 con 0x7ff2b0159690 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b0157690 con 0x7ff2b0159690 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f6c15cd10 0x7f7f6c0b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0b6ef0 0x7f7f6c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6c0ce150 con 0x7f7f6c0cd7d0 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6c15d0f0 con 0x7f7f6c15cd10 2024-09-13T18:47:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f7f72600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0d1880 con 0x7f7f6c0b6ef0 2024-09-13T18:47:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7fd0ad000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a8140af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7fd0ad000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a80ae110 0x7fd0a80b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a8140af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.942+0000 7f1159600700 1 -- start start 2024-09-13T18:47:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1159600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115406aaa0 0x7f1154164440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1159600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 0x7f1154156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff764a00700 1 -- 172.21.15.81:0/1155366528 shutdown_connections 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff764a00700 1 --2- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76006ab10 0x7ff76006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff764a00700 1 --2- 172.21.15.81:0/1155366528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff76013ebc0 0x7ff76006a5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff764a00700 1 -- 172.21.15.81:0/1155366528 >> 172.21.15.81:0/1155366528 conn(0x7ff7600b08d0 msgr2=0x7ff7600b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff2b015e2f0 con 0x7ff2b0159690 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1159600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11541610b0 0x7f11541629d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1159600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541625b0 con 0x7f11540b2d80 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1159600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154164980 con 0x7f115406aaa0 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1159600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1154161930 con 0x7f11541610b0 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a8140af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:50982/0 (socket says 172.21.15.81:50982) 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f6be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7f6c0cd7d0 0x7f7f6c0d06d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47116/0 (socket says 172.21.15.81:47116) 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f6be00700 1 -- 172.21.15.81:0/1164506071 learned_addr learned my addr 172.21.15.81:0/1164506071 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71200700 1 --2- 172.21.15.81:0/1164506071 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c15cd10 0x7f7f6c0b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71c00700 1 --2- 172.21.15.81:0/1164506071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0b6ef0 0x7f7f6c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a05000700 1 --2- 172.21.15.81:0/3707286588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8009ba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009910 tx=0x7f69f4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e203929c2911ef10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115406aaa0 0x7f1154164440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115406aaa0 0x7f1154164440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:50996/0 (socket says 172.21.15.81:50996) 2024-09-13T18:47:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 -- 172.21.15.81:0/165939601 learned_addr learned my addr 172.21.15.81:0/165939601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff764a00700 1 -- 172.21.15.81:0/1155366528 shutdown_connections 2024-09-13T18:47:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7400700 1 -- 172.21.15.81:0/663791114 learned_addr learned my addr 172.21.15.81:0/663791114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0ad000700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a815a030 0x7fd0a8149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a80b3120 con 0x7fd0a815a030 2024-09-13T18:47:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8141030 con 0x7fd0a806dc30 2024-09-13T18:47:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a815c460 con 0x7fd0a80ae110 2024-09-13T18:47:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1158c00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11541610b0 0x7f11541629d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7ff764a00700 1 -- 172.21.15.81:0/1155366528 wait complete. 2024-09-13T18:47:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153400700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 0x7f1154156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f69ff400700 1 -- 172.21.15.81:0/3707286588 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4005e50 con 0x7f69f8033ac0 2024-09-13T18:47:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a6a00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a80ae110 0x7fd0a80b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a815a030 0x7fd0a8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f69ff400700 1 -- 172.21.15.81:0/3707286588 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4006030 con 0x7f69f8033ac0 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f69ff400700 1 -- 172.21.15.81:0/3707286588 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f40063e0 con 0x7f69f8033ac0 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 -- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11541610b0 msgr2=0x7f11541629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11541610b0 0x7f11541629d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 -- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 msgr2=0x7f1154156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11540b2d80 0x7f1154156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f1153e00700 1 -- 172.21.15.81:0/165939601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440094b0 con 0x7f115406aaa0 2024-09-13T18:47:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f6b400700 1 -- 172.21.15.81:0/1164506071 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298593598 0 0) 0x7f7f6c0ce150 con 0x7f7f6c0cd7d0 2024-09-13T18:47:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f6b400700 1 -- 172.21.15.81:0/1164506071 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f540035d0 con 0x7f7f6c0cd7d0 2024-09-13T18:47:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f9608a00700 1 Processor -- start 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 -- 172.21.15.81:0/663791114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a80ae110 msgr2=0x7fd0a80b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a80ae110 0x7fd0a80b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 -- 172.21.15.81:0/663791114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 msgr2=0x7fd0a8140af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0a806dc30 0x7fd0a8140af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f9608a00700 1 -- start start 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0980094b0 con 0x7fd0a815a030 2024-09-13T18:47:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a6a00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0a80ae110 0x7fd0a80b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71c00700 1 -- 172.21.15.81:0/1164506071 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c15cd10 msgr2=0x7f7f6c0b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71c00700 1 --2- 172.21.15.81:0/1164506071 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c15cd10 0x7f7f6c0b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71c00700 1 -- 172.21.15.81:0/1164506071 >> v1:172.21.15.81:6789/0 conn(0x7f7f6c0cd7d0 legacy=0x7f7f6c0d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71c00700 1 -- 172.21.15.81:0/1164506071 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c0d1b20 con 0x7f7f6c0b6ef0 2024-09-13T18:47:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71200700 1 --2- 172.21.15.81:0/1164506071 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c15cd10 0x7f7f6c0b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7fd0a7e00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a815a030 0x7fd0a8149920 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000cbb0 tx=0x7fd0a000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 msgr2=0x7f69f8009ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 --2- 172.21.15.81:0/3707286588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8009ba0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009910 tx=0x7f69f4009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 shutdown_connections 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 --2- 172.21.15.81:0/3707286588 >> v2:172.21.15.178:3300/0 conn(0x7f69f80eb420 0x7f69f804ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 --2- 172.21.15.81:0/3707286588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8009ba0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 >> 172.21.15.81:0/3707286588 conn(0x7f69f8036140 msgr2=0x7f69f8036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f31800700 1 Processor -- start 2024-09-13T18:47:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 shutdown_connections 2024-09-13T18:47:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f31800700 1 -- start start 2024-09-13T18:47:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f7f71c00700 1 --2- 172.21.15.81:0/1164506071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0b6ef0 0x7f7f6c0cdc10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009d90 tx=0x7f7f6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1db2c2510fe75a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.946+0000 7f6a06400700 1 -- 172.21.15.81:0/3707286588 wait complete. 2024-09-13T18:47:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9608a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f9604142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9608a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9604158d90 0x7f960415bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f6b400700 1 -- 172.21.15.81:0/1164506071 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6400e070 con 0x7f7f6c0b6ef0 2024-09-13T18:47:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f6b400700 1 -- 172.21.15.81:0/1164506071 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400bb20 con 0x7f7f6c0b6ef0 2024-09-13T18:47:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9608a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96041537a0 0x7f960414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9608a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960414f830 con 0x7f96041537a0 2024-09-13T18:47:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9608a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960414ec20 con 0x7f95e8004cb0 2024-09-13T18:47:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9608a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960414ef00 con 0x7f9604158d90 2024-09-13T18:47:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f1153e00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115406aaa0 0x7f1154164440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f114c00ba50 tx=0x7f114c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 Processor -- start 2024-09-13T18:47:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00c9b0 con 0x7f115406aaa0 2024-09-13T18:47:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00cb30 con 0x7f115406aaa0 2024-09-13T18:47:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c014440 con 0x7f115406aaa0 2024-09-13T18:47:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f6b400700 1 -- 172.21.15.81:0/1164506071 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64012430 con 0x7f7f6c0b6ef0 2024-09-13T18:47:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 -- 172.21.15.81:0/1164506071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0b6ef0 msgr2=0x7f7f6c0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 --2- 172.21.15.81:0/1164506071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0b6ef0 0x7f7f6c0cdc10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009d90 tx=0x7f7f6400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2a0013c40 con 0x7ff2b0159690 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 -- 172.21.15.81:0/1164506071 shutdown_connections 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 --2- 172.21.15.81:0/1164506071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0b6ef0 0x7f7f6c0cdc10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 --2- 172.21.15.81:0/1164506071 >> v2:172.21.15.178:3300/0 conn(0x7f7f6c15cd10 0x7f7f6c0b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 -- 172.21.15.81:0/1164506071 >> 172.21.15.81:0/1164506071 conn(0x7f7f6c0cf580 msgr2=0x7f7f6c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 -- 172.21.15.81:0/1164506071 shutdown_connections 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f72600700 1 -- 172.21.15.81:0/1164506071 wait complete. 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f31800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f2c1466d0 0x7f7f2c1612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 -- start start 2024-09-13T18:47:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f9604142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f9604142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51002/0 (socket says 172.21.15.81:51002) 2024-09-13T18:47:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f31800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f2c06a980 0x7f7f2c0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 -- 172.21.15.81:0/415807426 learned_addr learned my addr 172.21.15.81:0/415807426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76006ab10 0x7ff760159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7600703d0 0x7ff7600cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f31800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c06d360 con 0x7f7f2c15d2a0 2024-09-13T18:47:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f31800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c1617e0 con 0x7f7f2c06a980 2024-09-13T18:47:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f31800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c06b9a0 con 0x7f7f2c1466d0 2024-09-13T18:47:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76013ebc0 0x7ff7601f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff75de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76006ab10 0x7ff760159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f6a06400700 1 Processor -- start 2024-09-13T18:47:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2aa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f2c1466d0 0x7f7f2c1612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f2c06a980 0x7f7f2c0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 -- 172.21.15.81:0/415807426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9604158d90 msgr2=0x7f960415bc80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9604158d90 0x7f960415bc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 -- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96041537a0 msgr2=0x7f960414fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96041537a0 0x7f960414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f9603400700 1 -- 172.21.15.81:0/415807426 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960414f1e0 con 0x7f95e8004cb0 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760158f30 con 0x7ff76006ab10 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff75e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76013ebc0 0x7ff7601f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff75e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76013ebc0 0x7ff7601f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49110/0 (socket says 172.21.15.81:49110) 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff75e800700 1 -- 172.21.15.81:0/2381913593 learned_addr learned my addr 172.21.15.81:0/2381913593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff75de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76006ab10 0x7ff760159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47082/0 (socket says 172.21.15.81:47082) 2024-09-13T18:47:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a0003c20 con 0x7fd0a815a030 2024-09-13T18:47:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a0003d80 con 0x7fd0a815a030 2024-09-13T18:47:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000aa80 con 0x7fd0a815a030 2024-09-13T18:47:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a80b2250 con 0x7fd0a815a030 2024-09-13T18:47:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a80b2780 con 0x7fd0a815a030 2024-09-13T18:47:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f6a06400700 1 -- start start 2024-09-13T18:47:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600b39a0 con 0x7ff7600703d0 2024-09-13T18:47:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff760158590 con 0x7ff76013ebc0 2024-09-13T18:47:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7f2c06a980 0x7f7f2c0d0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47090/0 (socket says 172.21.15.81:47090) 2024-09-13T18:47:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2a000700 1 -- 172.21.15.81:0/3021602869 learned_addr learned my addr 172.21.15.81:0/3021602869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2aa00700 1 -- 172.21.15.81:0/3021602869 >> v2:172.21.15.81:3300/0 conn(0x7f7f2c06a980 msgr2=0x7f7f2c0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2aa00700 1 --2- 172.21.15.81:0/3021602869 >> v2:172.21.15.81:3300/0 conn(0x7f7f2c06a980 0x7f7f2c0d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2aa00700 1 -- 172.21.15.81:0/3021602869 >> v1:172.21.15.81:6789/0 conn(0x7f7f2c15d2a0 legacy=0x7f7f2c06f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f7f2aa00700 1 -- 172.21.15.81:0/3021602869 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c06ae20 con 0x7f7f2c1466d0 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff2a7400700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff290066760 0x7ff290068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff2a0084620 con 0x7ff2b0159690 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff2a7400700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7ff29006fda0 0x7ff2900721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff2900728b0 con 0x7ff29006fda0 2024-09-13T18:47:38.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2a00849d0 con 0x7ff2b0159690 2024-09-13T18:47:38.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75d400700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7600703d0 0x7ff7600cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f9603400700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f9604142180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f95e800a180 tx=0x7f95f0001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.950+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1154161c10 con 0x7f115406aaa0 2024-09-13T18:47:38.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11541621d0 con 0x7f115406aaa0 2024-09-13T18:47:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff2af400700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7ff29006fda0 0x7ff2900721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f7f72600700 1 Processor -- start 2024-09-13T18:47:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75e800700 1 -- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7600703d0 msgr2=0x7ff7600cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0005e70 con 0x7f95e8004cb0 2024-09-13T18:47:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0a8159830 con 0x7fd0a815a030 2024-09-13T18:47:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00070d0 con 0x7f95e8004cb0 2024-09-13T18:47:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0007480 con 0x7f95e8004cb0 2024-09-13T18:47:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960414f4c0 con 0x7f95e8004cb0 2024-09-13T18:47:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff2aea00700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff290066760 0x7ff290068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960415c1c0 con 0x7f95e8004cb0 2024-09-13T18:47:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75e800700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7600703d0 0x7ff7600cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75e800700 1 -- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76006ab10 msgr2=0x7ff760159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75e800700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76006ab10 0x7ff760159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11540714a0 con 0x7f115406aaa0 2024-09-13T18:47:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff2af400700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7ff29006fda0 0x7ff2900721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a06400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69f8007260 0x7f69f80d8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a06400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8037eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a06400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80383f0 0x7f69f80e9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a06400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80e7310 con 0x7f69f80383f0 2024-09-13T18:47:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a06400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80e7890 con 0x7f69f8007260 2024-09-13T18:47:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a06400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8038950 con 0x7f69f8033ac0 2024-09-13T18:47:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff2aea00700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff290066760 0x7ff290068c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000f60 tx=0x7ff29c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75e800700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75800f050 con 0x7ff76013ebc0 2024-09-13T18:47:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f7f2aa00700 1 --2- 172.21.15.81:0/3021602869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c1466d0 0x7f7f2c1612a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c066e60 tx=0x7f7f1c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48cde8be69d10ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f7f72600700 1 -- start start 2024-09-13T18:47:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f69ffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8037eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80383f0 0x7f69f80e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f69ffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8037eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49114/0 (socket says 172.21.15.81:49114) 2024-09-13T18:47:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f69ffe00700 1 -- 172.21.15.81:0/2757057103 learned_addr learned my addr 172.21.15.81:0/2757057103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f7f29600700 1 -- 172.21.15.81:0/3021602869 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c014e90 con 0x7f7f2c1466d0 2024-09-13T18:47:39.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff75e800700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76013ebc0 0x7ff7601f6d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c480 tx=0x7ff75000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== osd.1 v2:172.21.15.81:6824/2924937371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff2900728b0 con 0x7ff29006fda0 2024-09-13T18:47:39.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f7f29600700 1 -- 172.21.15.81:0/3021602869 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c004030 con 0x7f7f2c1466d0 2024-09-13T18:47:39.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f7f29600700 1 -- 172.21.15.81:0/3021602869 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c0043c0 con 0x7f7f2c1466d0 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f114c0145a0 con 0x7f115406aaa0 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a05000700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69f8007260 0x7f69f80d8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a05a00700 1 -- 172.21.15.81:0/2757057103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 msgr2=0x7f69f8037eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a05a00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69f8033ac0 0x7f69f8037eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.954+0000 7f6a05a00700 1 -- 172.21.15.81:0/2757057103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69f8007260 msgr2=0x7f69f80d8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f6a05a00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69f8007260 0x7f69f80d8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f6a05a00700 1 -- 172.21.15.81:0/2757057103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009520 con 0x7f69f80383f0 2024-09-13T18:47:39.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500052d0 con 0x7ff76013ebc0 2024-09-13T18:47:39.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f6a05000700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69f8007260 0x7f69f80d8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:39.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f6a05a00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80383f0 0x7f69f80e9490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6a000641b0 tx=0x7f6a00073330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f72600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c0b6ef0 0x7f7f6c1fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd0a000abe0 con 0x7fd0a815a030 2024-09-13T18:47:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff750005430 con 0x7ff76013ebc0 2024-09-13T18:47:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500055a0 con 0x7ff76013ebc0 2024-09-13T18:47:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff760158870 con 0x7ff76013ebc0 2024-09-13T18:47:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600ce150 con 0x7ff76013ebc0 2024-09-13T18:47:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000680d0 con 0x7f69f80383f0 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f114be00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1134066730 0x7f1134068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f114c084870 con 0x7f115406aaa0 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f114be00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7f113406fcf0 0x7f1134072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1134072800 con 0x7f113406fcf0 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f114c084cc0 con 0x7f115406aaa0 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00068230 con 0x7f69f80383f0 2024-09-13T18:47:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00068620 con 0x7f69f80383f0 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f31800700 1 -- 172.21.15.81:0/3021602869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c1466d0 msgr2=0x7f7f2c1612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f31800700 1 --2- 172.21.15.81:0/3021602869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c1466d0 0x7f7f2c1612a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c066e60 tx=0x7f7f1c009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f31800700 1 -- 172.21.15.81:0/3021602869 shutdown_connections 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f31800700 1 --2- 172.21.15.81:0/3021602869 >> v2:172.21.15.81:3300/0 conn(0x7f7f2c06a980 0x7f7f2c0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f31800700 1 --2- 172.21.15.81:0/3021602869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c1466d0 0x7f7f2c1612a0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c066e60 tx=0x7f7f1c009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f31800700 1 -- 172.21.15.81:0/3021602869 >> 172.21.15.81:0/3021602869 conn(0x7f7f2c06e660 msgr2=0x7f7f2c06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f1158c00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7f113406fcf0 0x7f1134072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f72600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0cd7d0 0x7f7f6c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f72600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c15cd10 0x7f7f6c0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f72600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0cb470 con 0x7f7f6c15cd10 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f72600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0ca860 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f72600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c0cab40 con 0x7f7f6c0cd7d0 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c0b6ef0 0x7f7f6c1fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c0b6ef0 0x7f7f6c1fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51054/0 (socket says 172.21.15.81:51054) 2024-09-13T18:47:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 -- 172.21.15.81:0/3049370992 learned_addr learned my addr 172.21.15.81:0/3049370992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f1153400700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1134066730 0x7f1134068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f6be00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0cd7d0 0x7f7f6c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f1158c00700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7f113406fcf0 0x7f1134072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96040b22e0 con 0x7f95e8004cb0 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7fd09f400700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd088066810 0x7fd088068cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0a0084bb0 con 0x7fd0a815a030 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7fd09f400700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7fd08806fe50 0x7fd088072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd088072960 con 0x7fd08806fe50 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a0084f60 con 0x7fd0a815a030 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71c00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c15cd10 0x7f7f6c0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 -- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0cd7d0 msgr2=0x7f7f6c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f6c0cd7d0 0x7f7f6c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 -- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c15cd10 msgr2=0x7f7f6c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f6c15cd10 0x7f7f6c0b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.958+0000 7f7f71200700 1 -- 172.21.15.81:0/3049370992 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c0094b0 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8038c30 con 0x7f69f80383f0 2024-09-13T18:47:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f1153400700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1134066730 0x7f1134068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11541608d0 tx=0x7f1140009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f80d9070 con 0x7f69f80383f0 2024-09-13T18:47:39.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7fd0a6a00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7fd08806fe50 0x7fd088072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7fd0a7400700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd088066810 0x7fd088068cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f71200700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c0b6ef0 0x7f7f6c1fe950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00ebe0 tx=0x7f7f5c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1134072800 con 0x7f113406fcf0 2024-09-13T18:47:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00c890 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c00c9f0 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00cd80 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff76013f950 con 0x7ff76013ebc0 2024-09-13T18:47:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f69f800a0e0 con 0x7f69f80383f0 2024-09-13T18:47:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7fd0a6a00700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7fd08806fe50 0x7fd088072290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7fd0a7400700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd088066810 0x7fd088068cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd098009b50 tx=0x7fd09801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f64009a70 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c0cb100 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f31800700 1 -- 172.21.15.81:0/3021602869 shutdown_connections 2024-09-13T18:47:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f31800700 1 -- 172.21.15.81:0/3021602869 wait complete. 2024-09-13T18:47:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f7f31800700 1 Processor -- start 2024-09-13T18:47:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== osd.3 v2:172.21.15.81:6816/3484646797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd088072960 con 0x7fd08806fe50 2024-09-13T18:47:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95f00075e0 con 0x7f95e8004cb0 2024-09-13T18:47:39.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f95fb400700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e4066730 0x7f95e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f95f0085b60 con 0x7f95e8004cb0 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f95fb400700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f95e406fcf0 0x7f95e4072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 --> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95e4072800 con 0x7f95e406fcf0 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f008a240 con 0x7f95e8004cb0 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f9602a00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e4066730 0x7f95e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.962+0000 7f9603e00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f95e406fcf0 0x7f95e4072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f31800700 1 -- start start 2024-09-13T18:47:39.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f31800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c06a980 0x7f7f2c13c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f48000fc0 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f31800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2c15d2a0 0x7f7f2c15ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f2aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c06a980 0x7f7f2c13c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f2aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c06a980 0x7f7f2c13c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51068/0 (socket says 172.21.15.81:51068) 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f2a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2c15d2a0 0x7f7f2c15ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f2a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2c15d2a0 0x7f7f2c15ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47118/0 (socket says 172.21.15.81:47118) 2024-09-13T18:47:39.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f2aa00700 1 -- 172.21.15.81:0/2237896885 learned_addr learned my addr 172.21.15.81:0/2237896885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7500038e0 con 0x7ff76013ebc0 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff756000700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff740066800 0x7ff740068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff750083820 con 0x7ff76013ebc0 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff756000700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7ff74006fe40 0x7ff740072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff740072950 con 0x7ff74006fe40 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff750085e40 con 0x7ff76013ebc0 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7ff75d400700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7ff74006fe40 0x7ff740072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f31800700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f2c1604e0 0x7f7f2c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f5c013470 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.966+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c151ef0 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c152100 con 0x7f7f2c06a980 2024-09-13T18:47:39.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a00090070 con 0x7f69f80383f0 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f68c00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f50066830 0x7f7f50068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f5c0848f0 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2b400700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f2c1604e0 0x7f7f2c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1523e0 con 0x7f7f2c1604e0 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2a000700 1 -- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f2c1604e0 msgr2=0x7f7f2c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2a000700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f2c1604e0 0x7f7f2c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2a000700 1 -- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c06a980 msgr2=0x7f7f2c13c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2a000700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c06a980 0x7f7f2c13c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2a000700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0094b0 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2a000700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2c15d2a0 0x7f7f2c15ffa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800e810 tx=0x7f7f1800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f2aa00700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f2c06a980 0x7f7f2c13c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7ff75de00700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff740066800 0x7ff740068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7ff75d400700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7ff74006fe40 0x7ff740072280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f68c00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f7f5006fe70 0x7f7f500722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f69fcc00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69e0066800 0x7f69e0068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a000fd7d0 con 0x7f69f80383f0 2024-09-13T18:47:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f69fcc00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7f69e006fe40 0x7f69e0072280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f69e0072950 con 0x7f69e006fe40 2024-09-13T18:47:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f50072980 con 0x7f7f5006fe70 2024-09-13T18:47:39.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a000fdb80 con 0x7f69f80383f0 2024-09-13T18:47:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f5c089280 con 0x7f7f6c0b6ef0 2024-09-13T18:47:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f9602a00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e4066730 0x7f95e4068bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96041f11d0 tx=0x7f95f400a350 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f9603e00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f95e406fcf0 0x7f95e4072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18013610 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f18013770 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c1526c0 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== osd.7 v2:172.21.15.178:6816/2829585854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff740072950 con 0x7ff74006fe40 2024-09-13T18:47:39.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f6be00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f50066830 0x7f7f50068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f71c00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f7f5006fe70 0x7f7f500722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18013ae0 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.970+0000 7f6a05000700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69e0066800 0x7f69e0068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== osd.2 v2:172.21.15.81:6808/533641915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f95e4072800 con 0x7f95e406fcf0 2024-09-13T18:47:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f69ffe00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7f69e006fe40 0x7f69e0072280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c152c80 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7ff75de00700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff740066800 0x7ff740068cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff75800f6c0 tx=0x7ff758018040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f7f6be00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f50066830 0x7f7f50068cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0d03d0 tx=0x7f7f60007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f7f71c00700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f7f5006fe70 0x7f7f500722b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f69ffe00700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7f69e006fe40 0x7f69e0072280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f6a05000700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69e0066800 0x7f69e0068cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69f4006000 tx=0x7f69f4008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.974+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f2c0b4150 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.978+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f18013c40 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.978+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== osd.4 v2:172.21.15.178:6803/1450995168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7f50072980 con 0x7f7f5006fe70 2024-09-13T18:47:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.978+0000 7f7f22a00700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f0c066730 0x7f7f0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.978+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f69e0072950 con 0x7f69e006fe40 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.982+0000 7f7f2aa00700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f0c066730 0x7f7f0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.982+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f18084380 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f7f22a00700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f7f0c06fcf0 0x7f7f0c072130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f0c072800 con 0x7f7f0c06fcf0 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f180846a0 con 0x7f7f2c15d2a0 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f7f2b400700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f7f0c06fcf0 0x7f7f0c072130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f7f2aa00700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f0c066730 0x7f7f0c068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0090b0 tx=0x7f7f1c018000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f7f2b400700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f7f0c06fcf0 0x7f7f0c072130 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f115406b450 con 0x7f113406fcf0 2024-09-13T18:47:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.986+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff2b015e0b0 con 0x7ff29006fda0 2024-09-13T18:47:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f114be00700 1 -- 172.21.15.81:0/165939601 <== osd.6 v2:172.21.15.178:6800/3369283961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f11440036c0 con 0x7f113406fcf0 2024-09-13T18:47:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== osd.5 v2:172.21.15.178:6824/2042484449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7f0c072800 con 0x7f7f0c06fcf0 2024-09-13T18:47:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7f113406fcf0 msgr2=0x7f1134072130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7f113406fcf0 0x7f1134072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2a7400700 1 -- 172.21.15.81:0/1682194964 <== osd.1 v2:172.21.15.81:6824/2924937371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff2a8021040 con 0x7ff29006fda0 2024-09-13T18:47:39.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1134066730 msgr2=0x7f1134068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1134066730 0x7f1134068bf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11541608d0 tx=0x7f1140009040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115406aaa0 msgr2=0x7f1154164440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 --2- 172.21.15.81:0/165939601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f115406aaa0 0x7f1154164440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f114c00ba50 tx=0x7f114c00bd60 comp rx=0 tx=0).stop 2024-09-13T18:47:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1158c00700 1 -- 172.21.15.81:0/165939601 reap_dead start 2024-09-13T18:47:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 shutdown_connections 2024-09-13T18:47:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 >> 172.21.15.81:0/165939601 conn(0x7f11540b0c40 msgr2=0x7f11540b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7ff29006fda0 msgr2=0x7ff2900721e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 shutdown_connections 2024-09-13T18:47:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7f1159600700 1 -- 172.21.15.81:0/165939601 wait complete. 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2afe00700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7ff29006fda0 0x7ff2900721e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff290066760 msgr2=0x7ff290068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2afe00700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff290066760 0x7ff290068c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000f60 tx=0x7ff29c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b0159690 msgr2=0x7ff2b0158850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2afe00700 1 --2- 172.21.15.81:0/1682194964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2b0159690 0x7ff2b0158850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff2a000e7c0 tx=0x7ff2a000ead0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.990+0000 7ff2af400700 1 -- 172.21.15.81:0/1682194964 reap_dead start 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.994+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 shutdown_connections 2024-09-13T18:47:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.994+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 --> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0a80b3260 con 0x7fd08806fe50 2024-09-13T18:47:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.994+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 >> 172.21.15.81:0/1682194964 conn(0x7ff2b006ca10 msgr2=0x7ff2b015c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.994+0000 7fd09f400700 1 -- 172.21.15.81:0/663791114 <== osd.3 v2:172.21.15.81:6816/3484646797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd0a80b3260 con 0x7fd08806fe50 2024-09-13T18:47:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.994+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 --> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f960414f970 con 0x7f95e406fcf0 2024-09-13T18:47:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.994+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 shutdown_connections 2024-09-13T18:47:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7ff2afe00700 1 -- 172.21.15.81:0/1682194964 wait complete. 2024-09-13T18:47:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7f95fb400700 1 -- 172.21.15.81:0/415807426 <== osd.2 v2:172.21.15.81:6808/533641915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95fc002080 con 0x7f95e406fcf0 2024-09-13T18:47:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7fd08806fe50 msgr2=0x7fd088072290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7fd0ad000700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7fd08806fe50 0x7fd088072290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd088066810 msgr2=0x7fd088068cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7fd0ad000700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd088066810 0x7fd088068cd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd098009b50 tx=0x7fd09801c040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a815a030 msgr2=0x7fd0a8149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7fd0ad000700 1 --2- 172.21.15.81:0/663791114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0a815a030 0x7fd0a8149920 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000cbb0 tx=0x7fd0a000cec0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f69f80e7a00 con 0x7f69e006fe40 2024-09-13T18:47:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f95e406fcf0 msgr2=0x7f95e4072130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:38.998+0000 7f9608a00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f95e406fcf0 0x7f95e4072130 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7fd0a7e00700 1 -- 172.21.15.81:0/663791114 reap_dead start 2024-09-13T18:47:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 shutdown_connections 2024-09-13T18:47:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 >> 172.21.15.81:0/663791114 conn(0x7fd0a80b0c40 msgr2=0x7fd0a80cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e4066730 msgr2=0x7f95e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e4066730 0x7f95e4068bf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f96041f11d0 tx=0x7f95f400a350 comp rx=0 tx=0).stop 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 msgr2=0x7f9604142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 --2- 172.21.15.81:0/415807426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e8004cb0 0x7f9604142180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f95e800a180 tx=0x7f95f0001930 comp rx=0 tx=0).stop 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9603e00700 1 -- 172.21.15.81:0/415807426 reap_dead start 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 shutdown_connections 2024-09-13T18:47:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 >> 172.21.15.81:0/415807426 conn(0x7f960406a390 msgr2=0x7f960406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 shutdown_connections 2024-09-13T18:47:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7fd0ad000700 1 -- 172.21.15.81:0/663791114 wait complete. 2024-09-13T18:47:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f69fcc00700 1 -- 172.21.15.81:0/2757057103 <== osd.0 v2:172.21.15.81:6800/3220976985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f69f80e7a00 con 0x7f69e006fe40 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7f69e006fe40 msgr2=0x7f69e0072280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7f69e006fe40 0x7f69e0072280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69e0066800 msgr2=0x7f69e0068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f69e0066800 0x7f69e0068cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69f4006000 tx=0x7f69f4008070 comp rx=0 tx=0).stop 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80383f0 msgr2=0x7f69f80e9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 --2- 172.21.15.81:0/2757057103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69f80383f0 0x7f69f80e9490 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6a000641b0 tx=0x7f6a00073330 comp rx=0 tx=0).stop 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a05a00700 1 -- 172.21.15.81:0/2757057103 reap_dead start 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 shutdown_connections 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 >> 172.21.15.81:0/2757057103 conn(0x7f69f8036140 msgr2=0x7f69f804a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 shutdown_connections 2024-09-13T18:47:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f6a06400700 1 -- 172.21.15.81:0/2757057103 wait complete. 2024-09-13T18:47:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.002+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 shutdown_connections 2024-09-13T18:47:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.006+0000 7f9608a00700 1 -- 172.21.15.81:0/415807426 wait complete. 2024-09-13T18:47:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.010+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff760159070 con 0x7ff74006fe40 2024-09-13T18:47:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff756000700 1 -- 172.21.15.81:0/2381913593 <== osd.7 v2:172.21.15.178:6816/2829585854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff760159070 con 0x7ff74006fe40 2024-09-13T18:47:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f48002d60 con 0x7f7f5006fe70 2024-09-13T18:47:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7ff74006fe40 msgr2=0x7ff740072280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7ff74006fe40 0x7ff740072280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff740066800 msgr2=0x7ff740068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff740066800 0x7ff740068cc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff75800f6c0 tx=0x7ff758018040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76013ebc0 msgr2=0x7ff7601f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 --2- 172.21.15.81:0/2381913593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff76013ebc0 0x7ff7601f6d60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c480 tx=0x7ff75000c790 comp rx=0 tx=0).stop 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff75e800700 1 -- 172.21.15.81:0/2381913593 reap_dead start 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 shutdown_connections 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 >> 172.21.15.81:0/2381913593 conn(0x7ff7600b08d0 msgr2=0x7ff76015baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 shutdown_connections 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.014+0000 7ff764a00700 1 -- 172.21.15.81:0/2381913593 wait complete. 2024-09-13T18:47:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f68c00700 1 -- 172.21.15.81:0/3049370992 <== osd.4 v2:172.21.15.178:6803/1450995168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f48002d60 con 0x7f7f5006fe70 2024-09-13T18:47:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f7f5006fe70 msgr2=0x7f7f500722b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f7f5006fe70 0x7f7f500722b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f50066830 msgr2=0x7f7f50068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f50066830 0x7f7f50068cf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0d03d0 tx=0x7f7f60007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c0b6ef0 msgr2=0x7f7f6c1fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 --2- 172.21.15.81:0/3049370992 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f6c0b6ef0 0x7f7f6c1fe950 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00ebe0 tx=0x7f7f5c00eef0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f71c00700 1 -- 172.21.15.81:0/3049370992 reap_dead start 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 shutdown_connections 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.018+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 >> 172.21.15.81:0/3049370992 conn(0x7f7f6c0cf580 msgr2=0x7f7f6c0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.022+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f2c06b6c0 con 0x7f7f0c06fcf0 2024-09-13T18:47:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.022+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 shutdown_connections 2024-09-13T18:47:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.022+0000 7f7f72600700 1 -- 172.21.15.81:0/3049370992 wait complete. 2024-09-13T18:47:39.050 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:39.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:47:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.022+0000 7f7f22a00700 1 -- 172.21.15.81:0/2237896885 <== osd.5 v2:172.21.15.178:6824/2042484449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f24009bf0 con 0x7f7f0c06fcf0 2024-09-13T18:47:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.022+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f7f0c06fcf0 msgr2=0x7f7f0c072130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.022+0000 7f7f31800700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f7f0c06fcf0 0x7f7f0c072130 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.052 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:39.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:47:39.053 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:39.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:47:39.054 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:39.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:47:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f0c066730 msgr2=0x7f7f0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f0c066730 0x7f7f0c068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0090b0 tx=0x7f7f1c018000 comp rx=0 tx=0).stop 2024-09-13T18:47:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2c15d2a0 msgr2=0x7f7f2c15ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 --2- 172.21.15.81:0/2237896885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f2c15d2a0 0x7f7f2c15ffa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800e810 tx=0x7f7f1800eb20 comp rx=0 tx=0).stop 2024-09-13T18:47:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f2b400700 1 -- 172.21.15.81:0/2237896885 reap_dead start 2024-09-13T18:47:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 shutdown_connections 2024-09-13T18:47:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 >> 172.21.15.81:0/2237896885 conn(0x7f7f2c06e660 msgr2=0x7f7f2c15ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 shutdown_connections 2024-09-13T18:47:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.030+0000 7f7f31800700 1 -- 172.21.15.81:0/2237896885 wait complete. 2024-09-13T18:47:39.056 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:39.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:47:39.058 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-09-13T18:47:39.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:47:39.059 INFO:teuthology.orchestra.run.smithi081.stdout:55834574860 2024-09-13T18:47:39.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:47:39.060 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:39.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:47:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.314+0000 7f6ab7e00700 1 Processor -- start 2024-09-13T18:47:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.314+0000 7f6ab7e00700 1 -- start start 2024-09-13T18:47:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.314+0000 7fe713a00700 1 Processor -- start 2024-09-13T18:47:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.314+0000 7fe713a00700 1 -- start start 2024-09-13T18:47:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.314+0000 7f6ab7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6ab8161230 0x7f6ab8167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.314+0000 7f6ab7e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80b1910 con 0x7f6ab8143190 2024-09-13T18:47:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab7e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab8161890 con 0x7f6ab8071460 2024-09-13T18:47:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab7e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab81616a0 con 0x7f6ab8161230 2024-09-13T18:47:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6ab8143190 0x7f6ab8070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47126/0 (socket says 172.21.15.81:47126) 2024-09-13T18:47:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab6a00700 1 -- 172.21.15.81:0/2627266090 learned_addr learned my addr 172.21.15.81:0/2627266090 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe713a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7040e7000 0x7fe704006280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe713a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704033a80 0x7fe7040360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe713a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe704047800 con 0x7fe704047c90 2024-09-13T18:47:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe713a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70400bd00 con 0x7fe7040e7000 2024-09-13T18:47:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7040e7000 0x7fe704006280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3106331913 0 0) 0x7f6ab80b1910 con 0x7f6ab8143190 2024-09-13T18:47:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe713a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70400b740 con 0x7fe704033a80 2024-09-13T18:47:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704033a80 0x7fe7040360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c0035d0 con 0x7f6ab8143190 2024-09-13T18:47:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7040e7000 0x7fe704006280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51080/0 (socket says 172.21.15.81:51080) 2024-09-13T18:47:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711000700 1 -- 172.21.15.81:0/1602864658 learned_addr learned my addr 172.21.15.81:0/1602864658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828628553 0 0) 0x7f6ab8161890 con 0x7f6ab8071460 2024-09-13T18:47:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab80b1910 con 0x7f6ab8071460 2024-09-13T18:47:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab7400700 1 --2- 172.21.15.81:0/2627266090 >> v2:172.21.15.81:3300/0 conn(0x7f6ab8161230 0x7f6ab8167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7effc0200700 1 Processor -- start 2024-09-13T18:47:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1347072389 0 0) 0x7f6a9c0035d0 con 0x7f6ab8143190 2024-09-13T18:47:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 >> v2:172.21.15.81:3300/0 conn(0x7f6ab8161230 msgr2=0x7f6ab8167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 --2- 172.21.15.81:0/2627266090 >> v2:172.21.15.81:3300/0 conn(0x7f6ab8161230 0x7f6ab8167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 >> v1:172.21.15.178:6789/0 conn(0x7f6ab8071460 legacy=0x7f6ab8160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab806e270 con 0x7f6ab8143190 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f6aa8001670 con 0x7f6ab8143190 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 >> v1:172.21.15.81:6789/0 conn(0x7f6ab8143190 legacy=0x7f6ab8070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a9c003c70 0x7f6a9c004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a9c004870 0x7f6a9c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c005230 0x7f6a9c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711a00700 1 -- 172.21.15.81:0/1602864658 >> v2:172.21.15.178:3300/0 conn(0x7fe7040e7000 msgr2=0x7fe704006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711a00700 1 --2- 172.21.15.81:0/1602864658 >> v2:172.21.15.178:3300/0 conn(0x7fe7040e7000 0x7fe704006280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7effc0200700 1 -- start start 2024-09-13T18:47:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711a00700 1 -- 172.21.15.81:0/1602864658 >> v1:172.21.15.81:6789/0 conn(0x7fe704047c90 legacy=0x7fe7040067c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7fe711a00700 1 -- 172.21.15.81:0/1602864658 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70400ba20 con 0x7fe704033a80 2024-09-13T18:47:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c00c1a0 con 0x7f6a9c003c70 2024-09-13T18:47:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c00c310 con 0x7f6a9c005230 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.318+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c00c4d0 con 0x7f6a9c004870 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6a00700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a9c003c70 0x7f6a9c004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a9c004870 0x7f6a9c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7400700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c005230 0x7f6a9c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe711a00700 1 --2- 172.21.15.81:0/1602864658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704033a80 0x7fe7040360a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe70c069650 tx=0x7fe70c061dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fe3598c0e8d37aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe70b400700 1 -- 172.21.15.81:0/1602864658 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c04f010 con 0x7fe704033a80 2024-09-13T18:47:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 -- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c005230 msgr2=0x7f6a9c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c005230 0x7f6a9c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 -- 172.21.15.81:0/2627266090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a9c003c70 msgr2=0x7f6a9c004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe70b400700 1 -- 172.21.15.81:0/1602864658 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c0672a0 con 0x7fe704033a80 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a9c003c70 0x7f6a9c004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 -- 172.21.15.81:0/2627266090 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0035d0 con 0x7f6a9c004870 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6a00700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a9c003c70 0x7f6a9c004070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7400700 1 -- 172.21.15.81:0/2627266090 reap_dead start 2024-09-13T18:47:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe70b400700 1 -- 172.21.15.81:0/1602864658 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c067610 con 0x7fe704033a80 2024-09-13T18:47:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a9c004870 0x7f6a9c004cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4001960 tx=0x7f6a9c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=662f492cbc1e9d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4001450 con 0x7f6a9c004870 2024-09-13T18:47:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4006aa0 con 0x7f6a9c004870 2024-09-13T18:47:39.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab5600700 1 -- 172.21.15.81:0/2627266090 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4006e50 con 0x7f6a9c004870 2024-09-13T18:47:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effc0200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effb0037d60 0x7effb0058190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effbce00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effb0037d60 0x7effb0058190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effbce00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7effb0037d60 0x7effb0058190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47136/0 (socket says 172.21.15.81:47136) 2024-09-13T18:47:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effbce00700 1 -- 172.21.15.81:0/4285517356 learned_addr learned my addr 172.21.15.81:0/4285517356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effbd800700 1 --1- 172.21.15.81:0/4285517356 >> v1:172.21.15.81:6789/0 conn(0x7effb00e6f80 0x7effb0053a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47142/0 (socket says 172.21.15.81:47142) 2024-09-13T18:47:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effc0200700 1 --2- 172.21.15.81:0/4285517356 >> v2:172.21.15.178:3300/0 conn(0x7effb00e7360 0x7effb0006d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a9c004870 msgr2=0x7f6a9c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a9c004870 0x7f6a9c004cf0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4001960 tx=0x7f6a9c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe713a00700 1 -- 172.21.15.81:0/1602864658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704033a80 msgr2=0x7fe7040360a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe713a00700 1 --2- 172.21.15.81:0/1602864658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704033a80 0x7fe7040360a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe70c069650 tx=0x7fe70c061dc0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2627266090 shutdown_connections 2024-09-13T18:47:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2627266090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a9c004870 0x7f6a9c004cf0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2627266090 >> 172.21.15.81:0/2627266090 conn(0x7f6ab806a390 msgr2=0x7f6ab806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb0054150 con 0x7effb00e6f80 2024-09-13T18:47:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7effbe200700 1 --2- 172.21.15.81:0/4285517356 >> v2:172.21.15.178:3300/0 conn(0x7effb00e7360 0x7effb0006d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe713a00700 1 -- 172.21.15.81:0/1602864658 shutdown_connections 2024-09-13T18:47:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe713a00700 1 --2- 172.21.15.81:0/1602864658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704033a80 0x7fe7040360a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe713a00700 1 --2- 172.21.15.81:0/1602864658 >> v2:172.21.15.178:3300/0 conn(0x7fe7040e7000 0x7fe704006280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.322+0000 7fe713a00700 1 -- 172.21.15.81:0/1602864658 >> 172.21.15.81:0/1602864658 conn(0x7fe70401d9b0 msgr2=0x7fe704054620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00570f0 con 0x7effb0037d60 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb00573d0 con 0x7effb00e7360 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effb7e00700 1 -- 172.21.15.81:0/4285517356 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496805592 0 0) 0x7effb0054150 con 0x7effb00e6f80 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effb7e00700 1 -- 172.21.15.81:0/4285517356 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa00035d0 con 0x7effb00e6f80 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effb7e00700 1 -- 172.21.15.81:0/4285517356 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1779159020 0 0) 0x7effa00035d0 con 0x7effb00e6f80 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effbce00700 1 -- 172.21.15.81:0/4285517356 >> v2:172.21.15.178:3300/0 conn(0x7effb00e7360 msgr2=0x7effb0006d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effbce00700 1 --2- 172.21.15.81:0/4285517356 >> v2:172.21.15.178:3300/0 conn(0x7effb00e7360 0x7effb0006d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effbce00700 1 -- 172.21.15.81:0/4285517356 >> v1:172.21.15.81:6789/0 conn(0x7effb00e6f80 legacy=0x7effb0053a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effbce00700 1 -- 172.21.15.81:0/4285517356 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00576b0 con 0x7effb0037d60 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effbe200700 1 --2- 172.21.15.81:0/4285517356 >> v2:172.21.15.178:3300/0 conn(0x7effb00e7360 0x7effb0006d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:39.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effbce00700 1 --2- 172.21.15.81:0/4285517356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb0058190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7effb000dd80 tx=0x7effac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d6a13d328f32be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2627266090 shutdown_connections 2024-09-13T18:47:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2627266090 wait complete. 2024-09-13T18:47:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7fe713a00700 1 -- 172.21.15.81:0/1602864658 shutdown_connections 2024-09-13T18:47:39.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7fe713a00700 1 -- 172.21.15.81:0/1602864658 wait complete. 2024-09-13T18:47:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effb7e00700 1 -- 172.21.15.81:0/4285517356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4001670 con 0x7effb0037d60 2024-09-13T18:47:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effb7e00700 1 -- 172.21.15.81:0/4285517356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac004030 con 0x7effb0037d60 2024-09-13T18:47:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effb7e00700 1 -- 172.21.15.81:0/4285517356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0043c0 con 0x7effb0037d60 2024-09-13T18:47:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 msgr2=0x7effb0058190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.326+0000 7effc0200700 1 --2- 172.21.15.81:0/4285517356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb0058190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7effb000dd80 tx=0x7effac009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 shutdown_connections 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 --2- 172.21.15.81:0/4285517356 >> v2:172.21.15.178:3300/0 conn(0x7effb00e7360 0x7effb0006d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 --2- 172.21.15.81:0/4285517356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb0058190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 >> 172.21.15.81:0/4285517356 conn(0x7effb003a560 msgr2=0x7effb003a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 shutdown_connections 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 -- 172.21.15.81:0/4285517356 wait complete. 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f5ee7e00700 1 Processor -- start 2024-09-13T18:47:39.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 Processor -- start 2024-09-13T18:47:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f5ee7e00700 1 -- start start 2024-09-13T18:47:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 Processor -- start 2024-09-13T18:47:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 -- start start 2024-09-13T18:47:39.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fd840200700 1 Processor -- start 2024-09-13T18:47:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f5ee7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee815cd90 0x7f5ee80b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 -- start start 2024-09-13T18:47:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe704033a80 0x7fe7040365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 0x7fe7041801b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7040e7000 0x7fe704050560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040d73b0 con 0x7fe7040e7000 2024-09-13T18:47:39.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7041806f0 con 0x7fe704033a80 2024-09-13T18:47:39.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c004870 0x7f6ab813ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 0x7f6ab813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab81402b0 0x7f6ab81f9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fe713a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7040352c0 con 0x7fe704047c90 2024-09-13T18:47:39.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8140740 con 0x7f6ab8139b90 2024-09-13T18:47:39.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8139180 con 0x7f6a9c004870 2024-09-13T18:47:39.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab81383c0 con 0x7f6ab81402b0 2024-09-13T18:47:39.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f6ab6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 0x7f6ab813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7f5ee7e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80d1390 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 0x7f6ab813fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47140/0 (socket says 172.21.15.81:47140) 2024-09-13T18:47:39.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 -- 172.21.15.81:0/2118709272 learned_addr learned my addr 172.21.15.81:0/2118709272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee815cd90 0x7f5ee80b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee7e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80d1670 con 0x7f5ee815d170 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b2530 con 0x7f5ee815cd90 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 0x7fe7041801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 0x7fe7041801b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49164/0 (socket says 172.21.15.81:49164) 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 -- 172.21.15.81:0/3837700429 learned_addr learned my addr 172.21.15.81:0/3837700429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee7400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ee80cdfe0 0x7f5ee806bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47144/0 (socket says 172.21.15.81:47144) 2024-09-13T18:47:39.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee7400700 1 -- 172.21.15.81:0/1759461096 learned_addr learned my addr 172.21.15.81:0/1759461096 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:39.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab7400700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab81402b0 0x7f6ab81f9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe711000700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe704033a80 0x7fe7040365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 -- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe704033a80 msgr2=0x7fe7040365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7fd840200700 1 -- start start 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd840200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8380718d0 0x7fd8381615a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd840200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8380cd420 con 0x7fd838071d40 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd840200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd838162190 con 0x7fd8380ceb00 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd840200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd838070df0 con 0x7fd8380718d0 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe704033a80 0x7fe7040365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 -- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7040e7000 msgr2=0x7fe704050560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:47:39.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6a00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c004870 0x7f6ab813ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 -- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab81402b0 msgr2=0x7f6ab81f9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab81402b0 0x7f6ab81f9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 -- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c004870 msgr2=0x7f6ab813ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c004870 0x7f6ab813ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 -- 172.21.15.81:0/2118709272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab81386a0 con 0x7f6ab8139b90 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6000700 1 -- 172.21.15.81:0/1759461096 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460729367 0 0) 0x7f5ee80d1390 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8380718d0 0x7fd8381615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8380718d0 0x7fd8381615a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47154/0 (socket says 172.21.15.81:47154) 2024-09-13T18:47:39.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 -- 172.21.15.81:0/1731348536 learned_addr learned my addr 172.21.15.81:0/1731348536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7040e7000 0x7fe704050560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 -- 172.21.15.81:0/3837700429 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c072e30 con 0x7fe704047c90 2024-09-13T18:47:39.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.330+0000 7effc0200700 1 Processor -- start 2024-09-13T18:47:39.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 -- start start 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb000d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 0x7effb004e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb00e7360 0x7effb00e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb0184f50 con 0x7effb0037d60 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb003cb00 con 0x7effb00e6f80 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effc0200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb004f020 con 0x7effb00e7360 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6000700 1 -- 172.21.15.81:0/1759461096 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ecc0035d0 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab6000700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 0x7f6ab813fd70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00c660 tx=0x7f6aa40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6000700 1 -- 172.21.15.81:0/1759461096 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100762226 0 0) 0x7f5ee80d1670 con 0x7f5ee815d170 2024-09-13T18:47:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6a00700 1 -- 172.21.15.81:0/1759461096 >> v1:172.21.15.178:6789/0 conn(0x7f5ee815d170 legacy=0x7f5ee80cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f191dc00700 1 Processor -- start 2024-09-13T18:47:39.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbd800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb000d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbe200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb00e7360 0x7effb00e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 0x7effb004e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbd800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb000d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47174/0 (socket says 172.21.15.81:47174) 2024-09-13T18:47:39.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 0x7effb004e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51142/0 (socket says 172.21.15.81:51142) 2024-09-13T18:47:39.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbd800700 1 -- 172.21.15.81:0/614117934 learned_addr learned my addr 172.21.15.81:0/614117934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbe200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb00e7360 0x7effb00e99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49192/0 (socket says 172.21.15.81:49192) 2024-09-13T18:47:39.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6a00700 1 -- 172.21.15.81:0/1759461096 >> v1:172.21.15.81:6789/0 conn(0x7f5ee80cdfe0 legacy=0x7f5ee806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6a00700 1 -- 172.21.15.81:0/1759461096 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee80d1950 con 0x7f5ee815cd90 2024-09-13T18:47:39.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 -- 172.21.15.81:0/1731348536 >> v1:172.21.15.178:6789/0 conn(0x7fd8380ceb00 legacy=0x7fd8380ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7ffb83000700 1 Processor -- start 2024-09-13T18:47:39.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 -- 172.21.15.81:0/1731348536 >> v1:172.21.15.81:6789/0 conn(0x7fd838071d40 legacy=0x7fd83806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 -- 172.21.15.81:0/1731348536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380710d0 con 0x7fd8380718d0 2024-09-13T18:47:39.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40054d0 con 0x7f6ab8139b90 2024-09-13T18:47:39.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7ffb83000700 1 -- start start 2024-09-13T18:47:39.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa4007030 con 0x7f6ab8139b90 2024-09-13T18:47:39.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40073a0 con 0x7f6ab8139b90 2024-09-13T18:47:39.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fe70be00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 0x7fe7041801b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c460 tx=0x7fe70000c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f191dc00700 1 -- start start 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd83ce00700 1 --2- 172.21.15.81:0/1731348536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd8381615a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009910 tx=0x7fd82c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e330b36397e2fd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 -- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb00e7360 msgr2=0x7effb00e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb00e7360 0x7effb00e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 -- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 msgr2=0x7effb000d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb000d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7effbce00700 1 -- 172.21.15.81:0/614117934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009570 con 0x7effb00e6f80 2024-09-13T18:47:39.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f5ee6a00700 1 --2- 172.21.15.81:0/1759461096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee815cd90 0x7f5ee80b1f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009dc0 tx=0x7f5ed800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef22e5affbcb7f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7fd837e00700 1 -- 172.21.15.81:0/1731348536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004230 con 0x7fd8380718d0 2024-09-13T18:47:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd837e00700 1 -- 172.21.15.81:0/1731348536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c004390 con 0x7fd8380718d0 2024-09-13T18:47:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd837e00700 1 -- 172.21.15.81:0/1731348536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c009e60 con 0x7fd8380718d0 2024-09-13T18:47:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.334+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8138980 con 0x7f6ab8139b90 2024-09-13T18:47:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab813a010 con 0x7f6ab8139b90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee6000700 1 -- 172.21.15.81:0/1759461096 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800e070 con 0x7f5ee815cd90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee6000700 1 -- 172.21.15.81:0/1759461096 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed800bb20 con 0x7f5ee815cd90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee6000700 1 -- 172.21.15.81:0/1759461096 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8012430 con 0x7f5ee815cd90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000052d0 con 0x7fe704047c90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700005430 con 0x7fe704047c90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000055a0 con 0x7fe704047c90 2024-09-13T18:47:39.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7040e7560 con 0x7fe704047c90 2024-09-13T18:47:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe704035820 con 0x7fe704047c90 2024-09-13T18:47:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 -- 172.21.15.81:0/1731348536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 msgr2=0x7fd8381615a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 --2- 172.21.15.81:0/1731348536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd8381615a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009910 tx=0x7fd82c009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1759461096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee815cd90 msgr2=0x7f5ee80b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/1759461096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee815cd90 0x7f5ee80b1f50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009dc0 tx=0x7f5ed800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7effbce00700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 0x7effb004e660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7effac015000 tx=0x7effac004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 -- 172.21.15.81:0/1731348536 shutdown_connections 2024-09-13T18:47:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 --2- 172.21.15.81:0/1731348536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd8381615a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 -- 172.21.15.81:0/1731348536 >> 172.21.15.81:0/1731348536 conn(0x7fd8380b0860 msgr2=0x7fd8380b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 -- 172.21.15.81:0/1731348536 shutdown_connections 2024-09-13T18:47:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fd840200700 1 -- 172.21.15.81:0/1731348536 wait complete. 2024-09-13T18:47:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1759461096 shutdown_connections 2024-09-13T18:47:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/1759461096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee815cd90 0x7f5ee80b1f50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1759461096 >> 172.21.15.81:0/1759461096 conn(0x7f5ee80d2c10 msgr2=0x7f5ee80d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab8138ea0 con 0x7f6ab8139b90 2024-09-13T18:47:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f19180b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191dc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19180b7370 0x7f191809b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191dc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191806d790 con 0x7f191809bdc0 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191dc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1918161640 con 0x7f19180b7370 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191dc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191806cea0 con 0x7f19180b46b0 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f190f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19180b7370 0x7f191809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191d200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f191809bdc0 0x7f19180b5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47174/0 (socket says 172.21.15.81:47174) 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f191d200700 1 -- 172.21.15.81:0/850863743 learned_addr learned my addr 172.21.15.81:0/850863743 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac003a80 con 0x7effb00e6f80 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac020070 con 0x7effb00e6f80 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac003e00 con 0x7effb00e6f80 2024-09-13T18:47:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb004f300 con 0x7effb00e6f80 2024-09-13T18:47:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb004f8c0 con 0x7effb00e6f80 2024-09-13T18:47:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7ffb83000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c06ad90 0x7ffb7c0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8005310 con 0x7fe704047c90 2024-09-13T18:47:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1759461096 shutdown_connections 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f1917e00700 1 --2- 172.21.15.81:0/850863743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f19180b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7ffb83000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c071550 con 0x7ffb7c0ce0a0 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7ffb83000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7c071830 con 0x7ffb7c13f570 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7ffb83000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c071ef0 con 0x7ffb7c06ad90 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7ffb81000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffb7c0ce0a0 0x7ffb7c0b19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47184/0 (socket says 172.21.15.81:47184) 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7ffb81000700 1 -- 172.21.15.81:0/4208053099 learned_addr learned my addr 172.21.15.81:0/4208053099 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.338+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1759461096 wait complete. 2024-09-13T18:47:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 Processor -- start 2024-09-13T18:47:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f190f400700 1 -- 172.21.15.81:0/850863743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 msgr2=0x7f19180b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f190f400700 1 --2- 172.21.15.81:0/850863743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f19180b4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f190f400700 1 -- 172.21.15.81:0/850863743 >> v1:172.21.15.81:6789/0 conn(0x7f191809bdc0 legacy=0x7f19180b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f190f400700 1 -- 172.21.15.81:0/850863743 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19180b4fd0 con 0x7f19180b7370 2024-09-13T18:47:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f190f400700 1 --2- 172.21.15.81:0/850863743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191809b880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1900009850 tx=0x7f1900009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7641e351e9eaf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7000036a0 con 0x7fe704047c90 2024-09-13T18:47:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 -- start start 2024-09-13T18:47:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7ffb73e00700 1 --2- 172.21.15.81:0/4208053099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c06ad90 0x7ffb7c0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7ffb73e00700 1 -- 172.21.15.81:0/4208053099 >> v1:172.21.15.178:6789/0 conn(0x7ffb7c13f570 legacy=0x7ffb7c06a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7ffb73e00700 1 -- 172.21.15.81:0/4208053099 >> v1:172.21.15.81:6789/0 conn(0x7ffb7c0ce0a0 legacy=0x7ffb7c0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6aa4007500 con 0x7f6ab8139b90 2024-09-13T18:47:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f1917400700 1 -- 172.21.15.81:0/850863743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011830 con 0x7f19180b7370 2024-09-13T18:47:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7ffb73e00700 1 -- 172.21.15.81:0/4208053099 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c071b10 con 0x7ffb7c06ad90 2024-09-13T18:47:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f5ee7e00700 1 Processor -- start 2024-09-13T18:47:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f1917400700 1 -- 172.21.15.81:0/850863743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900011990 con 0x7f19180b7370 2024-09-13T18:47:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f1917400700 1 -- 172.21.15.81:0/850863743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900011d20 con 0x7f19180b7370 2024-09-13T18:47:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f6aaea00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a98066730 0x7f6a98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fe708c00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe6ec066780 0x7fe6ec068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe700083640 con 0x7fe704047c90 2024-09-13T18:47:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff94005310 con 0x7effb00e6f80 2024-09-13T18:47:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6aa4084f80 con 0x7f6ab8139b90 2024-09-13T18:47:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd83815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd838071d40 0x7fd8380b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8380ceb00 0x7fd838156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380b26a0 con 0x7fd8380718d0 2024-09-13T18:47:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380b3ae0 con 0x7fd8380ceb00 2024-09-13T18:47:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd840200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380b3860 con 0x7fd838071d40 2024-09-13T18:47:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f6ab6a00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a98066730 0x7f6a98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f5ee7e00700 1 -- start start 2024-09-13T18:47:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd83ce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd838071d40 0x7fd8380b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd83ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8380ceb00 0x7fd838156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd83ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8380ceb00 0x7fd838156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51158/0 (socket says 172.21.15.81:51158) 2024-09-13T18:47:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fd83ec00700 1 -- 172.21.15.81:0/1713057541 learned_addr learned my addr 172.21.15.81:0/1713057541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f191dc00700 1 -- 172.21.15.81:0/850863743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 msgr2=0x7f191809b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7f191dc00700 1 --2- 172.21.15.81:0/850863743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191809b880 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1900009850 tx=0x7f1900009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.342+0000 7fe711000700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe6ec066780 0x7fe6ec068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effac022030 con 0x7effb00e6f80 2024-09-13T18:47:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7ffb73e00700 1 --2- 172.21.15.81:0/4208053099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c06ad90 0x7ffb7c0cdb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb64008880 tx=0x7ffb6400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9351c833ef18ddb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 -- 172.21.15.81:0/850863743 shutdown_connections 2024-09-13T18:47:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 --2- 172.21.15.81:0/850863743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191809b880 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 --2- 172.21.15.81:0/850863743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f19180b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 -- 172.21.15.81:0/850863743 >> 172.21.15.81:0/850863743 conn(0x7f19180cf6b0 msgr2=0x7f19180cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83d800700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd83815e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 -- 172.21.15.81:0/850863743 shutdown_connections 2024-09-13T18:47:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f6ab6a00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a98066730 0x7f6a98068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8001030 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 -- 172.21.15.81:0/850863743 wait complete. 2024-09-13T18:47:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7effb5600700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff980667b0 0x7eff98068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fe711000700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe6ec066780 0x7fe6ec068c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009ac0 tx=0x7fe6f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effac085f40 con 0x7effb00e6f80 2024-09-13T18:47:39.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83ce00700 1 -- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8380ceb00 msgr2=0x7fd838156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83ce00700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8380ceb00 0x7fd838156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83ce00700 1 -- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 msgr2=0x7fd83815e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7effbd800700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff980667b0 0x7eff98068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83ce00700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd83815e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83ce00700 1 -- 172.21.15.81:0/1713057541 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009570 con 0x7fd838071d40 2024-09-13T18:47:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 0x7f5ee80b6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee815cd90 0x7f5ee80b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee815d170 0x7f5ee80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b60b0 con 0x7f5ee815cd90 2024-09-13T18:47:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80cb140 con 0x7f5ee815d170 2024-09-13T18:47:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80cb3e0 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83d800700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd83815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 0x7f5ee80b6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ede000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee815cd90 0x7f5ee80b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 0x7f5ee80b6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49232/0 (socket says 172.21.15.81:49232) 2024-09-13T18:47:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 -- 172.21.15.81:0/2192683346 learned_addr learned my addr 172.21.15.81:0/2192683346 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7fd83ce00700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd838071d40 0x7fd8380b3320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd82c015000 tx=0x7fd82c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7effbd800700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff980667b0 0x7eff98068c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7effa4000f60 tx=0x7effa40017f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee7400700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee815d170 0x7f5ee80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 -- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee815d170 msgr2=0x7f5ee80cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee815d170 0x7f5ee80cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 -- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee815cd90 msgr2=0x7f5ee80b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee815cd90 0x7f5ee80b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 -- 172.21.15.81:0/2192683346 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8009a70 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ede000700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee815cd90 0x7f5ee80b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:39.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f5ee6a00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 0x7f5ee80b6540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80d2b70 tx=0x7f5ed8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 Processor -- start 2024-09-13T18:47:39.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f8120e00700 1 Processor -- start 2024-09-13T18:47:39.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f8120e00700 1 -- start start 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.346+0000 7f191dc00700 1 -- start start 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191809bdc0 0x7f19180b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f191815a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191dc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19180c9e30 con 0x7f19180b7370 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191dc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19180ca110 con 0x7f191809bdc0 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191dc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19180ca3f0 con 0x7f19180b46b0 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f190f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f191815a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191815ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47200/0 (socket says 172.21.15.81:47200) 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f190f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f191815a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49248/0 (socket says 172.21.15.81:49248) 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 -- 172.21.15.81:0/2448034759 learned_addr learned my addr 172.21.15.81:0/2448034759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f1917e00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191809bdc0 0x7f19180b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 -- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 msgr2=0x7f191815a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f191815a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 -- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191809bdc0 msgr2=0x7f19180b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191809bdc0 0x7f19180b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 -- 172.21.15.81:0/2448034759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000094b0 con 0x7f19180b7370 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f8120e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811401c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f191d200700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191815ae60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f191000c420 tx=0x7f191000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f8120e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8114050b90 0x7f8114005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f8120e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140e3310 con 0x7f811404fe30 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f8120e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140e35f0 con 0x7f8114050b90 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f8120e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140e38d0 con 0x7f81140df8e0 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8114050b90 0x7f8114005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8114050b90 0x7f8114005b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47212/0 (socket says 172.21.15.81:47212) 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 -- 172.21.15.81:0/1395729514 learned_addr learned my addr 172.21.15.81:0/1395729514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811aa00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f811404fe30 0x7f8114050480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33850/0 (socket says 172.21.15.81:33850) 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811b400700 1 --2- 172.21.15.81:0/1395729514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811401c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 -- 172.21.15.81:0/1395729514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 msgr2=0x7f811401c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 --2- 172.21.15.81:0/1395729514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811401c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 -- 172.21.15.81:0/1395729514 >> v1:172.21.15.178:6789/0 conn(0x7f811404fe30 legacy=0x7f8114050480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 -- 172.21.15.81:0/1395729514 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140e3bb0 con 0x7f8114050b90 2024-09-13T18:47:39.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811be00700 1 --2- 172.21.15.81:0/1395729514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8114050b90 0x7f8114005b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f811c074530 tx=0x7f811c04f6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83823a4fa7b8d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811a000700 1 -- 172.21.15.81:0/1395729514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0672a0 con 0x7f8114050b90 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f811a000700 1 -- 172.21.15.81:0/1395729514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c067400 con 0x7f8114050b90 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f811a000700 1 -- 172.21.15.81:0/1395729514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0679b0 con 0x7f8114050b90 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6aa40b6db0 con 0x7f6ab8139b90 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8004940 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80cb6c0 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80b5d40 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.350+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910005d90 con 0x7f19180b7370 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19100070d0 con 0x7f19180b7370 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910007440 con 0x7f19180b7370 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19180ca6d0 con 0x7f19180b7370 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19180b6210 con 0x7f19180b7370 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00be50 con 0x7fd838071d40 2024-09-13T18:47:39.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c01f070 con 0x7fd838071d40 2024-09-13T18:47:39.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c003900 con 0x7fd838071d40 2024-09-13T18:47:39.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd838156760 con 0x7fd838071d40 2024-09-13T18:47:39.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f8120e00700 1 -- 172.21.15.81:0/1395729514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8114050b90 msgr2=0x7f8114005b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f8120e00700 1 --2- 172.21.15.81:0/1395729514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8114050b90 0x7f8114005b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f811c074530 tx=0x7f811c04f6d0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8380b1fe0 con 0x7fd838071d40 2024-09-13T18:47:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7000506a0 con 0x7fe704047c90 2024-09-13T18:47:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb7b400700 1 -- 172.21.15.81:0/4208053099 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb64010070 con 0x7ffb7c06ad90 2024-09-13T18:47:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f8120e00700 1 -- 172.21.15.81:0/1395729514 shutdown_connections 2024-09-13T18:47:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f8120e00700 1 --2- 172.21.15.81:0/1395729514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8114050b90 0x7f8114005b10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f8120e00700 1 --2- 172.21.15.81:0/1395729514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811401c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f8120e00700 1 -- 172.21.15.81:0/1395729514 >> 172.21.15.81:0/1395729514 conn(0x7f8114036140 msgr2=0x7f8114036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb7b400700 1 -- 172.21.15.81:0/4208053099 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6400d9c0 con 0x7ffb7c06ad90 2024-09-13T18:47:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8020070 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee8067ad0 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8027680 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 -- 172.21.15.81:0/4208053099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c06ad90 msgr2=0x7ffb7c0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 --2- 172.21.15.81:0/4208053099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c06ad90 0x7ffb7c0cdb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb64008880 tx=0x7ffb6400d330 comp rx=0 tx=0).stop 2024-09-13T18:47:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8380b27e0 con 0x7fd838071d40 2024-09-13T18:47:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effac053030 con 0x7effb00e6f80 2024-09-13T18:47:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 -- 172.21.15.81:0/4208053099 shutdown_connections 2024-09-13T18:47:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 --2- 172.21.15.81:0/4208053099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c06ad90 0x7ffb7c0cdb60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 -- 172.21.15.81:0/4208053099 >> 172.21.15.81:0/4208053099 conn(0x7ffb7c0b08d0 msgr2=0x7ffb7c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ed80277e0 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 -- 172.21.15.81:0/4208053099 shutdown_connections 2024-09-13T18:47:39.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7ffb83000700 1 -- 172.21.15.81:0/4208053099 wait complete. 2024-09-13T18:47:39.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f5edfe00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec4066730 0x7f5ec4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.354+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19180cabf0 con 0x7f19180b7370 2024-09-13T18:47:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ed8022070 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7ffb83000700 1 Processor -- start 2024-09-13T18:47:39.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f5ede000700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec4066730 0x7f5ec4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd82c021070 con 0x7fd838071d40 2024-09-13T18:47:39.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f8120e00700 1 -- 172.21.15.81:0/1395729514 shutdown_connections 2024-09-13T18:47:39.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19100075a0 con 0x7f19180b7370 2024-09-13T18:47:39.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f1914c00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f18f4066830 0x7f18f4068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f19100839e0 con 0x7f19180b7370 2024-09-13T18:47:39.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7fd835600700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd81c066780 0x7fd81c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7ffb83000700 1 -- start start 2024-09-13T18:47:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f8120e00700 1 -- 172.21.15.81:0/1395729514 wait complete. 2024-09-13T18:47:39.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd82c02be60 con 0x7fd838071d40 2024-09-13T18:47:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.358+0000 7f5ede000700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec4066730 0x7f5ec4068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80b4e60 tx=0x7f5ed0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ed8057710 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7fd83d800700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd81c066780 0x7fd81c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7fd83d800700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd81c066780 0x7fd81c068c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd828009d70 tx=0x7fd8280090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7f1917e00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f18f4066830 0x7f18f4068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7f1917e00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f18f4066830 0x7f18f4068cf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19080073f0 tx=0x7f190800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7f8120e00700 1 Processor -- start 2024-09-13T18:47:39.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7ffb83000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c06ad90 0x7ffb7c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7ffb83000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7c0ce0a0 0x7ffb7c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7ffb83000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 0x7ffb7c159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.362+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd82c052d50 con 0x7fd838071d40 2024-09-13T18:47:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb83000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c1ef310 con 0x7ffb7c06ad90 2024-09-13T18:47:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb83000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c15b050 con 0x7ffb7c0ce0a0 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb83000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c15b330 con 0x7ffb7c13f570 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 0x7ffb7c159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 0x7ffb7c159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49252/0 (socket says 172.21.15.81:49252) 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 -- 172.21.15.81:0/2898293807 learned_addr learned my addr 172.21.15.81:0/2898293807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb73e00700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7c0ce0a0 0x7ffb7c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 -- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7c0ce0a0 msgr2=0x7ffb7c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7c0ce0a0 0x7ffb7c0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 -- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c06ad90 msgr2=0x7ffb7c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c06ad90 0x7ffb7c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 -- 172.21.15.81:0/2898293807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64008530 con 0x7ffb7c13f570 2024-09-13T18:47:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1910050b80 con 0x7f19180b7370 2024-09-13T18:47:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb81000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 0x7ffb7c159da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffb740021c0 tx=0x7ffb740021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7f8120e00700 1 -- start start 2024-09-13T18:47:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74011a90 con 0x7ffb7c13f570 2024-09-13T18:47:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74011bf0 con 0x7ffb7c13f570 2024-09-13T18:47:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c15b610 con 0x7ffb7c13f570 2024-09-13T18:47:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7401a470 con 0x7ffb7c13f570 2024-09-13T18:47:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.366+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c15bd10 con 0x7ffb7c13f570 2024-09-13T18:47:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb54005310 con 0x7ffb7c13f570 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f8120e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 0x7f81140d4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f8120e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8114050b90 0x7f81140d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 0x7f81140d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 0x7f81140d4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47232/0 (socket says 172.21.15.81:47232) 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 -- 172.21.15.81:0/3986312003 learned_addr learned my addr 172.21.15.81:0/3986312003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811404caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811aa00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8114050b90 0x7f81140d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811404c850 con 0x7f811404fe30 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140d4500 con 0x7f8114050b90 2024-09-13T18:47:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811404c290 con 0x7f81140df8e0 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811be00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811404caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 -- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 msgr2=0x7f811404caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811404caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 -- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8114050b90 msgr2=0x7f81140d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8114050b90 0x7f81140d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811404c570 con 0x7f811404fe30 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.370+0000 7f811b400700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 0x7f81140d4750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f811000d800 tx=0x7f811000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110017070 con 0x7f811404fe30 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8110005a40 con 0x7f811404fe30 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110005bf0 con 0x7f811404fe30 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140db9e0 con 0x7f811404fe30 2024-09-13T18:47:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81140374a0 con 0x7f811404fe30 2024-09-13T18:47:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb74017070 con 0x7ffb7c13f570 2024-09-13T18:47:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.374+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81140db840 con 0x7f811404fe30 2024-09-13T18:47:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.378+0000 7ffb78c00700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb58066800 0x7ffb58068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.378+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb74088840 con 0x7ffb7c13f570 2024-09-13T18:47:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.382+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb74055930 con 0x7ffb7c13f570 2024-09-13T18:47:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.382+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8110005d50 con 0x7f811404fe30 2024-09-13T18:47:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.382+0000 7f810f400700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f80fc0667b0 0x7f80fc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.382+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8110055b60 con 0x7f811404fe30 2024-09-13T18:47:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.386+0000 7ffb7be00700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb58066800 0x7ffb58068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.386+0000 7f811aa00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f80fc0667b0 0x7f80fc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.386+0000 7f811aa00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f80fc0667b0 0x7f80fc068c70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f811403ed10 tx=0x7f8108007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.386+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81100517a0 con 0x7f811404fe30 2024-09-13T18:47:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.386+0000 7ffb7be00700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb58066800 0x7ffb58068cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c000f60 tx=0x7ffb6c007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.702+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ab815ddb0 con 0x7f6ab8139b90 2024-09-13T18:47:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.702+0000 7f6aaea00700 1 -- 172.21.15.81:0/2118709272 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6ab8138ea0 con 0x7f6ab8139b90 2024-09-13T18:47:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.702+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7eff94005890 con 0x7effb00e6f80 2024-09-13T18:47:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.706+0000 7effb5600700 1 -- 172.21.15.81:0/614117934 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7effac056650 con 0x7effb00e6f80 2024-09-13T18:47:39.714 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-13T18:47:39.715 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.706+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a98066730 msgr2=0x7f6a98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.706+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a98066730 0x7f6a98068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8001030 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.706+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 msgr2=0x7f6ab813fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.706+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 0x7f6ab813fd70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00c660 tx=0x7f6aa40012d0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.706+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 shutdown_connections 2024-09-13T18:47:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a98066730 0x7f6a98068bf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab81402b0 0x7f6ab81f9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab8139b90 0x7f6ab813fd70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 --2- 172.21.15.81:0/2118709272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a9c004870 0x7f6ab813ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 >> 172.21.15.81:0/2118709272 conn(0x7f6ab806a390 msgr2=0x7f6ab80b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 shutdown_connections 2024-09-13T18:47:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f6ab7e00700 1 -- 172.21.15.81:0/2118709272 wait complete. 2024-09-13T18:47:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff980667b0 msgr2=0x7eff98068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff980667b0 0x7eff98068c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7effa4000f60 tx=0x7effa40017f0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 msgr2=0x7effb004e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ee80cb520 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 0x7effb004e660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7effac015000 tx=0x7effac004770 comp rx=0 tx=0).stop 2024-09-13T18:47:39.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8380b27e0 con 0x7fd838071d40 2024-09-13T18:47:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 shutdown_connections 2024-09-13T18:47:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff980667b0 0x7eff98068c70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb00e7360 0x7effb00e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb00e6f80 0x7effb004e660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 --2- 172.21.15.81:0/614117934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb0037d60 0x7effb000d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 >> 172.21.15.81:0/614117934 conn(0x7effb003a560 msgr2=0x7effb0053010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7f5edfe00700 1 -- 172.21.15.81:0/2192683346 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ee80cb520 con 0x7f5ee80cdfe0 2024-09-13T18:47:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe6e80055c0 con 0x7fe704047c90 2024-09-13T18:47:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 shutdown_connections 2024-09-13T18:47:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7effc0200700 1 -- 172.21.15.81:0/614117934 wait complete. 2024-09-13T18:47:39.723 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7fe708c00700 1 -- 172.21.15.81:0/3837700429 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe700001120 con 0x7fe704047c90 2024-09-13T18:47:39.723 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:39.724 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-13T18:47:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.710+0000 7fd835600700 1 -- 172.21.15.81:0/1713057541 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8380b27e0 con 0x7fd838071d40 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec4066730 msgr2=0x7f5ec4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec4066730 0x7f5ec4068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80b4e60 tx=0x7f5ed0009040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 msgr2=0x7f5ee80b6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 0x7f5ee80b6540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80d2b70 tx=0x7f5ed8004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe6ec066780 msgr2=0x7fe6ec068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7fe713a00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe6ec066780 0x7fe6ec068c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009ac0 tx=0x7fe6f8008040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 msgr2=0x7fe7041801b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.714+0000 7fe713a00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 0x7fe7041801b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c460 tx=0x7fe70000c820 comp rx=0 tx=0).stop 2024-09-13T18:47:39.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 shutdown_connections 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec4066730 0x7f5ec4068bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee815d170 0x7f5ee80cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee815cd90 0x7f5ee80b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/2192683346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee80cdfe0 0x7f5ee80b6540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 >> 172.21.15.81:0/2192683346 conn(0x7f5ee80d2c10 msgr2=0x7f5ee815f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 shutdown_connections 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe6ec066780 0x7fe6ec068c40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7040e7000 0x7fe704050560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe704047c90 0x7fe7041801b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 --2- 172.21.15.81:0/3837700429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe704033a80 0x7fe7040365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 >> 172.21.15.81:0/3837700429 conn(0x7fe70401d9b0 msgr2=0x7fe704006be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd81c066780 msgr2=0x7fd81c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd81c066780 0x7fd81c068c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd828009d70 tx=0x7fd8280090e0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd838071d40 msgr2=0x7fd8380b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd838071d40 0x7fd8380b3320 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd82c015000 tx=0x7fd82c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 shutdown_connections 2024-09-13T18:47:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f5ee7e00700 1 -- 172.21.15.81:0/2192683346 wait complete. 2024-09-13T18:47:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 shutdown_connections 2024-09-13T18:47:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 shutdown_connections 2024-09-13T18:47:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd81c066780 0x7fd81c068c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8380ceb00 0x7fd838156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fe713a00700 1 -- 172.21.15.81:0/3837700429 wait complete. 2024-09-13T18:47:39.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd838071d40 0x7fd8380b3320 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 --2- 172.21.15.81:0/1713057541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8380718d0 0x7fd83815e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 >> 172.21.15.81:0/1713057541 conn(0x7fd8380b0860 msgr2=0x7fd83806d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 shutdown_connections 2024-09-13T18:47:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7fd840200700 1 -- 172.21.15.81:0/1713057541 wait complete. 2024-09-13T18:47:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f19180cabf0 con 0x7f19180b7370 2024-09-13T18:47:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.722+0000 7f1914c00700 1 -- 172.21.15.81:0/2448034759 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19180cabf0 con 0x7f19180b7370 2024-09-13T18:47:39.735 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:39.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f18f4066830 msgr2=0x7f18f4068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f18f4066830 0x7f18f4068cf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f19080073f0 tx=0x7f190800b040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 msgr2=0x7f191815ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191815ae60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f191000c420 tx=0x7f191000c730 comp rx=0 tx=0).stop 2024-09-13T18:47:39.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 shutdown_connections 2024-09-13T18:47:39.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f18f4066830 0x7f18f4068cf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19180b7370 0x7f191815ae60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f81140db840 con 0x7f811404fe30 2024-09-13T18:47:39.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19180b46b0 0x7f191815a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 --2- 172.21.15.81:0/2448034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f191809bdc0 0x7f19180b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 >> 172.21.15.81:0/2448034759 conn(0x7f19180cf6b0 msgr2=0x7f19180cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 shutdown_connections 2024-09-13T18:47:39.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.726+0000 7f191dc00700 1 -- 172.21.15.81:0/2448034759 wait complete. 2024-09-13T18:47:39.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.730+0000 7f810f400700 1 -- 172.21.15.81:0/3986312003 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81140db840 con 0x7f811404fe30 2024-09-13T18:47:39.740 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-09-13T18:47:39.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-09-13T18:47:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f80fc0667b0 msgr2=0x7f80fc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f80fc0667b0 0x7f80fc068c70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f811403ed10 tx=0x7f8108007ef0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 msgr2=0x7f81140d4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 0x7f81140d4750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f811000d800 tx=0x7f811000db10 comp rx=0 tx=0).stop 2024-09-13T18:47:39.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ffb54005890 con 0x7ffb7c13f570 2024-09-13T18:47:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 shutdown_connections 2024-09-13T18:47:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.734+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f80fc0667b0 0x7f80fc068c70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81140df8e0 0x7f811404caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8114050b90 0x7f81140d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7ffb78c00700 1 -- 172.21.15.81:0/2898293807 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb74058f50 con 0x7ffb7c13f570 2024-09-13T18:47:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7f8120e00700 1 --2- 172.21.15.81:0/3986312003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f811404fe30 0x7f81140d4750 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 >> 172.21.15.81:0/3986312003 conn(0x7f8114036140 msgr2=0x7f811401ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.749 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-13T18:47:39.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 shutdown_connections 2024-09-13T18:47:39.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7f8120e00700 1 -- 172.21.15.81:0/3986312003 wait complete. 2024-09-13T18:47:39.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.738+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb58066800 msgr2=0x7ffb58068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb58066800 0x7ffb58068cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c000f60 tx=0x7ffb6c007a80 comp rx=0 tx=0).stop 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 msgr2=0x7ffb7c159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 0x7ffb7c159da0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffb740021c0 tx=0x7ffb740021f0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 shutdown_connections 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb58066800 0x7ffb58068cc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7c13f570 0x7ffb7c159da0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7c0ce0a0 0x7ffb7c0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 --2- 172.21.15.81:0/2898293807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7c06ad90 0x7ffb7c0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 >> 172.21.15.81:0/2898293807 conn(0x7ffb7c0b08d0 msgr2=0x7ffb7c141960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 shutdown_connections 2024-09-13T18:47:39.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:39.742+0000 7ffb83000700 1 -- 172.21.15.81:0/2898293807 wait complete. 2024-09-13T18:47:39.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-09-13T18:47:39.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-09-13T18:47:39.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-09-13T18:47:39.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-09-13T18:47:39.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2024-09-13T18:47:39.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-09-13T18:47:40.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:47:40.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:47:40.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:47:40.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:47:40.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:47:40.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:47:40.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:47:40.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:47:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 Processor -- start 2024-09-13T18:47:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 -- start start 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4f24005b10 0x7f4f240e18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f2401cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f240e1e00 con 0x7f4f2400a5b0 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f24006ce0 con 0x7f4f24005b10 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.966+0000 7f4f32200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240060d0 con 0x7f4f2401c740 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f2400a5b0 0x7f4f2400a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47186/0 (socket says 172.21.15.81:47186) 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2b400700 1 -- 172.21.15.81:0/1086850841 learned_addr learned my addr 172.21.15.81:0/1086850841 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:40.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2aa00700 1 --2- 172.21.15.81:0/1086850841 >> v2:172.21.15.81:3300/0 conn(0x7f4f24005b10 0x7f4f240e18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2aa00700 1 -- 172.21.15.81:0/1086850841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 msgr2=0x7f4f2401cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2aa00700 1 --2- 172.21.15.81:0/1086850841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f2401cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2aa00700 1 -- 172.21.15.81:0/1086850841 >> v1:172.21.15.81:6789/0 conn(0x7f4f2400a5b0 legacy=0x7f4f2400a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2aa00700 1 -- 172.21.15.81:0/1086850841 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f240063b0 con 0x7f4f24005b10 2024-09-13T18:47:40.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2aa00700 1 --2- 172.21.15.81:0/1086850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240e18c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009850 tx=0x7f4f18009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd67608fe656beb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.970+0000 7f4f2a000700 1 -- 172.21.15.81:0/1086850841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011830 con 0x7f4f24005b10 2024-09-13T18:47:40.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f2a000700 1 -- 172.21.15.81:0/1086850841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18011990 con 0x7f4f24005b10 2024-09-13T18:47:40.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f2a000700 1 -- 172.21.15.81:0/1086850841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011d00 con 0x7f4f24005b10 2024-09-13T18:47:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 -- 172.21.15.81:0/1086850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 msgr2=0x7f4f240e18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 --2- 172.21.15.81:0/1086850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240e18c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009850 tx=0x7f4f18009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 -- 172.21.15.81:0/1086850841 shutdown_connections 2024-09-13T18:47:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 --2- 172.21.15.81:0/1086850841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f2401cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 --2- 172.21.15.81:0/1086850841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240e18c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 -- 172.21.15.81:0/1086850841 >> 172.21.15.81:0/1086850841 conn(0x7f4f24036140 msgr2=0x7f4f24036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 -- 172.21.15.81:0/1086850841 shutdown_connections 2024-09-13T18:47:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.974+0000 7f4f32200700 1 -- 172.21.15.81:0/1086850841 wait complete. 2024-09-13T18:47:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.978+0000 7f4f32200700 1 Processor -- start 2024-09-13T18:47:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.978+0000 7f4f32200700 1 -- start start 2024-09-13T18:47:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f32200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f32200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f2400a5b0 0x7f4f240346a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f32200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f24034be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f32200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f240e01f0 con 0x7f4f24005b10 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f32200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24196200 con 0x7f4f2400a5b0 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f32200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24020b70 con 0x7f4f2401c740 2024-09-13T18:47:40.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240dfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47250/0 (socket says 172.21.15.81:47250) 2024-09-13T18:47:40.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f24034be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f24034be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49282/0 (socket says 172.21.15.81:49282) 2024-09-13T18:47:40.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 -- 172.21.15.81:0/2391698110 learned_addr learned my addr 172.21.15.81:0/2391698110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:40.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 -- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f2400a5b0 msgr2=0x7f4f240346a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f2400a5b0 0x7f4f240346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 -- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 msgr2=0x7f4f240dfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240dfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.982+0000 7f4f2be00700 1 -- 172.21.15.81:0/2391698110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180094b0 con 0x7f4f2401c740 2024-09-13T18:47:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f2be00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f24034be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c079b40 tx=0x7f4f2c073330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0680d0 con 0x7f4f2401c740 2024-09-13T18:47:40.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c068250 con 0x7f4f2401c740 2024-09-13T18:47:40.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c068600 con 0x7f4f2401c740 2024-09-13T18:47:40.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f32200700 1 -- 172.21.15.81:0/2391698110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f24020e50 con 0x7f4f2401c740 2024-09-13T18:47:40.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f32200700 1 -- 172.21.15.81:0/2391698110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f24021410 con 0x7f4f2401c740 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.986+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f24037050 con 0x7f4f2401c740 2024-09-13T18:47:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.994+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f2c090070 con 0x7f4f2401c740 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.994+0000 7f4f1f400700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f0c066800 0x7f4f0c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:40.994+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4f2c0fd9d0 con 0x7f4f2401c740 2024-09-13T18:47:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.002+0000 7f4f2b400700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f0c066800 0x7f4f0c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.002+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f2c0caac0 con 0x7f4f2401c740 2024-09-13T18:47:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.002+0000 7f4f2b400700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f0c066800 0x7f4f0c068cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f20007fd0 tx=0x7f4f20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 Processor -- start 2024-09-13T18:47:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 Processor -- start 2024-09-13T18:47:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 -- start start 2024-09-13T18:47:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 Processor -- start 2024-09-13T18:47:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 -- start start 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34641573a0 0x7f34640ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 -- start start 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf4066090 0x7f9bf4066470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9bf41622a0 0x7f9bf4164e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9bf41653c0 0x7f9bf4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40b4240 con 0x7f9bf41653c0 2024-09-13T18:47:41.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40669b0 con 0x7f9bf41622a0 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f9bf9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b3630 con 0x7f9bf4066090 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c15d170 0x7f295c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f295c0cdfe0 0x7f295c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c0d1390 con 0x7f295c15cd90 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c0b2530 con 0x7f295c0cdfe0 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2962800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0d05f0 con 0x7f295c15d170 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2961400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f295c15cd90 0x7f295c0cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47196/0 (socket says 172.21.15.81:47196) 2024-09-13T18:47:41.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f2961400700 1 -- 172.21.15.81:0/3501923624 learned_addr learned my addr 172.21.15.81:0/3501923624 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7fc6e2000700 1 Processor -- start 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f346415d3d0 0x7f346406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346406fe20 con 0x7f346406aae0 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346406aee0 con 0x7f346415d3d0 2024-09-13T18:47:41.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.018+0000 7f346a400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346415d970 con 0x7f34641573a0 2024-09-13T18:47:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9bf41622a0 0x7f9bf4164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9bf41622a0 0x7f9bf4164e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51230/0 (socket says 172.21.15.81:51230) 2024-09-13T18:47:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1400700 1 -- 172.21.15.81:0/1805948360 learned_addr learned my addr 172.21.15.81:0/1805948360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 --2- 172.21.15.81:0/1805948360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf4066090 0x7f9bf4066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6e2000700 1 -- start start 2024-09-13T18:47:41.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34641573a0 0x7f34640ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432802949 0 0) 0x7f295c0d1390 con 0x7f295c15cd90 2024-09-13T18:47:41.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29440035d0 con 0x7f295c15cd90 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3462a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f346415d3d0 0x7f346406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f346406aae0 0x7f34640cb3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47202/0 (socket says 172.21.15.81:47202) 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463e00700 1 -- 172.21.15.81:0/2891186726 learned_addr learned my addr 172.21.15.81:0/2891186726 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf2800700 1 --2- 172.21.15.81:0/1805948360 >> v2:172.21.15.81:3300/0 conn(0x7f9bf41653c0 0x7f9bf4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 -- 172.21.15.81:0/1805948360 >> v2:172.21.15.178:3300/0 conn(0x7f9bf41622a0 msgr2=0x7f9bf4164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 --2- 172.21.15.81:0/1805948360 >> v2:172.21.15.178:3300/0 conn(0x7f9bf41622a0 0x7f9bf4164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 -- 172.21.15.81:0/1805948360 >> v2:172.21.15.81:3300/0 conn(0x7f9bf41653c0 msgr2=0x7f9bf4070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 --2- 172.21.15.81:0/1805948360 >> v2:172.21.15.81:3300/0 conn(0x7f9bf41653c0 0x7f9bf4070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 -- 172.21.15.81:0/1805948360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40b3910 con 0x7f9bf4066090 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643584507 0 0) 0x7f29440035d0 con 0x7f295c15cd90 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c15d170 msgr2=0x7f295c0b1f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c15d170 0x7f295c0b1f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 >> v2:172.21.15.178:3300/0 conn(0x7f295c0cdfe0 msgr2=0x7f295c0ce490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 --2- 172.21.15.81:0/3501923624 >> v2:172.21.15.178:3300/0 conn(0x7f295c0cdfe0 0x7f295c0ce490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0d1670 con 0x7f295c15cd90 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 Processor -- start 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463400700 1 -- 172.21.15.81:0/2891186726 >> v2:172.21.15.81:3300/0 conn(0x7f346415d3d0 msgr2=0x7f346406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463400700 1 --2- 172.21.15.81:0/2891186726 >> v2:172.21.15.81:3300/0 conn(0x7f346415d3d0 0x7f346406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463400700 1 -- 172.21.15.81:0/2891186726 >> v1:172.21.15.81:6789/0 conn(0x7f346406aae0 legacy=0x7f34640cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463400700 1 -- 172.21.15.81:0/2891186726 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346415dc50 con 0x7f34641573a0 2024-09-13T18:47:41.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 -- start start 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3462a00700 1 --2- 172.21.15.81:0/2891186726 >> v2:172.21.15.81:3300/0 conn(0x7f346415d3d0 0x7f346406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f2950001670 con 0x7f295c15cd90 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 >> v1:172.21.15.81:6789/0 conn(0x7f295c15cd90 legacy=0x7f295c0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2944003a90 0x7f2944003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2944004870 0x7f2944004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f294400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0b2530 con 0x7f2944003a90 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294400c250 con 0x7f2944005330 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294400c410 con 0x7f2944004870 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6e2000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6dc0b1210 0x7fc6dc06a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6e2000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc071550 con 0x7fc6dc0ce270 2024-09-13T18:47:41.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6e2000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc071830 con 0x7fc6dc13f5e0 2024-09-13T18:47:41.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6e2000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc071ef0 con 0x7fc6dc0b1210 2024-09-13T18:47:41.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf2800700 1 --2- 172.21.15.81:0/1805948360 >> v2:172.21.15.81:3300/0 conn(0x7f9bf41653c0 0x7f9bf4070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:41.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3463400700 1 --2- 172.21.15.81:0/2891186726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641573a0 0x7f34640ce000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34640cc4e0 tx=0x7f3454009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63fb65428ba6800 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f2961400700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2944003a90 0x7f2944003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f2961e00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f294400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6db400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6dc0b1210 0x7fc6dc06a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6db400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6dc0b1210 0x7fc6dc06a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47272/0 (socket says 172.21.15.81:47272) 2024-09-13T18:47:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6db400700 1 -- 172.21.15.81:0/3862654866 learned_addr learned my addr 172.21.15.81:0/3862654866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf1e00700 1 --2- 172.21.15.81:0/1805948360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf4066090 0x7f9bf4066470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4161a80 tx=0x7f9be0009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09b455901625faa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f2960a00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2944004870 0x7f2944004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3462000700 1 -- 172.21.15.81:0/2891186726 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011830 con 0x7f34641573a0 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3462000700 1 -- 172.21.15.81:0/2891186726 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454011990 con 0x7f34641573a0 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f3462000700 1 -- 172.21.15.81:0/2891186726 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454011d00 con 0x7f34641573a0 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf0a00700 1 -- 172.21.15.81:0/1805948360 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0011830 con 0x7f9bf4066090 2024-09-13T18:47:41.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf0a00700 1 -- 172.21.15.81:0/1805948360 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be0011990 con 0x7f9bf4066090 2024-09-13T18:47:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f9bf0a00700 1 -- 172.21.15.81:0/1805948360 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0011d20 con 0x7f9bf4066090 2024-09-13T18:47:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6db400700 1 -- 172.21.15.81:0/3862654866 >> v1:172.21.15.178:6789/0 conn(0x7fc6dc13f5e0 legacy=0x7fc6dc0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6db400700 1 -- 172.21.15.81:0/3862654866 >> v1:172.21.15.81:6789/0 conn(0x7fc6dc0ce270 legacy=0x7fc6dc0b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7fc6db400700 1 -- 172.21.15.81:0/3862654866 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc071b10 con 0x7fc6dc0b1210 2024-09-13T18:47:41.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6db400700 1 --2- 172.21.15.81:0/3862654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc06a690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009910 tx=0x7fc6cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93124d1ae0c17d35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4aec153420 0x7f4aec1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aec15a230 con 0x7f4aec06ae80 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aec0b2800 con 0x7f4aec153420 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.022+0000 7f4af3000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0b1a40 con 0x7f4aec071460 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aebe00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4aec06ae80 0x7f4aec070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33860/0 (socket says 172.21.15.81:33860) 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aebe00700 1 -- 172.21.15.81:0/437327812 learned_addr learned my addr 172.21.15.81:0/437327812 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:41.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fa763200700 1 Processor -- start 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeb400700 1 --2- 172.21.15.81:0/437327812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6da000700 1 -- 172.21.15.81:0/3862654866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc004230 con 0x7fc6dc0b1210 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6da000700 1 -- 172.21.15.81:0/3862654866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc004390 con 0x7fc6dc0b1210 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6da000700 1 -- 172.21.15.81:0/3862654866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc009e60 con 0x7fc6dc0b1210 2024-09-13T18:47:41.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4af1000700 1 --2- 172.21.15.81:0/437327812 >> v2:172.21.15.81:3300/0 conn(0x7f4aec153420 0x7f4aec1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2961e00700 1 -- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2944004870 msgr2=0x7f2944004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2961e00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2944004870 0x7f2944004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2961e00700 1 -- 172.21.15.81:0/3501923624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2944003a90 msgr2=0x7f2944003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2961e00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2944003a90 0x7f2944003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2961e00700 1 -- 172.21.15.81:0/3501923624 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440035d0 con 0x7f2944005330 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 -- 172.21.15.81:0/1805948360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf4066090 msgr2=0x7f9bf4066470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 --2- 172.21.15.81:0/1805948360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf4066090 0x7f9bf4066470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4161a80 tx=0x7f9be0009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 -- 172.21.15.81:0/2891186726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641573a0 msgr2=0x7f34640ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 --2- 172.21.15.81:0/2891186726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641573a0 0x7f34640ce000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34640cc4e0 tx=0x7f3454009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 -- 172.21.15.81:0/2891186726 shutdown_connections 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 --2- 172.21.15.81:0/2891186726 >> v2:172.21.15.81:3300/0 conn(0x7f346415d3d0 0x7f346406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 --2- 172.21.15.81:0/2891186726 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641573a0 0x7f34640ce000 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f34640cc4e0 tx=0x7f3454009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:41.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 -- 172.21.15.81:0/2891186726 >> 172.21.15.81:0/2891186726 conn(0x7f34640b06f0 msgr2=0x7f34640b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2960a00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2944004870 0x7f2944004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeb400700 1 -- 172.21.15.81:0/437327812 >> v2:172.21.15.81:3300/0 conn(0x7f4aec153420 msgr2=0x7f4aec1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeb400700 1 --2- 172.21.15.81:0/437327812 >> v2:172.21.15.81:3300/0 conn(0x7f4aec153420 0x7f4aec1599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeb400700 1 -- 172.21.15.81:0/437327812 >> v1:172.21.15.178:6789/0 conn(0x7f4aec06ae80 legacy=0x7f4aec070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeb400700 1 -- 172.21.15.81:0/437327812 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec0b1d20 con 0x7f4aec071460 2024-09-13T18:47:41.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2961e00700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f294400ba30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2954009e60 tx=0x7f29440058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e89ea4ee6c488d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 -- 172.21.15.81:0/1805948360 shutdown_connections 2024-09-13T18:47:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 --2- 172.21.15.81:0/1805948360 >> v2:172.21.15.178:3300/0 conn(0x7f9bf41622a0 0x7f9bf4164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 --2- 172.21.15.81:0/1805948360 >> v2:172.21.15.81:3300/0 conn(0x7f9bf41653c0 0x7f9bf4070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 --2- 172.21.15.81:0/1805948360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf4066090 0x7f9bf4066470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 -- 172.21.15.81:0/1805948360 >> 172.21.15.81:0/1805948360 conn(0x7f9bf406e840 msgr2=0x7f9bf406ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 -- 172.21.15.81:0/2891186726 shutdown_connections 2024-09-13T18:47:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 -- 172.21.15.81:0/1805948360 shutdown_connections 2024-09-13T18:47:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f9bf9200700 1 -- 172.21.15.81:0/1805948360 wait complete. 2024-09-13T18:47:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6e2000700 1 -- 172.21.15.81:0/3862654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 msgr2=0x7fc6dc06a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6e2000700 1 --2- 172.21.15.81:0/3862654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc06a690 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009910 tx=0x7fc6cc009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400baa0 con 0x7f2944005330 2024-09-13T18:47:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295400bc20 con 0x7f2944005330 2024-09-13T18:47:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f295be00700 1 -- 172.21.15.81:0/3501923624 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954015420 con 0x7f2944005330 2024-09-13T18:47:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f346a400700 1 -- 172.21.15.81:0/2891186726 wait complete. 2024-09-13T18:47:41.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeb400700 1 --2- 172.21.15.81:0/437327812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec159490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009850 tx=0x7f4ad8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0887059b8f1fed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fa763200700 1 -- start start 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4acee00700 1 Processor -- start 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6e2000700 1 -- 172.21.15.81:0/3862654866 shutdown_connections 2024-09-13T18:47:41.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6e2000700 1 --2- 172.21.15.81:0/3862654866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc06a690 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6e2000700 1 -- 172.21.15.81:0/3862654866 >> 172.21.15.81:0/3862654866 conn(0x7fc6dc0b06f0 msgr2=0x7fc6dc0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeaa00700 1 -- 172.21.15.81:0/437327812 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8011830 con 0x7f4aec071460 2024-09-13T18:47:41.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4aeaa00700 1 -- 172.21.15.81:0/437327812 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad8011990 con 0x7f4aec071460 2024-09-13T18:47:41.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2962800700 1 -- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 msgr2=0x7f294400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f2962800700 1 --2- 172.21.15.81:0/3501923624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f294400ba30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2954009e60 tx=0x7f29440058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7fc6e2000700 1 -- 172.21.15.81:0/3862654866 shutdown_connections 2024-09-13T18:47:41.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4af3000700 1 -- 172.21.15.81:0/437327812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 msgr2=0x7f4aec159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4af3000700 1 --2- 172.21.15.81:0/437327812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec159490 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009850 tx=0x7f4ad8009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:41.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fc6e2000700 1 -- 172.21.15.81:0/3862654866 wait complete. 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa763200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa76406aaa0 0x7fa76406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.026+0000 7f4acee00700 1 -- start start 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 0x7f4ac806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acee00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ac80ad4e0 0x7f4ac80b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acee00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac8071ba0 con 0x7f4ac8161180 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acee00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac8070120 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac8070400 con 0x7f4ac80ae200 2024-09-13T18:47:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa763200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa7640b2670 0x7fa7640b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 Processor -- start 2024-09-13T18:47:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa763200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7640b3560 con 0x7fa7641610b0 2024-09-13T18:47:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa763200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa764070b30 con 0x7fa7640b2670 2024-09-13T18:47:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa763200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76406b450 con 0x7fa76406aaa0 2024-09-13T18:47:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 -- start start 2024-09-13T18:47:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa76406aaa0 0x7fa76406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa7641610b0 0x7fa7640719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33872/0 (socket says 172.21.15.81:33872) 2024-09-13T18:47:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761e00700 1 -- 172.21.15.81:0/2258406216 learned_addr learned my addr 172.21.15.81:0/2258406216 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 0x7f4ac806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f346a400700 1 Processor -- start 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 0x7f4ac806bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49338/0 (socket says 172.21.15.81:49338) 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 -- 172.21.15.81:0/3345654851 learned_addr learned my addr 172.21.15.81:0/3345654851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4af3000700 1 -- 172.21.15.81:0/437327812 shutdown_connections 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4af3000700 1 --2- 172.21.15.81:0/437327812 >> v2:172.21.15.81:3300/0 conn(0x7f4aec153420 0x7f4aec1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4af3000700 1 --2- 172.21.15.81:0/437327812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec159490 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4af3000700 1 -- 172.21.15.81:0/437327812 >> 172.21.15.81:0/437327812 conn(0x7f4aec06a390 msgr2=0x7f4aec06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4ace400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ac80ad4e0 0x7f4ac80b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa762800700 1 --2- 172.21.15.81:0/2258406216 >> v2:172.21.15.81:3300/0 conn(0x7fa7640b2670 0x7fa7640b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4af3000700 1 -- 172.21.15.81:0/437327812 shutdown_connections 2024-09-13T18:47:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 -- 172.21.15.81:0/3345654851 >> v2:172.21.15.178:3300/0 conn(0x7f4ac80ad4e0 msgr2=0x7f4ac80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 --2- 172.21.15.81:0/3345654851 >> v2:172.21.15.178:3300/0 conn(0x7f4ac80ad4e0 0x7f4ac80b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 -- 172.21.15.81:0/3345654851 >> v1:172.21.15.178:6789/0 conn(0x7f4ac8161180 legacy=0x7f4ac80acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 -- 172.21.15.81:0/3345654851 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac80706e0 con 0x7f4ac80ae200 2024-09-13T18:47:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761400700 1 -- 172.21.15.81:0/2258406216 >> v2:172.21.15.81:3300/0 conn(0x7fa7640b2670 msgr2=0x7fa7640b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761400700 1 --2- 172.21.15.81:0/2258406216 >> v2:172.21.15.81:3300/0 conn(0x7fa7640b2670 0x7fa7640b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761400700 1 -- 172.21.15.81:0/2258406216 >> v1:172.21.15.178:6789/0 conn(0x7fa7641610b0 legacy=0x7fa7640719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761400700 1 -- 172.21.15.81:0/2258406216 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640b3000 con 0x7fa76406aaa0 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf4066090 0x7f9bf4168100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf41622a0 0x7f9bf40a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf41653c0 0x7f9bf4169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4167c70 con 0x7f9bf4066090 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4167060 con 0x7f9bf41653c0 2024-09-13T18:47:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4167340 con 0x7f9bf41622a0 2024-09-13T18:47:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fc6e2000700 1 Processor -- start 2024-09-13T18:47:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf4066090 0x7f9bf4168100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf4066090 0x7f9bf4168100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47310/0 (socket says 172.21.15.81:47310) 2024-09-13T18:47:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f2961e00700 1 -- 172.21.15.81:0/3501923624 reap_dead start 2024-09-13T18:47:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4acd000700 1 --2- 172.21.15.81:0/3345654851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 0x7f4ac806bd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009910 tx=0x7f4ab4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7670d84cfb4faefe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1e00700 1 -- 172.21.15.81:0/3437483899 learned_addr learned my addr 172.21.15.81:0/3437483899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf2800700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf41653c0 0x7f9bf4169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1400700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf41622a0 0x7f9bf40a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f2962800700 1 -- 172.21.15.81:0/3501923624 shutdown_connections 2024-09-13T18:47:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f2962800700 1 -- 172.21.15.81:0/3501923624 >> 172.21.15.81:0/3501923624 conn(0x7f295c0d2c10 msgr2=0x7f295c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fc6e2000700 1 -- start start 2024-09-13T18:47:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa761400700 1 --2- 172.21.15.81:0/2258406216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa76406aaa0 0x7fa76406af10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009850 tx=0x7fa74c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749768a72e53b6c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4ac7e00700 1 -- 172.21.15.81:0/3345654851 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400ba60 con 0x7f4ac80ae200 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4ac7e00700 1 -- 172.21.15.81:0/3345654851 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab400bbc0 con 0x7f4ac80ae200 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4ac7e00700 1 -- 172.21.15.81:0/3345654851 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4009e60 con 0x7f4ac80ae200 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1400700 1 -- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf41653c0 msgr2=0x7f9bf4169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1400700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf41653c0 0x7f9bf4169220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1400700 1 -- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf4066090 msgr2=0x7f9bf4168100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1400700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf4066090 0x7f9bf4168100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f9bf1400700 1 -- 172.21.15.81:0/3437483899 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be00094b0 con 0x7f9bf41622a0 2024-09-13T18:47:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa760a00700 1 -- 172.21.15.81:0/2258406216 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c004230 con 0x7fa76406aaa0 2024-09-13T18:47:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa760a00700 1 -- 172.21.15.81:0/2258406216 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c004390 con 0x7fa76406aaa0 2024-09-13T18:47:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7fa760a00700 1 -- 172.21.15.81:0/2258406216 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0036c0 con 0x7fa76406aaa0 2024-09-13T18:47:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bf1400700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf41622a0 0x7f9bf40a8b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bf41585b0 tx=0x7f9be400eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4013680 con 0x7f9bf41622a0 2024-09-13T18:47:41.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 -- 172.21.15.81:0/2258406216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa76406aaa0 msgr2=0x7fa76406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be40137e0 con 0x7f9bf41622a0 2024-09-13T18:47:41.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4013b50 con 0x7f9bf41622a0 2024-09-13T18:47:41.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 --2- 172.21.15.81:0/2258406216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa76406aaa0 0x7fa76406af10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009850 tx=0x7fa74c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 -- 172.21.15.81:0/3345654851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 msgr2=0x7f4ac806bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 --2- 172.21.15.81:0/3345654851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 0x7f4ac806bd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009910 tx=0x7f4ab4009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc0ce270 0x7fc6dc13bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6dc13f5e0 0x7fc6dc0a9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 -- 172.21.15.81:0/3345654851 shutdown_connections 2024-09-13T18:47:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 --2- 172.21.15.81:0/3345654851 >> v2:172.21.15.178:3300/0 conn(0x7f4ac80ad4e0 0x7f4ac80b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 --2- 172.21.15.81:0/3345654851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac80ae200 0x7f4ac806bd00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 -- 172.21.15.81:0/3345654851 >> 172.21.15.81:0/3345654851 conn(0x7f4ac80cecc0 msgr2=0x7f4ac80cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 -- 172.21.15.81:0/2258406216 shutdown_connections 2024-09-13T18:47:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc13c1e0 con 0x7fc6dc0b1210 2024-09-13T18:47:41.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0a9590 con 0x7fc6dc0ce270 2024-09-13T18:47:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 --2- 172.21.15.81:0/2258406216 >> v2:172.21.15.81:3300/0 conn(0x7fa7640b2670 0x7fa7640b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc14c6c0 con 0x7fc6dc13f5e0 2024-09-13T18:47:41.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 --2- 172.21.15.81:0/2258406216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa76406aaa0 0x7fa76406af10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf4167620 con 0x7f9bf41622a0 2024-09-13T18:47:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 -- 172.21.15.81:0/2258406216 >> 172.21.15.81:0/2258406216 conn(0x7fa7640b0c40 msgr2=0x7fa76406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf4168640 con 0x7f9bf41622a0 2024-09-13T18:47:41.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 -- 172.21.15.81:0/3345654851 shutdown_connections 2024-09-13T18:47:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6daa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc0ce270 0x7fc6dc13bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6dbe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6dc13f5e0 0x7fc6dc0a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6daa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc0ce270 0x7fc6dc13bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51278/0 (socket says 172.21.15.81:51278) 2024-09-13T18:47:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6daa00700 1 -- 172.21.15.81:0/468286864 learned_addr learned my addr 172.21.15.81:0/468286864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 -- 172.21.15.81:0/2258406216 shutdown_connections 2024-09-13T18:47:41.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fa763200700 1 -- 172.21.15.81:0/2258406216 wait complete. 2024-09-13T18:47:41.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.030+0000 7f4af3000700 1 -- 172.21.15.81:0/437327812 wait complete. 2024-09-13T18:47:41.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 -- start start 2024-09-13T18:47:41.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346406aae0 0x7f3464157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 0x7f34641fca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641ff5d0 0x7f3464203490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f2962800700 1 -- 172.21.15.81:0/3501923624 shutdown_connections 2024-09-13T18:47:41.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 -- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6dc13f5e0 msgr2=0x7fc6dc0a9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6dc13f5e0 0x7fc6dc0a9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 -- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc0ce270 msgr2=0x7fc6dc13bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc0ce270 0x7fc6dc13bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 -- 172.21.15.81:0/468286864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc009570 con 0x7fc6dc0b1210 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6dbe00700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6dc13f5e0 0x7fc6dc0a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346415d000 con 0x7f346415d3d0 2024-09-13T18:47:41.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 -- 172.21.15.81:0/3345654851 wait complete. 2024-09-13T18:47:41.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3464203000 con 0x7f34641ff5d0 2024-09-13T18:47:41.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f346a400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34641fcf60 con 0x7f346406aae0 2024-09-13T18:47:41.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3462a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 0x7f34641fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6db400700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc14e660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc071df0 tx=0x7fc6cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3462a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 0x7f34641fca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47330/0 (socket says 172.21.15.81:47330) 2024-09-13T18:47:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3462a00700 1 -- 172.21.15.81:0/548580139 learned_addr learned my addr 172.21.15.81:0/548580139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463e00700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641ff5d0 0x7f3464203490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00be10 con 0x7fc6dc0b1210 2024-09-13T18:47:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc01f070 con 0x7fc6dc0b1210 2024-09-13T18:47:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc003900 con 0x7fc6dc0b1210 2024-09-13T18:47:41.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346406aae0 0x7f3464157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 Processor -- start 2024-09-13T18:47:41.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463e00700 1 -- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346406aae0 msgr2=0x7f3464157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463e00700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346406aae0 0x7f3464157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463e00700 1 -- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 msgr2=0x7f34641fca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463e00700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 0x7f34641fca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3463e00700 1 -- 172.21.15.81:0/548580139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34540094b0 con 0x7f34641ff5d0 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f3462a00700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 0x7f34641fca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f3463e00700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641ff5d0 0x7f3464203490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f345c00caa0 tx=0x7f345c00cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6dc14f290 con 0x7fc6dc0b1210 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc14efb0 con 0x7fc6dc0b1210 2024-09-13T18:47:41.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f4acee00700 1 -- start start 2024-09-13T18:47:41.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 0x7f4ac8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 Processor -- start 2024-09-13T18:47:41.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 -- start start 2024-09-13T18:47:41.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c007480 con 0x7f34641ff5d0 2024-09-13T18:47:41.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c0075e0 con 0x7f34641ff5d0 2024-09-13T18:47:41.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c007950 con 0x7f34641ff5d0 2024-09-13T18:47:41.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ac80ae200 0x7f4ac814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac8161180 0x7f4ac814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 0x7f4ac8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf4167e20 con 0x7f9bf41622a0 2024-09-13T18:47:41.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9be4013cb0 con 0x7f9bf41622a0 2024-09-13T18:47:41.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acd000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ac80ae200 0x7f4ac814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.034+0000 7f2962800700 1 -- 172.21.15.81:0/3501923624 wait complete. 2024-09-13T18:47:41.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76406aaa0 0x7fa764150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7640b2670 0x7fa7641fa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 0x7fa7640ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641fabd0 con 0x7fa7641610b0 2024-09-13T18:47:41.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641f87b0 con 0x7fa7640b2670 2024-09-13T18:47:41.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa763200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa764150290 con 0x7fa76406aaa0 2024-09-13T18:47:41.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa762800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 0x7fa7640ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f9bea000700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9bd4066730 0x7f9bd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9be4084500 con 0x7f9bf41622a0 2024-09-13T18:47:41.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f2962800700 1 Processor -- start 2024-09-13T18:47:41.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3464157900 con 0x7f34641ff5d0 2024-09-13T18:47:41.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3464200160 con 0x7f34641ff5d0 2024-09-13T18:47:41.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc06a690 con 0x7fc6dc0b1210 2024-09-13T18:47:41.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4af3000700 1 Processor -- start 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acd000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ac80ae200 0x7f4ac814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51290/0 (socket says 172.21.15.81:51290) 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 0x7f4ac8151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47342/0 (socket says 172.21.15.81:47342) 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acd000700 1 -- 172.21.15.81:0/712046182 learned_addr learned my addr 172.21.15.81:0/712046182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4ace400700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac8161180 0x7f4ac814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac814e660 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac814da50 con 0x7f4ac80ae200 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac814dd30 con 0x7f4ac8161180 2024-09-13T18:47:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc6cc021070 con 0x7fc6dc0b1210 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 -- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac8161180 msgr2=0x7f4ac814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac8161180 0x7f4ac814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 -- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ac80ae200 msgr2=0x7f4ac814ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ac80ae200 0x7f4ac814ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab4009570 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f9bf1e00700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9bd4066730 0x7f9bd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa762800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 0x7fa7640ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47356/0 (socket says 172.21.15.81:47356) 2024-09-13T18:47:41.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4acda00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 0x7f4ac8151e00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c480 tx=0x7f4abc00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa762800700 1 -- 172.21.15.81:0/1983029481 learned_addr learned my addr 172.21.15.81:0/1983029481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7f4af3000700 1 -- start start 2024-09-13T18:47:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.038+0000 7fa761400700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7640b2670 0x7fa7641fa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76406aaa0 0x7fa764150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f9bf1e00700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9bd4066730 0x7f9bd4068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009b70 tx=0x7f9be0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fc6d3400700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6bc066830 0x7fc6bc068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6cc0858c0 con 0x7fc6dc0b1210 2024-09-13T18:47:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 -- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7640b2670 msgr2=0x7fa7641fa690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7640b2670 0x7fa7641fa690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 -- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 msgr2=0x7fa7640ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 0x7fa7640ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 -- 172.21.15.81:0/1983029481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0094b0 con 0x7fa76406aaa0 2024-09-13T18:47:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa762800700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 0x7fa7640ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fc6daa00700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6bc066830 0x7fc6bc068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa761e00700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76406aaa0 0x7fa764150780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa75c001fc0 tx=0x7fa75c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f2962800700 1 -- start start 2024-09-13T18:47:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640b1100 con 0x7f34641ff5d0 2024-09-13T18:47:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fc6daa00700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6bc066830 0x7fc6bc068cf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0af880 tx=0x7fc6c8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af3000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec06ae80 0x7f4aec150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af3000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af3000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 0x7f4aec0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af3000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec151ea0 con 0x7f4aec06ae80 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af3000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec1ff5d0 con 0x7f4aec153420 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af3000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aec0af360 con 0x7f4aec071460 2024-09-13T18:47:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f345c01b3b0 con 0x7f34641ff5d0 2024-09-13T18:47:41.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00ac90 con 0x7fa76406aaa0 2024-09-13T18:47:41.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4aebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec06ae80 0x7f4aec150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af1000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 0x7f4aec0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00adf0 con 0x7fa76406aaa0 2024-09-13T18:47:41.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c007310 con 0x7fa76406aaa0 2024-09-13T18:47:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7641f7ba0 con 0x7fa76406aaa0 2024-09-13T18:47:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7641f8160 con 0x7fa76406aaa0 2024-09-13T18:47:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9be4051560 con 0x7f9bf41622a0 2024-09-13T18:47:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f345b400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3444066780 0x7f3444068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f345c083af0 con 0x7f34641ff5d0 2024-09-13T18:47:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f3463400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3444066780 0x7f3444068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4aeb400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af1000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 0x7f4aec0aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51310/0 (socket says 172.21.15.81:51310) 2024-09-13T18:47:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4af1000700 1 -- 172.21.15.81:0/3726003747 learned_addr learned my addr 172.21.15.81:0/3726003747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.042+0000 7f4aebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec06ae80 0x7f4aec150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47362/0 (socket says 172.21.15.81:47362) 2024-09-13T18:47:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f4af1000700 1 -- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 msgr2=0x7f4aec1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f4af1000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec1522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f4af1000700 1 -- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec06ae80 msgr2=0x7f4aec150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f4af1000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec06ae80 0x7f4aec150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f4af1000700 1 -- 172.21.15.81:0/3726003747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80094b0 con 0x7f4aec153420 2024-09-13T18:47:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa764160740 con 0x7fa76406aaa0 2024-09-13T18:47:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2962800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f295c149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2962800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c0ca680 0x7f295c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2962800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c0cb040 0x7f295c0b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2962800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0a0540 con 0x7f295c0ca680 2024-09-13T18:47:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2962800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c151680 con 0x7f2944005330 2024-09-13T18:47:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2962800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0cb4c0 con 0x7f295c0cb040 2024-09-13T18:47:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f3463400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3444066780 0x7f3444068c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34640cc4b0 tx=0x7f3454008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2960a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c0ca680 0x7f295c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2960a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c0ca680 0x7f295c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47368/0 (socket says 172.21.15.81:47368) 2024-09-13T18:47:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2960a00700 1 -- 172.21.15.81:0/1939735766 learned_addr learned my addr 172.21.15.81:0/1939735766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f295c149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961e00700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c0cb040 0x7f295c0b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f4af1000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 0x7f4aec0aee20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d800 tx=0x7f4adc00db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 -- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c0cb040 msgr2=0x7f295c0b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c0cb040 0x7f295c0b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 -- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c0ca680 msgr2=0x7f295c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c0ca680 0x7f295c0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 -- 172.21.15.81:0/1939735766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c09ff10 con 0x7f2944005330 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.046+0000 7f2961400700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f295c149bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f295000e700 tx=0x7f295000ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa75c007470 con 0x7fa76406aaa0 2024-09-13T18:47:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0052d0 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc005430 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0055a0 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac814e010 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac814d720 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc6cc0529b0 con 0x7fc6dc0b1210 2024-09-13T18:47:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7fa75a000700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa740066780 0x7fa740068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa75c084740 con 0x7fa76406aaa0 2024-09-13T18:47:41.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7fa761400700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa740066780 0x7fa740068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7fa761400700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa740066780 0x7fa740068c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0090b0 tx=0x7fa74c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4abc0038e0 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.050+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac80677c0 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa75c0518a0 con 0x7fa76406aaa0 2024-09-13T18:47:41.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4ac5600700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4aa8066800 0x7f4aa8068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4abc0837c0 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4acd000700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4aa8066800 0x7f4aa8068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950010510 con 0x7f2944005330 2024-09-13T18:47:41.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2950010690 con 0x7f2944005330 2024-09-13T18:47:41.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950010a40 con 0x7f2944005330 2024-09-13T18:47:41.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c0b29e0 con 0x7f2944005330 2024-09-13T18:47:41.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c0a01d0 con 0x7f2944005330 2024-09-13T18:47:41.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0125f0 con 0x7f4aec153420 2024-09-13T18:47:41.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc012790 con 0x7f4aec153420 2024-09-13T18:47:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f345c050d10 con 0x7f34641ff5d0 2024-09-13T18:47:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aec151220 con 0x7f4aec153420 2024-09-13T18:47:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc012b40 con 0x7f4aec153420 2024-09-13T18:47:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c0ce490 con 0x7f2944005330 2024-09-13T18:47:41.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec1517e0 con 0x7f4aec153420 2024-09-13T18:47:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.054+0000 7f4acd000700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4aa8066800 0x7f4aa8068cc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009150 tx=0x7f4ab4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.058+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac4005310 con 0x7f4aec153420 2024-09-13T18:47:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.058+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4adc012ca0 con 0x7f4aec153420 2024-09-13T18:47:41.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.062+0000 7f4ae3e00700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4acc066800 0x7f4acc068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.058+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2950010ba0 con 0x7f2944005330 2024-09-13T18:47:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.062+0000 7f4aebe00700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4acc066800 0x7f4acc068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.062+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4adc0843f0 con 0x7f4aec153420 2024-09-13T18:47:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.062+0000 7f2959600700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f293c066780 0x7f293c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.062+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2950083b90 con 0x7f2944005330 2024-09-13T18:47:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.062+0000 7f2960a00700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f293c066780 0x7f293c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.066+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4abc050820 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.066+0000 7f4aebe00700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4acc066800 0x7f4acc068cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40012e0 tx=0x7f4ae4001a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.066+0000 7f2960a00700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f293c066780 0x7f293c068c40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f295c0b1470 tx=0x7f2948006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.066+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2950050d80 con 0x7f2944005330 2024-09-13T18:47:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.078+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4adc051450 con 0x7f4aec153420 2024-09-13T18:47:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.342+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4f24009880 con 0x7f4f2401c740 2024-09-13T18:47:41.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.342+0000 7f4f1f400700 1 -- 172.21.15.81:0/2391698110 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f2c0ce0e0 con 0x7f4f2401c740 2024-09-13T18:47:41.351 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f0c066800 msgr2=0x7f4f0c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f0c066800 0x7f4f0c068cc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4f20007fd0 tx=0x7f4f20009040 comp rx=0 tx=0).stop 2024-09-13T18:47:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 msgr2=0x7f4f24034be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f24034be0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c079b40 tx=0x7f4f2c073330 comp rx=0 tx=0).stop 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 shutdown_connections 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f0c066800 0x7f4f0c068cc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2401c740 0x7f4f24034be0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f2400a5b0 0x7f4f240346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 --2- 172.21.15.81:0/2391698110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f24005b10 0x7f4f240dfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 >> 172.21.15.81:0/2391698110 conn(0x7f4f24036140 msgr2=0x7f4f2401d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 shutdown_connections 2024-09-13T18:47:41.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.350+0000 7f4f1cc00700 1 -- 172.21.15.81:0/2391698110 wait complete. 2024-09-13T18:47:41.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-09-13T18:47:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.374+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bf4167de0 con 0x7f9bf41622a0 2024-09-13T18:47:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.374+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f34640ce5d0 con 0x7f34641ff5d0 2024-09-13T18:47:41.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.374+0000 7f9bea000700 1 -- 172.21.15.81:0/3437483899 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9be4054b80 con 0x7f9bf41622a0 2024-09-13T18:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.374+0000 7f345b400700 1 -- 172.21.15.81:0/548580139 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f345c083e60 con 0x7f34641ff5d0 2024-09-13T18:47:41.385 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9bd4066730 msgr2=0x7f9bd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9bd4066730 0x7f9bd4068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009b70 tx=0x7f9be0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf41622a0 msgr2=0x7f9bf40a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf41622a0 0x7f9bf40a8b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9bf41585b0 tx=0x7f9be400eb00 comp rx=0 tx=0).stop 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 shutdown_connections 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9bd4066730 0x7f9bd4068bf0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009b70 tx=0x7f9be0008030 comp rx=0 tx=0).stop 2024-09-13T18:47:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf41653c0 0x7f9bf4169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf41622a0 0x7f9bf40a8b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 --2- 172.21.15.81:0/3437483899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bf4066090 0x7f9bf4168100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 >> 172.21.15.81:0/3437483899 conn(0x7f9bf406e840 msgr2=0x7f9bf41638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 shutdown_connections 2024-09-13T18:47:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f9bf9200700 1 -- 172.21.15.81:0/3437483899 wait complete. 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3444066780 msgr2=0x7f3444068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3444066780 0x7f3444068c40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f34640cc4b0 tx=0x7f3454008030 comp rx=0 tx=0).stop 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641ff5d0 msgr2=0x7f3464203490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641ff5d0 0x7f3464203490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f345c00caa0 tx=0x7f345c00cad0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 shutdown_connections 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3444066780 0x7f3444068c40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34641ff5d0 0x7f3464203490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f346415d3d0 0x7f34641fca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 --2- 172.21.15.81:0/548580139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f346406aae0 0x7f3464157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.378+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 >> 172.21.15.81:0/548580139 conn(0x7f34640b06f0 msgr2=0x7f34640afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.382+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 shutdown_connections 2024-09-13T18:47:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.382+0000 7f346a400700 1 -- 172.21.15.81:0/548580139 wait complete. 2024-09-13T18:47:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.382+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc6dc06a690 con 0x7fc6dc0b1210 2024-09-13T18:47:41.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.386+0000 7fc6d3400700 1 -- 172.21.15.81:0/468286864 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6cc055fd0 con 0x7fc6dc0b1210 2024-09-13T18:47:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.386+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7641638f0 con 0x7fa76406aaa0 2024-09-13T18:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.386+0000 7fa75a000700 1 -- 172.21.15.81:0/1983029481 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa75c018020 con 0x7fa76406aaa0 2024-09-13T18:47:41.396 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-13T18:47:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.390+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6bc066830 msgr2=0x7fc6bc068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.390+0000 7fc6e2000700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6bc066830 0x7fc6bc068cf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0af880 tx=0x7fc6c8009190 comp rx=0 tx=0).stop 2024-09-13T18:47:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.390+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 msgr2=0x7fc6dc14e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.390+0000 7fc6e2000700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc14e660 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc071df0 tx=0x7fc6cc004770 comp rx=0 tx=0).stop 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa740066780 msgr2=0x7fa740068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa740066780 0x7fa740068c40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0090b0 tx=0x7fa74c010000 comp rx=0 tx=0).stop 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76406aaa0 msgr2=0x7fa764150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76406aaa0 0x7fa764150780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa75c001fc0 tx=0x7fa75c00a340 comp rx=0 tx=0).stop 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 shutdown_connections 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6bc066830 0x7fc6bc068cf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6dc13f5e0 0x7fc6dc0a9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6dc0ce270 0x7fc6dc13bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 --2- 172.21.15.81:0/468286864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6dc0b1210 0x7fc6dc14e660 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 >> 172.21.15.81:0/468286864 conn(0x7fc6dc0b06f0 msgr2=0x7fc6dc0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 shutdown_connections 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 shutdown_connections 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa740066780 0x7fa740068c40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7641610b0 0x7fa7640ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7640b2670 0x7fa7641fa690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 --2- 172.21.15.81:0/1983029481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa76406aaa0 0x7fa764150780 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 >> 172.21.15.81:0/1983029481 conn(0x7fa7640b0c40 msgr2=0x7fa76415fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fc6e2000700 1 -- 172.21.15.81:0/468286864 wait complete. 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 shutdown_connections 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7fa763200700 1 -- 172.21.15.81:0/1983029481 wait complete. 2024-09-13T18:47:41.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.394+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4ac80ae750 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.398+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f295c06c410 con 0x7f2944005330 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.398+0000 7f4ac5600700 1 -- 172.21.15.81:0/712046182 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4abc053e40 con 0x7f4ac80ad4e0 2024-09-13T18:47:41.409 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-13T18:47:41.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-09-13T18:47:41.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f2959600700 1 -- 172.21.15.81:0/1939735766 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2950019020 con 0x7f2944005330 2024-09-13T18:47:41.411 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4aa8066800 msgr2=0x7f4aa8068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4aa8066800 0x7f4aa8068cc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009150 tx=0x7f4ab4008030 comp rx=0 tx=0).stop 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 msgr2=0x7f4ac8151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 0x7f4ac8151e00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c480 tx=0x7f4abc00c790 comp rx=0 tx=0).stop 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 shutdown_connections 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4aa8066800 0x7f4aa8068cc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ac8161180 0x7f4ac814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ac80ae200 0x7f4ac814ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 --2- 172.21.15.81:0/712046182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ad4e0 0x7f4ac8151e00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 >> 172.21.15.81:0/712046182 conn(0x7f4ac80cecc0 msgr2=0x7f4ac80abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 shutdown_connections 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.402+0000 7f4acee00700 1 -- 172.21.15.81:0/712046182 wait complete. 2024-09-13T18:47:41.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f293c066780 msgr2=0x7f293c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f293c066780 0x7f293c068c40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f295c0b1470 tx=0x7f2948006f90 comp rx=0 tx=0).stop 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 msgr2=0x7f295c149bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f295c149bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f295000e700 tx=0x7f295000ea10 comp rx=0 tx=0).stop 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 shutdown_connections 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f293c066780 0x7f293c068c40 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f295c0b1470 tx=0x7f2948006f90 comp rx=0 tx=0).stop 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f295c0cb040 0x7f295c0b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f295c0ca680 0x7f295c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 --2- 172.21.15.81:0/1939735766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2944005330 0x7f295c149bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 >> 172.21.15.81:0/1939735766 conn(0x7f295c0d2c10 msgr2=0x7f295c0b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-09-13T18:47:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 shutdown_connections 2024-09-13T18:47:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.406+0000 7f2962800700 1 -- 172.21.15.81:0/1939735766 wait complete. 2024-09-13T18:47:41.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.414+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4ac40055c0 con 0x7f4aec153420 2024-09-13T18:47:41.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.414+0000 7f4ae3e00700 1 -- 172.21.15.81:0/3726003747 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4adc059e60 con 0x7f4aec153420 2024-09-13T18:47:41.424 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-09-13T18:47:41.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-09-13T18:47:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4acc066800 msgr2=0x7f4acc068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4acc066800 0x7f4acc068cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40012e0 tx=0x7f4ae4001a30 comp rx=0 tx=0).stop 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 msgr2=0x7f4aec0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 0x7f4aec0aee20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4adc00d800 tx=0x7f4adc00db10 comp rx=0 tx=0).stop 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 shutdown_connections 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4acc066800 0x7f4acc068cc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4aec153420 0x7f4aec0aee20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4aec071460 0x7f4aec1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 --2- 172.21.15.81:0/3726003747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4aec06ae80 0x7f4aec150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 >> 172.21.15.81:0/3726003747 conn(0x7f4aec06a390 msgr2=0x7f4aec0cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 shutdown_connections 2024-09-13T18:47:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:41.418+0000 7f4af3000700 1 -- 172.21.15.81:0/3726003747 wait complete. 2024-09-13T18:47:41.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-09-13T18:47:41.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-09-13T18:47:41.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-09-13T18:47:41.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2024-09-13T18:47:42.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:47:42.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:47:42.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:47:42.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:47:42.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:47:42.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:42.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:47:42.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:47:42.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:47:42.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 Processor -- start 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 -- start start 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d6015b250 0x7f3d6015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d6006a5a0 0x7f3d6006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d60143dc0 con 0x7f3d601439e0 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6015bc00 con 0x7f3d6006a5a0 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d65c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6006ca00 con 0x7f3d6015b250 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d5f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d6006a5a0 0x7f3d6006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d5e000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d6015b250 0x7f3d6015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d5f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d6006a5a0 0x7f3d6006a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47372/0 (socket says 172.21.15.81:47372) 2024-09-13T18:47:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.582+0000 7f3d5f400700 1 -- 172.21.15.81:0/2089538966 learned_addr learned my addr 172.21.15.81:0/2089538966 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5e000700 1 -- 172.21.15.81:0/2089538966 >> v2:172.21.15.81:3300/0 conn(0x7f3d6006a5a0 msgr2=0x7f3d6006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5e000700 1 --2- 172.21.15.81:0/2089538966 >> v2:172.21.15.81:3300/0 conn(0x7f3d6006a5a0 0x7f3d6006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5e000700 1 -- 172.21.15.81:0/2089538966 >> v1:172.21.15.178:6789/0 conn(0x7f3d601439e0 legacy=0x7f3d6006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5e000700 1 -- 172.21.15.81:0/2089538966 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6006af00 con 0x7f3d6015b250 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5e000700 1 --2- 172.21.15.81:0/2089538966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6015b250 0x7f3d6015b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d600b22e0 tx=0x7f3d50009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e17c9abdf2668a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5d600700 1 -- 172.21.15.81:0/2089538966 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011830 con 0x7f3d6015b250 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5d600700 1 -- 172.21.15.81:0/2089538966 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50011990 con 0x7f3d6015b250 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d5d600700 1 -- 172.21.15.81:0/2089538966 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50011830 con 0x7f3d6015b250 2024-09-13T18:47:42.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d65c00700 1 -- 172.21.15.81:0/2089538966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6015b250 msgr2=0x7f3d6015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d65c00700 1 --2- 172.21.15.81:0/2089538966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6015b250 0x7f3d6015b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3d600b22e0 tx=0x7f3d50009b30 comp rx=0 tx=0).stop 2024-09-13T18:47:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d65c00700 1 -- 172.21.15.81:0/2089538966 shutdown_connections 2024-09-13T18:47:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d65c00700 1 --2- 172.21.15.81:0/2089538966 >> v2:172.21.15.81:3300/0 conn(0x7f3d6006a5a0 0x7f3d6006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d65c00700 1 --2- 172.21.15.81:0/2089538966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d6015b250 0x7f3d6015b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.586+0000 7f3d65c00700 1 -- 172.21.15.81:0/2089538966 >> 172.21.15.81:0/2089538966 conn(0x7f3d600b06f0 msgr2=0x7f3d600b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.590+0000 7f3d65c00700 1 -- 172.21.15.81:0/2089538966 shutdown_connections 2024-09-13T18:47:42.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.590+0000 7f3d65c00700 1 -- 172.21.15.81:0/2089538966 wait complete. 2024-09-13T18:47:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.590+0000 7f3d65c00700 1 Processor -- start 2024-09-13T18:47:42.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.590+0000 7f3d65c00700 1 -- start start 2024-09-13T18:47:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d65c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d6006a5a0 0x7f3d6015d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d65c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d601439e0 0x7f3d6013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d65c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d6015b250 0x7f3d6013d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d65c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6013b270 con 0x7f3d6015b250 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d6006a5a0 0x7f3d6015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d6006a5a0 0x7f3d6015d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49414/0 (socket says 172.21.15.81:49414) 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5ea00700 1 -- 172.21.15.81:0/3265165101 learned_addr learned my addr 172.21.15.81:0/3265165101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5f400700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d6015b250 0x7f3d6013d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d601439e0 0x7f3d6013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6013cad0 con 0x7f3d601439e0 2024-09-13T18:47:42.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6013cdb0 con 0x7f3d6006a5a0 2024-09-13T18:47:42.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 -- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d6006a5a0 msgr2=0x7f3d6015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d6006a5a0 0x7f3d6015d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 -- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d6015b250 msgr2=0x7f3d6013d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d6015b250 0x7f3d6013d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500094b0 con 0x7f3d601439e0 2024-09-13T18:47:42.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.594+0000 7f3d5e000700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d601439e0 0x7f3d6013a800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3d50016000 tx=0x7f3d50004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.598+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50004440 con 0x7f3d601439e0 2024-09-13T18:47:42.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.598+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d500045c0 con 0x7f3d601439e0 2024-09-13T18:47:42.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.598+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50019a60 con 0x7f3d601439e0 2024-09-13T18:47:42.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.598+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6013d090 con 0x7f3d601439e0 2024-09-13T18:47:42.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.598+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6015d550 con 0x7f3d601439e0 2024-09-13T18:47:42.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.598+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d6013d5b0 con 0x7f3d601439e0 2024-09-13T18:47:42.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.602+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d50019bc0 con 0x7f3d601439e0 2024-09-13T18:47:42.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.602+0000 7f3d56a00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d3c06ab40 0x7f3d3c06d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.602+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d50085830 con 0x7f3d601439e0 2024-09-13T18:47:42.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.606+0000 7f3d5ea00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d3c06ab40 0x7f3d3c06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.606+0000 7f3d5ea00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d3c06ab40 0x7f3d3c06d000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d48001940 tx=0x7f3d48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.614+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d6013d5b0 con 0x7f3d601439e0 2024-09-13T18:47:42.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.638+0000 7f50bd000700 1 Processor -- start 2024-09-13T18:47:42.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.638+0000 7f50bd000700 1 -- start start 2024-09-13T18:47:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50bd000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f50b8161040 0x7f50b80ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50bd000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b80cd260 con 0x7f50b806b7b0 2024-09-13T18:47:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50bd000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b8161420 con 0x7f50b8066090 2024-09-13T18:47:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50bd000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b8165b70 con 0x7f50b8161040 2024-09-13T18:47:42.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f50b806b7b0 0x7f50b8164bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47218/0 (socket says 172.21.15.81:47218) 2024-09-13T18:47:42.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6a00700 1 -- 172.21.15.81:0/1124606848 learned_addr learned my addr 172.21.15.81:0/1124606848 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:42.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938668964 0 0) 0x7f50b80cd260 con 0x7f50b806b7b0 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f509c0035d0 con 0x7f50b806b7b0 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b7400700 1 --2- 172.21.15.81:0/1124606848 >> v2:172.21.15.178:3300/0 conn(0x7f50b8161040 0x7f50b80ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943983653 0 0) 0x7f509c0035d0 con 0x7f50b806b7b0 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 >> v2:172.21.15.178:3300/0 conn(0x7f50b8161040 msgr2=0x7f50b80ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 --2- 172.21.15.81:0/1124606848 >> v2:172.21.15.178:3300/0 conn(0x7f50b8161040 0x7f50b80ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 >> v1:172.21.15.178:6789/0 conn(0x7f50b8066090 legacy=0x7f50b80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b81652e0 con 0x7f50b806b7b0 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.642+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f50a4001670 con 0x7f50b806b7b0 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 >> v1:172.21.15.81:6789/0 conn(0x7f50b806b7b0 legacy=0x7f50b8164bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c003a90 0x7f509c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c004870 0x7f509c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c005280 0x7f509c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8165b70 con 0x7f509c004870 2024-09-13T18:47:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c00c1d0 con 0x7f509c005280 2024-09-13T18:47:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c00c390 con 0x7f509c003a90 2024-09-13T18:47:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7fc68f200700 1 Processor -- start 2024-09-13T18:47:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7fc68f200700 1 -- start start 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c005280 0x7f509c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7400700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c003a90 0x7f509c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6a00700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c004870 0x7f509c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 -- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c003a90 msgr2=0x7f509c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c003a90 0x7f509c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 -- 172.21.15.81:0/1124606848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c004870 msgr2=0x7f509c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c004870 0x7f509c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 -- 172.21.15.81:0/1124606848 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0035d0 con 0x7f509c005280 2024-09-13T18:47:42.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 -- 172.21.15.81:0/1124606848 reap_dead start 2024-09-13T18:47:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b7e00700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c005280 0x7f509c00ba30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50b0002210 tx=0x7f509c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a00cce1ed1548d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7fc68f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc690143190 0x7fc690070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7fc68f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc69006d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0001c80 con 0x7f509c005280 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000cc70 con 0x7f509c005280 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7f50b6000700 1 -- 172.21.15.81:0/1124606848 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0003a20 con 0x7f509c005280 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.646+0000 7fc68d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc690071290 0x7fc690160b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47232/0 (socket says 172.21.15.81:47232) 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 -- 172.21.15.81:0/1678466208 learned_addr learned my addr 172.21.15.81:0/1678466208 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68de00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc690143190 0x7fc690070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68e800700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc69006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6900b1910 con 0x7fc690071290 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6900716d0 con 0x7fc690143190 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc690161890 con 0x7fc690161230 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753827965 0 0) 0x7fc6900b1910 con 0x7fc690071290 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6740035d0 con 0x7fc690071290 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2371344024 0 0) 0x7fc6740035d0 con 0x7fc690071290 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 msgr2=0x7fc69006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc69006d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 >> v2:172.21.15.178:3300/0 conn(0x7fc690143190 msgr2=0x7fc690070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 --2- 172.21.15.81:0/1678466208 >> v2:172.21.15.178:3300/0 conn(0x7fc690143190 0x7fc690070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69015e2d0 con 0x7fc690071290 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fc680001670 con 0x7fc690071290 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 -- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c005280 msgr2=0x7f509c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c005280 0x7f509c00ba30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50b0002210 tx=0x7f509c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 >> v1:172.21.15.81:6789/0 conn(0x7fc690071290 legacy=0x7fc690160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc674003ab0 0x7fc674003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc674004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 -- 172.21.15.81:0/1124606848 shutdown_connections 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 --2- 172.21.15.81:0/1124606848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c005280 0x7f509c00ba30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc674004db0 0x7fc674005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 -- 172.21.15.81:0/1124606848 >> 172.21.15.81:0/1124606848 conn(0x7f50b8070d10 msgr2=0x7f50b80710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900716d0 con 0x7fc674003ab0 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc690161890 con 0x7fc674004db0 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67400ba30 con 0x7fc690161230 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 -- 172.21.15.81:0/1124606848 shutdown_connections 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc674004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68de00700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc674003ab0 0x7fc674003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68e800700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc674004db0 0x7fc674005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 -- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc674004db0 msgr2=0x7fc674005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc674004db0 0x7fc674005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 -- 172.21.15.81:0/1678466208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc674003ab0 msgr2=0x7fc674003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc674003ab0 0x7fc674003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7fc68d400700 1 -- 172.21.15.81:0/1678466208 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900b1910 con 0x7fc690161230 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7fc68d400700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc674004870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c350 tx=0x7fc6740058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0f1b2ef9471ae8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68000ce50 con 0x7fc690161230 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc680007bc0 con 0x7fc690161230 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7fc68ca00700 1 -- 172.21.15.81:0/1678466208 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680004b90 con 0x7fc690161230 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.650+0000 7f50bd000700 1 -- 172.21.15.81:0/1124606848 wait complete. 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7f50bd000700 1 Processor -- start 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7f3694e00700 1 Processor -- start 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7f3694e00700 1 -- start start 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.654+0000 7f50bd000700 1 -- start start 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 Processor -- start 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 msgr2=0x7fc674004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68f200700 1 --2- 172.21.15.81:0/1678466208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc674004870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c350 tx=0x7fc6740058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68e800700 1 -- 172.21.15.81:0/1678466208 reap_dead start 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 shutdown_connections 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 >> 172.21.15.81:0/1678466208 conn(0x7fc69006a390 msgr2=0x7fc69006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 shutdown_connections 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7fc68f200700 1 -- 172.21.15.81:0/1678466208 wait complete. 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f3694e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f36900ccfd0 0x7f36900ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f3694e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3690071150 con 0x7f369006e0a0 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f3694e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900cd540 con 0x7f36900cb200 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f3694e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900ceb20 con 0x7f36900ccfd0 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368f400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f36900cb200 0x7f369006d990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33904/0 (socket says 172.21.15.81:33904) 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368f400700 1 -- 172.21.15.81:0/3928222621 learned_addr learned my addr 172.21.15.81:0/3928222621 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368fe00700 1 --2- 172.21.15.81:0/3928222621 >> v2:172.21.15.178:3300/0 conn(0x7f36900ccfd0 0x7f36900ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 -- start start 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42a40c2310 0x7f42a40ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40ce070 0x7f42a40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a406ccb0 con 0x7f42a40c26f0 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a406d550 con 0x7f42a40c2310 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42aa000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40ce5c0 con 0x7f42a40ce070 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368fe00700 1 -- 172.21.15.81:0/3928222621 >> v1:172.21.15.178:6789/0 conn(0x7f36900cb200 legacy=0x7f369006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368fe00700 1 -- 172.21.15.81:0/3928222621 >> v1:172.21.15.81:6789/0 conn(0x7f369006e0a0 legacy=0x7f36900704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368fe00700 1 -- 172.21.15.81:0/3928222621 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900cd820 con 0x7f36900ccfd0 2024-09-13T18:47:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f368fe00700 1 --2- 172.21.15.81:0/3928222621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36900ccfd0 0x7f36900ce5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3688009d90 tx=0x7f368800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d540f097e0332b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42a8c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42a40c2310 0x7f42a40ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42a9600700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f42a40c26f0 0x7f42a4165240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33908/0 (socket says 172.21.15.81:33908) 2024-09-13T18:47:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42a9600700 1 -- 172.21.15.81:0/2779692420 learned_addr learned my addr 172.21.15.81:0/2779692420 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:42.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.658+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2779692420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40ce070 0x7f42a40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50bd000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c005280 0x7f50b80b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50bd000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50b8157bb0 0x7f50b8157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50bd000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 0x7f50b81630c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50bd000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b8158530 con 0x7f509c005280 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50bd000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b81f69a0 con 0x7f50b8162c30 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50bd000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b81f6c80 con 0x7f50b8157bb0 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3400700 1 -- 172.21.15.81:0/2779692420 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606625948 0 0) 0x7f42a406ccb0 con 0x7f42a40c26f0 2024-09-13T18:47:42.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3400700 1 -- 172.21.15.81:0/2779692420 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f428c0035d0 con 0x7f42a40c26f0 2024-09-13T18:47:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68f200700 1 Processor -- start 2024-09-13T18:47:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f368e000700 1 -- 172.21.15.81:0/3928222621 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800e070 con 0x7f36900ccfd0 2024-09-13T18:47:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f368e000700 1 -- 172.21.15.81:0/3928222621 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368800bad0 con 0x7f36900ccfd0 2024-09-13T18:47:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f368e000700 1 -- 172.21.15.81:0/3928222621 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368800be60 con 0x7f36900ccfd0 2024-09-13T18:47:42.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3e00700 1 -- 172.21.15.81:0/2779692420 >> v2:172.21.15.178:3300/0 conn(0x7f42a40c2310 msgr2=0x7f42a40ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2779692420 >> v2:172.21.15.178:3300/0 conn(0x7f42a40c2310 0x7f42a40ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3e00700 1 -- 172.21.15.81:0/2779692420 >> v1:172.21.15.178:6789/0 conn(0x7f42a40c26f0 legacy=0x7f42a4165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3e00700 1 -- 172.21.15.81:0/2779692420 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a406cf00 con 0x7f42a40ce070 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2779692420 >> v2:172.21.15.178:3300/0 conn(0x7f42a40c2310 0x7f42a40ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68f200700 1 -- start start 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f3694e00700 1 -- 172.21.15.81:0/3928222621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36900ccfd0 msgr2=0x7f36900ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f3694e00700 1 --2- 172.21.15.81:0/3928222621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36900ccfd0 0x7f36900ce5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3688009d90 tx=0x7f368800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:42.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 0x7f50b81630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 0x7f50b81630c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51412/0 (socket says 172.21.15.81:51412) 2024-09-13T18:47:42.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f3694e00700 1 -- 172.21.15.81:0/3928222621 shutdown_connections 2024-09-13T18:47:42.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f3694e00700 1 --2- 172.21.15.81:0/3928222621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36900ccfd0 0x7f36900ce5e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f3694e00700 1 -- 172.21.15.81:0/3928222621 >> 172.21.15.81:0/3928222621 conn(0x7f36900cf0d0 msgr2=0x7f36900cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 -- 172.21.15.81:0/2463821412 learned_addr learned my addr 172.21.15.81:0/2463821412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2779692420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40ce070 0x7f42a40cd510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4290009850 tx=0x7f4290009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab77ac5f4dcf2d88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3400700 1 -- 172.21.15.81:0/2779692420 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290011830 con 0x7f42a40ce070 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3400700 1 -- 172.21.15.81:0/2779692420 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4290011990 con 0x7f42a40ce070 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f42a3400700 1 -- 172.21.15.81:0/2779692420 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290011d40 con 0x7f42a40ce070 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 -- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50b8157bb0 msgr2=0x7f50b8157ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:47:42.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50b8157bb0 0x7f50b8157ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 -- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c005280 msgr2=0x7f50b80b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc6900cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 0x7fc6900c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c005280 0x7f50b80b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6900c3a40 0x7fc6900c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 -- 172.21.15.81:0/2463821412 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b81f6f60 con 0x7f50b8162c30 2024-09-13T18:47:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50b7e00700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 0x7f50b81630c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50b8071bd0 tx=0x7f50b0001330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00054e0 con 0x7f50b8162c30 2024-09-13T18:47:42.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc6900cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0005660 con 0x7f50b8162c30 2024-09-13T18:47:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 0x7fc6900c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7fc68d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 0x7fc6900c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47418/0 (socket says 172.21.15.81:47418) 2024-09-13T18:47:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.662+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b001d420 con 0x7f50b8162c30 2024-09-13T18:47:42.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc6900cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49438/0 (socket says 172.21.15.81:49438) 2024-09-13T18:47:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b81f7240 con 0x7f50b8162c30 2024-09-13T18:47:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 -- 172.21.15.81:0/2779692420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40ce070 msgr2=0x7f42a40cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 --2- 172.21.15.81:0/2779692420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40ce070 0x7f42a40cd510 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4290009850 tx=0x7f4290009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:42.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b8163600 con 0x7f50b8162c30 2024-09-13T18:47:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68d400700 1 -- 172.21.15.81:0/715675631 learned_addr learned my addr 172.21.15.81:0/715675631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f3694e00700 1 -- 172.21.15.81:0/3928222621 shutdown_connections 2024-09-13T18:47:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 -- 172.21.15.81:0/2779692420 shutdown_connections 2024-09-13T18:47:42.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 --2- 172.21.15.81:0/2779692420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40ce070 0x7f42a40cd510 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c87d0 con 0x7fc6900c7e10 2024-09-13T18:47:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 --2- 172.21.15.81:0/2779692420 >> v2:172.21.15.178:3300/0 conn(0x7f42a40c2310 0x7f42a40ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 -- 172.21.15.81:0/2779692420 >> 172.21.15.81:0/2779692420 conn(0x7f42a40cf0d0 msgr2=0x7f42a40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900cdbb0 con 0x7fc6900c3a40 2024-09-13T18:47:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6900c4770 con 0x7fc690161230 2024-09-13T18:47:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6900c3a40 0x7fc6900c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 -- 172.21.15.81:0/2779692420 shutdown_connections 2024-09-13T18:47:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f42aa000700 1 -- 172.21.15.81:0/2779692420 wait complete. 2024-09-13T18:47:42.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 -- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 msgr2=0x7fc6900cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc6900cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 -- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 msgr2=0x7fc6900c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 0x7fc6900c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6900c4a50 con 0x7fc6900c3a40 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68d400700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 0x7fc6900c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68e800700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6900c3a40 0x7fc6900c3ef0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc69006aef0 tx=0x7fc6880114b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f3694e00700 1 -- 172.21.15.81:0/3928222621 wait complete. 2024-09-13T18:47:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68800e070 con 0x7fc6900c3a40 2024-09-13T18:47:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc688003c50 con 0x7fc6900c3a40 2024-09-13T18:47:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc688003e40 con 0x7fc6900c3a40 2024-09-13T18:47:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b80ccd20 con 0x7f50b8162c30 2024-09-13T18:47:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7f3694e00700 1 Processor -- start 2024-09-13T18:47:42.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.666+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900c4d30 con 0x7fc6900c3a40 2024-09-13T18:47:42.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 -- start start 2024-09-13T18:47:42.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 Processor -- start 2024-09-13T18:47:42.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6900c4430 con 0x7fc6900c3a40 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 -- start start 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369006e0a0 0x7f369009c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36900cb200 0x7f369015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36900ccfd0 0x7f369015c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40c2310 0x7f42a40b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 0x7f42a40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a40ce070 0x7f42a40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c78b0 con 0x7f36900ccfd0 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f368f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369006e0a0 0x7f369009c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f368f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369006e0a0 0x7f369009c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51426/0 (socket says 172.21.15.81:51426) 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f368f400700 1 -- 172.21.15.81:0/1895936770 learned_addr learned my addr 172.21.15.81:0/1895936770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c7b90 con 0x7f369006e0a0 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36900c7e70 con 0x7f36900cb200 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42a8c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40c2310 0x7f42a40b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42a3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 0x7f42a40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50b001d580 con 0x7f50b8162c30 2024-09-13T18:47:42.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42a8c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40c2310 0x7f42a40b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49444/0 (socket says 172.21.15.81:49444) 2024-09-13T18:47:42.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42a3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 0x7f42a40b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51438/0 (socket says 172.21.15.81:51438) 2024-09-13T18:47:42.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc688011960 con 0x7fc6900c3a40 2024-09-13T18:47:42.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42a8c00700 1 -- 172.21.15.81:0/2326926727 learned_addr learned my addr 172.21.15.81:0/2326926727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40c5a10 con 0x7f42a40ce070 2024-09-13T18:47:42.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40b19f0 con 0x7f42a40c26f0 2024-09-13T18:47:42.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.670+0000 7f42aa000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40c4e00 con 0x7f42a40c2310 2024-09-13T18:47:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36900cb200 0x7f369015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a9600700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a40ce070 0x7f42a40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368fe00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36900ccfd0 0x7f369015c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7fc686000700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6700667b0 0x7fc670068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f50af400700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5098066730 0x7f5098068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f50b0085bc0 con 0x7f50b8162c30 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f50b7400700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5098066730 0x7f5098068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a3e00700 1 -- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40c2310 msgr2=0x7f42a40b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40c2310 0x7f42a40b14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a3e00700 1 -- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a40ce070 msgr2=0x7f42a40c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a40ce070 0x7f42a40c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a3e00700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980094b0 con 0x7f42a40c26f0 2024-09-13T18:47:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f50b7400700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5098066730 0x7f5098068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50a80098e0 tx=0x7f50a80094e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 0x7f42a40b0300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4290016000 tx=0x7f4290004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7fc68de00700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6700667b0 0x7fc670068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 -- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369006e0a0 msgr2=0x7f369009c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369006e0a0 0x7f369009c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 -- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36900ccfd0 msgr2=0x7f369015c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36900ccfd0 0x7f369015c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009a70 con 0x7f36900cb200 2024-09-13T18:47:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc690143570 con 0x7fc6900c3a40 2024-09-13T18:47:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7fc68de00700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6700667b0 0x7fc670068c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0045f0 tx=0x7fc67c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f368ea00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36900cb200 0x7f369015c400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f367c00b3e0 tx=0x7f367c00b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.674+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c011620 con 0x7f36900cb200 2024-09-13T18:47:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290004510 con 0x7f42a40c26f0 2024-09-13T18:47:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc688055bc0 con 0x7fc6900c3a40 2024-09-13T18:47:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f42aa000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42900094b0 con 0x7f42a40c26f0 2024-09-13T18:47:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f42aa000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a40c53c0 con 0x7f42a40c26f0 2024-09-13T18:47:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c011780 con 0x7f36900cb200 2024-09-13T18:47:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50b0052c30 con 0x7f50b8162c30 2024-09-13T18:47:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c011b30 con 0x7f36900cb200 2024-09-13T18:47:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36900c8150 con 0x7f36900cb200 2024-09-13T18:47:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280005310 con 0x7f42a40c26f0 2024-09-13T18:47:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.678+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369009c650 con 0x7f36900cb200 2024-09-13T18:47:42.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.682+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900cb5e0 con 0x7f36900cb200 2024-09-13T18:47:42.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.682+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f367c011c90 con 0x7f36900cb200 2024-09-13T18:47:42.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.682+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429001f070 con 0x7f42a40c26f0 2024-09-13T18:47:42.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.682+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290003900 con 0x7f42a40c26f0 2024-09-13T18:47:42.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.682+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc688051800 con 0x7fc6900c3a40 2024-09-13T18:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f3687400700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3670066730 0x7f3670068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f367c083f10 con 0x7f36900cb200 2024-09-13T18:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4290003a60 con 0x7f42a40c26f0 2024-09-13T18:47:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f368f400700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3670066730 0x7f3670068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f42a0c00700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4284066730 0x7f4284068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4290021070 con 0x7f42a40c26f0 2024-09-13T18:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.686+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4284066730 0x7f4284068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.690+0000 7f368f400700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3670066730 0x7f3670068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36800014a0 tx=0x7f3680001430 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.690+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4284066730 0x7f4284068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42a40c2070 tx=0x7f4298009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.690+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4290052c40 con 0x7f42a40c26f0 2024-09-13T18:47:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.690+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f367c050f90 con 0x7f36900cb200 2024-09-13T18:47:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 Processor -- start 2024-09-13T18:47:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 -- start start 2024-09-13T18:47:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad4415d170 0x7fad440b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 0x7fad440ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440d1390 con 0x7fad4415cd90 2024-09-13T18:47:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440b2530 con 0x7fad4415d170 2024-09-13T18:47:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad43200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440d05f0 con 0x7fad440cdfe0 2024-09-13T18:47:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad42800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 0x7fad440ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad42800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 0x7fad440ce450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49472/0 (socket says 172.21.15.81:49472) 2024-09-13T18:47:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.698+0000 7fad42800700 1 -- 172.21.15.81:0/1620864487 learned_addr learned my addr 172.21.15.81:0/1620864487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad39400700 1 --2- 172.21.15.81:0/1620864487 >> v2:172.21.15.81:3300/0 conn(0x7fad4415d170 0x7fad440b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad41400700 1 -- 172.21.15.81:0/1620864487 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230738893 0 0) 0x7fad440d1390 con 0x7fad4415cd90 2024-09-13T18:47:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad41400700 1 -- 172.21.15.81:0/1620864487 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad280035d0 con 0x7fad4415cd90 2024-09-13T18:47:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad42800700 1 -- 172.21.15.81:0/1620864487 >> v2:172.21.15.81:3300/0 conn(0x7fad4415d170 msgr2=0x7fad440b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad42800700 1 --2- 172.21.15.81:0/1620864487 >> v2:172.21.15.81:3300/0 conn(0x7fad4415d170 0x7fad440b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad42800700 1 -- 172.21.15.81:0/1620864487 >> v1:172.21.15.178:6789/0 conn(0x7fad4415cd90 legacy=0x7fad440cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad42800700 1 -- 172.21.15.81:0/1620864487 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440d1670 con 0x7fad440cdfe0 2024-09-13T18:47:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad39400700 1 --2- 172.21.15.81:0/1620864487 >> v2:172.21.15.81:3300/0 conn(0x7fad4415d170 0x7fad440b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad42800700 1 --2- 172.21.15.81:0/1620864487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 0x7fad440ce450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009910 tx=0x7fad3c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7feefa05c5072335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad41400700 1 -- 172.21.15.81:0/1620864487 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c011830 con 0x7fad440cdfe0 2024-09-13T18:47:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad41400700 1 -- 172.21.15.81:0/1620864487 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c011990 con 0x7fad440cdfe0 2024-09-13T18:47:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.702+0000 7fad41400700 1 -- 172.21.15.81:0/1620864487 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c011d40 con 0x7fad440cdfe0 2024-09-13T18:47:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 -- 172.21.15.81:0/1620864487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 msgr2=0x7fad440ce450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 --2- 172.21.15.81:0/1620864487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 0x7fad440ce450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009910 tx=0x7fad3c009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 -- 172.21.15.81:0/1620864487 shutdown_connections 2024-09-13T18:47:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 --2- 172.21.15.81:0/1620864487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad440cdfe0 0x7fad440ce450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 --2- 172.21.15.81:0/1620864487 >> v2:172.21.15.81:3300/0 conn(0x7fad4415d170 0x7fad440b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 -- 172.21.15.81:0/1620864487 >> 172.21.15.81:0/1620864487 conn(0x7fad440d2c10 msgr2=0x7fad440d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 -- 172.21.15.81:0/1620864487 shutdown_connections 2024-09-13T18:47:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7f3ebb200700 1 Processor -- start 2024-09-13T18:47:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7f3ebb200700 1 -- start start 2024-09-13T18:47:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.706+0000 7fad43200700 1 -- 172.21.15.81:0/1620864487 wait complete. 2024-09-13T18:47:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3ebb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40b1f40 0x7f3eb40d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3ebb200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3eb406bd40 0x7f3eb406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3ebb200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb406b8b0 con 0x7f3eb40d3880 2024-09-13T18:47:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7fad43200700 1 Processor -- start 2024-09-13T18:47:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7fad43200700 1 -- start start 2024-09-13T18:47:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3eba800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3eb406bd40 0x7f3eb406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3eba800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3eb406bd40 0x7f3eb406c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47450/0 (socket says 172.21.15.81:47450) 2024-09-13T18:47:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3eba800700 1 -- 172.21.15.81:0/4254726365 learned_addr learned my addr 172.21.15.81:0/4254726365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40ce580 con 0x7f3eb406bd40 2024-09-13T18:47:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7fc26f200700 1 Processor -- start 2024-09-13T18:47:42.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ce820 con 0x7f3eb40b1f40 2024-09-13T18:47:42.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eba800700 1 -- 172.21.15.81:0/4254726365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40b1f40 msgr2=0x7f3eb40d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eb9e00700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40b1f40 0x7f3eb40d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.710+0000 7fc26f200700 1 -- start start 2024-09-13T18:47:42.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eba800700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40b1f40 0x7f3eb40d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad43200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad440cdfe0 0x7fad441f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eba800700 1 -- 172.21.15.81:0/4254726365 >> v1:172.21.15.178:6789/0 conn(0x7f3eb40d3880 legacy=0x7f3eb40d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eba800700 1 -- 172.21.15.81:0/4254726365 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40ceb00 con 0x7f3eb406bd40 2024-09-13T18:47:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad43200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad4415cd90 0x7fad440b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eb9e00700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40b1f40 0x7f3eb40d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:42.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad43200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 0x7fad440b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eba800700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb406bd40 0x7f3eb406c1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009e50 tx=0x7f3eb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612c5578c68f0a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad43200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cc440 con 0x7fad4415cd90 2024-09-13T18:47:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2701610b0 0x7fc2700719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2700b2d80 0x7fc27006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad43200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad441f1290 con 0x7fad440cdfe0 2024-09-13T18:47:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad42800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 0x7fad440b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad42800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 0x7fad440b8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49490/0 (socket says 172.21.15.81:49490) 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad42800700 1 -- 172.21.15.81:0/2959380696 learned_addr learned my addr 172.21.15.81:0/2959380696 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440cbba0 con 0x7fad4415d170 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad41e00700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad440cdfe0 0x7fad441f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26d400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc27006aaa0 0x7fc2700b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33926/0 (socket says 172.21.15.81:33926) 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2701610b0 0x7fc2700719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2701610b0 0x7fc2700719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49504/0 (socket says 172.21.15.81:49504) 2024-09-13T18:47:42.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26d400700 1 -- 172.21.15.81:0/3112380732 learned_addr learned my addr 172.21.15.81:0/3112380732 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eb8a00700 1 -- 172.21.15.81:0/4254726365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000e070 con 0x7f3eb406bd40 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eb8a00700 1 -- 172.21.15.81:0/4254726365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb0003a40 con 0x7f3eb406bd40 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3eb8a00700 1 -- 172.21.15.81:0/4254726365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0003df0 con 0x7f3eb406bd40 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb406bd40 msgr2=0x7f3eb406c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb406bd40 0x7f3eb406c1f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009e50 tx=0x7f3eb000b330 comp rx=0 tx=0).stop 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 shutdown_connections 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb406bd40 0x7f3eb406c1f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 --2- 172.21.15.81:0/4254726365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40b1f40 0x7f3eb40d0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 >> 172.21.15.81:0/4254726365 conn(0x7f3eb40d2c10 msgr2=0x7f3eb40d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2700b3560 con 0x7fc27006aaa0 2024-09-13T18:47:42.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26e800700 1 --2- 172.21.15.81:0/3112380732 >> v2:172.21.15.81:3300/0 conn(0x7fc2700b2d80 0x7fc27006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 shutdown_connections 2024-09-13T18:47:42.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fad39400700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad4415cd90 0x7fad440b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7f3ebb200700 1 -- 172.21.15.81:0/4254726365 wait complete. 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.714+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc270070b30 con 0x7fc2700b2d80 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad42800700 1 -- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad440cdfe0 msgr2=0x7fad441f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad42800700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad440cdfe0 0x7fad441f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad42800700 1 -- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad4415cd90 msgr2=0x7fad440b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad42800700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad4415cd90 0x7fad440b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad42800700 1 -- 172.21.15.81:0/2959380696 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0094b0 con 0x7fad4415d170 2024-09-13T18:47:42.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad41e00700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad440cdfe0 0x7fad441f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:42.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26ca00700 1 -- 172.21.15.81:0/3112380732 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927064139 0 0) 0x7fc2700b3560 con 0x7fc27006aaa0 2024-09-13T18:47:42.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27006b420 con 0x7fc2701610b0 2024-09-13T18:47:42.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26ca00700 1 -- 172.21.15.81:0/3112380732 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2540035d0 con 0x7fc27006aaa0 2024-09-13T18:47:42.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad42800700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 0x7fad440b8400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad4408d140 tx=0x7fad3c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad39400700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad4415cd90 0x7fad440b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c004510 con 0x7fad4415d170 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0036c0 con 0x7fad4415d170 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c003a50 con 0x7fad4415d170 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c009570 con 0x7fad4415d170 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad440cc160 con 0x7fad4415d170 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26e800700 1 -- 172.21.15.81:0/3112380732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2701610b0 msgr2=0x7fc2700719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26e800700 1 --2- 172.21.15.81:0/3112380732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2701610b0 0x7fc2700719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26e800700 1 -- 172.21.15.81:0/3112380732 >> v1:172.21.15.178:6789/0 conn(0x7fc27006aaa0 legacy=0x7fc2700b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26e800700 1 -- 172.21.15.81:0/3112380732 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700b3280 con 0x7fc2700b2d80 2024-09-13T18:47:42.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26e800700 1 --2- 172.21.15.81:0/3112380732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2700b2d80 0x7fc27006aee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc260009850 tx=0x7fc260009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9413c5e46bfd84fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7f3ebb200700 1 Processor -- start 2024-09-13T18:47:42.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26ca00700 1 -- 172.21.15.81:0/3112380732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260011830 con 0x7fc2700b2d80 2024-09-13T18:47:42.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7f3ebb200700 1 -- start start 2024-09-13T18:47:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26ca00700 1 -- 172.21.15.81:0/3112380732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260011990 con 0x7fc2700b2d80 2024-09-13T18:47:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.718+0000 7fc26ca00700 1 -- 172.21.15.81:0/3112380732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260011830 con 0x7fc2700b2d80 2024-09-13T18:47:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3ebb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb406bd40 0x7f3eb41f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad440d1390 con 0x7fad4415d170 2024-09-13T18:47:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2700b2d80 msgr2=0x7fc27006aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 --2- 172.21.15.81:0/3112380732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2700b2d80 0x7fc27006aee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc260009850 tx=0x7fc260009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3ebb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40b1f40 0x7f3eb40b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3ebb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40d3880 0x7f3eb40b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb406bd40 0x7f3eb41f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40b1f40 0x7f3eb40b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb406bd40 0x7f3eb41f6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51466/0 (socket says 172.21.15.81:51466) 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9e00700 1 -- 172.21.15.81:0/3839362301 learned_addr learned my addr 172.21.15.81:0/3839362301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eba800700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40d3880 0x7f3eb40b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3ebb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb4161db0 con 0x7f3eb40b1f40 2024-09-13T18:47:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 shutdown_connections 2024-09-13T18:47:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 --2- 172.21.15.81:0/3112380732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2700b2d80 0x7fc27006aee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 --2- 172.21.15.81:0/3112380732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2701610b0 0x7fc2700719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 >> 172.21.15.81:0/3112380732 conn(0x7fc2700b0c40 msgr2=0x7fc27006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad3c003bb0 con 0x7fad4415d170 2024-09-13T18:47:42.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fad3aa00700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad20066780 0x7fad20068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40b7690 con 0x7f3eb406bd40 2024-09-13T18:47:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40b7970 con 0x7f3eb40d3880 2024-09-13T18:47:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad3c056be0 con 0x7fad4415d170 2024-09-13T18:47:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 shutdown_connections 2024-09-13T18:47:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fad41e00700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad20066780 0x7fad20068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7fc26f200700 1 -- 172.21.15.81:0/3112380732 wait complete. 2024-09-13T18:47:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9400700 1 -- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40d3880 msgr2=0x7f3eb40b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9400700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40d3880 0x7f3eb40b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9400700 1 -- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb406bd40 msgr2=0x7f3eb41f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9400700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb406bd40 0x7f3eb41f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.722+0000 7f3eb9400700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb0009b30 con 0x7f3eb40b1f40 2024-09-13T18:47:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3eba800700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40d3880 0x7f3eb40b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7fad41e00700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad20066780 0x7fad20068c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad34001560 tx=0x7fad34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3eb9400700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40b1f40 0x7f3eb40b6ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3eb408b260 tx=0x7f3ea400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011620 con 0x7f3eb40b1f40 2024-09-13T18:47:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40117a0 con 0x7f3eb40b1f40 2024-09-13T18:47:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40b7c50 con 0x7f3eb40b1f40 2024-09-13T18:47:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011b50 con 0x7f3eb40b1f40 2024-09-13T18:47:42.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb40b8210 con 0x7f3eb40b1f40 2024-09-13T18:47:42.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7fc26f200700 1 Processor -- start 2024-09-13T18:47:42.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7fc26f200700 1 -- start start 2024-09-13T18:47:42.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.726+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40b83a0 con 0x7f3eb40b1f40 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc27006aaa0 0x7fc2700ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2700b2d80 0x7fc2701f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 0x7fc2701fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc27006aaa0 0x7fc2700ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc27006aaa0 0x7fc2700ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49524/0 (socket says 172.21.15.81:49524) 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2700b2d80 0x7fc2701f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2700b2d80 0x7fc2701f6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51470/0 (socket says 172.21.15.81:51470) 2024-09-13T18:47:42.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ea4011cb0 con 0x7f3eb40b1f40 2024-09-13T18:47:42.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7f3eae000700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e98066730 0x7f3e98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ea4083f00 con 0x7f3eb40b1f40 2024-09-13T18:47:42.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 0x7fc2701fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 0x7fc2701fa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47496/0 (socket says 172.21.15.81:47496) 2024-09-13T18:47:42.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7f3eb9e00700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e98066730 0x7f3e98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad3c052fb0 con 0x7fad4415d170 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26de00700 1 -- 172.21.15.81:0/3284914258 learned_addr learned my addr 172.21.15.81:0/3284914258 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701f6eb0 con 0x7fc2701610b0 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700ab570 con 0x7fc2700b2d80 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2701fadf0 con 0x7fc27006aaa0 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 -- 172.21.15.81:0/3284914258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc27006aaa0 msgr2=0x7fc2700ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc27006aaa0 0x7fc2700ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 -- 172.21.15.81:0/3284914258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2700b2d80 msgr2=0x7fc2701f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2700b2d80 0x7fc2701f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.730+0000 7fc26e800700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600094b0 con 0x7fc2701610b0 2024-09-13T18:47:42.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7fc26e800700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 0x7fc2701fa8b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc260016000 tx=0x7fc260004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.734+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ea4050f70 con 0x7f3eb40b1f40 2024-09-13T18:47:42.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7f3eb9e00700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e98066730 0x7f3e98068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8006fd0 tx=0x7f3ea8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260004240 con 0x7fc2701610b0 2024-09-13T18:47:42.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26001f070 con 0x7fc2701610b0 2024-09-13T18:47:42.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260004600 con 0x7fc2701610b0 2024-09-13T18:47:42.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2700aaf60 con 0x7fc2701610b0 2024-09-13T18:47:42.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.738+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2700ada30 con 0x7fc2701610b0 2024-09-13T18:47:42.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.742+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2700ab720 con 0x7fc2701610b0 2024-09-13T18:47:42.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.742+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc260021030 con 0x7fc2701610b0 2024-09-13T18:47:42.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.742+0000 7fc266000700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc250066780 0x7fc250068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.750+0000 7fc26de00700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc250066780 0x7fc250068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.750+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc260056890 con 0x7fc2701610b0 2024-09-13T18:47:42.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.750+0000 7fc26de00700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc250066780 0x7fc250068c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2680094c0 tx=0x7fc26800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.754+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2700ab720 con 0x7fc2701610b0 2024-09-13T18:47:42.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.950+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d6013d5b0 con 0x7f3d601439e0 2024-09-13T18:47:42.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.950+0000 7f3d56a00700 1 -- 172.21.15.81:0/3265165101 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d50020020 con 0x7f3d601439e0 2024-09-13T18:47:42.962 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:42.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d3c06ab40 msgr2=0x7f3d3c06d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d3c06ab40 0x7f3d3c06d000 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d48001940 tx=0x7f3d48009040 comp rx=0 tx=0).stop 2024-09-13T18:47:42.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d601439e0 msgr2=0x7f3d6013a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d601439e0 0x7f3d6013a800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3d50016000 tx=0x7f3d50004770 comp rx=0 tx=0).stop 2024-09-13T18:47:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 shutdown_connections 2024-09-13T18:47:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d3c06ab40 0x7f3d3c06d000 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d6015b250 0x7f3d6013d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d601439e0 0x7f3d6013a800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 --2- 172.21.15.81:0/3265165101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d6006a5a0 0x7f3d6015d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 >> 172.21.15.81:0/3265165101 conn(0x7f3d600b06f0 msgr2=0x7f3d6006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 shutdown_connections 2024-09-13T18:47:42.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:42.958+0000 7f3d65c00700 1 -- 172.21.15.81:0/3265165101 wait complete. 2024-09-13T18:47:42.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-09-13T18:47:42.994 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.006+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f4280005890 con 0x7f42a40c26f0 2024-09-13T18:47:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.006+0000 7f42a0c00700 1 -- 172.21.15.81:0/2326926727 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4290015020 con 0x7f42a40c26f0 2024-09-13T18:47:43.016 INFO:teuthology.orchestra.run.smithi081.stdout:55834574859 2024-09-13T18:47:43.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4284066730 msgr2=0x7f4284068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4284066730 0x7f4284068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42a40c2070 tx=0x7f4298009240 comp rx=0 tx=0).stop 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 msgr2=0x7f42a40b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 0x7f42a40b0300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4290016000 tx=0x7f4290004770 comp rx=0 tx=0).stop 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 shutdown_connections 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4284066730 0x7f4284068bf0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42a40c2070 tx=0x7f4298009240 comp rx=0 tx=0).stop 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a40ce070 0x7f42a40c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40c26f0 0x7f42a40b0300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 --2- 172.21.15.81:0/2326926727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40c2310 0x7f42a40b14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 >> 172.21.15.81:0/2326926727 conn(0x7f42a40cf0d0 msgr2=0x7f42a40ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 shutdown_connections 2024-09-13T18:47:43.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.010+0000 7f4296000700 1 -- 172.21.15.81:0/2326926727 wait complete. 2024-09-13T18:47:43.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.014+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc6901606b0 con 0x7fc6900c3a40 2024-09-13T18:47:43.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.018+0000 7fc686000700 1 -- 172.21.15.81:0/715675631 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc688054e20 con 0x7fc6900c3a40 2024-09-13T18:47:43.027 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:43.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.018+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f50b80b3990 con 0x7f50b8162c30 2024-09-13T18:47:43.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.018+0000 7f50af400700 1 -- 172.21.15.81:0/2463821412 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50b0056250 con 0x7f50b8162c30 2024-09-13T18:47:43.029 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:43.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6700667b0 msgr2=0x7fc670068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6700667b0 0x7fc670068c70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc67c0045f0 tx=0x7fc67c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:43.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6900c3a40 msgr2=0x7fc6900c3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6900c3a40 0x7fc6900c3ef0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc69006aef0 tx=0x7fc6880114b0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 shutdown_connections 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc6700667b0 0x7fc670068c70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6900c3a40 0x7fc6900c3ef0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6900c7e10 0x7fc6900c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 --2- 172.21.15.81:0/715675631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc690161230 0x7fc6900cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 >> 172.21.15.81:0/715675631 conn(0x7fc69006a390 msgr2=0x7fc6900ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 shutdown_connections 2024-09-13T18:47:43.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.022+0000 7fc68f200700 1 -- 172.21.15.81:0/715675631 wait complete. 2024-09-13T18:47:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5098066730 msgr2=0x7f5098068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5098066730 0x7f5098068bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f50a80098e0 tx=0x7f50a80094e0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 msgr2=0x7f50b81630c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 0x7f50b81630c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f50b8071bd0 tx=0x7f50b0001330 comp rx=0 tx=0).stop 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 shutdown_connections 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5098066730 0x7f5098068bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b8162c30 0x7f50b81630c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50b8157bb0 0x7f50b8157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 --2- 172.21.15.81:0/2463821412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f509c005280 0x7f50b80b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 >> 172.21.15.81:0/2463821412 conn(0x7f50b8070d10 msgr2=0x7f50b80b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 shutdown_connections 2024-09-13T18:47:43.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.026+0000 7f50bd000700 1 -- 172.21.15.81:0/2463821412 wait complete. 2024-09-13T18:47:43.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-09-13T18:47:43.039 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.030+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f369006d880 con 0x7f36900cb200 2024-09-13T18:47:43.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.030+0000 7f3687400700 1 -- 172.21.15.81:0/1895936770 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f367c015090 con 0x7f36900cb200 2024-09-13T18:47:43.042 INFO:teuthology.orchestra.run.smithi081.stdout:55834574858 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3670066730 msgr2=0x7f3670068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3670066730 0x7f3670068bf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36800014a0 tx=0x7f3680001430 comp rx=0 tx=0).stop 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36900cb200 msgr2=0x7f369015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36900cb200 0x7f369015c400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f367c00b3e0 tx=0x7f367c00b6f0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 shutdown_connections 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3670066730 0x7f3670068bf0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f36800014a0 tx=0x7f3680001430 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36900ccfd0 0x7f369015c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36900cb200 0x7f369015c400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 --2- 172.21.15.81:0/1895936770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f369006e0a0 0x7f369009c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 >> 172.21.15.81:0/1895936770 conn(0x7f36900cf0d0 msgr2=0x7f36900abea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 shutdown_connections 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.034+0000 7f3694e00700 1 -- 172.21.15.81:0/1895936770 wait complete. 2024-09-13T18:47:43.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-09-13T18:47:43.054 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-09-13T18:47:43.059 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-09-13T18:47:43.066 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.062+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3eb40d1230 con 0x7f3eb40b1f40 2024-09-13T18:47:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.062+0000 7f3eae000700 1 -- 172.21.15.81:0/3839362301 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ea4054590 con 0x7f3eb40b1f40 2024-09-13T18:47:43.073 INFO:teuthology.orchestra.run.smithi081.stdout:55834574860 2024-09-13T18:47:43.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e98066730 msgr2=0x7f3e98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e98066730 0x7f3e98068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8006fd0 tx=0x7f3ea8008040 comp rx=0 tx=0).stop 2024-09-13T18:47:43.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40b1f40 msgr2=0x7f3eb40b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40b1f40 0x7f3eb40b6ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3eb408b260 tx=0x7f3ea400b6c0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 shutdown_connections 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e98066730 0x7f3e98068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb40d3880 0x7f3eb40b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3eb40b1f40 0x7f3eb40b6ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 --2- 172.21.15.81:0/3839362301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb406bd40 0x7f3eb41f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 >> 172.21.15.81:0/3839362301 conn(0x7f3eb40d2c10 msgr2=0x7f3eb40cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 shutdown_connections 2024-09-13T18:47:43.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.066+0000 7f3ebb200700 1 -- 172.21.15.81:0/3839362301 wait complete. 2024-09-13T18:47:43.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.070+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad440cdc10 con 0x7fad4415d170 2024-09-13T18:47:43.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.070+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2700ab720 con 0x7fc2701610b0 2024-09-13T18:47:43.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.070+0000 7fad3aa00700 1 -- 172.21.15.81:0/2959380696 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad3c053150 con 0x7fad4415d170 2024-09-13T18:47:43.080 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:43.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.070+0000 7fc266000700 1 -- 172.21.15.81:0/3284914258 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2700ab720 con 0x7fc2701610b0 2024-09-13T18:47:43.081 INFO:teuthology.orchestra.run.smithi081.stdout:55834574857 2024-09-13T18:47:43.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc250066780 msgr2=0x7fc250068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc250066780 0x7fc250068c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2680094c0 tx=0x7fc26800b040 comp rx=0 tx=0).stop 2024-09-13T18:47:43.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 msgr2=0x7fc2701fa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 0x7fc2701fa8b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc260016000 tx=0x7fc260004770 comp rx=0 tx=0).stop 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 shutdown_connections 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc250066780 0x7fc250068c40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2701610b0 0x7fc2701fa8b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2700b2d80 0x7fc2701f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 --2- 172.21.15.81:0/3284914258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc27006aaa0 0x7fc2700ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 >> 172.21.15.81:0/3284914258 conn(0x7fc2700b0c40 msgr2=0x7fc27006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 shutdown_connections 2024-09-13T18:47:43.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fc26f200700 1 -- 172.21.15.81:0/3284914258 wait complete. 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad20066780 msgr2=0x7fad20068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad20066780 0x7fad20068c40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad34001560 tx=0x7fad34009040 comp rx=0 tx=0).stop 2024-09-13T18:47:43.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 msgr2=0x7fad440b8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 0x7fad440b8400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fad4408d140 tx=0x7fad3c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 shutdown_connections 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad20066780 0x7fad20068c40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad4415d170 0x7fad440b8400 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad4415cd90 0x7fad440b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 --2- 172.21.15.81:0/2959380696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad440cdfe0 0x7fad441f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 >> 172.21.15.81:0/2959380696 conn(0x7fad440d2c10 msgr2=0x7fad440b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 shutdown_connections 2024-09-13T18:47:43.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.074+0000 7fad43200700 1 -- 172.21.15.81:0/2959380696 wait complete. 2024-09-13T18:47:43.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2024-09-13T18:47:43.097 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-09-13T18:47:43.102 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-09-13T18:47:43.107 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:43.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:47:43.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 Processor -- start 2024-09-13T18:47:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 -- start start 2024-09-13T18:47:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f277c160000 0x7f277c160770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c0b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c06d640 con 0x7f277c066090 2024-09-13T18:47:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c0b3af0 con 0x7f277c160000 2024-09-13T18:47:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.306+0000 7f277b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c160e70 con 0x7f277c0b3370 2024-09-13T18:47:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f277c066090 0x7f277c0b2c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47262/0 (socket says 172.21.15.81:47262) 2024-09-13T18:47:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779400700 1 -- 172.21.15.81:0/667569500 learned_addr learned my addr 172.21.15.81:0/667569500 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779e00700 1 --2- 172.21.15.81:0/667569500 >> v2:172.21.15.81:3300/0 conn(0x7f277c160000 0x7f277c160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277a800700 1 --2- 172.21.15.81:0/667569500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c0b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2778a00700 1 -- 172.21.15.81:0/667569500 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076857672 0 0) 0x7f277c06d640 con 0x7f277c066090 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2778a00700 1 -- 172.21.15.81:0/667569500 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27600035d0 con 0x7f277c066090 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779e00700 1 -- 172.21.15.81:0/667569500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 msgr2=0x7f277c0b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779e00700 1 --2- 172.21.15.81:0/667569500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c0b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779e00700 1 -- 172.21.15.81:0/667569500 >> v1:172.21.15.81:6789/0 conn(0x7f277c066090 legacy=0x7f277c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2778a00700 1 -- 172.21.15.81:0/667569500 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470467359 0 0) 0x7f27600035d0 con 0x7f277c066090 2024-09-13T18:47:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779e00700 1 -- 172.21.15.81:0/667569500 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c161710 con 0x7f277c160000 2024-09-13T18:47:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2779e00700 1 --2- 172.21.15.81:0/667569500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c160770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f276c009850 tx=0x7f276c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb93cfad7c3e6ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2778a00700 1 -- 172.21.15.81:0/667569500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2768001670 con 0x7f277c160000 2024-09-13T18:47:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2778a00700 1 -- 172.21.15.81:0/667569500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c004030 con 0x7f277c160000 2024-09-13T18:47:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f2778a00700 1 -- 172.21.15.81:0/667569500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c0043a0 con 0x7f277c160000 2024-09-13T18:47:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 -- 172.21.15.81:0/667569500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 msgr2=0x7f277c160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 --2- 172.21.15.81:0/667569500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c160770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f276c009850 tx=0x7f276c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 -- 172.21.15.81:0/667569500 shutdown_connections 2024-09-13T18:47:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 --2- 172.21.15.81:0/667569500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c0b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 --2- 172.21.15.81:0/667569500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c160770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 -- 172.21.15.81:0/667569500 >> 172.21.15.81:0/667569500 conn(0x7f277c06c8e0 msgr2=0x7f277c06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 -- 172.21.15.81:0/667569500 shutdown_connections 2024-09-13T18:47:43.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.310+0000 7f277b200700 1 -- 172.21.15.81:0/667569500 wait complete. 2024-09-13T18:47:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 Processor -- start 2024-09-13T18:47:43.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 -- start start 2024-09-13T18:47:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f277c066090 0x7f277c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c158640 con 0x7f277c160000 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c0ae130 con 0x7f277c066090 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c158890 con 0x7f277c0b3370 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c1540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47518/0 (socket says 172.21.15.81:47518) 2024-09-13T18:47:43.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 -- 172.21.15.81:0/1075283650 learned_addr learned my addr 172.21.15.81:0/1075283650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:43.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f2779e00700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f277c066090 0x7f277c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f2779400700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 -- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 msgr2=0x7f277c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 -- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f277c066090 msgr2=0x7f277c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f277c066090 0x7f277c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f277a800700 1 -- 172.21.15.81:0/1075283650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0094b0 con 0x7f277c160000 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.314+0000 7f2779400700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f277a800700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c1540d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f277400efc0 tx=0x7f277400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774009ba0 con 0x7f277c160000 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400f040 con 0x7f277c160000 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774014480 con 0x7f277c160000 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c158b70 con 0x7f277c160000 2024-09-13T18:47:43.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c1f3190 con 0x7f277c160000 2024-09-13T18:47:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c0677c0 con 0x7f277c160000 2024-09-13T18:47:43.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.318+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27740145e0 con 0x7f277c160000 2024-09-13T18:47:43.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.322+0000 7f2772000700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f275c066730 0x7f275c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.322+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2774084d10 con 0x7f277c160000 2024-09-13T18:47:43.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.322+0000 7f2779e00700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f275c066730 0x7f275c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.322+0000 7f2779e00700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f275c066730 0x7f275c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f276c0090b0 tx=0x7f276c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.326+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f277408a020 con 0x7f277c160000 2024-09-13T18:47:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.510+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f277c161430 con 0x7f275c066730 2024-09-13T18:47:43.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.522+0000 7f2772000700 1 -- 172.21.15.81:0/1075283650 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345083 (secure 0 0 0) 0x7f276c0042e0 con 0x7f275c066730 2024-09-13T18:47:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f275c066730 msgr2=0x7f275c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f275c066730 0x7f275c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f276c0090b0 tx=0x7f276c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 msgr2=0x7f277c1540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c1540d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f277400efc0 tx=0x7f277400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 shutdown_connections 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f275c066730 0x7f275c068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f277c160000 0x7f277c1540d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f277c0b3370 0x7f277c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 --2- 172.21.15.81:0/1075283650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f277c066090 0x7f277c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 >> 172.21.15.81:0/1075283650 conn(0x7f277c06c8e0 msgr2=0x7f277c0cc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 shutdown_connections 2024-09-13T18:47:43.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.534+0000 7f277b200700 1 -- 172.21.15.81:0/1075283650 wait complete. 2024-09-13T18:47:43.545 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:47:43.564 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-13T18:47:42.978456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227568,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747152,"statfs":{"total":773094113280,"available":772861083648,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004773"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491815+0000","last_change":"2024-09-13T18:47:14.995976+0000","last_active":"2024-09-13T18:47:19.491815+0000","last_peered":"2024-09-13T18:47:19.491815+0000","last_clean":"2024-09-13T18:47:19.491815+0000","last_became_active":"2024-09-13T18:47:14.995706+0000","last_became_peered":"2024-09-13T18:47:14.995706+0000","last_unstale":"2024-09-13T18:47:19.491815+0000","last_undegraded":"2024-09-13T18:47:19.491815+0000","last_fullsized":"2024-09-13T18:47:19.491815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:18.193015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487329+0000","last_change":"2024-09-13T18:47:15.484957+0000","last_active":"2024-09-13T18:47:19.487329+0000","last_peered":"2024-09-13T18:47:19.487329+0000","last_clean":"2024-09-13T18:47:19.487329+0000","last_became_active":"2024-09-13T18:47:15.484720+0000","last_became_peered":"2024-09-13T18:47:15.484720+0000","last_unstale":"2024-09-13T18:47:19.487329+0000","last_undegraded":"2024-09-13T18:47:19.487329+0000","last_fullsized":"2024-09-13T18:47:19.487329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961870+0000","last_change":"2024-09-13T18:47:19.593844+0000","last_active":"2024-09-13T18:47:19.961870+0000","last_peered":"2024-09-13T18:47:19.961870+0000","last_clean":"2024-09-13T18:47:19.961870+0000","last_became_active":"2024-09-13T18:47:19.591052+0000","last_became_peered":"2024-09-13T18:47:19.591052+0000","last_unstale":"2024-09-13T18:47:19.961870+0000","last_undegraded":"2024-09-13T18:47:19.961870+0000","last_fullsized":"2024-09-13T18:47:19.961870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:05.476346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487465+0000","last_change":"2024-09-13T18:47:14.991104+0000","last_active":"2024-09-13T18:47:19.487465+0000","last_peered":"2024-09-13T18:47:19.487465+0000","last_clean":"2024-09-13T18:47:19.487465+0000","last_became_active":"2024-09-13T18:47:14.990785+0000","last_became_peered":"2024-09-13T18:47:14.990785+0000","last_unstale":"2024-09-13T18:47:19.487465+0000","last_undegraded":"2024-09-13T18:47:19.487465+0000","last_fullsized":"2024-09-13T18:47:19.487465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.795074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491728+0000","last_change":"2024-09-13T18:47:15.478881+0000","last_active":"2024-09-13T18:47:19.491728+0000","last_peered":"2024-09-13T18:47:19.491728+0000","last_clean":"2024-09-13T18:47:19.491728+0000","last_became_active":"2024-09-13T18:47:15.478630+0000","last_became_peered":"2024-09-13T18:47:15.478630+0000","last_unstale":"2024-09-13T18:47:19.491728+0000","last_undegraded":"2024-09-13T18:47:19.491728+0000","last_fullsized":"2024-09-13T18:47:19.491728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:13.833360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089448+0000","last_change":"2024-09-13T18:47:19.506466+0000","last_active":"2024-09-13T18:47:20.089448+0000","last_peered":"2024-09-13T18:47:20.089448+0000","last_clean":"2024-09-13T18:47:20.089448+0000","last_became_active":"2024-09-13T18:47:19.505998+0000","last_became_peered":"2024-09-13T18:47:19.505998+0000","last_unstale":"2024-09-13T18:47:20.089448+0000","last_undegraded":"2024-09-13T18:47:20.089448+0000","last_fullsized":"2024-09-13T18:47:20.089448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:12.843575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592163+0000","last_change":"2024-09-13T18:47:15.007303+0000","last_active":"2024-09-13T18:47:19.592163+0000","last_peered":"2024-09-13T18:47:19.592163+0000","last_clean":"2024-09-13T18:47:19.592163+0000","last_became_active":"2024-09-13T18:47:15.006847+0000","last_became_peered":"2024-09-13T18:47:15.006847+0000","last_unstale":"2024-09-13T18:47:19.592163+0000","last_undegraded":"2024-09-13T18:47:19.592163+0000","last_fullsized":"2024-09-13T18:47:19.592163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:41.820844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489015+0000","last_change":"2024-09-13T18:47:15.482116+0000","last_active":"2024-09-13T18:47:19.489015+0000","last_peered":"2024-09-13T18:47:19.489015+0000","last_clean":"2024-09-13T18:47:19.489015+0000","last_became_active":"2024-09-13T18:47:15.481869+0000","last_became_peered":"2024-09-13T18:47:15.481869+0000","last_unstale":"2024-09-13T18:47:19.489015+0000","last_undegraded":"2024-09-13T18:47:19.489015+0000","last_fullsized":"2024-09-13T18:47:19.489015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089608+0000","last_change":"2024-09-13T18:47:19.509850+0000","last_active":"2024-09-13T18:47:20.089608+0000","last_peered":"2024-09-13T18:47:20.089608+0000","last_clean":"2024-09-13T18:47:20.089608+0000","last_became_active":"2024-09-13T18:47:19.509444+0000","last_became_peered":"2024-09-13T18:47:19.509444+0000","last_unstale":"2024-09-13T18:47:20.089608+0000","last_undegraded":"2024-09-13T18:47:20.089608+0000","last_fullsized":"2024-09-13T18:47:20.089608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591632+0000","last_change":"2024-09-13T18:47:15.002453+0000","last_active":"2024-09-13T18:47:19.591632+0000","last_peered":"2024-09-13T18:47:19.591632+0000","last_clean":"2024-09-13T18:47:19.591632+0000","last_became_active":"2024-09-13T18:47:15.002127+0000","last_became_peered":"2024-09-13T18:47:15.002127+0000","last_unstale":"2024-09-13T18:47:19.591632+0000","last_undegraded":"2024-09-13T18:47:19.591632+0000","last_fullsized":"2024-09-13T18:47:19.591632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:18.452266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490093+0000","last_change":"2024-09-13T18:47:15.477221+0000","last_active":"2024-09-13T18:47:19.490093+0000","last_peered":"2024-09-13T18:47:19.490093+0000","last_clean":"2024-09-13T18:47:19.490093+0000","last_became_active":"2024-09-13T18:47:15.475771+0000","last_became_peered":"2024-09-13T18:47:15.475771+0000","last_unstale":"2024-09-13T18:47:19.490093+0000","last_undegraded":"2024-09-13T18:47:19.490093+0000","last_fullsized":"2024-09-13T18:47:19.490093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090621+0000","last_change":"2024-09-13T18:47:19.513245+0000","last_active":"2024-09-13T18:47:20.090621+0000","last_peered":"2024-09-13T18:47:20.090621+0000","last_clean":"2024-09-13T18:47:20.090621+0000","last_became_active":"2024-09-13T18:47:19.512719+0000","last_became_peered":"2024-09-13T18:47:19.512719+0000","last_unstale":"2024-09-13T18:47:20.090621+0000","last_undegraded":"2024-09-13T18:47:20.090621+0000","last_fullsized":"2024-09-13T18:47:20.090621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499018+0000","last_change":"2024-09-13T18:47:15.481298+0000","last_active":"2024-09-13T18:47:19.499018+0000","last_peered":"2024-09-13T18:47:19.499018+0000","last_clean":"2024-09-13T18:47:19.499018+0000","last_became_active":"2024-09-13T18:47:15.481041+0000","last_became_peered":"2024-09-13T18:47:15.481041+0000","last_unstale":"2024-09-13T18:47:19.499018+0000","last_undegraded":"2024-09-13T18:47:19.499018+0000","last_fullsized":"2024-09-13T18:47:19.499018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592125+0000","last_change":"2024-09-13T18:47:15.004858+0000","last_active":"2024-09-13T18:47:19.592125+0000","last_peered":"2024-09-13T18:47:19.592125+0000","last_clean":"2024-09-13T18:47:19.592125+0000","last_became_active":"2024-09-13T18:47:15.004589+0000","last_became_peered":"2024-09-13T18:47:15.004589+0000","last_unstale":"2024-09-13T18:47:19.592125+0000","last_undegraded":"2024-09-13T18:47:19.592125+0000","last_fullsized":"2024-09-13T18:47:19.592125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093955+0000","last_change":"2024-09-13T18:47:19.514214+0000","last_active":"2024-09-13T18:47:20.093955+0000","last_peered":"2024-09-13T18:47:20.093955+0000","last_clean":"2024-09-13T18:47:20.093955+0000","last_became_active":"2024-09-13T18:47:19.513786+0000","last_became_peered":"2024-09-13T18:47:19.513786+0000","last_unstale":"2024-09-13T18:47:20.093955+0000","last_undegraded":"2024-09-13T18:47:20.093955+0000","last_fullsized":"2024-09-13T18:47:20.093955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:47.811667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487784+0000","last_change":"2024-09-13T18:47:15.472641+0000","last_active":"2024-09-13T18:47:19.487784+0000","last_peered":"2024-09-13T18:47:19.487784+0000","last_clean":"2024-09-13T18:47:19.487784+0000","last_became_active":"2024-09-13T18:47:15.472397+0000","last_became_peered":"2024-09-13T18:47:15.472397+0000","last_unstale":"2024-09-13T18:47:19.487784+0000","last_undegraded":"2024-09-13T18:47:19.487784+0000","last_fullsized":"2024-09-13T18:47:19.487784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493540+0000","last_change":"2024-09-13T18:47:14.983697+0000","last_active":"2024-09-13T18:47:19.493540+0000","last_peered":"2024-09-13T18:47:19.493540+0000","last_clean":"2024-09-13T18:47:19.493540+0000","last_became_active":"2024-09-13T18:47:14.983443+0000","last_became_peered":"2024-09-13T18:47:14.983443+0000","last_unstale":"2024-09-13T18:47:19.493540+0000","last_undegraded":"2024-09-13T18:47:19.493540+0000","last_fullsized":"2024-09-13T18:47:19.493540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089265+0000","last_change":"2024-09-13T18:47:19.511041+0000","last_active":"2024-09-13T18:47:20.089265+0000","last_peered":"2024-09-13T18:47:20.089265+0000","last_clean":"2024-09-13T18:47:20.089265+0000","last_became_active":"2024-09-13T18:47:19.510682+0000","last_became_peered":"2024-09-13T18:47:19.510682+0000","last_unstale":"2024-09-13T18:47:20.089265+0000","last_undegraded":"2024-09-13T18:47:20.089265+0000","last_fullsized":"2024-09-13T18:47:20.089265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487319+0000","last_change":"2024-09-13T18:47:15.487483+0000","last_active":"2024-09-13T18:47:19.487319+0000","last_peered":"2024-09-13T18:47:19.487319+0000","last_clean":"2024-09-13T18:47:19.487319+0000","last_became_active":"2024-09-13T18:47:15.481535+0000","last_became_peered":"2024-09-13T18:47:15.481535+0000","last_unstale":"2024-09-13T18:47:19.487319+0000","last_undegraded":"2024-09-13T18:47:19.487319+0000","last_fullsized":"2024-09-13T18:47:19.487319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492990+0000","last_change":"2024-09-13T18:47:14.995731+0000","last_active":"2024-09-13T18:47:19.492990+0000","last_peered":"2024-09-13T18:47:19.492990+0000","last_clean":"2024-09-13T18:47:19.492990+0000","last_became_active":"2024-09-13T18:47:14.995401+0000","last_became_peered":"2024-09-13T18:47:14.995401+0000","last_unstale":"2024-09-13T18:47:19.492990+0000","last_undegraded":"2024-09-13T18:47:19.492990+0000","last_fullsized":"2024-09-13T18:47:19.492990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083631+0000","last_change":"2024-09-13T18:47:19.594879+0000","last_active":"2024-09-13T18:47:20.083631+0000","last_peered":"2024-09-13T18:47:20.083631+0000","last_clean":"2024-09-13T18:47:20.083631+0000","last_became_active":"2024-09-13T18:47:19.594314+0000","last_became_peered":"2024-09-13T18:47:19.594314+0000","last_unstale":"2024-09-13T18:47:20.083631+0000","last_undegraded":"2024-09-13T18:47:20.083631+0000","last_fullsized":"2024-09-13T18:47:20.083631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492372+0000","last_change":"2024-09-13T18:47:15.463467+0000","last_active":"2024-09-13T18:47:19.492372+0000","last_peered":"2024-09-13T18:47:19.492372+0000","last_clean":"2024-09-13T18:47:19.492372+0000","last_became_active":"2024-09-13T18:47:15.463197+0000","last_became_peered":"2024-09-13T18:47:15.463197+0000","last_unstale":"2024-09-13T18:47:19.492372+0000","last_undegraded":"2024-09-13T18:47:19.492372+0000","last_fullsized":"2024-09-13T18:47:19.492372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:05.037494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591200+0000","last_change":"2024-09-13T18:47:15.007100+0000","last_active":"2024-09-13T18:47:19.591200+0000","last_peered":"2024-09-13T18:47:19.591200+0000","last_clean":"2024-09-13T18:47:19.591200+0000","last_became_active":"2024-09-13T18:47:15.002832+0000","last_became_peered":"2024-09-13T18:47:15.002832+0000","last_unstale":"2024-09-13T18:47:19.591200+0000","last_undegraded":"2024-09-13T18:47:19.591200+0000","last_fullsized":"2024-09-13T18:47:19.591200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093085+0000","last_change":"2024-09-13T18:47:19.512627+0000","last_active":"2024-09-13T18:47:20.093085+0000","last_peered":"2024-09-13T18:47:20.093085+0000","last_clean":"2024-09-13T18:47:20.093085+0000","last_became_active":"2024-09-13T18:47:19.512153+0000","last_became_peered":"2024-09-13T18:47:19.512153+0000","last_unstale":"2024-09-13T18:47:20.093085+0000","last_undegraded":"2024-09-13T18:47:20.093085+0000","last_fullsized":"2024-09-13T18:47:20.093085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491322+0000","last_change":"2024-09-13T18:47:15.475389+0000","last_active":"2024-09-13T18:47:19.491322+0000","last_peered":"2024-09-13T18:47:19.491322+0000","last_clean":"2024-09-13T18:47:19.491322+0000","last_became_active":"2024-09-13T18:47:15.475119+0000","last_became_peered":"2024-09-13T18:47:15.475119+0000","last_unstale":"2024-09-13T18:47:19.491322+0000","last_undegraded":"2024-09-13T18:47:19.491322+0000","last_fullsized":"2024-09-13T18:47:19.491322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501582+0000","last_change":"2024-09-13T18:47:15.002258+0000","last_active":"2024-09-13T18:47:19.501582+0000","last_peered":"2024-09-13T18:47:19.501582+0000","last_clean":"2024-09-13T18:47:19.501582+0000","last_became_active":"2024-09-13T18:47:15.001885+0000","last_became_peered":"2024-09-13T18:47:15.001885+0000","last_unstale":"2024-09-13T18:47:19.501582+0000","last_undegraded":"2024-09-13T18:47:19.501582+0000","last_fullsized":"2024-09-13T18:47:19.501582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089874+0000","last_change":"2024-09-13T18:47:19.600283+0000","last_active":"2024-09-13T18:47:20.089874+0000","last_peered":"2024-09-13T18:47:20.089874+0000","last_clean":"2024-09-13T18:47:20.089874+0000","last_became_active":"2024-09-13T18:47:19.598652+0000","last_became_peered":"2024-09-13T18:47:19.598652+0000","last_unstale":"2024-09-13T18:47:20.089874+0000","last_undegraded":"2024-09-13T18:47:20.089874+0000","last_fullsized":"2024-09-13T18:47:20.089874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:29.767904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488008+0000","last_change":"2024-09-13T18:47:15.472100+0000","last_active":"2024-09-13T18:47:19.488008+0000","last_peered":"2024-09-13T18:47:19.488008+0000","last_clean":"2024-09-13T18:47:19.488008+0000","last_became_active":"2024-09-13T18:47:15.470896+0000","last_became_peered":"2024-09-13T18:47:15.470896+0000","last_unstale":"2024-09-13T18:47:19.488008+0000","last_undegraded":"2024-09-13T18:47:19.488008+0000","last_fullsized":"2024-09-13T18:47:19.488008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.915538+0000","last_change":"2024-09-13T18:47:14.993205+0000","last_active":"2024-09-13T18:47:19.915538+0000","last_peered":"2024-09-13T18:47:19.915538+0000","last_clean":"2024-09-13T18:47:19.915538+0000","last_became_active":"2024-09-13T18:47:14.992192+0000","last_became_peered":"2024-09-13T18:47:14.992192+0000","last_unstale":"2024-09-13T18:47:19.915538+0000","last_undegraded":"2024-09-13T18:47:19.915538+0000","last_fullsized":"2024-09-13T18:47:19.915538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961562+0000","last_change":"2024-09-13T18:47:19.591216+0000","last_active":"2024-09-13T18:47:19.961562+0000","last_peered":"2024-09-13T18:47:19.961562+0000","last_clean":"2024-09-13T18:47:19.961562+0000","last_became_active":"2024-09-13T18:47:19.590770+0000","last_became_peered":"2024-09-13T18:47:19.590770+0000","last_unstale":"2024-09-13T18:47:19.961562+0000","last_undegraded":"2024-09-13T18:47:19.961562+0000","last_fullsized":"2024-09-13T18:47:19.961562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:46.641313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496179+0000","last_change":"2024-09-13T18:47:15.460995+0000","last_active":"2024-09-13T18:47:19.496179+0000","last_peered":"2024-09-13T18:47:19.496179+0000","last_clean":"2024-09-13T18:47:19.496179+0000","last_became_active":"2024-09-13T18:47:15.460641+0000","last_became_peered":"2024-09-13T18:47:15.460641+0000","last_unstale":"2024-09-13T18:47:19.496179+0000","last_undegraded":"2024-09-13T18:47:19.496179+0000","last_fullsized":"2024-09-13T18:47:19.496179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592272+0000","last_change":"2024-09-13T18:47:15.010681+0000","last_active":"2024-09-13T18:47:19.592272+0000","last_peered":"2024-09-13T18:47:19.592272+0000","last_clean":"2024-09-13T18:47:19.592272+0000","last_became_active":"2024-09-13T18:47:15.010462+0000","last_became_peered":"2024-09-13T18:47:15.010462+0000","last_unstale":"2024-09-13T18:47:19.592272+0000","last_undegraded":"2024-09-13T18:47:19.592272+0000","last_fullsized":"2024-09-13T18:47:19.592272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961765+0000","last_change":"2024-09-13T18:47:19.592197+0000","last_active":"2024-09-13T18:47:19.961765+0000","last_peered":"2024-09-13T18:47:19.961765+0000","last_clean":"2024-09-13T18:47:19.961765+0000","last_became_active":"2024-09-13T18:47:19.591271+0000","last_became_peered":"2024-09-13T18:47:19.591271+0000","last_unstale":"2024-09-13T18:47:19.961765+0000","last_undegraded":"2024-09-13T18:47:19.961765+0000","last_fullsized":"2024-09-13T18:47:19.961765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489858+0000","last_change":"2024-09-13T18:47:15.477286+0000","last_active":"2024-09-13T18:47:19.489858+0000","last_peered":"2024-09-13T18:47:19.489858+0000","last_clean":"2024-09-13T18:47:19.489858+0000","last_became_active":"2024-09-13T18:47:15.477017+0000","last_became_peered":"2024-09-13T18:47:15.477017+0000","last_unstale":"2024-09-13T18:47:19.489858+0000","last_undegraded":"2024-09-13T18:47:19.489858+0000","last_fullsized":"2024-09-13T18:47:19.489858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496254+0000","last_change":"2024-09-13T18:47:14.979483+0000","last_active":"2024-09-13T18:47:19.496254+0000","last_peered":"2024-09-13T18:47:19.496254+0000","last_clean":"2024-09-13T18:47:19.496254+0000","last_became_active":"2024-09-13T18:47:14.979179+0000","last_became_peered":"2024-09-13T18:47:14.979179+0000","last_unstale":"2024-09-13T18:47:19.496254+0000","last_undegraded":"2024-09-13T18:47:19.496254+0000","last_fullsized":"2024-09-13T18:47:19.496254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.082807+0000","last_change":"2024-09-13T18:47:19.515192+0000","last_active":"2024-09-13T18:47:20.082807+0000","last_peered":"2024-09-13T18:47:20.082807+0000","last_clean":"2024-09-13T18:47:20.082807+0000","last_became_active":"2024-09-13T18:47:19.514784+0000","last_became_peered":"2024-09-13T18:47:19.514784+0000","last_unstale":"2024-09-13T18:47:20.082807+0000","last_undegraded":"2024-09-13T18:47:20.082807+0000","last_fullsized":"2024-09-13T18:47:20.082807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498864+0000","last_change":"2024-09-13T18:47:15.475155+0000","last_active":"2024-09-13T18:47:19.498864+0000","last_peered":"2024-09-13T18:47:19.498864+0000","last_clean":"2024-09-13T18:47:19.498864+0000","last_became_active":"2024-09-13T18:47:15.472919+0000","last_became_peered":"2024-09-13T18:47:15.472919+0000","last_unstale":"2024-09-13T18:47:19.498864+0000","last_undegraded":"2024-09-13T18:47:19.498864+0000","last_fullsized":"2024-09-13T18:47:19.498864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:42.832696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489690+0000","last_change":"2024-09-13T18:47:14.989036+0000","last_active":"2024-09-13T18:47:19.489690+0000","last_peered":"2024-09-13T18:47:19.489690+0000","last_clean":"2024-09-13T18:47:19.489690+0000","last_became_active":"2024-09-13T18:47:14.988570+0000","last_became_peered":"2024-09-13T18:47:14.988570+0000","last_unstale":"2024-09-13T18:47:19.489690+0000","last_undegraded":"2024-09-13T18:47:19.489690+0000","last_fullsized":"2024-09-13T18:47:19.489690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083437+0000","last_change":"2024-09-13T18:47:19.517431+0000","last_active":"2024-09-13T18:47:20.083437+0000","last_peered":"2024-09-13T18:47:20.083437+0000","last_clean":"2024-09-13T18:47:20.083437+0000","last_became_active":"2024-09-13T18:47:19.517085+0000","last_became_peered":"2024-09-13T18:47:19.517085+0000","last_unstale":"2024-09-13T18:47:20.083437+0000","last_undegraded":"2024-09-13T18:47:20.083437+0000","last_fullsized":"2024-09-13T18:47:20.083437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492896+0000","last_change":"2024-09-13T18:47:15.467657+0000","last_active":"2024-09-13T18:47:19.492896+0000","last_peered":"2024-09-13T18:47:19.492896+0000","last_clean":"2024-09-13T18:47:19.492896+0000","last_became_active":"2024-09-13T18:47:15.467436+0000","last_became_peered":"2024-09-13T18:47:15.467436+0000","last_unstale":"2024-09-13T18:47:19.492896+0000","last_undegraded":"2024-09-13T18:47:19.492896+0000","last_fullsized":"2024-09-13T18:47:19.492896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498237+0000","last_change":"2024-09-13T18:47:14.987619+0000","last_active":"2024-09-13T18:47:19.498237+0000","last_peered":"2024-09-13T18:47:19.498237+0000","last_clean":"2024-09-13T18:47:19.498237+0000","last_became_active":"2024-09-13T18:47:14.987294+0000","last_became_peered":"2024-09-13T18:47:14.987294+0000","last_unstale":"2024-09-13T18:47:19.498237+0000","last_undegraded":"2024-09-13T18:47:19.498237+0000","last_fullsized":"2024-09-13T18:47:19.498237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083730+0000","last_change":"2024-09-13T18:47:19.512260+0000","last_active":"2024-09-13T18:47:20.083730+0000","last_peered":"2024-09-13T18:47:20.083730+0000","last_clean":"2024-09-13T18:47:20.083730+0000","last_became_active":"2024-09-13T18:47:19.511869+0000","last_became_peered":"2024-09-13T18:47:19.511869+0000","last_unstale":"2024-09-13T18:47:20.083730+0000","last_undegraded":"2024-09-13T18:47:20.083730+0000","last_fullsized":"2024-09-13T18:47:20.083730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.483967+0000","last_change":"2024-09-13T18:47:15.469232+0000","last_active":"2024-09-13T18:47:19.483967+0000","last_peered":"2024-09-13T18:47:19.483967+0000","last_clean":"2024-09-13T18:47:19.483967+0000","last_became_active":"2024-09-13T18:47:15.469087+0000","last_became_peered":"2024-09-13T18:47:15.469087+0000","last_unstale":"2024-09-13T18:47:19.483967+0000","last_undegraded":"2024-09-13T18:47:19.483967+0000","last_fullsized":"2024-09-13T18:47:19.483967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591340+0000","last_change":"2024-09-13T18:47:15.007648+0000","last_active":"2024-09-13T18:47:19.591340+0000","last_peered":"2024-09-13T18:47:19.591340+0000","last_clean":"2024-09-13T18:47:19.591340+0000","last_became_active":"2024-09-13T18:47:15.006632+0000","last_became_peered":"2024-09-13T18:47:15.006632+0000","last_unstale":"2024-09-13T18:47:19.591340+0000","last_undegraded":"2024-09-13T18:47:19.591340+0000","last_fullsized":"2024-09-13T18:47:19.591340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963378+0000","last_change":"2024-09-13T18:47:19.591686+0000","last_active":"2024-09-13T18:47:19.963378+0000","last_peered":"2024-09-13T18:47:19.963378+0000","last_clean":"2024-09-13T18:47:19.963378+0000","last_became_active":"2024-09-13T18:47:19.590830+0000","last_became_peered":"2024-09-13T18:47:19.590830+0000","last_unstale":"2024-09-13T18:47:19.963378+0000","last_undegraded":"2024-09-13T18:47:19.963378+0000","last_fullsized":"2024-09-13T18:47:19.963378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487530+0000","last_change":"2024-09-13T18:47:15.480640+0000","last_active":"2024-09-13T18:47:19.487530+0000","last_peered":"2024-09-13T18:47:19.487530+0000","last_clean":"2024-09-13T18:47:19.487530+0000","last_became_active":"2024-09-13T18:47:15.480343+0000","last_became_peered":"2024-09-13T18:47:15.480343+0000","last_unstale":"2024-09-13T18:47:19.487530+0000","last_undegraded":"2024-09-13T18:47:19.487530+0000","last_fullsized":"2024-09-13T18:47:19.487530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488746+0000","last_change":"2024-09-13T18:47:14.993847+0000","last_active":"2024-09-13T18:47:19.488746+0000","last_peered":"2024-09-13T18:47:19.488746+0000","last_clean":"2024-09-13T18:47:19.488746+0000","last_became_active":"2024-09-13T18:47:14.993582+0000","last_became_peered":"2024-09-13T18:47:14.993582+0000","last_unstale":"2024-09-13T18:47:19.488746+0000","last_undegraded":"2024-09-13T18:47:19.488746+0000","last_fullsized":"2024-09-13T18:47:19.488746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591343+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:47:19.591343+0000","last_peered":"2024-09-13T18:47:19.591343+0000","last_clean":"2024-09-13T18:47:19.591343+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:47:19.591343+0000","last_undegraded":"2024-09-13T18:47:19.591343+0000","last_fullsized":"2024-09-13T18:47:19.591343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092727+0000","last_change":"2024-09-13T18:47:19.599505+0000","last_active":"2024-09-13T18:47:20.092727+0000","last_peered":"2024-09-13T18:47:20.092727+0000","last_clean":"2024-09-13T18:47:20.092727+0000","last_became_active":"2024-09-13T18:47:19.599105+0000","last_became_peered":"2024-09-13T18:47:19.599105+0000","last_unstale":"2024-09-13T18:47:20.092727+0000","last_undegraded":"2024-09-13T18:47:20.092727+0000","last_fullsized":"2024-09-13T18:47:20.092727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:44.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591948+0000","last_change":"2024-09-13T18:47:15.491819+0000","last_active":"2024-09-13T18:47:19.591948+0000","last_peered":"2024-09-13T18:47:19.591948+0000","last_clean":"2024-09-13T18:47:19.591948+0000","last_became_active":"2024-09-13T18:47:15.491497+0000","last_became_peered":"2024-09-13T18:47:15.491497+0000","last_unstale":"2024-09-13T18:47:19.591948+0000","last_undegraded":"2024-09-13T18:47:19.591948+0000","last_fullsized":"2024-09-13T18:47:19.591948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498674+0000","last_change":"2024-09-13T18:47:14.990404+0000","last_active":"2024-09-13T18:47:19.498674+0000","last_peered":"2024-09-13T18:47:19.498674+0000","last_clean":"2024-09-13T18:47:19.498674+0000","last_became_active":"2024-09-13T18:47:14.990115+0000","last_became_peered":"2024-09-13T18:47:14.990115+0000","last_unstale":"2024-09-13T18:47:19.498674+0000","last_undegraded":"2024-09-13T18:47:19.498674+0000","last_fullsized":"2024-09-13T18:47:19.498674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.088631+0000","last_change":"2024-09-13T18:47:19.594274+0000","last_active":"2024-09-13T18:47:20.088631+0000","last_peered":"2024-09-13T18:47:20.088631+0000","last_clean":"2024-09-13T18:47:20.088631+0000","last_became_active":"2024-09-13T18:47:19.593700+0000","last_became_peered":"2024-09-13T18:47:19.593700+0000","last_unstale":"2024-09-13T18:47:20.088631+0000","last_undegraded":"2024-09-13T18:47:20.088631+0000","last_fullsized":"2024-09-13T18:47:20.088631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489145+0000","last_change":"2024-09-13T18:47:15.478629+0000","last_active":"2024-09-13T18:47:19.489145+0000","last_peered":"2024-09-13T18:47:19.489145+0000","last_clean":"2024-09-13T18:47:19.489145+0000","last_became_active":"2024-09-13T18:47:15.476132+0000","last_became_peered":"2024-09-13T18:47:15.476132+0000","last_unstale":"2024-09-13T18:47:19.489145+0000","last_undegraded":"2024-09-13T18:47:19.489145+0000","last_fullsized":"2024-09-13T18:47:19.489145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493042+0000","last_change":"2024-09-13T18:47:14.995147+0000","last_active":"2024-09-13T18:47:19.493042+0000","last_peered":"2024-09-13T18:47:19.493042+0000","last_clean":"2024-09-13T18:47:19.493042+0000","last_became_active":"2024-09-13T18:47:14.994931+0000","last_became_peered":"2024-09-13T18:47:14.994931+0000","last_unstale":"2024-09-13T18:47:19.493042+0000","last_undegraded":"2024-09-13T18:47:19.493042+0000","last_fullsized":"2024-09-13T18:47:19.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961957+0000","last_change":"2024-09-13T18:47:19.510647+0000","last_active":"2024-09-13T18:47:19.961957+0000","last_peered":"2024-09-13T18:47:19.961957+0000","last_clean":"2024-09-13T18:47:19.961957+0000","last_became_active":"2024-09-13T18:47:19.508746+0000","last_became_peered":"2024-09-13T18:47:19.508746+0000","last_unstale":"2024-09-13T18:47:19.961957+0000","last_undegraded":"2024-09-13T18:47:19.961957+0000","last_fullsized":"2024-09-13T18:47:19.961957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592399+0000","last_change":"2024-09-13T18:47:15.494681+0000","last_active":"2024-09-13T18:47:19.592399+0000","last_peered":"2024-09-13T18:47:19.592399+0000","last_clean":"2024-09-13T18:47:19.592399+0000","last_became_active":"2024-09-13T18:47:15.490395+0000","last_became_peered":"2024-09-13T18:47:15.490395+0000","last_unstale":"2024-09-13T18:47:19.592399+0000","last_undegraded":"2024-09-13T18:47:19.592399+0000","last_fullsized":"2024-09-13T18:47:19.592399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499936+0000","last_change":"2024-09-13T18:47:14.992959+0000","last_active":"2024-09-13T18:47:19.499936+0000","last_peered":"2024-09-13T18:47:19.499936+0000","last_clean":"2024-09-13T18:47:19.499936+0000","last_became_active":"2024-09-13T18:47:14.989696+0000","last_became_peered":"2024-09-13T18:47:14.989696+0000","last_unstale":"2024-09-13T18:47:19.499936+0000","last_undegraded":"2024-09-13T18:47:19.499936+0000","last_fullsized":"2024-09-13T18:47:19.499936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092955+0000","last_change":"2024-09-13T18:47:19.594315+0000","last_active":"2024-09-13T18:47:20.092955+0000","last_peered":"2024-09-13T18:47:20.092955+0000","last_clean":"2024-09-13T18:47:20.092955+0000","last_became_active":"2024-09-13T18:47:19.593856+0000","last_became_peered":"2024-09-13T18:47:19.593856+0000","last_unstale":"2024-09-13T18:47:20.092955+0000","last_undegraded":"2024-09-13T18:47:20.092955+0000","last_fullsized":"2024-09-13T18:47:20.092955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592241+0000","last_change":"2024-09-13T18:47:15.493079+0000","last_active":"2024-09-13T18:47:19.592241+0000","last_peered":"2024-09-13T18:47:19.592241+0000","last_clean":"2024-09-13T18:47:19.592241+0000","last_became_active":"2024-09-13T18:47:15.492647+0000","last_became_peered":"2024-09-13T18:47:15.492647+0000","last_unstale":"2024-09-13T18:47:19.592241+0000","last_undegraded":"2024-09-13T18:47:19.592241+0000","last_fullsized":"2024-09-13T18:47:19.592241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:55.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.494245+0000","last_change":"2024-09-13T18:47:15.001931+0000","last_active":"2024-09-13T18:47:19.494245+0000","last_peered":"2024-09-13T18:47:19.494245+0000","last_clean":"2024-09-13T18:47:19.494245+0000","last_became_active":"2024-09-13T18:47:15.001488+0000","last_became_peered":"2024-09-13T18:47:15.001488+0000","last_unstale":"2024-09-13T18:47:19.494245+0000","last_undegraded":"2024-09-13T18:47:19.494245+0000","last_fullsized":"2024-09-13T18:47:19.494245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.883156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089502+0000","last_change":"2024-09-13T18:47:19.507944+0000","last_active":"2024-09-13T18:47:20.089502+0000","last_peered":"2024-09-13T18:47:20.089502+0000","last_clean":"2024-09-13T18:47:20.089502+0000","last_became_active":"2024-09-13T18:47:19.506708+0000","last_became_peered":"2024-09-13T18:47:19.506708+0000","last_unstale":"2024-09-13T18:47:20.089502+0000","last_undegraded":"2024-09-13T18:47:20.089502+0000","last_fullsized":"2024-09-13T18:47:20.089502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:12.199448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591479+0000","last_change":"2024-09-13T18:47:15.482887+0000","last_active":"2024-09-13T18:47:19.591479+0000","last_peered":"2024-09-13T18:47:19.591479+0000","last_clean":"2024-09-13T18:47:19.591479+0000","last_became_active":"2024-09-13T18:47:15.482616+0000","last_became_peered":"2024-09-13T18:47:15.482616+0000","last_unstale":"2024-09-13T18:47:19.591479+0000","last_undegraded":"2024-09-13T18:47:19.591479+0000","last_fullsized":"2024-09-13T18:47:19.591479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:44.301458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499180+0000","last_change":"2024-09-13T18:47:14.983612+0000","last_active":"2024-09-13T18:47:19.499180+0000","last_peered":"2024-09-13T18:47:19.499180+0000","last_clean":"2024-09-13T18:47:19.499180+0000","last_became_active":"2024-09-13T18:47:14.983354+0000","last_became_peered":"2024-09-13T18:47:14.983354+0000","last_unstale":"2024-09-13T18:47:19.499180+0000","last_undegraded":"2024-09-13T18:47:19.499180+0000","last_fullsized":"2024-09-13T18:47:19.499180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963361+0000","last_change":"2024-09-13T18:47:19.504797+0000","last_active":"2024-09-13T18:47:19.963361+0000","last_peered":"2024-09-13T18:47:19.963361+0000","last_clean":"2024-09-13T18:47:19.963361+0000","last_became_active":"2024-09-13T18:47:19.504472+0000","last_became_peered":"2024-09-13T18:47:19.504472+0000","last_unstale":"2024-09-13T18:47:19.963361+0000","last_undegraded":"2024-09-13T18:47:19.963361+0000","last_fullsized":"2024-09-13T18:47:19.963361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495782+0000","last_change":"2024-09-13T18:47:15.469363+0000","last_active":"2024-09-13T18:47:19.495782+0000","last_peered":"2024-09-13T18:47:19.495782+0000","last_clean":"2024-09-13T18:47:19.495782+0000","last_became_active":"2024-09-13T18:47:15.468718+0000","last_became_peered":"2024-09-13T18:47:15.468718+0000","last_unstale":"2024-09-13T18:47:19.495782+0000","last_undegraded":"2024-09-13T18:47:19.495782+0000","last_fullsized":"2024-09-13T18:47:19.495782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499734+0000","last_change":"2024-09-13T18:47:15.006188+0000","last_active":"2024-09-13T18:47:19.499734+0000","last_peered":"2024-09-13T18:47:19.499734+0000","last_clean":"2024-09-13T18:47:19.499734+0000","last_became_active":"2024-09-13T18:47:15.003764+0000","last_became_peered":"2024-09-13T18:47:15.003764+0000","last_unstale":"2024-09-13T18:47:19.499734+0000","last_undegraded":"2024-09-13T18:47:19.499734+0000","last_fullsized":"2024-09-13T18:47:19.499734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962715+0000","last_change":"2024-09-13T18:47:19.597771+0000","last_active":"2024-09-13T18:47:19.962715+0000","last_peered":"2024-09-13T18:47:19.962715+0000","last_clean":"2024-09-13T18:47:19.962715+0000","last_became_active":"2024-09-13T18:47:19.597144+0000","last_became_peered":"2024-09-13T18:47:19.597144+0000","last_unstale":"2024-09-13T18:47:19.962715+0000","last_undegraded":"2024-09-13T18:47:19.962715+0000","last_fullsized":"2024-09-13T18:47:19.962715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.794670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592050+0000","last_change":"2024-09-13T18:47:15.484848+0000","last_active":"2024-09-13T18:47:19.592050+0000","last_peered":"2024-09-13T18:47:19.592050+0000","last_clean":"2024-09-13T18:47:19.592050+0000","last_became_active":"2024-09-13T18:47:15.484444+0000","last_became_peered":"2024-09-13T18:47:15.484444+0000","last_unstale":"2024-09-13T18:47:19.592050+0000","last_undegraded":"2024-09-13T18:47:19.592050+0000","last_fullsized":"2024-09-13T18:47:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489024+0000","last_change":"2024-09-13T18:47:14.991470+0000","last_active":"2024-09-13T18:47:19.489024+0000","last_peered":"2024-09-13T18:47:19.489024+0000","last_clean":"2024-09-13T18:47:19.489024+0000","last_became_active":"2024-09-13T18:47:14.991135+0000","last_became_peered":"2024-09-13T18:47:14.991135+0000","last_unstale":"2024-09-13T18:47:19.489024+0000","last_undegraded":"2024-09-13T18:47:19.489024+0000","last_fullsized":"2024-09-13T18:47:19.489024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962615+0000","last_change":"2024-09-13T18:47:19.593992+0000","last_active":"2024-09-13T18:47:19.962615+0000","last_peered":"2024-09-13T18:47:19.962615+0000","last_clean":"2024-09-13T18:47:19.962615+0000","last_became_active":"2024-09-13T18:47:19.591585+0000","last_became_peered":"2024-09-13T18:47:19.591585+0000","last_unstale":"2024-09-13T18:47:19.962615+0000","last_undegraded":"2024-09-13T18:47:19.962615+0000","last_fullsized":"2024-09-13T18:47:19.962615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:29.971970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487602+0000","last_change":"2024-09-13T18:47:15.463821+0000","last_active":"2024-09-13T18:47:19.487602+0000","last_peered":"2024-09-13T18:47:19.487602+0000","last_clean":"2024-09-13T18:47:19.487602+0000","last_became_active":"2024-09-13T18:47:15.463563+0000","last_became_peered":"2024-09-13T18:47:15.463563+0000","last_unstale":"2024-09-13T18:47:19.487602+0000","last_undegraded":"2024-09-13T18:47:19.487602+0000","last_fullsized":"2024-09-13T18:47:19.487602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488046+0000","last_change":"2024-09-13T18:47:14.990471+0000","last_active":"2024-09-13T18:47:19.488046+0000","last_peered":"2024-09-13T18:47:19.488046+0000","last_clean":"2024-09-13T18:47:19.488046+0000","last_became_active":"2024-09-13T18:47:14.990222+0000","last_became_peered":"2024-09-13T18:47:14.990222+0000","last_unstale":"2024-09-13T18:47:19.488046+0000","last_undegraded":"2024-09-13T18:47:19.488046+0000","last_fullsized":"2024-09-13T18:47:19.488046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093959+0000","last_change":"2024-09-13T18:47:19.594886+0000","last_active":"2024-09-13T18:47:20.093959+0000","last_peered":"2024-09-13T18:47:20.093959+0000","last_clean":"2024-09-13T18:47:20.093959+0000","last_became_active":"2024-09-13T18:47:19.593831+0000","last_became_peered":"2024-09-13T18:47:19.593831+0000","last_unstale":"2024-09-13T18:47:20.093959+0000","last_undegraded":"2024-09-13T18:47:20.093959+0000","last_fullsized":"2024-09-13T18:47:20.093959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:50.947334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591916+0000","last_change":"2024-09-13T18:47:15.495522+0000","last_active":"2024-09-13T18:47:19.591916+0000","last_peered":"2024-09-13T18:47:19.591916+0000","last_clean":"2024-09-13T18:47:19.591916+0000","last_became_active":"2024-09-13T18:47:15.495212+0000","last_became_peered":"2024-09-13T18:47:15.495212+0000","last_unstale":"2024-09-13T18:47:19.591916+0000","last_undegraded":"2024-09-13T18:47:19.591916+0000","last_fullsized":"2024-09-13T18:47:19.591916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:32.484198+0000","last_change":"2024-09-13T18:47:15.000232+0000","last_active":"2024-09-13T18:47:32.484198+0000","last_peered":"2024-09-13T18:47:32.484198+0000","last_clean":"2024-09-13T18:47:32.484198+0000","last_became_active":"2024-09-13T18:47:14.993720+0000","last_became_peered":"2024-09-13T18:47:14.993720+0000","last_unstale":"2024-09-13T18:47:32.484198+0000","last_undegraded":"2024-09-13T18:47:32.484198+0000","last_fullsized":"2024-09-13T18:47:32.484198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083179+0000","last_change":"2024-09-13T18:47:19.515199+0000","last_active":"2024-09-13T18:47:20.083179+0000","last_peered":"2024-09-13T18:47:20.083179+0000","last_clean":"2024-09-13T18:47:20.083179+0000","last_became_active":"2024-09-13T18:47:19.514767+0000","last_became_peered":"2024-09-13T18:47:19.514767+0000","last_unstale":"2024-09-13T18:47:20.083179+0000","last_undegraded":"2024-09-13T18:47:20.083179+0000","last_fullsized":"2024-09-13T18:47:20.083179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:12.518830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497412+0000","last_change":"2024-09-13T18:47:15.471819+0000","last_active":"2024-09-13T18:47:19.497412+0000","last_peered":"2024-09-13T18:47:19.497412+0000","last_clean":"2024-09-13T18:47:19.497412+0000","last_became_active":"2024-09-13T18:47:15.470912+0000","last_became_peered":"2024-09-13T18:47:15.470912+0000","last_unstale":"2024-09-13T18:47:19.497412+0000","last_undegraded":"2024-09-13T18:47:19.497412+0000","last_fullsized":"2024-09-13T18:47:19.497412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492949+0000","last_change":"2024-09-13T18:47:14.986030+0000","last_active":"2024-09-13T18:47:19.492949+0000","last_peered":"2024-09-13T18:47:19.492949+0000","last_clean":"2024-09-13T18:47:19.492949+0000","last_became_active":"2024-09-13T18:47:14.984931+0000","last_became_peered":"2024-09-13T18:47:14.984931+0000","last_unstale":"2024-09-13T18:47:19.492949+0000","last_undegraded":"2024-09-13T18:47:19.492949+0000","last_fullsized":"2024-09-13T18:47:19.492949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089956+0000","last_change":"2024-09-13T18:47:19.507392+0000","last_active":"2024-09-13T18:47:20.089956+0000","last_peered":"2024-09-13T18:47:20.089956+0000","last_clean":"2024-09-13T18:47:20.089956+0000","last_became_active":"2024-09-13T18:47:19.506702+0000","last_became_peered":"2024-09-13T18:47:19.506702+0000","last_unstale":"2024-09-13T18:47:20.089956+0000","last_undegraded":"2024-09-13T18:47:20.089956+0000","last_fullsized":"2024-09-13T18:47:20.089956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491898+0000","last_change":"2024-09-13T18:47:15.478357+0000","last_active":"2024-09-13T18:47:19.491898+0000","last_peered":"2024-09-13T18:47:19.491898+0000","last_clean":"2024-09-13T18:47:19.491898+0000","last_became_active":"2024-09-13T18:47:15.471984+0000","last_became_peered":"2024-09-13T18:47:15.471984+0000","last_unstale":"2024-09-13T18:47:19.491898+0000","last_undegraded":"2024-09-13T18:47:19.491898+0000","last_fullsized":"2024-09-13T18:47:19.491898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:56.409431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489487+0000","last_change":"2024-09-13T18:47:14.994513+0000","last_active":"2024-09-13T18:47:19.489487+0000","last_peered":"2024-09-13T18:47:19.489487+0000","last_clean":"2024-09-13T18:47:19.489487+0000","last_became_active":"2024-09-13T18:47:14.994172+0000","last_became_peered":"2024-09-13T18:47:14.994172+0000","last_unstale":"2024-09-13T18:47:19.489487+0000","last_undegraded":"2024-09-13T18:47:19.489487+0000","last_fullsized":"2024-09-13T18:47:19.489487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961893+0000","last_change":"2024-09-13T18:47:19.503298+0000","last_active":"2024-09-13T18:47:19.961893+0000","last_peered":"2024-09-13T18:47:19.961893+0000","last_clean":"2024-09-13T18:47:19.961893+0000","last_became_active":"2024-09-13T18:47:19.502791+0000","last_became_peered":"2024-09-13T18:47:19.502791+0000","last_unstale":"2024-09-13T18:47:19.961893+0000","last_undegraded":"2024-09-13T18:47:19.961893+0000","last_fullsized":"2024-09-13T18:47:19.961893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:34.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489361+0000","last_change":"2024-09-13T18:47:15.478250+0000","last_active":"2024-09-13T18:47:19.489361+0000","last_peered":"2024-09-13T18:47:19.489361+0000","last_clean":"2024-09-13T18:47:19.489361+0000","last_became_active":"2024-09-13T18:47:15.477916+0000","last_became_peered":"2024-09-13T18:47:15.477916+0000","last_unstale":"2024-09-13T18:47:19.489361+0000","last_undegraded":"2024-09-13T18:47:19.489361+0000","last_fullsized":"2024-09-13T18:47:19.489361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501456+0000","last_change":"2024-09-13T18:47:14.992683+0000","last_active":"2024-09-13T18:47:19.501456+0000","last_peered":"2024-09-13T18:47:19.501456+0000","last_clean":"2024-09-13T18:47:19.501456+0000","last_became_active":"2024-09-13T18:47:14.992232+0000","last_became_peered":"2024-09-13T18:47:14.992232+0000","last_unstale":"2024-09-13T18:47:19.501456+0000","last_undegraded":"2024-09-13T18:47:19.501456+0000","last_fullsized":"2024-09-13T18:47:19.501456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962042+0000","last_change":"2024-09-13T18:47:19.596501+0000","last_active":"2024-09-13T18:47:19.962042+0000","last_peered":"2024-09-13T18:47:19.962042+0000","last_clean":"2024-09-13T18:47:19.962042+0000","last_became_active":"2024-09-13T18:47:19.590331+0000","last_became_peered":"2024-09-13T18:47:19.590331+0000","last_unstale":"2024-09-13T18:47:19.962042+0000","last_undegraded":"2024-09-13T18:47:19.962042+0000","last_fullsized":"2024-09-13T18:47:19.962042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:10.553259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961696+0000","last_change":"2024-09-13T18:47:19.596767+0000","last_active":"2024-09-13T18:47:19.961696+0000","last_peered":"2024-09-13T18:47:19.961696+0000","last_clean":"2024-09-13T18:47:19.961696+0000","last_became_active":"2024-09-13T18:47:19.595887+0000","last_became_peered":"2024-09-13T18:47:19.595887+0000","last_unstale":"2024-09-13T18:47:19.961696+0000","last_undegraded":"2024-09-13T18:47:19.961696+0000","last_fullsized":"2024-09-13T18:47:19.961696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492575+0000","last_change":"2024-09-13T18:47:15.471603+0000","last_active":"2024-09-13T18:47:19.492575+0000","last_peered":"2024-09-13T18:47:19.492575+0000","last_clean":"2024-09-13T18:47:19.492575+0000","last_became_active":"2024-09-13T18:47:15.471339+0000","last_became_peered":"2024-09-13T18:47:15.471339+0000","last_unstale":"2024-09-13T18:47:19.492575+0000","last_undegraded":"2024-09-13T18:47:19.492575+0000","last_fullsized":"2024-09-13T18:47:19.492575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489486+0000","last_change":"2024-09-13T18:47:14.987617+0000","last_active":"2024-09-13T18:47:19.489486+0000","last_peered":"2024-09-13T18:47:19.489486+0000","last_clean":"2024-09-13T18:47:19.489486+0000","last_became_active":"2024-09-13T18:47:14.987317+0000","last_became_peered":"2024-09-13T18:47:14.987317+0000","last_unstale":"2024-09-13T18:47:19.489486+0000","last_undegraded":"2024-09-13T18:47:19.489486+0000","last_fullsized":"2024-09-13T18:47:19.489486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090892+0000","last_change":"2024-09-13T18:47:19.509912+0000","last_active":"2024-09-13T18:47:20.090892+0000","last_peered":"2024-09-13T18:47:20.090892+0000","last_clean":"2024-09-13T18:47:20.090892+0000","last_became_active":"2024-09-13T18:47:19.509495+0000","last_became_peered":"2024-09-13T18:47:19.509495+0000","last_unstale":"2024-09-13T18:47:20.090892+0000","last_undegraded":"2024-09-13T18:47:20.090892+0000","last_fullsized":"2024-09-13T18:47:20.090892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:47.911959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487233+0000","last_change":"2024-09-13T18:47:15.471151+0000","last_active":"2024-09-13T18:47:19.487233+0000","last_peered":"2024-09-13T18:47:19.487233+0000","last_clean":"2024-09-13T18:47:19.487233+0000","last_became_active":"2024-09-13T18:47:15.470918+0000","last_became_peered":"2024-09-13T18:47:15.470918+0000","last_unstale":"2024-09-13T18:47:19.487233+0000","last_undegraded":"2024-09-13T18:47:19.487233+0000","last_fullsized":"2024-09-13T18:47:19.487233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488692+0000","last_change":"2024-09-13T18:47:14.991806+0000","last_active":"2024-09-13T18:47:19.488692+0000","last_peered":"2024-09-13T18:47:19.488692+0000","last_clean":"2024-09-13T18:47:19.488692+0000","last_became_active":"2024-09-13T18:47:14.991545+0000","last_became_peered":"2024-09-13T18:47:14.991545+0000","last_unstale":"2024-09-13T18:47:19.488692+0000","last_undegraded":"2024-09-13T18:47:19.488692+0000","last_fullsized":"2024-09-13T18:47:19.488692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500273+0000","last_change":"2024-09-13T18:47:14.999437+0000","last_active":"2024-09-13T18:47:19.500273+0000","last_peered":"2024-09-13T18:47:19.500273+0000","last_clean":"2024-09-13T18:47:19.500273+0000","last_became_active":"2024-09-13T18:47:14.993774+0000","last_became_peered":"2024-09-13T18:47:14.993774+0000","last_unstale":"2024-09-13T18:47:19.500273+0000","last_undegraded":"2024-09-13T18:47:19.500273+0000","last_fullsized":"2024-09-13T18:47:19.500273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487997+0000","last_change":"2024-09-13T18:47:15.459688+0000","last_active":"2024-09-13T18:47:19.487997+0000","last_peered":"2024-09-13T18:47:19.487997+0000","last_clean":"2024-09-13T18:47:19.487997+0000","last_became_active":"2024-09-13T18:47:15.459427+0000","last_became_peered":"2024-09-13T18:47:15.459427+0000","last_unstale":"2024-09-13T18:47:19.487997+0000","last_undegraded":"2024-09-13T18:47:19.487997+0000","last_fullsized":"2024-09-13T18:47:19.487997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.960515+0000","last_change":"2024-09-13T18:47:19.509191+0000","last_active":"2024-09-13T18:47:19.960515+0000","last_peered":"2024-09-13T18:47:19.960515+0000","last_clean":"2024-09-13T18:47:19.960515+0000","last_became_active":"2024-09-13T18:47:19.505978+0000","last_became_peered":"2024-09-13T18:47:19.505978+0000","last_unstale":"2024-09-13T18:47:19.960515+0000","last_undegraded":"2024-09-13T18:47:19.960515+0000","last_fullsized":"2024-09-13T18:47:19.960515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:54.531127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487778+0000","last_change":"2024-09-13T18:47:14.996586+0000","last_active":"2024-09-13T18:47:19.487778+0000","last_peered":"2024-09-13T18:47:19.487778+0000","last_clean":"2024-09-13T18:47:19.487778+0000","last_became_active":"2024-09-13T18:47:14.996310+0000","last_became_peered":"2024-09-13T18:47:14.996310+0000","last_unstale":"2024-09-13T18:47:19.487778+0000","last_undegraded":"2024-09-13T18:47:19.487778+0000","last_fullsized":"2024-09-13T18:47:19.487778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497807+0000","last_change":"2024-09-13T18:47:15.478387+0000","last_active":"2024-09-13T18:47:19.497807+0000","last_peered":"2024-09-13T18:47:19.497807+0000","last_clean":"2024-09-13T18:47:19.497807+0000","last_became_active":"2024-09-13T18:47:15.478052+0000","last_became_peered":"2024-09-13T18:47:15.478052+0000","last_unstale":"2024-09-13T18:47:19.497807+0000","last_undegraded":"2024-09-13T18:47:19.497807+0000","last_fullsized":"2024-09-13T18:47:19.497807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:20.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962836+0000","last_change":"2024-09-13T18:47:19.511484+0000","last_active":"2024-09-13T18:47:19.962836+0000","last_peered":"2024-09-13T18:47:19.962836+0000","last_clean":"2024-09-13T18:47:19.962836+0000","last_became_active":"2024-09-13T18:47:19.511269+0000","last_became_peered":"2024-09-13T18:47:19.511269+0000","last_unstale":"2024-09-13T18:47:19.962836+0000","last_undegraded":"2024-09-13T18:47:19.962836+0000","last_fullsized":"2024-09-13T18:47:19.962836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:27.500957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495634+0000","last_change":"2024-09-13T18:47:15.471234+0000","last_active":"2024-09-13T18:47:19.495634+0000","last_peered":"2024-09-13T18:47:19.495634+0000","last_clean":"2024-09-13T18:47:19.495634+0000","last_became_active":"2024-09-13T18:47:15.469073+0000","last_became_peered":"2024-09-13T18:47:15.469073+0000","last_unstale":"2024-09-13T18:47:19.495634+0000","last_undegraded":"2024-09-13T18:47:19.495634+0000","last_fullsized":"2024-09-13T18:47:19.495634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498324+0000","last_change":"2024-09-13T18:47:15.484477+0000","last_active":"2024-09-13T18:47:19.498324+0000","last_peered":"2024-09-13T18:47:19.498324+0000","last_clean":"2024-09-13T18:47:19.498324+0000","last_became_active":"2024-09-13T18:47:15.484155+0000","last_became_peered":"2024-09-13T18:47:15.484155+0000","last_unstale":"2024-09-13T18:47:19.498324+0000","last_undegraded":"2024-09-13T18:47:19.498324+0000","last_fullsized":"2024-09-13T18:47:19.498324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:39.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488918+0000","last_change":"2024-09-13T18:47:15.478632+0000","last_active":"2024-09-13T18:47:19.488918+0000","last_peered":"2024-09-13T18:47:19.488918+0000","last_clean":"2024-09-13T18:47:19.488918+0000","last_became_active":"2024-09-13T18:47:15.477839+0000","last_became_peered":"2024-09-13T18:47:15.477839+0000","last_unstale":"2024-09-13T18:47:19.488918+0000","last_undegraded":"2024-09-13T18:47:19.488918+0000","last_fullsized":"2024-09-13T18:47:19.488918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487900+0000","last_change":"2024-09-13T18:47:15.468102+0000","last_active":"2024-09-13T18:47:19.487900+0000","last_peered":"2024-09-13T18:47:19.487900+0000","last_clean":"2024-09-13T18:47:19.487900+0000","last_became_active":"2024-09-13T18:47:15.467859+0000","last_became_peered":"2024-09-13T18:47:15.467859+0000","last_unstale":"2024-09-13T18:47:19.487900+0000","last_undegraded":"2024-09-13T18:47:19.487900+0000","last_fullsized":"2024-09-13T18:47:19.487900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490262+0000","last_change":"2024-09-13T18:47:15.483966+0000","last_active":"2024-09-13T18:47:19.490262+0000","last_peered":"2024-09-13T18:47:19.490262+0000","last_clean":"2024-09-13T18:47:19.490262+0000","last_became_active":"2024-09-13T18:47:15.483703+0000","last_became_peered":"2024-09-13T18:47:15.483703+0000","last_unstale":"2024-09-13T18:47:19.490262+0000","last_undegraded":"2024-09-13T18:47:19.490262+0000","last_fullsized":"2024-09-13T18:47:19.490262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492839+0000","last_change":"2024-09-13T18:47:15.473022+0000","last_active":"2024-09-13T18:47:19.492839+0000","last_peered":"2024-09-13T18:47:19.492839+0000","last_clean":"2024-09-13T18:47:19.492839+0000","last_became_active":"2024-09-13T18:47:15.472759+0000","last_became_peered":"2024-09-13T18:47:15.472759+0000","last_unstale":"2024-09-13T18:47:19.492839+0000","last_undegraded":"2024-09-13T18:47:19.492839+0000","last_fullsized":"2024-09-13T18:47:19.492839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501045+0000","last_change":"2024-09-13T18:47:15.498630+0000","last_active":"2024-09-13T18:47:19.501045+0000","last_peered":"2024-09-13T18:47:19.501045+0000","last_clean":"2024-09-13T18:47:19.501045+0000","last_became_active":"2024-09-13T18:47:15.489640+0000","last_became_peered":"2024-09-13T18:47:15.489640+0000","last_unstale":"2024-09-13T18:47:19.501045+0000","last_undegraded":"2024-09-13T18:47:19.501045+0000","last_fullsized":"2024-09-13T18:47:19.501045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487931+0000","last_change":"2024-09-13T18:47:15.484677+0000","last_active":"2024-09-13T18:47:19.487931+0000","last_peered":"2024-09-13T18:47:19.487931+0000","last_clean":"2024-09-13T18:47:19.487931+0000","last_became_active":"2024-09-13T18:47:15.484344+0000","last_became_peered":"2024-09-13T18:47:15.484344+0000","last_unstale":"2024-09-13T18:47:19.487931+0000","last_undegraded":"2024-09-13T18:47:19.487931+0000","last_fullsized":"2024-09-13T18:47:19.487931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490604+0000","last_change":"2024-09-13T18:47:15.480276+0000","last_active":"2024-09-13T18:47:19.490604+0000","last_peered":"2024-09-13T18:47:19.490604+0000","last_clean":"2024-09-13T18:47:19.490604+0000","last_became_active":"2024-09-13T18:47:15.477492+0000","last_became_peered":"2024-09-13T18:47:15.477492+0000","last_unstale":"2024-09-13T18:47:19.490604+0000","last_undegraded":"2024-09-13T18:47:19.490604+0000","last_fullsized":"2024-09-13T18:47:19.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488622+0000","last_change":"2024-09-13T18:47:15.484967+0000","last_active":"2024-09-13T18:47:19.488622+0000","last_peered":"2024-09-13T18:47:19.488622+0000","last_clean":"2024-09-13T18:47:19.488622+0000","last_became_active":"2024-09-13T18:47:15.484678+0000","last_became_peered":"2024-09-13T18:47:15.484678+0000","last_unstale":"2024-09-13T18:47:19.488622+0000","last_undegraded":"2024-09-13T18:47:19.488622+0000","last_fullsized":"2024-09-13T18:47:19.488622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488812+0000","last_change":"2024-09-13T18:47:15.486476+0000","last_active":"2024-09-13T18:47:19.488812+0000","last_peered":"2024-09-13T18:47:19.488812+0000","last_clean":"2024-09-13T18:47:19.488812+0000","last_became_active":"2024-09-13T18:47:15.478333+0000","last_became_peered":"2024-09-13T18:47:15.478333+0000","last_unstale":"2024-09-13T18:47:19.488812+0000","last_undegraded":"2024-09-13T18:47:19.488812+0000","last_fullsized":"2024-09-13T18:47:19.488812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487773+0000","last_change":"2024-09-13T18:47:15.465478+0000","last_active":"2024-09-13T18:47:19.487773+0000","last_peered":"2024-09-13T18:47:19.487773+0000","last_clean":"2024-09-13T18:47:19.487773+0000","last_became_active":"2024-09-13T18:47:15.463578+0000","last_became_peered":"2024-09-13T18:47:15.463578+0000","last_unstale":"2024-09-13T18:47:19.487773+0000","last_undegraded":"2024-09-13T18:47:19.487773+0000","last_fullsized":"2024-09-13T18:47:19.487773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500654+0000","last_change":"2024-09-13T18:47:15.480360+0000","last_active":"2024-09-13T18:47:19.500654+0000","last_peered":"2024-09-13T18:47:19.500654+0000","last_clean":"2024-09-13T18:47:19.500654+0000","last_became_active":"2024-09-13T18:47:15.480117+0000","last_became_peered":"2024-09-13T18:47:15.480117+0000","last_unstale":"2024-09-13T18:47:19.500654+0000","last_undegraded":"2024-09-13T18:47:19.500654+0000","last_fullsized":"2024-09-13T18:47:19.500654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592107+0000","last_change":"2024-09-13T18:47:15.480704+0000","last_active":"2024-09-13T18:47:19.592107+0000","last_peered":"2024-09-13T18:47:19.592107+0000","last_clean":"2024-09-13T18:47:19.592107+0000","last_became_active":"2024-09-13T18:47:15.480427+0000","last_became_peered":"2024-09-13T18:47:15.480427+0000","last_unstale":"2024-09-13T18:47:19.592107+0000","last_undegraded":"2024-09-13T18:47:19.592107+0000","last_fullsized":"2024-09-13T18:47:19.592107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499735+0000","last_change":"2024-09-13T18:47:15.483066+0000","last_active":"2024-09-13T18:47:19.499735+0000","last_peered":"2024-09-13T18:47:19.499735+0000","last_clean":"2024-09-13T18:47:19.499735+0000","last_became_active":"2024-09-13T18:47:15.482829+0000","last_became_peered":"2024-09-13T18:47:15.482829+0000","last_unstale":"2024-09-13T18:47:19.499735+0000","last_undegraded":"2024-09-13T18:47:19.499735+0000","last_fullsized":"2024-09-13T18:47:19.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489201+0000","last_change":"2024-09-13T18:47:15.480926+0000","last_active":"2024-09-13T18:47:19.489201+0000","last_peered":"2024-09-13T18:47:19.489201+0000","last_clean":"2024-09-13T18:47:19.489201+0000","last_became_active":"2024-09-13T18:47:15.475793+0000","last_became_peered":"2024-09-13T18:47:15.475793+0000","last_unstale":"2024-09-13T18:47:19.489201+0000","last_undegraded":"2024-09-13T18:47:19.489201+0000","last_fullsized":"2024-09-13T18:47:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489302+0000","last_change":"2024-09-13T18:47:15.476117+0000","last_active":"2024-09-13T18:47:19.489302+0000","last_peered":"2024-09-13T18:47:19.489302+0000","last_clean":"2024-09-13T18:47:19.489302+0000","last_became_active":"2024-09-13T18:47:15.474650+0000","last_became_peered":"2024-09-13T18:47:15.474650+0000","last_unstale":"2024-09-13T18:47:19.489302+0000","last_undegraded":"2024-09-13T18:47:19.489302+0000","last_fullsized":"2024-09-13T18:47:19.489302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492576+0000","last_change":"2024-09-13T18:47:15.462353+0000","last_active":"2024-09-13T18:47:19.492576+0000","last_peered":"2024-09-13T18:47:19.492576+0000","last_clean":"2024-09-13T18:47:19.492576+0000","last_became_active":"2024-09-13T18:47:15.462033+0000","last_became_peered":"2024-09-13T18:47:15.462033+0000","last_unstale":"2024-09-13T18:47:19.492576+0000","last_undegraded":"2024-09-13T18:47:19.492576+0000","last_fullsized":"2024-09-13T18:47:19.492576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487542+0000","last_change":"2024-09-13T18:47:15.476234+0000","last_active":"2024-09-13T18:47:19.487542+0000","last_peered":"2024-09-13T18:47:19.487542+0000","last_clean":"2024-09-13T18:47:19.487542+0000","last_became_active":"2024-09-13T18:47:15.475946+0000","last_became_peered":"2024-09-13T18:47:15.475946+0000","last_unstale":"2024-09-13T18:47:19.487542+0000","last_undegraded":"2024-09-13T18:47:19.487542+0000","last_fullsized":"2024-09-13T18:47:19.487542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487685+0000","last_change":"2024-09-13T18:47:15.467147+0000","last_active":"2024-09-13T18:47:19.487685+0000","last_peered":"2024-09-13T18:47:19.487685+0000","last_clean":"2024-09-13T18:47:19.487685+0000","last_became_active":"2024-09-13T18:47:15.466819+0000","last_became_peered":"2024-09-13T18:47:15.466819+0000","last_unstale":"2024-09-13T18:47:19.487685+0000","last_undegraded":"2024-09-13T18:47:19.487685+0000","last_fullsized":"2024-09-13T18:47:19.487685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497332+0000","last_change":"2024-09-13T18:47:15.465815+0000","last_active":"2024-09-13T18:47:19.497332+0000","last_peered":"2024-09-13T18:47:19.497332+0000","last_clean":"2024-09-13T18:47:19.497332+0000","last_became_active":"2024-09-13T18:47:15.464960+0000","last_became_peered":"2024-09-13T18:47:15.464960+0000","last_unstale":"2024-09-13T18:47:19.497332+0000","last_undegraded":"2024-09-13T18:47:19.497332+0000","last_fullsized":"2024-09-13T18:47:19.497332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.346283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500854+0000","last_change":"2024-09-13T18:47:15.482526+0000","last_active":"2024-09-13T18:47:19.500854+0000","last_peered":"2024-09-13T18:47:19.500854+0000","last_clean":"2024-09-13T18:47:19.500854+0000","last_became_active":"2024-09-13T18:47:15.482236+0000","last_became_peered":"2024-09-13T18:47:15.482236+0000","last_unstale":"2024-09-13T18:47:19.500854+0000","last_undegraded":"2024-09-13T18:47:19.500854+0000","last_fullsized":"2024-09-13T18:47:19.500854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500973+0000","last_change":"2024-09-13T18:47:15.498504+0000","last_active":"2024-09-13T18:47:19.500973+0000","last_peered":"2024-09-13T18:47:19.500973+0000","last_clean":"2024-09-13T18:47:19.500973+0000","last_became_active":"2024-09-13T18:47:15.490041+0000","last_became_peered":"2024-09-13T18:47:15.490041+0000","last_unstale":"2024-09-13T18:47:19.500973+0000","last_undegraded":"2024-09-13T18:47:19.500973+0000","last_fullsized":"2024-09-13T18:47:19.500973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592385+0000","last_change":"2024-09-13T18:47:15.495466+0000","last_active":"2024-09-13T18:47:19.592385+0000","last_peered":"2024-09-13T18:47:19.592385+0000","last_clean":"2024-09-13T18:47:19.592385+0000","last_became_active":"2024-09-13T18:47:15.495197+0000","last_became_peered":"2024-09-13T18:47:15.495197+0000","last_unstale":"2024-09-13T18:47:19.592385+0000","last_undegraded":"2024-09-13T18:47:19.592385+0000","last_fullsized":"2024-09-13T18:47:19.592385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487124+0000","last_change":"2024-09-13T18:47:15.474386+0000","last_active":"2024-09-13T18:47:19.487124+0000","last_peered":"2024-09-13T18:47:19.487124+0000","last_clean":"2024-09-13T18:47:19.487124+0000","last_became_active":"2024-09-13T18:47:15.473414+0000","last_became_peered":"2024-09-13T18:47:15.473414+0000","last_unstale":"2024-09-13T18:47:19.487124+0000","last_undegraded":"2024-09-13T18:47:19.487124+0000","last_fullsized":"2024-09-13T18:47:19.487124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591466+0000","last_change":"2024-09-13T18:47:15.469797+0000","last_active":"2024-09-13T18:47:19.591466+0000","last_peered":"2024-09-13T18:47:19.591466+0000","last_clean":"2024-09-13T18:47:19.591466+0000","last_became_active":"2024-09-13T18:47:15.469460+0000","last_became_peered":"2024-09-13T18:47:15.469460+0000","last_unstale":"2024-09-13T18:47:19.591466+0000","last_undegraded":"2024-09-13T18:47:19.591466+0000","last_fullsized":"2024-09-13T18:47:19.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488705+0000","last_change":"2024-09-13T18:47:15.483840+0000","last_active":"2024-09-13T18:47:19.488705+0000","last_peered":"2024-09-13T18:47:19.488705+0000","last_clean":"2024-09-13T18:47:19.488705+0000","last_became_active":"2024-09-13T18:47:15.478139+0000","last_became_peered":"2024-09-13T18:47:15.478139+0000","last_unstale":"2024-09-13T18:47:19.488705+0000","last_undegraded":"2024-09-13T18:47:19.488705+0000","last_fullsized":"2024-09-13T18:47:19.488705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591973+0000","last_change":"2024-09-13T18:47:15.484385+0000","last_active":"2024-09-13T18:47:19.591973+0000","last_peered":"2024-09-13T18:47:19.591973+0000","last_clean":"2024-09-13T18:47:19.591973+0000","last_became_active":"2024-09-13T18:47:15.477424+0000","last_became_peered":"2024-09-13T18:47:15.477424+0000","last_unstale":"2024-09-13T18:47:19.591973+0000","last_undegraded":"2024-09-13T18:47:19.591973+0000","last_fullsized":"2024-09-13T18:47:19.591973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488909+0000","last_change":"2024-09-13T18:47:15.477871+0000","last_active":"2024-09-13T18:47:19.488909+0000","last_peered":"2024-09-13T18:47:19.488909+0000","last_clean":"2024-09-13T18:47:19.488909+0000","last_became_active":"2024-09-13T18:47:15.474849+0000","last_became_peered":"2024-09-13T18:47:15.474849+0000","last_unstale":"2024-09-13T18:47:19.488909+0000","last_undegraded":"2024-09-13T18:47:19.488909+0000","last_fullsized":"2024-09-13T18:47:19.488909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487837+0000","last_change":"2024-09-13T18:47:15.464724+0000","last_active":"2024-09-13T18:47:19.487837+0000","last_peered":"2024-09-13T18:47:19.487837+0000","last_clean":"2024-09-13T18:47:19.487837+0000","last_became_active":"2024-09-13T18:47:15.463105+0000","last_became_peered":"2024-09-13T18:47:15.463105+0000","last_unstale":"2024-09-13T18:47:19.487837+0000","last_undegraded":"2024-09-13T18:47:19.487837+0000","last_fullsized":"2024-09-13T18:47:19.487837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:15.445388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493023+0000","last_change":"2024-09-13T18:47:15.476846+0000","last_active":"2024-09-13T18:47:19.493023+0000","last_peered":"2024-09-13T18:47:19.493023+0000","last_clean":"2024-09-13T18:47:19.493023+0000","last_became_active":"2024-09-13T18:47:15.476551+0000","last_became_peered":"2024-09-13T18:47:15.476551+0000","last_unstale":"2024-09-13T18:47:19.493023+0000","last_undegraded":"2024-09-13T18:47:19.493023+0000","last_fullsized":"2024-09-13T18:47:19.493023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592316+0000","last_change":"2024-09-13T18:47:15.496912+0000","last_active":"2024-09-13T18:47:19.592316+0000","last_peered":"2024-09-13T18:47:19.592316+0000","last_clean":"2024-09-13T18:47:19.592316+0000","last_became_active":"2024-09-13T18:47:15.496644+0000","last_became_peered":"2024-09-13T18:47:15.496644+0000","last_unstale":"2024-09-13T18:47:19.592316+0000","last_undegraded":"2024-09-13T18:47:19.592316+0000","last_fullsized":"2024-09-13T18:47:19.592316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9039999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:43.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.750+0000 7f3b8ce00700 1 Processor -- start 2024-09-13T18:47:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.750+0000 7f3b8ce00700 1 -- start start 2024-09-13T18:47:43.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b8ce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8806cba0 0x7f3b880b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b8ce00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880d1390 con 0x7f3b8815cd90 2024-09-13T18:47:43.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b8ce00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880d1670 con 0x7f3b8815d170 2024-09-13T18:47:43.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b8ce00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880b2530 con 0x7f3b8806cba0 2024-09-13T18:47:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b8815cd90 0x7f3b880cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47274/0 (socket says 172.21.15.81:47274) 2024-09-13T18:47:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 -- 172.21.15.81:0/647577072 learned_addr learned my addr 172.21.15.81:0/647577072 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87e00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8806cba0 0x7f3b880b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282679579 0 0) 0x7f3b880d1390 con 0x7f3b8815cd90 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6c0035d0 con 0x7f3b8815cd90 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3618143517 0 0) 0x7f3b6c0035d0 con 0x7f3b8815cd90 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8806cba0 msgr2=0x7f3b880b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8806cba0 0x7f3b880b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 >> v1:172.21.15.178:6789/0 conn(0x7f3b8815d170 legacy=0x7f3b880cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880d1950 con 0x7f3b8815cd90 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f3b780019f0 con 0x7f3b8815cd90 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 >> v1:172.21.15.81:6789/0 conn(0x7f3b8815cd90 legacy=0x7f3b880cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c003ac0 0x7f3b6c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c004420 0x7f3b6c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0050f0 0x7f3b6c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880b2530 con 0x7f3b6c004420 2024-09-13T18:47:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c00c020 con 0x7f3b6c0050f0 2024-09-13T18:47:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c00c1e0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c003ac0 0x7f3b6c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b7ea00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c004420 0x7f3b6c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87e00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0050f0 0x7f3b6c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 -- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0050f0 msgr2=0x7f3b6c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b6c0050f0 0x7f3b6c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 -- 172.21.15.81:0/647577072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c004420 msgr2=0x7f3b6c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c004420 0x7f3b6c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.754+0000 7f3b87400700 1 -- 172.21.15.81:0/647577072 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0035d0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b87400700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c003ac0 0x7f3b6c003ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800a840 tx=0x7f3b6c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c255d5d89940f1e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780072d0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78007430 con 0x7f3b6c003ac0 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b86a00700 1 -- 172.21.15.81:0/647577072 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780077e0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b8ce00700 1 -- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c003ac0 msgr2=0x7f3b6c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/647577072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b6c003ac0 0x7f3b6c003ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800a840 tx=0x7f3b6c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b87e00700 1 -- 172.21.15.81:0/647577072 reap_dead start 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b8ce00700 1 -- 172.21.15.81:0/647577072 shutdown_connections 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b8ce00700 1 -- 172.21.15.81:0/647577072 >> 172.21.15.81:0/647577072 conn(0x7f3b880d2c10 msgr2=0x7f3b880d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b8ce00700 1 -- 172.21.15.81:0/647577072 shutdown_connections 2024-09-13T18:47:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.758+0000 7f3b8ce00700 1 -- 172.21.15.81:0/647577072 wait complete. 2024-09-13T18:47:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 Processor -- start 2024-09-13T18:47:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 -- start start 2024-09-13T18:47:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 0x7f3b880b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b880c8fa0 0x7f3b88149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8814a270 0x7f3b880b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88149af0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880b36c0 con 0x7f3b880c8fa0 2024-09-13T18:47:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880b4240 con 0x7f3b8814a270 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 0x7f3b880b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 0x7f3b880b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47548/0 (socket says 172.21.15.81:47548) 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 -- 172.21.15.81:0/1290732813 learned_addr learned my addr 172.21.15.81:0/1290732813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b7ea00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b880c8fa0 0x7f3b88149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87e00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8814a270 0x7f3b880b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 -- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8814a270 msgr2=0x7f3b880b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8814a270 0x7f3b880b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 -- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b880c8fa0 msgr2=0x7f3b88149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b880c8fa0 0x7f3b88149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 -- 172.21.15.81:0/1290732813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880b3910 con 0x7f3b6c003ac0 2024-09-13T18:47:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b7ea00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b880c8fa0 0x7f3b88149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b87400700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 0x7f3b880b86f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c370 tx=0x7f3b880cd820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780079b0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78007b10 con 0x7f3b6c003ac0 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b880b3bf0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.762+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78012640 con 0x7f3b6c003ac0 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.766+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8814ca40 con 0x7f3b6c003ac0 2024-09-13T18:47:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.766+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b880d1670 con 0x7f3b6c003ac0 2024-09-13T18:47:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.766+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b7801a070 con 0x7f3b6c003ac0 2024-09-13T18:47:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.770+0000 7f3b7fe00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b64066730 0x7f3b64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.770+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b78085bd0 con 0x7f3b6c003ac0 2024-09-13T18:47:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.770+0000 7f3b7ea00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b64066730 0x7f3b64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.770+0000 7f3b7ea00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b64066730 0x7f3b64068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3b881f37b0 tx=0x7f3b70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.774+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b78052d60 con 0x7f3b6c003ac0 2024-09-13T18:47:43.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.950+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b880ce6f0 con 0x7f3b64066730 2024-09-13T18:47:43.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.966+0000 7f3b7fe00700 1 -- 172.21.15.81:0/1290732813 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345083 (secure 0 0 0) 0x7f3b70001390 con 0x7f3b64066730 2024-09-13T18:47:43.983 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:43.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b64066730 msgr2=0x7f3b64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b64066730 0x7f3b64068bf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3b881f37b0 tx=0x7f3b70009040 comp rx=0 tx=0).stop 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 msgr2=0x7f3b880b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 0x7f3b880b86f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00c370 tx=0x7f3b880cd820 comp rx=0 tx=0).stop 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 shutdown_connections 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b64066730 0x7f3b64068bf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b8814a270 0x7f3b880b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b880c8fa0 0x7f3b88149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 --2- 172.21.15.81:0/1290732813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c003ac0 0x7f3b880b86f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 >> 172.21.15.81:0/1290732813 conn(0x7f3b880d2c10 msgr2=0x7f3b8815fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 shutdown_connections 2024-09-13T18:47:43.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:43.978+0000 7f3b8ce00700 1 -- 172.21.15.81:0/1290732813 wait complete. 2024-09-13T18:47:43.989 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:47:44.009 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-13T18:47:42.978456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227568,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":224243,"kb_avail":754747152,"statfs":{"total":773094113280,"available":772861083648,"internally_reserved":0,"allocated":3284992,"data_stored":1988162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":229625403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004773"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491815+0000","last_change":"2024-09-13T18:47:14.995976+0000","last_active":"2024-09-13T18:47:19.491815+0000","last_peered":"2024-09-13T18:47:19.491815+0000","last_clean":"2024-09-13T18:47:19.491815+0000","last_became_active":"2024-09-13T18:47:14.995706+0000","last_became_peered":"2024-09-13T18:47:14.995706+0000","last_unstale":"2024-09-13T18:47:19.491815+0000","last_undegraded":"2024-09-13T18:47:19.491815+0000","last_fullsized":"2024-09-13T18:47:19.491815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:00:18.193015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487329+0000","last_change":"2024-09-13T18:47:15.484957+0000","last_active":"2024-09-13T18:47:19.487329+0000","last_peered":"2024-09-13T18:47:19.487329+0000","last_clean":"2024-09-13T18:47:19.487329+0000","last_became_active":"2024-09-13T18:47:15.484720+0000","last_became_peered":"2024-09-13T18:47:15.484720+0000","last_unstale":"2024-09-13T18:47:19.487329+0000","last_undegraded":"2024-09-13T18:47:19.487329+0000","last_fullsized":"2024-09-13T18:47:19.487329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961870+0000","last_change":"2024-09-13T18:47:19.593844+0000","last_active":"2024-09-13T18:47:19.961870+0000","last_peered":"2024-09-13T18:47:19.961870+0000","last_clean":"2024-09-13T18:47:19.961870+0000","last_became_active":"2024-09-13T18:47:19.591052+0000","last_became_peered":"2024-09-13T18:47:19.591052+0000","last_unstale":"2024-09-13T18:47:19.961870+0000","last_undegraded":"2024-09-13T18:47:19.961870+0000","last_fullsized":"2024-09-13T18:47:19.961870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:05.476346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487465+0000","last_change":"2024-09-13T18:47:14.991104+0000","last_active":"2024-09-13T18:47:19.487465+0000","last_peered":"2024-09-13T18:47:19.487465+0000","last_clean":"2024-09-13T18:47:19.487465+0000","last_became_active":"2024-09-13T18:47:14.990785+0000","last_became_peered":"2024-09-13T18:47:14.990785+0000","last_unstale":"2024-09-13T18:47:19.487465+0000","last_undegraded":"2024-09-13T18:47:19.487465+0000","last_fullsized":"2024-09-13T18:47:19.487465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:20.795074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491728+0000","last_change":"2024-09-13T18:47:15.478881+0000","last_active":"2024-09-13T18:47:19.491728+0000","last_peered":"2024-09-13T18:47:19.491728+0000","last_clean":"2024-09-13T18:47:19.491728+0000","last_became_active":"2024-09-13T18:47:15.478630+0000","last_became_peered":"2024-09-13T18:47:15.478630+0000","last_unstale":"2024-09-13T18:47:19.491728+0000","last_undegraded":"2024-09-13T18:47:19.491728+0000","last_fullsized":"2024-09-13T18:47:19.491728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:13.833360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089448+0000","last_change":"2024-09-13T18:47:19.506466+0000","last_active":"2024-09-13T18:47:20.089448+0000","last_peered":"2024-09-13T18:47:20.089448+0000","last_clean":"2024-09-13T18:47:20.089448+0000","last_became_active":"2024-09-13T18:47:19.505998+0000","last_became_peered":"2024-09-13T18:47:19.505998+0000","last_unstale":"2024-09-13T18:47:20.089448+0000","last_undegraded":"2024-09-13T18:47:20.089448+0000","last_fullsized":"2024-09-13T18:47:20.089448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:12.843575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592163+0000","last_change":"2024-09-13T18:47:15.007303+0000","last_active":"2024-09-13T18:47:19.592163+0000","last_peered":"2024-09-13T18:47:19.592163+0000","last_clean":"2024-09-13T18:47:19.592163+0000","last_became_active":"2024-09-13T18:47:15.006847+0000","last_became_peered":"2024-09-13T18:47:15.006847+0000","last_unstale":"2024-09-13T18:47:19.592163+0000","last_undegraded":"2024-09-13T18:47:19.592163+0000","last_fullsized":"2024-09-13T18:47:19.592163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:41.820844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489015+0000","last_change":"2024-09-13T18:47:15.482116+0000","last_active":"2024-09-13T18:47:19.489015+0000","last_peered":"2024-09-13T18:47:19.489015+0000","last_clean":"2024-09-13T18:47:19.489015+0000","last_became_active":"2024-09-13T18:47:15.481869+0000","last_became_peered":"2024-09-13T18:47:15.481869+0000","last_unstale":"2024-09-13T18:47:19.489015+0000","last_undegraded":"2024-09-13T18:47:19.489015+0000","last_fullsized":"2024-09-13T18:47:19.489015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089608+0000","last_change":"2024-09-13T18:47:19.509850+0000","last_active":"2024-09-13T18:47:20.089608+0000","last_peered":"2024-09-13T18:47:20.089608+0000","last_clean":"2024-09-13T18:47:20.089608+0000","last_became_active":"2024-09-13T18:47:19.509444+0000","last_became_peered":"2024-09-13T18:47:19.509444+0000","last_unstale":"2024-09-13T18:47:20.089608+0000","last_undegraded":"2024-09-13T18:47:20.089608+0000","last_fullsized":"2024-09-13T18:47:20.089608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591632+0000","last_change":"2024-09-13T18:47:15.002453+0000","last_active":"2024-09-13T18:47:19.591632+0000","last_peered":"2024-09-13T18:47:19.591632+0000","last_clean":"2024-09-13T18:47:19.591632+0000","last_became_active":"2024-09-13T18:47:15.002127+0000","last_became_peered":"2024-09-13T18:47:15.002127+0000","last_unstale":"2024-09-13T18:47:19.591632+0000","last_undegraded":"2024-09-13T18:47:19.591632+0000","last_fullsized":"2024-09-13T18:47:19.591632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:18.452266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490093+0000","last_change":"2024-09-13T18:47:15.477221+0000","last_active":"2024-09-13T18:47:19.490093+0000","last_peered":"2024-09-13T18:47:19.490093+0000","last_clean":"2024-09-13T18:47:19.490093+0000","last_became_active":"2024-09-13T18:47:15.475771+0000","last_became_peered":"2024-09-13T18:47:15.475771+0000","last_unstale":"2024-09-13T18:47:19.490093+0000","last_undegraded":"2024-09-13T18:47:19.490093+0000","last_fullsized":"2024-09-13T18:47:19.490093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090621+0000","last_change":"2024-09-13T18:47:19.513245+0000","last_active":"2024-09-13T18:47:20.090621+0000","last_peered":"2024-09-13T18:47:20.090621+0000","last_clean":"2024-09-13T18:47:20.090621+0000","last_became_active":"2024-09-13T18:47:19.512719+0000","last_became_peered":"2024-09-13T18:47:19.512719+0000","last_unstale":"2024-09-13T18:47:20.090621+0000","last_undegraded":"2024-09-13T18:47:20.090621+0000","last_fullsized":"2024-09-13T18:47:20.090621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499018+0000","last_change":"2024-09-13T18:47:15.481298+0000","last_active":"2024-09-13T18:47:19.499018+0000","last_peered":"2024-09-13T18:47:19.499018+0000","last_clean":"2024-09-13T18:47:19.499018+0000","last_became_active":"2024-09-13T18:47:15.481041+0000","last_became_peered":"2024-09-13T18:47:15.481041+0000","last_unstale":"2024-09-13T18:47:19.499018+0000","last_undegraded":"2024-09-13T18:47:19.499018+0000","last_fullsized":"2024-09-13T18:47:19.499018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:13.882562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592125+0000","last_change":"2024-09-13T18:47:15.004858+0000","last_active":"2024-09-13T18:47:19.592125+0000","last_peered":"2024-09-13T18:47:19.592125+0000","last_clean":"2024-09-13T18:47:19.592125+0000","last_became_active":"2024-09-13T18:47:15.004589+0000","last_became_peered":"2024-09-13T18:47:15.004589+0000","last_unstale":"2024-09-13T18:47:19.592125+0000","last_undegraded":"2024-09-13T18:47:19.592125+0000","last_fullsized":"2024-09-13T18:47:19.592125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093955+0000","last_change":"2024-09-13T18:47:19.514214+0000","last_active":"2024-09-13T18:47:20.093955+0000","last_peered":"2024-09-13T18:47:20.093955+0000","last_clean":"2024-09-13T18:47:20.093955+0000","last_became_active":"2024-09-13T18:47:19.513786+0000","last_became_peered":"2024-09-13T18:47:19.513786+0000","last_unstale":"2024-09-13T18:47:20.093955+0000","last_undegraded":"2024-09-13T18:47:20.093955+0000","last_fullsized":"2024-09-13T18:47:20.093955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:47.811667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487784+0000","last_change":"2024-09-13T18:47:15.472641+0000","last_active":"2024-09-13T18:47:19.487784+0000","last_peered":"2024-09-13T18:47:19.487784+0000","last_clean":"2024-09-13T18:47:19.487784+0000","last_became_active":"2024-09-13T18:47:15.472397+0000","last_became_peered":"2024-09-13T18:47:15.472397+0000","last_unstale":"2024-09-13T18:47:19.487784+0000","last_undegraded":"2024-09-13T18:47:19.487784+0000","last_fullsized":"2024-09-13T18:47:19.487784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493540+0000","last_change":"2024-09-13T18:47:14.983697+0000","last_active":"2024-09-13T18:47:19.493540+0000","last_peered":"2024-09-13T18:47:19.493540+0000","last_clean":"2024-09-13T18:47:19.493540+0000","last_became_active":"2024-09-13T18:47:14.983443+0000","last_became_peered":"2024-09-13T18:47:14.983443+0000","last_unstale":"2024-09-13T18:47:19.493540+0000","last_undegraded":"2024-09-13T18:47:19.493540+0000","last_fullsized":"2024-09-13T18:47:19.493540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089265+0000","last_change":"2024-09-13T18:47:19.511041+0000","last_active":"2024-09-13T18:47:20.089265+0000","last_peered":"2024-09-13T18:47:20.089265+0000","last_clean":"2024-09-13T18:47:20.089265+0000","last_became_active":"2024-09-13T18:47:19.510682+0000","last_became_peered":"2024-09-13T18:47:19.510682+0000","last_unstale":"2024-09-13T18:47:20.089265+0000","last_undegraded":"2024-09-13T18:47:20.089265+0000","last_fullsized":"2024-09-13T18:47:20.089265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487319+0000","last_change":"2024-09-13T18:47:15.487483+0000","last_active":"2024-09-13T18:47:19.487319+0000","last_peered":"2024-09-13T18:47:19.487319+0000","last_clean":"2024-09-13T18:47:19.487319+0000","last_became_active":"2024-09-13T18:47:15.481535+0000","last_became_peered":"2024-09-13T18:47:15.481535+0000","last_unstale":"2024-09-13T18:47:19.487319+0000","last_undegraded":"2024-09-13T18:47:19.487319+0000","last_fullsized":"2024-09-13T18:47:19.487319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492990+0000","last_change":"2024-09-13T18:47:14.995731+0000","last_active":"2024-09-13T18:47:19.492990+0000","last_peered":"2024-09-13T18:47:19.492990+0000","last_clean":"2024-09-13T18:47:19.492990+0000","last_became_active":"2024-09-13T18:47:14.995401+0000","last_became_peered":"2024-09-13T18:47:14.995401+0000","last_unstale":"2024-09-13T18:47:19.492990+0000","last_undegraded":"2024-09-13T18:47:19.492990+0000","last_fullsized":"2024-09-13T18:47:19.492990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083631+0000","last_change":"2024-09-13T18:47:19.594879+0000","last_active":"2024-09-13T18:47:20.083631+0000","last_peered":"2024-09-13T18:47:20.083631+0000","last_clean":"2024-09-13T18:47:20.083631+0000","last_became_active":"2024-09-13T18:47:19.594314+0000","last_became_peered":"2024-09-13T18:47:19.594314+0000","last_unstale":"2024-09-13T18:47:20.083631+0000","last_undegraded":"2024-09-13T18:47:20.083631+0000","last_fullsized":"2024-09-13T18:47:20.083631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492372+0000","last_change":"2024-09-13T18:47:15.463467+0000","last_active":"2024-09-13T18:47:19.492372+0000","last_peered":"2024-09-13T18:47:19.492372+0000","last_clean":"2024-09-13T18:47:19.492372+0000","last_became_active":"2024-09-13T18:47:15.463197+0000","last_became_peered":"2024-09-13T18:47:15.463197+0000","last_unstale":"2024-09-13T18:47:19.492372+0000","last_undegraded":"2024-09-13T18:47:19.492372+0000","last_fullsized":"2024-09-13T18:47:19.492372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:05.037494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591200+0000","last_change":"2024-09-13T18:47:15.007100+0000","last_active":"2024-09-13T18:47:19.591200+0000","last_peered":"2024-09-13T18:47:19.591200+0000","last_clean":"2024-09-13T18:47:19.591200+0000","last_became_active":"2024-09-13T18:47:15.002832+0000","last_became_peered":"2024-09-13T18:47:15.002832+0000","last_unstale":"2024-09-13T18:47:19.591200+0000","last_undegraded":"2024-09-13T18:47:19.591200+0000","last_fullsized":"2024-09-13T18:47:19.591200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093085+0000","last_change":"2024-09-13T18:47:19.512627+0000","last_active":"2024-09-13T18:47:20.093085+0000","last_peered":"2024-09-13T18:47:20.093085+0000","last_clean":"2024-09-13T18:47:20.093085+0000","last_became_active":"2024-09-13T18:47:19.512153+0000","last_became_peered":"2024-09-13T18:47:19.512153+0000","last_unstale":"2024-09-13T18:47:20.093085+0000","last_undegraded":"2024-09-13T18:47:20.093085+0000","last_fullsized":"2024-09-13T18:47:20.093085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491322+0000","last_change":"2024-09-13T18:47:15.475389+0000","last_active":"2024-09-13T18:47:19.491322+0000","last_peered":"2024-09-13T18:47:19.491322+0000","last_clean":"2024-09-13T18:47:19.491322+0000","last_became_active":"2024-09-13T18:47:15.475119+0000","last_became_peered":"2024-09-13T18:47:15.475119+0000","last_unstale":"2024-09-13T18:47:19.491322+0000","last_undegraded":"2024-09-13T18:47:19.491322+0000","last_fullsized":"2024-09-13T18:47:19.491322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501582+0000","last_change":"2024-09-13T18:47:15.002258+0000","last_active":"2024-09-13T18:47:19.501582+0000","last_peered":"2024-09-13T18:47:19.501582+0000","last_clean":"2024-09-13T18:47:19.501582+0000","last_became_active":"2024-09-13T18:47:15.001885+0000","last_became_peered":"2024-09-13T18:47:15.001885+0000","last_unstale":"2024-09-13T18:47:19.501582+0000","last_undegraded":"2024-09-13T18:47:19.501582+0000","last_fullsized":"2024-09-13T18:47:19.501582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089874+0000","last_change":"2024-09-13T18:47:19.600283+0000","last_active":"2024-09-13T18:47:20.089874+0000","last_peered":"2024-09-13T18:47:20.089874+0000","last_clean":"2024-09-13T18:47:20.089874+0000","last_became_active":"2024-09-13T18:47:19.598652+0000","last_became_peered":"2024-09-13T18:47:19.598652+0000","last_unstale":"2024-09-13T18:47:20.089874+0000","last_undegraded":"2024-09-13T18:47:20.089874+0000","last_fullsized":"2024-09-13T18:47:20.089874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:29.767904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488008+0000","last_change":"2024-09-13T18:47:15.472100+0000","last_active":"2024-09-13T18:47:19.488008+0000","last_peered":"2024-09-13T18:47:19.488008+0000","last_clean":"2024-09-13T18:47:19.488008+0000","last_became_active":"2024-09-13T18:47:15.470896+0000","last_became_peered":"2024-09-13T18:47:15.470896+0000","last_unstale":"2024-09-13T18:47:19.488008+0000","last_undegraded":"2024-09-13T18:47:19.488008+0000","last_fullsized":"2024-09-13T18:47:19.488008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.915538+0000","last_change":"2024-09-13T18:47:14.993205+0000","last_active":"2024-09-13T18:47:19.915538+0000","last_peered":"2024-09-13T18:47:19.915538+0000","last_clean":"2024-09-13T18:47:19.915538+0000","last_became_active":"2024-09-13T18:47:14.992192+0000","last_became_peered":"2024-09-13T18:47:14.992192+0000","last_unstale":"2024-09-13T18:47:19.915538+0000","last_undegraded":"2024-09-13T18:47:19.915538+0000","last_fullsized":"2024-09-13T18:47:19.915538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961562+0000","last_change":"2024-09-13T18:47:19.591216+0000","last_active":"2024-09-13T18:47:19.961562+0000","last_peered":"2024-09-13T18:47:19.961562+0000","last_clean":"2024-09-13T18:47:19.961562+0000","last_became_active":"2024-09-13T18:47:19.590770+0000","last_became_peered":"2024-09-13T18:47:19.590770+0000","last_unstale":"2024-09-13T18:47:19.961562+0000","last_undegraded":"2024-09-13T18:47:19.961562+0000","last_fullsized":"2024-09-13T18:47:19.961562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:46.641313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496179+0000","last_change":"2024-09-13T18:47:15.460995+0000","last_active":"2024-09-13T18:47:19.496179+0000","last_peered":"2024-09-13T18:47:19.496179+0000","last_clean":"2024-09-13T18:47:19.496179+0000","last_became_active":"2024-09-13T18:47:15.460641+0000","last_became_peered":"2024-09-13T18:47:15.460641+0000","last_unstale":"2024-09-13T18:47:19.496179+0000","last_undegraded":"2024-09-13T18:47:19.496179+0000","last_fullsized":"2024-09-13T18:47:19.496179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592272+0000","last_change":"2024-09-13T18:47:15.010681+0000","last_active":"2024-09-13T18:47:19.592272+0000","last_peered":"2024-09-13T18:47:19.592272+0000","last_clean":"2024-09-13T18:47:19.592272+0000","last_became_active":"2024-09-13T18:47:15.010462+0000","last_became_peered":"2024-09-13T18:47:15.010462+0000","last_unstale":"2024-09-13T18:47:19.592272+0000","last_undegraded":"2024-09-13T18:47:19.592272+0000","last_fullsized":"2024-09-13T18:47:19.592272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961765+0000","last_change":"2024-09-13T18:47:19.592197+0000","last_active":"2024-09-13T18:47:19.961765+0000","last_peered":"2024-09-13T18:47:19.961765+0000","last_clean":"2024-09-13T18:47:19.961765+0000","last_became_active":"2024-09-13T18:47:19.591271+0000","last_became_peered":"2024-09-13T18:47:19.591271+0000","last_unstale":"2024-09-13T18:47:19.961765+0000","last_undegraded":"2024-09-13T18:47:19.961765+0000","last_fullsized":"2024-09-13T18:47:19.961765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:37.154029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489858+0000","last_change":"2024-09-13T18:47:15.477286+0000","last_active":"2024-09-13T18:47:19.489858+0000","last_peered":"2024-09-13T18:47:19.489858+0000","last_clean":"2024-09-13T18:47:19.489858+0000","last_became_active":"2024-09-13T18:47:15.477017+0000","last_became_peered":"2024-09-13T18:47:15.477017+0000","last_unstale":"2024-09-13T18:47:19.489858+0000","last_undegraded":"2024-09-13T18:47:19.489858+0000","last_fullsized":"2024-09-13T18:47:19.489858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.496254+0000","last_change":"2024-09-13T18:47:14.979483+0000","last_active":"2024-09-13T18:47:19.496254+0000","last_peered":"2024-09-13T18:47:19.496254+0000","last_clean":"2024-09-13T18:47:19.496254+0000","last_became_active":"2024-09-13T18:47:14.979179+0000","last_became_peered":"2024-09-13T18:47:14.979179+0000","last_unstale":"2024-09-13T18:47:19.496254+0000","last_undegraded":"2024-09-13T18:47:19.496254+0000","last_fullsized":"2024-09-13T18:47:19.496254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.082807+0000","last_change":"2024-09-13T18:47:19.515192+0000","last_active":"2024-09-13T18:47:20.082807+0000","last_peered":"2024-09-13T18:47:20.082807+0000","last_clean":"2024-09-13T18:47:20.082807+0000","last_became_active":"2024-09-13T18:47:19.514784+0000","last_became_peered":"2024-09-13T18:47:19.514784+0000","last_unstale":"2024-09-13T18:47:20.082807+0000","last_undegraded":"2024-09-13T18:47:20.082807+0000","last_fullsized":"2024-09-13T18:47:20.082807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498864+0000","last_change":"2024-09-13T18:47:15.475155+0000","last_active":"2024-09-13T18:47:19.498864+0000","last_peered":"2024-09-13T18:47:19.498864+0000","last_clean":"2024-09-13T18:47:19.498864+0000","last_became_active":"2024-09-13T18:47:15.472919+0000","last_became_peered":"2024-09-13T18:47:15.472919+0000","last_unstale":"2024-09-13T18:47:19.498864+0000","last_undegraded":"2024-09-13T18:47:19.498864+0000","last_fullsized":"2024-09-13T18:47:19.498864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:24:42.832696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489690+0000","last_change":"2024-09-13T18:47:14.989036+0000","last_active":"2024-09-13T18:47:19.489690+0000","last_peered":"2024-09-13T18:47:19.489690+0000","last_clean":"2024-09-13T18:47:19.489690+0000","last_became_active":"2024-09-13T18:47:14.988570+0000","last_became_peered":"2024-09-13T18:47:14.988570+0000","last_unstale":"2024-09-13T18:47:19.489690+0000","last_undegraded":"2024-09-13T18:47:19.489690+0000","last_fullsized":"2024-09-13T18:47:19.489690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083437+0000","last_change":"2024-09-13T18:47:19.517431+0000","last_active":"2024-09-13T18:47:20.083437+0000","last_peered":"2024-09-13T18:47:20.083437+0000","last_clean":"2024-09-13T18:47:20.083437+0000","last_became_active":"2024-09-13T18:47:19.517085+0000","last_became_peered":"2024-09-13T18:47:19.517085+0000","last_unstale":"2024-09-13T18:47:20.083437+0000","last_undegraded":"2024-09-13T18:47:20.083437+0000","last_fullsized":"2024-09-13T18:47:20.083437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492896+0000","last_change":"2024-09-13T18:47:15.467657+0000","last_active":"2024-09-13T18:47:19.492896+0000","last_peered":"2024-09-13T18:47:19.492896+0000","last_clean":"2024-09-13T18:47:19.492896+0000","last_became_active":"2024-09-13T18:47:15.467436+0000","last_became_peered":"2024-09-13T18:47:15.467436+0000","last_unstale":"2024-09-13T18:47:19.492896+0000","last_undegraded":"2024-09-13T18:47:19.492896+0000","last_fullsized":"2024-09-13T18:47:19.492896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498237+0000","last_change":"2024-09-13T18:47:14.987619+0000","last_active":"2024-09-13T18:47:19.498237+0000","last_peered":"2024-09-13T18:47:19.498237+0000","last_clean":"2024-09-13T18:47:19.498237+0000","last_became_active":"2024-09-13T18:47:14.987294+0000","last_became_peered":"2024-09-13T18:47:14.987294+0000","last_unstale":"2024-09-13T18:47:19.498237+0000","last_undegraded":"2024-09-13T18:47:19.498237+0000","last_fullsized":"2024-09-13T18:47:19.498237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083730+0000","last_change":"2024-09-13T18:47:19.512260+0000","last_active":"2024-09-13T18:47:20.083730+0000","last_peered":"2024-09-13T18:47:20.083730+0000","last_clean":"2024-09-13T18:47:20.083730+0000","last_became_active":"2024-09-13T18:47:19.511869+0000","last_became_peered":"2024-09-13T18:47:19.511869+0000","last_unstale":"2024-09-13T18:47:20.083730+0000","last_undegraded":"2024-09-13T18:47:20.083730+0000","last_fullsized":"2024-09-13T18:47:20.083730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.483967+0000","last_change":"2024-09-13T18:47:15.469232+0000","last_active":"2024-09-13T18:47:19.483967+0000","last_peered":"2024-09-13T18:47:19.483967+0000","last_clean":"2024-09-13T18:47:19.483967+0000","last_became_active":"2024-09-13T18:47:15.469087+0000","last_became_peered":"2024-09-13T18:47:15.469087+0000","last_unstale":"2024-09-13T18:47:19.483967+0000","last_undegraded":"2024-09-13T18:47:19.483967+0000","last_fullsized":"2024-09-13T18:47:19.483967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591340+0000","last_change":"2024-09-13T18:47:15.007648+0000","last_active":"2024-09-13T18:47:19.591340+0000","last_peered":"2024-09-13T18:47:19.591340+0000","last_clean":"2024-09-13T18:47:19.591340+0000","last_became_active":"2024-09-13T18:47:15.006632+0000","last_became_peered":"2024-09-13T18:47:15.006632+0000","last_unstale":"2024-09-13T18:47:19.591340+0000","last_undegraded":"2024-09-13T18:47:19.591340+0000","last_fullsized":"2024-09-13T18:47:19.591340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963378+0000","last_change":"2024-09-13T18:47:19.591686+0000","last_active":"2024-09-13T18:47:19.963378+0000","last_peered":"2024-09-13T18:47:19.963378+0000","last_clean":"2024-09-13T18:47:19.963378+0000","last_became_active":"2024-09-13T18:47:19.590830+0000","last_became_peered":"2024-09-13T18:47:19.590830+0000","last_unstale":"2024-09-13T18:47:19.963378+0000","last_undegraded":"2024-09-13T18:47:19.963378+0000","last_fullsized":"2024-09-13T18:47:19.963378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:33.879201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487530+0000","last_change":"2024-09-13T18:47:15.480640+0000","last_active":"2024-09-13T18:47:19.487530+0000","last_peered":"2024-09-13T18:47:19.487530+0000","last_clean":"2024-09-13T18:47:19.487530+0000","last_became_active":"2024-09-13T18:47:15.480343+0000","last_became_peered":"2024-09-13T18:47:15.480343+0000","last_unstale":"2024-09-13T18:47:19.487530+0000","last_undegraded":"2024-09-13T18:47:19.487530+0000","last_fullsized":"2024-09-13T18:47:19.487530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488746+0000","last_change":"2024-09-13T18:47:14.993847+0000","last_active":"2024-09-13T18:47:19.488746+0000","last_peered":"2024-09-13T18:47:19.488746+0000","last_clean":"2024-09-13T18:47:19.488746+0000","last_became_active":"2024-09-13T18:47:14.993582+0000","last_became_peered":"2024-09-13T18:47:14.993582+0000","last_unstale":"2024-09-13T18:47:19.488746+0000","last_undegraded":"2024-09-13T18:47:19.488746+0000","last_fullsized":"2024-09-13T18:47:19.488746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591343+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:47:19.591343+0000","last_peered":"2024-09-13T18:47:19.591343+0000","last_clean":"2024-09-13T18:47:19.591343+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:47:19.591343+0000","last_undegraded":"2024-09-13T18:47:19.591343+0000","last_fullsized":"2024-09-13T18:47:19.591343+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092727+0000","last_change":"2024-09-13T18:47:19.599505+0000","last_active":"2024-09-13T18:47:20.092727+0000","last_peered":"2024-09-13T18:47:20.092727+0000","last_clean":"2024-09-13T18:47:20.092727+0000","last_became_active":"2024-09-13T18:47:19.599105+0000","last_became_peered":"2024-09-13T18:47:19.599105+0000","last_unstale":"2024-09-13T18:47:20.092727+0000","last_undegraded":"2024-09-13T18:47:20.092727+0000","last_fullsized":"2024-09-13T18:47:20.092727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:44.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591948+0000","last_change":"2024-09-13T18:47:15.491819+0000","last_active":"2024-09-13T18:47:19.591948+0000","last_peered":"2024-09-13T18:47:19.591948+0000","last_clean":"2024-09-13T18:47:19.591948+0000","last_became_active":"2024-09-13T18:47:15.491497+0000","last_became_peered":"2024-09-13T18:47:15.491497+0000","last_unstale":"2024-09-13T18:47:19.591948+0000","last_undegraded":"2024-09-13T18:47:19.591948+0000","last_fullsized":"2024-09-13T18:47:19.591948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:48.271498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498674+0000","last_change":"2024-09-13T18:47:14.990404+0000","last_active":"2024-09-13T18:47:19.498674+0000","last_peered":"2024-09-13T18:47:19.498674+0000","last_clean":"2024-09-13T18:47:19.498674+0000","last_became_active":"2024-09-13T18:47:14.990115+0000","last_became_peered":"2024-09-13T18:47:14.990115+0000","last_unstale":"2024-09-13T18:47:19.498674+0000","last_undegraded":"2024-09-13T18:47:19.498674+0000","last_fullsized":"2024-09-13T18:47:19.498674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.088631+0000","last_change":"2024-09-13T18:47:19.594274+0000","last_active":"2024-09-13T18:47:20.088631+0000","last_peered":"2024-09-13T18:47:20.088631+0000","last_clean":"2024-09-13T18:47:20.088631+0000","last_became_active":"2024-09-13T18:47:19.593700+0000","last_became_peered":"2024-09-13T18:47:19.593700+0000","last_unstale":"2024-09-13T18:47:20.088631+0000","last_undegraded":"2024-09-13T18:47:20.088631+0000","last_fullsized":"2024-09-13T18:47:20.088631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489145+0000","last_change":"2024-09-13T18:47:15.478629+0000","last_active":"2024-09-13T18:47:19.489145+0000","last_peered":"2024-09-13T18:47:19.489145+0000","last_clean":"2024-09-13T18:47:19.489145+0000","last_became_active":"2024-09-13T18:47:15.476132+0000","last_became_peered":"2024-09-13T18:47:15.476132+0000","last_unstale":"2024-09-13T18:47:19.489145+0000","last_undegraded":"2024-09-13T18:47:19.489145+0000","last_fullsized":"2024-09-13T18:47:19.489145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493042+0000","last_change":"2024-09-13T18:47:14.995147+0000","last_active":"2024-09-13T18:47:19.493042+0000","last_peered":"2024-09-13T18:47:19.493042+0000","last_clean":"2024-09-13T18:47:19.493042+0000","last_became_active":"2024-09-13T18:47:14.994931+0000","last_became_peered":"2024-09-13T18:47:14.994931+0000","last_unstale":"2024-09-13T18:47:19.493042+0000","last_undegraded":"2024-09-13T18:47:19.493042+0000","last_fullsized":"2024-09-13T18:47:19.493042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961957+0000","last_change":"2024-09-13T18:47:19.510647+0000","last_active":"2024-09-13T18:47:19.961957+0000","last_peered":"2024-09-13T18:47:19.961957+0000","last_clean":"2024-09-13T18:47:19.961957+0000","last_became_active":"2024-09-13T18:47:19.508746+0000","last_became_peered":"2024-09-13T18:47:19.508746+0000","last_unstale":"2024-09-13T18:47:19.961957+0000","last_undegraded":"2024-09-13T18:47:19.961957+0000","last_fullsized":"2024-09-13T18:47:19.961957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:26.043628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592399+0000","last_change":"2024-09-13T18:47:15.494681+0000","last_active":"2024-09-13T18:47:19.592399+0000","last_peered":"2024-09-13T18:47:19.592399+0000","last_clean":"2024-09-13T18:47:19.592399+0000","last_became_active":"2024-09-13T18:47:15.490395+0000","last_became_peered":"2024-09-13T18:47:15.490395+0000","last_unstale":"2024-09-13T18:47:19.592399+0000","last_undegraded":"2024-09-13T18:47:19.592399+0000","last_fullsized":"2024-09-13T18:47:19.592399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499936+0000","last_change":"2024-09-13T18:47:14.992959+0000","last_active":"2024-09-13T18:47:19.499936+0000","last_peered":"2024-09-13T18:47:19.499936+0000","last_clean":"2024-09-13T18:47:19.499936+0000","last_became_active":"2024-09-13T18:47:14.989696+0000","last_became_peered":"2024-09-13T18:47:14.989696+0000","last_unstale":"2024-09-13T18:47:19.499936+0000","last_undegraded":"2024-09-13T18:47:19.499936+0000","last_fullsized":"2024-09-13T18:47:19.499936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:46.523824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.092955+0000","last_change":"2024-09-13T18:47:19.594315+0000","last_active":"2024-09-13T18:47:20.092955+0000","last_peered":"2024-09-13T18:47:20.092955+0000","last_clean":"2024-09-13T18:47:20.092955+0000","last_became_active":"2024-09-13T18:47:19.593856+0000","last_became_peered":"2024-09-13T18:47:19.593856+0000","last_unstale":"2024-09-13T18:47:20.092955+0000","last_undegraded":"2024-09-13T18:47:20.092955+0000","last_fullsized":"2024-09-13T18:47:20.092955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:52.422924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592241+0000","last_change":"2024-09-13T18:47:15.493079+0000","last_active":"2024-09-13T18:47:19.592241+0000","last_peered":"2024-09-13T18:47:19.592241+0000","last_clean":"2024-09-13T18:47:19.592241+0000","last_became_active":"2024-09-13T18:47:15.492647+0000","last_became_peered":"2024-09-13T18:47:15.492647+0000","last_unstale":"2024-09-13T18:47:19.592241+0000","last_undegraded":"2024-09-13T18:47:19.592241+0000","last_fullsized":"2024-09-13T18:47:19.592241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:55.125290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.494245+0000","last_change":"2024-09-13T18:47:15.001931+0000","last_active":"2024-09-13T18:47:19.494245+0000","last_peered":"2024-09-13T18:47:19.494245+0000","last_clean":"2024-09-13T18:47:19.494245+0000","last_became_active":"2024-09-13T18:47:15.001488+0000","last_became_peered":"2024-09-13T18:47:15.001488+0000","last_unstale":"2024-09-13T18:47:19.494245+0000","last_undegraded":"2024-09-13T18:47:19.494245+0000","last_fullsized":"2024-09-13T18:47:19.494245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:55.883156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089502+0000","last_change":"2024-09-13T18:47:19.507944+0000","last_active":"2024-09-13T18:47:20.089502+0000","last_peered":"2024-09-13T18:47:20.089502+0000","last_clean":"2024-09-13T18:47:20.089502+0000","last_became_active":"2024-09-13T18:47:19.506708+0000","last_became_peered":"2024-09-13T18:47:19.506708+0000","last_unstale":"2024-09-13T18:47:20.089502+0000","last_undegraded":"2024-09-13T18:47:20.089502+0000","last_fullsized":"2024-09-13T18:47:20.089502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:12.199448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591479+0000","last_change":"2024-09-13T18:47:15.482887+0000","last_active":"2024-09-13T18:47:19.591479+0000","last_peered":"2024-09-13T18:47:19.591479+0000","last_clean":"2024-09-13T18:47:19.591479+0000","last_became_active":"2024-09-13T18:47:15.482616+0000","last_became_peered":"2024-09-13T18:47:15.482616+0000","last_unstale":"2024-09-13T18:47:19.591479+0000","last_undegraded":"2024-09-13T18:47:19.591479+0000","last_fullsized":"2024-09-13T18:47:19.591479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:44.301458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499180+0000","last_change":"2024-09-13T18:47:14.983612+0000","last_active":"2024-09-13T18:47:19.499180+0000","last_peered":"2024-09-13T18:47:19.499180+0000","last_clean":"2024-09-13T18:47:19.499180+0000","last_became_active":"2024-09-13T18:47:14.983354+0000","last_became_peered":"2024-09-13T18:47:14.983354+0000","last_unstale":"2024-09-13T18:47:19.499180+0000","last_undegraded":"2024-09-13T18:47:19.499180+0000","last_fullsized":"2024-09-13T18:47:19.499180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.963361+0000","last_change":"2024-09-13T18:47:19.504797+0000","last_active":"2024-09-13T18:47:19.963361+0000","last_peered":"2024-09-13T18:47:19.963361+0000","last_clean":"2024-09-13T18:47:19.963361+0000","last_became_active":"2024-09-13T18:47:19.504472+0000","last_became_peered":"2024-09-13T18:47:19.504472+0000","last_unstale":"2024-09-13T18:47:19.963361+0000","last_undegraded":"2024-09-13T18:47:19.963361+0000","last_fullsized":"2024-09-13T18:47:19.963361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495782+0000","last_change":"2024-09-13T18:47:15.469363+0000","last_active":"2024-09-13T18:47:19.495782+0000","last_peered":"2024-09-13T18:47:19.495782+0000","last_clean":"2024-09-13T18:47:19.495782+0000","last_became_active":"2024-09-13T18:47:15.468718+0000","last_became_peered":"2024-09-13T18:47:15.468718+0000","last_unstale":"2024-09-13T18:47:19.495782+0000","last_undegraded":"2024-09-13T18:47:19.495782+0000","last_fullsized":"2024-09-13T18:47:19.495782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499734+0000","last_change":"2024-09-13T18:47:15.006188+0000","last_active":"2024-09-13T18:47:19.499734+0000","last_peered":"2024-09-13T18:47:19.499734+0000","last_clean":"2024-09-13T18:47:19.499734+0000","last_became_active":"2024-09-13T18:47:15.003764+0000","last_became_peered":"2024-09-13T18:47:15.003764+0000","last_unstale":"2024-09-13T18:47:19.499734+0000","last_undegraded":"2024-09-13T18:47:19.499734+0000","last_fullsized":"2024-09-13T18:47:19.499734+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962715+0000","last_change":"2024-09-13T18:47:19.597771+0000","last_active":"2024-09-13T18:47:19.962715+0000","last_peered":"2024-09-13T18:47:19.962715+0000","last_clean":"2024-09-13T18:47:19.962715+0000","last_became_active":"2024-09-13T18:47:19.597144+0000","last_became_peered":"2024-09-13T18:47:19.597144+0000","last_unstale":"2024-09-13T18:47:19.962715+0000","last_undegraded":"2024-09-13T18:47:19.962715+0000","last_fullsized":"2024-09-13T18:47:19.962715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.794670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592050+0000","last_change":"2024-09-13T18:47:15.484848+0000","last_active":"2024-09-13T18:47:19.592050+0000","last_peered":"2024-09-13T18:47:19.592050+0000","last_clean":"2024-09-13T18:47:19.592050+0000","last_became_active":"2024-09-13T18:47:15.484444+0000","last_became_peered":"2024-09-13T18:47:15.484444+0000","last_unstale":"2024-09-13T18:47:19.592050+0000","last_undegraded":"2024-09-13T18:47:19.592050+0000","last_fullsized":"2024-09-13T18:47:19.592050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489024+0000","last_change":"2024-09-13T18:47:14.991470+0000","last_active":"2024-09-13T18:47:19.489024+0000","last_peered":"2024-09-13T18:47:19.489024+0000","last_clean":"2024-09-13T18:47:19.489024+0000","last_became_active":"2024-09-13T18:47:14.991135+0000","last_became_peered":"2024-09-13T18:47:14.991135+0000","last_unstale":"2024-09-13T18:47:19.489024+0000","last_undegraded":"2024-09-13T18:47:19.489024+0000","last_fullsized":"2024-09-13T18:47:19.489024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:27.824654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962615+0000","last_change":"2024-09-13T18:47:19.593992+0000","last_active":"2024-09-13T18:47:19.962615+0000","last_peered":"2024-09-13T18:47:19.962615+0000","last_clean":"2024-09-13T18:47:19.962615+0000","last_became_active":"2024-09-13T18:47:19.591585+0000","last_became_peered":"2024-09-13T18:47:19.591585+0000","last_unstale":"2024-09-13T18:47:19.962615+0000","last_undegraded":"2024-09-13T18:47:19.962615+0000","last_fullsized":"2024-09-13T18:47:19.962615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:29.971970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487602+0000","last_change":"2024-09-13T18:47:15.463821+0000","last_active":"2024-09-13T18:47:19.487602+0000","last_peered":"2024-09-13T18:47:19.487602+0000","last_clean":"2024-09-13T18:47:19.487602+0000","last_became_active":"2024-09-13T18:47:15.463563+0000","last_became_peered":"2024-09-13T18:47:15.463563+0000","last_unstale":"2024-09-13T18:47:19.487602+0000","last_undegraded":"2024-09-13T18:47:19.487602+0000","last_fullsized":"2024-09-13T18:47:19.487602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488046+0000","last_change":"2024-09-13T18:47:14.990471+0000","last_active":"2024-09-13T18:47:19.488046+0000","last_peered":"2024-09-13T18:47:19.488046+0000","last_clean":"2024-09-13T18:47:19.488046+0000","last_became_active":"2024-09-13T18:47:14.990222+0000","last_became_peered":"2024-09-13T18:47:14.990222+0000","last_unstale":"2024-09-13T18:47:19.488046+0000","last_undegraded":"2024-09-13T18:47:19.488046+0000","last_fullsized":"2024-09-13T18:47:19.488046+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.093959+0000","last_change":"2024-09-13T18:47:19.594886+0000","last_active":"2024-09-13T18:47:20.093959+0000","last_peered":"2024-09-13T18:47:20.093959+0000","last_clean":"2024-09-13T18:47:20.093959+0000","last_became_active":"2024-09-13T18:47:19.593831+0000","last_became_peered":"2024-09-13T18:47:19.593831+0000","last_unstale":"2024-09-13T18:47:20.093959+0000","last_undegraded":"2024-09-13T18:47:20.093959+0000","last_fullsized":"2024-09-13T18:47:20.093959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:50.947334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591916+0000","last_change":"2024-09-13T18:47:15.495522+0000","last_active":"2024-09-13T18:47:19.591916+0000","last_peered":"2024-09-13T18:47:19.591916+0000","last_clean":"2024-09-13T18:47:19.591916+0000","last_became_active":"2024-09-13T18:47:15.495212+0000","last_became_peered":"2024-09-13T18:47:15.495212+0000","last_unstale":"2024-09-13T18:47:19.591916+0000","last_undegraded":"2024-09-13T18:47:19.591916+0000","last_fullsized":"2024-09-13T18:47:19.591916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:32.484198+0000","last_change":"2024-09-13T18:47:15.000232+0000","last_active":"2024-09-13T18:47:32.484198+0000","last_peered":"2024-09-13T18:47:32.484198+0000","last_clean":"2024-09-13T18:47:32.484198+0000","last_became_active":"2024-09-13T18:47:14.993720+0000","last_became_peered":"2024-09-13T18:47:14.993720+0000","last_unstale":"2024-09-13T18:47:32.484198+0000","last_undegraded":"2024-09-13T18:47:32.484198+0000","last_fullsized":"2024-09-13T18:47:32.484198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.083179+0000","last_change":"2024-09-13T18:47:19.515199+0000","last_active":"2024-09-13T18:47:20.083179+0000","last_peered":"2024-09-13T18:47:20.083179+0000","last_clean":"2024-09-13T18:47:20.083179+0000","last_became_active":"2024-09-13T18:47:19.514767+0000","last_became_peered":"2024-09-13T18:47:19.514767+0000","last_unstale":"2024-09-13T18:47:20.083179+0000","last_undegraded":"2024-09-13T18:47:20.083179+0000","last_fullsized":"2024-09-13T18:47:20.083179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:12.518830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497412+0000","last_change":"2024-09-13T18:47:15.471819+0000","last_active":"2024-09-13T18:47:19.497412+0000","last_peered":"2024-09-13T18:47:19.497412+0000","last_clean":"2024-09-13T18:47:19.497412+0000","last_became_active":"2024-09-13T18:47:15.470912+0000","last_became_peered":"2024-09-13T18:47:15.470912+0000","last_unstale":"2024-09-13T18:47:19.497412+0000","last_undegraded":"2024-09-13T18:47:19.497412+0000","last_fullsized":"2024-09-13T18:47:19.497412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492949+0000","last_change":"2024-09-13T18:47:14.986030+0000","last_active":"2024-09-13T18:47:19.492949+0000","last_peered":"2024-09-13T18:47:19.492949+0000","last_clean":"2024-09-13T18:47:19.492949+0000","last_became_active":"2024-09-13T18:47:14.984931+0000","last_became_peered":"2024-09-13T18:47:14.984931+0000","last_unstale":"2024-09-13T18:47:19.492949+0000","last_undegraded":"2024-09-13T18:47:19.492949+0000","last_fullsized":"2024-09-13T18:47:19.492949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:19.590763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.089956+0000","last_change":"2024-09-13T18:47:19.507392+0000","last_active":"2024-09-13T18:47:20.089956+0000","last_peered":"2024-09-13T18:47:20.089956+0000","last_clean":"2024-09-13T18:47:20.089956+0000","last_became_active":"2024-09-13T18:47:19.506702+0000","last_became_peered":"2024-09-13T18:47:19.506702+0000","last_unstale":"2024-09-13T18:47:20.089956+0000","last_undegraded":"2024-09-13T18:47:20.089956+0000","last_fullsized":"2024-09-13T18:47:20.089956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:13.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.491898+0000","last_change":"2024-09-13T18:47:15.478357+0000","last_active":"2024-09-13T18:47:19.491898+0000","last_peered":"2024-09-13T18:47:19.491898+0000","last_clean":"2024-09-13T18:47:19.491898+0000","last_became_active":"2024-09-13T18:47:15.471984+0000","last_became_peered":"2024-09-13T18:47:15.471984+0000","last_unstale":"2024-09-13T18:47:19.491898+0000","last_undegraded":"2024-09-13T18:47:19.491898+0000","last_fullsized":"2024-09-13T18:47:19.491898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:56.409431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489487+0000","last_change":"2024-09-13T18:47:14.994513+0000","last_active":"2024-09-13T18:47:19.489487+0000","last_peered":"2024-09-13T18:47:19.489487+0000","last_clean":"2024-09-13T18:47:19.489487+0000","last_became_active":"2024-09-13T18:47:14.994172+0000","last_became_peered":"2024-09-13T18:47:14.994172+0000","last_unstale":"2024-09-13T18:47:19.489487+0000","last_undegraded":"2024-09-13T18:47:19.489487+0000","last_fullsized":"2024-09-13T18:47:19.489487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:51.567908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961893+0000","last_change":"2024-09-13T18:47:19.503298+0000","last_active":"2024-09-13T18:47:19.961893+0000","last_peered":"2024-09-13T18:47:19.961893+0000","last_clean":"2024-09-13T18:47:19.961893+0000","last_became_active":"2024-09-13T18:47:19.502791+0000","last_became_peered":"2024-09-13T18:47:19.502791+0000","last_unstale":"2024-09-13T18:47:19.961893+0000","last_undegraded":"2024-09-13T18:47:19.961893+0000","last_fullsized":"2024-09-13T18:47:19.961893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:34.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489361+0000","last_change":"2024-09-13T18:47:15.478250+0000","last_active":"2024-09-13T18:47:19.489361+0000","last_peered":"2024-09-13T18:47:19.489361+0000","last_clean":"2024-09-13T18:47:19.489361+0000","last_became_active":"2024-09-13T18:47:15.477916+0000","last_became_peered":"2024-09-13T18:47:15.477916+0000","last_unstale":"2024-09-13T18:47:19.489361+0000","last_undegraded":"2024-09-13T18:47:19.489361+0000","last_fullsized":"2024-09-13T18:47:19.489361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:38.623577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501456+0000","last_change":"2024-09-13T18:47:14.992683+0000","last_active":"2024-09-13T18:47:19.501456+0000","last_peered":"2024-09-13T18:47:19.501456+0000","last_clean":"2024-09-13T18:47:19.501456+0000","last_became_active":"2024-09-13T18:47:14.992232+0000","last_became_peered":"2024-09-13T18:47:14.992232+0000","last_unstale":"2024-09-13T18:47:19.501456+0000","last_undegraded":"2024-09-13T18:47:19.501456+0000","last_fullsized":"2024-09-13T18:47:19.501456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:49.334432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962042+0000","last_change":"2024-09-13T18:47:19.596501+0000","last_active":"2024-09-13T18:47:19.962042+0000","last_peered":"2024-09-13T18:47:19.962042+0000","last_clean":"2024-09-13T18:47:19.962042+0000","last_became_active":"2024-09-13T18:47:19.590331+0000","last_became_peered":"2024-09-13T18:47:19.590331+0000","last_unstale":"2024-09-13T18:47:19.962042+0000","last_undegraded":"2024-09-13T18:47:19.962042+0000","last_fullsized":"2024-09-13T18:47:19.962042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:10.553259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.961696+0000","last_change":"2024-09-13T18:47:19.596767+0000","last_active":"2024-09-13T18:47:19.961696+0000","last_peered":"2024-09-13T18:47:19.961696+0000","last_clean":"2024-09-13T18:47:19.961696+0000","last_became_active":"2024-09-13T18:47:19.595887+0000","last_became_peered":"2024-09-13T18:47:19.595887+0000","last_unstale":"2024-09-13T18:47:19.961696+0000","last_undegraded":"2024-09-13T18:47:19.961696+0000","last_fullsized":"2024-09-13T18:47:19.961696+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:09:49.827540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492575+0000","last_change":"2024-09-13T18:47:15.471603+0000","last_active":"2024-09-13T18:47:19.492575+0000","last_peered":"2024-09-13T18:47:19.492575+0000","last_clean":"2024-09-13T18:47:19.492575+0000","last_became_active":"2024-09-13T18:47:15.471339+0000","last_became_peered":"2024-09-13T18:47:15.471339+0000","last_unstale":"2024-09-13T18:47:19.492575+0000","last_undegraded":"2024-09-13T18:47:19.492575+0000","last_fullsized":"2024-09-13T18:47:19.492575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489486+0000","last_change":"2024-09-13T18:47:14.987617+0000","last_active":"2024-09-13T18:47:19.489486+0000","last_peered":"2024-09-13T18:47:19.489486+0000","last_clean":"2024-09-13T18:47:19.489486+0000","last_became_active":"2024-09-13T18:47:14.987317+0000","last_became_peered":"2024-09-13T18:47:14.987317+0000","last_unstale":"2024-09-13T18:47:19.489486+0000","last_undegraded":"2024-09-13T18:47:19.489486+0000","last_fullsized":"2024-09-13T18:47:19.489486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:20.090892+0000","last_change":"2024-09-13T18:47:19.509912+0000","last_active":"2024-09-13T18:47:20.090892+0000","last_peered":"2024-09-13T18:47:20.090892+0000","last_clean":"2024-09-13T18:47:20.090892+0000","last_became_active":"2024-09-13T18:47:19.509495+0000","last_became_peered":"2024-09-13T18:47:19.509495+0000","last_unstale":"2024-09-13T18:47:20.090892+0000","last_undegraded":"2024-09-13T18:47:20.090892+0000","last_fullsized":"2024-09-13T18:47:20.090892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:47.911959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487233+0000","last_change":"2024-09-13T18:47:15.471151+0000","last_active":"2024-09-13T18:47:19.487233+0000","last_peered":"2024-09-13T18:47:19.487233+0000","last_clean":"2024-09-13T18:47:19.487233+0000","last_became_active":"2024-09-13T18:47:15.470918+0000","last_became_peered":"2024-09-13T18:47:15.470918+0000","last_unstale":"2024-09-13T18:47:19.487233+0000","last_undegraded":"2024-09-13T18:47:19.487233+0000","last_fullsized":"2024-09-13T18:47:19.487233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488692+0000","last_change":"2024-09-13T18:47:14.991806+0000","last_active":"2024-09-13T18:47:19.488692+0000","last_peered":"2024-09-13T18:47:19.488692+0000","last_clean":"2024-09-13T18:47:19.488692+0000","last_became_active":"2024-09-13T18:47:14.991545+0000","last_became_peered":"2024-09-13T18:47:14.991545+0000","last_unstale":"2024-09-13T18:47:19.488692+0000","last_undegraded":"2024-09-13T18:47:19.488692+0000","last_fullsized":"2024-09-13T18:47:19.488692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:59.200089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500273+0000","last_change":"2024-09-13T18:47:14.999437+0000","last_active":"2024-09-13T18:47:19.500273+0000","last_peered":"2024-09-13T18:47:19.500273+0000","last_clean":"2024-09-13T18:47:19.500273+0000","last_became_active":"2024-09-13T18:47:14.993774+0000","last_became_peered":"2024-09-13T18:47:14.993774+0000","last_unstale":"2024-09-13T18:47:19.500273+0000","last_undegraded":"2024-09-13T18:47:19.500273+0000","last_fullsized":"2024-09-13T18:47:19.500273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:04.025643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487997+0000","last_change":"2024-09-13T18:47:15.459688+0000","last_active":"2024-09-13T18:47:19.487997+0000","last_peered":"2024-09-13T18:47:19.487997+0000","last_clean":"2024-09-13T18:47:19.487997+0000","last_became_active":"2024-09-13T18:47:15.459427+0000","last_became_peered":"2024-09-13T18:47:15.459427+0000","last_unstale":"2024-09-13T18:47:19.487997+0000","last_undegraded":"2024-09-13T18:47:19.487997+0000","last_fullsized":"2024-09-13T18:47:19.487997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.960515+0000","last_change":"2024-09-13T18:47:19.509191+0000","last_active":"2024-09-13T18:47:19.960515+0000","last_peered":"2024-09-13T18:47:19.960515+0000","last_clean":"2024-09-13T18:47:19.960515+0000","last_became_active":"2024-09-13T18:47:19.505978+0000","last_became_peered":"2024-09-13T18:47:19.505978+0000","last_unstale":"2024-09-13T18:47:19.960515+0000","last_undegraded":"2024-09-13T18:47:19.960515+0000","last_fullsized":"2024-09-13T18:47:19.960515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:54.531127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487778+0000","last_change":"2024-09-13T18:47:14.996586+0000","last_active":"2024-09-13T18:47:19.487778+0000","last_peered":"2024-09-13T18:47:19.487778+0000","last_clean":"2024-09-13T18:47:19.487778+0000","last_became_active":"2024-09-13T18:47:14.996310+0000","last_became_peered":"2024-09-13T18:47:14.996310+0000","last_unstale":"2024-09-13T18:47:19.487778+0000","last_undegraded":"2024-09-13T18:47:19.487778+0000","last_fullsized":"2024-09-13T18:47:19.487778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:13.941302+0000","last_clean_scrub_stamp":"2024-09-13T18:47:13.941302+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:19.619184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497807+0000","last_change":"2024-09-13T18:47:15.478387+0000","last_active":"2024-09-13T18:47:19.497807+0000","last_peered":"2024-09-13T18:47:19.497807+0000","last_clean":"2024-09-13T18:47:19.497807+0000","last_became_active":"2024-09-13T18:47:15.478052+0000","last_became_peered":"2024-09-13T18:47:15.478052+0000","last_unstale":"2024-09-13T18:47:19.497807+0000","last_undegraded":"2024-09-13T18:47:19.497807+0000","last_fullsized":"2024-09-13T18:47:19.497807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:20.602614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.962836+0000","last_change":"2024-09-13T18:47:19.511484+0000","last_active":"2024-09-13T18:47:19.962836+0000","last_peered":"2024-09-13T18:47:19.962836+0000","last_clean":"2024-09-13T18:47:19.962836+0000","last_became_active":"2024-09-13T18:47:19.511269+0000","last_became_peered":"2024-09-13T18:47:19.511269+0000","last_unstale":"2024-09-13T18:47:19.962836+0000","last_undegraded":"2024-09-13T18:47:19.962836+0000","last_fullsized":"2024-09-13T18:47:19.962836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:18.463362+0000","last_clean_scrub_stamp":"2024-09-13T18:47:18.463362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:27.500957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.495634+0000","last_change":"2024-09-13T18:47:15.471234+0000","last_active":"2024-09-13T18:47:19.495634+0000","last_peered":"2024-09-13T18:47:19.495634+0000","last_clean":"2024-09-13T18:47:19.495634+0000","last_became_active":"2024-09-13T18:47:15.469073+0000","last_became_peered":"2024-09-13T18:47:15.469073+0000","last_unstale":"2024-09-13T18:47:19.495634+0000","last_undegraded":"2024-09-13T18:47:19.495634+0000","last_fullsized":"2024-09-13T18:47:19.495634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.498324+0000","last_change":"2024-09-13T18:47:15.484477+0000","last_active":"2024-09-13T18:47:19.498324+0000","last_peered":"2024-09-13T18:47:19.498324+0000","last_clean":"2024-09-13T18:47:19.498324+0000","last_became_active":"2024-09-13T18:47:15.484155+0000","last_became_peered":"2024-09-13T18:47:15.484155+0000","last_unstale":"2024-09-13T18:47:19.498324+0000","last_undegraded":"2024-09-13T18:47:19.498324+0000","last_fullsized":"2024-09-13T18:47:19.498324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:39.856879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488918+0000","last_change":"2024-09-13T18:47:15.478632+0000","last_active":"2024-09-13T18:47:19.488918+0000","last_peered":"2024-09-13T18:47:19.488918+0000","last_clean":"2024-09-13T18:47:19.488918+0000","last_became_active":"2024-09-13T18:47:15.477839+0000","last_became_peered":"2024-09-13T18:47:15.477839+0000","last_unstale":"2024-09-13T18:47:19.488918+0000","last_undegraded":"2024-09-13T18:47:19.488918+0000","last_fullsized":"2024-09-13T18:47:19.488918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487900+0000","last_change":"2024-09-13T18:47:15.468102+0000","last_active":"2024-09-13T18:47:19.487900+0000","last_peered":"2024-09-13T18:47:19.487900+0000","last_clean":"2024-09-13T18:47:19.487900+0000","last_became_active":"2024-09-13T18:47:15.467859+0000","last_became_peered":"2024-09-13T18:47:15.467859+0000","last_unstale":"2024-09-13T18:47:19.487900+0000","last_undegraded":"2024-09-13T18:47:19.487900+0000","last_fullsized":"2024-09-13T18:47:19.487900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:38.771394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490262+0000","last_change":"2024-09-13T18:47:15.483966+0000","last_active":"2024-09-13T18:47:19.490262+0000","last_peered":"2024-09-13T18:47:19.490262+0000","last_clean":"2024-09-13T18:47:19.490262+0000","last_became_active":"2024-09-13T18:47:15.483703+0000","last_became_peered":"2024-09-13T18:47:15.483703+0000","last_unstale":"2024-09-13T18:47:19.490262+0000","last_undegraded":"2024-09-13T18:47:19.490262+0000","last_fullsized":"2024-09-13T18:47:19.490262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492839+0000","last_change":"2024-09-13T18:47:15.473022+0000","last_active":"2024-09-13T18:47:19.492839+0000","last_peered":"2024-09-13T18:47:19.492839+0000","last_clean":"2024-09-13T18:47:19.492839+0000","last_became_active":"2024-09-13T18:47:15.472759+0000","last_became_peered":"2024-09-13T18:47:15.472759+0000","last_unstale":"2024-09-13T18:47:19.492839+0000","last_undegraded":"2024-09-13T18:47:19.492839+0000","last_fullsized":"2024-09-13T18:47:19.492839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:37.821510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.501045+0000","last_change":"2024-09-13T18:47:15.498630+0000","last_active":"2024-09-13T18:47:19.501045+0000","last_peered":"2024-09-13T18:47:19.501045+0000","last_clean":"2024-09-13T18:47:19.501045+0000","last_became_active":"2024-09-13T18:47:15.489640+0000","last_became_peered":"2024-09-13T18:47:15.489640+0000","last_unstale":"2024-09-13T18:47:19.501045+0000","last_undegraded":"2024-09-13T18:47:19.501045+0000","last_fullsized":"2024-09-13T18:47:19.501045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487931+0000","last_change":"2024-09-13T18:47:15.484677+0000","last_active":"2024-09-13T18:47:19.487931+0000","last_peered":"2024-09-13T18:47:19.487931+0000","last_clean":"2024-09-13T18:47:19.487931+0000","last_became_active":"2024-09-13T18:47:15.484344+0000","last_became_peered":"2024-09-13T18:47:15.484344+0000","last_unstale":"2024-09-13T18:47:19.487931+0000","last_undegraded":"2024-09-13T18:47:19.487931+0000","last_fullsized":"2024-09-13T18:47:19.487931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.490604+0000","last_change":"2024-09-13T18:47:15.480276+0000","last_active":"2024-09-13T18:47:19.490604+0000","last_peered":"2024-09-13T18:47:19.490604+0000","last_clean":"2024-09-13T18:47:19.490604+0000","last_became_active":"2024-09-13T18:47:15.477492+0000","last_became_peered":"2024-09-13T18:47:15.477492+0000","last_unstale":"2024-09-13T18:47:19.490604+0000","last_undegraded":"2024-09-13T18:47:19.490604+0000","last_fullsized":"2024-09-13T18:47:19.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488622+0000","last_change":"2024-09-13T18:47:15.484967+0000","last_active":"2024-09-13T18:47:19.488622+0000","last_peered":"2024-09-13T18:47:19.488622+0000","last_clean":"2024-09-13T18:47:19.488622+0000","last_became_active":"2024-09-13T18:47:15.484678+0000","last_became_peered":"2024-09-13T18:47:15.484678+0000","last_unstale":"2024-09-13T18:47:19.488622+0000","last_undegraded":"2024-09-13T18:47:19.488622+0000","last_fullsized":"2024-09-13T18:47:19.488622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488812+0000","last_change":"2024-09-13T18:47:15.486476+0000","last_active":"2024-09-13T18:47:19.488812+0000","last_peered":"2024-09-13T18:47:19.488812+0000","last_clean":"2024-09-13T18:47:19.488812+0000","last_became_active":"2024-09-13T18:47:15.478333+0000","last_became_peered":"2024-09-13T18:47:15.478333+0000","last_unstale":"2024-09-13T18:47:19.488812+0000","last_undegraded":"2024-09-13T18:47:19.488812+0000","last_fullsized":"2024-09-13T18:47:19.488812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:06.110697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487773+0000","last_change":"2024-09-13T18:47:15.465478+0000","last_active":"2024-09-13T18:47:19.487773+0000","last_peered":"2024-09-13T18:47:19.487773+0000","last_clean":"2024-09-13T18:47:19.487773+0000","last_became_active":"2024-09-13T18:47:15.463578+0000","last_became_peered":"2024-09-13T18:47:15.463578+0000","last_unstale":"2024-09-13T18:47:19.487773+0000","last_undegraded":"2024-09-13T18:47:19.487773+0000","last_fullsized":"2024-09-13T18:47:19.487773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500654+0000","last_change":"2024-09-13T18:47:15.480360+0000","last_active":"2024-09-13T18:47:19.500654+0000","last_peered":"2024-09-13T18:47:19.500654+0000","last_clean":"2024-09-13T18:47:19.500654+0000","last_became_active":"2024-09-13T18:47:15.480117+0000","last_became_peered":"2024-09-13T18:47:15.480117+0000","last_unstale":"2024-09-13T18:47:19.500654+0000","last_undegraded":"2024-09-13T18:47:19.500654+0000","last_fullsized":"2024-09-13T18:47:19.500654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592107+0000","last_change":"2024-09-13T18:47:15.480704+0000","last_active":"2024-09-13T18:47:19.592107+0000","last_peered":"2024-09-13T18:47:19.592107+0000","last_clean":"2024-09-13T18:47:19.592107+0000","last_became_active":"2024-09-13T18:47:15.480427+0000","last_became_peered":"2024-09-13T18:47:15.480427+0000","last_unstale":"2024-09-13T18:47:19.592107+0000","last_undegraded":"2024-09-13T18:47:19.592107+0000","last_fullsized":"2024-09-13T18:47:19.592107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.499735+0000","last_change":"2024-09-13T18:47:15.483066+0000","last_active":"2024-09-13T18:47:19.499735+0000","last_peered":"2024-09-13T18:47:19.499735+0000","last_clean":"2024-09-13T18:47:19.499735+0000","last_became_active":"2024-09-13T18:47:15.482829+0000","last_became_peered":"2024-09-13T18:47:15.482829+0000","last_unstale":"2024-09-13T18:47:19.499735+0000","last_undegraded":"2024-09-13T18:47:19.499735+0000","last_fullsized":"2024-09-13T18:47:19.499735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:39:19.464118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489201+0000","last_change":"2024-09-13T18:47:15.480926+0000","last_active":"2024-09-13T18:47:19.489201+0000","last_peered":"2024-09-13T18:47:19.489201+0000","last_clean":"2024-09-13T18:47:19.489201+0000","last_became_active":"2024-09-13T18:47:15.475793+0000","last_became_peered":"2024-09-13T18:47:15.475793+0000","last_unstale":"2024-09-13T18:47:19.489201+0000","last_undegraded":"2024-09-13T18:47:19.489201+0000","last_fullsized":"2024-09-13T18:47:19.489201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.489302+0000","last_change":"2024-09-13T18:47:15.476117+0000","last_active":"2024-09-13T18:47:19.489302+0000","last_peered":"2024-09-13T18:47:19.489302+0000","last_clean":"2024-09-13T18:47:19.489302+0000","last_became_active":"2024-09-13T18:47:15.474650+0000","last_became_peered":"2024-09-13T18:47:15.474650+0000","last_unstale":"2024-09-13T18:47:19.489302+0000","last_undegraded":"2024-09-13T18:47:19.489302+0000","last_fullsized":"2024-09-13T18:47:19.489302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.492576+0000","last_change":"2024-09-13T18:47:15.462353+0000","last_active":"2024-09-13T18:47:19.492576+0000","last_peered":"2024-09-13T18:47:19.492576+0000","last_clean":"2024-09-13T18:47:19.492576+0000","last_became_active":"2024-09-13T18:47:15.462033+0000","last_became_peered":"2024-09-13T18:47:15.462033+0000","last_unstale":"2024-09-13T18:47:19.492576+0000","last_undegraded":"2024-09-13T18:47:19.492576+0000","last_fullsized":"2024-09-13T18:47:19.492576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487542+0000","last_change":"2024-09-13T18:47:15.476234+0000","last_active":"2024-09-13T18:47:19.487542+0000","last_peered":"2024-09-13T18:47:19.487542+0000","last_clean":"2024-09-13T18:47:19.487542+0000","last_became_active":"2024-09-13T18:47:15.475946+0000","last_became_peered":"2024-09-13T18:47:15.475946+0000","last_unstale":"2024-09-13T18:47:19.487542+0000","last_undegraded":"2024-09-13T18:47:19.487542+0000","last_fullsized":"2024-09-13T18:47:19.487542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487685+0000","last_change":"2024-09-13T18:47:15.467147+0000","last_active":"2024-09-13T18:47:19.487685+0000","last_peered":"2024-09-13T18:47:19.487685+0000","last_clean":"2024-09-13T18:47:19.487685+0000","last_became_active":"2024-09-13T18:47:15.466819+0000","last_became_peered":"2024-09-13T18:47:15.466819+0000","last_unstale":"2024-09-13T18:47:19.487685+0000","last_undegraded":"2024-09-13T18:47:19.487685+0000","last_fullsized":"2024-09-13T18:47:19.487685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:51.020919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.497332+0000","last_change":"2024-09-13T18:47:15.465815+0000","last_active":"2024-09-13T18:47:19.497332+0000","last_peered":"2024-09-13T18:47:19.497332+0000","last_clean":"2024-09-13T18:47:19.497332+0000","last_became_active":"2024-09-13T18:47:15.464960+0000","last_became_peered":"2024-09-13T18:47:15.464960+0000","last_unstale":"2024-09-13T18:47:19.497332+0000","last_undegraded":"2024-09-13T18:47:19.497332+0000","last_fullsized":"2024-09-13T18:47:19.497332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:50.346283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500854+0000","last_change":"2024-09-13T18:47:15.482526+0000","last_active":"2024-09-13T18:47:19.500854+0000","last_peered":"2024-09-13T18:47:19.500854+0000","last_clean":"2024-09-13T18:47:19.500854+0000","last_became_active":"2024-09-13T18:47:15.482236+0000","last_became_peered":"2024-09-13T18:47:15.482236+0000","last_unstale":"2024-09-13T18:47:19.500854+0000","last_undegraded":"2024-09-13T18:47:19.500854+0000","last_fullsized":"2024-09-13T18:47:19.500854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:23.451459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.500973+0000","last_change":"2024-09-13T18:47:15.498504+0000","last_active":"2024-09-13T18:47:19.500973+0000","last_peered":"2024-09-13T18:47:19.500973+0000","last_clean":"2024-09-13T18:47:19.500973+0000","last_became_active":"2024-09-13T18:47:15.490041+0000","last_became_peered":"2024-09-13T18:47:15.490041+0000","last_unstale":"2024-09-13T18:47:19.500973+0000","last_undegraded":"2024-09-13T18:47:19.500973+0000","last_fullsized":"2024-09-13T18:47:19.500973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:10.841857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592385+0000","last_change":"2024-09-13T18:47:15.495466+0000","last_active":"2024-09-13T18:47:19.592385+0000","last_peered":"2024-09-13T18:47:19.592385+0000","last_clean":"2024-09-13T18:47:19.592385+0000","last_became_active":"2024-09-13T18:47:15.495197+0000","last_became_peered":"2024-09-13T18:47:15.495197+0000","last_unstale":"2024-09-13T18:47:19.592385+0000","last_undegraded":"2024-09-13T18:47:19.592385+0000","last_fullsized":"2024-09-13T18:47:19.592385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:28.484112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487124+0000","last_change":"2024-09-13T18:47:15.474386+0000","last_active":"2024-09-13T18:47:19.487124+0000","last_peered":"2024-09-13T18:47:19.487124+0000","last_clean":"2024-09-13T18:47:19.487124+0000","last_became_active":"2024-09-13T18:47:15.473414+0000","last_became_peered":"2024-09-13T18:47:15.473414+0000","last_unstale":"2024-09-13T18:47:19.487124+0000","last_undegraded":"2024-09-13T18:47:19.487124+0000","last_fullsized":"2024-09-13T18:47:19.487124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:54.659397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591466+0000","last_change":"2024-09-13T18:47:15.469797+0000","last_active":"2024-09-13T18:47:19.591466+0000","last_peered":"2024-09-13T18:47:19.591466+0000","last_clean":"2024-09-13T18:47:19.591466+0000","last_became_active":"2024-09-13T18:47:15.469460+0000","last_became_peered":"2024-09-13T18:47:15.469460+0000","last_unstale":"2024-09-13T18:47:19.591466+0000","last_undegraded":"2024-09-13T18:47:19.591466+0000","last_fullsized":"2024-09-13T18:47:19.591466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:58.005456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488705+0000","last_change":"2024-09-13T18:47:15.483840+0000","last_active":"2024-09-13T18:47:19.488705+0000","last_peered":"2024-09-13T18:47:19.488705+0000","last_clean":"2024-09-13T18:47:19.488705+0000","last_became_active":"2024-09-13T18:47:15.478139+0000","last_became_peered":"2024-09-13T18:47:15.478139+0000","last_unstale":"2024-09-13T18:47:19.488705+0000","last_undegraded":"2024-09-13T18:47:19.488705+0000","last_fullsized":"2024-09-13T18:47:19.488705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:30.254683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.591973+0000","last_change":"2024-09-13T18:47:15.484385+0000","last_active":"2024-09-13T18:47:19.591973+0000","last_peered":"2024-09-13T18:47:19.591973+0000","last_clean":"2024-09-13T18:47:19.591973+0000","last_became_active":"2024-09-13T18:47:15.477424+0000","last_became_peered":"2024-09-13T18:47:15.477424+0000","last_unstale":"2024-09-13T18:47:19.591973+0000","last_undegraded":"2024-09-13T18:47:19.591973+0000","last_fullsized":"2024-09-13T18:47:19.591973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:10.028836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.488909+0000","last_change":"2024-09-13T18:47:15.477871+0000","last_active":"2024-09-13T18:47:19.488909+0000","last_peered":"2024-09-13T18:47:19.488909+0000","last_clean":"2024-09-13T18:47:19.488909+0000","last_became_active":"2024-09-13T18:47:15.474849+0000","last_became_peered":"2024-09-13T18:47:15.474849+0000","last_unstale":"2024-09-13T18:47:19.488909+0000","last_undegraded":"2024-09-13T18:47:19.488909+0000","last_fullsized":"2024-09-13T18:47:19.488909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:28:34.371864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.487837+0000","last_change":"2024-09-13T18:47:15.464724+0000","last_active":"2024-09-13T18:47:19.487837+0000","last_peered":"2024-09-13T18:47:19.487837+0000","last_clean":"2024-09-13T18:47:19.487837+0000","last_became_active":"2024-09-13T18:47:15.463105+0000","last_became_peered":"2024-09-13T18:47:15.463105+0000","last_unstale":"2024-09-13T18:47:19.487837+0000","last_undegraded":"2024-09-13T18:47:19.487837+0000","last_fullsized":"2024-09-13T18:47:19.487837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:15.445388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.493023+0000","last_change":"2024-09-13T18:47:15.476846+0000","last_active":"2024-09-13T18:47:19.493023+0000","last_peered":"2024-09-13T18:47:19.493023+0000","last_clean":"2024-09-13T18:47:19.493023+0000","last_became_active":"2024-09-13T18:47:15.476551+0000","last_became_peered":"2024-09-13T18:47:15.476551+0000","last_unstale":"2024-09-13T18:47:19.493023+0000","last_undegraded":"2024-09-13T18:47:19.493023+0000","last_fullsized":"2024-09-13T18:47:19.493023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:49.998551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-13T18:47:19.592316+0000","last_change":"2024-09-13T18:47:15.496912+0000","last_active":"2024-09-13T18:47:19.592316+0000","last_peered":"2024-09-13T18:47:19.592316+0000","last_clean":"2024-09-13T18:47:19.592316+0000","last_became_active":"2024-09-13T18:47:15.496644+0000","last_became_peered":"2024-09-13T18:47:15.496644+0000","last_unstale":"2024-09-13T18:47:19.592316+0000","last_undegraded":"2024-09-13T18:47:19.592316+0000","last_fullsized":"2024-09-13T18:47:19.592316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:14.953153+0000","last_clean_scrub_stamp":"2024-09-13T18:47:14.953153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:06.329665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.53}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.48}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6890000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5109999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4550000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9039999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:47:44.015 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:47:44.015 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:47:44.015 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:47:44.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:47:44.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.202+0000 7f5746200700 1 Processor -- start 2024-09-13T18:47:44.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.202+0000 7f5746200700 1 -- start start 2024-09-13T18:47:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5746200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f574006c960 0x7f5740161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5746200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57400b1980 0x7f5740162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5746200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5740162340 con 0x7f574006cd40 2024-09-13T18:47:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5746200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57400b2280 con 0x7f574006c960 2024-09-13T18:47:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5746200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400b2560 con 0x7f57400b1980 2024-09-13T18:47:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5744e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f574006c960 0x7f5740161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5737e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f574006cd40 0x7f57400b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33946/0 (socket says 172.21.15.81:33946) 2024-09-13T18:47:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5737e00700 1 -- 172.21.15.81:0/3027635258 learned_addr learned my addr 172.21.15.81:0/3027635258 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:44.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.206+0000 7f5745800700 1 --2- 172.21.15.81:0/3027635258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57400b1980 0x7f5740162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f573fe00700 1 -- 172.21.15.81:0/3027635258 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038802627 0 0) 0x7f5740162340 con 0x7f574006cd40 2024-09-13T18:47:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5745800700 1 -- 172.21.15.81:0/3027635258 >> v2:172.21.15.178:3300/0 conn(0x7f574006c960 msgr2=0x7f5740161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5745800700 1 --2- 172.21.15.81:0/3027635258 >> v2:172.21.15.178:3300/0 conn(0x7f574006c960 0x7f5740161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5745800700 1 -- 172.21.15.81:0/3027635258 >> v1:172.21.15.178:6789/0 conn(0x7f574006cd40 legacy=0x7f57400b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5745800700 1 -- 172.21.15.81:0/3027635258 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400b2840 con 0x7f57400b1980 2024-09-13T18:47:44.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5745800700 1 --2- 172.21.15.81:0/3027635258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57400b1980 0x7f5740162560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5738009d90 tx=0x7f573800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75dd777de62bc591 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f573fe00700 1 -- 172.21.15.81:0/3027635258 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800e070 con 0x7f57400b1980 2024-09-13T18:47:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f573fe00700 1 -- 172.21.15.81:0/3027635258 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800bb20 con 0x7f57400b1980 2024-09-13T18:47:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f573fe00700 1 -- 172.21.15.81:0/3027635258 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738012430 con 0x7f57400b1980 2024-09-13T18:47:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 -- 172.21.15.81:0/3027635258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57400b1980 msgr2=0x7f5740162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 --2- 172.21.15.81:0/3027635258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57400b1980 0x7f5740162560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5738009d90 tx=0x7f573800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 -- 172.21.15.81:0/3027635258 shutdown_connections 2024-09-13T18:47:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 --2- 172.21.15.81:0/3027635258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57400b1980 0x7f5740162560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 --2- 172.21.15.81:0/3027635258 >> v2:172.21.15.178:3300/0 conn(0x7f574006c960 0x7f5740161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 -- 172.21.15.81:0/3027635258 >> 172.21.15.81:0/3027635258 conn(0x7f574006a390 msgr2=0x7f574006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 -- 172.21.15.81:0/3027635258 shutdown_connections 2024-09-13T18:47:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.210+0000 7f5746200700 1 -- 172.21.15.81:0/3027635258 wait complete. 2024-09-13T18:47:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 Processor -- start 2024-09-13T18:47:44.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 -- start start 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 0x7f5740142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f574006cd40 0x7f57401e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57400b1980 0x7f5740146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740155b00 con 0x7f574006c960 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740142ec0 con 0x7f57400b1980 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5746200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5740143540 con 0x7f574006cd40 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5744e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 0x7f5740142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5744e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 0x7f5740142980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47556/0 (socket says 172.21.15.81:47556) 2024-09-13T18:47:44.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5744e00700 1 -- 172.21.15.81:0/2359916838 learned_addr learned my addr 172.21.15.81:0/2359916838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5745800700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57400b1980 0x7f5740146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.214+0000 7f5737e00700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f574006cd40 0x7f57401e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5744e00700 1 -- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f574006cd40 msgr2=0x7f57401e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5744e00700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f574006cd40 0x7f57401e7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5744e00700 1 -- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57400b1980 msgr2=0x7f5740146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5744e00700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57400b1980 0x7f5740146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5744e00700 1 -- 172.21.15.81:0/2359916838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738009a70 con 0x7f574006c960 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5744e00700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 0x7f5740142980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f573000e840 tx=0x7f573000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300095a0 con 0x7f574006c960 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000c690 con 0x7f574006c960 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573000ca00 con 0x7f574006c960 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5740143820 con 0x7f574006c960 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5740143de0 con 0x7f574006c960 2024-09-13T18:47:44.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.218+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5740161e00 con 0x7f574006c960 2024-09-13T18:47:44.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.222+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f573000cb60 con 0x7f574006c960 2024-09-13T18:47:44.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.222+0000 7f573d600700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f571c066730 0x7f571c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.222+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57300843a0 con 0x7f574006c960 2024-09-13T18:47:44.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.222+0000 7f5737e00700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f571c066730 0x7f571c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.222+0000 7f5737e00700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f571c066730 0x7f571c068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5740158230 tx=0x7f5728007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.226+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f57300514b0 con 0x7f574006c960 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.422+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f57400ae720 con 0x7f574006c960 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.426+0000 7f573d600700 1 -- 172.21.15.81:0/2359916838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5730054ad0 con 0x7f574006c960 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:47:44.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f571c066730 msgr2=0x7f571c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f571c066730 0x7f571c068bf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5740158230 tx=0x7f5728007cb0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 msgr2=0x7f5740142980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 0x7f5740142980 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f573000e840 tx=0x7f573000ec00 comp rx=0 tx=0).stop 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 shutdown_connections 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f571c066730 0x7f571c068bf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57400b1980 0x7f5740146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f574006cd40 0x7f57401e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 --2- 172.21.15.81:0/2359916838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574006c960 0x7f5740142980 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 >> 172.21.15.81:0/2359916838 conn(0x7f574006a390 msgr2=0x7f57400cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 shutdown_connections 2024-09-13T18:47:44.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.430+0000 7f5746200700 1 -- 172.21.15.81:0/2359916838 wait complete. 2024-09-13T18:47:44.460 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:47:44.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:44.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.606+0000 7f6ebb000700 1 Processor -- start 2024-09-13T18:47:44.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.606+0000 7f6ebb000700 1 -- start start 2024-09-13T18:47:44.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6ebb000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eb415d310 0x7f6eb40b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6ebb000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb415e560 con 0x7f6eb406aaa0 2024-09-13T18:47:44.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6ebb000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb415d920 con 0x7f6eb415e9f0 2024-09-13T18:47:44.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6ebb000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40b3ec0 con 0x7f6eb415d310 2024-09-13T18:47:44.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eb415d310 0x7f6eb40b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6eb415d310 0x7f6eb40b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47560/0 (socket says 172.21.15.81:47560) 2024-09-13T18:47:44.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 -- 172.21.15.81:0/563793681 learned_addr learned my addr 172.21.15.81:0/563793681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:44.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 -- 172.21.15.81:0/563793681 >> v1:172.21.15.178:6789/0 conn(0x7f6eb415e9f0 legacy=0x7f6eb415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 -- 172.21.15.81:0/563793681 >> v1:172.21.15.81:6789/0 conn(0x7f6eb406aaa0 legacy=0x7f6eb406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 -- 172.21.15.81:0/563793681 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb415dc00 con 0x7f6eb415d310 2024-09-13T18:47:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb9200700 1 --2- 172.21.15.81:0/563793681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415d310 0x7f6eb40b3980 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009910 tx=0x7f6ea4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b3fbcf17e71b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb3e00700 1 -- 172.21.15.81:0/563793681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4004230 con 0x7f6eb415d310 2024-09-13T18:47:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb3e00700 1 -- 172.21.15.81:0/563793681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea4004390 con 0x7f6eb415d310 2024-09-13T18:47:44.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.610+0000 7f6eb3e00700 1 -- 172.21.15.81:0/563793681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4009e60 con 0x7f6eb415d310 2024-09-13T18:47:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 -- 172.21.15.81:0/563793681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415d310 msgr2=0x7f6eb40b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 --2- 172.21.15.81:0/563793681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415d310 0x7f6eb40b3980 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009910 tx=0x7f6ea4009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 -- 172.21.15.81:0/563793681 shutdown_connections 2024-09-13T18:47:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 --2- 172.21.15.81:0/563793681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415d310 0x7f6eb40b3980 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 -- 172.21.15.81:0/563793681 >> 172.21.15.81:0/563793681 conn(0x7f6eb40b0c40 msgr2=0x7f6eb406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 -- 172.21.15.81:0/563793681 shutdown_connections 2024-09-13T18:47:44.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 -- 172.21.15.81:0/563793681 wait complete. 2024-09-13T18:47:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 Processor -- start 2024-09-13T18:47:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.614+0000 7f6ebb000700 1 -- start start 2024-09-13T18:47:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6eb406aaa0 0x7f6eb415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eb415d310 0x7f6eb4145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 0x7f6eb4145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb413e270 con 0x7f6eb415e9f0 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4139f70 con 0x7f6eb415d310 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb413d790 con 0x7f6eb406aaa0 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 0x7f6eb4145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 0x7f6eb4145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47574/0 (socket says 172.21.15.81:47574) 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 -- 172.21.15.81:0/2929254806 learned_addr learned my addr 172.21.15.81:0/2929254806 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:44.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eb9c00700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6eb406aaa0 0x7f6eb415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eb9200700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eb415d310 0x7f6eb4145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 -- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6eb406aaa0 msgr2=0x7f6eb415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6eb406aaa0 0x7f6eb415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 -- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eb415d310 msgr2=0x7f6eb4145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eb415d310 0x7f6eb4145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 -- 172.21.15.81:0/2929254806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4009570 con 0x7f6eb415e9f0 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eb9200700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eb415d310 0x7f6eb4145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eba600700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 0x7f6eb4145f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00b990 tx=0x7f6eac00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00c930 con 0x7f6eb415e9f0 2024-09-13T18:47:44.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00ca90 con 0x7f6eb415e9f0 2024-09-13T18:47:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb413da70 con 0x7f6eb415e9f0 2024-09-13T18:47:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00ce40 con 0x7f6eb415e9f0 2024-09-13T18:47:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.618+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4139bb0 con 0x7f6eb415e9f0 2024-09-13T18:47:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.622+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb413df90 con 0x7f6eb415e9f0 2024-09-13T18:47:44.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.622+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6eac01d3b0 con 0x7f6eb415e9f0 2024-09-13T18:47:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.622+0000 7f6eb1600700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e98066730 0x7f6e98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.626+0000 7f6eb9c00700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e98066730 0x7f6e98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.626+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6eac0842b0 con 0x7f6eb415e9f0 2024-09-13T18:47:44.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.626+0000 7f6eb9c00700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e98066730 0x7f6e98068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80018a0 tx=0x7f6ea8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.630+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6eac0512a0 con 0x7f6eb415e9f0 2024-09-13T18:47:44.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.818+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6eb40b3980 con 0x7f6eb415e9f0 2024-09-13T18:47:44.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.818+0000 7f6eb1600700 1 -- 172.21.15.81:0/2929254806 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6eac0548c0 con 0x7f6eb415e9f0 2024-09-13T18:47:44.830 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:44.831 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e98066730 msgr2=0x7f6e98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e98066730 0x7f6e98068bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80018a0 tx=0x7f6ea8009040 comp rx=0 tx=0).stop 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 msgr2=0x7f6eb4145f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 0x7f6eb4145f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00b990 tx=0x7f6eac00bca0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 shutdown_connections 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e98066730 0x7f6e98068bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eb415e9f0 0x7f6eb4145f50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6eb415d310 0x7f6eb4145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 --2- 172.21.15.81:0/2929254806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6eb406aaa0 0x7f6eb415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 >> 172.21.15.81:0/2929254806 conn(0x7f6eb40b0c40 msgr2=0x7f6eb406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 shutdown_connections 2024-09-13T18:47:44.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:44.822+0000 7f6ebb000700 1 -- 172.21.15.81:0/2929254806 wait complete. 2024-09-13T18:47:44.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:47:44.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb3e00700 1 Processor -- start 2024-09-13T18:47:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb3e00700 1 -- start start 2024-09-13T18:47:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7effb40716b0 0x7effb40b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb406aff0 con 0x7effb4070b50 2024-09-13T18:47:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb406b240 con 0x7effb40aee70 2024-09-13T18:47:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb40af2c0 con 0x7effb40716b0 2024-09-13T18:47:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb2000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7effb4070b50 0x7effb40ae760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47290/0 (socket says 172.21.15.81:47290) 2024-09-13T18:47:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb2000700 1 -- 172.21.15.81:0/3559964036 learned_addr learned my addr 172.21.15.81:0/3559964036 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:45.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb2a00700 1 --2- 172.21.15.81:0/3559964036 >> v2:172.21.15.178:3300/0 conn(0x7effb40716b0 0x7effb40b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb1600700 1 -- 172.21.15.81:0/3559964036 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637197697 0 0) 0x7effb406aff0 con 0x7effb4070b50 2024-09-13T18:47:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb1600700 1 -- 172.21.15.81:0/3559964036 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff980035d0 con 0x7effb4070b50 2024-09-13T18:47:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb2a00700 1 -- 172.21.15.81:0/3559964036 >> v1:172.21.15.178:6789/0 conn(0x7effb40aee70 legacy=0x7effb415d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb2a00700 1 -- 172.21.15.81:0/3559964036 >> v1:172.21.15.81:6789/0 conn(0x7effb4070b50 legacy=0x7effb40ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb1600700 1 -- 172.21.15.81:0/3559964036 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3258710094 0 0) 0x7eff980035d0 con 0x7effb4070b50 2024-09-13T18:47:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.034+0000 7effb2a00700 1 -- 172.21.15.81:0/3559964036 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb406b520 con 0x7effb40716b0 2024-09-13T18:47:45.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb2a00700 1 --2- 172.21.15.81:0/3559964036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb40b1900 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7effa4009850 tx=0x7effa4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7ae92fa0de6a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb1600700 1 -- 172.21.15.81:0/3559964036 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa0001670 con 0x7effb40716b0 2024-09-13T18:47:45.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb1600700 1 -- 172.21.15.81:0/3559964036 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa4004030 con 0x7effb40716b0 2024-09-13T18:47:45.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb1600700 1 -- 172.21.15.81:0/3559964036 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa40043c0 con 0x7effb40716b0 2024-09-13T18:47:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 -- 172.21.15.81:0/3559964036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 msgr2=0x7effb40b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 --2- 172.21.15.81:0/3559964036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb40b1900 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7effa4009850 tx=0x7effa4009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 -- 172.21.15.81:0/3559964036 shutdown_connections 2024-09-13T18:47:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 --2- 172.21.15.81:0/3559964036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb40b1900 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 -- 172.21.15.81:0/3559964036 >> 172.21.15.81:0/3559964036 conn(0x7effb406cb90 msgr2=0x7effb406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 -- 172.21.15.81:0/3559964036 shutdown_connections 2024-09-13T18:47:45.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.038+0000 7effb3e00700 1 -- 172.21.15.81:0/3559964036 wait complete. 2024-09-13T18:47:45.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 Processor -- start 2024-09-13T18:47:45.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 -- start start 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 0x7effb4155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb4145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb40aee70 0x7effb41539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41467f0 con 0x7effb4070b50 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb41457b0 con 0x7effb40716b0 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb4145be0 con 0x7effb40aee70 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 0x7effb4155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 0x7effb4155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47578/0 (socket says 172.21.15.81:47578) 2024-09-13T18:47:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.042+0000 7effb2a00700 1 -- 172.21.15.81:0/3187420297 learned_addr learned my addr 172.21.15.81:0/3187420297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb3400700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb40aee70 0x7effb41539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2a00700 1 -- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb40aee70 msgr2=0x7effb41539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2000700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb4145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2a00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb40aee70 0x7effb41539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2a00700 1 -- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 msgr2=0x7effb4145270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2a00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb4145270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2a00700 1 -- 172.21.15.81:0/3187420297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa40094b0 con 0x7effb4070b50 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb3400700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb40aee70 0x7effb41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2000700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb4145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb2a00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 0x7effb4155300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7effb40b2450 tx=0x7effa4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4011830 con 0x7effb4070b50 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa401f070 con 0x7effb4070b50 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4145ec0 con 0x7effb4070b50 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4011bd0 con 0x7effb4070b50 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb4146480 con 0x7effb4070b50 2024-09-13T18:47:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.046+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40afdf0 con 0x7effb4070b50 2024-09-13T18:47:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.050+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effa4011d30 con 0x7effb4070b50 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.050+0000 7effaaa00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff94066730 0x7eff94068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.050+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effa4021070 con 0x7effb4070b50 2024-09-13T18:47:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.050+0000 7effb2000700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff94066730 0x7eff94068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.050+0000 7effb2000700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff94066730 0x7eff94068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7effa0001860 tx=0x7effa0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.058+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effa4052e90 con 0x7effb4070b50 2024-09-13T18:47:45.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.238+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effb40b2200 con 0x7effb4070b50 2024-09-13T18:47:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.238+0000 7effaaa00700 1 -- 172.21.15.81:0/3187420297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7effa402b0a0 con 0x7effb4070b50 2024-09-13T18:47:45.248 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:47:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff94066730 msgr2=0x7eff94068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff94066730 0x7eff94068bf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7effa0001860 tx=0x7effa0009040 comp rx=0 tx=0).stop 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 msgr2=0x7effb4155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 0x7effb4155300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7effb40b2450 tx=0x7effa4004770 comp rx=0 tx=0).stop 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 shutdown_connections 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7eff94066730 0x7eff94068bf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effb40aee70 0x7effb41539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effb40716b0 0x7effb4145270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 --2- 172.21.15.81:0/3187420297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effb4070b50 0x7effb4155300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 >> 172.21.15.81:0/3187420297 conn(0x7effb406cb90 msgr2=0x7effb40af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 shutdown_connections 2024-09-13T18:47:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.242+0000 7effb3e00700 1 -- 172.21.15.81:0/3187420297 wait complete. 2024-09-13T18:47:45.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.446+0000 7f5007600700 1 Processor -- start 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.446+0000 7f5007600700 1 -- start start 2024-09-13T18:47:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5007600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5000161090 0x7f50000b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5007600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f500006b860 0x7f500006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5007600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5000161470 con 0x7f500006f2b0 2024-09-13T18:47:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5007600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500006f690 con 0x7f5000161090 2024-09-13T18:47:45.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5007600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50000b34c0 con 0x7f500006b860 2024-09-13T18:47:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5004c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5000161090 0x7f50000b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5005600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f500006f2b0 0x7f5000066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47296/0 (socket says 172.21.15.81:47296) 2024-09-13T18:47:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5005600700 1 -- 172.21.15.81:0/2103007156 learned_addr learned my addr 172.21.15.81:0/2103007156 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:45.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f4fffe00700 1 --2- 172.21.15.81:0/2103007156 >> v2:172.21.15.178:3300/0 conn(0x7f500006b860 0x7f500006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5004c00700 1 -- 172.21.15.81:0/2103007156 >> v2:172.21.15.178:3300/0 conn(0x7f500006b860 msgr2=0x7f500006ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5004c00700 1 --2- 172.21.15.81:0/2103007156 >> v2:172.21.15.178:3300/0 conn(0x7f500006b860 0x7f500006ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5004c00700 1 -- 172.21.15.81:0/2103007156 >> v1:172.21.15.81:6789/0 conn(0x7f500006f2b0 legacy=0x7f5000066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5004c00700 1 -- 172.21.15.81:0/2103007156 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50000b37a0 con 0x7f5000161090 2024-09-13T18:47:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f4fff400700 1 -- 172.21.15.81:0/2103007156 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533861875 0 0) 0x7f5000161470 con 0x7f500006f2b0 2024-09-13T18:47:45.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.450+0000 7f5004c00700 1 --2- 172.21.15.81:0/2103007156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000161090 0x7f50000b2bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f500006a740 tx=0x7f4ff400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652e5af877f5255d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f4fff400700 1 -- 172.21.15.81:0/2103007156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff400e070 con 0x7f5000161090 2024-09-13T18:47:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f4fff400700 1 -- 172.21.15.81:0/2103007156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff400bb20 con 0x7f5000161090 2024-09-13T18:47:45.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f4fff400700 1 -- 172.21.15.81:0/2103007156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4012430 con 0x7f5000161090 2024-09-13T18:47:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 -- 172.21.15.81:0/2103007156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000161090 msgr2=0x7f50000b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 --2- 172.21.15.81:0/2103007156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000161090 0x7f50000b2bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f500006a740 tx=0x7f4ff400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 -- 172.21.15.81:0/2103007156 shutdown_connections 2024-09-13T18:47:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 --2- 172.21.15.81:0/2103007156 >> v2:172.21.15.178:3300/0 conn(0x7f500006b860 0x7f500006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 --2- 172.21.15.81:0/2103007156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5000161090 0x7f50000b2bc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 -- 172.21.15.81:0/2103007156 >> 172.21.15.81:0/2103007156 conn(0x7f500006d530 msgr2=0x7f500006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 -- 172.21.15.81:0/2103007156 shutdown_connections 2024-09-13T18:47:45.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.454+0000 7f5007600700 1 -- 172.21.15.81:0/2103007156 wait complete. 2024-09-13T18:47:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 Processor -- start 2024-09-13T18:47:45.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 -- start start 2024-09-13T18:47:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f500006b860 0x7f50001fa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 0x7f50001f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5000161090 0x7f500015d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500015dcb0 con 0x7f500006f2b0 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500015d9d0 con 0x7f5000161090 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f5007600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50001f9cc0 con 0x7f500006b860 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f4fffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 0x7f50001f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f4fffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 0x7f50001f5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47592/0 (socket says 172.21.15.81:47592) 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.458+0000 7f4fffe00700 1 -- 172.21.15.81:0/2478644043 learned_addr learned my addr 172.21.15.81:0/2478644043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f5005600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5000161090 0x7f500015d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f5004c00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f500006b860 0x7f50001fa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4fffe00700 1 -- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f500006b860 msgr2=0x7f50001fa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4fffe00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f500006b860 0x7f50001fa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4fffe00700 1 -- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5000161090 msgr2=0x7f500015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4fffe00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5000161090 0x7f500015d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4fffe00700 1 -- 172.21.15.81:0/2478644043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff4009a70 con 0x7f500006f2b0 2024-09-13T18:47:45.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4fffe00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 0x7f50001f5e40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e9d0 tx=0x7f4fec00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec009720 con 0x7f500006f2b0 2024-09-13T18:47:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec00c850 con 0x7f500006f2b0 2024-09-13T18:47:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00cbc0 con 0x7f500006f2b0 2024-09-13T18:47:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50001f9fa0 con 0x7f500006f2b0 2024-09-13T18:47:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50001f6380 con 0x7f500006f2b0 2024-09-13T18:47:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.462+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500006ed70 con 0x7f500006f2b0 2024-09-13T18:47:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.466+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fec00cd20 con 0x7f500006f2b0 2024-09-13T18:47:45.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.466+0000 7f4ffcc00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fe0066730 0x7f4fe0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.466+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fec084610 con 0x7f500006f2b0 2024-09-13T18:47:45.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.466+0000 7f5004c00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fe0066730 0x7f4fe0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.466+0000 7f5004c00700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fe0066730 0x7f4fe0068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4014040 tx=0x7f4ff4011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.474+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4fec0515f0 con 0x7f500006f2b0 2024-09-13T18:47:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.658+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50000ce910 con 0x7f500006f2b0 2024-09-13T18:47:45.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.658+0000 7f4ffcc00700 1 -- 172.21.15.81:0/2478644043 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fec054c10 con 0x7f500006f2b0 2024-09-13T18:47:45.669 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.662+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fe0066730 msgr2=0x7f4fe0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fe0066730 0x7f4fe0068bf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4014040 tx=0x7f4ff4011000 comp rx=0 tx=0).stop 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 msgr2=0x7f50001f5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 0x7f50001f5e40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00e9d0 tx=0x7f4fec00ed90 comp rx=0 tx=0).stop 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 shutdown_connections 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fe0066730 0x7f4fe0068bf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5000161090 0x7f500015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f500006f2b0 0x7f50001f5e40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 --2- 172.21.15.81:0/2478644043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f500006b860 0x7f50001fa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 >> 172.21.15.81:0/2478644043 conn(0x7f500006d530 msgr2=0x7f500006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 shutdown_connections 2024-09-13T18:47:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.666+0000 7f5007600700 1 -- 172.21.15.81:0/2478644043 wait complete. 2024-09-13T18:47:45.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:45.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 Processor -- start 2024-09-13T18:47:45.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 -- start start 2024-09-13T18:47:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 0x7fa8a00ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa8a015e030 0x7fa8a0070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b57e0 con 0x7fa8a00cd140 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00b3b80 con 0x7fa8a015e030 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a8800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00b5a80 con 0x7fa8a0157500 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a5400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa8a015e030 0x7fa8a0070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.862+0000 7fa8a5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 0x7fa8a00ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 0x7fa8a00ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49634/0 (socket says 172.21.15.81:49634) 2024-09-13T18:47:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 -- 172.21.15.81:0/1350414661 learned_addr learned my addr 172.21.15.81:0/1350414661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 -- 172.21.15.81:0/1350414661 >> v2:172.21.15.81:3300/0 conn(0x7fa8a015e030 msgr2=0x7fa8a0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 --2- 172.21.15.81:0/1350414661 >> v2:172.21.15.81:3300/0 conn(0x7fa8a015e030 0x7fa8a0070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 -- 172.21.15.81:0/1350414661 >> v1:172.21.15.178:6789/0 conn(0x7fa8a00cd140 legacy=0x7fa8a0160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 -- 172.21.15.81:0/1350414661 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00b5d60 con 0x7fa8a0157500 2024-09-13T18:47:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a4a00700 1 -- 172.21.15.81:0/1350414661 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246904029 0 0) 0x7fa8a00b57e0 con 0x7fa8a00cd140 2024-09-13T18:47:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5400700 1 --2- 172.21.15.81:0/1350414661 >> v2:172.21.15.81:3300/0 conn(0x7fa8a015e030 0x7fa8a0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a5e00700 1 --2- 172.21.15.81:0/1350414661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 0x7fa8a00ce700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa894009910 tx=0x7fa894009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57a30c15c48984f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a4a00700 1 -- 172.21.15.81:0/1350414661 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011830 con 0x7fa8a0157500 2024-09-13T18:47:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a4a00700 1 -- 172.21.15.81:0/1350414661 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa894011990 con 0x7fa8a0157500 2024-09-13T18:47:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a4a00700 1 -- 172.21.15.81:0/1350414661 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894011d40 con 0x7fa8a0157500 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 -- 172.21.15.81:0/1350414661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 msgr2=0x7fa8a00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 --2- 172.21.15.81:0/1350414661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 0x7fa8a00ce700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa894009910 tx=0x7fa894009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 -- 172.21.15.81:0/1350414661 shutdown_connections 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 --2- 172.21.15.81:0/1350414661 >> v2:172.21.15.81:3300/0 conn(0x7fa8a015e030 0x7fa8a0070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 --2- 172.21.15.81:0/1350414661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a0157500 0x7fa8a00ce700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 -- 172.21.15.81:0/1350414661 >> 172.21.15.81:0/1350414661 conn(0x7fa8a006e660 msgr2=0x7fa8a006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 -- 172.21.15.81:0/1350414661 shutdown_connections 2024-09-13T18:47:45.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.866+0000 7fa8a8800700 1 -- 172.21.15.81:0/1350414661 wait complete. 2024-09-13T18:47:45.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 Processor -- start 2024-09-13T18:47:45.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 -- start start 2024-09-13T18:47:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a00cd140 0x7fa8a0152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 0x7fa8a014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8a015e030 0x7fa8a014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0153020 con 0x7fa8a0157500 2024-09-13T18:47:45.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a014e650 con 0x7fa8a015e030 2024-09-13T18:47:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a8800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a014fe90 con 0x7fa8a00cd140 2024-09-13T18:47:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.870+0000 7fa8a5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 0x7fa8a014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 0x7fa8a014e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47604/0 (socket says 172.21.15.81:47604) 2024-09-13T18:47:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 -- 172.21.15.81:0/3624354846 learned_addr learned my addr 172.21.15.81:0/3624354846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5e00700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a00cd140 0x7fa8a0152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a6800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8a015e030 0x7fa8a014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 -- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a00cd140 msgr2=0x7fa8a0152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a00cd140 0x7fa8a0152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 -- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8a015e030 msgr2=0x7fa8a014f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8a015e030 0x7fa8a014f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 -- 172.21.15.81:0/3624354846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8900094b0 con 0x7fa8a0157500 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a5400700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 0x7fa8a014e110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa89000e9b0 tx=0x7fa89000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890009710 con 0x7fa8a0157500 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89000c850 con 0x7fa8a0157500 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894009570 con 0x7fa8a0157500 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000cc00 con 0x7fa8a0157500 2024-09-13T18:47:45.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.874+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a014eb90 con 0x7fa8a0157500 2024-09-13T18:47:45.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.878+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a00cd9b0 con 0x7fa8a0157500 2024-09-13T18:47:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.878+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa890013470 con 0x7fa8a0157500 2024-09-13T18:47:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.878+0000 7fa89a000700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa884066730 0x7fa884068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.878+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa890084180 con 0x7fa8a0157500 2024-09-13T18:47:45.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.878+0000 7fa8a5e00700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa884066730 0x7fa884068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.882+0000 7fa8a5e00700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa884066730 0x7fa884068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00b5d30 tx=0x7fa894008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:45.886+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa890051160 con 0x7fa8a0157500 2024-09-13T18:47:46.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8a0070160 con 0x7fa8a0157500 2024-09-13T18:47:46.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa89a000700 1 -- 172.21.15.81:0/3624354846 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa890054780 con 0x7fa8a0157500 2024-09-13T18:47:46.075 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:47:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa884066730 msgr2=0x7fa884068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa884066730 0x7fa884068bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00b5d30 tx=0x7fa894008030 comp rx=0 tx=0).stop 2024-09-13T18:47:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 msgr2=0x7fa8a014e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 0x7fa8a014e110 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa89000e9b0 tx=0x7fa89000ecc0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 shutdown_connections 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa884066730 0x7fa884068bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa8a015e030 0x7fa8a014f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8a0157500 0x7fa8a014e110 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 --2- 172.21.15.81:0/3624354846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8a00cd140 0x7fa8a0152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.066+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 >> 172.21.15.81:0/3624354846 conn(0x7fa8a006e660 msgr2=0x7fa8a00b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.070+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 shutdown_connections 2024-09-13T18:47:46.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.070+0000 7fa8a8800700 1 -- 172.21.15.81:0/3624354846 wait complete. 2024-09-13T18:47:46.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:47:46.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.266+0000 7f6362000700 1 Processor -- start 2024-09-13T18:47:46.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.270+0000 7f6362000700 1 -- start start 2024-09-13T18:47:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.270+0000 7f6362000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f635c15ed90 0x7f635c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.270+0000 7f6362000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f635c15f170 0x7f635c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.270+0000 7f6362000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c0cdc30 con 0x7f635c0cf5b0 2024-09-13T18:47:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.270+0000 7f6362000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c15b050 con 0x7f635c15f170 2024-09-13T18:47:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.270+0000 7f6362000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c15b330 con 0x7f635c15ed90 2024-09-13T18:47:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f635c15f170 0x7f635c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f635c15f170 0x7f635c06ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47616/0 (socket says 172.21.15.81:47616) 2024-09-13T18:47:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 -- 172.21.15.81:0/1426854532 learned_addr learned my addr 172.21.15.81:0/1426854532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635b400700 1 --2- 172.21.15.81:0/1426854532 >> v2:172.21.15.178:3300/0 conn(0x7f635c15ed90 0x7f635c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 -- 172.21.15.81:0/1426854532 >> v2:172.21.15.178:3300/0 conn(0x7f635c15ed90 msgr2=0x7f635c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 --2- 172.21.15.81:0/1426854532 >> v2:172.21.15.178:3300/0 conn(0x7f635c15ed90 0x7f635c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 -- 172.21.15.81:0/1426854532 >> v1:172.21.15.81:6789/0 conn(0x7f635c0cf5b0 legacy=0x7f635c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 -- 172.21.15.81:0/1426854532 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c15b610 con 0x7f635c15f170 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635aa00700 1 --2- 172.21.15.81:0/1426854532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c06ed70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6348009910 tx=0x7f6348009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e952031ee951856d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635a000700 1 -- 172.21.15.81:0/1426854532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348004230 con 0x7f635c15f170 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635a000700 1 -- 172.21.15.81:0/1426854532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6348004390 con 0x7f635c15f170 2024-09-13T18:47:46.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f635a000700 1 -- 172.21.15.81:0/1426854532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6348009e60 con 0x7f635c15f170 2024-09-13T18:47:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 -- 172.21.15.81:0/1426854532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 msgr2=0x7f635c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 --2- 172.21.15.81:0/1426854532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c06ed70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6348009910 tx=0x7f6348009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 -- 172.21.15.81:0/1426854532 shutdown_connections 2024-09-13T18:47:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 --2- 172.21.15.81:0/1426854532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c06ed70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 --2- 172.21.15.81:0/1426854532 >> v2:172.21.15.178:3300/0 conn(0x7f635c15ed90 0x7f635c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 -- 172.21.15.81:0/1426854532 >> 172.21.15.81:0/1426854532 conn(0x7f635c0b1e10 msgr2=0x7f635c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 -- 172.21.15.81:0/1426854532 shutdown_connections 2024-09-13T18:47:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.274+0000 7f6362000700 1 -- 172.21.15.81:0/1426854532 wait complete. 2024-09-13T18:47:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 Processor -- start 2024-09-13T18:47:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 -- start start 2024-09-13T18:47:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635c0cf5b0 0x7f635c1f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635c15ed90 0x7f635c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c0afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1f2cc0 con 0x7f635c15f170 2024-09-13T18:47:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c152500 con 0x7f635c15ed90 2024-09-13T18:47:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f6362000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c151f40 con 0x7f635c0cf5b0 2024-09-13T18:47:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c0afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c0afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47622/0 (socket says 172.21.15.81:47622) 2024-09-13T18:47:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 -- 172.21.15.81:0/13035617 learned_addr learned my addr 172.21.15.81:0/13035617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635b400700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635c0cf5b0 0x7f635c1f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635aa00700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635c15ed90 0x7f635c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 -- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635c0cf5b0 msgr2=0x7f635c1f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635c0cf5b0 0x7f635c1f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 -- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635c15ed90 msgr2=0x7f635c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.278+0000 7f635be00700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635c15ed90 0x7f635c14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f635be00700 1 -- 172.21.15.81:0/13035617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6348009570 con 0x7f635c15f170 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f635be00700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c0afc50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f635400cc10 tx=0x7f635400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6354004bb0 con 0x7f635c15f170 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6354004d10 con 0x7f635c15f170 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c152220 con 0x7f635c15f170 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635400aae0 con 0x7f635c15f170 2024-09-13T18:47:46.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c1f3690 con 0x7f635c15f170 2024-09-13T18:47:46.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.282+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c0ce920 con 0x7f635c15f170 2024-09-13T18:47:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.286+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f635400ac40 con 0x7f635c15f170 2024-09-13T18:47:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.286+0000 7f6353400700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f633c066760 0x7f633c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.286+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6354083e10 con 0x7f635c15f170 2024-09-13T18:47:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.286+0000 7f635b400700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f633c066760 0x7f633c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.286+0000 7f635b400700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f633c066760 0x7f633c068c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f634c006b40 tx=0x7f634c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.294+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6354087030 con 0x7f635c15f170 2024-09-13T18:47:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.470+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f635c0cf070 con 0x7f635c15f170 2024-09-13T18:47:46.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.470+0000 7f6353400700 1 -- 172.21.15.81:0/13035617 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6354017070 con 0x7f635c15f170 2024-09-13T18:47:46.480 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:46.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f633c066760 msgr2=0x7f633c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f633c066760 0x7f633c068c20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f634c006b40 tx=0x7f634c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 msgr2=0x7f635c0afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c0afc50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f635400cc10 tx=0x7f635400cf20 comp rx=0 tx=0).stop 2024-09-13T18:47:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 shutdown_connections 2024-09-13T18:47:46.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f633c066760 0x7f633c068c20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f635c15f170 0x7f635c0afc50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635c15ed90 0x7f635c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 --2- 172.21.15.81:0/13035617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635c0cf5b0 0x7f635c1f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 >> 172.21.15.81:0/13035617 conn(0x7f635c0b1e10 msgr2=0x7f635c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 shutdown_connections 2024-09-13T18:47:46.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.474+0000 7f6362000700 1 -- 172.21.15.81:0/13035617 wait complete. 2024-09-13T18:47:46.503 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.662+0000 7f8312a00700 1 Processor -- start 2024-09-13T18:47:46.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.662+0000 7f8312a00700 1 -- start start 2024-09-13T18:47:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f8312a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f830c0667a0 0x7f830c0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f8312a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c15e000 con 0x7f830c15a830 2024-09-13T18:47:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f8312a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830c15d3f0 con 0x7f830c0b3960 2024-09-13T18:47:46.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f8312a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c15ac10 con 0x7f830c0667a0 2024-09-13T18:47:46.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f830c15a830 0x7f830c066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49276/0 (socket says 172.21.15.81:49276) 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830be00700 1 -- 172.21.15.81:0/2690912877 learned_addr learned my addr 172.21.15.81:0/2690912877 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830b400700 1 --2- 172.21.15.81:0/2690912877 >> v2:172.21.15.178:3300/0 conn(0x7f830c0667a0 0x7f830c0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592064687 0 0) 0x7f830c15e000 con 0x7f830c15a830 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f00035d0 con 0x7f830c15a830 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643798360 0 0) 0x7f830c15d3f0 con 0x7f830c0b3960 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f830c15e000 con 0x7f830c0b3960 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830b400700 1 -- 172.21.15.81:0/2690912877 >> v1:172.21.15.178:6789/0 conn(0x7f830c0b3960 legacy=0x7f830c0aca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830b400700 1 -- 172.21.15.81:0/2690912877 >> v1:172.21.15.81:6789/0 conn(0x7f830c15a830 legacy=0x7f830c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830b400700 1 -- 172.21.15.81:0/2690912877 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c15d6d0 con 0x7f830c0667a0 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830b400700 1 --2- 172.21.15.81:0/2690912877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c0b5300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009850 tx=0x7f82f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ca15952177df35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011830 con 0x7f830c0667a0 2024-09-13T18:47:46.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8011990 con 0x7f830c0667a0 2024-09-13T18:47:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.666+0000 7f830aa00700 1 -- 172.21.15.81:0/2690912877 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8011d00 con 0x7f830c0667a0 2024-09-13T18:47:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 -- 172.21.15.81:0/2690912877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 msgr2=0x7f830c0b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 --2- 172.21.15.81:0/2690912877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c0b5300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009850 tx=0x7f82f8009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 -- 172.21.15.81:0/2690912877 shutdown_connections 2024-09-13T18:47:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 --2- 172.21.15.81:0/2690912877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c0b5300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 -- 172.21.15.81:0/2690912877 >> 172.21.15.81:0/2690912877 conn(0x7f830c06e660 msgr2=0x7f830c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 -- 172.21.15.81:0/2690912877 shutdown_connections 2024-09-13T18:47:46.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 -- 172.21.15.81:0/2690912877 wait complete. 2024-09-13T18:47:46.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 Processor -- start 2024-09-13T18:47:46.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.670+0000 7f8312a00700 1 -- start start 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f830c0b3960 0x7f830c152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 0x7f830c0af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c152ad0 con 0x7f830c15a830 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c1f5bd0 con 0x7f830c0667a0 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0afbd0 con 0x7f830c0b3960 2024-09-13T18:47:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 0x7f830c0af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 0x7f830c0af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49920/0 (socket says 172.21.15.81:49920) 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 -- 172.21.15.81:0/2389484179 learned_addr learned my addr 172.21.15.81:0/2389484179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f830be00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f830b400700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f830c0b3960 0x7f830c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 -- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f830c0b3960 msgr2=0x7f830c152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f830c0b3960 0x7f830c152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 -- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 msgr2=0x7f830c1f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c1f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 -- 172.21.15.81:0/2389484179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80094b0 con 0x7f830c15a830 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8310a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 0x7f830c0af150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f830400cc20 tx=0x7f830400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304003c20 con 0x7f830c15a830 2024-09-13T18:47:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304003d80 con 0x7f830c15a830 2024-09-13T18:47:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830400aae0 con 0x7f830c15a830 2024-09-13T18:47:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c0afeb0 con 0x7f830c15a830 2024-09-13T18:47:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.674+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c1f6150 con 0x7f830c15a830 2024-09-13T18:47:46.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.678+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c1f6340 con 0x7f830c15a830 2024-09-13T18:47:46.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.678+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f830400ac40 con 0x7f830c15a830 2024-09-13T18:47:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.682+0000 7f8303e00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82ec066730 0x7f82ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.682+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8304084450 con 0x7f830c15a830 2024-09-13T18:47:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.682+0000 7f830be00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82ec066730 0x7f82ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.682+0000 7f830be00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82ec066730 0x7f82ec068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f82fc007fd0 tx=0x7f82fc007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.686+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83040514c0 con 0x7f830c15a830 2024-09-13T18:47:46.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.918+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f830c0b5300 con 0x7f830c15a830 2024-09-13T18:47:46.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.918+0000 7f8303e00700 1 -- 172.21.15.81:0/2389484179 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7f8304054ae0 con 0x7f830c15a830 2024-09-13T18:47:46.928 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:46.928 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82ec066730 msgr2=0x7f82ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82ec066730 0x7f82ec068bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f82fc007fd0 tx=0x7f82fc007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 msgr2=0x7f830c0af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 0x7f830c0af150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f830400cc20 tx=0x7f830400cf30 comp rx=0 tx=0).stop 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 shutdown_connections 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82ec066730 0x7f82ec068bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f830c15a830 0x7f830c0af150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f830c0b3960 0x7f830c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 --2- 172.21.15.81:0/2389484179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f830c0667a0 0x7f830c1f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 >> 172.21.15.81:0/2389484179 conn(0x7f830c06e660 msgr2=0x7f830c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 shutdown_connections 2024-09-13T18:47:46.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:46.922+0000 7f8312a00700 1 -- 172.21.15.81:0/2389484179 wait complete. 2024-09-13T18:47:46.935 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:47:46.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.114+0000 7faf6ac00700 1 Processor -- start 2024-09-13T18:47:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.114+0000 7faf6ac00700 1 -- start start 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf6ac00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf640b3b80 0x7faf6415f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf6ac00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6415af60 con 0x7faf640cf410 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf6ac00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf640cefa0 con 0x7faf640d0ae0 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf6ac00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6415f550 con 0x7faf640b3b80 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf5b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faf640b3b80 0x7faf6415f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf68c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faf640cf410 0x7faf640cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49284/0 (socket says 172.21.15.81:49284) 2024-09-13T18:47:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf68c00700 1 -- 172.21.15.81:0/1694249880 learned_addr learned my addr 172.21.15.81:0/1694249880 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf5b400700 1 -- 172.21.15.81:0/1694249880 >> v1:172.21.15.178:6789/0 conn(0x7faf640d0ae0 legacy=0x7faf640d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf5b400700 1 -- 172.21.15.81:0/1694249880 >> v1:172.21.15.81:6789/0 conn(0x7faf640cf410 legacy=0x7faf640cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf5b400700 1 -- 172.21.15.81:0/1694249880 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640b4160 con 0x7faf640b3b80 2024-09-13T18:47:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf5b400700 1 --2- 172.21.15.81:0/1694249880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640b3b80 0x7faf6415f010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009850 tx=0x7faf4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a48b770cee53cdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf63400700 1 -- 172.21.15.81:0/1694249880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c011830 con 0x7faf640b3b80 2024-09-13T18:47:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf63400700 1 -- 172.21.15.81:0/1694249880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c011990 con 0x7faf640b3b80 2024-09-13T18:47:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.118+0000 7faf63400700 1 -- 172.21.15.81:0/1694249880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c011d20 con 0x7faf640b3b80 2024-09-13T18:47:47.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 -- 172.21.15.81:0/1694249880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640b3b80 msgr2=0x7faf6415f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 --2- 172.21.15.81:0/1694249880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640b3b80 0x7faf6415f010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009850 tx=0x7faf4c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 -- 172.21.15.81:0/1694249880 shutdown_connections 2024-09-13T18:47:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 --2- 172.21.15.81:0/1694249880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640b3b80 0x7faf6415f010 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 -- 172.21.15.81:0/1694249880 >> 172.21.15.81:0/1694249880 conn(0x7faf6406e660 msgr2=0x7faf6406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 -- 172.21.15.81:0/1694249880 shutdown_connections 2024-09-13T18:47:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 -- 172.21.15.81:0/1694249880 wait complete. 2024-09-13T18:47:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.122+0000 7faf6ac00700 1 Processor -- start 2024-09-13T18:47:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 -- start start 2024-09-13T18:47:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf640b3b80 0x7faf6415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 0x7faf640c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf640d0ae0 0x7faf64158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64157090 con 0x7faf640cf410 2024-09-13T18:47:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf64157370 con 0x7faf640b3b80 2024-09-13T18:47:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf64157650 con 0x7faf640d0ae0 2024-09-13T18:47:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 0x7faf640c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 0x7faf640c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49948/0 (socket says 172.21.15.81:49948) 2024-09-13T18:47:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 -- 172.21.15.81:0/406906098 learned_addr learned my addr 172.21.15.81:0/406906098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf63e00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf640b3b80 0x7faf6415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf68c00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf640d0ae0 0x7faf64158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 -- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf640d0ae0 msgr2=0x7faf64158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf640d0ae0 0x7faf64158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 -- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf640b3b80 msgr2=0x7faf6415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf640b3b80 0x7faf6415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 -- 172.21.15.81:0/406906098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0094b0 con 0x7faf640cf410 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf63e00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf640b3b80 0x7faf6415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf68c00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf640d0ae0 0x7faf64158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf5b400700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 0x7faf640c77c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009fd0 tx=0x7faf4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0038c0 con 0x7faf640cf410 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c01e070 con 0x7faf640cf410 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c003c80 con 0x7faf640cf410 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf64157930 con 0x7faf640cf410 2024-09-13T18:47:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.126+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf64156d80 con 0x7faf640cf410 2024-09-13T18:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.130+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6415f010 con 0x7faf640cf410 2024-09-13T18:47:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.130+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf4c01a420 con 0x7faf640cf410 2024-09-13T18:47:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.130+0000 7faf60c00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faf40066730 0x7faf40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.130+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf4c020070 con 0x7faf640cf410 2024-09-13T18:47:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.130+0000 7faf63e00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faf40066730 0x7faf40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.134+0000 7faf63e00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faf40066730 0x7faf40068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faf54000f60 tx=0x7faf54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.134+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf4c052c80 con 0x7faf640cf410 2024-09-13T18:47:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.334+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf640b58f0 con 0x7faf640cf410 2024-09-13T18:47:47.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.334+0000 7faf60c00700 1 -- 172.21.15.81:0/406906098 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7faf4c02a090 con 0x7faf640cf410 2024-09-13T18:47:47.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:47.345 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faf40066730 msgr2=0x7faf40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faf40066730 0x7faf40068bf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faf54000f60 tx=0x7faf54009040 comp rx=0 tx=0).stop 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 msgr2=0x7faf640c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 0x7faf640c77c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009fd0 tx=0x7faf4c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 shutdown_connections 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faf40066730 0x7faf40068bf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf640d0ae0 0x7faf64158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf640cf410 0x7faf640c77c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 --2- 172.21.15.81:0/406906098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf640b3b80 0x7faf6415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 >> 172.21.15.81:0/406906098 conn(0x7faf6406e660 msgr2=0x7faf641537c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.338+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 shutdown_connections 2024-09-13T18:47:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.342+0000 7faf6ac00700 1 -- 172.21.15.81:0/406906098 wait complete. 2024-09-13T18:47:47.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:47:47.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:47.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.534+0000 7f1893e00700 1 Processor -- start 2024-09-13T18:47:47.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.534+0000 7f1893e00700 1 -- start start 2024-09-13T18:47:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.534+0000 7f1893e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894143b70 0x7f18940cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.534+0000 7f1893e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f189406d070 0x7f18940b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.534+0000 7f1893e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18940b1980 con 0x7f189406d620 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.534+0000 7f1893e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18940b2500 con 0x7f189406d070 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18940b1bd0 con 0x7f1894143b70 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f189406d070 0x7f18940b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f189406d070 0x7f18940b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:42100/0 (socket says 172.21.15.81:42100) 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 -- 172.21.15.81:0/830641962 learned_addr learned my addr 172.21.15.81:0/830641962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1892a00700 1 --2- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894143b70 0x7f18940cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 -- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894143b70 msgr2=0x7f18940cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 --2- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894143b70 0x7f18940cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 -- 172.21.15.81:0/830641962 >> v1:172.21.15.178:6789/0 conn(0x7f189406d620 legacy=0x7f189406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 -- 172.21.15.81:0/830641962 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940b1eb0 con 0x7f189406d070 2024-09-13T18:47:47.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893400700 1 --2- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d070 0x7f18940b2990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f188c009e50 tx=0x7f188c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f09f779b2aa14f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1892000700 1 -- 172.21.15.81:0/830641962 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00e070 con 0x7f189406d070 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1892000700 1 -- 172.21.15.81:0/830641962 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00b910 con 0x7f189406d070 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1892000700 1 -- 172.21.15.81:0/830641962 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00bcc0 con 0x7f189406d070 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893e00700 1 -- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d070 msgr2=0x7f18940b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.538+0000 7f1893e00700 1 --2- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d070 0x7f18940b2990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f188c009e50 tx=0x7f188c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.542+0000 7f1893e00700 1 -- 172.21.15.81:0/830641962 shutdown_connections 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.542+0000 7f1893e00700 1 --2- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d070 0x7f18940b2990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.542+0000 7f1893e00700 1 --2- 172.21.15.81:0/830641962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1894143b70 0x7f18940cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.542+0000 7f1893e00700 1 -- 172.21.15.81:0/830641962 >> 172.21.15.81:0/830641962 conn(0x7f189406a390 msgr2=0x7f189406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.542+0000 7f1893e00700 1 -- 172.21.15.81:0/830641962 shutdown_connections 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.542+0000 7f1893e00700 1 -- 172.21.15.81:0/830641962 wait complete. 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 Processor -- start 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 -- start start 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f189406d070 0x7f189415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d620 0x7f18940c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 0x7f1894134930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894141a20 con 0x7f1894143b70 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1894141c70 con 0x7f189406d620 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1894141f50 con 0x7f189406d070 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 0x7f1894134930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 0x7f1894134930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49962/0 (socket says 172.21.15.81:49962) 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 -- 172.21.15.81:0/3108246271 learned_addr learned my addr 172.21.15.81:0/3108246271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1892a00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f189406d070 0x7f189415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f188a000700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d620 0x7f18940c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 -- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f189406d070 msgr2=0x7f189415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f189406d070 0x7f189415a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 -- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d620 msgr2=0x7f18940c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d620 0x7f18940c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 -- 172.21.15.81:0/3108246271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c009b30 con 0x7f1894143b70 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.546+0000 7f1893400700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 0x7f1894134930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18940742f0 tx=0x7f188c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.550+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c004800 con 0x7f1894143b70 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.550+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c0099b0 con 0x7f1894143b70 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.550+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1894142230 con 0x7f1894143b70 2024-09-13T18:47:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.550+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c01c680 con 0x7f1894143b70 2024-09-13T18:47:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.550+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18940c3e30 con 0x7f1894143b70 2024-09-13T18:47:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.550+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1894142750 con 0x7f1894143b70 2024-09-13T18:47:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.554+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f188c01c7e0 con 0x7f1894143b70 2024-09-13T18:47:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.554+0000 7f188b400700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1870066730 0x7f1870068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.554+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f188c085ca0 con 0x7f1894143b70 2024-09-13T18:47:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.554+0000 7f1892a00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1870066730 0x7f1870068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.554+0000 7f1892a00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1870066730 0x7f1870068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1884009b50 tx=0x7f1884009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.558+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1894142750 con 0x7f1894143b70 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.742+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1894142750 con 0x7f1894143b70 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.742+0000 7f188b400700 1 -- 172.21.15.81:0/3108246271 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1894142750 con 0x7f1894143b70 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1870066730 msgr2=0x7f1870068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1870066730 0x7f1870068bf0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1884009b50 tx=0x7f1884009240 comp rx=0 tx=0).stop 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 msgr2=0x7f1894134930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 0x7f1894134930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18940742f0 tx=0x7f188c004af0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 shutdown_connections 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1870066730 0x7f1870068bf0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1894143b70 0x7f1894134930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f189406d620 0x7f18940c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 --2- 172.21.15.81:0/3108246271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f189406d070 0x7f189415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 >> 172.21.15.81:0/3108246271 conn(0x7f189406a390 msgr2=0x7f18940acf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 shutdown_connections 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.750+0000 7f1893e00700 1 -- 172.21.15.81:0/3108246271 wait complete. 2024-09-13T18:47:47.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 Processor -- start 2024-09-13T18:47:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 -- start start 2024-09-13T18:47:47.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f865415ca20 0x7f865415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 0x7f865406b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8654160680 con 0x7f865406cd80 2024-09-13T18:47:47.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86540b4a20 con 0x7f865415ca20 2024-09-13T18:47:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.946+0000 7f8653e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865406b750 con 0x7f865406ada0 2024-09-13T18:47:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8652a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f865415ca20 0x7f865415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 0x7f865406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8652a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f865415ca20 0x7f865415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:42120/0 (socket says 172.21.15.81:42120) 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8652000700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f865406cd80 0x7f86540b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:50992/0 (socket says 172.21.15.81:50992) 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8652000700 1 -- 172.21.15.81:0/1848930634 learned_addr learned my addr 172.21.15.81:0/1848930634 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 0x7f865406b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49016/0 (socket says 172.21.15.81:49016) 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 -- 172.21.15.81:0/1848930634 >> v2:172.21.15.178:3300/0 conn(0x7f865415ca20 msgr2=0x7f865415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 --2- 172.21.15.81:0/1848930634 >> v2:172.21.15.178:3300/0 conn(0x7f865415ca20 0x7f865415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 -- 172.21.15.81:0/1848930634 >> v1:172.21.15.178:6789/0 conn(0x7f865406cd80 legacy=0x7f86540b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 -- 172.21.15.81:0/1848930634 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865415d670 con 0x7f865406ada0 2024-09-13T18:47:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653400700 1 --2- 172.21.15.81:0/1848930634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 0x7f865406b210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f864c009d90 tx=0x7f864c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be0ca8ba6a03058b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8651600700 1 -- 172.21.15.81:0/1848930634 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c00e070 con 0x7f865406ada0 2024-09-13T18:47:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8651600700 1 -- 172.21.15.81:0/1848930634 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c00bb20 con 0x7f865406ada0 2024-09-13T18:47:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8651600700 1 -- 172.21.15.81:0/1848930634 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c012430 con 0x7f865406ada0 2024-09-13T18:47:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653e00700 1 -- 172.21.15.81:0/1848930634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 msgr2=0x7f865406b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653e00700 1 --2- 172.21.15.81:0/1848930634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 0x7f865406b210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f864c009d90 tx=0x7f864c00b330 comp rx=0 tx=0).stop 2024-09-13T18:47:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653e00700 1 -- 172.21.15.81:0/1848930634 shutdown_connections 2024-09-13T18:47:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653e00700 1 --2- 172.21.15.81:0/1848930634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406ada0 0x7f865406b210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653e00700 1 --2- 172.21.15.81:0/1848930634 >> v2:172.21.15.178:3300/0 conn(0x7f865415ca20 0x7f865415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.950+0000 7f8653e00700 1 -- 172.21.15.81:0/1848930634 >> 172.21.15.81:0/1848930634 conn(0x7f8654071d20 msgr2=0x7f8654072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.954+0000 7f8653e00700 1 -- 172.21.15.81:0/1848930634 shutdown_connections 2024-09-13T18:47:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.954+0000 7f8653e00700 1 -- 172.21.15.81:0/1848930634 wait complete. 2024-09-13T18:47:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.954+0000 7f8653e00700 1 Processor -- start 2024-09-13T18:47:47.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.954+0000 7f8653e00700 1 -- start start 2024-09-13T18:47:47.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 0x7f865414f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406cd80 0x7f86540cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865415ca20 0x7f865414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540ce3b0 con 0x7f865406ada0 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540cf900 con 0x7f865415ca20 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86540ce600 con 0x7f865406cd80 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 0x7f865414f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406cd80 0x7f86540cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 0x7f865414f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49978/0 (socket says 172.21.15.81:49978) 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 -- 172.21.15.81:0/3954295970 learned_addr learned my addr 172.21.15.81:0/3954295970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406cd80 0x7f86540cf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49028/0 (socket says 172.21.15.81:49028) 2024-09-13T18:47:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653400700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865415ca20 0x7f865414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 -- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406cd80 msgr2=0x7f86540cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406cd80 0x7f86540cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 -- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865415ca20 msgr2=0x7f865414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865415ca20 0x7f865414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 -- 172.21.15.81:0/3954295970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009a70 con 0x7f865406ada0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8652a00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 0x7f865414f3d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f864400e840 tx=0x7f864400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440095a0 con 0x7f865406ada0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644013680 con 0x7f865406ada0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86440139f0 con 0x7f865406ada0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.958+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86540ce8e0 con 0x7f865406ada0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.962+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86540ceea0 con 0x7f865406ada0 2024-09-13T18:47:47.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.962+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865406d1c0 con 0x7f865406ada0 2024-09-13T18:47:47.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.962+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8644013b50 con 0x7f865406ada0 2024-09-13T18:47:47.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.962+0000 7f864aa00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8634066730 0x7f8634068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.966+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86440842f0 con 0x7f865406ada0 2024-09-13T18:47:47.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.966+0000 7f8652000700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8634066730 0x7f8634068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.966+0000 7f8652000700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8634066730 0x7f8634068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86540d1510 tx=0x7f8640007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:47.970+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8644051360 con 0x7f865406ada0 2024-09-13T18:47:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.154+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f865406ab80 con 0x7f865406ada0 2024-09-13T18:47:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.154+0000 7f864aa00700 1 -- 172.21.15.81:0/3954295970 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8644054980 con 0x7f865406ada0 2024-09-13T18:47:48.163 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8634066730 msgr2=0x7f8634068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8634066730 0x7f8634068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86540d1510 tx=0x7f8640007f30 comp rx=0 tx=0).stop 2024-09-13T18:47:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 msgr2=0x7f865414f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 0x7f865414f3d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f864400e840 tx=0x7f864400eb50 comp rx=0 tx=0).stop 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 shutdown_connections 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8634066730 0x7f8634068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f865415ca20 0x7f865414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f865406cd80 0x7f86540cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 --2- 172.21.15.81:0/3954295970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865406ada0 0x7f865414f3d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 >> 172.21.15.81:0/3954295970 conn(0x7f8654071d20 msgr2=0x7f86540b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 shutdown_connections 2024-09-13T18:47:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.158+0000 7f8653e00700 1 -- 172.21.15.81:0/3954295970 wait complete. 2024-09-13T18:47:48.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.350+0000 7fd473c00700 1 Processor -- start 2024-09-13T18:47:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.350+0000 7fd473c00700 1 -- start start 2024-09-13T18:47:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd473c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd46c0cf280 0x7fd46c16bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd473c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c06d000 con 0x7fd46c06be10 2024-09-13T18:47:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd473c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c06c3f0 con 0x7fd46c160fc0 2024-09-13T18:47:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd473c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c06c6d0 con 0x7fd46c0cf280 2024-09-13T18:47:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd46c06be10 0x7fd46c0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49298/0 (socket says 172.21.15.81:49298) 2024-09-13T18:47:48.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46be00700 1 -- 172.21.15.81:0/704444141 learned_addr learned my addr 172.21.15.81:0/704444141 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:48.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd471c00700 1 --2- 172.21.15.81:0/704444141 >> v2:172.21.15.178:3300/0 conn(0x7fd46c0cf280 0x7fd46c16bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911746533 0 0) 0x7fd46c06d000 con 0x7fd46c06be10 2024-09-13T18:47:48.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4540035d0 con 0x7fd46c06be10 2024-09-13T18:47:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541013018 0 0) 0x7fd46c06c3f0 con 0x7fd46c160fc0 2024-09-13T18:47:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd46c06d000 con 0x7fd46c160fc0 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1232888542 0 0) 0x7fd4540035d0 con 0x7fd46c06be10 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 >> v2:172.21.15.178:3300/0 conn(0x7fd46c0cf280 msgr2=0x7fd46c16bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 --2- 172.21.15.81:0/704444141 >> v2:172.21.15.178:3300/0 conn(0x7fd46c0cf280 0x7fd46c16bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 >> v1:172.21.15.178:6789/0 conn(0x7fd46c160fc0 legacy=0x7fd46c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c06c9b0 con 0x7fd46c06be10 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fd458001670 con 0x7fd46c06be10 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 >> v1:172.21.15.81:6789/0 conn(0x7fd46c06be10 legacy=0x7fd46c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd454003bb0 0x7fd454003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454004870 0x7fd454004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd454005230 0x7fd45400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c06c6d0 con 0x7fd454005230 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45400c050 con 0x7fd454003bb0 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45400c210 con 0x7fd454004870 2024-09-13T18:47:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.354+0000 7fd471c00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd454005230 0x7fd45400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd46be00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454004870 0x7fd454004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471200700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd454003bb0 0x7fd454003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 -- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454004870 msgr2=0x7fd454004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454004870 0x7fd454004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 -- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd454003bb0 msgr2=0x7fd454003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd454003bb0 0x7fd454003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 -- 172.21.15.81:0/704444141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540035d0 con 0x7fd454005230 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 -- 172.21.15.81:0/704444141 reap_dead start 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd471c00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd454005230 0x7fd45400ba30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd464009f90 tx=0x7fd4540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48e2947903adf46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46400ec30 con 0x7fd454005230 2024-09-13T18:47:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46400f040 con 0x7fd454005230 2024-09-13T18:47:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd46b400700 1 -- 172.21.15.81:0/704444141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464014480 con 0x7fd454005230 2024-09-13T18:47:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 -- 172.21.15.81:0/704444141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd454005230 msgr2=0x7fd45400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd454005230 0x7fd45400ba30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd464009f90 tx=0x7fd4540058a0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 -- 172.21.15.81:0/704444141 shutdown_connections 2024-09-13T18:47:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 --2- 172.21.15.81:0/704444141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd454005230 0x7fd45400ba30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 -- 172.21.15.81:0/704444141 >> 172.21.15.81:0/704444141 conn(0x7fd46c06a570 msgr2=0x7fd46c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 -- 172.21.15.81:0/704444141 shutdown_connections 2024-09-13T18:47:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.358+0000 7fd473c00700 1 -- 172.21.15.81:0/704444141 wait complete. 2024-09-13T18:47:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 Processor -- start 2024-09-13T18:47:48.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 -- start start 2024-09-13T18:47:48.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454005230 0x7fd46c1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 0x7fd46c1f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd46c158170 0x7fd46c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c158b40 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c15b080 con 0x7fd46c158170 2024-09-13T18:47:48.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd473c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1f1290 con 0x7fd454005230 2024-09-13T18:47:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd46be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 0x7fd46c1f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd46be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 0x7fd46c1f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49992/0 (socket says 172.21.15.81:49992) 2024-09-13T18:47:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd46be00700 1 -- 172.21.15.81:0/3853935543 learned_addr learned my addr 172.21.15.81:0/3853935543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd471c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd46c158170 0x7fd46c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.362+0000 7fd471200700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454005230 0x7fd46c1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd46be00700 1 -- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454005230 msgr2=0x7fd46c1f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd46be00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454005230 0x7fd46c1f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd46be00700 1 -- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd46c158170 msgr2=0x7fd46c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd46be00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd46c158170 0x7fd46c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd46be00700 1 -- 172.21.15.81:0/3853935543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c1f7d40 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd471c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd46c158170 0x7fd46c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd46be00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 0x7fd46c1f7800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd458008340 tx=0x7fd458008700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45800e9f0 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45800eb70 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c15a190 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458014470 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c15a750 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c15b210 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.366+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd45801d3b0 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.370+0000 7fd468c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd44c066730 0x7fd44c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.370+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd458083f30 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.370+0000 7fd471200700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd44c066730 0x7fd44c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.370+0000 7fd471200700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd44c066730 0x7fd44c068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd460007900 tx=0x7fd460009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:48.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.378+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd458050fa0 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.550+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd46c06c3f0 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd468c00700 1 -- 172.21.15.81:0/3853935543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd458019020 con 0x7fd46c0ce0d0 2024-09-13T18:47:48.562 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd44c066730 msgr2=0x7fd44c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd44c066730 0x7fd44c068bf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd460007900 tx=0x7fd460009040 comp rx=0 tx=0).stop 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 msgr2=0x7fd46c1f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 0x7fd46c1f7800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd458008340 tx=0x7fd458008700 comp rx=0 tx=0).stop 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 shutdown_connections 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd44c066730 0x7fd44c068bf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd46c158170 0x7fd46c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd46c0ce0d0 0x7fd46c1f7800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 --2- 172.21.15.81:0/3853935543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd454005230 0x7fd46c1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 >> 172.21.15.81:0/3853935543 conn(0x7fd46c06a570 msgr2=0x7fd46c15e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:48.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 shutdown_connections 2024-09-13T18:47:48.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.554+0000 7fd473c00700 1 -- 172.21.15.81:0/3853935543 wait complete. 2024-09-13T18:47:48.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:47:48.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.746+0000 7fdc6a200700 1 Processor -- start 2024-09-13T18:47:48.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.746+0000 7fdc6a200700 1 -- start start 2024-09-13T18:47:48.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc6a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc640cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc6a200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc6415ad70 0x7fdc6406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc6a200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc64071f80 con 0x7fdc641519f0 2024-09-13T18:47:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc6a200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6406a760 con 0x7fdc6415ad70 2024-09-13T18:47:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc6a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6415b3c0 con 0x7fdc640b5500 2024-09-13T18:47:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc68e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc641519f0 0x7fdc640b4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49308/0 (socket says 172.21.15.81:49308) 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc69800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc6415ad70 0x7fdc6406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc68e00700 1 -- 172.21.15.81:0/512782540 learned_addr learned my addr 172.21.15.81:0/512782540 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc5be00700 1 --2- 172.21.15.81:0/512782540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc640cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc69800700 1 -- 172.21.15.81:0/512782540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 msgr2=0x7fdc640cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc69800700 1 --2- 172.21.15.81:0/512782540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc640cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc69800700 1 -- 172.21.15.81:0/512782540 >> v1:172.21.15.81:6789/0 conn(0x7fdc641519f0 legacy=0x7fdc640b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc69800700 1 -- 172.21.15.81:0/512782540 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6415b6a0 con 0x7fdc6415ad70 2024-09-13T18:47:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc69800700 1 --2- 172.21.15.81:0/512782540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc6406ac10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009850 tx=0x7fdc5c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8a133e5bc3e2ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc63e00700 1 -- 172.21.15.81:0/512782540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c011830 con 0x7fdc6415ad70 2024-09-13T18:47:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc63e00700 1 -- 172.21.15.81:0/512782540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c011990 con 0x7fdc6415ad70 2024-09-13T18:47:48.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.750+0000 7fdc63e00700 1 -- 172.21.15.81:0/512782540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c011d40 con 0x7fdc6415ad70 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 -- 172.21.15.81:0/512782540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 msgr2=0x7fdc6406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 --2- 172.21.15.81:0/512782540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc6406ac10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c009850 tx=0x7fdc5c009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 -- 172.21.15.81:0/512782540 shutdown_connections 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 --2- 172.21.15.81:0/512782540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc6406ac10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 --2- 172.21.15.81:0/512782540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc640cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 -- 172.21.15.81:0/512782540 >> 172.21.15.81:0/512782540 conn(0x7fdc64070d10 msgr2=0x7fdc640710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:48.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 -- 172.21.15.81:0/512782540 shutdown_connections 2024-09-13T18:47:48.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.754+0000 7fdc6a200700 1 -- 172.21.15.81:0/512782540 wait complete. 2024-09-13T18:47:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 Processor -- start 2024-09-13T18:47:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 -- start start 2024-09-13T18:47:48.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc6414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc641519f0 0x7fdc640a8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc64159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640a9100 con 0x7fdc6415ad70 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b3090 con 0x7fdc641519f0 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc6a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b3370 con 0x7fdc640b5500 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc64159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc64159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50024/0 (socket says 172.21.15.81:50024) 2024-09-13T18:47:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 -- 172.21.15.81:0/3381558541 learned_addr learned my addr 172.21.15.81:0/3381558541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc68e00700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc6414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc5be00700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc641519f0 0x7fdc640a8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 -- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 msgr2=0x7fdc6414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc6414d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 -- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc641519f0 msgr2=0x7fdc640a8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc641519f0 0x7fdc640a8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 -- 172.21.15.81:0/3381558541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0094b0 con 0x7fdc6415ad70 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc5be00700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc641519f0 0x7fdc640a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.758+0000 7fdc69800700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc64159810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0090b0 tx=0x7fdc5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.762+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0036c0 con 0x7fdc6415ad70 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.762+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c01e070 con 0x7fdc6415ad70 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.762+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc640b3650 con 0x7fdc6415ad70 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.762+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c003a40 con 0x7fdc6415ad70 2024-09-13T18:47:48.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.762+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc640a93e0 con 0x7fdc6415ad70 2024-09-13T18:47:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.762+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc64151250 con 0x7fdc6415ad70 2024-09-13T18:47:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.766+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc5c003ba0 con 0x7fdc6415ad70 2024-09-13T18:47:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.766+0000 7fdc61600700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc40066730 0x7fdc40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:48.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.766+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdc5c020070 con 0x7fdc6415ad70 2024-09-13T18:47:48.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.766+0000 7fdc68e00700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc40066730 0x7fdc40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.766+0000 7fdc68e00700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc40066730 0x7fdc40068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc54005cb0 tx=0x7fdc54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.774+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc5c052aa0 con 0x7fdc6415ad70 2024-09-13T18:47:48.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.954+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc6406ac10 con 0x7fdc6415ad70 2024-09-13T18:47:48.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.954+0000 7fdc61600700 1 -- 172.21.15.81:0/3381558541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc5c0150a0 con 0x7fdc6415ad70 2024-09-13T18:47:48.964 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:47:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc40066730 msgr2=0x7fdc40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc40066730 0x7fdc40068bf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc54005cb0 tx=0x7fdc54009040 comp rx=0 tx=0).stop 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 msgr2=0x7fdc64159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc64159810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0090b0 tx=0x7fdc5c004770 comp rx=0 tx=0).stop 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 shutdown_connections 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc40066730 0x7fdc40068bf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc6415ad70 0x7fdc64159810 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc641519f0 0x7fdc640a8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 --2- 172.21.15.81:0/3381558541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc640b5500 0x7fdc6414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 >> 172.21.15.81:0/3381558541 conn(0x7fdc64070d10 msgr2=0x7fdc6414f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 shutdown_connections 2024-09-13T18:47:48.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:48.958+0000 7fdc6a200700 1 -- 172.21.15.81:0/3381558541 wait complete. 2024-09-13T18:47:48.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:49.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.146+0000 7f502be00700 1 Processor -- start 2024-09-13T18:47:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502be00700 1 -- start start 2024-09-13T18:47:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c0cd970 con 0x7f502c0d10f0 2024-09-13T18:47:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502c15e450 con 0x7f502c0b2c50 2024-09-13T18:47:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0d0050 con 0x7f502c15e070 2024-09-13T18:47:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502a000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f502c0d10f0 0x7f502c0b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49320/0 (socket says 172.21.15.81:49320) 2024-09-13T18:47:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502a000700 1 -- 172.21.15.81:0/1952298593 learned_addr learned my addr 172.21.15.81:0/1952298593 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.150+0000 7f502aa00700 1 --2- 172.21.15.81:0/1952298593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f5029600700 1 -- 172.21.15.81:0/1952298593 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557306992 0 0) 0x7f5018001110 con 0x7f502c0d10f0 2024-09-13T18:47:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f5029600700 1 -- 172.21.15.81:0/1952298593 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50100035d0 con 0x7f502c0d10f0 2024-09-13T18:47:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502aa00700 1 -- 172.21.15.81:0/1952298593 >> v1:172.21.15.178:6789/0 conn(0x7f502c0b2c50 legacy=0x7f502c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502aa00700 1 -- 172.21.15.81:0/1952298593 >> v1:172.21.15.81:6789/0 conn(0x7f502c0d10f0 legacy=0x7f502c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502aa00700 1 -- 172.21.15.81:0/1952298593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502c0d0330 con 0x7f502c15e070 2024-09-13T18:47:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502aa00700 1 --2- 172.21.15.81:0/1952298593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0cd430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f501c009880 tx=0x7f501c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e622309104bffb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f5029600700 1 -- 172.21.15.81:0/1952298593 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c011830 con 0x7f502c15e070 2024-09-13T18:47:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f5029600700 1 -- 172.21.15.81:0/1952298593 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c011990 con 0x7f502c15e070 2024-09-13T18:47:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f5029600700 1 -- 172.21.15.81:0/1952298593 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c011d20 con 0x7f502c15e070 2024-09-13T18:47:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 -- 172.21.15.81:0/1952298593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 msgr2=0x7f502c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 --2- 172.21.15.81:0/1952298593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0cd430 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f501c009880 tx=0x7f501c009b90 comp rx=0 tx=0).stop 2024-09-13T18:47:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 -- 172.21.15.81:0/1952298593 shutdown_connections 2024-09-13T18:47:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 --2- 172.21.15.81:0/1952298593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0cd430 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 -- 172.21.15.81:0/1952298593 >> 172.21.15.81:0/1952298593 conn(0x7f502c071f00 msgr2=0x7f502c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 -- 172.21.15.81:0/1952298593 shutdown_connections 2024-09-13T18:47:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.154+0000 7f502be00700 1 -- 172.21.15.81:0/1952298593 wait complete. 2024-09-13T18:47:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 Processor -- start 2024-09-13T18:47:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 -- start start 2024-09-13T18:47:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f502c0b2c50 0x7f502c1f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 0x7f502c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0b3cc0 con 0x7f502c0d10f0 2024-09-13T18:47:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502c1f69b0 con 0x7f502c0b2c50 2024-09-13T18:47:49.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502c0c69e0 con 0x7f502c15e070 2024-09-13T18:47:49.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 0x7f502c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 0x7f502c15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50038/0 (socket says 172.21.15.81:50038) 2024-09-13T18:47:49.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 -- 172.21.15.81:0/1875750511 learned_addr learned my addr 172.21.15.81:0/1875750511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:49.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502aa00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f502c0b2c50 0x7f502c1f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502b400700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 -- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 msgr2=0x7f502c0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 -- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f502c0b2c50 msgr2=0x7f502c1f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f502c0b2c50 0x7f502c1f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502a000700 1 -- 172.21.15.81:0/1875750511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0094b0 con 0x7f502c0d10f0 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.158+0000 7f502b400700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f502a000700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 0x7f502c15ad80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5018001270 tx=0x7f501800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018005d90 con 0x7f502c0d10f0 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180070d0 con 0x7f502c0d10f0 2024-09-13T18:47:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502c0c6cc0 con 0x7f502c0d10f0 2024-09-13T18:47:49.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018007480 con 0x7f502c0d10f0 2024-09-13T18:47:49.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502c0b3950 con 0x7f502c0d10f0 2024-09-13T18:47:49.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502c0b3e70 con 0x7f502c0d10f0 2024-09-13T18:47:49.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.162+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50180075e0 con 0x7f502c0d10f0 2024-09-13T18:47:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.166+0000 7f5022a00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f500c066730 0x7f500c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.166+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5018083770 con 0x7f502c0d10f0 2024-09-13T18:47:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.166+0000 7f502aa00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f500c066730 0x7f500c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.166+0000 7f502aa00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f500c066730 0x7f500c068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f501c0090b0 tx=0x7f501c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:49.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.170+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f502c0b3e70 con 0x7f502c0d10f0 2024-09-13T18:47:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.398+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f502c0cd970 con 0x7f502c0d10f0 2024-09-13T18:47:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.398+0000 7f5022a00700 1 -- 172.21.15.81:0/1875750511 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7f502c0cd970 con 0x7f502c0d10f0 2024-09-13T18:47:49.409 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:49.409 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.402+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f500c066730 msgr2=0x7f500c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.402+0000 7f502be00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f500c066730 0x7f500c068bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f501c0090b0 tx=0x7f501c010000 comp rx=0 tx=0).stop 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.402+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 msgr2=0x7f502c15ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.402+0000 7f502be00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 0x7f502c15ad80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5018001270 tx=0x7f501800c9e0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 shutdown_connections 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f500c066730 0x7f500c068bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f502c15e070 0x7f502c0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f502c0d10f0 0x7f502c15ad80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 --2- 172.21.15.81:0/1875750511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f502c0b2c50 0x7f502c1f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 >> 172.21.15.81:0/1875750511 conn(0x7f502c071f00 msgr2=0x7f502c0b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 shutdown_connections 2024-09-13T18:47:49.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.406+0000 7f502be00700 1 -- 172.21.15.81:0/1875750511 wait complete. 2024-09-13T18:47:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:47:49.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:49.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.590+0000 7fac29c00700 1 Processor -- start 2024-09-13T18:47:49.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.590+0000 7fac29c00700 1 -- start start 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.590+0000 7fac29c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac240cb020 0x7fac240cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2415c2a0 0x7fac2415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac240b2ad0 con 0x7fac2406aaa0 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2415b960 con 0x7fac240cb020 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2415bc40 con 0x7fac2415c2a0 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac240cb020 0x7fac240cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac240cb020 0x7fac240cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50048/0 (socket says 172.21.15.81:50048) 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 -- 172.21.15.81:0/809002280 learned_addr learned my addr 172.21.15.81:0/809002280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29200700 1 --1- 172.21.15.81:0/809002280 >> v1:172.21.15.81:6789/0 conn(0x7fac2406aaa0 0x7fac240b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49328/0 (socket says 172.21.15.81:49328) 2024-09-13T18:47:49.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac1b400700 1 --2- 172.21.15.81:0/809002280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2415c2a0 0x7fac2415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 -- 172.21.15.81:0/809002280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2415c2a0 msgr2=0x7fac2415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:49.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 --2- 172.21.15.81:0/809002280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2415c2a0 0x7fac2415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 -- 172.21.15.81:0/809002280 >> v1:172.21.15.81:6789/0 conn(0x7fac2406aaa0 legacy=0x7fac240b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 -- 172.21.15.81:0/809002280 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2415bf20 con 0x7fac240cb020 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23e00700 1 --2- 172.21.15.81:0/809002280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac240cc6f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac14009e50 tx=0x7fac1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f98783967c2be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23400700 1 -- 172.21.15.81:0/809002280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400e070 con 0x7fac240cb020 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23400700 1 -- 172.21.15.81:0/809002280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1400b9c0 con 0x7fac240cb020 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac23400700 1 -- 172.21.15.81:0/809002280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400bd70 con 0x7fac240cb020 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- 172.21.15.81:0/809002280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 msgr2=0x7fac240cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 --2- 172.21.15.81:0/809002280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac240cc6f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fac14009e50 tx=0x7fac1400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:49.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- 172.21.15.81:0/809002280 shutdown_connections 2024-09-13T18:47:49.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 --2- 172.21.15.81:0/809002280 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2415c2a0 0x7fac2415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 --2- 172.21.15.81:0/809002280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac240cc6f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- 172.21.15.81:0/809002280 >> 172.21.15.81:0/809002280 conn(0x7fac240b0c40 msgr2=0x7fac2406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:49.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- 172.21.15.81:0/809002280 shutdown_connections 2024-09-13T18:47:49.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.594+0000 7fac29c00700 1 -- 172.21.15.81:0/809002280 wait complete. 2024-09-13T18:47:49.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.598+0000 7fac29c00700 1 Processor -- start 2024-09-13T18:47:49.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.598+0000 7fac29c00700 1 -- start start 2024-09-13T18:47:49.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2406aaa0 0x7fac24133c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac241366a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac2415c2a0 0x7fac24135280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac24134e60 con 0x7fac240cb020 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac241f38c0 con 0x7fac2415c2a0 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac24136be0 con 0x7fac2406aaa0 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac241366a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac241366a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50052/0 (socket says 172.21.15.81:50052) 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 -- 172.21.15.81:0/2414325559 learned_addr learned my addr 172.21.15.81:0/2414325559 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac23e00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2406aaa0 0x7fac24133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29200700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac2415c2a0 0x7fac24135280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 -- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2406aaa0 msgr2=0x7fac24133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2406aaa0 0x7fac24133c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 -- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac2415c2a0 msgr2=0x7fac24135280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac2415c2a0 0x7fac24135280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 -- 172.21.15.81:0/2414325559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14009b30 con 0x7fac240cb020 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac1b400700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac241366a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00d800 tx=0x7fac0c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c017070 con 0x7fac240cb020 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c004020 con 0x7fac240cb020 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0041d0 con 0x7fac240cb020 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac241341e0 con 0x7fac240cb020 2024-09-13T18:47:49.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.602+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac241347a0 con 0x7fac240cb020 2024-09-13T18:47:49.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.606+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac24134fa0 con 0x7fac240cb020 2024-09-13T18:47:49.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.606+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac0c004330 con 0x7fac240cb020 2024-09-13T18:47:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.606+0000 7fac20c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fac00066730 0x7fac00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.606+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac0c083f80 con 0x7fac240cb020 2024-09-13T18:47:49.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.606+0000 7fac23e00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fac00066730 0x7fac00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:49.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.610+0000 7fac23e00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fac00066730 0x7fac00068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b370 tx=0x7fac14009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:49.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.614+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac24134fa0 con 0x7fac240cb020 2024-09-13T18:47:49.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.814+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac24134fa0 con 0x7fac240cb020 2024-09-13T18:47:49.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac20c00700 1 -- 172.21.15.81:0/2414325559 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fac24134fa0 con 0x7fac240cb020 2024-09-13T18:47:49.826 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:49.827 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:19.951038+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fac00066730 msgr2=0x7fac00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fac00066730 0x7fac00068bf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b370 tx=0x7fac14009000 comp rx=0 tx=0).stop 2024-09-13T18:47:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 msgr2=0x7fac241366a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac241366a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00d800 tx=0x7fac0c00db10 comp rx=0 tx=0).stop 2024-09-13T18:47:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 shutdown_connections 2024-09-13T18:47:49.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fac00066730 0x7fac00068bf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fac2415c2a0 0x7fac24135280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac240cb020 0x7fac241366a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 --2- 172.21.15.81:0/2414325559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fac2406aaa0 0x7fac24133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 >> 172.21.15.81:0/2414325559 conn(0x7fac240b0c40 msgr2=0x7fac2406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 shutdown_connections 2024-09-13T18:47:49.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:49.818+0000 7fac29c00700 1 -- 172.21.15.81:0/2414325559 wait complete. 2024-09-13T18:47:49.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.018+0000 7ff3e6400700 1 Processor -- start 2024-09-13T18:47:50.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.018+0000 7ff3e6400700 1 -- start start 2024-09-13T18:47:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3e6400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4f30 0x7ff3e00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3e6400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3e015e660 0x7ff3e00d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3e6400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e015b210 con 0x7ff3e00b4b50 2024-09-13T18:47:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3e6400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e015ec20 con 0x7ff3e015e660 2024-09-13T18:47:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3e6400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e015ef00 con 0x7ff3e00b4f30 2024-09-13T18:47:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3df400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff3e00b4b50 0x7ff3e00cd410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49330/0 (socket says 172.21.15.81:49330) 2024-09-13T18:47:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.022+0000 7ff3df400700 1 -- 172.21.15.81:0/657270322 learned_addr learned my addr 172.21.15.81:0/657270322 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dfe00700 1 --2- 172.21.15.81:0/657270322 >> v2:172.21.15.81:3300/0 conn(0x7ff3e015e660 0x7ff3e00d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dea00700 1 --2- 172.21.15.81:0/657270322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4f30 0x7ff3e00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3de000700 1 -- 172.21.15.81:0/657270322 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309929622 0 0) 0x7ff3e015b210 con 0x7ff3e00b4b50 2024-09-13T18:47:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3de000700 1 -- 172.21.15.81:0/657270322 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c40035d0 con 0x7ff3e00b4b50 2024-09-13T18:47:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dfe00700 1 -- 172.21.15.81:0/657270322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4f30 msgr2=0x7ff3e00b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dfe00700 1 --2- 172.21.15.81:0/657270322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4f30 0x7ff3e00b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dfe00700 1 -- 172.21.15.81:0/657270322 >> v1:172.21.15.81:6789/0 conn(0x7ff3e00b4b50 legacy=0x7ff3e00cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dfe00700 1 -- 172.21.15.81:0/657270322 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e015f1e0 con 0x7ff3e015e660 2024-09-13T18:47:50.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3dfe00700 1 --2- 172.21.15.81:0/657270322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e015e660 0x7ff3e00d0ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009d90 tx=0x7ff3d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1993d2af898b111e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3de000700 1 -- 172.21.15.81:0/657270322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800e070 con 0x7ff3e015e660 2024-09-13T18:47:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3de000700 1 -- 172.21.15.81:0/657270322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d800bb20 con 0x7ff3e015e660 2024-09-13T18:47:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3de000700 1 -- 172.21.15.81:0/657270322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800be90 con 0x7ff3e015e660 2024-09-13T18:47:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 -- 172.21.15.81:0/657270322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e015e660 msgr2=0x7ff3e00d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 --2- 172.21.15.81:0/657270322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e015e660 0x7ff3e00d0ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009d90 tx=0x7ff3d800b330 comp rx=0 tx=0).stop 2024-09-13T18:47:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 -- 172.21.15.81:0/657270322 shutdown_connections 2024-09-13T18:47:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 --2- 172.21.15.81:0/657270322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e015e660 0x7ff3e00d0ee0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 --2- 172.21.15.81:0/657270322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4f30 0x7ff3e00b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 -- 172.21.15.81:0/657270322 >> 172.21.15.81:0/657270322 conn(0x7ff3e00b5fc0 msgr2=0x7ff3e00b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 -- 172.21.15.81:0/657270322 shutdown_connections 2024-09-13T18:47:50.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.026+0000 7ff3e6400700 1 -- 172.21.15.81:0/657270322 wait complete. 2024-09-13T18:47:50.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.030+0000 7ff3e6400700 1 Processor -- start 2024-09-13T18:47:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.030+0000 7ff3e6400700 1 -- start start 2024-09-13T18:47:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4b50 0x7ff3e013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 0x7ff3e006a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3e015e660 0x7ff3e01481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e006c2e0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e006b240 con 0x7ff3e015e660 2024-09-13T18:47:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e006b520 con 0x7ff3e00b4b50 2024-09-13T18:47:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 0x7ff3e006a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 0x7ff3e006a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50076/0 (socket says 172.21.15.81:50076) 2024-09-13T18:47:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 -- 172.21.15.81:0/609896333 learned_addr learned my addr 172.21.15.81:0/609896333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3df400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4b50 0x7ff3e013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dfe00700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3e015e660 0x7ff3e01481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 -- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4b50 msgr2=0x7ff3e013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4b50 0x7ff3e013e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 -- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3e015e660 msgr2=0x7ff3e01481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3e015e660 0x7ff3e01481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 -- 172.21.15.81:0/609896333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d8009a70 con 0x7ff3e00b4f30 2024-09-13T18:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3df400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4b50 0x7ff3e013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3dea00700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 0x7ff3e006a780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00e960 tx=0x7ff3cc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0096c0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc013680 con 0x7ff3e00b4f30 2024-09-13T18:47:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e006b800 con 0x7ff3e00b4f30 2024-09-13T18:47:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0139f0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.034+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e006bdc0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.038+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e00b3aa0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.038+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3cc013b50 con 0x7ff3e00b4f30 2024-09-13T18:47:50.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.038+0000 7ff3d7400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3c0066730 0x7ff3c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.038+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff3cc084520 con 0x7ff3e00b4f30 2024-09-13T18:47:50.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.042+0000 7ff3df400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3c0066730 0x7ff3c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.042+0000 7ff3df400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3c0066730 0x7ff3c0068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0007fd0 tx=0x7ff3d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.046+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3cc051480 con 0x7ff3e00b4f30 2024-09-13T18:47:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.270+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3e00b57d0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.274+0000 7ff3d7400700 1 -- 172.21.15.81:0/609896333 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7ff3cc054aa0 con 0x7ff3e00b4f30 2024-09-13T18:47:50.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:47:50.282 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:47:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3c0066730 msgr2=0x7ff3c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3c0066730 0x7ff3c0068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0007fd0 tx=0x7ff3d0009040 comp rx=0 tx=0).stop 2024-09-13T18:47:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 msgr2=0x7ff3e006a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 0x7ff3e006a780 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00e960 tx=0x7ff3cc00ec70 comp rx=0 tx=0).stop 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 shutdown_connections 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3c0066730 0x7ff3c0068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3e015e660 0x7ff3e01481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e00b4f30 0x7ff3e006a780 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 --2- 172.21.15.81:0/609896333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3e00b4b50 0x7ff3e013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 >> 172.21.15.81:0/609896333 conn(0x7ff3e00b5fc0 msgr2=0x7ff3e006cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 shutdown_connections 2024-09-13T18:47:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.278+0000 7ff3e6400700 1 -- 172.21.15.81:0/609896333 wait complete. 2024-09-13T18:47:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:47:50.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:47:15.438108+0000', 'modified': '2024-09-13T18:47:35.558150+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6835/968984617', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 968984617}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 968984617}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:47:50.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:47:50.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:47:50.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.882+0000 7ff1c0c00700 1 Processor -- start 2024-09-13T18:47:50.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.882+0000 7ff1c0c00700 1 -- start start 2024-09-13T18:47:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1c0c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1bc0cc6f0 0x7ff1bc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1c0c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1bc06aaa0 0x7ff1bc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1c0c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0ccb40 con 0x7ff1bc0cb020 2024-09-13T18:47:50.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1c0c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc06b430 con 0x7ff1bc0cc6f0 2024-09-13T18:47:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1c0c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc0b2ad0 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1bb400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1bc0cb020 0x7ff1bc15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49342/0 (socket says 172.21.15.81:49342) 2024-09-13T18:47:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1b2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1bc0cc6f0 0x7ff1bc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1bb400700 1 -- 172.21.15.81:0/2880465341 learned_addr learned my addr 172.21.15.81:0/2880465341 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:50.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/2880465341 >> v2:172.21.15.178:3300/0 conn(0x7ff1bc06aaa0 0x7ff1bc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1b2a00700 1 -- 172.21.15.81:0/2880465341 >> v2:172.21.15.178:3300/0 conn(0x7ff1bc06aaa0 msgr2=0x7ff1bc06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/2880465341 >> v2:172.21.15.178:3300/0 conn(0x7ff1bc06aaa0 0x7ff1bc06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1baa00700 1 -- 172.21.15.81:0/2880465341 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512876640 0 0) 0x7ff1bc0ccb40 con 0x7ff1bc0cb020 2024-09-13T18:47:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1b2a00700 1 -- 172.21.15.81:0/2880465341 >> v1:172.21.15.81:6789/0 conn(0x7ff1bc0cb020 legacy=0x7ff1bc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1b2a00700 1 -- 172.21.15.81:0/2880465341 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc15b960 con 0x7ff1bc0cc6f0 2024-09-13T18:47:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.886+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/2880465341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc0cc6f0 0x7ff1bc15b0e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0cd7e0 tx=0x7ff1a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a17f25c4bf2c740 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1baa00700 1 -- 172.21.15.81:0/2880465341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400e070 con 0x7ff1bc0cc6f0 2024-09-13T18:47:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1baa00700 1 -- 172.21.15.81:0/2880465341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a400bbd0 con 0x7ff1bc0cc6f0 2024-09-13T18:47:50.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1baa00700 1 -- 172.21.15.81:0/2880465341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4012430 con 0x7ff1bc0cc6f0 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 -- 172.21.15.81:0/2880465341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc0cc6f0 msgr2=0x7ff1bc15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/2880465341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc0cc6f0 0x7ff1bc15b0e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc0cd7e0 tx=0x7ff1a400b330 comp rx=0 tx=0).stop 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 -- 172.21.15.81:0/2880465341 shutdown_connections 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/2880465341 >> v2:172.21.15.178:3300/0 conn(0x7ff1bc06aaa0 0x7ff1bc06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/2880465341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc0cc6f0 0x7ff1bc15b0e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 -- 172.21.15.81:0/2880465341 >> 172.21.15.81:0/2880465341 conn(0x7ff1bc0b0c40 msgr2=0x7ff1bc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 -- 172.21.15.81:0/2880465341 shutdown_connections 2024-09-13T18:47:50.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.890+0000 7ff1c0c00700 1 -- 172.21.15.81:0/2880465341 wait complete. 2024-09-13T18:47:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 Processor -- start 2024-09-13T18:47:50.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 -- start start 2024-09-13T18:47:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 0x7ff1bc0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1bc0cb020 0x7ff1bc1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1bc0cc6f0 0x7ff1bc071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc1549e0 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc158620 con 0x7ff1bc0cb020 2024-09-13T18:47:50.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1c0c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc155bd0 con 0x7ff1bc0cc6f0 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 0x7ff1bc0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 0x7ff1bc0ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50090/0 (socket says 172.21.15.81:50090) 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1bb400700 1 -- 172.21.15.81:0/3177109168 learned_addr learned my addr 172.21.15.81:0/3177109168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1bc0cc6f0 0x7ff1bc071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.894+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1bc0cb020 0x7ff1bc1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1bb400700 1 -- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1bc0cc6f0 msgr2=0x7ff1bc071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1bb400700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1bc0cc6f0 0x7ff1bc071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1bb400700 1 -- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1bc0cb020 msgr2=0x7ff1bc1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1bb400700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1bc0cb020 0x7ff1bc1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1bb400700 1 -- 172.21.15.81:0/3177109168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4009a70 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1bb400700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 0x7ff1bc0ca1e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c580 tx=0x7ff1ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1b3e00700 1 -- 172.21.15.81:0/3177109168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac004ca0 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1b3e00700 1 -- 172.21.15.81:0/3177109168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac004e20 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1b3e00700 1 -- 172.21.15.81:0/3177109168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac007310 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc157cf0 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.898+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc1582b0 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.902+0000 7ff1b3e00700 1 -- 172.21.15.81:0/3177109168 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1ac007470 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.902+0000 7ff1b3e00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff198066760 0x7ff198068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.902+0000 7ff1b3e00700 1 -- 172.21.15.81:0/3177109168 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff1ac0841a0 con 0x7ff1bc06aaa0 2024-09-13T18:47:50.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.902+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff198066760 0x7ff198068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff198066760 0x7ff198068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4014040 tx=0x7ff1a4011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 Processor -- start 2024-09-13T18:47:50.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 -- start start 2024-09-13T18:47:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9633da0 0x9634180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 0x95fc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x95fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x955bd80 con 0x9612d00 2024-09-13T18:47:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9559510 con 0x9633da0 2024-09-13T18:47:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x9554e00 con 0x96346c0 2024-09-13T18:47:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 0x95fc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 0x95fc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50094/0 (socket says 172.21.15.81:50094) 2024-09-13T18:47:50.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 -- 172.21.15.81:0/146319662 learned_addr learned my addr 172.21.15.81:0/146319662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1bb400700 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9633da0 0x9634180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x95fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 -- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 msgr2=0x95fcdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x95fcdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 -- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9633da0 msgr2=0x9634180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9633da0 0x9634180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 -- 172.21.15.81:0/146319662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x93c7960 con 0x9612d00 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x95fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.906+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 0x95fc890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400b730 tx=0x7ff1a4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0ae2f48b495b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1ab400700 1 -- 172.21.15.81:0/146319662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4031480 con 0x9612d00 2024-09-13T18:47:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1ab400700 1 -- 172.21.15.81:0/146319662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a402c070 con 0x9612d00 2024-09-13T18:47:50.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1ab400700 1 -- 172.21.15.81:0/146319662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40317e0 con 0x9612d00 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 -- 172.21.15.81:0/146319662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 msgr2=0x95fc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 0x95fc890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400b730 tx=0x7ff1a4010000 comp rx=0 tx=0).stop 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 -- 172.21.15.81:0/146319662 shutdown_connections 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x95fcdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9612d00 0x95fc890 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 --2- 172.21.15.81:0/146319662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9633da0 0x9634180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 -- 172.21.15.81:0/146319662 >> 172.21.15.81:0/146319662 conn(0x937c4d0 msgr2=0x9615c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 -- 172.21.15.81:0/146319662 shutdown_connections 2024-09-13T18:47:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 -- 172.21.15.81:0/146319662 wait complete. 2024-09-13T18:47:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 -- start start 2024-09-13T18:47:50.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.910+0000 7ff1c5690740 1 Processor -- start 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x9634180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x962f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x963a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x9512730 con 0x9633da0 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x95185b0 con 0x9612d00 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x9400aa0 con 0x96346c0 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 10 client.0 _ll_register_callbacks cb 0x954e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:47:50.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x962f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x962f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50096/0 (socket says 172.21.15.81:50096) 2024-09-13T18:47:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 -- 172.21.15.81:0/1654644430 learned_addr learned my addr 172.21.15.81:0/1654644430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x963a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1bb400700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x9634180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 -- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 msgr2=0x963a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x963a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 -- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 msgr2=0x9634180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x9634180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 -- 172.21.15.81:0/1654644430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a4022050 con 0x9633da0 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x962f690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4012c50 tx=0x7ff1a4004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38536a01f75c67a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff19fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff19fe00700 1 -- 172.21.15.81:0/1654644430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4031790 con 0x9633da0 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff19fe00700 1 -- 172.21.15.81:0/1654644430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff1a40318f0 con 0x9633da0 2024-09-13T18:47:50.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x93891e0 con 0x9633da0 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff19fe00700 1 -- 172.21.15.81:0/1654644430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a4031ab0 con 0x9633da0 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 10 client.4887 fetch_fsmap learned FSMap version 9 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x951b220 con 0x9633da0 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff19fe00700 1 -- 172.21.15.81:0/1654644430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x93891e0 con 0x9633da0 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff19fe00700 1 -- 172.21.15.81:0/1654644430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff1a4031c10 con 0x9633da0 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 10 client.4887 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 20 client.4887 populate_metadata read hostname 'smithi081' 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x95ed2f0 0x95ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 4 client.4887 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:47:50.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 --> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x93d3460 con 0x95ed2f0 2024-09-13T18:47:50.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.914+0000 7ff1bb400700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x95ed2f0 0x95ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff19fe00700 10 client.4887 ms_handle_connect on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:50.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1bb400700 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x95ed2f0 0x95ed6d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f968887c9612fb74 server_cookie=6887a8822272ef0b in_seq=0 out_seq=0 2024-09-13T18:47:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff19fe00700 1 -- 172.21.15.81:0/1654644430 <== mds.0 v2:172.21.15.81:6834/968984617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x93d3460 con 0x95ed2f0 2024-09-13T18:47:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff19fe00700 10 client.4887 handle_command_reply: tid=0 2024-09-13T18:47:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 client.4887 shutdown 2024-09-13T18:47:50.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 msgr2=0x962f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x962f690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4012c50 tx=0x7ff1a4004b60 comp rx=0 tx=0).stop 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 shutdown_connections 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x95ed2f0 0x95ed6d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x963a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x962f690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 --2- 172.21.15.81:0/1654644430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x9634180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 >> 172.21.15.81:0/1654644430 conn(0x937c4d0 msgr2=0x960f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff19fe00700 0 client.4887 ms_handle_reset on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 shutdown_connections 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 1 -- 172.21.15.81:0/1654644430 wait complete. 2024-09-13T18:47:50.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.918+0000 7ff1c5690740 20 client.4887 trim_cache size 0 max 16384 2024-09-13T18:47:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 Processor -- start 2024-09-13T18:47:50.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 -- start start 2024-09-13T18:47:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x960e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x960e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x9634aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x94f3470 con 0x9633da0 2024-09-13T18:47:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9583ec0 con 0x9612d00 2024-09-13T18:47:50.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x94fd020 con 0x96346c0 2024-09-13T18:47:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x960e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x960e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50106/0 (socket says 172.21.15.81:50106) 2024-09-13T18:47:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1bb400700 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x960e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1b2a00700 1 -- 172.21.15.81:0/150093204 learned_addr learned my addr 172.21.15.81:0/150093204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:50.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x9634aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.938+0000 7ff1b2a00700 1 -- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 msgr2=0x9634aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x9634aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1b2a00700 1 -- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 msgr2=0x960e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x960e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1b2a00700 1 -- 172.21.15.81:0/150093204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x9501450 con 0x9633da0 2024-09-13T18:47:50.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1bb400700 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x960e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x960e580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4033010 tx=0x7ff1a4033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d8a3b0cc66606b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1abe00700 1 -- 172.21.15.81:0/150093204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40285e0 con 0x9633da0 2024-09-13T18:47:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1abe00700 1 -- 172.21.15.81:0/150093204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4028880 con 0x9633da0 2024-09-13T18:47:50.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1abe00700 1 -- 172.21.15.81:0/150093204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4028bf0 con 0x9633da0 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 -- 172.21.15.81:0/150093204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 msgr2=0x960e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x960e580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4033010 tx=0x7ff1a4033040 comp rx=0 tx=0).stop 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 -- 172.21.15.81:0/150093204 shutdown_connections 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x9634aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9633da0 0x960e580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 --2- 172.21.15.81:0/150093204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x960e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 -- 172.21.15.81:0/150093204 >> 172.21.15.81:0/150093204 conn(0x937c4d0 msgr2=0x9611f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 -- 172.21.15.81:0/150093204 shutdown_connections 2024-09-13T18:47:50.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 -- 172.21.15.81:0/150093204 wait complete. 2024-09-13T18:47:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 -- start start 2024-09-13T18:47:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.942+0000 7ff1c5690740 1 Processor -- start 2024-09-13T18:47:50.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x967ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x96950a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 0x96959c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x95ebb40 con 0x96955e0 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9639d60 con 0x9612d00 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x95b60f0 con 0x96346c0 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 10 client.0 _ll_register_callbacks cb 0x95ab710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:47:50.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 0x96959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 0x96959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50118/0 (socket says 172.21.15.81:50118) 2024-09-13T18:47:50.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 -- 172.21.15.81:0/4272801489 learned_addr learned my addr 172.21.15.81:0/4272801489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:50.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1b2a00700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x96950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bb400700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x967ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 -- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 msgr2=0x96950a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x96950a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 -- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 msgr2=0x967ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:50.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x967ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 -- 172.21.15.81:0/4272801489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc1582b0 con 0x96955e0 2024-09-13T18:47:50.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1bbe00700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 0x96959c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4016620 tx=0x7ff1b4016930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bdccc740a8a29d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:50.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff19fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff19fe00700 1 -- 172.21.15.81:0/4272801489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4018660 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff19fe00700 1 -- 172.21.15.81:0/4272801489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff1b4022e00 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1a402c070 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff19fe00700 1 -- 172.21.15.81:0/4272801489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1b40187c0 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 10 client.4893 fetch_fsmap learned FSMap version 9 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x951b220 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff19fe00700 1 -- 172.21.15.81:0/4272801489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a402c070 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff19fe00700 1 -- 172.21.15.81:0/4272801489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff1b4018920 con 0x96955e0 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 10 client.4893 fetch_fsmap finished waiting for FSMap version 9 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 10 client.4893 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 20 client.4893 populate_metadata read hostname 'smithi081' 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x9636f80 0x9637360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:50.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 4 client.4893 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:47:50.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.946+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 --> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] -- command(tid 0: {"prefix": "status"}) v1 -- 0x93f81e0 con 0x9636f80 2024-09-13T18:47:50.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1bb400700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x9636f80 0x9637360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1bb400700 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x9636f80 0x9637360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=603dac45e0fd078d server_cookie=75ea1bcb61e6ec85 in_seq=0 out_seq=0 2024-09-13T18:47:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff19fe00700 10 client.4893 ms_handle_connect on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff19fe00700 1 -- 172.21.15.81:0/4272801489 <== mds.0 v2:172.21.15.81:6834/968984617 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x93f81e0 con 0x9636f80 2024-09-13T18:47:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff19fe00700 10 client.4893 handle_command_reply: tid=0 2024-09-13T18:47:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 client.4893 shutdown 2024-09-13T18:47:50.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 msgr2=0x96959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 0x96959c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4016620 tx=0x7ff1b4016930 comp rx=0 tx=0).stop 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 shutdown_connections 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:6834/968984617,v1:172.21.15.81:6835/968984617] conn(0x9636f80 0x9637360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x96955e0 0x96959c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x96346c0 0x96950a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 --2- 172.21.15.81:0/4272801489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9612d00 0x967ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff19fe00700 0 client.4893 ms_handle_reset on v2:172.21.15.81:6834/968984617 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 >> 172.21.15.81:0/4272801489 conn(0x937c4d0 msgr2=0x95ea710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 shutdown_connections 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 1 -- 172.21.15.81:0/4272801489 wait complete. 2024-09-13T18:47:50.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c5690740 20 client.4893 trim_cache size 0 max 16384 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4278, 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 35.510725540000003, 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 9, 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 24, 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 24, 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 41.047166881999999 2024-09-13T18:47:50.962 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff198066760 msgr2=0x7ff198068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff198066760 0x7ff198068c20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4014040 tx=0x7ff1a4011000 comp rx=0 tx=0).stop 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 msgr2=0x7ff1bc0ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 0x7ff1bc0ca1e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00c580 tx=0x7ff1ac00c940 comp rx=0 tx=0).stop 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 shutdown_connections 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff198066760 0x7ff198068c20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1bc0cc6f0 0x7ff1bc071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1bc0cb020 0x7ff1bc1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 --2- 172.21.15.81:0/3177109168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1bc06aaa0 0x7ff1bc0ca1e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 >> 172.21.15.81:0/3177109168 conn(0x7ff1bc0b0c40 msgr2=0x7ff1bc0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 shutdown_connections 2024-09-13T18:47:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:50.950+0000 7ff1c0c00700 1 -- 172.21.15.81:0/3177109168 wait complete. 2024-09-13T18:47:50.987 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:47:50.997 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:47:50.997 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:47:50.997 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:47:50.997 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:47:51.048 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:47:51.048 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T18:47:51.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.049 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:47:51.067 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T18:47:51.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T18:47:51.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-13T18:47:51.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.723 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:47:51.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-13T18:47:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-13T18:47:51.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:47:51.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.824 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-09-13T18:47:51.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.841 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-09-13T18:47:51.926 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-09-13T18:47:51.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:47:51.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.930 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-09-13T18:47:51.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:51.993 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-09-13T18:47:52.074 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-09-13T18:47:52.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:47:52.077 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-13T18:47:52.077 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:47:52.078 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:52.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:52.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.238+0000 7fad5b200700 1 Processor -- start 2024-09-13T18:47:52.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.238+0000 7fad5b200700 1 -- start start 2024-09-13T18:47:52.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad5b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad5c0cc6f0 0x7fad5c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad5b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c06aaa0 0x7fad5c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad5b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c0ccb40 con 0x7fad5c0cb020 2024-09-13T18:47:52.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad5b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c06b430 con 0x7fad5c0cc6f0 2024-09-13T18:47:52.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad5b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0b2ad0 con 0x7fad5c06aaa0 2024-09-13T18:47:52.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad51400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad5c0cc6f0 0x7fad5c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad59e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad5c0cb020 0x7fad5c15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49356/0 (socket says 172.21.15.81:49356) 2024-09-13T18:47:52.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad59e00700 1 -- 172.21.15.81:0/1674027976 learned_addr learned my addr 172.21.15.81:0/1674027976 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:52.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad5a800700 1 --2- 172.21.15.81:0/1674027976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c06aaa0 0x7fad5c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad51400700 1 -- 172.21.15.81:0/1674027976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c06aaa0 msgr2=0x7fad5c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:52.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad51400700 1 --2- 172.21.15.81:0/1674027976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c06aaa0 0x7fad5c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad51400700 1 -- 172.21.15.81:0/1674027976 >> v1:172.21.15.81:6789/0 conn(0x7fad5c0cb020 legacy=0x7fad5c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad59400700 1 -- 172.21.15.81:0/1674027976 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304020368 0 0) 0x7fad5c0ccb40 con 0x7fad5c0cb020 2024-09-13T18:47:52.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad51400700 1 -- 172.21.15.81:0/1674027976 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c15b960 con 0x7fad5c0cc6f0 2024-09-13T18:47:52.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad51400700 1 --2- 172.21.15.81:0/1674027976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c0cc6f0 0x7fad5c15b0e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad44009850 tx=0x7fad44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae157bb1d0849736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:52.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad59400700 1 -- 172.21.15.81:0/1674027976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44011830 con 0x7fad5c0cc6f0 2024-09-13T18:47:52.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad59400700 1 -- 172.21.15.81:0/1674027976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44011990 con 0x7fad5c0cc6f0 2024-09-13T18:47:52.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.242+0000 7fad59400700 1 -- 172.21.15.81:0/1674027976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44011d20 con 0x7fad5c0cc6f0 2024-09-13T18:47:52.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 -- 172.21.15.81:0/1674027976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c0cc6f0 msgr2=0x7fad5c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 --2- 172.21.15.81:0/1674027976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c0cc6f0 0x7fad5c15b0e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fad44009850 tx=0x7fad44009b60 comp rx=0 tx=0).stop 2024-09-13T18:47:52.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 -- 172.21.15.81:0/1674027976 shutdown_connections 2024-09-13T18:47:52.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 --2- 172.21.15.81:0/1674027976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c06aaa0 0x7fad5c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 --2- 172.21.15.81:0/1674027976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c0cc6f0 0x7fad5c15b0e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 -- 172.21.15.81:0/1674027976 >> 172.21.15.81:0/1674027976 conn(0x7fad5c0b0c40 msgr2=0x7fad5c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:52.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 -- 172.21.15.81:0/1674027976 shutdown_connections 2024-09-13T18:47:52.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.246+0000 7fad5b200700 1 -- 172.21.15.81:0/1674027976 wait complete. 2024-09-13T18:47:52.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 Processor -- start 2024-09-13T18:47:52.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 -- start start 2024-09-13T18:47:52.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 0x7fad5c157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad5c0cb020 0x7fad5c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c0cc6f0 0x7fad5c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c1f3dc0 con 0x7fad5c06aaa0 2024-09-13T18:47:52.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14e280 con 0x7fad5c0cb020 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c14e560 con 0x7fad5c0cc6f0 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 0x7fad5c157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 0x7fad5c157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50130/0 (socket says 172.21.15.81:50130) 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 -- 172.21.15.81:0/4139493131 learned_addr learned my addr 172.21.15.81:0/4139493131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad51400700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad5c0cb020 0x7fad5c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad5a800700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c0cc6f0 0x7fad5c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 -- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c0cc6f0 msgr2=0x7fad5c14dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c0cc6f0 0x7fad5c14dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 -- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad5c0cb020 msgr2=0x7fad5c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad5c0cb020 0x7fad5c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 -- 172.21.15.81:0/4139493131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440094b0 con 0x7fad5c06aaa0 2024-09-13T18:47:52.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.250+0000 7fad59e00700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 0x7fad5c157d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad4c001f80 tx=0x7fad4c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:52.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00ad80 con 0x7fad5c06aaa0 2024-09-13T18:47:52.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c0020d0 con 0x7fad5c06aaa0 2024-09-13T18:47:52.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5c14e840 con 0x7fad5c06aaa0 2024-09-13T18:47:52.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0072f0 con 0x7fad5c06aaa0 2024-09-13T18:47:52.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c156860 con 0x7fad5c06aaa0 2024-09-13T18:47:52.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c0cb400 con 0x7fad5c06aaa0 2024-09-13T18:47:52.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.254+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad4c007450 con 0x7fad5c06aaa0 2024-09-13T18:47:52.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.258+0000 7fad52a00700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad38066730 0x7fad38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.258+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad4c084300 con 0x7fad5c06aaa0 2024-09-13T18:47:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.258+0000 7fad51400700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad38066730 0x7fad38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.258+0000 7fad51400700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad38066730 0x7fad38068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad44014040 tx=0x7fad44008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:52.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.262+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad4c051380 con 0x7fad5c06aaa0 2024-09-13T18:47:52.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.486+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad5c06cc40 con 0x7fad5c06aaa0 2024-09-13T18:47:52.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.490+0000 7fad52a00700 1 -- 172.21.15.81:0/4139493131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fad4c0549a0 con 0x7fad5c06aaa0 2024-09-13T18:47:52.531 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad38066730 msgr2=0x7fad38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad38066730 0x7fad38068bf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad44014040 tx=0x7fad44008030 comp rx=0 tx=0).stop 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 msgr2=0x7fad5c157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 0x7fad5c157d70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fad4c001f80 tx=0x7fad4c00a340 comp rx=0 tx=0).stop 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 shutdown_connections 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad38066730 0x7fad38068bf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad5c0cc6f0 0x7fad5c14dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad5c0cb020 0x7fad5c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 --2- 172.21.15.81:0/4139493131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad5c06aaa0 0x7fad5c157d70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 >> 172.21.15.81:0/4139493131 conn(0x7fad5c0b0c40 msgr2=0x7fad5c0b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 shutdown_connections 2024-09-13T18:47:52.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:52.494+0000 7fad5b200700 1 -- 172.21.15.81:0/4139493131 wait complete. 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:47:52.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:47:52.534 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:52.534 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:47:52.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.534 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:52.552 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:52.553 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:47:52.554 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:52.554 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:47:52.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:47:52.555 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:52.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.703 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:52.733 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:47:52.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.736 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:47:52.795 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:47:52.795 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:52.795 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:47:52.795 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:52.795 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:47:52.795 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:47:52.796 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:47:52.796 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:52.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.796 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:52.796 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:52.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:52.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:52.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:52.796 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:52.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.928 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:47:52.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:52.947 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-13T18:47:53.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:53.005 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:53.006 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:53.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:47:53.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:47:53.006 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:53.125 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:47:53.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:47:53.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:47:53.126 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:53.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:53.264 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:53.264 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:53.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:47:53.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:47:53.264 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:53.327 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:53.328 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:53.341 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:47:53.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:53.341 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:53.406 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:47:53.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:53.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:53.542 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:53.543 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:54.268 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:54.268 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:54.268 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:47:54.268 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:47:54.268 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:47:54.275 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:47:54.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:54.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.303 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:54.372 INFO:teuthology.orchestra.run.smithi081.stdout:client4858 2024-09-13T18:47:54.373 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:47:54.373 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:54.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.436 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:54.502 INFO:teuthology.orchestra.run.smithi081.stdout:client4858 2024-09-13T18:47:54.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.503 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:54.571 INFO:teuthology.orchestra.run.smithi081.stdout:client4858 2024-09-13T18:47:54.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.572 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a8432ea3-e34b-45da-88c0-4120757fcc5d.client4858/status') 2024-09-13T18:47:54.660 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4858 (3)172.21.15.81:0/778773135 2024-09-13T18:47:54.661 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-13T18:47:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-13T18:47:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-13T18:47:54.662 INFO:teuthology.orchestra.run.smithi081.stderr:69 bytes copied, 0.000106638 s, 647 kB/s 2024-09-13T18:47:54.662 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-13T18:47:54.662 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:47:54.662 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:47:54.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:54.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 Processor -- start 2024-09-13T18:47:54.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 -- start start 2024-09-13T18:47:54.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff38415e070 0x7ff3840cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff3840d10f0 0x7ff3840b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3840cd970 con 0x7ff3840d1540 2024-09-13T18:47:54.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38415e450 con 0x7ff38415e070 2024-09-13T18:47:54.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff389400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3840d0050 con 0x7ff3840d10f0 2024-09-13T18:47:54.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff383e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff38415e070 0x7ff3840cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff383e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff38415e070 0x7ff3840cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50144/0 (socket says 172.21.15.81:50144) 2024-09-13T18:47:54.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff383e00700 1 -- 172.21.15.81:0/3557825925 learned_addr learned my addr 172.21.15.81:0/3557825925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:54.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.873+0000 7ff37be00700 1 --2- 172.21.15.81:0/3557825925 >> v2:172.21.15.178:3300/0 conn(0x7ff3840d10f0 0x7ff3840b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383e00700 1 -- 172.21.15.81:0/3557825925 >> v2:172.21.15.178:3300/0 conn(0x7ff3840d10f0 msgr2=0x7ff3840b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:54.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383e00700 1 --2- 172.21.15.81:0/3557825925 >> v2:172.21.15.178:3300/0 conn(0x7ff3840d10f0 0x7ff3840b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383e00700 1 -- 172.21.15.81:0/3557825925 >> v1:172.21.15.178:6789/0 conn(0x7ff3840d1540 legacy=0x7ff3840b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383e00700 1 -- 172.21.15.81:0/3557825925 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3840d0330 con 0x7ff38415e070 2024-09-13T18:47:54.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383e00700 1 --2- 172.21.15.81:0/3557825925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3840cd430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3840ce350 tx=0x7ff374009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b32a5ed479e8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383400700 1 -- 172.21.15.81:0/3557825925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011830 con 0x7ff38415e070 2024-09-13T18:47:54.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383400700 1 -- 172.21.15.81:0/3557825925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374011990 con 0x7ff38415e070 2024-09-13T18:47:54.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff383400700 1 -- 172.21.15.81:0/3557825925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011d20 con 0x7ff38415e070 2024-09-13T18:47:54.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 -- 172.21.15.81:0/3557825925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 msgr2=0x7ff3840cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 --2- 172.21.15.81:0/3557825925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3840cd430 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3840ce350 tx=0x7ff374009bf0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 -- 172.21.15.81:0/3557825925 shutdown_connections 2024-09-13T18:47:54.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 --2- 172.21.15.81:0/3557825925 >> v2:172.21.15.178:3300/0 conn(0x7ff3840d10f0 0x7ff3840b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 --2- 172.21.15.81:0/3557825925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3840cd430 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 -- 172.21.15.81:0/3557825925 >> 172.21.15.81:0/3557825925 conn(0x7ff384071f00 msgr2=0x7ff3840722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:54.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 -- 172.21.15.81:0/3557825925 shutdown_connections 2024-09-13T18:47:54.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.877+0000 7ff389400700 1 -- 172.21.15.81:0/3557825925 wait complete. 2024-09-13T18:47:54.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 Processor -- start 2024-09-13T18:47:54.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 -- start start 2024-09-13T18:47:54.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3840d10f0 0x7ff38414aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3840d1540 0x7ff3840b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3841e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840a8cf0 con 0x7ff38415e070 2024-09-13T18:47:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3841488d0 con 0x7ff3840d10f0 2024-09-13T18:47:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff389400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38414b0e0 con 0x7ff3840d1540 2024-09-13T18:47:54.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff388a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3841e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff388a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3841e6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50152/0 (socket says 172.21.15.81:50152) 2024-09-13T18:47:54.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff388a00700 1 -- 172.21.15.81:0/609417136 learned_addr learned my addr 172.21.15.81:0/609417136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:54.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff383e00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3840d10f0 0x7ff38414aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.881+0000 7ff37be00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3840d1540 0x7ff3840b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff388a00700 1 -- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3840d1540 msgr2=0x7ff3840b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff388a00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3840d1540 0x7ff3840b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff388a00700 1 -- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3840d10f0 msgr2=0x7ff38414aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff388a00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3840d10f0 0x7ff38414aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff388a00700 1 -- 172.21.15.81:0/609417136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374009570 con 0x7ff38415e070 2024-09-13T18:47:54.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff388a00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3841e6870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00cb50 tx=0x7ff37c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c003c20 con 0x7ff38415e070 2024-09-13T18:47:54.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c003d80 con 0x7ff38415e070 2024-09-13T18:47:54.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3840a8a10 con 0x7ff38415e070 2024-09-13T18:47:54.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00aa20 con 0x7ff38415e070 2024-09-13T18:47:54.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff384148560 con 0x7ff38415e070 2024-09-13T18:47:54.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.885+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3840cb050 con 0x7ff38415e070 2024-09-13T18:47:54.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.889+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff37c00ab80 con 0x7ff38415e070 2024-09-13T18:47:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.889+0000 7ff380c00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff360066760 0x7ff360068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.889+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff37c084370 con 0x7ff38415e070 2024-09-13T18:47:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.889+0000 7ff383e00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff360066760 0x7ff360068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.889+0000 7ff383e00700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff360066760 0x7ff360068c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff374000c00 tx=0x7ff374008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:54.893+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff37c051350 con 0x7ff38415e070 2024-09-13T18:47:55.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.125+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff3840cd970 con 0x7ff38415e070 2024-09-13T18:47:55.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.125+0000 7ff380c00700 1 -- 172.21.15.81:0/609417136 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7ff3840cd970 con 0x7ff38415e070 2024-09-13T18:47:55.137 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:47:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.129+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff360066760 msgr2=0x7ff360068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.129+0000 7ff389400700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff360066760 0x7ff360068c20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff374000c00 tx=0x7ff374008030 comp rx=0 tx=0).stop 2024-09-13T18:47:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 msgr2=0x7ff3841e6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3841e6870 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00cb50 tx=0x7ff37c00ce60 comp rx=0 tx=0).stop 2024-09-13T18:47:55.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 shutdown_connections 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff360066760 0x7ff360068c20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff38415e070 0x7ff3841e6870 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3840d1540 0x7ff3840b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 --2- 172.21.15.81:0/609417136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3840d10f0 0x7ff38414aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 >> 172.21.15.81:0/609417136 conn(0x7ff384071f00 msgr2=0x7ff3840b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 shutdown_connections 2024-09-13T18:47:55.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:55.133+0000 7ff389400700 1 -- 172.21.15.81:0/609417136 wait complete. 2024-09-13T18:47:55.166 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:47:55.166 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:55.166 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:47:55.166 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T18:47:55.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:47:55.166 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:47:55.167 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:47:55.167 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:55.167 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.167 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42417sec preferred_lft 42417sec 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.187 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:55.267 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:47:55.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.274 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:47:55.339 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:55.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.340 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:55.341 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:55.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:55.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:55.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:55.341 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:55.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.470 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:47:55.487 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:47:55.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.488 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-13T18:47:55.548 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T18:47:55.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.550 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:55.550 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:55.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:47:55.550 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T18:47:55.550 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:55.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 2e:e0:dc:21:ac:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:47:55.692 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::2ce0:dcff:fe21:ac13/64 scope link 2024-09-13T18:47:55.693 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:47:55.775 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:55.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.776 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:47:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 2e:e0:dc:21:ac:13 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:47:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:47:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::2ce0:dcff:fe21:ac13/64 scope link 2024-09-13T18:47:55.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:55.778 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T18:47:55.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T18:47:55.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T18:47:55.779 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:55.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:55.954 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:47:55.954 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:47:55.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2024-09-13T18:47:55.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:47:55.955 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:47:56.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:56.021 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T18:47:56.038 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:47:56.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:56.039 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:47:56.101 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-13T18:47:56.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:56.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:56.227 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:56.227 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:56.255 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:47:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 2@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:47:56.256 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:47:56.262 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:47:56.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:56.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:47:56.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:56.292 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:56.358 INFO:teuthology.orchestra.run.smithi081.stdout:client4911 2024-09-13T18:47:56.358 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:47:56.358 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:56.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:56.419 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:56.492 INFO:teuthology.orchestra.run.smithi081.stdout:client4911 2024-09-13T18:47:56.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:56.492 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:56.557 INFO:teuthology.orchestra.run.smithi081.stdout:client4911 2024-09-13T18:47:56.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:56.558 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a8432ea3-e34b-45da-88c0-4120757fcc5d.client4911/status') 2024-09-13T18:47:56.640 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4911 (3)192.168.0.2:0/1989946260 2024-09-13T18:47:56.640 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-09-13T18:47:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-09-13T18:47:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-09-13T18:47:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:69 bytes copied, 0.000144567 s, 477 kB/s 2024-09-13T18:47:56.643 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-13T18:47:56.643 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:47:56.644 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:56.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:56.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.853+0000 7f901a800700 1 Processor -- start 2024-09-13T18:47:56.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.853+0000 7f901a800700 1 -- start start 2024-09-13T18:47:56.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f901a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f901415d310 0x7f90140b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:56.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f901a800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901415e560 con 0x7f901415e9f0 2024-09-13T18:47:56.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f901a800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901415d920 con 0x7f901406aaa0 2024-09-13T18:47:56.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f901a800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90140b3ec0 con 0x7f901415d310 2024-09-13T18:47:56.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f901415d310 0x7f90140b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:56.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f901415d310 0x7f90140b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37280/0 (socket says 172.21.15.81:37280) 2024-09-13T18:47:56.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 -- 172.21.15.81:0/2795404356 learned_addr learned my addr 172.21.15.81:0/2795404356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:56.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 -- 172.21.15.81:0/2795404356 >> v1:172.21.15.178:6789/0 conn(0x7f901406aaa0 legacy=0x7f901406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:56.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 -- 172.21.15.81:0/2795404356 >> v1:172.21.15.81:6789/0 conn(0x7f901415e9f0 legacy=0x7f901415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:56.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 -- 172.21.15.81:0/2795404356 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901415dc00 con 0x7f901415d310 2024-09-13T18:47:56.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9018a00700 1 --2- 172.21.15.81:0/2795404356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901415d310 0x7f90140b3980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9000009910 tx=0x7f9000009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfde232562710c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:56.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.857+0000 7f9013e00700 1 -- 172.21.15.81:0/2795404356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900000ba60 con 0x7f901415d310 2024-09-13T18:47:56.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f9013e00700 1 -- 172.21.15.81:0/2795404356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900000bbc0 con 0x7f901415d310 2024-09-13T18:47:56.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f9013e00700 1 -- 172.21.15.81:0/2795404356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000009e60 con 0x7f901415d310 2024-09-13T18:47:56.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 -- 172.21.15.81:0/2795404356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901415d310 msgr2=0x7f90140b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:56.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 --2- 172.21.15.81:0/2795404356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901415d310 0x7f90140b3980 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9000009910 tx=0x7f9000009c20 comp rx=0 tx=0).stop 2024-09-13T18:47:56.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 -- 172.21.15.81:0/2795404356 shutdown_connections 2024-09-13T18:47:56.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 --2- 172.21.15.81:0/2795404356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901415d310 0x7f90140b3980 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:56.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 -- 172.21.15.81:0/2795404356 >> 172.21.15.81:0/2795404356 conn(0x7f90140b0c40 msgr2=0x7f901406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:56.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 -- 172.21.15.81:0/2795404356 shutdown_connections 2024-09-13T18:47:56.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.861+0000 7f901a800700 1 -- 172.21.15.81:0/2795404356 wait complete. 2024-09-13T18:47:56.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 Processor -- start 2024-09-13T18:47:56.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 -- start start 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 0x7f901415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f901415d310 0x7f901413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f901415e9f0 0x7f901413bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901413ee30 con 0x7f901406aaa0 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901413e1b0 con 0x7f901415e9f0 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f901a800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901413e490 con 0x7f901415d310 2024-09-13T18:47:56.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 0x7f901415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 0x7f901415c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37296/0 (socket says 172.21.15.81:37296) 2024-09-13T18:47:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 -- 172.21.15.81:0/1442654198 learned_addr learned my addr 172.21.15.81:0/1442654198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019e00700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f901415e9f0 0x7f901413bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:56.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9018a00700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f901415d310 0x7f901413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 -- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f901415d310 msgr2=0x7f901413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f901415d310 0x7f901413f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 -- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f901415e9f0 msgr2=0x7f901413bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f901415e9f0 0x7f901413bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 -- 172.21.15.81:0/1442654198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000009570 con 0x7f901406aaa0 2024-09-13T18:47:56.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.865+0000 7f9019400700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 0x7f901415c890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f900800c500 tx=0x7f900800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080052d0 con 0x7f901406aaa0 2024-09-13T18:47:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9008005430 con 0x7f901406aaa0 2024-09-13T18:47:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901413e770 con 0x7f901406aaa0 2024-09-13T18:47:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90080055a0 con 0x7f901406aaa0 2024-09-13T18:47:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901413ddf0 con 0x7f901406aaa0 2024-09-13T18:47:56.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901413df80 con 0x7f901406aaa0 2024-09-13T18:47:56.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90080038e0 con 0x7f901406aaa0 2024-09-13T18:47:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.869+0000 7f9011600700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ff4066730 0x7f8ff4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:56.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.873+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9008083be0 con 0x7f901406aaa0 2024-09-13T18:47:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.873+0000 7f9018a00700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ff4066730 0x7f8ff4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.873+0000 7f9018a00700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ff4066730 0x7f8ff4068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9000006f80 tx=0x7f9000008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:56.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:56.877+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9008050cf0 con 0x7f901406aaa0 2024-09-13T18:47:57.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f901413f0a0 con 0x7f901406aaa0 2024-09-13T18:47:57.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f9011600700 1 -- 172.21.15.81:0/1442654198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9008017070 con 0x7f901406aaa0 2024-09-13T18:47:57.151 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:47:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ff4066730 msgr2=0x7f8ff4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:57.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ff4066730 0x7f8ff4068bf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9000006f80 tx=0x7f9000008030 comp rx=0 tx=0).stop 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 msgr2=0x7f901415c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 0x7f901415c890 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f900800c500 tx=0x7f900800c810 comp rx=0 tx=0).stop 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 shutdown_connections 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ff4066730 0x7f8ff4068bf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f901415e9f0 0x7f901413bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f901415d310 0x7f901413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.141+0000 7f901a800700 1 --2- 172.21.15.81:0/1442654198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f901406aaa0 0x7f901415c890 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.145+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 >> 172.21.15.81:0/1442654198 conn(0x7f90140b0c40 msgr2=0x7f901406ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:57.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.145+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 shutdown_connections 2024-09-13T18:47:57.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:57.145+0000 7f901a800700 1 -- 172.21.15.81:0/1442654198 wait complete. 2024-09-13T18:47:57.174 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:47:57.174 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:57.174 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2024-09-13T18:47:57.174 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:47:57.174 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:57.174 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:47:57.175 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:47:57.175 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:57.175 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:47:57.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.175 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2024-09-13T18:47:57.193 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:57.194 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42427sec preferred_lft 42427sec 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ec4:7aff:fe88:7ef9/64 scope link 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 02:42:67:0b:d2:af brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:57.195 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:47:57.196 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:57.196 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:47:57.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr flush dev ceph-brx 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set ceph-brx up 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:47:57.197 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:47:57.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.350 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:57.380 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-09-13T18:47:57.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.384 DEBUG:teuthology.orchestra.run.smithi178:> route 2024-09-13T18:47:57.471 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:57.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.472 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:47:57.473 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:47:57.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:57.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:57.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:57.473 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:47:57.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.602 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-09-13T18:47:57.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.625 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2024-09-13T18:47:57.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.684 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:47:57.684 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:47:57.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:47:57.684 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:47:57.684 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:47:57.795 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:47:57.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.795 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:47:57.796 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:47:57.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:57.954 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:47:57.954 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:47:57.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.0 up 2024-09-13T18:47:57.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:47:57.955 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:47:58.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:58.020 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:58.038 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:47:58.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:58.039 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:58.093 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:47:58.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:58.093 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:58.226 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:58.226 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:58.958 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:58.959 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:58.959 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:47:58.959 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 1@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:47:58.959 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:47:58.966 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:47:58.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:58.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:58.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:58.998 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:59.084 INFO:teuthology.orchestra.run.smithi178.stdout:client4876 2024-09-13T18:47:59.084 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:47:59.084 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:59.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.145 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:59.213 INFO:teuthology.orchestra.run.smithi178.stdout:client4876 2024-09-13T18:47:59.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.213 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:59.283 INFO:teuthology.orchestra.run.smithi178.stdout:client4876 2024-09-13T18:47:59.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.283 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a8432ea3-e34b-45da-88c0-4120757fcc5d.client4876/status') 2024-09-13T18:47:59.365 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4876 (3)192.168.0.1:0/2508992161 2024-09-13T18:47:59.366 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2024-09-13T18:47:59.366 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2024-09-13T18:47:59.366 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2024-09-13T18:47:59.366 INFO:teuthology.orchestra.run.smithi178.stderr:69 bytes copied, 0.000169566 s, 407 kB/s 2024-09-13T18:47:59.369 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-13T18:47:59.369 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:47:59.369 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:47:59.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:59.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.529+0000 7faa67200700 1 Processor -- start 2024-09-13T18:47:59.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.529+0000 7faa67200700 1 -- start start 2024-09-13T18:47:59.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa67200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa681593f0 0x7faa680718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:59.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa67200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa6806cbb0 0x7faa6806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:59.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa67200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa680cd190 con 0x7faa6806fd40 2024-09-13T18:47:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa67200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa681597d0 con 0x7faa6806cbb0 2024-09-13T18:47:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa67200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6806d530 con 0x7faa681593f0 2024-09-13T18:47:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa681593f0 0x7faa680718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa66800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faa6806fd40 0x7faa680701f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53174/0 (socket says 172.21.15.81:53174) 2024-09-13T18:47:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa66800700 1 -- 172.21.15.81:0/4009599451 learned_addr learned my addr 172.21.15.81:0/4009599451 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:47:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65400700 1 --2- 172.21.15.81:0/4009599451 >> v2:172.21.15.178:3300/0 conn(0x7faa6806cbb0 0x7faa6806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:59.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65e00700 1 -- 172.21.15.81:0/4009599451 >> v2:172.21.15.178:3300/0 conn(0x7faa6806cbb0 msgr2=0x7faa6806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:59.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65e00700 1 --2- 172.21.15.81:0/4009599451 >> v2:172.21.15.178:3300/0 conn(0x7faa6806cbb0 0x7faa6806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65e00700 1 -- 172.21.15.81:0/4009599451 >> v1:172.21.15.81:6789/0 conn(0x7faa6806fd40 legacy=0x7faa680701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:59.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65e00700 1 -- 172.21.15.81:0/4009599451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680b19b0 con 0x7faa681593f0 2024-09-13T18:47:59.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.533+0000 7faa65e00700 1 --2- 172.21.15.81:0/4009599451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa681593f0 0x7faa680718c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa58008120 tx=0x7faa5800abe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca7a4d831d1e622 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:59.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa64a00700 1 -- 172.21.15.81:0/4009599451 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58004230 con 0x7faa681593f0 2024-09-13T18:47:59.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa64a00700 1 -- 172.21.15.81:0/4009599451 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa58004390 con 0x7faa681593f0 2024-09-13T18:47:59.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa64a00700 1 -- 172.21.15.81:0/4009599451 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580036c0 con 0x7faa681593f0 2024-09-13T18:47:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 -- 172.21.15.81:0/4009599451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa681593f0 msgr2=0x7faa680718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 --2- 172.21.15.81:0/4009599451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa681593f0 0x7faa680718c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faa58008120 tx=0x7faa5800abe0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 -- 172.21.15.81:0/4009599451 shutdown_connections 2024-09-13T18:47:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 --2- 172.21.15.81:0/4009599451 >> v2:172.21.15.178:3300/0 conn(0x7faa6806cbb0 0x7faa6806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 --2- 172.21.15.81:0/4009599451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa681593f0 0x7faa680718c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 -- 172.21.15.81:0/4009599451 >> 172.21.15.81:0/4009599451 conn(0x7faa680b0c40 msgr2=0x7faa6806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 -- 172.21.15.81:0/4009599451 shutdown_connections 2024-09-13T18:47:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.537+0000 7faa67200700 1 -- 172.21.15.81:0/4009599451 wait complete. 2024-09-13T18:47:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 Processor -- start 2024-09-13T18:47:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 -- start start 2024-09-13T18:47:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 0x7faa681f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6806fd40 0x7faa68142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa681593f0 0x7faa681f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68142750 con 0x7faa6806cbb0 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa681504c0 con 0x7faa681593f0 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa67200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa681f3060 con 0x7faa6806fd40 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 0x7faa681f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 0x7faa681f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37312/0 (socket says 172.21.15.81:37312) 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 -- 172.21.15.81:0/1528586404 learned_addr learned my addr 172.21.15.81:0/1528586404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65400700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6806fd40 0x7faa68142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:59.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa66800700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa681593f0 0x7faa681f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 -- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6806fd40 msgr2=0x7faa68142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6806fd40 0x7faa68142210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 -- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa681593f0 msgr2=0x7faa681f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa681593f0 0x7faa681f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.541+0000 7faa65e00700 1 -- 172.21.15.81:0/1528586404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5800a560 con 0x7faa6806cbb0 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa65e00700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 0x7faa681f6910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa5800a1c0 tx=0x7faa58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58010690 con 0x7faa6806cbb0 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5801e040 con 0x7faa6806cbb0 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa681f3340 con 0x7faa6806cbb0 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa58010a50 con 0x7faa6806cbb0 2024-09-13T18:47:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa681f3900 con 0x7faa6806cbb0 2024-09-13T18:47:59.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.545+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa68150290 con 0x7faa6806cbb0 2024-09-13T18:47:59.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.549+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faa58010bb0 con 0x7faa6806cbb0 2024-09-13T18:47:59.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.549+0000 7faa5e000700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faa48066730 0x7faa48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:59.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.549+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa58086200 con 0x7faa6806cbb0 2024-09-13T18:47:59.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.549+0000 7faa65400700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faa48066730 0x7faa48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:59.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.549+0000 7faa65400700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faa48066730 0x7faa48068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa6814f1e0 tx=0x7faa5400b750 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:59.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.557+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faa580531a0 con 0x7faa6806cbb0 2024-09-13T18:47:59.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.785+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa680ce440 con 0x7faa6806cbb0 2024-09-13T18:47:59.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa5e000700 1 -- 172.21.15.81:0/1528586404 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7faa58010e60 con 0x7faa6806cbb0 2024-09-13T18:47:59.798 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T18:47:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faa48066730 msgr2=0x7faa48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faa48066730 0x7faa48068bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa6814f1e0 tx=0x7faa5400b750 comp rx=0 tx=0).stop 2024-09-13T18:47:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 msgr2=0x7faa681f6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 0x7faa681f6910 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faa5800a1c0 tx=0x7faa58004770 comp rx=0 tx=0).stop 2024-09-13T18:47:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 shutdown_connections 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faa48066730 0x7faa48068bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa681593f0 0x7faa681f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6806fd40 0x7faa68142210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 --2- 172.21.15.81:0/1528586404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6806cbb0 0x7faa681f6910 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 >> 172.21.15.81:0/1528586404 conn(0x7faa680b0c40 msgr2=0x7faa680b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 shutdown_connections 2024-09-13T18:47:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:47:59.789+0000 7faa67200700 1 -- 172.21.15.81:0/1528586404 wait complete. 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:59.823 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:47:59.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.824 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2024-09-13T18:47:59.845 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:59.845 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:59.845 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:59.845 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.846 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:59.846 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.846 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:59.847 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:59.847 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2024-09-13T18:47:59.847 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:59.847 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42425sec preferred_lft 42425sec 2024-09-13T18:47:59.848 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ec4:7aff:fe88:7ef9/64 scope link 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 02:42:67:0b:d2:af brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 26:50:23:04:ef:dd brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.849 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::d4ea:80ff:feeb:17de/64 scope link 2024-09-13T18:47:59.850 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.850 INFO:teuthology.orchestra.run.smithi178.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:47:59.850 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 26:50:23:04:ef:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:47:59.850 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::2450:23ff:fe04:efdd/64 scope link 2024-09-13T18:47:59.850 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:59.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.853 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:59.929 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-09-13T18:47:59.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.933 DEBUG:teuthology.orchestra.run.smithi178:> route 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:47:59.993 INFO:teuthology.orchestra.run.smithi178.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:47:59.994 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:59.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:59.994 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:47:59.994 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:47:59.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:59.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:59.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:59.994 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:48:00.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.124 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-09-13T18:48:00.140 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:48:00.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.141 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2024-09-13T18:48:00.202 INFO:teuthology.orchestra.run.smithi178.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T18:48:00.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.204 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:48:00.204 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:48:00.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:48:00.204 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T18:48:00.204 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:48:00.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.316 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:48:00.348 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:48:00.348 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 6e:b1:fd:c8:35:49 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::6cb1:fdff:fec8:3549/64 scope link 2024-09-13T18:48:00.349 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:48:00.437 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 6e:b1:fd:c8:35:49 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::6cb1:fdff:fec8:3549/64 scope link 2024-09-13T18:48:00.438 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:00.440 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T18:48:00.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.440 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:48:00.440 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:48:00.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T18:48:00.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:48:00.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T18:48:00.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T18:48:00.441 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T18:48:00.441 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.623 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-09-13T18:48:00.623 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-09-13T18:48:00.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.1 up 2024-09-13T18:48:00.624 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:48:00.624 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:48:00.685 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:48:00.701 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:48:00.762 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-13T18:48:00.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.763 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:48:00.889 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:48:00.889 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:48:00.917 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:48:00.917 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:48:00.918 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:48:00.918 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with new device syntax: 3@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:48:00.918 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:48:00.924 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:48:00.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.924 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:48:00.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:00.955 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:48:01.026 INFO:teuthology.orchestra.run.smithi178.stdout:client4929 2024-09-13T18:48:01.027 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:01.027 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:01.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:01.088 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:48:01.158 INFO:teuthology.orchestra.run.smithi178.stdout:client4929 2024-09-13T18:48:01.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:01.158 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:48:01.225 INFO:teuthology.orchestra.run.smithi178.stdout:client4929 2024-09-13T18:48:01.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:01.225 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a8432ea3-e34b-45da-88c0-4120757fcc5d.client4929/status') 2024-09-13T18:48:01.308 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4929 (3)172.21.15.178:0/2335328871 2024-09-13T18:48:01.309 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2024-09-13T18:48:01.309 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2024-09-13T18:48:01.309 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2024-09-13T18:48:01.309 INFO:teuthology.orchestra.run.smithi178.stderr:71 bytes copied, 0.000156484 s, 454 kB/s 2024-09-13T18:48:01.312 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T18:48:01.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.549+0000 7f7083000700 1 Processor -- start 2024-09-13T18:48:01.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.549+0000 7f7083000700 1 -- start start 2024-09-13T18:48:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7083000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c072510 0x7f707c073870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7083000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f707c0cac10 0x7f707c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7083000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c15c2a0 con 0x7f707c06d680 2024-09-13T18:48:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7083000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c073db0 con 0x7f707c0cac10 2024-09-13T18:48:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7083000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c15b690 con 0x7f707c072510 2024-09-13T18:48:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f707c0cac10 0x7f707c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f707b400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c072510 0x7f707c073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f707c0cac10 0x7f707c15eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37316/0 (socket says 172.21.15.81:37316) 2024-09-13T18:48:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 -- 172.21.15.81:0/3111483895 learned_addr learned my addr 172.21.15.81:0/3111483895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f707be00700 1 --1- 172.21.15.81:0/3111483895 >> v1:172.21.15.178:6789/0 conn(0x7f707c06d680 0x7f707c06da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:38820/0 (socket says 172.21.15.81:38820) 2024-09-13T18:48:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 -- 172.21.15.81:0/3111483895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c072510 msgr2=0x7f707c073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:01.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 --2- 172.21.15.81:0/3111483895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c072510 0x7f707c073870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 -- 172.21.15.81:0/3111483895 >> v1:172.21.15.178:6789/0 conn(0x7f707c06d680 legacy=0x7f707c06da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f707aa00700 1 -- 172.21.15.81:0/3111483895 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741828507 0 0) 0x7f707c15c2a0 con 0x7f707c06d680 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 -- 172.21.15.81:0/3111483895 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c15b970 con 0x7f707c0cac10 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.553+0000 7f7081000700 1 --2- 172.21.15.81:0/3111483895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c0cac10 0x7f707c15eb80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7074009e50 tx=0x7f707400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16042c127ff65a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f707aa00700 1 -- 172.21.15.81:0/3111483895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400e070 con 0x7f707c0cac10 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f707aa00700 1 -- 172.21.15.81:0/3111483895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400b910 con 0x7f707c0cac10 2024-09-13T18:48:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f707aa00700 1 -- 172.21.15.81:0/3111483895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707400bcc0 con 0x7f707c0cac10 2024-09-13T18:48:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 -- 172.21.15.81:0/3111483895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c0cac10 msgr2=0x7f707c15eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 --2- 172.21.15.81:0/3111483895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c0cac10 0x7f707c15eb80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7074009e50 tx=0x7f707400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:01.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 -- 172.21.15.81:0/3111483895 shutdown_connections 2024-09-13T18:48:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 --2- 172.21.15.81:0/3111483895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c0cac10 0x7f707c15eb80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 --2- 172.21.15.81:0/3111483895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c072510 0x7f707c073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 -- 172.21.15.81:0/3111483895 >> 172.21.15.81:0/3111483895 conn(0x7f707c0718f0 msgr2=0x7f707c071d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 -- 172.21.15.81:0/3111483895 shutdown_connections 2024-09-13T18:48:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 -- 172.21.15.81:0/3111483895 wait complete. 2024-09-13T18:48:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 Processor -- start 2024-09-13T18:48:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.557+0000 7f7083000700 1 -- start start 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f707c06d680 0x7f707c1f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 0x7f707c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c0cac10 0x7f707c159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c44b0 con 0x7f707c072510 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c7140 con 0x7f707c06d680 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c7420 con 0x7f707c0cac10 2024-09-13T18:48:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 0x7f707c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 0x7f707c0c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37330/0 (socket says 172.21.15.81:37330) 2024-09-13T18:48:01.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 -- 172.21.15.81:0/4072588459 learned_addr learned my addr 172.21.15.81:0/4072588459 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7081000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c0cac10 0x7f707c159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707be00700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f707c06d680 0x7f707c1f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 -- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c0cac10 msgr2=0x7f707c159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c0cac10 0x7f707c159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 -- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f707c06d680 msgr2=0x7f707c1f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f707c06d680 0x7f707c1f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 -- 172.21.15.81:0/4072588459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7074009b30 con 0x7f707c072510 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7081000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c0cac10 0x7f707c159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707be00700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f707c06d680 0x7f707c1f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f707b400700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 0x7f707c0c8b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f706800e9a0 tx=0x7f706800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068009720 con 0x7f707c072510 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706800c850 con 0x7f707c072510 2024-09-13T18:48:01.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c0c7700 con 0x7f707c072510 2024-09-13T18:48:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706800cc00 con 0x7f707c072510 2024-09-13T18:48:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.561+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c0c90a0 con 0x7f707c072510 2024-09-13T18:48:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.565+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c15b2b0 con 0x7f707c072510 2024-09-13T18:48:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.565+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7068013470 con 0x7f707c072510 2024-09-13T18:48:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.565+0000 7f7073e00700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f705c066730 0x7f705c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.565+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7068084950 con 0x7f707c072510 2024-09-13T18:48:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.565+0000 7f707be00700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f705c066730 0x7f705c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.565+0000 7f707be00700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f705c066730 0x7f705c068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f706c000f60 tx=0x7f706c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:01.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.573+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7068051990 con 0x7f707c072510 2024-09-13T18:48:01.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.765+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f707c0cfba0 con 0x7f707c072510 2024-09-13T18:48:01.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.769+0000 7f7073e00700 1 -- 172.21.15.81:0/4072588459 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f707c0cfba0 con 0x7f707c072510 2024-09-13T18:48:01.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:01.780 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:01.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f705c066730 msgr2=0x7f705c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f705c066730 0x7f705c068bf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f706c000f60 tx=0x7f706c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 msgr2=0x7f707c0c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 0x7f707c0c8b60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f706800e9a0 tx=0x7f706800ed60 comp rx=0 tx=0).stop 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 shutdown_connections 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f705c066730 0x7f705c068bf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f707c0cac10 0x7f707c159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f707c072510 0x7f707c0c8b60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 --2- 172.21.15.81:0/4072588459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f707c06d680 0x7f707c1f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 >> 172.21.15.81:0/4072588459 conn(0x7f707c0718f0 msgr2=0x7f707c068140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 shutdown_connections 2024-09-13T18:48:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.773+0000 7f7083000700 1 -- 172.21.15.81:0/4072588459 wait complete. 2024-09-13T18:48:01.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:01.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:01.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.969+0000 7ff241200700 1 Processor -- start 2024-09-13T18:48:01.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.969+0000 7ff241200700 1 -- start start 2024-09-13T18:48:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff241200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff241200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff23c06cd40 0x7ff23c0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff241200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff23c0b1980 0x7ff23c162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff241200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c162340 con 0x7ff23c06cd40 2024-09-13T18:48:01.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff241200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c0b2280 con 0x7ff23c0b1980 2024-09-13T18:48:01.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff241200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0b2560 con 0x7ff23c06c960 2024-09-13T18:48:01.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff23c06cd40 0x7ff23c0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff23c06cd40 0x7ff23c0b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37346/0 (socket says 172.21.15.81:37346) 2024-09-13T18:48:01.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 -- 172.21.15.81:0/3194788570 learned_addr learned my addr 172.21.15.81:0/3194788570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:01.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23b400700 1 --2- 172.21.15.81:0/3194788570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23be00700 1 --2- 172.21.15.81:0/3194788570 >> v2:172.21.15.178:3300/0 conn(0x7ff23c0b1980 0x7ff23c162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 -- 172.21.15.81:0/3194788570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 msgr2=0x7ff23c161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:01.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 --2- 172.21.15.81:0/3194788570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 -- 172.21.15.81:0/3194788570 >> v2:172.21.15.178:3300/0 conn(0x7ff23c0b1980 msgr2=0x7ff23c162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 --2- 172.21.15.81:0/3194788570 >> v2:172.21.15.178:3300/0 conn(0x7ff23c0b1980 0x7ff23c162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 -- 172.21.15.81:0/3194788570 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c0b2840 con 0x7ff23c06cd40 2024-09-13T18:48:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23aa00700 1 --2- 172.21.15.81:0/3194788570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c06cd40 0x7ff23c0b3320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0b3db0 tx=0x7ff228009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b73aaeca039a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23a000700 1 -- 172.21.15.81:0/3194788570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228011830 con 0x7ff23c06cd40 2024-09-13T18:48:01.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23a000700 1 -- 172.21.15.81:0/3194788570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228011990 con 0x7ff23c06cd40 2024-09-13T18:48:01.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.973+0000 7ff23a000700 1 -- 172.21.15.81:0/3194788570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228011d20 con 0x7ff23c06cd40 2024-09-13T18:48:01.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 -- 172.21.15.81:0/3194788570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c06cd40 msgr2=0x7ff23c0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 --2- 172.21.15.81:0/3194788570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c06cd40 0x7ff23c0b3320 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff23c0b3db0 tx=0x7ff228009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 -- 172.21.15.81:0/3194788570 shutdown_connections 2024-09-13T18:48:01.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 --2- 172.21.15.81:0/3194788570 >> v2:172.21.15.178:3300/0 conn(0x7ff23c0b1980 0x7ff23c162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 --2- 172.21.15.81:0/3194788570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c06cd40 0x7ff23c0b3320 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 --2- 172.21.15.81:0/3194788570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 -- 172.21.15.81:0/3194788570 >> 172.21.15.81:0/3194788570 conn(0x7ff23c06a390 msgr2=0x7ff23c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:01.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 -- 172.21.15.81:0/3194788570 shutdown_connections 2024-09-13T18:48:01.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 -- 172.21.15.81:0/3194788570 wait complete. 2024-09-13T18:48:01.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.977+0000 7ff241200700 1 Processor -- start 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 -- start start 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23c06cd40 0x7ff23c15d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 0x7ff23c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c15d780 con 0x7ff23c0b1980 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0a8480 con 0x7ff23c06cd40 2024-09-13T18:48:01.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff241200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0a86d0 con 0x7ff23c06c960 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 0x7ff23c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23c06cd40 0x7ff23c15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 0x7ff23c15b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37356/0 (socket says 172.21.15.81:37356) 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 -- 172.21.15.81:0/3152937474 learned_addr learned my addr 172.21.15.81:0/3152937474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23b400700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 -- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 msgr2=0x7ff23c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 -- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23c06cd40 msgr2=0x7ff23c15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23c06cd40 0x7ff23c15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:01.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 -- 172.21.15.81:0/3152937474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009570 con 0x7ff23c0b1980 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff23be00700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 0x7ff23c15b9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff23400efc0 tx=0x7ff23400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.981+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400cad0 con 0x7ff23c0b1980 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.985+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23400f040 con 0x7ff23c0b1980 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.985+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c148700 con 0x7ff23c0b1980 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.985+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23400ce70 con 0x7ff23c0b1980 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.985+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c148cc0 con 0x7ff23c0b1980 2024-09-13T18:48:01.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.985+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c148ee0 con 0x7ff23c0b1980 2024-09-13T18:48:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.985+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff234014480 con 0x7ff23c0b1980 2024-09-13T18:48:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.989+0000 7ff233400700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff21c066730 0x7ff21c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.989+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff234084ff0 con 0x7ff23c0b1980 2024-09-13T18:48:01.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.989+0000 7ff23b400700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff21c066730 0x7ff21c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.989+0000 7ff23b400700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff21c066730 0x7ff21c068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff23c1f9f50 tx=0x7ff22c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:01.997+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff234051f00 con 0x7ff23c0b1980 2024-09-13T18:48:02.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.177+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff23c0b1df0 con 0x7ff23c0b1980 2024-09-13T18:48:02.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.177+0000 7ff233400700 1 -- 172.21.15.81:0/3152937474 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff234018020 con 0x7ff23c0b1980 2024-09-13T18:48:02.187 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:02.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff21c066730 msgr2=0x7ff21c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff21c066730 0x7ff21c068bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff23c1f9f50 tx=0x7ff22c009240 comp rx=0 tx=0).stop 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 msgr2=0x7ff23c15b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 0x7ff23c15b9e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff23400efc0 tx=0x7ff23400c0c0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 shutdown_connections 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff21c066730 0x7ff21c068bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff23c0b1980 0x7ff23c15b9e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff23c06cd40 0x7ff23c15d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 --2- 172.21.15.81:0/3152937474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff23c06c960 0x7ff23c157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 >> 172.21.15.81:0/3152937474 conn(0x7ff23c06a390 msgr2=0x7ff23c163c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 shutdown_connections 2024-09-13T18:48:02.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.181+0000 7ff241200700 1 -- 172.21.15.81:0/3152937474 wait complete. 2024-09-13T18:48:02.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:02.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.373+0000 7f374be00700 1 Processor -- start 2024-09-13T18:48:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.373+0000 7f374be00700 1 -- start start 2024-09-13T18:48:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f374be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3744157470 0x7f374415a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f374be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f374415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f374be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3744157850 con 0x7f374406ed70 2024-09-13T18:48:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f374be00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374415dd20 con 0x7f3744157470 2024-09-13T18:48:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f374be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374415e000 con 0x7f37440725c0 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3744157470 0x7f374415a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3744157470 0x7f374415a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37370/0 (socket says 172.21.15.81:37370) 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 -- 172.21.15.81:0/2214996421 learned_addr learned my addr 172.21.15.81:0/2214996421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3748a00700 1 --2- 172.21.15.81:0/2214996421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f374415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 -- 172.21.15.81:0/2214996421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 msgr2=0x7f374415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 --2- 172.21.15.81:0/2214996421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f374415d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 -- 172.21.15.81:0/2214996421 >> v1:172.21.15.81:6789/0 conn(0x7f374406ed70 legacy=0x7f37440cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.377+0000 7f3749400700 1 -- 172.21.15.81:0/2214996421 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744159ff0 con 0x7f3744157470 2024-09-13T18:48:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f3749400700 1 --2- 172.21.15.81:0/2214996421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3744157470 0x7f374415a7f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3738009910 tx=0x7f3738009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67461e5c3bcf8cc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f3743e00700 1 -- 172.21.15.81:0/2214996421 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373800ba60 con 0x7f3744157470 2024-09-13T18:48:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f3743e00700 1 -- 172.21.15.81:0/2214996421 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373800bbc0 con 0x7f3744157470 2024-09-13T18:48:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f3743e00700 1 -- 172.21.15.81:0/2214996421 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738009e60 con 0x7f3744157470 2024-09-13T18:48:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 -- 172.21.15.81:0/2214996421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3744157470 msgr2=0x7f374415a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 --2- 172.21.15.81:0/2214996421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3744157470 0x7f374415a7f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3738009910 tx=0x7f3738009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 -- 172.21.15.81:0/2214996421 shutdown_connections 2024-09-13T18:48:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 --2- 172.21.15.81:0/2214996421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f374415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 --2- 172.21.15.81:0/2214996421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3744157470 0x7f374415a7f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 -- 172.21.15.81:0/2214996421 >> 172.21.15.81:0/2214996421 conn(0x7f37440b1e10 msgr2=0x7f374406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 -- 172.21.15.81:0/2214996421 shutdown_connections 2024-09-13T18:48:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.381+0000 7f374be00700 1 -- 172.21.15.81:0/2214996421 wait complete. 2024-09-13T18:48:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 Processor -- start 2024-09-13T18:48:02.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 -- start start 2024-09-13T18:48:02.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 0x7f37441f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f37441495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3744157470 0x7f37440b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440c8e60 con 0x7f374406ed70 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441f7850 con 0x7f3744157470 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.385+0000 7f374be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3744158ba0 con 0x7f37440725c0 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 0x7f37441f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 0x7f37441f7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37376/0 (socket says 172.21.15.81:37376) 2024-09-13T18:48:02.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 -- 172.21.15.81:0/2279152767 learned_addr learned my addr 172.21.15.81:0/2279152767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:02.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3748a00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f37441495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 -- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 msgr2=0x7f37441495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f37441495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 -- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3744157470 msgr2=0x7f37440b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749e00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3744157470 0x7f37440b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3744157470 0x7f37440b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 -- 172.21.15.81:0/2279152767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738009570 con 0x7f374406ed70 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749e00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3744157470 0x7f37440b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3749400700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 0x7f37441f7310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3738009c60 tx=0x7f3738004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738004550 con 0x7f374406ed70 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373801f070 con 0x7f374406ed70 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738003900 con 0x7f374406ed70 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3744158e80 con 0x7f374406ed70 2024-09-13T18:48:02.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37440c9390 con 0x7f374406ed70 2024-09-13T18:48:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.389+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37440c95a0 con 0x7f374406ed70 2024-09-13T18:48:02.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.393+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3738003a60 con 0x7f374406ed70 2024-09-13T18:48:02.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.393+0000 7f3741600700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3724066730 0x7f3724068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.393+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3738021070 con 0x7f374406ed70 2024-09-13T18:48:02.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.393+0000 7f3748a00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3724066730 0x7f3724068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.393+0000 7f3748a00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3724066730 0x7f3724068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3730009790 tx=0x7f3730008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.397+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3738052ac0 con 0x7f374406ed70 2024-09-13T18:48:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.581+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f374415d4d0 con 0x7f374406ed70 2024-09-13T18:48:02.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.581+0000 7f3741600700 1 -- 172.21.15.81:0/2279152767 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37380560e0 con 0x7f374406ed70 2024-09-13T18:48:02.592 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3724066730 msgr2=0x7f3724068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3724066730 0x7f3724068bf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3730009790 tx=0x7f3730008040 comp rx=0 tx=0).stop 2024-09-13T18:48:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 msgr2=0x7f37441f7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 0x7f37441f7310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3738009c60 tx=0x7f3738004770 comp rx=0 tx=0).stop 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 shutdown_connections 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3724066730 0x7f3724068bf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3744157470 0x7f37440b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440725c0 0x7f37441495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 --2- 172.21.15.81:0/2279152767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f374406ed70 0x7f37441f7310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 >> 172.21.15.81:0/2279152767 conn(0x7f37440b1e10 msgr2=0x7f374406abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 shutdown_connections 2024-09-13T18:48:02.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.585+0000 7f374be00700 1 -- 172.21.15.81:0/2279152767 wait complete. 2024-09-13T18:48:02.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.781+0000 7f3e12800700 1 Processor -- start 2024-09-13T18:48:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.781+0000 7f3e12800700 1 -- start start 2024-09-13T18:48:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e12800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e0c15aa90 0x7f3e0c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e12800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3e0c0cf830 0x7f3e0c0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e12800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0c0b4680 con 0x7f3e0c06c5a0 2024-09-13T18:48:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e12800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c15aee0 con 0x7f3e0c15aa90 2024-09-13T18:48:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e12800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e0c0b4960 con 0x7f3e0c0cf830 2024-09-13T18:48:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e10a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e0c15aa90 0x7f3e0c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e11400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3e0c06c5a0 0x7f3e0c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53194/0 (socket says 172.21.15.81:53194) 2024-09-13T18:48:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e11400700 1 -- 172.21.15.81:0/728662992 learned_addr learned my addr 172.21.15.81:0/728662992 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e11e00700 1 --2- 172.21.15.81:0/728662992 >> v2:172.21.15.178:3300/0 conn(0x7f3e0c0cf830 0x7f3e0c0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e10a00700 1 -- 172.21.15.81:0/728662992 >> v2:172.21.15.178:3300/0 conn(0x7f3e0c0cf830 msgr2=0x7f3e0c0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e10a00700 1 --2- 172.21.15.81:0/728662992 >> v2:172.21.15.178:3300/0 conn(0x7f3e0c0cf830 0x7f3e0c0cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e10a00700 1 -- 172.21.15.81:0/728662992 >> v1:172.21.15.81:6789/0 conn(0x7f3e0c06c5a0 legacy=0x7f3e0c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e0be00700 1 -- 172.21.15.81:0/728662992 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871624929 0 0) 0x7f3e0c0b4680 con 0x7f3e0c06c5a0 2024-09-13T18:48:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e10a00700 1 -- 172.21.15.81:0/728662992 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c0cf030 con 0x7f3e0c15aa90 2024-09-13T18:48:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.785+0000 7f3e10a00700 1 --2- 172.21.15.81:0/728662992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c0b56c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0d19e0 tx=0x7f3df8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c2468f964591f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e0be00700 1 -- 172.21.15.81:0/728662992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011830 con 0x7f3e0c15aa90 2024-09-13T18:48:02.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e0be00700 1 -- 172.21.15.81:0/728662992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8011990 con 0x7f3e0c15aa90 2024-09-13T18:48:02.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e0be00700 1 -- 172.21.15.81:0/728662992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8011d20 con 0x7f3e0c15aa90 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 -- 172.21.15.81:0/728662992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 msgr2=0x7f3e0c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 --2- 172.21.15.81:0/728662992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c0b56c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0d19e0 tx=0x7f3df8009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 -- 172.21.15.81:0/728662992 shutdown_connections 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 --2- 172.21.15.81:0/728662992 >> v2:172.21.15.178:3300/0 conn(0x7f3e0c0cf830 0x7f3e0c0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 --2- 172.21.15.81:0/728662992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c0b56c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 -- 172.21.15.81:0/728662992 >> 172.21.15.81:0/728662992 conn(0x7f3e0c071d20 msgr2=0x7f3e0c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 -- 172.21.15.81:0/728662992 shutdown_connections 2024-09-13T18:48:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.789+0000 7f3e12800700 1 -- 172.21.15.81:0/728662992 wait complete. 2024-09-13T18:48:02.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 Processor -- start 2024-09-13T18:48:02.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 -- start start 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e0c06c5a0 0x7f3e0c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e0c0cf830 0x7f3e0c1473a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c151e30 con 0x7f3e0c15aa90 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c15b5b0 con 0x7f3e0c06c5a0 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e12800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0c15b870 con 0x7f3e0c0cf830 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c15c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37398/0 (socket says 172.21.15.81:37398) 2024-09-13T18:48:02.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 -- 172.21.15.81:0/2857326368 learned_addr learned my addr 172.21.15.81:0/2857326368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:02.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11400700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e0c06c5a0 0x7f3e0c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e10a00700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e0c0cf830 0x7f3e0c1473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 -- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e0c0cf830 msgr2=0x7f3e0c1473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e0c0cf830 0x7f3e0c1473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 -- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e0c06c5a0 msgr2=0x7f3e0c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e0c06c5a0 0x7f3e0c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e11e00700 1 -- 172.21.15.81:0/2857326368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80094b0 con 0x7f3e0c15aa90 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.793+0000 7f3e10a00700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e0c0cf830 0x7f3e0c1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e11e00700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c15c630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400efc0 tx=0x7f3e0400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0400cd40 con 0x7f3e0c15aa90 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0400f040 con 0x7f3e0c15aa90 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040146c0 con 0x7f3e0c15aa90 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0c15bb50 con 0x7f3e0c15aa90 2024-09-13T18:48:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0c15c110 con 0x7f3e0c15aa90 2024-09-13T18:48:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.797+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0c15c300 con 0x7f3e0c15aa90 2024-09-13T18:48:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.801+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e04014820 con 0x7f3e0c15aa90 2024-09-13T18:48:02.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.801+0000 7f3e09600700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dec066730 0x7f3dec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:02.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.801+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e04084ed0 con 0x7f3e0c15aa90 2024-09-13T18:48:02.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.801+0000 7f3e11400700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dec066730 0x7f3dec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:02.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.801+0000 7f3e11400700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dec066730 0x7f3dec068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f60 tx=0x7f3e00007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:02.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.805+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e04051de0 con 0x7f3e0c15aa90 2024-09-13T18:48:03.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.997+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e0c06c980 con 0x7f3e0c15aa90 2024-09-13T18:48:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:02.997+0000 7f3e09600700 1 -- 172.21.15.81:0/2857326368 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e04018020 con 0x7f3e0c15aa90 2024-09-13T18:48:03.007 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:03.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dec066730 msgr2=0x7f3dec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dec066730 0x7f3dec068bf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f60 tx=0x7f3e00007cb0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 msgr2=0x7f3e0c15c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c15c630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400efc0 tx=0x7f3e0400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 shutdown_connections 2024-09-13T18:48:03.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dec066730 0x7f3dec068bf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c15aa90 0x7f3e0c15c630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e0c0cf830 0x7f3e0c1473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 --2- 172.21.15.81:0/2857326368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e0c06c5a0 0x7f3e0c1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 >> 172.21.15.81:0/2857326368 conn(0x7f3e0c071d20 msgr2=0x7f3e0c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 shutdown_connections 2024-09-13T18:48:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.001+0000 7f3e12800700 1 -- 172.21.15.81:0/2857326368 wait complete. 2024-09-13T18:48:03.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.197+0000 7f1e20e00700 1 Processor -- start 2024-09-13T18:48:03.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 -- start start 2024-09-13T18:48:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e1c06c5a0 0x7f1e1c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c980 0x7f1e1c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e1c0b2540 0x7f1e1c0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0b4680 con 0x7f1e1c0b2540 2024-09-13T18:48:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0b4960 con 0x7f1e1c06c5a0 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e20e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0cf030 con 0x7f1e1c06c980 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e1c0b2540 0x7f1e1c0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e1c06c5a0 0x7f1e1c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e1c0b2540 0x7f1e1c0b2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37412/0 (socket says 172.21.15.81:37412) 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e1c06c5a0 0x7f1e1c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:36278/0 (socket says 172.21.15.81:36278) 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1be00700 1 -- 172.21.15.81:0/1439830064 learned_addr learned my addr 172.21.15.81:0/1439830064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:03.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1aa00700 1 --2- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c980 0x7f1e1c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.201+0000 7f1e1b400700 1 -- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c980 msgr2=0x7f1e1c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1b400700 1 --2- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c980 0x7f1e1c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1b400700 1 -- 172.21.15.81:0/1439830064 >> v2:172.21.15.81:3300/0 conn(0x7f1e1c0b2540 msgr2=0x7f1e1c0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1b400700 1 --2- 172.21.15.81:0/1439830064 >> v2:172.21.15.81:3300/0 conn(0x7f1e1c0b2540 0x7f1e1c0b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1b400700 1 -- 172.21.15.81:0/1439830064 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0cf310 con 0x7f1e1c06c5a0 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1b400700 1 --2- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c5a0 0x7f1e1c15aa90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0b3650 tx=0x7f1e0c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405e21da46899fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1a000700 1 -- 172.21.15.81:0/1439830064 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011830 con 0x7f1e1c06c5a0 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1a000700 1 -- 172.21.15.81:0/1439830064 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c011990 con 0x7f1e1c06c5a0 2024-09-13T18:48:03.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e1a000700 1 -- 172.21.15.81:0/1439830064 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c011d20 con 0x7f1e1c06c5a0 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 -- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c5a0 msgr2=0x7f1e1c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 --2- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c5a0 0x7f1e1c15aa90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0b3650 tx=0x7f1e0c009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 -- 172.21.15.81:0/1439830064 shutdown_connections 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 --2- 172.21.15.81:0/1439830064 >> v2:172.21.15.81:3300/0 conn(0x7f1e1c0b2540 0x7f1e1c0b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 --2- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c980 0x7f1e1c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 --2- 172.21.15.81:0/1439830064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c5a0 0x7f1e1c15aa90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 -- 172.21.15.81:0/1439830064 >> 172.21.15.81:0/1439830064 conn(0x7f1e1c071d20 msgr2=0x7f1e1c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 -- 172.21.15.81:0/1439830064 shutdown_connections 2024-09-13T18:48:03.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.205+0000 7f1e20e00700 1 -- 172.21.15.81:0/1439830064 wait complete. 2024-09-13T18:48:03.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.209+0000 7f1e20e00700 1 Processor -- start 2024-09-13T18:48:03.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.209+0000 7f1e20e00700 1 -- start start 2024-09-13T18:48:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.209+0000 7f1e20e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c5a0 0x7f1e1c13d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c980 0x7f1e1c06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c149f00 con 0x7f1e1c0b2540 2024-09-13T18:48:03.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1492f0 con 0x7f1e1c06c980 2024-09-13T18:48:03.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1495d0 con 0x7f1e1c06c5a0 2024-09-13T18:48:03.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c1569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37424/0 (socket says 172.21.15.81:37424) 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 -- 172.21.15.81:0/2320861778 learned_addr learned my addr 172.21.15.81:0/2320861778 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1b400700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c5a0 0x7f1e1c13d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1aa00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c980 0x7f1e1c06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 -- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c5a0 msgr2=0x7f1e1c13d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c5a0 0x7f1e1c13d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 -- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c980 msgr2=0x7f1e1c06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c980 0x7f1e1c06bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 -- 172.21.15.81:0/2320861778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c0094b0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e1be00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c1569a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400efc0 tx=0x7f1e1400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14003c40 con 0x7f1e1c0b2540 2024-09-13T18:48:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400f040 con 0x7f1e1c0b2540 2024-09-13T18:48:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c1498b0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400c660 con 0x7f1e1c0b2540 2024-09-13T18:48:03.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c13d6a0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.213+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c14a0b0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.217+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1e1400c7c0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.217+0000 7f1e13400700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1dfc066730 0x7f1dfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.217+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1e14084790 con 0x7f1e1c0b2540 2024-09-13T18:48:03.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.217+0000 7f1e1b400700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1dfc066730 0x7f1dfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.221+0000 7f1e1b400700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1dfc066730 0x7f1dfc068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:03.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.225+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e1c14a0b0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.405+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e1c06cda0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.405+0000 7f1e13400700 1 -- 172.21.15.81:0/2320861778 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e140516c0 con 0x7f1e1c0b2540 2024-09-13T18:48:03.415 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1dfc066730 msgr2=0x7f1dfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1dfc066730 0x7f1dfc068bf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c008030 comp rx=0 tx=0).stop 2024-09-13T18:48:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 msgr2=0x7f1e1c1569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c1569a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400efc0 tx=0x7f1e1400c0c0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 shutdown_connections 2024-09-13T18:48:03.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1dfc066730 0x7f1dfc068bf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e1c0b2540 0x7f1e1c1569a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e1c06c980 0x7f1e1c06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 --2- 172.21.15.81:0/2320861778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e1c06c5a0 0x7f1e1c13d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 >> 172.21.15.81:0/2320861778 conn(0x7f1e1c071d20 msgr2=0x7f1e1c157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:03.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 shutdown_connections 2024-09-13T18:48:03.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.409+0000 7f1e20e00700 1 -- 172.21.15.81:0/2320861778 wait complete. 2024-09-13T18:48:03.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.597+0000 7ff042e00700 1 Processor -- start 2024-09-13T18:48:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff042e00700 1 -- start start 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff042e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03c1593f0 0x7ff03c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff042e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0cd190 con 0x7ff03c0b3150 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff042e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c0b19b0 con 0x7ff03c06cbb0 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff042e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c1597d0 con 0x7ff03c1593f0 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff041a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03c1593f0 0x7ff03c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff041a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff03c1593f0 0x7ff03c0718c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37432/0 (socket says 172.21.15.81:37432) 2024-09-13T18:48:03.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff041a00700 1 -- 172.21.15.81:0/1344524860 learned_addr learned my addr 172.21.15.81:0/1344524860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.601+0000 7ff041a00700 1 -- 172.21.15.81:0/1344524860 >> v1:172.21.15.178:6789/0 conn(0x7ff03c06cbb0 legacy=0x7ff03c06fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff041a00700 1 -- 172.21.15.81:0/1344524860 >> v1:172.21.15.81:6789/0 conn(0x7ff03c0b3150 legacy=0x7ff03c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:03.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff041a00700 1 -- 172.21.15.81:0/1344524860 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c070b60 con 0x7ff03c1593f0 2024-09-13T18:48:03.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff041a00700 1 --2- 172.21.15.81:0/1344524860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c1593f0 0x7ff03c0718c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff030009910 tx=0x7ff030009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fffaa421407a133 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:03.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff03be00700 1 -- 172.21.15.81:0/1344524860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030004230 con 0x7ff03c1593f0 2024-09-13T18:48:03.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff03be00700 1 -- 172.21.15.81:0/1344524860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff030004390 con 0x7ff03c1593f0 2024-09-13T18:48:03.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff03be00700 1 -- 172.21.15.81:0/1344524860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030009e60 con 0x7ff03c1593f0 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 -- 172.21.15.81:0/1344524860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c1593f0 msgr2=0x7ff03c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 --2- 172.21.15.81:0/1344524860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c1593f0 0x7ff03c0718c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff030009910 tx=0x7ff030009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 -- 172.21.15.81:0/1344524860 shutdown_connections 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 --2- 172.21.15.81:0/1344524860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c1593f0 0x7ff03c0718c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 -- 172.21.15.81:0/1344524860 >> 172.21.15.81:0/1344524860 conn(0x7ff03c0b0c40 msgr2=0x7ff03c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 -- 172.21.15.81:0/1344524860 shutdown_connections 2024-09-13T18:48:03.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.605+0000 7ff042e00700 1 -- 172.21.15.81:0/1344524860 wait complete. 2024-09-13T18:48:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 Processor -- start 2024-09-13T18:48:03.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 -- start start 2024-09-13T18:48:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff03c06cbb0 0x7ff03c070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 0x7ff03c154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff03c154910 0x7ff03c13d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c1559b0 con 0x7ff03c0b3150 2024-09-13T18:48:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c154da0 con 0x7ff03c154910 2024-09-13T18:48:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c155080 con 0x7ff03c06cbb0 2024-09-13T18:48:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 0x7ff03c154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 0x7ff03c154010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37438/0 (socket says 172.21.15.81:37438) 2024-09-13T18:48:03.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 -- 172.21.15.81:0/2709062085 learned_addr learned my addr 172.21.15.81:0/2709062085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041a00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff03c06cbb0 0x7ff03c070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff042400700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff03c154910 0x7ff03c13d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 -- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff03c06cbb0 msgr2=0x7ff03c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff03c06cbb0 0x7ff03c070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 -- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff03c154910 msgr2=0x7ff03c13d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff03c154910 0x7ff03c13d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.609+0000 7ff041000700 1 -- 172.21.15.81:0/2709062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030009570 con 0x7ff03c0b3150 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff041000700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 0x7ff03c154010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff02800b4a0 tx=0x7ff02800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011830 con 0x7ff03c0b3150 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028011990 con 0x7ff03c0b3150 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011d40 con 0x7ff03c0b3150 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c155360 con 0x7ff03c0b3150 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c0705b0 con 0x7ff03c0b3150 2024-09-13T18:48:03.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c155b60 con 0x7ff03c0b3150 2024-09-13T18:48:03.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.613+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff02801a400 con 0x7ff03c0b3150 2024-09-13T18:48:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.617+0000 7ff039600700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff01c066760 0x7ff01c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.617+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff028084230 con 0x7ff03c0b3150 2024-09-13T18:48:03.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.617+0000 7ff041a00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff01c066760 0x7ff01c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:03.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.617+0000 7ff041a00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff01c066760 0x7ff01c068c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff030009910 tx=0x7ff030008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:03.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.621+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff03c155b60 con 0x7ff03c0b3150 2024-09-13T18:48:03.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.805+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff03c0ce440 con 0x7ff03c0b3150 2024-09-13T18:48:03.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.809+0000 7ff039600700 1 -- 172.21.15.81:0/2709062085 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7ff0280510b0 con 0x7ff03c0b3150 2024-09-13T18:48:03.820 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:03.820 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.809+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff01c066760 msgr2=0x7ff01c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.809+0000 7ff042e00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff01c066760 0x7ff01c068c20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff030009910 tx=0x7ff030008030 comp rx=0 tx=0).stop 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 msgr2=0x7ff03c154010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 0x7ff03c154010 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff02800b4a0 tx=0x7ff02800b7b0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 shutdown_connections 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff01c066760 0x7ff01c068c20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff03c154910 0x7ff03c13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff03c0b3150 0x7ff03c154010 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 --2- 172.21.15.81:0/2709062085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff03c06cbb0 0x7ff03c070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 >> 172.21.15.81:0/2709062085 conn(0x7ff03c0b0c40 msgr2=0x7ff03c0b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 shutdown_connections 2024-09-13T18:48:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:03.813+0000 7ff042e00700 1 -- 172.21.15.81:0/2709062085 wait complete. 2024-09-13T18:48:03.844 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:03.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:04.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.005+0000 7fa544800700 1 Processor -- start 2024-09-13T18:48:04.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.005+0000 7fa544800700 1 -- start start 2024-09-13T18:48:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa544800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa544800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c06d000 con 0x7fa53c160fc0 2024-09-13T18:48:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa544800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c06c3f0 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa544800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0cf560 con 0x7fa53c06be10 2024-09-13T18:48:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa541e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa53c160fc0 0x7fa53c0b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53222/0 (socket says 172.21.15.81:53222) 2024-09-13T18:48:04.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa541e00700 1 -- 172.21.15.81:0/3906605191 learned_addr learned my addr 172.21.15.81:0/3906605191 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:04.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa541400700 1 --2- 172.21.15.81:0/3906605191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa540a00700 1 -- 172.21.15.81:0/3906605191 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417996847 0 0) 0x7fa53c06d000 con 0x7fa53c160fc0 2024-09-13T18:48:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa541400700 1 -- 172.21.15.81:0/3906605191 >> v1:172.21.15.178:6789/0 conn(0x7fa53c0cf0b0 legacy=0x7fa53c1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa541400700 1 -- 172.21.15.81:0/3906605191 >> v1:172.21.15.81:6789/0 conn(0x7fa53c160fc0 legacy=0x7fa53c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.009+0000 7fa541400700 1 -- 172.21.15.81:0/3906605191 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c06c6d0 con 0x7fa53c06be10 2024-09-13T18:48:04.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa541400700 1 --2- 172.21.15.81:0/3906605191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c0ceb70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009880 tx=0x7fa52c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b292fb05d4f36619 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa540a00700 1 -- 172.21.15.81:0/3906605191 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c011830 con 0x7fa53c06be10 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa540a00700 1 -- 172.21.15.81:0/3906605191 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c011990 con 0x7fa53c06be10 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa540a00700 1 -- 172.21.15.81:0/3906605191 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c011d20 con 0x7fa53c06be10 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 -- 172.21.15.81:0/3906605191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 msgr2=0x7fa53c0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 --2- 172.21.15.81:0/3906605191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c0ceb70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009880 tx=0x7fa52c009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 -- 172.21.15.81:0/3906605191 shutdown_connections 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 --2- 172.21.15.81:0/3906605191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c0ceb70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 -- 172.21.15.81:0/3906605191 >> 172.21.15.81:0/3906605191 conn(0x7fa53c06a570 msgr2=0x7fa53c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 -- 172.21.15.81:0/3906605191 shutdown_connections 2024-09-13T18:48:04.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 -- 172.21.15.81:0/3906605191 wait complete. 2024-09-13T18:48:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 Processor -- start 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.013+0000 7fa544800700 1 -- start start 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c1637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 0x7fa53c0ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c160fc0 0x7fa53c15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0ccf80 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0a98d0 con 0x7fa53c160fc0 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0a9bb0 con 0x7fa53c06be10 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 0x7fa53c0ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 0x7fa53c0ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37452/0 (socket says 172.21.15.81:37452) 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 -- 172.21.15.81:0/3699439539 learned_addr learned my addr 172.21.15.81:0/3699439539 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:04.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541e00700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c1637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa542800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c160fc0 0x7fa53c15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 -- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 msgr2=0x7fa53c1637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c1637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 -- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c160fc0 msgr2=0x7fa53c15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c160fc0 0x7fa53c15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 -- 172.21.15.81:0/3699439539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52c0094b0 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa542800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c160fc0 0x7fa53c15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:04.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa541400700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 0x7fa53c0ac2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0090b0 tx=0x7fa52c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c00bc10 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52c01f070 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c01a430 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c0a9e90 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.017+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c163f10 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.021+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c0a9730 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.021+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa52c01a590 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.021+0000 7fa536000700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa520066730 0x7fa520068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.021+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa52c021070 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.021+0000 7fa541e00700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa520066730 0x7fa520068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.025+0000 7fa541e00700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa520066730 0x7fa520068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa530000f60 tx=0x7fa530007db0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.029+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa53c0a9730 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.213+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa53c163f10 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.213+0000 7fa536000700 1 -- 172.21.15.81:0/3699439539 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa53c163f10 con 0x7fa53c0cf0b0 2024-09-13T18:48:04.226 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa520066730 msgr2=0x7fa520068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa520066730 0x7fa520068bf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa530000f60 tx=0x7fa530007db0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 msgr2=0x7fa53c0ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 0x7fa53c0ac2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0090b0 tx=0x7fa52c004770 comp rx=0 tx=0).stop 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 shutdown_connections 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa520066730 0x7fa520068bf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c160fc0 0x7fa53c15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa53c0cf0b0 0x7fa53c0ac2a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 --2- 172.21.15.81:0/3699439539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06be10 0x7fa53c1637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 >> 172.21.15.81:0/3699439539 conn(0x7fa53c06a570 msgr2=0x7fa53c15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 shutdown_connections 2024-09-13T18:48:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.217+0000 7fa544800700 1 -- 172.21.15.81:0/3699439539 wait complete. 2024-09-13T18:48:04.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae9200700 1 Processor -- start 2024-09-13T18:48:04.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae9200700 1 -- start start 2024-09-13T18:48:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae40cf280 0x7f8ae416bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae9200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae406d000 con 0x7f8ae4160fc0 2024-09-13T18:48:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae9200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae406c3f0 con 0x7f8ae406be10 2024-09-13T18:48:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae406c6d0 con 0x7f8ae40cf280 2024-09-13T18:48:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae1e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ae4160fc0 0x7f8ae40b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53224/0 (socket says 172.21.15.81:53224) 2024-09-13T18:48:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae1e00700 1 -- 172.21.15.81:0/1572625773 learned_addr learned my addr 172.21.15.81:0/1572625773 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:04.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae2800700 1 --2- 172.21.15.81:0/1572625773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae40cf280 0x7f8ae416bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae0a00700 1 -- 172.21.15.81:0/1572625773 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115755721 0 0) 0x7f8ae406d000 con 0x7f8ae4160fc0 2024-09-13T18:48:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.417+0000 7f8ae0a00700 1 -- 172.21.15.81:0/1572625773 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ac80035d0 con 0x7f8ae4160fc0 2024-09-13T18:48:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae2800700 1 -- 172.21.15.81:0/1572625773 >> v1:172.21.15.178:6789/0 conn(0x7f8ae406be10 legacy=0x7f8ae40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae2800700 1 -- 172.21.15.81:0/1572625773 >> v1:172.21.15.81:6789/0 conn(0x7f8ae4160fc0 legacy=0x7f8ae40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae2800700 1 -- 172.21.15.81:0/1572625773 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae406c9b0 con 0x7f8ae40cf280 2024-09-13T18:48:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae2800700 1 --2- 172.21.15.81:0/1572625773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae40cf280 0x7f8ae416bbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009800 tx=0x7f8adc009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade79ea3cb2486fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae0a00700 1 -- 172.21.15.81:0/1572625773 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc004230 con 0x7f8ae40cf280 2024-09-13T18:48:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae0a00700 1 -- 172.21.15.81:0/1572625773 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc004390 con 0x7f8ae40cf280 2024-09-13T18:48:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae0a00700 1 -- 172.21.15.81:0/1572625773 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0036c0 con 0x7f8ae40cf280 2024-09-13T18:48:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 -- 172.21.15.81:0/1572625773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae40cf280 msgr2=0x7f8ae416bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 --2- 172.21.15.81:0/1572625773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae40cf280 0x7f8ae416bbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009800 tx=0x7f8adc009b10 comp rx=0 tx=0).stop 2024-09-13T18:48:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 -- 172.21.15.81:0/1572625773 shutdown_connections 2024-09-13T18:48:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 --2- 172.21.15.81:0/1572625773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae40cf280 0x7f8ae416bbc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 -- 172.21.15.81:0/1572625773 >> 172.21.15.81:0/1572625773 conn(0x7f8ae406a570 msgr2=0x7f8ae406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:04.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 -- 172.21.15.81:0/1572625773 shutdown_connections 2024-09-13T18:48:04.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.421+0000 7f8ae9200700 1 -- 172.21.15.81:0/1572625773 wait complete. 2024-09-13T18:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.425+0000 7f8ae9200700 1 Processor -- start 2024-09-13T18:48:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.425+0000 7f8ae9200700 1 -- start start 2024-09-13T18:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae406be10 0x7f8ae415ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ae40cf280 0x7f8ae41594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 0x7f8ae41579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41599e0 con 0x7f8ae4160fc0 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae415a4b0 con 0x7f8ae40cf280 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4159c10 con 0x7f8ae406be10 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 0x7f8ae41579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 0x7f8ae41579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37458/0 (socket says 172.21.15.81:37458) 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 -- 172.21.15.81:0/3362526372 learned_addr learned my addr 172.21.15.81:0/3362526372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae1e00700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae406be10 0x7f8ae415ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae1400700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ae40cf280 0x7f8ae41594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 -- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae406be10 msgr2=0x7f8ae415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae406be10 0x7f8ae415ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 -- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ae40cf280 msgr2=0x7f8ae41594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ae40cf280 0x7f8ae41594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 -- 172.21.15.81:0/3362526372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc0094b0 con 0x7f8ae4160fc0 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae2800700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 0x7f8ae41579e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8adc014040 tx=0x7f8adc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc003e80 con 0x7f8ae4160fc0 2024-09-13T18:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc004520 con 0x7f8ae4160fc0 2024-09-13T18:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae4159ef0 con 0x7f8ae4160fc0 2024-09-13T18:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.429+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011870 con 0x7f8ae4160fc0 2024-09-13T18:48:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.433+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae41e9950 con 0x7f8ae4160fc0 2024-09-13T18:48:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.433+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae40674c0 con 0x7f8ae4160fc0 2024-09-13T18:48:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.433+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8adc018050 con 0x7f8ae4160fc0 2024-09-13T18:48:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.437+0000 7f8ada000700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ac4066730 0x7f8ac4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.437+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8adc084f00 con 0x7f8ae4160fc0 2024-09-13T18:48:04.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.437+0000 7f8ae1e00700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ac4066730 0x7f8ac4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.437+0000 7f8ae1e00700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ac4066730 0x7f8ac4068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4001560 tx=0x7f8ad4001a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.441+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8adc051f40 con 0x7f8ae4160fc0 2024-09-13T18:48:04.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.633+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ae40ceb70 con 0x7f8ae4160fc0 2024-09-13T18:48:04.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.633+0000 7f8ada000700 1 -- 172.21.15.81:0/3362526372 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8adc02b020 con 0x7f8ae4160fc0 2024-09-13T18:48:04.644 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:04.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ac4066730 msgr2=0x7f8ac4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ac4066730 0x7f8ac4068bf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4001560 tx=0x7f8ad4001a90 comp rx=0 tx=0).stop 2024-09-13T18:48:04.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 msgr2=0x7f8ae41579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 0x7f8ae41579e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8adc014040 tx=0x7f8adc004770 comp rx=0 tx=0).stop 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 shutdown_connections 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8ac4066730 0x7f8ac4068bf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ae4160fc0 0x7f8ae41579e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ae40cf280 0x7f8ae41594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 --2- 172.21.15.81:0/3362526372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ae406be10 0x7f8ae415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 >> 172.21.15.81:0/3362526372 conn(0x7f8ae406a570 msgr2=0x7f8ae4162db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 shutdown_connections 2024-09-13T18:48:04.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.637+0000 7f8ae9200700 1 -- 172.21.15.81:0/3362526372 wait complete. 2024-09-13T18:48:04.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:04.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.837+0000 7f26eb600700 1 Processor -- start 2024-09-13T18:48:04.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.837+0000 7f26eb600700 1 -- start start 2024-09-13T18:48:04.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26eb600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f26e40cfac0 0x7f26e40d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26eb600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e40d0780 con 0x7f26e4143b60 2024-09-13T18:48:04.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26eb600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e4143f40 con 0x7f26e415e720 2024-09-13T18:48:04.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26eb600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e415f710 con 0x7f26e40cfac0 2024-09-13T18:48:04.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e8c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26e4143b60 0x7f26e40cf3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53238/0 (socket says 172.21.15.81:53238) 2024-09-13T18:48:04.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e8c00700 1 -- 172.21.15.81:0/2773550233 learned_addr learned my addr 172.21.15.81:0/2773550233 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:04.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3e00700 1 --2- 172.21.15.81:0/2773550233 >> v2:172.21.15.178:3300/0 conn(0x7f26e40cfac0 0x7f26e40d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3400700 1 -- 172.21.15.81:0/2773550233 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242260342 0 0) 0x7f26d8001490 con 0x7f26e4143b60 2024-09-13T18:48:04.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3400700 1 -- 172.21.15.81:0/2773550233 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26cc0035d0 con 0x7f26e4143b60 2024-09-13T18:48:04.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3e00700 1 -- 172.21.15.81:0/2773550233 >> v1:172.21.15.178:6789/0 conn(0x7f26e415e720 legacy=0x7f26e415eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3400700 1 -- 172.21.15.81:0/2773550233 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698247531 0 0) 0x7f26e4143f40 con 0x7f26e415e720 2024-09-13T18:48:04.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3e00700 1 -- 172.21.15.81:0/2773550233 >> v1:172.21.15.81:6789/0 conn(0x7f26e4143b60 legacy=0x7f26e40cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3e00700 1 -- 172.21.15.81:0/2773550233 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e415f430 con 0x7f26e40cfac0 2024-09-13T18:48:04.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.841+0000 7f26e3e00700 1 --2- 172.21.15.81:0/2773550233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e40d14a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009850 tx=0x7f26d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375ac164713310a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26e3400700 1 -- 172.21.15.81:0/2773550233 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0011830 con 0x7f26e40cfac0 2024-09-13T18:48:04.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26e3400700 1 -- 172.21.15.81:0/2773550233 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d0011990 con 0x7f26e40cfac0 2024-09-13T18:48:04.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26e3400700 1 -- 172.21.15.81:0/2773550233 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0011d00 con 0x7f26e40cfac0 2024-09-13T18:48:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 -- 172.21.15.81:0/2773550233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 msgr2=0x7f26e40d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 --2- 172.21.15.81:0/2773550233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e40d14a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009850 tx=0x7f26d0009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 -- 172.21.15.81:0/2773550233 shutdown_connections 2024-09-13T18:48:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 --2- 172.21.15.81:0/2773550233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e40d14a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 -- 172.21.15.81:0/2773550233 >> 172.21.15.81:0/2773550233 conn(0x7f26e406e660 msgr2=0x7f26e406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:04.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 -- 172.21.15.81:0/2773550233 shutdown_connections 2024-09-13T18:48:04.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.845+0000 7f26eb600700 1 -- 172.21.15.81:0/2773550233 wait complete. 2024-09-13T18:48:04.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 Processor -- start 2024-09-13T18:48:04.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 -- start start 2024-09-13T18:48:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e41f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e4143b60 0x7f26e413b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 0x7f26e41f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e406c000 con 0x7f26e415e720 2024-09-13T18:48:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e41f35e0 con 0x7f26e40cfac0 2024-09-13T18:48:04.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26eb600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e41f38c0 con 0x7f26e4143b60 2024-09-13T18:48:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26e8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e41f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.849+0000 7f26e9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 0x7f26e41f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e41f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:36346/0 (socket says 172.21.15.81:36346) 2024-09-13T18:48:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 0x7f26e41f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37464/0 (socket says 172.21.15.81:37464) 2024-09-13T18:48:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 -- 172.21.15.81:0/1925095714 learned_addr learned my addr 172.21.15.81:0/1925095714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:04.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e3e00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e4143b60 0x7f26e413b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 -- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e4143b60 msgr2=0x7f26e413b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e4143b60 0x7f26e413b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 -- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 msgr2=0x7f26e41f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 0x7f26e41f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 -- 172.21.15.81:0/1925095714 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00094b0 con 0x7f26e40cfac0 2024-09-13T18:48:04.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e9600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 0x7f26e41f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:04.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e8c00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e41f6bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26d800cbb0 tx=0x7f26d800cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8007500 con 0x7f26e40cfac0 2024-09-13T18:48:04.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d8007660 con 0x7f26e40cfac0 2024-09-13T18:48:04.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e41f60d0 con 0x7f26e40cfac0 2024-09-13T18:48:04.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80079d0 con 0x7f26e40cfac0 2024-09-13T18:48:04.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e41f6690 con 0x7f26e40cfac0 2024-09-13T18:48:04.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.853+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e40d14a0 con 0x7f26e40cfac0 2024-09-13T18:48:04.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.857+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26d801b3b0 con 0x7f26e40cfac0 2024-09-13T18:48:04.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.857+0000 7f26e0c00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f26c4066730 0x7f26c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:04.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.857+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26d8083c30 con 0x7f26e40cfac0 2024-09-13T18:48:04.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.857+0000 7f26e3e00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f26c4066730 0x7f26c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:04.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.857+0000 7f26e3e00700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f26c4066730 0x7f26c4068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26d00090b0 tx=0x7f26d0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:04.865+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26d8050c80 con 0x7f26e40cfac0 2024-09-13T18:48:05.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.045+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26e40d0780 con 0x7f26e40cfac0 2024-09-13T18:48:05.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.045+0000 7f26e0c00700 1 -- 172.21.15.81:0/1925095714 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f26e40d0780 con 0x7f26e40cfac0 2024-09-13T18:48:05.057 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:05.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.049+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f26c4066730 msgr2=0x7f26c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.049+0000 7f26eb600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f26c4066730 0x7f26c4068bf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f26d00090b0 tx=0x7f26d0008030 comp rx=0 tx=0).stop 2024-09-13T18:48:05.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.049+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 msgr2=0x7f26e41f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.049+0000 7f26eb600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e41f6bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26d800cbb0 tx=0x7f26d800cbe0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 shutdown_connections 2024-09-13T18:48:05.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f26c4066730 0x7f26c4068bf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26e415e720 0x7f26e41f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e4143b60 0x7f26e413b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 --2- 172.21.15.81:0/1925095714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40cfac0 0x7f26e41f6bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 >> 172.21.15.81:0/1925095714 conn(0x7f26e406e660 msgr2=0x7f26e415eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 shutdown_connections 2024-09-13T18:48:05.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.053+0000 7f26eb600700 1 -- 172.21.15.81:0/1925095714 wait complete. 2024-09-13T18:48:05.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:05.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 Processor -- start 2024-09-13T18:48:05.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 -- start start 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 0x7f17300b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f17300b1ec0 0x7f1730070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173006d560 con 0x7f17301590a0 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17300b2310 con 0x7f17300b1ec0 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.241+0000 7f1735c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1730159480 con 0x7f173015a000 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f17301590a0 0x7f17300ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53244/0 (socket says 172.21.15.81:53244) 2024-09-13T18:48:05.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172fe00700 1 -- 172.21.15.81:0/3315492844 learned_addr learned my addr 172.21.15.81:0/3315492844 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:05.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535226986 0 0) 0x7f173006d560 con 0x7f17301590a0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17140035d0 con 0x7f17301590a0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 --2- 172.21.15.81:0/3315492844 >> v2:172.21.15.178:3300/0 conn(0x7f17300b1ec0 0x7f1730070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1727400700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 0x7f17300b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132857016 0 0) 0x7f17140035d0 con 0x7f17301590a0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 msgr2=0x7f17300b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 0x7f17300b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 >> v2:172.21.15.178:3300/0 conn(0x7f17300b1ec0 msgr2=0x7f1730070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 --2- 172.21.15.81:0/3315492844 >> v2:172.21.15.178:3300/0 conn(0x7f17300b1ec0 0x7f1730070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173006d840 con 0x7f17301590a0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f1720001670 con 0x7f17301590a0 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1727400700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 0x7f17300b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 >> v1:172.21.15.81:6789/0 conn(0x7f17301590a0 legacy=0x7f17300ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714003a20 0x7f1714003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 0x7f1714004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1714004db0 0x7f1714005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730159480 con 0x7f1714004db0 2024-09-13T18:48:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171400bae0 con 0x7f1714003a20 2024-09-13T18:48:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171400bc50 con 0x7f173015a000 2024-09-13T18:48:05.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1714004db0 0x7f1714005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 -- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 msgr2=0x7f1714004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f173015a000 0x7f1714004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 -- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714003a20 msgr2=0x7f1714003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714003a20 0x7f1714003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 -- 172.21.15.81:0/3315492844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140035d0 con 0x7f1714004db0 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1714004db0 0x7f1714005230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1728007360 tx=0x7f17140058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f3cf9dd3baf376 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728007e80 con 0x7f1714004db0 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728014400 con 0x7f1714004db0 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f172f400700 1 -- 172.21.15.81:0/3315492844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728014790 con 0x7f1714004db0 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735c00700 1 -- 172.21.15.81:0/3315492844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1714004db0 msgr2=0x7f1714005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735c00700 1 --2- 172.21.15.81:0/3315492844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1714004db0 0x7f1714005230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1728007360 tx=0x7f17140058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.245+0000 7f1735200700 1 -- 172.21.15.81:0/3315492844 reap_dead start 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- 172.21.15.81:0/3315492844 shutdown_connections 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- 172.21.15.81:0/3315492844 >> 172.21.15.81:0/3315492844 conn(0x7f173006a390 msgr2=0x7f173006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- 172.21.15.81:0/3315492844 shutdown_connections 2024-09-13T18:48:05.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- 172.21.15.81:0/3315492844 wait complete. 2024-09-13T18:48:05.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 Processor -- start 2024-09-13T18:48:05.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- start start 2024-09-13T18:48:05.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714004db0 0x7f173014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 0x7f17300b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17300b3060 0x7f1730150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b34e0 con 0x7f173014ebf0 2024-09-13T18:48:05.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173014e760 con 0x7f1714004db0 2024-09-13T18:48:05.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1730151a90 con 0x7f17300b3060 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1727400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 0x7f17300b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1727400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 0x7f17300b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37486/0 (socket says 172.21.15.81:37486) 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1727400700 1 -- 172.21.15.81:0/1151613636 learned_addr learned my addr 172.21.15.81:0/1151613636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f172fe00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714004db0 0x7f173014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.249+0000 7f1735200700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17300b3060 0x7f1730150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1727400700 1 -- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17300b3060 msgr2=0x7f1730150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1727400700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17300b3060 0x7f1730150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1727400700 1 -- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714004db0 msgr2=0x7f173014c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1727400700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714004db0 0x7f173014c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1727400700 1 -- 172.21.15.81:0/1151613636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173014de30 con 0x7f173014ebf0 2024-09-13T18:48:05.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1735200700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17300b3060 0x7f1730150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:05.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1727400700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 0x7f17300b2b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f171800c7c0 tx=0x7f171800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011800 con 0x7f173014ebf0 2024-09-13T18:48:05.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718011960 con 0x7f173014ebf0 2024-09-13T18:48:05.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173014e110 con 0x7f173014ebf0 2024-09-13T18:48:05.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011cd0 con 0x7f173014ebf0 2024-09-13T18:48:05.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17301512a0 con 0x7f173014ebf0 2024-09-13T18:48:05.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.253+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17300ce270 con 0x7f173014ebf0 2024-09-13T18:48:05.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.257+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1718021350 con 0x7f173014ebf0 2024-09-13T18:48:05.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.257+0000 7f172cc00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.257+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17180843f0 con 0x7f173014ebf0 2024-09-13T18:48:05.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.257+0000 7f172fe00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.257+0000 7f172fe00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f170c066730 0x7f170c068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f17200017a0 tx=0x7f1720001ce0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.265+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1718051310 con 0x7f173014ebf0 2024-09-13T18:48:05.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.445+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17300ce6b0 con 0x7f173014ebf0 2024-09-13T18:48:05.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.445+0000 7f172cc00700 1 -- 172.21.15.81:0/1151613636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1718054930 con 0x7f173014ebf0 2024-09-13T18:48:05.457 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.449+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f170c066730 msgr2=0x7f170c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.449+0000 7f1735c00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f170c066730 0x7f170c068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f17200017a0 tx=0x7f1720001ce0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.449+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 msgr2=0x7f17300b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.449+0000 7f1735c00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 0x7f17300b2b20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f171800c7c0 tx=0x7f171800cad0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 shutdown_connections 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17300b3060 0x7f1730150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f173014ebf0 0x7f17300b2b20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 --2- 172.21.15.81:0/1151613636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1714004db0 0x7f173014c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 >> 172.21.15.81:0/1151613636 conn(0x7f173006a390 msgr2=0x7f1730070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 shutdown_connections 2024-09-13T18:48:05.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.453+0000 7f1735c00700 1 -- 172.21.15.81:0/1151613636 wait complete. 2024-09-13T18:48:05.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:05.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.637+0000 7fc815400700 1 Processor -- start 2024-09-13T18:48:05.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.637+0000 7fc815400700 1 -- start start 2024-09-13T18:48:05.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc815400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8100b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc815400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc81015e9f0 0x7fc81015eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc815400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81015e560 con 0x7fc81006aaa0 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc815400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100b3ec0 con 0x7fc81015e9f0 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc815400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8100adf90 con 0x7fc81015d310 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc814a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc81015e9f0 0x7fc81015eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc807400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8100b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc80fe00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc81006aaa0 0x7fc81006ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:38864/0 (socket says 172.21.15.81:38864) 2024-09-13T18:48:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc80fe00700 1 -- 172.21.15.81:0/482260741 learned_addr learned my addr 172.21.15.81:0/482260741 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc814a00700 1 -- 172.21.15.81:0/482260741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 msgr2=0x7fc8100b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc814a00700 1 --2- 172.21.15.81:0/482260741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8100b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc814a00700 1 -- 172.21.15.81:0/482260741 >> v1:172.21.15.178:6789/0 conn(0x7fc81006aaa0 legacy=0x7fc81006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc80f400700 1 -- 172.21.15.81:0/482260741 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236950049 0 0) 0x7fc81015e560 con 0x7fc81006aaa0 2024-09-13T18:48:05.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc814a00700 1 -- 172.21.15.81:0/482260741 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81015d920 con 0x7fc81015e9f0 2024-09-13T18:48:05.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc814a00700 1 --2- 172.21.15.81:0/482260741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc81015eea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc808009d90 tx=0x7fc80800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2260f9968fc0cf91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc80f400700 1 -- 172.21.15.81:0/482260741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80800e070 con 0x7fc81015e9f0 2024-09-13T18:48:05.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc80f400700 1 -- 172.21.15.81:0/482260741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80800bb20 con 0x7fc81015e9f0 2024-09-13T18:48:05.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.641+0000 7fc80f400700 1 -- 172.21.15.81:0/482260741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808012430 con 0x7fc81015e9f0 2024-09-13T18:48:05.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 -- 172.21.15.81:0/482260741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 msgr2=0x7fc81015eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 --2- 172.21.15.81:0/482260741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc81015eea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc808009d90 tx=0x7fc80800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 -- 172.21.15.81:0/482260741 shutdown_connections 2024-09-13T18:48:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 --2- 172.21.15.81:0/482260741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc81015eea0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 --2- 172.21.15.81:0/482260741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8100b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 -- 172.21.15.81:0/482260741 >> 172.21.15.81:0/482260741 conn(0x7fc8100b0c40 msgr2=0x7fc81006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 -- 172.21.15.81:0/482260741 shutdown_connections 2024-09-13T18:48:05.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 -- 172.21.15.81:0/482260741 wait complete. 2024-09-13T18:48:05.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 Processor -- start 2024-09-13T18:48:05.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.645+0000 7fc815400700 1 -- start start 2024-09-13T18:48:05.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc81006aaa0 0x7fc81013f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8101e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc8101e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101e6e30 con 0x7fc81015e9f0 2024-09-13T18:48:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101e7110 con 0x7fc81006aaa0 2024-09-13T18:48:05.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101e73f0 con 0x7fc81015d310 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc8101e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc8101e67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37506/0 (socket says 172.21.15.81:37506) 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 -- 172.21.15.81:0/3929283370 learned_addr learned my addr 172.21.15.81:0/3929283370 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc807400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8101e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc80fe00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc81006aaa0 0x7fc81013f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 -- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 msgr2=0x7fc8101e6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8101e6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 -- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc81006aaa0 msgr2=0x7fc81013f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc81006aaa0 0x7fc81013f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 -- 172.21.15.81:0/3929283370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009a70 con 0x7fc81015e9f0 2024-09-13T18:48:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc814a00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc8101e67a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8100b1690 tx=0x7fc808004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808012430 con 0x7fc81015e9f0 2024-09-13T18:48:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808020070 con 0x7fc81015e9f0 2024-09-13T18:48:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808004280 con 0x7fc81015e9f0 2024-09-13T18:48:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8101e76d0 con 0x7fc81015e9f0 2024-09-13T18:48:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.649+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8100ccaf0 con 0x7fc81015e9f0 2024-09-13T18:48:05.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.653+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8100b3980 con 0x7fc81015e9f0 2024-09-13T18:48:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.653+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8080043e0 con 0x7fc81015e9f0 2024-09-13T18:48:05.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.653+0000 7fc80cc00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7ec066730 0x7fc7ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.657+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc808022070 con 0x7fc81015e9f0 2024-09-13T18:48:05.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.657+0000 7fc80fe00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7ec066730 0x7fc7ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.657+0000 7fc80fe00700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7ec066730 0x7fc7ec068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc800000f60 tx=0x7fc800007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.661+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8080530f0 con 0x7fc81015e9f0 2024-09-13T18:48:05.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.849+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8100caa80 con 0x7fc81015e9f0 2024-09-13T18:48:05.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.853+0000 7fc80cc00700 1 -- 172.21.15.81:0/3929283370 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7fc808056710 con 0x7fc81015e9f0 2024-09-13T18:48:05.864 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:05.864 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7ec066730 msgr2=0x7fc7ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7ec066730 0x7fc7ec068bf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc800000f60 tx=0x7fc800007e90 comp rx=0 tx=0).stop 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 msgr2=0x7fc8101e67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc8101e67a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc8100b1690 tx=0x7fc808004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 shutdown_connections 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7ec066730 0x7fc7ec068bf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc81015e9f0 0x7fc8101e67a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc81015d310 0x7fc8101e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 --2- 172.21.15.81:0/3929283370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc81006aaa0 0x7fc81013f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 >> 172.21.15.81:0/3929283370 conn(0x7fc8100b0c40 msgr2=0x7fc81006d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 shutdown_connections 2024-09-13T18:48:05.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:05.857+0000 7fc815400700 1 -- 172.21.15.81:0/3929283370 wait complete. 2024-09-13T18:48:05.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:05.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 Processor -- start 2024-09-13T18:48:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 -- start start 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55b4157500 0x7f55b40ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b4070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b40b57e0 con 0x7f55b40cd140 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b40b3b80 con 0x7f55b4157500 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55bbc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b40b5a80 con 0x7f55b415e030 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55b9c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f55b40cd140 0x7f55b4160ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53248/0 (socket says 172.21.15.81:53248) 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55b9c00700 1 -- 172.21.15.81:0/1219293793 learned_addr learned my addr 172.21.15.81:0/1219293793 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55b9200700 1 --2- 172.21.15.81:0/1219293793 >> v2:172.21.15.178:3300/0 conn(0x7f55b4157500 0x7f55b40ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.057+0000 7f55b3e00700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b4070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b9200700 1 -- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 msgr2=0x7f55b4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b9200700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b4070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b9200700 1 -- 172.21.15.81:0/1219293793 >> v1:172.21.15.81:6789/0 conn(0x7f55b40cd140 legacy=0x7f55b4160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b3400700 1 -- 172.21.15.81:0/1219293793 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003416439 0 0) 0x7f55b40b57e0 con 0x7f55b40cd140 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b9200700 1 -- 172.21.15.81:0/1219293793 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b40b5d60 con 0x7f55b4157500 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b3e00700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b4070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b9200700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b40ce700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009850 tx=0x7f55a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2647a7f9be7cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b3400700 1 -- 172.21.15.81:0/1219293793 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8011830 con 0x7f55b4157500 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b3400700 1 -- 172.21.15.81:0/1219293793 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8011990 con 0x7f55b4157500 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55b3400700 1 -- 172.21.15.81:0/1219293793 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8011d40 con 0x7f55b4157500 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 -- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 msgr2=0x7f55b40ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b40ce700 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55a8009850 tx=0x7f55a8009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 -- 172.21.15.81:0/1219293793 shutdown_connections 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b4070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 --2- 172.21.15.81:0/1219293793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b40ce700 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 -- 172.21.15.81:0/1219293793 >> 172.21.15.81:0/1219293793 conn(0x7f55b406e660 msgr2=0x7f55b406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 -- 172.21.15.81:0/1219293793 shutdown_connections 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.061+0000 7f55bbc00700 1 -- 172.21.15.81:0/1219293793 wait complete. 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 Processor -- start 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 -- start start 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 0x7f55b406a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b4144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b41473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b41f2ec0 con 0x7f55b40cd140 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b41f3110 con 0x7f55b4157500 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55bbc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b406a8d0 con 0x7f55b415e030 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 0x7f55b406a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 0x7f55b406a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37522/0 (socket says 172.21.15.81:37522) 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 -- 172.21.15.81:0/57078244 learned_addr learned my addr 172.21.15.81:0/57078244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b3e00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b4144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9c00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b41473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 -- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 msgr2=0x7f55b41473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b41473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 -- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 msgr2=0x7f55b4144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.065+0000 7f55b9200700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b4144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55b9200700 1 -- 172.21.15.81:0/57078244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a00094b0 con 0x7f55b40cd140 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55b9c00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b41473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55b9200700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 0x7f55b406a390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55a8000c00 tx=0x7f55a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a801aac0 con 0x7f55b40cd140 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a80094b0 con 0x7f55b40cd140 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a801f070 con 0x7f55b40cd140 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a801ae60 con 0x7f55b40cd140 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b406b060 con 0x7f55b40cd140 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.069+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b40cda00 con 0x7f55b40cd140 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.073+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55a801b430 con 0x7f55b40cd140 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.073+0000 7f55b0c00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5594066760 0x7f5594068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.073+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f55a8085660 con 0x7f55b40cd140 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.073+0000 7f55b3e00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5594066760 0x7f5594068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.073+0000 7f55b3e00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5594066760 0x7f5594068c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55b4147260 tx=0x7f55a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.081+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55a8052620 con 0x7f55b40cd140 2024-09-13T18:48:06.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.257+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55b4070160 con 0x7f55b40cd140 2024-09-13T18:48:06.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55b0c00700 1 -- 172.21.15.81:0/57078244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55a8055c40 con 0x7f55b40cd140 2024-09-13T18:48:06.270 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5594066760 msgr2=0x7f5594068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5594066760 0x7f5594068c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f55b4147260 tx=0x7f55a0008040 comp rx=0 tx=0).stop 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 msgr2=0x7f55b406a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 0x7f55b406a390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f55a8000c00 tx=0x7f55a8004770 comp rx=0 tx=0).stop 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 shutdown_connections 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5594066760 0x7f5594068c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b415e030 0x7f55b41473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b4157500 0x7f55b4144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 --2- 172.21.15.81:0/57078244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55b40cd140 0x7f55b406a390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 >> 172.21.15.81:0/57078244 conn(0x7f55b406e660 msgr2=0x7f55b415fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 shutdown_connections 2024-09-13T18:48:06.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.261+0000 7f55bbc00700 1 -- 172.21.15.81:0/57078244 wait complete. 2024-09-13T18:48:06.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.453+0000 7f90fe800700 1 Processor -- start 2024-09-13T18:48:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.453+0000 7f90fe800700 1 -- start start 2024-09-13T18:48:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90fe800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90f80b2290 0x7f90f8159500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90fe800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f815a920 con 0x7f90f8159a40 2024-09-13T18:48:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90fe800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f8159f20 con 0x7f90f80b0f20 2024-09-13T18:48:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90fe800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f815a7c0 con 0x7f90f80b2290 2024-09-13T18:48:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90f7e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f90f8159a40 0x7f90f8071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53254/0 (socket says 172.21.15.81:53254) 2024-09-13T18:48:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90f7e00700 1 -- 172.21.15.81:0/202045922 learned_addr learned my addr 172.21.15.81:0/202045922 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:06.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90efe00700 1 --2- 172.21.15.81:0/202045922 >> v2:172.21.15.178:3300/0 conn(0x7f90f80b2290 0x7f90f8159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90f6a00700 1 -- 172.21.15.81:0/202045922 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638417554 0 0) 0x7f90f815a920 con 0x7f90f8159a40 2024-09-13T18:48:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90f6a00700 1 -- 172.21.15.81:0/202045922 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90dc0034f0 con 0x7f90f8159a40 2024-09-13T18:48:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90efe00700 1 -- 172.21.15.81:0/202045922 >> v1:172.21.15.178:6789/0 conn(0x7f90f80b0f20 legacy=0x7f90f80b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90efe00700 1 -- 172.21.15.81:0/202045922 >> v1:172.21.15.81:6789/0 conn(0x7f90f8159a40 legacy=0x7f90f8071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90efe00700 1 -- 172.21.15.81:0/202045922 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f815a200 con 0x7f90f80b2290 2024-09-13T18:48:06.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.457+0000 7f90efe00700 1 --2- 172.21.15.81:0/202045922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8159500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009850 tx=0x7f90e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb31e081a25038c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90f6a00700 1 -- 172.21.15.81:0/202045922 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0011830 con 0x7f90f80b2290 2024-09-13T18:48:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90f6a00700 1 -- 172.21.15.81:0/202045922 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0011990 con 0x7f90f80b2290 2024-09-13T18:48:06.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90f6a00700 1 -- 172.21.15.81:0/202045922 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0011d40 con 0x7f90f80b2290 2024-09-13T18:48:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 -- 172.21.15.81:0/202045922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 msgr2=0x7f90f8159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 --2- 172.21.15.81:0/202045922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8159500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90e0009850 tx=0x7f90e0009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 -- 172.21.15.81:0/202045922 shutdown_connections 2024-09-13T18:48:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 --2- 172.21.15.81:0/202045922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8159500 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 -- 172.21.15.81:0/202045922 >> 172.21.15.81:0/202045922 conn(0x7f90f806e840 msgr2=0x7f90f806c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 -- 172.21.15.81:0/202045922 shutdown_connections 2024-09-13T18:48:06.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.461+0000 7f90fe800700 1 -- 172.21.15.81:0/202045922 wait complete. 2024-09-13T18:48:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 Processor -- start 2024-09-13T18:48:06.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 -- start start 2024-09-13T18:48:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 0x7f90f814ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f8159a40 0x7f90f814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f814b3b0 con 0x7f90f80b0f20 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f81583d0 con 0x7f90f80b2290 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90fe800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8152df0 con 0x7f90f8159a40 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 0x7f90f814ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 0x7f90f814ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37538/0 (socket says 172.21.15.81:37538) 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.465+0000 7f90f7400700 1 -- 172.21.15.81:0/934046583 learned_addr learned my addr 172.21.15.81:0/934046583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90efe00700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7e00700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f8159a40 0x7f90f814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7400700 1 -- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f8159a40 msgr2=0x7f90f814cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7400700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f8159a40 0x7f90f814cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7400700 1 -- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 msgr2=0x7f90f8156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7400700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7400700 1 -- 172.21.15.81:0/934046583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00094b0 con 0x7f90f80b0f20 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90f7400700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 0x7f90f814ae70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90e800c500 tx=0x7f90e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80052d0 con 0x7f90f80b0f20 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e8005430 con 0x7f90f80b0f20 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e80055a0 con 0x7f90f80b0f20 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f8158860 con 0x7f90f80b0f20 2024-09-13T18:48:06.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f8157aa0 con 0x7f90f80b0f20 2024-09-13T18:48:06.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.469+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f8073b10 con 0x7f90f80b0f20 2024-09-13T18:48:06.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.473+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90e80038e0 con 0x7f90f80b0f20 2024-09-13T18:48:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.473+0000 7f90ef400700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f90d4066730 0x7f90d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.473+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f90e8083950 con 0x7f90f80b0f20 2024-09-13T18:48:06.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.473+0000 7f90efe00700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f90d4066730 0x7f90d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.477+0000 7f90efe00700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f90d4066730 0x7f90d4068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90e00090b0 tx=0x7f90e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.477+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90e8050860 con 0x7f90f80b0f20 2024-09-13T18:48:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.661+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90f80aebe0 con 0x7f90f80b0f20 2024-09-13T18:48:06.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90ef400700 1 -- 172.21.15.81:0/934046583 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90e8053e80 con 0x7f90f80b0f20 2024-09-13T18:48:06.675 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:06.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f90d4066730 msgr2=0x7f90d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f90d4066730 0x7f90d4068bf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90e00090b0 tx=0x7f90e0008030 comp rx=0 tx=0).stop 2024-09-13T18:48:06.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 msgr2=0x7f90f814ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 0x7f90f814ae70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90e800c500 tx=0x7f90e800c810 comp rx=0 tx=0).stop 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 shutdown_connections 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f90d4066730 0x7f90d4068bf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90f8159a40 0x7f90f814cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90f80b2290 0x7f90f8156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 --2- 172.21.15.81:0/934046583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f80b0f20 0x7f90f814ae70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 >> 172.21.15.81:0/934046583 conn(0x7f90f806e840 msgr2=0x7f90f806c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.665+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 shutdown_connections 2024-09-13T18:48:06.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.669+0000 7f90fe800700 1 -- 172.21.15.81:0/934046583 wait complete. 2024-09-13T18:48:06.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:06.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.861+0000 7f12dca00700 1 Processor -- start 2024-09-13T18:48:06.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.861+0000 7f12dca00700 1 -- start start 2024-09-13T18:48:06.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12dca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12dca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12d806d760 0x7f12d80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12dca00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d806bcf0 con 0x7f12d8144710 2024-09-13T18:48:06.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12dca00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d80cce10 con 0x7f12d806d760 2024-09-13T18:48:06.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12dca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d806cb50 con 0x7f12d8144330 2024-09-13T18:48:06.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12d806d760 0x7f12d80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12d806d760 0x7f12d80b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:60120/0 (socket says 172.21.15.81:60120) 2024-09-13T18:48:06.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 -- 172.21.15.81:0/2366342451 learned_addr learned my addr 172.21.15.81:0/2366342451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 -- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 msgr2=0x7f12d80cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 --2- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d80cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 -- 172.21.15.81:0/2366342451 >> v1:172.21.15.178:6789/0 conn(0x7f12d8144710 legacy=0x7f12d815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 -- 172.21.15.81:0/2366342451 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d80cf4b0 con 0x7f12d806d760 2024-09-13T18:48:06.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.865+0000 7f12d5400700 1 --2- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d806d760 0x7f12d80b35a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12c4009910 tx=0x7f12c4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ead157750209f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12d4a00700 1 -- 172.21.15.81:0/2366342451 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011830 con 0x7f12d806d760 2024-09-13T18:48:06.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12d4a00700 1 -- 172.21.15.81:0/2366342451 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4011990 con 0x7f12d806d760 2024-09-13T18:48:06.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12d4a00700 1 -- 172.21.15.81:0/2366342451 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011d40 con 0x7f12d806d760 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 -- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d806d760 msgr2=0x7f12d80b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 --2- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d806d760 0x7f12d80b35a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f12c4009910 tx=0x7f12c4009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 -- 172.21.15.81:0/2366342451 shutdown_connections 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 --2- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d806d760 0x7f12d80b35a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 --2- 172.21.15.81:0/2366342451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d80cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 -- 172.21.15.81:0/2366342451 >> 172.21.15.81:0/2366342451 conn(0x7f12d806a570 msgr2=0x7f12d806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 -- 172.21.15.81:0/2366342451 shutdown_connections 2024-09-13T18:48:06.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.869+0000 7f12dca00700 1 -- 172.21.15.81:0/2366342451 wait complete. 2024-09-13T18:48:06.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 Processor -- start 2024-09-13T18:48:06.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 -- start start 2024-09-13T18:48:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 0x7f12d8136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d81406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d8071850 0x7f12d8159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d81367d0 con 0x7f12d806d760 2024-09-13T18:48:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d8140fc0 con 0x7f12d8071850 2024-09-13T18:48:06.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12dca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d81439c0 con 0x7f12d8144330 2024-09-13T18:48:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12d5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 0x7f12d8136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12d5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 0x7f12d8136290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57916/0 (socket says 172.21.15.81:57916) 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.873+0000 7f12d5e00700 1 -- 172.21.15.81:0/3285589427 learned_addr learned my addr 172.21.15.81:0/3285589427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5400700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d81406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d6800700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d8071850 0x7f12d8159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5e00700 1 -- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 msgr2=0x7f12d81406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5e00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d81406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5e00700 1 -- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d8071850 msgr2=0x7f12d8159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5e00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d8071850 0x7f12d8159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5e00700 1 -- 172.21.15.81:0/3285589427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4009570 con 0x7f12d806d760 2024-09-13T18:48:06.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12d5e00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 0x7f12d8136290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12c800e9d0 tx=0x7f12c800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c8009720 con 0x7f12d806d760 2024-09-13T18:48:06.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c800c7f0 con 0x7f12d806d760 2024-09-13T18:48:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d8143090 con 0x7f12d806d760 2024-09-13T18:48:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c800cb60 con 0x7f12d806d760 2024-09-13T18:48:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d8143650 con 0x7f12d806d760 2024-09-13T18:48:06.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.877+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d80b2c00 con 0x7f12d806d760 2024-09-13T18:48:06.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.881+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12c800ccc0 con 0x7f12d806d760 2024-09-13T18:48:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.881+0000 7f12ce000700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12b8066730 0x7f12b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.881+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f12c8084910 con 0x7f12d806d760 2024-09-13T18:48:06.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.881+0000 7f12d5400700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12b8066730 0x7f12b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.881+0000 7f12d5400700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12b8066730 0x7f12b8068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f12d8072000 tx=0x7f12c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:06.885+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12c80518c0 con 0x7f12d806d760 2024-09-13T18:48:07.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.065+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12d80cdd40 con 0x7f12d806d760 2024-09-13T18:48:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12ce000700 1 -- 172.21.15.81:0/3285589427 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12c8054ee0 con 0x7f12d806d760 2024-09-13T18:48:07.078 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12b8066730 msgr2=0x7f12b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12b8066730 0x7f12b8068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f12d8072000 tx=0x7f12c4008030 comp rx=0 tx=0).stop 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 msgr2=0x7f12d8136290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 0x7f12d8136290 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12c800e9d0 tx=0x7f12c800ed90 comp rx=0 tx=0).stop 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 shutdown_connections 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12b8066730 0x7f12b8068bf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12d8071850 0x7f12d8159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12d8144330 0x7f12d81406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 --2- 172.21.15.81:0/3285589427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12d806d760 0x7f12d8136290 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 >> 172.21.15.81:0/3285589427 conn(0x7f12d806a570 msgr2=0x7f12d80cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 shutdown_connections 2024-09-13T18:48:07.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.069+0000 7f12dca00700 1 -- 172.21.15.81:0/3285589427 wait complete. 2024-09-13T18:48:07.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:07.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.277+0000 7f5957e00700 1 Processor -- start 2024-09-13T18:48:07.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.277+0000 7f5957e00700 1 -- start start 2024-09-13T18:48:07.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806cd80 0x7f59580b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f595806ada0 0x7f595806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5958160680 con 0x7f595815ca20 2024-09-13T18:48:07.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595806b770 con 0x7f595806ada0 2024-09-13T18:48:07.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595815d670 con 0x7f595806cd80 2024-09-13T18:48:07.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f595806ada0 0x7f595806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5956a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f595815ca20 0x7f595815ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38760/0 (socket says 172.21.15.81:38760) 2024-09-13T18:48:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5956a00700 1 -- 172.21.15.81:0/327094795 learned_addr learned my addr 172.21.15.81:0/327094795 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:07.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5956000700 1 --2- 172.21.15.81:0/327094795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806cd80 0x7f59580b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5955600700 1 -- 172.21.15.81:0/327094795 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310165703 0 0) 0x7f5958160680 con 0x7f595815ca20 2024-09-13T18:48:07.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5955600700 1 -- 172.21.15.81:0/327094795 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f593c0035d0 con 0x7f595815ca20 2024-09-13T18:48:07.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957400700 1 -- 172.21.15.81:0/327094795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806cd80 msgr2=0x7f59580b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:07.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957400700 1 --2- 172.21.15.81:0/327094795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806cd80 0x7f59580b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957400700 1 -- 172.21.15.81:0/327094795 >> v1:172.21.15.81:6789/0 conn(0x7f595815ca20 legacy=0x7f595815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957400700 1 -- 172.21.15.81:0/327094795 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595815d950 con 0x7f595806ada0 2024-09-13T18:48:07.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.281+0000 7f5957400700 1 --2- 172.21.15.81:0/327094795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806ada0 0x7f595806b230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5950009d90 tx=0x7f595000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08b2a72def63296 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:07.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5955600700 1 -- 172.21.15.81:0/327094795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000e070 con 0x7f595806ada0 2024-09-13T18:48:07.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5955600700 1 -- 172.21.15.81:0/327094795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000bb20 con 0x7f595806ada0 2024-09-13T18:48:07.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5955600700 1 -- 172.21.15.81:0/327094795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950012430 con 0x7f595806ada0 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 -- 172.21.15.81:0/327094795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806ada0 msgr2=0x7f595806b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 --2- 172.21.15.81:0/327094795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806ada0 0x7f595806b230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5950009d90 tx=0x7f595000b330 comp rx=0 tx=0).stop 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 -- 172.21.15.81:0/327094795 shutdown_connections 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 --2- 172.21.15.81:0/327094795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806ada0 0x7f595806b230 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 --2- 172.21.15.81:0/327094795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806cd80 0x7f59580b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 -- 172.21.15.81:0/327094795 >> 172.21.15.81:0/327094795 conn(0x7f5958071d20 msgr2=0x7f5958072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 -- 172.21.15.81:0/327094795 shutdown_connections 2024-09-13T18:48:07.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.285+0000 7f5957e00700 1 -- 172.21.15.81:0/327094795 wait complete. 2024-09-13T18:48:07.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 Processor -- start 2024-09-13T18:48:07.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 -- start start 2024-09-13T18:48:07.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806ada0 0x7f59580cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 0x7f59580b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f595815ca20 0x7f59580b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958145470 con 0x7f595806cd80 2024-09-13T18:48:07.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958145750 con 0x7f595815ca20 2024-09-13T18:48:07.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5958145a30 con 0x7f595806ada0 2024-09-13T18:48:07.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 0x7f59580b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 0x7f59580b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57926/0 (socket says 172.21.15.81:57926) 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 -- 172.21.15.81:0/3997128358 learned_addr learned my addr 172.21.15.81:0/3997128358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5957400700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f595815ca20 0x7f59580b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956a00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806ada0 0x7f59580cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 -- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806ada0 msgr2=0x7f59580cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806ada0 0x7f59580cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 -- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f595815ca20 msgr2=0x7f59580b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f595815ca20 0x7f59580b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.289+0000 7f5956000700 1 -- 172.21.15.81:0/3997128358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5950009a70 con 0x7f595806cd80 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f5956000700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 0x7f59580b1e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f594400e9d0 tx=0x7f594400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944009720 con 0x7f595806cd80 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594400c850 con 0x7f595806cd80 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594400cbc0 con 0x7f595806cd80 2024-09-13T18:48:07.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5958145d10 con 0x7f595806cd80 2024-09-13T18:48:07.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5958144fa0 con 0x7f595806cd80 2024-09-13T18:48:07.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5958145ea0 con 0x7f595806cd80 2024-09-13T18:48:07.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.293+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f594400cd20 con 0x7f595806cd80 2024-09-13T18:48:07.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.297+0000 7f594f400700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5938066730 0x7f5938068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.297+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f59440846b0 con 0x7f595806cd80 2024-09-13T18:48:07.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.297+0000 7f5956a00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5938066730 0x7f5938068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.297+0000 7f5956a00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5938066730 0x7f5938068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59480011e0 tx=0x7f5948009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:07.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.301+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5944051650 con 0x7f595806cd80 2024-09-13T18:48:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.493+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f595806d1c0 con 0x7f595806cd80 2024-09-13T18:48:07.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.493+0000 7f594f400700 1 -- 172.21.15.81:0/3997128358 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5944054c70 con 0x7f595806cd80 2024-09-13T18:48:07.504 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5938066730 msgr2=0x7f5938068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5938066730 0x7f5938068bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f59480011e0 tx=0x7f5948009040 comp rx=0 tx=0).stop 2024-09-13T18:48:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 msgr2=0x7f59580b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 0x7f59580b1e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f594400e9d0 tx=0x7f594400ed90 comp rx=0 tx=0).stop 2024-09-13T18:48:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 shutdown_connections 2024-09-13T18:48:07.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5938066730 0x7f5938068bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f595815ca20 0x7f59580b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f595806cd80 0x7f59580b1e00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 --2- 172.21.15.81:0/3997128358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f595806ada0 0x7f59580cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 >> 172.21.15.81:0/3997128358 conn(0x7f5958071d20 msgr2=0x7f595815e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 shutdown_connections 2024-09-13T18:48:07.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.497+0000 7f5957e00700 1 -- 172.21.15.81:0/3997128358 wait complete. 2024-09-13T18:48:07.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:07.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.685+0000 7f7ed2400700 1 Processor -- start 2024-09-13T18:48:07.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed2400700 1 -- start start 2024-09-13T18:48:07.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 0x7f7ecc06ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed2400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc06d3c0 con 0x7f7ecc1647e0 2024-09-13T18:48:07.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed2400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc06a530 con 0x7f7ecc15cb30 2024-09-13T18:48:07.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed2400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cd7a0 con 0x7f7ecc06ca30 2024-09-13T18:48:07.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed1a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ecc1647e0 0x7f7ecc166bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38776/0 (socket says 172.21.15.81:38776) 2024-09-13T18:48:07.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.689+0000 7f7ed1a00700 1 -- 172.21.15.81:0/780574014 learned_addr learned my addr 172.21.15.81:0/780574014 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:07.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ec3e00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 0x7f7ecc06ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506513108 0 0) 0x7f7ec4001490 con 0x7f7ecc1647e0 2024-09-13T18:48:07.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb00035d0 con 0x7f7ecc1647e0 2024-09-13T18:48:07.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810502294 0 0) 0x7f7ecc06a530 con 0x7f7ecc15cb30 2024-09-13T18:48:07.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec4001490 con 0x7f7ecc15cb30 2024-09-13T18:48:07.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146154116 0 0) 0x7f7eb00035d0 con 0x7f7ecc1647e0 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 msgr2=0x7f7ecc06ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 0x7f7ecc06ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 >> v1:172.21.15.178:6789/0 conn(0x7f7ecc15cb30 legacy=0x7f7ecc06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc06a810 con 0x7f7ecc1647e0 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f7ec4001b80 con 0x7f7ecc1647e0 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 >> v1:172.21.15.81:6789/0 conn(0x7f7ecc1647e0 legacy=0x7f7ecc166bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7eb0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 0x7f7eb0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb0004db0 0x7f7eb0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cd7a0 con 0x7f7eb0003c50 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb000bb40 con 0x7f7eb0004db0 2024-09-13T18:48:07.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb000bd00 con 0x7f7ecc06ca30 2024-09-13T18:48:07.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7eb0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ec3e00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 0x7f7eb0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1a00700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb0004db0 0x7f7eb0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 -- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 msgr2=0x7f7eb0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc06ca30 0x7f7eb0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 -- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb0004db0 msgr2=0x7f7eb0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb0004db0 0x7f7eb0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 -- 172.21.15.81:0/780574014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00035d0 con 0x7f7eb0003c50 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ed1000700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7eb0004050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc007fd0 tx=0x7f7eb00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f4d1416bdc1947 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc001450 con 0x7f7eb0003c50 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0052f0 con 0x7f7eb0003c50 2024-09-13T18:48:07.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.693+0000 7f7ecbe00700 1 -- 172.21.15.81:0/780574014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc001d60 con 0x7f7eb0003c50 2024-09-13T18:48:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 -- 172.21.15.81:0/780574014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 msgr2=0x7f7eb0004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 --2- 172.21.15.81:0/780574014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7eb0004050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc007fd0 tx=0x7f7eb00058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed1a00700 1 -- 172.21.15.81:0/780574014 reap_dead start 2024-09-13T18:48:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 -- 172.21.15.81:0/780574014 shutdown_connections 2024-09-13T18:48:07.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 -- 172.21.15.81:0/780574014 >> 172.21.15.81:0/780574014 conn(0x7f7ecc071f00 msgr2=0x7f7ecc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:07.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 -- 172.21.15.81:0/780574014 shutdown_connections 2024-09-13T18:48:07.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 -- 172.21.15.81:0/780574014 wait complete. 2024-09-13T18:48:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 Processor -- start 2024-09-13T18:48:07.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.697+0000 7f7ed2400700 1 -- start start 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7ecc158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc0c5ae0 0x7f7ecc0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ecc0c5f60 0x7f7ecc0c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc157cd0 con 0x7f7eb0003c50 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc15f3e0 con 0x7f7ecc0c5f60 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc15f100 con 0x7f7ecc0c5ae0 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7ecc158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7ecc158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57950/0 (socket says 172.21.15.81:57950) 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 -- 172.21.15.81:0/24611333 learned_addr learned my addr 172.21.15.81:0/24611333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ec3e00700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc0c5ae0 0x7f7ecc0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1a00700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ecc0c5f60 0x7f7ecc0c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 -- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc0c5ae0 msgr2=0x7f7ecc0c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc0c5ae0 0x7f7ecc0c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 -- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ecc0c5f60 msgr2=0x7f7ecc0c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ecc0c5f60 0x7f7ecc0c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 -- 172.21.15.81:0/24611333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc157680 con 0x7f7eb0003c50 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1a00700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ecc0c5f60 0x7f7ecc0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed1000700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7ecc158160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000bb10 tx=0x7f7ebc0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc006c90 con 0x7f7eb0003c50 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc157960 con 0x7f7eb0003c50 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc006df0 con 0x7f7eb0003c50 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc007260 con 0x7f7eb0003c50 2024-09-13T18:48:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.701+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc1565f0 con 0x7f7eb0003c50 2024-09-13T18:48:07.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.705+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc06c1f0 con 0x7f7eb0003c50 2024-09-13T18:48:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.705+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ebc0073c0 con 0x7f7eb0003c50 2024-09-13T18:48:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.705+0000 7f7ec9600700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea8066760 0x7f7ea8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.705+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ebc085750 con 0x7f7eb0003c50 2024-09-13T18:48:07.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.705+0000 7f7ec3e00700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea8066760 0x7f7ea8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:07.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.709+0000 7f7ec3e00700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea8066760 0x7f7ea8068c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc1568c0 tx=0x7f7eb4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:07.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.713+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ecc06c1f0 con 0x7f7eb0003c50 2024-09-13T18:48:07.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.901+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ecc06c1f0 con 0x7f7eb0003c50 2024-09-13T18:48:07.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ec9600700 1 -- 172.21.15.81:0/24611333 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f7ecc06c1f0 con 0x7f7eb0003c50 2024-09-13T18:48:07.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:07.915 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea8066760 msgr2=0x7f7ea8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea8066760 0x7f7ea8068c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc1568c0 tx=0x7f7eb4008040 comp rx=0 tx=0).stop 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 msgr2=0x7f7ecc158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7ecc158160 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000bb10 tx=0x7f7ebc0012d0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 shutdown_connections 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea8066760 0x7f7ea8068c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ecc0c5f60 0x7f7ecc0c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ecc0c5ae0 0x7f7ecc0c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 --2- 172.21.15.81:0/24611333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eb0003c50 0x7f7ecc158160 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.905+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 >> 172.21.15.81:0/24611333 conn(0x7f7ecc071f00 msgr2=0x7f7ecc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.909+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 shutdown_connections 2024-09-13T18:48:07.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:07.909+0000 7f7ed2400700 1 -- 172.21.15.81:0/24611333 wait complete. 2024-09-13T18:48:07.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:07.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:08.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 Processor -- start 2024-09-13T18:48:08.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 -- start start 2024-09-13T18:48:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f93581590a0 0x7f935815a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93580cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935815a540 con 0x7f93580b1980 2024-09-13T18:48:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9358159480 con 0x7f93581590a0 2024-09-13T18:48:08.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935806d560 con 0x7f93580ccff0 2024-09-13T18:48:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935d000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f93581590a0 0x7f935815a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935d000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f93581590a0 0x7f935815a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:60152/0 (socket says 172.21.15.81:60152) 2024-09-13T18:48:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f935d000700 1 -- 172.21.15.81:0/590579515 learned_addr learned my addr 172.21.15.81:0/590579515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:08.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.105+0000 7f9357e00700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93580cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935d000700 1 -- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 msgr2=0x7f93580cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935d000700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93580cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935d000700 1 -- 172.21.15.81:0/590579515 >> v1:172.21.15.178:6789/0 conn(0x7f93580b1980 legacy=0x7f9358070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935d000700 1 -- 172.21.15.81:0/590579515 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935806d840 con 0x7f93581590a0 2024-09-13T18:48:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f9357e00700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93580cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:08.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935d000700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935815a000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f934c00d150 tx=0x7f934c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4bf047f3ea052b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f9357400700 1 -- 172.21.15.81:0/590579515 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c010070 con 0x7f93581590a0 2024-09-13T18:48:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f9357400700 1 -- 172.21.15.81:0/590579515 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c00db00 con 0x7f93581590a0 2024-09-13T18:48:08.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f9357400700 1 -- 172.21.15.81:0/590579515 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00de90 con 0x7f93581590a0 2024-09-13T18:48:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 -- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 msgr2=0x7f935815a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935815a000 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f934c00d150 tx=0x7f934c00d460 comp rx=0 tx=0).stop 2024-09-13T18:48:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 -- 172.21.15.81:0/590579515 shutdown_connections 2024-09-13T18:48:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93580cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 --2- 172.21.15.81:0/590579515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935815a000 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 -- 172.21.15.81:0/590579515 >> 172.21.15.81:0/590579515 conn(0x7f935806a390 msgr2=0x7f935806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 -- 172.21.15.81:0/590579515 shutdown_connections 2024-09-13T18:48:08.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.109+0000 7f935e400700 1 -- 172.21.15.81:0/590579515 wait complete. 2024-09-13T18:48:08.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 Processor -- start 2024-09-13T18:48:08.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 -- start start 2024-09-13T18:48:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 0x7f9358151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93581e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358152230 con 0x7f93580b1980 2024-09-13T18:48:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358152510 con 0x7f93581590a0 2024-09-13T18:48:08.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93581527f0 con 0x7f93580ccff0 2024-09-13T18:48:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 0x7f9358151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 0x7f9358151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57962/0 (socket says 172.21.15.81:57962) 2024-09-13T18:48:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f935d000700 1 -- 172.21.15.81:0/2485300527 learned_addr learned my addr 172.21.15.81:0/2485300527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.113+0000 7f9357e00700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93581e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935da00700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935d000700 1 -- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 msgr2=0x7f93581e3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935d000700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93581e3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935d000700 1 -- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 msgr2=0x7f935813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935d000700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935813f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935d000700 1 -- 172.21.15.81:0/2485300527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93440094b0 con 0x7f93580b1980 2024-09-13T18:48:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935d000700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 0x7f9358151b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f934c00d4a0 tx=0x7f934c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c01f670 con 0x7f93580b1980 2024-09-13T18:48:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c00bd40 con 0x7f93580b1980 2024-09-13T18:48:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c01f7f0 con 0x7f93580b1980 2024-09-13T18:48:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c01fba0 con 0x7f93580b1980 2024-09-13T18:48:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9358152db0 con 0x7f93580b1980 2024-09-13T18:48:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.117+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9358152fa0 con 0x7f93580b1980 2024-09-13T18:48:08.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.121+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f934c01fd00 con 0x7f93580b1980 2024-09-13T18:48:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.121+0000 7f9354c00700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9338066730 0x7f9338068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.121+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f934c088960 con 0x7f93580b1980 2024-09-13T18:48:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.121+0000 7f9357e00700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9338066730 0x7f9338068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.121+0000 7f9357e00700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9338066730 0x7f9338068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93581e43d0 tx=0x7f9344008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.125+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f934c055910 con 0x7f93580b1980 2024-09-13T18:48:08.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.305+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93580cc410 con 0x7f93580b1980 2024-09-13T18:48:08.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.305+0000 7f9354c00700 1 -- 172.21.15.81:0/2485300527 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f934c058f30 con 0x7f93580b1980 2024-09-13T18:48:08.317 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9338066730 msgr2=0x7f9338068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9338066730 0x7f9338068bf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f93581e43d0 tx=0x7f9344008040 comp rx=0 tx=0).stop 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 msgr2=0x7f9358151b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 0x7f9358151b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f934c00d4a0 tx=0x7f934c004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 shutdown_connections 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9338066730 0x7f9338068bf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93581590a0 0x7f935813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93580ccff0 0x7f93581e3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 --2- 172.21.15.81:0/2485300527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93580b1980 0x7f9358151b30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 >> 172.21.15.81:0/2485300527 conn(0x7f935806a390 msgr2=0x7f935806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 shutdown_connections 2024-09-13T18:48:08.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.309+0000 7f935e400700 1 -- 172.21.15.81:0/2485300527 wait complete. 2024-09-13T18:48:08.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbeeb000700 1 Processor -- start 2024-09-13T18:48:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbeeb000700 1 -- start start 2024-09-13T18:48:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbeeb000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee406be10 0x7fbee40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbeeb000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee406d000 con 0x7fbee4160fc0 2024-09-13T18:48:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbeeb000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee406c3f0 con 0x7fbee40cf0b0 2024-09-13T18:48:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbeeb000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40cf560 con 0x7fbee406be10 2024-09-13T18:48:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbee3e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbee4160fc0 0x7fbee40b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38786/0 (socket says 172.21.15.81:38786) 2024-09-13T18:48:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.509+0000 7fbee3e00700 1 -- 172.21.15.81:0/2818440447 learned_addr learned my addr 172.21.15.81:0/2818440447 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbedb400700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee406be10 0x7fbee40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534427735 0 0) 0x7fbee406d000 con 0x7fbee4160fc0 2024-09-13T18:48:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec80035d0 con 0x7fbee4160fc0 2024-09-13T18:48:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251017713 0 0) 0x7fbee406c3f0 con 0x7fbee40cf0b0 2024-09-13T18:48:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee406d000 con 0x7fbee40cf0b0 2024-09-13T18:48:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 742446918 0 0) 0x7fbec80035d0 con 0x7fbee4160fc0 2024-09-13T18:48:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee406be10 msgr2=0x7fbee40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee406be10 0x7fbee40ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 >> v1:172.21.15.178:6789/0 conn(0x7fbee40cf0b0 legacy=0x7fbee41618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee406c6d0 con 0x7fbee4160fc0 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fbed40019f0 con 0x7fbee4160fc0 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 >> v1:172.21.15.81:6789/0 conn(0x7fbee4160fc0 legacy=0x7fbee40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec8003be0 0x7fbec8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8004870 0x7fbec8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec8005230 0x7fbec800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40cf560 con 0x7fbec8003be0 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec800c020 con 0x7fbec8004870 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec800c1e0 con 0x7fbec8005230 2024-09-13T18:48:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec8003be0 0x7fbec8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee9000700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec8005230 0x7fbec800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbedb400700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8004870 0x7fbec8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 -- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec8005230 msgr2=0x7fbec800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec8005230 0x7fbec800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 -- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8004870 msgr2=0x7fbec8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8004870 0x7fbec8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 -- 172.21.15.81:0/2818440447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80035d0 con 0x7fbec8003be0 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3e00700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec8003be0 0x7fbec8003fe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbed400a7d0 tx=0x7fbec80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9bc7f7905e23ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40072d0 con 0x7fbec8003be0 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400ae90 con 0x7fbec8003be0 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.513+0000 7fbee3400700 1 -- 172.21.15.81:0/2818440447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4007670 con 0x7fbec8003be0 2024-09-13T18:48:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 -- 172.21.15.81:0/2818440447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec8003be0 msgr2=0x7fbec8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 --2- 172.21.15.81:0/2818440447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec8003be0 0x7fbec8003fe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbed400a7d0 tx=0x7fbec80058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbee9000700 1 -- 172.21.15.81:0/2818440447 reap_dead start 2024-09-13T18:48:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 -- 172.21.15.81:0/2818440447 shutdown_connections 2024-09-13T18:48:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 -- 172.21.15.81:0/2818440447 >> 172.21.15.81:0/2818440447 conn(0x7fbee406a570 msgr2=0x7fbee406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 -- 172.21.15.81:0/2818440447 shutdown_connections 2024-09-13T18:48:08.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 -- 172.21.15.81:0/2818440447 wait complete. 2024-09-13T18:48:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.517+0000 7fbeeb000700 1 Processor -- start 2024-09-13T18:48:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 -- start start 2024-09-13T18:48:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8003be0 0x7fbee41f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee40cd9d0 0x7fbee41636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 0x7fbee4163be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41f67f0 con 0x7fbee40cde10 2024-09-13T18:48:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40cbd20 con 0x7fbec8003be0 2024-09-13T18:48:08.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40cbfe0 con 0x7fbee40cd9d0 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 0x7fbee4163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 0x7fbee4163be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57978/0 (socket says 172.21.15.81:57978) 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 -- 172.21.15.81:0/3241232592 learned_addr learned my addr 172.21.15.81:0/3241232592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbedb400700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee40cd9d0 0x7fbee41636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee3e00700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8003be0 0x7fbee41f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 -- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee40cd9d0 msgr2=0x7fbee41636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee40cd9d0 0x7fbee41636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 -- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8003be0 msgr2=0x7fbee41f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8003be0 0x7fbee41f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 -- 172.21.15.81:0/3241232592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40cc2c0 con 0x7fbee40cde10 2024-09-13T18:48:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee9000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 0x7fbee4163be0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbee406b330 tx=0x7fbedc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0050d0 con 0x7fbee40cde10 2024-09-13T18:48:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc005250 con 0x7fbee40cde10 2024-09-13T18:48:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc006880 con 0x7fbee40cde10 2024-09-13T18:48:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee40cc5a0 con 0x7fbee40cde10 2024-09-13T18:48:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.521+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee40ccda0 con 0x7fbee40cde10 2024-09-13T18:48:08.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.525+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee40ccac0 con 0x7fbee40cde10 2024-09-13T18:48:08.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.525+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbedc006bf0 con 0x7fbee40cde10 2024-09-13T18:48:08.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.525+0000 7fbee0c00700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbec0066730 0x7fbec0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.529+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbedc083ee0 con 0x7fbee40cde10 2024-09-13T18:48:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.529+0000 7fbee3e00700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbec0066730 0x7fbec0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.529+0000 7fbee3e00700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbec0066730 0x7fbec0068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbed4001c30 tx=0x7fbed4009070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.529+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbee40ccac0 con 0x7fbee40cde10 2024-09-13T18:48:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.717+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbee40ccac0 con 0x7fbee40cde10 2024-09-13T18:48:08.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.717+0000 7fbee0c00700 1 -- 172.21.15.81:0/3241232592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbee40ccac0 con 0x7fbee40cde10 2024-09-13T18:48:08.730 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:08.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbec0066730 msgr2=0x7fbec0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbec0066730 0x7fbec0068bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbed4001c30 tx=0x7fbed4009070 comp rx=0 tx=0).stop 2024-09-13T18:48:08.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 msgr2=0x7fbee4163be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 0x7fbee4163be0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbee406b330 tx=0x7fbedc00e720 comp rx=0 tx=0).stop 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 shutdown_connections 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbec0066730 0x7fbec0068bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbee40cde10 0x7fbee4163be0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbee40cd9d0 0x7fbee41636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 --2- 172.21.15.81:0/3241232592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec8003be0 0x7fbee41f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 >> 172.21.15.81:0/3241232592 conn(0x7fbee406a570 msgr2=0x7fbee40b0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 shutdown_connections 2024-09-13T18:48:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.721+0000 7fbeeb000700 1 -- 172.21.15.81:0/3241232592 wait complete. 2024-09-13T18:48:08.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.921+0000 7f79b6000700 1 Processor -- start 2024-09-13T18:48:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.921+0000 7f79b6000700 1 -- start start 2024-09-13T18:48:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b6000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79b006c5a0 0x7f79b015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b6000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b00cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b6000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b00b4680 con 0x7f79b006c980 2024-09-13T18:48:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b6000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00b5dd0 con 0x7f79b006c5a0 2024-09-13T18:48:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b6000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00b4960 con 0x7f79b00cf830 2024-09-13T18:48:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b00cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b4c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79b006c5a0 0x7f79b015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b00cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:53236/0 (socket says 172.21.15.81:53236) 2024-09-13T18:48:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 -- 172.21.15.81:0/1091170032 learned_addr learned my addr 172.21.15.81:0/1091170032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 -- 172.21.15.81:0/1091170032 >> v2:172.21.15.178:3300/0 conn(0x7f79b006c5a0 msgr2=0x7f79b015aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 --2- 172.21.15.81:0/1091170032 >> v2:172.21.15.178:3300/0 conn(0x7f79b006c5a0 0x7f79b015aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 -- 172.21.15.81:0/1091170032 >> v1:172.21.15.178:6789/0 conn(0x7f79b006c980 legacy=0x7f79b00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b5600700 1 -- 172.21.15.81:0/1091170032 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00cf030 con 0x7f79b00cf830 2024-09-13T18:48:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.925+0000 7f79b4c00700 1 --2- 172.21.15.81:0/1091170032 >> v2:172.21.15.178:3300/0 conn(0x7f79b006c5a0 0x7f79b015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b5600700 1 --2- 172.21.15.81:0/1091170032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b00cfc40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009e50 tx=0x7f79a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15bea2bbd661964d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79af400700 1 -- 172.21.15.81:0/1091170032 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800e070 con 0x7f79b00cf830 2024-09-13T18:48:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79af400700 1 -- 172.21.15.81:0/1091170032 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a800b910 con 0x7f79b00cf830 2024-09-13T18:48:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79af400700 1 -- 172.21.15.81:0/1091170032 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a800bcc0 con 0x7f79b00cf830 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 -- 172.21.15.81:0/1091170032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 msgr2=0x7f79b00cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 --2- 172.21.15.81:0/1091170032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b00cfc40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009e50 tx=0x7f79a800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 -- 172.21.15.81:0/1091170032 shutdown_connections 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 --2- 172.21.15.81:0/1091170032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b00cfc40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 --2- 172.21.15.81:0/1091170032 >> v2:172.21.15.178:3300/0 conn(0x7f79b006c5a0 0x7f79b015aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 -- 172.21.15.81:0/1091170032 >> 172.21.15.81:0/1091170032 conn(0x7f79b0071d20 msgr2=0x7f79b0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 -- 172.21.15.81:0/1091170032 shutdown_connections 2024-09-13T18:48:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.929+0000 7f79b6000700 1 -- 172.21.15.81:0/1091170032 wait complete. 2024-09-13T18:48:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.933+0000 7f79b6000700 1 Processor -- start 2024-09-13T18:48:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.933+0000 7f79b6000700 1 -- start start 2024-09-13T18:48:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b006c5a0 0x7f79b00b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 0x7f79b00b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b0146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b0145a10 con 0x7f79b006c980 2024-09-13T18:48:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b0145cf0 con 0x7f79b006c5a0 2024-09-13T18:48:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b0145fd0 con 0x7f79b00cf830 2024-09-13T18:48:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 0x7f79b00b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 0x7f79b00b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57986/0 (socket says 172.21.15.81:57986) 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 -- 172.21.15.81:0/2191400145 learned_addr learned my addr 172.21.15.81:0/2191400145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b4c00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b006c5a0 0x7f79b00b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b5600700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b0146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 -- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 msgr2=0x7f79b0146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b0146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 -- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b006c5a0 msgr2=0x7f79b00b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b006c5a0 0x7f79b00b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 -- 172.21.15.81:0/2191400145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a40094b0 con 0x7f79b006c980 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79afe00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 0x7f79b00b5200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c500 tx=0x7f799c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0052d0 con 0x7f79b006c980 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c005430 con 0x7f79b006c980 2024-09-13T18:48:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0055a0 con 0x7f79b006c980 2024-09-13T18:48:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a8009b30 con 0x7f79b006c980 2024-09-13T18:48:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.937+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b0146590 con 0x7f79b006c980 2024-09-13T18:48:08.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.941+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b01467b0 con 0x7f79b006c980 2024-09-13T18:48:08.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.941+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f799c0038e0 con 0x7f79b006c980 2024-09-13T18:48:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.945+0000 7f79acc00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7990066730 0x7f7990068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.945+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f799c083950 con 0x7f79b006c980 2024-09-13T18:48:08.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.945+0000 7f79b4c00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7990066730 0x7f7990068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.945+0000 7f79b4c00700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7990066730 0x7f7990068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009d80 tx=0x7f79a4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:08.953+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f799c050870 con 0x7f79b006c980 2024-09-13T18:48:09.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.129+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79b00cec70 con 0x7f79b006c980 2024-09-13T18:48:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79acc00700 1 -- 172.21.15.81:0/2191400145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f799c053e90 con 0x7f79b006c980 2024-09-13T18:48:09.142 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:09.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7990066730 msgr2=0x7f7990068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7990066730 0x7f7990068bf0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009d80 tx=0x7f79a4009240 comp rx=0 tx=0).stop 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 msgr2=0x7f79b00b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 0x7f79b00b5200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c500 tx=0x7f799c00c810 comp rx=0 tx=0).stop 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 shutdown_connections 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7990066730 0x7f7990068bf0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79b00cf830 0x7f79b0146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79b006c980 0x7f79b00b5200 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 --2- 172.21.15.81:0/2191400145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79b006c5a0 0x7f79b00b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 >> 172.21.15.81:0/2191400145 conn(0x7f79b0071d20 msgr2=0x7f79b0159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 shutdown_connections 2024-09-13T18:48:09.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.133+0000 7f79b6000700 1 -- 172.21.15.81:0/2191400145 wait complete. 2024-09-13T18:48:09.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.337+0000 7f3274c00700 1 Processor -- start 2024-09-13T18:48:09.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.337+0000 7f3274c00700 1 -- start start 2024-09-13T18:48:09.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.337+0000 7f3274c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f327015e030 0x7f32700ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.337+0000 7f3274c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32700b57e0 con 0x7f32700cd140 2024-09-13T18:48:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.337+0000 7f3274c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32700b3b80 con 0x7f3270157500 2024-09-13T18:48:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.337+0000 7f3274c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32700b5a80 con 0x7f327015e030 2024-09-13T18:48:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326e800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f32700cd140 0x7f3270160ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38790/0 (socket says 172.21.15.81:38790) 2024-09-13T18:48:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326e800700 1 -- 172.21.15.81:0/3831872531 learned_addr learned my addr 172.21.15.81:0/3831872531 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:09.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326d400700 1 --2- 172.21.15.81:0/3831872531 >> v2:172.21.15.178:3300/0 conn(0x7f327015e030 0x7f32700ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617825716 0 0) 0x7f32700b57e0 con 0x7f32700cd140 2024-09-13T18:48:09.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32540035d0 con 0x7f32700cd140 2024-09-13T18:48:09.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797987230 0 0) 0x7f32700b3b80 con 0x7f3270157500 2024-09-13T18:48:09.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32700b57e0 con 0x7f3270157500 2024-09-13T18:48:09.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326d400700 1 -- 172.21.15.81:0/3831872531 >> v1:172.21.15.178:6789/0 conn(0x7f3270157500 legacy=0x7f3270070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326d400700 1 -- 172.21.15.81:0/3831872531 >> v1:172.21.15.81:6789/0 conn(0x7f32700cd140 legacy=0x7f3270160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326d400700 1 -- 172.21.15.81:0/3831872531 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700b5d60 con 0x7f327015e030 2024-09-13T18:48:09.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326d400700 1 --2- 172.21.15.81:0/3831872531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f327015e030 0x7f32700ce700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f325c009880 tx=0x7f325c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668a72907ca6c0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c011830 con 0x7f327015e030 2024-09-13T18:48:09.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325c011990 con 0x7f327015e030 2024-09-13T18:48:09.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f326ca00700 1 -- 172.21.15.81:0/3831872531 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325c011d20 con 0x7f327015e030 2024-09-13T18:48:09.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.341+0000 7f3274c00700 1 -- 172.21.15.81:0/3831872531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f327015e030 msgr2=0x7f32700ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 --2- 172.21.15.81:0/3831872531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f327015e030 0x7f32700ce700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f325c009880 tx=0x7f325c009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:09.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- 172.21.15.81:0/3831872531 shutdown_connections 2024-09-13T18:48:09.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 --2- 172.21.15.81:0/3831872531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f327015e030 0x7f32700ce700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- 172.21.15.81:0/3831872531 >> 172.21.15.81:0/3831872531 conn(0x7f327006e660 msgr2=0x7f327006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- 172.21.15.81:0/3831872531 shutdown_connections 2024-09-13T18:48:09.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- 172.21.15.81:0/3831872531 wait complete. 2024-09-13T18:48:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 Processor -- start 2024-09-13T18:48:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- start start 2024-09-13T18:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32700cd140 0x7f327014b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3270157500 0x7f32700ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 0x7f3270147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3270147b50 con 0x7f327015e030 2024-09-13T18:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327014a500 con 0x7f3270157500 2024-09-13T18:48:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.345+0000 7f3274c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32700cad40 con 0x7f32700cd140 2024-09-13T18:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 0x7f3270147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 0x7f3270147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57990/0 (socket says 172.21.15.81:57990) 2024-09-13T18:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 -- 172.21.15.81:0/4149305557 learned_addr learned my addr 172.21.15.81:0/4149305557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326de00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32700cd140 0x7f327014b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326d400700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3270157500 0x7f32700ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 -- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32700cd140 msgr2=0x7f327014b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32700cd140 0x7f327014b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 -- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3270157500 msgr2=0x7f32700ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3270157500 0x7f32700ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 -- 172.21.15.81:0/4149305557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c0094b0 con 0x7f327015e030 2024-09-13T18:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f326e800700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 0x7f3270147610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f326800cb40 tx=0x7f326800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268007500 con 0x7f327015e030 2024-09-13T18:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3268007680 con 0x7f327015e030 2024-09-13T18:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32700cb020 con 0x7f327015e030 2024-09-13T18:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3268007a30 con 0x7f327015e030 2024-09-13T18:48:09.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32700cb5e0 con 0x7f327015e030 2024-09-13T18:48:09.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.349+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32700ce700 con 0x7f327015e030 2024-09-13T18:48:09.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.353+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f326801b3b0 con 0x7f327015e030 2024-09-13T18:48:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.353+0000 7f3266000700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3250066730 0x7f3250068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.353+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3268083f30 con 0x7f327015e030 2024-09-13T18:48:09.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.353+0000 7f326de00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3250066730 0x7f3250068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.353+0000 7f326de00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3250066730 0x7f3250068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32600011e0 tx=0x7f3260009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.361+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3268050ed0 con 0x7f327015e030 2024-09-13T18:48:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.537+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3270070160 con 0x7f327015e030 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.537+0000 7f3266000700 1 -- 172.21.15.81:0/4149305557 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3268017020 con 0x7f327015e030 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3250066730 msgr2=0x7f3250068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3250066730 0x7f3250068bf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f32600011e0 tx=0x7f3260009040 comp rx=0 tx=0).stop 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 msgr2=0x7f3270147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 0x7f3270147610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f326800cb40 tx=0x7f326800cb70 comp rx=0 tx=0).stop 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 shutdown_connections 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3250066730 0x7f3250068bf0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f327015e030 0x7f3270147610 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3270157500 0x7f32700ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 --2- 172.21.15.81:0/4149305557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32700cd140 0x7f327014b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 >> 172.21.15.81:0/4149305557 conn(0x7f327006e660 msgr2=0x7f32700b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 shutdown_connections 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.541+0000 7f3274c00700 1 -- 172.21.15.81:0/4149305557 wait complete. 2024-09-13T18:48:09.585 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-13T18:48:09.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.737+0000 7f4f9ac00700 1 Processor -- start 2024-09-13T18:48:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.737+0000 7f4f9ac00700 1 -- start start 2024-09-13T18:48:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f9ac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f94159550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f9ac00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f94159a90 con 0x7f4f9413f210 2024-09-13T18:48:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f9ac00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f94159d20 con 0x7f4f9413edb0 2024-09-13T18:48:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f9ac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9413f680 con 0x7f4f9415cba0 2024-09-13T18:48:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f9a200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4f9413f210 0x7f4f94070740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38798/0 (socket says 172.21.15.81:38798) 2024-09-13T18:48:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f9a200700 1 -- 172.21.15.81:0/2558190449 learned_addr learned my addr 172.21.15.81:0/2558190449 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f99800700 1 --2- 172.21.15.81:0/2558190449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f94159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f93e00700 1 -- 172.21.15.81:0/2558190449 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745909106 0 0) 0x7f4f94159a90 con 0x7f4f9413f210 2024-09-13T18:48:09.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f93e00700 1 -- 172.21.15.81:0/2558190449 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c0034f0 con 0x7f4f9413f210 2024-09-13T18:48:09.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f99800700 1 -- 172.21.15.81:0/2558190449 >> v1:172.21.15.178:6789/0 conn(0x7f4f9413edb0 legacy=0x7f4f9413c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f93e00700 1 -- 172.21.15.81:0/2558190449 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4217034999 0 0) 0x7f4f94159d20 con 0x7f4f9413edb0 2024-09-13T18:48:09.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f99800700 1 -- 172.21.15.81:0/2558190449 >> v1:172.21.15.81:6789/0 conn(0x7f4f9413f210 legacy=0x7f4f94070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f99800700 1 -- 172.21.15.81:0/2558190449 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9415a000 con 0x7f4f9415cba0 2024-09-13T18:48:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.741+0000 7f4f99800700 1 --2- 172.21.15.81:0/2558190449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f94159550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009880 tx=0x7f4f88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7248538c0bdc897 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f93e00700 1 -- 172.21.15.81:0/2558190449 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88011830 con 0x7f4f9415cba0 2024-09-13T18:48:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f93e00700 1 -- 172.21.15.81:0/2558190449 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f88011990 con 0x7f4f9415cba0 2024-09-13T18:48:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f93e00700 1 -- 172.21.15.81:0/2558190449 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88011d20 con 0x7f4f9415cba0 2024-09-13T18:48:09.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 -- 172.21.15.81:0/2558190449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 msgr2=0x7f4f94159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/2558190449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f94159550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4f88009880 tx=0x7f4f88009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 -- 172.21.15.81:0/2558190449 shutdown_connections 2024-09-13T18:48:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/2558190449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f94159550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 -- 172.21.15.81:0/2558190449 >> 172.21.15.81:0/2558190449 conn(0x7f4f9406a390 msgr2=0x7f4f9406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 -- 172.21.15.81:0/2558190449 shutdown_connections 2024-09-13T18:48:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.745+0000 7f4f9ac00700 1 -- 172.21.15.81:0/2558190449 wait complete. 2024-09-13T18:48:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 Processor -- start 2024-09-13T18:48:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 -- start start 2024-09-13T18:48:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f9413edb0 0x7f4f9415bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 0x7f4f9413bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f940b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9413c120 con 0x7f4f9413f210 2024-09-13T18:48:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415aa70 con 0x7f4f9413edb0 2024-09-13T18:48:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415ad50 con 0x7f4f9415cba0 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 0x7f4f9413bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 0x7f4f9413bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58002/0 (socket says 172.21.15.81:58002) 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 -- 172.21.15.81:0/4025301781 learned_addr learned my addr 172.21.15.81:0/4025301781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9a200700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f940b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f99800700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f9413edb0 0x7f4f9415bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 -- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 msgr2=0x7f4f940b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f940b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 -- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f9413edb0 msgr2=0x7f4f9415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f9413edb0 0x7f4f9415bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 -- 172.21.15.81:0/4025301781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880094b0 con 0x7f4f9413f210 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f98e00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 0x7f4f9413bbe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f800011e0 tx=0x7f4f8000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800054e0 con 0x7f4f9413f210 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f800036a0 con 0x7f4f9413f210 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80003a50 con 0x7f4f9413f210 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9415b030 con 0x7f4f9413f210 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.749+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9415b5f0 con 0x7f4f9413f210 2024-09-13T18:48:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.753+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9415b7e0 con 0x7f4f9413f210 2024-09-13T18:48:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.753+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f80003bb0 con 0x7f4f9413f210 2024-09-13T18:48:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.757+0000 7f4f91600700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f74066730 0x7f4f74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.757+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4f800839c0 con 0x7f4f9413f210 2024-09-13T18:48:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.757+0000 7f4f99800700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f74066730 0x7f4f74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.757+0000 7f4f99800700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f74066730 0x7f4f74068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f880090b0 tx=0x7f4f8801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.765+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4f80050960 con 0x7f4f9413f210 2024-09-13T18:48:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.965+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f94159550 con 0x7f4f9413f210 2024-09-13T18:48:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.969+0000 7f4f91600700 1 -- 172.21.15.81:0/4025301781 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f4f80003e60 con 0x7f4f9413f210 2024-09-13T18:48:09.979 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:09.979 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.969+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f74066730 msgr2=0x7f4f74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.969+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f74066730 0x7f4f74068bf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f880090b0 tx=0x7f4f8801c040 comp rx=0 tx=0).stop 2024-09-13T18:48:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 msgr2=0x7f4f9413bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 0x7f4f9413bbe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f800011e0 tx=0x7f4f8000ca30 comp rx=0 tx=0).stop 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 shutdown_connections 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f74066730 0x7f4f74068bf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f9415cba0 0x7f4f940b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f9413f210 0x7f4f9413bbe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 --2- 172.21.15.81:0/4025301781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f9413edb0 0x7f4f9415bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 >> 172.21.15.81:0/4025301781 conn(0x7f4f9406a390 msgr2=0x7f4f9413e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 shutdown_connections 2024-09-13T18:48:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:09.973+0000 7f4f9ac00700 1 -- 172.21.15.81:0/4025301781 wait complete. 2024-09-13T18:48:10.002 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:10.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.169+0000 7f2ca6400700 1 Processor -- start 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.169+0000 7f2ca6400700 1 -- start start 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2ca6400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00ce280 0x7f2ca00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2ca6400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ca015a880 0x7f2ca0070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2ca6400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca00cf640 con 0x7f2ca00cf1e0 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2ca6400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca015acb0 con 0x7f2ca015a880 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2ca6400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca015e420 con 0x7f2ca00ce280 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ca015a880 0x7f2ca0070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ca015a880 0x7f2ca0070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58006/0 (socket says 172.21.15.81:58006) 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 -- 172.21.15.81:0/2287111875 learned_addr learned my addr 172.21.15.81:0/2287111875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c97e00700 1 --1- 172.21.15.81:0/2287111875 >> v1:172.21.15.81:6789/0 conn(0x7f2ca00cf1e0 0x7f2ca015a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38806/0 (socket says 172.21.15.81:38806) 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9f400700 1 --2- 172.21.15.81:0/2287111875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00ce280 0x7f2ca00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 -- 172.21.15.81:0/2287111875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00ce280 msgr2=0x7f2ca00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 --2- 172.21.15.81:0/2287111875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00ce280 0x7f2ca00ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 -- 172.21.15.81:0/2287111875 >> v1:172.21.15.81:6789/0 conn(0x7f2ca00cf1e0 legacy=0x7f2ca015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 -- 172.21.15.81:0/2287111875 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca015df90 con 0x7f2ca015a880 2024-09-13T18:48:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.173+0000 7f2c9fe00700 1 --2- 172.21.15.81:0/2287111875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca015a880 0x7f2ca0070ca0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009e50 tx=0x7f2c9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f791d39f2f878e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2c9ea00700 1 -- 172.21.15.81:0/2287111875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800e070 con 0x7f2ca015a880 2024-09-13T18:48:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2c9ea00700 1 -- 172.21.15.81:0/2287111875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800b910 con 0x7f2ca015a880 2024-09-13T18:48:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2c9ea00700 1 -- 172.21.15.81:0/2287111875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800bcc0 con 0x7f2ca015a880 2024-09-13T18:48:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 -- 172.21.15.81:0/2287111875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca015a880 msgr2=0x7f2ca0070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 --2- 172.21.15.81:0/2287111875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca015a880 0x7f2ca0070ca0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c98009e50 tx=0x7f2c9800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 -- 172.21.15.81:0/2287111875 shutdown_connections 2024-09-13T18:48:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 --2- 172.21.15.81:0/2287111875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca015a880 0x7f2ca0070ca0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 --2- 172.21.15.81:0/2287111875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00ce280 0x7f2ca00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 -- 172.21.15.81:0/2287111875 >> 172.21.15.81:0/2287111875 conn(0x7f2ca006a570 msgr2=0x7f2ca006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 -- 172.21.15.81:0/2287111875 shutdown_connections 2024-09-13T18:48:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.177+0000 7f2ca6400700 1 -- 172.21.15.81:0/2287111875 wait complete. 2024-09-13T18:48:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 Processor -- start 2024-09-13T18:48:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 -- start start 2024-09-13T18:48:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 0x7f2ca00cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00cf1e0 0x7f2ca0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca015a880 0x7f2ca014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0151a20 con 0x7f2ca00ce280 2024-09-13T18:48:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0151d00 con 0x7f2ca015a880 2024-09-13T18:48:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2ca6400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca0151fe0 con 0x7f2ca00cf1e0 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 0x7f2ca00cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 0x7f2ca00cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58018/0 (socket says 172.21.15.81:58018) 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 -- 172.21.15.81:0/495600621 learned_addr learned my addr 172.21.15.81:0/495600621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9fe00700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca015a880 0x7f2ca014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c97e00700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00cf1e0 0x7f2ca0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 -- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00cf1e0 msgr2=0x7f2ca0150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00cf1e0 0x7f2ca0150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 -- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca015a880 msgr2=0x7f2ca014da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca015a880 0x7f2ca014da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 -- 172.21.15.81:0/495600621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c98009b30 con 0x7f2ca00ce280 2024-09-13T18:48:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9fe00700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca015a880 0x7f2ca014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.181+0000 7f2c9f400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 0x7f2ca00cc1c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000e840 tx=0x7f2c9000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.185+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900095a0 con 0x7f2ca00ce280 2024-09-13T18:48:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.185+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000c690 con 0x7f2ca00ce280 2024-09-13T18:48:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.185+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca01522c0 con 0x7f2ca00ce280 2024-09-13T18:48:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.185+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000ca00 con 0x7f2ca00ce280 2024-09-13T18:48:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.185+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca014bf10 con 0x7f2ca00ce280 2024-09-13T18:48:10.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.185+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca00ce660 con 0x7f2ca00ce280 2024-09-13T18:48:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.189+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c9000cb60 con 0x7f2ca00ce280 2024-09-13T18:48:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.189+0000 7f2c97400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c7c066730 0x7f2c7c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.189+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2c90084610 con 0x7f2ca00ce280 2024-09-13T18:48:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.189+0000 7f2c97e00700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c7c066730 0x7f2c7c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.189+0000 7f2c97e00700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c7c066730 0x7f2c7c068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00cd6b0 tx=0x7f2c88007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.197+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c90051520 con 0x7f2ca00ce280 2024-09-13T18:48:10.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.381+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ca0164470 con 0x7f2ca00ce280 2024-09-13T18:48:10.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.381+0000 7f2c97400700 1 -- 172.21.15.81:0/495600621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c90054b40 con 0x7f2ca00ce280 2024-09-13T18:48:10.391 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:10.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c7c066730 msgr2=0x7f2c7c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c7c066730 0x7f2c7c068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00cd6b0 tx=0x7f2c88007d30 comp rx=0 tx=0).stop 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 msgr2=0x7f2ca00cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 0x7f2ca00cc1c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000e840 tx=0x7f2c9000ec00 comp rx=0 tx=0).stop 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 shutdown_connections 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c7c066730 0x7f2c7c068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ca015a880 0x7f2ca014da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ca00cf1e0 0x7f2ca0150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 --2- 172.21.15.81:0/495600621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca00ce280 0x7f2ca00cc1c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 >> 172.21.15.81:0/495600621 conn(0x7f2ca006a570 msgr2=0x7f2ca015b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 shutdown_connections 2024-09-13T18:48:10.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.385+0000 7f2ca6400700 1 -- 172.21.15.81:0/495600621 wait complete. 2024-09-13T18:48:10.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.625+0000 7f934e000700 1 Processor -- start 2024-09-13T18:48:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.625+0000 7f934e000700 1 -- start start 2024-09-13T18:48:10.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f934e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93480ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f934e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93480cf1e0 0x7f934815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f934e000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93480cf640 con 0x7f934815a6b0 2024-09-13T18:48:10.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f934e000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934815e420 con 0x7f93480cf1e0 2024-09-13T18:48:10.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f934e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934815df90 con 0x7f93480ce280 2024-09-13T18:48:10.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9346a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93480cf1e0 0x7f934815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9347400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93480ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9346a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93480cf1e0 0x7f934815a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58022/0 (socket says 172.21.15.81:58022) 2024-09-13T18:48:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9346a00700 1 -- 172.21.15.81:0/3085375699 learned_addr learned my addr 172.21.15.81:0/3085375699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9347400700 1 -- 172.21.15.81:0/3085375699 >> v2:172.21.15.81:3300/0 conn(0x7f93480cf1e0 msgr2=0x7f934815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9347400700 1 --2- 172.21.15.81:0/3085375699 >> v2:172.21.15.81:3300/0 conn(0x7f93480cf1e0 0x7f934815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9347400700 1 -- 172.21.15.81:0/3085375699 >> v1:172.21.15.178:6789/0 conn(0x7f934815a6b0 legacy=0x7f93480b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.629+0000 7f9347400700 1 -- 172.21.15.81:0/3085375699 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934815aea0 con 0x7f93480ce280 2024-09-13T18:48:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f9347400700 1 --2- 172.21.15.81:0/3085375699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93480ceca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f933800baf0 tx=0x7f933800be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa19c75e5c7bb87d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f9346000700 1 -- 172.21.15.81:0/3085375699 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800dc70 con 0x7f93480ce280 2024-09-13T18:48:10.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f9346000700 1 -- 172.21.15.81:0/3085375699 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800ddd0 con 0x7f93480ce280 2024-09-13T18:48:10.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f9346000700 1 -- 172.21.15.81:0/3085375699 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338010690 con 0x7f93480ce280 2024-09-13T18:48:10.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 -- 172.21.15.81:0/3085375699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 msgr2=0x7f93480ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 --2- 172.21.15.81:0/3085375699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93480ceca0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f933800baf0 tx=0x7f933800be00 comp rx=0 tx=0).stop 2024-09-13T18:48:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 -- 172.21.15.81:0/3085375699 shutdown_connections 2024-09-13T18:48:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 --2- 172.21.15.81:0/3085375699 >> v2:172.21.15.81:3300/0 conn(0x7f93480cf1e0 0x7f934815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 --2- 172.21.15.81:0/3085375699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93480ceca0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 -- 172.21.15.81:0/3085375699 >> 172.21.15.81:0/3085375699 conn(0x7f934806a570 msgr2=0x7f934806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 -- 172.21.15.81:0/3085375699 shutdown_connections 2024-09-13T18:48:10.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.633+0000 7f934e000700 1 -- 172.21.15.81:0/3085375699 wait complete. 2024-09-13T18:48:10.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.637+0000 7f934e000700 1 Processor -- start 2024-09-13T18:48:10.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.637+0000 7f934e000700 1 -- start start 2024-09-13T18:48:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93481ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 0x7f934814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f934815a6b0 0x7f934814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348151150 con 0x7f93480cf1e0 2024-09-13T18:48:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348151430 con 0x7f934815a6b0 2024-09-13T18:48:10.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9348151710 con 0x7f93480ce280 2024-09-13T18:48:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 0x7f934814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 0x7f934814bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58026/0 (socket says 172.21.15.81:58026) 2024-09-13T18:48:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 -- 172.21.15.81:0/1721296250 learned_addr learned my addr 172.21.15.81:0/1721296250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9347e00700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f934815a6b0 0x7f934814e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9347400700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93481ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 -- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 msgr2=0x7f93481ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93481ee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 -- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f934815a6b0 msgr2=0x7f934814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f934815a6b0 0x7f934814e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 -- 172.21.15.81:0/1721296250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933800b750 con 0x7f93480cf1e0 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9347e00700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f934815a6b0 0x7f934814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f9346a00700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 0x7f934814bdc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f933400e930 tx=0x7f933400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93340096c0 con 0x7f93480cf1e0 2024-09-13T18:48:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933400c850 con 0x7f93480cf1e0 2024-09-13T18:48:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400cc00 con 0x7f93480cf1e0 2024-09-13T18:48:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93481519f0 con 0x7f93480cf1e0 2024-09-13T18:48:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93481eea10 con 0x7f93480cf1e0 2024-09-13T18:48:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.641+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934815aae0 con 0x7f93480cf1e0 2024-09-13T18:48:10.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.645+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f933400cd60 con 0x7f93480cf1e0 2024-09-13T18:48:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.649+0000 7f933f400700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9328066730 0x7f9328068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.649+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9334084610 con 0x7f93480cf1e0 2024-09-13T18:48:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.649+0000 7f9347400700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9328066730 0x7f9328068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.649+0000 7f9347400700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9328066730 0x7f9328068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f933800bfd0 tx=0x7f9338013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.653+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9334051520 con 0x7f93480cf1e0 2024-09-13T18:48:10.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.841+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93480730c0 con 0x7f93480cf1e0 2024-09-13T18:48:10.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f933f400700 1 -- 172.21.15.81:0/1721296250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9334054b40 con 0x7f93480cf1e0 2024-09-13T18:48:10.854 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9328066730 msgr2=0x7f9328068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9328066730 0x7f9328068bf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f933800bfd0 tx=0x7f9338013000 comp rx=0 tx=0).stop 2024-09-13T18:48:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 msgr2=0x7f934814bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 0x7f934814bdc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f933400e930 tx=0x7f933400ecf0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 shutdown_connections 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9328066730 0x7f9328068bf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f934815a6b0 0x7f934814e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93480cf1e0 0x7f934814bdc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 --2- 172.21.15.81:0/1721296250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93480ce280 0x7f93481ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 >> 172.21.15.81:0/1721296250 conn(0x7f934806a570 msgr2=0x7f93480b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 shutdown_connections 2024-09-13T18:48:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:10.845+0000 7f934e000700 1 -- 172.21.15.81:0/1721296250 wait complete. 2024-09-13T18:48:10.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:11.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 Processor -- start 2024-09-13T18:48:11.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 -- start start 2024-09-13T18:48:11.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f390415b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3904071a20 0x7f3904071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390415b400 con 0x7f390415bdd0 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3904072410 con 0x7f3904071a20 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.037+0000 7f390a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390406ce10 con 0x7f390415a970 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3903e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f390415bdd0 0x7f390406bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38822/0 (socket says 172.21.15.81:38822) 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3903e00700 1 -- 172.21.15.81:0/3079648718 learned_addr learned my addr 172.21.15.81:0/3079648718 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:11.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3909800700 1 --2- 172.21.15.81:0/3079648718 >> v2:172.21.15.81:3300/0 conn(0x7f3904071a20 0x7f3904071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3908e00700 1 --2- 172.21.15.81:0/3079648718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f390415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3909800700 1 -- 172.21.15.81:0/3079648718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 msgr2=0x7f390415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3909800700 1 --2- 172.21.15.81:0/3079648718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f390415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3909800700 1 -- 172.21.15.81:0/3079648718 >> v1:172.21.15.81:6789/0 conn(0x7f390415bdd0 legacy=0x7f390406bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3909800700 1 -- 172.21.15.81:0/3079648718 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390415b0d0 con 0x7f3904071a20 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3903400700 1 -- 172.21.15.81:0/3079648718 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151143388 0 0) 0x7f390415b400 con 0x7f390415bdd0 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3909800700 1 --2- 172.21.15.81:0/3079648718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f3904071ed0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009dc0 tx=0x7f38fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e48fd167ad987f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3903400700 1 -- 172.21.15.81:0/3079648718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00e070 con 0x7f3904071a20 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3903400700 1 -- 172.21.15.81:0/3079648718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc00bae0 con 0x7f3904071a20 2024-09-13T18:48:11.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f3903400700 1 -- 172.21.15.81:0/3079648718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc00be90 con 0x7f3904071a20 2024-09-13T18:48:11.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 -- 172.21.15.81:0/3079648718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 msgr2=0x7f3904071ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 --2- 172.21.15.81:0/3079648718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f3904071ed0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f38fc009dc0 tx=0x7f38fc00b330 comp rx=0 tx=0).stop 2024-09-13T18:48:11.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 -- 172.21.15.81:0/3079648718 shutdown_connections 2024-09-13T18:48:11.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 --2- 172.21.15.81:0/3079648718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f3904071ed0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 --2- 172.21.15.81:0/3079648718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f390415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 -- 172.21.15.81:0/3079648718 >> 172.21.15.81:0/3079648718 conn(0x7f390406a390 msgr2=0x7f390406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 -- 172.21.15.81:0/3079648718 shutdown_connections 2024-09-13T18:48:11.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.041+0000 7f390a200700 1 -- 172.21.15.81:0/3079648718 wait complete. 2024-09-13T18:48:11.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 Processor -- start 2024-09-13T18:48:11.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 -- start start 2024-09-13T18:48:11.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f390415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f39041f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390415bdd0 0x7f39041f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390415dd40 con 0x7f3904071a20 2024-09-13T18:48:11.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390415d130 con 0x7f390415bdd0 2024-09-13T18:48:11.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f390a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390415d410 con 0x7f390415a970 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.045+0000 7f3908e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f390415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f390415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58042/0 (socket says 172.21.15.81:58042) 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 -- 172.21.15.81:0/3698451901 learned_addr learned my addr 172.21.15.81:0/3698451901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3903e00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f39041f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3909800700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390415bdd0 0x7f39041f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 -- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 msgr2=0x7f39041f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f39041f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 -- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390415bdd0 msgr2=0x7f39041f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390415bdd0 0x7f39041f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 -- 172.21.15.81:0/3698451901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009a70 con 0x7f3904071a20 2024-09-13T18:48:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3908e00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f390415eb40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e9d0 tx=0x7f38f800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8009720 con 0x7f3904071a20 2024-09-13T18:48:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f800ee70 con 0x7f3904071a20 2024-09-13T18:48:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800ca50 con 0x7f3904071a20 2024-09-13T18:48:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390415d6f0 con 0x7f3904071a20 2024-09-13T18:48:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390415cdc0 con 0x7f3904071a20 2024-09-13T18:48:11.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.049+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3904071800 con 0x7f3904071a20 2024-09-13T18:48:11.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.053+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38f800cbb0 con 0x7f3904071a20 2024-09-13T18:48:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.053+0000 7f3900c00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38e4066730 0x7f38e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.053+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f38f8084580 con 0x7f3904071a20 2024-09-13T18:48:11.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.053+0000 7f3903e00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38e4066730 0x7f38e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.057+0000 7f3903e00700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38e4066730 0x7f38e4068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f390406c1f0 tx=0x7f38f0007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.061+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38f8051520 con 0x7f3904071a20 2024-09-13T18:48:11.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.261+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39040cacd0 con 0x7f3904071a20 2024-09-13T18:48:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.261+0000 7f3900c00700 1 -- 172.21.15.81:0/3698451901 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38f800ce60 con 0x7f3904071a20 2024-09-13T18:48:11.273 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38e4066730 msgr2=0x7f38e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38e4066730 0x7f38e4068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f390406c1f0 tx=0x7f38f0007e90 comp rx=0 tx=0).stop 2024-09-13T18:48:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 msgr2=0x7f390415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f390415eb40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f38f800e9d0 tx=0x7f38f800ece0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 shutdown_connections 2024-09-13T18:48:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38e4066730 0x7f38e4068bf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f390415bdd0 0x7f39041f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f390415a970 0x7f39041f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 --2- 172.21.15.81:0/3698451901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3904071a20 0x7f390415eb40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 >> 172.21.15.81:0/3698451901 conn(0x7f390406a390 msgr2=0x7f39040adb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 shutdown_connections 2024-09-13T18:48:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.265+0000 7f390a200700 1 -- 172.21.15.81:0/3698451901 wait complete. 2024-09-13T18:48:11.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:11.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.457+0000 7f6454e00700 1 Processor -- start 2024-09-13T18:48:11.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.457+0000 7f6454e00700 1 -- start start 2024-09-13T18:48:11.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f6454e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f6454e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f645015d720 0x7f6450071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f6454e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645015a240 con 0x7f64500cb220 2024-09-13T18:48:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f6454e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645015dce0 con 0x7f645015d720 2024-09-13T18:48:11.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f6454e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645015a6d0 con 0x7f645006dd90 2024-09-13T18:48:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f645015d720 0x7f6450071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644ea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f64500cb220 0x7f64500b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38834/0 (socket says 172.21.15.81:38834) 2024-09-13T18:48:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644ea00700 1 -- 172.21.15.81:0/1103068780 learned_addr learned my addr 172.21.15.81:0/1103068780 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:11.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644f400700 1 --2- 172.21.15.81:0/1103068780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644e000700 1 -- 172.21.15.81:0/1103068780 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305285112 0 0) 0x7f645015a240 con 0x7f64500cb220 2024-09-13T18:48:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644fe00700 1 -- 172.21.15.81:0/1103068780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 msgr2=0x7f64500718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644fe00700 1 --2- 172.21.15.81:0/1103068780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644fe00700 1 -- 172.21.15.81:0/1103068780 >> v1:172.21.15.81:6789/0 conn(0x7f64500cb220 legacy=0x7f64500b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644fe00700 1 -- 172.21.15.81:0/1103068780 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450159910 con 0x7f645015d720 2024-09-13T18:48:11.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644fe00700 1 --2- 172.21.15.81:0/1103068780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f6450071e30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6448009d90 tx=0x7f644800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=272644bfe63ecaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644e000700 1 -- 172.21.15.81:0/1103068780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644800e070 con 0x7f645015d720 2024-09-13T18:48:11.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644e000700 1 -- 172.21.15.81:0/1103068780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644800bb20 con 0x7f645015d720 2024-09-13T18:48:11.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.461+0000 7f644e000700 1 -- 172.21.15.81:0/1103068780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448012430 con 0x7f645015d720 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 -- 172.21.15.81:0/1103068780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 msgr2=0x7f6450071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 --2- 172.21.15.81:0/1103068780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f6450071e30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6448009d90 tx=0x7f644800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 -- 172.21.15.81:0/1103068780 shutdown_connections 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 --2- 172.21.15.81:0/1103068780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f6450071e30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 --2- 172.21.15.81:0/1103068780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 -- 172.21.15.81:0/1103068780 >> 172.21.15.81:0/1103068780 conn(0x7f64500b4770 msgr2=0x7f64500b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 -- 172.21.15.81:0/1103068780 shutdown_connections 2024-09-13T18:48:11.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 -- 172.21.15.81:0/1103068780 wait complete. 2024-09-13T18:48:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 Processor -- start 2024-09-13T18:48:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.465+0000 7f6454e00700 1 -- start start 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64500cb220 0x7f645014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f645014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645013d600 con 0x7f645015d720 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64500b0790 con 0x7f64500cb220 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6450150780 con 0x7f645006dd90 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f645014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f645014ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58064/0 (socket says 172.21.15.81:58064) 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 -- 172.21.15.81:0/1344206594 learned_addr learned my addr 172.21.15.81:0/1344206594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644ea00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64500cb220 0x7f645014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644f400700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 -- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 msgr2=0x7f64500b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 -- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64500cb220 msgr2=0x7f645014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64500cb220 0x7f645014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 -- 172.21.15.81:0/1344206594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448009a70 con 0x7f645015d720 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644ea00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64500cb220 0x7f645014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f644fe00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f645014ebe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64500b4720 tx=0x7f6448004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448012430 con 0x7f645015d720 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6448020070 con 0x7f645015d720 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6450150a60 con 0x7f645015d720 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448004240 con 0x7f645015d720 2024-09-13T18:48:11.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.469+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6450151020 con 0x7f645015d720 2024-09-13T18:48:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.473+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645006e170 con 0x7f645015d720 2024-09-13T18:48:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.473+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64480043a0 con 0x7f645015d720 2024-09-13T18:48:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.473+0000 7f6447400700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6430066730 0x7f6430068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.473+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6448022070 con 0x7f645015d720 2024-09-13T18:48:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.473+0000 7f644f400700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6430066730 0x7f6430068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.477+0000 7f644f400700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6430066730 0x7f6430068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6440009b50 tx=0x7f6440009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.481+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6448053630 con 0x7f645015d720 2024-09-13T18:48:11.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.677+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6450070b80 con 0x7f645015d720 2024-09-13T18:48:11.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.677+0000 7f6447400700 1 -- 172.21.15.81:0/1344206594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f644801ae60 con 0x7f645015d720 2024-09-13T18:48:11.687 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6430066730 msgr2=0x7f6430068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6430066730 0x7f6430068bf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6440009b50 tx=0x7f6440009240 comp rx=0 tx=0).stop 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 msgr2=0x7f645014ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f645014ebe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f64500b4720 tx=0x7f6448004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 shutdown_connections 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6430066730 0x7f6430068bf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f645015d720 0x7f645014ebe0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64500cb220 0x7f645014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 --2- 172.21.15.81:0/1344206594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f645006dd90 0x7f64500b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 >> 172.21.15.81:0/1344206594 conn(0x7f64500b4770 msgr2=0x7f645015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 shutdown_connections 2024-09-13T18:48:11.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.681+0000 7f6454e00700 1 -- 172.21.15.81:0/1344206594 wait complete. 2024-09-13T18:48:11.711 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2024-09-13T18:48:11.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.869+0000 7f4d71a00700 1 Processor -- start 2024-09-13T18:48:11.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.869+0000 7f4d71a00700 1 -- start start 2024-09-13T18:48:11.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.869+0000 7f4d71a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.869+0000 7f4d71a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c0b3560 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.869+0000 7f4d71a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c0b3280 con 0x7f4d6c1610b0 2024-09-13T18:48:11.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.869+0000 7f4d71a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c070b30 con 0x7f4d6c0b2d80 2024-09-13T18:48:11.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d63400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4d6c06aaa0 0x7f4d6c0b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38836/0 (socket says 172.21.15.81:38836) 2024-09-13T18:48:11.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d63400700 1 -- 172.21.15.81:0/3644287829 learned_addr learned my addr 172.21.15.81:0/3644287829 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:11.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71000700 1 --2- 172.21.15.81:0/3644287829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937518358 0 0) 0x7f4d6c0b3560 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d500035d0 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168329608 0 0) 0x7f4d6c0b3280 con 0x7f4d6c1610b0 2024-09-13T18:48:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d6c0b3560 con 0x7f4d6c1610b0 2024-09-13T18:48:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71000700 1 -- 172.21.15.81:0/3644287829 >> v1:172.21.15.178:6789/0 conn(0x7f4d6c1610b0 legacy=0x7f4d6c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71000700 1 -- 172.21.15.81:0/3644287829 >> v1:172.21.15.81:6789/0 conn(0x7f4d6c06aaa0 legacy=0x7f4d6c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71000700 1 -- 172.21.15.81:0/3644287829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c070ee0 con 0x7f4d6c0b2d80 2024-09-13T18:48:11.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71000700 1 --2- 172.21.15.81:0/3644287829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c06af10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009df0 tx=0x7f4d6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f99f9b1dd48702dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400e070 con 0x7f4d6c0b2d80 2024-09-13T18:48:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6400bae0 con 0x7f4d6c0b2d80 2024-09-13T18:48:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d6b400700 1 -- 172.21.15.81:0/3644287829 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400be50 con 0x7f4d6c0b2d80 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71a00700 1 -- 172.21.15.81:0/3644287829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 msgr2=0x7f4d6c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.873+0000 7f4d71a00700 1 --2- 172.21.15.81:0/3644287829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c06af10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009df0 tx=0x7f4d6400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 -- 172.21.15.81:0/3644287829 shutdown_connections 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 --2- 172.21.15.81:0/3644287829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c06af10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 -- 172.21.15.81:0/3644287829 >> 172.21.15.81:0/3644287829 conn(0x7f4d6c0b0c40 msgr2=0x7f4d6c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 -- 172.21.15.81:0/3644287829 shutdown_connections 2024-09-13T18:48:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 -- 172.21.15.81:0/3644287829 wait complete. 2024-09-13T18:48:11.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 Processor -- start 2024-09-13T18:48:11.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.877+0000 7f4d71a00700 1 -- start start 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 0x7f4d6c157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d6c1610b0 0x7f4d6c163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c154e90 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c162700 con 0x7f4d6c1610b0 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c1629d0 con 0x7f4d6c0b2d80 2024-09-13T18:48:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 0x7f4d6c157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 0x7f4d6c157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58066/0 (socket says 172.21.15.81:58066) 2024-09-13T18:48:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 -- 172.21.15.81:0/4109738038 learned_addr learned my addr 172.21.15.81:0/4109738038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71000700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d6c1610b0 0x7f4d6c163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d63400700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 -- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 msgr2=0x7f4d6c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c1621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 -- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d6c1610b0 msgr2=0x7f4d6c163ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d6c1610b0 0x7f4d6c163ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 -- 172.21.15.81:0/4109738038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009a70 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71000700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d6c1610b0 0x7f4d6c163ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d63400700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d6be00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 0x7f4d6c157470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c490 tx=0x7f4d5c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0052d0 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c162cb0 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c005450 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0038e0 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.881+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c1550e0 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.885+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c06af10 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.885+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d5c003a40 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.889+0000 7f4d68c00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d48066730 0x7f4d48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.889+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d5c083ac0 con 0x7f4d6c06aaa0 2024-09-13T18:48:11.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.889+0000 7f4d63400700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d48066730 0x7f4d48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.889+0000 7f4d63400700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d48066730 0x7f4d48068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06c350 tx=0x7f4d54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:11.893+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4d5c0509f0 con 0x7f4d6c06aaa0 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:12.141+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) v1 -- 0x7f4d6c06c0a0 con 0x7f4d6c06aaa0 2024-09-13T18:48:12.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:12.531 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:13.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.145+0000 7f4d68c00700 1 -- 172.21.15.81:0/4109738038 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v76) v1 ==== 139+0+0 (secure 0 0 0) 0x7f4d5c054010 con 0x7f4d6c06aaa0 2024-09-13T18:48:13.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d48066730 msgr2=0x7f4d48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d48066730 0x7f4d48068bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c06c350 tx=0x7f4d54009040 comp rx=0 tx=0).stop 2024-09-13T18:48:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 msgr2=0x7f4d6c157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 0x7f4d6c157470 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00c490 tx=0x7f4d5c00c850 comp rx=0 tx=0).stop 2024-09-13T18:48:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 shutdown_connections 2024-09-13T18:48:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d48066730 0x7f4d48068bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d6c1610b0 0x7f4d6c163ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d6c0b2d80 0x7f4d6c1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 --2- 172.21.15.81:0/4109738038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d6c06aaa0 0x7f4d6c157470 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 >> 172.21.15.81:0/4109738038 conn(0x7f4d6c0b0c40 msgr2=0x7f4d6c0b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 shutdown_connections 2024-09-13T18:48:13.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.153+0000 7f4d71a00700 1 -- 172.21.15.81:0/4109738038 wait complete. 2024-09-13T18:48:13.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:48:13.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 Processor -- start 2024-09-13T18:48:13.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 -- start start 2024-09-13T18:48:13.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 0x7fe4d815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d8161510 con 0x7fe4d80b1e20 2024-09-13T18:48:13.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d806bd50 con 0x7fe4d806b730 2024-09-13T18:48:13.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.349+0000 7fe4d7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d80b2290 con 0x7fe4d80cef60 2024-09-13T18:48:13.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d6800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 0x7fe4d815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d6800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 0x7fe4d815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:60280/0 (socket says 172.21.15.81:60280) 2024-09-13T18:48:13.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d6800700 1 -- 172.21.15.81:0/3502360429 learned_addr learned my addr 172.21.15.81:0/3502360429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:13.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d5e00700 1 -- 172.21.15.81:0/3502360429 >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 msgr2=0x7fe4d815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:13.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d5e00700 1 --2- 172.21.15.81:0/3502360429 >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 0x7fe4d815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d5e00700 1 -- 172.21.15.81:0/3502360429 >> v1:172.21.15.178:6789/0 conn(0x7fe4d80b1e20 legacy=0x7fe4d806b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d5e00700 1 -- 172.21.15.81:0/3502360429 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8153ee0 con 0x7fe4d80cef60 2024-09-13T18:48:13.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d6800700 1 --2- 172.21.15.81:0/3502360429 >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 0x7fe4d815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:13.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d5e00700 1 --2- 172.21.15.81:0/3502360429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80b18e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009850 tx=0x7fe4c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2672fe34f553450f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d4a00700 1 -- 172.21.15.81:0/3502360429 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8011830 con 0x7fe4d80cef60 2024-09-13T18:48:13.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d4a00700 1 -- 172.21.15.81:0/3502360429 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8011990 con 0x7fe4d80cef60 2024-09-13T18:48:13.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d4a00700 1 -- 172.21.15.81:0/3502360429 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8011d40 con 0x7fe4d80cef60 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d7200700 1 -- 172.21.15.81:0/3502360429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 msgr2=0x7fe4d80b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.353+0000 7fe4d7200700 1 --2- 172.21.15.81:0/3502360429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80b18e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009850 tx=0x7fe4c8009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 -- 172.21.15.81:0/3502360429 shutdown_connections 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 --2- 172.21.15.81:0/3502360429 >> v2:172.21.15.178:3300/0 conn(0x7fe4d806b730 0x7fe4d815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 --2- 172.21.15.81:0/3502360429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80b18e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 -- 172.21.15.81:0/3502360429 >> 172.21.15.81:0/3502360429 conn(0x7fe4d806cb90 msgr2=0x7fe4d806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 -- 172.21.15.81:0/3502360429 shutdown_connections 2024-09-13T18:48:13.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 -- 172.21.15.81:0/3502360429 wait complete. 2024-09-13T18:48:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 Processor -- start 2024-09-13T18:48:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.357+0000 7fe4d7200700 1 -- start start 2024-09-13T18:48:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 0x7fe4d8149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d80b1e20 0x7fe4d80c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d814f2b0 con 0x7fe4d806b730 2024-09-13T18:48:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d814ecf0 con 0x7fe4d80b1e20 2024-09-13T18:48:13.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d814efd0 con 0x7fe4d80cef60 2024-09-13T18:48:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 0x7fe4d8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 0x7fe4d8149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58076/0 (socket says 172.21.15.81:58076) 2024-09-13T18:48:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 -- 172.21.15.81:0/2380362238 learned_addr learned my addr 172.21.15.81:0/2380362238 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5400700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d80b1e20 0x7fe4d80c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d6800700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 -- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 msgr2=0x7fe4d80c4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80c4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 -- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d80b1e20 msgr2=0x7fe4d80c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d80b1e20 0x7fe4d80c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.361+0000 7fe4d5e00700 1 -- 172.21.15.81:0/2380362238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0009b30 con 0x7fe4d806b730 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4d5e00700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 0x7fe4d8149920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8014040 tx=0x7fe4c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8024620 con 0x7fe4d806b730 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8024780 con 0x7fe4d806b730 2024-09-13T18:48:13.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8024b30 con 0x7fe4d806b730 2024-09-13T18:48:13.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c80094b0 con 0x7fe4d806b730 2024-09-13T18:48:13.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d814ae70 con 0x7fe4d806b730 2024-09-13T18:48:13.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.365+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d814a9f0 con 0x7fe4d806b730 2024-09-13T18:48:13.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.369+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4c8022070 con 0x7fe4d806b730 2024-09-13T18:48:13.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.369+0000 7fe4ce000700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4b8066730 0x7fe4b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.369+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4c8085260 con 0x7fe4d806b730 2024-09-13T18:48:13.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.369+0000 7fe4d5400700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4b8066730 0x7fe4b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.369+0000 7fe4d5400700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4b8066730 0x7fe4b8068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40018a0 tx=0x7fe4c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.377+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4d814a9f0 con 0x7fe4d806b730 2024-09-13T18:48:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.553+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe4d814a9f0 con 0x7fe4d806b730 2024-09-13T18:48:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.565+0000 7fe4ce000700 1 -- 172.21.15.81:0/2380362238 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe4d814a9f0 con 0x7fe4d806b730 2024-09-13T18:48:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4b8066730 msgr2=0x7fe4b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4b8066730 0x7fe4b8068bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe4c40018a0 tx=0x7fe4c4009040 comp rx=0 tx=0).stop 2024-09-13T18:48:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 msgr2=0x7fe4d8149920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 0x7fe4d8149920 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8014040 tx=0x7fe4c8004770 comp rx=0 tx=0).stop 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 shutdown_connections 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4b8066730 0x7fe4b8068bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d80cef60 0x7fe4d80c4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d80b1e20 0x7fe4d80c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 --2- 172.21.15.81:0/2380362238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d806b730 0x7fe4d8149920 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 >> 172.21.15.81:0/2380362238 conn(0x7fe4d806cb90 msgr2=0x7fe4d80b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 shutdown_connections 2024-09-13T18:48:13.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:13.569+0000 7fe4d7200700 1 -- 172.21.15.81:0/2380362238 wait complete. 2024-09-13T18:48:13.601 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:48:13.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:48:13.639 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:48:13.681 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:48:13.682 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:13.682 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:13.703 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:13.703 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:13.763 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:13.763 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:13.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.037+0000 7febb9000700 1 Processor -- start 2024-09-13T18:48:14.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.037+0000 7febb9000700 1 -- start start 2024-09-13T18:48:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb9000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febb40cb020 0x7febb40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb9000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb406b430 con 0x7febb415c2a0 2024-09-13T18:48:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb9000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb40b2ad0 con 0x7febb40cb020 2024-09-13T18:48:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb415b960 con 0x7febb406aaa0 2024-09-13T18:48:14.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febb40cb020 0x7febb40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7febb40cb020 0x7febb40cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58080/0 (socket says 172.21.15.81:58080) 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 -- 172.21.15.81:0/3651596926 learned_addr learned my addr 172.21.15.81:0/3651596926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3e00700 1 --2- 172.21.15.81:0/3651596926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 -- 172.21.15.81:0/3651596926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 msgr2=0x7febb406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 --2- 172.21.15.81:0/3651596926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 -- 172.21.15.81:0/3651596926 >> v1:172.21.15.178:6789/0 conn(0x7febb415c2a0 legacy=0x7febb415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 -- 172.21.15.81:0/3651596926 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb415bc40 con 0x7febb40cb020 2024-09-13T18:48:14.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb3400700 1 --2- 172.21.15.81:0/3651596926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40cb020 0x7febb40cc6f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feba4009910 tx=0x7feba4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96b8d674275f3de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb2a00700 1 -- 172.21.15.81:0/3651596926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4011830 con 0x7febb40cb020 2024-09-13T18:48:14.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb2a00700 1 -- 172.21.15.81:0/3651596926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba4011990 con 0x7febb40cb020 2024-09-13T18:48:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.041+0000 7febb2a00700 1 -- 172.21.15.81:0/3651596926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba4011d40 con 0x7febb40cb020 2024-09-13T18:48:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 -- 172.21.15.81:0/3651596926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40cb020 msgr2=0x7febb40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 --2- 172.21.15.81:0/3651596926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40cb020 0x7febb40cc6f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feba4009910 tx=0x7feba4009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 -- 172.21.15.81:0/3651596926 shutdown_connections 2024-09-13T18:48:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 --2- 172.21.15.81:0/3651596926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 --2- 172.21.15.81:0/3651596926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb40cb020 0x7febb40cc6f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 -- 172.21.15.81:0/3651596926 >> 172.21.15.81:0/3651596926 conn(0x7febb40b0c40 msgr2=0x7febb406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 -- 172.21.15.81:0/3651596926 shutdown_connections 2024-09-13T18:48:14.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.045+0000 7febb9000700 1 -- 172.21.15.81:0/3651596926 wait complete. 2024-09-13T18:48:14.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 Processor -- start 2024-09-13T18:48:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 -- start start 2024-09-13T18:48:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb41577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febb40cb020 0x7febb4157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 0x7febb40c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb40ca220 con 0x7febb415c2a0 2024-09-13T18:48:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb40c95a0 con 0x7febb40cb020 2024-09-13T18:48:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb40c9880 con 0x7febb406aaa0 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 0x7febb40c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 0x7febb40c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58094/0 (socket says 172.21.15.81:58094) 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb3e00700 1 -- 172.21.15.81:0/2664103113 learned_addr learned my addr 172.21.15.81:0/2664103113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febb3400700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb41577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.049+0000 7febaaa00700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febb40cb020 0x7febb4157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb3e00700 1 -- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 msgr2=0x7febb41577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb3e00700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb41577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb3e00700 1 -- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febb40cb020 msgr2=0x7febb4157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb3e00700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febb40cb020 0x7febb4157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb3e00700 1 -- 172.21.15.81:0/2664103113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba4009570 con 0x7febb415c2a0 2024-09-13T18:48:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb3e00700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 0x7febb40c7c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7febac00efc0 tx=0x7febac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac009ea0 con 0x7febb415c2a0 2024-09-13T18:48:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00f040 con 0x7febb415c2a0 2024-09-13T18:48:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00ced0 con 0x7febb415c2a0 2024-09-13T18:48:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb40c9b60 con 0x7febb415c2a0 2024-09-13T18:48:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb40c9270 con 0x7febb415c2a0 2024-09-13T18:48:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.053+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb40ca360 con 0x7febb415c2a0 2024-09-13T18:48:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.057+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7febac014480 con 0x7febb415c2a0 2024-09-13T18:48:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.057+0000 7febabe00700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb90066730 0x7feb90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.057+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febac084c80 con 0x7febb415c2a0 2024-09-13T18:48:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.057+0000 7febb3400700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb90066730 0x7feb90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.061+0000 7febb3400700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb90066730 0x7feb90068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feba4000c00 tx=0x7feba4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.065+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7febb40ca360 con 0x7febb415c2a0 2024-09-13T18:48:14.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.257+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febb40ca360 con 0x7febb415c2a0 2024-09-13T18:48:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.261+0000 7febabe00700 1 -- 172.21.15.81:0/2664103113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7febb40ca360 con 0x7febb415c2a0 2024-09-13T18:48:14.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:14.273 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb90066730 msgr2=0x7feb90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb90066730 0x7feb90068bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feba4000c00 tx=0x7feba4008030 comp rx=0 tx=0).stop 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 msgr2=0x7febb40c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 0x7febb40c7c90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7febac00efc0 tx=0x7febac00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 shutdown_connections 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb90066730 0x7feb90068bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb415c2a0 0x7febb40c7c90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febb40cb020 0x7febb4157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 --2- 172.21.15.81:0/2664103113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febb406aaa0 0x7febb41577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.265+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 >> 172.21.15.81:0/2664103113 conn(0x7febb40b0c40 msgr2=0x7febb415dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.269+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 shutdown_connections 2024-09-13T18:48:14.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.269+0000 7febb9000700 1 -- 172.21.15.81:0/2664103113 wait complete. 2024-09-13T18:48:14.300 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:14.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.465+0000 7f8273200700 1 Processor -- start 2024-09-13T18:48:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.465+0000 7f8273200700 1 -- start start 2024-09-13T18:48:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f827415ca20 0x7f827415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406cd80 0x7f82740b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827406ada0 0x7f827406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827406b770 con 0x7f827406ada0 2024-09-13T18:48:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8274160680 con 0x7f827415ca20 2024-09-13T18:48:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827415d670 con 0x7f827406cd80 2024-09-13T18:48:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827406ada0 0x7f827406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8271e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f827415ca20 0x7f827415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f827406ada0 0x7f827406b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58102/0 (socket says 172.21.15.81:58102) 2024-09-13T18:48:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 -- 172.21.15.81:0/3740735509 learned_addr learned my addr 172.21.15.81:0/3740735509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8271400700 1 --2- 172.21.15.81:0/3740735509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406cd80 0x7f82740b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 -- 172.21.15.81:0/3740735509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406cd80 msgr2=0x7f82740b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 --2- 172.21.15.81:0/3740735509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406cd80 0x7f82740b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 -- 172.21.15.81:0/3740735509 >> v2:172.21.15.178:3300/0 conn(0x7f827415ca20 msgr2=0x7f827415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 --2- 172.21.15.81:0/3740735509 >> v2:172.21.15.178:3300/0 conn(0x7f827415ca20 0x7f827415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 -- 172.21.15.81:0/3740735509 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827415d950 con 0x7f827406ada0 2024-09-13T18:48:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8272800700 1 --2- 172.21.15.81:0/3740735509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406ada0 0x7f827406b230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8274073c60 tx=0x7f826c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568a17802df2ec03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8270a00700 1 -- 172.21.15.81:0/3740735509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00e070 con 0x7f827406ada0 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8270a00700 1 -- 172.21.15.81:0/3740735509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c00b910 con 0x7f827406ada0 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8270a00700 1 -- 172.21.15.81:0/3740735509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00bcc0 con 0x7f827406ada0 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 -- 172.21.15.81:0/3740735509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406ada0 msgr2=0x7f827406b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 --2- 172.21.15.81:0/3740735509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406ada0 0x7f827406b230 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8274073c60 tx=0x7f826c00b330 comp rx=0 tx=0).stop 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 -- 172.21.15.81:0/3740735509 shutdown_connections 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 --2- 172.21.15.81:0/3740735509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406ada0 0x7f827406b230 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.469+0000 7f8273200700 1 --2- 172.21.15.81:0/3740735509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406cd80 0x7f82740b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.473+0000 7f8273200700 1 --2- 172.21.15.81:0/3740735509 >> v2:172.21.15.178:3300/0 conn(0x7f827415ca20 0x7f827415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.473+0000 7f8273200700 1 -- 172.21.15.81:0/3740735509 >> 172.21.15.81:0/3740735509 conn(0x7f8274071d20 msgr2=0x7f8274072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.473+0000 7f8273200700 1 -- 172.21.15.81:0/3740735509 shutdown_connections 2024-09-13T18:48:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.473+0000 7f8273200700 1 -- 172.21.15.81:0/3740735509 wait complete. 2024-09-13T18:48:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.473+0000 7f8273200700 1 Processor -- start 2024-09-13T18:48:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.473+0000 7f8273200700 1 -- start start 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8273200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406ada0 0x7f82741f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8273200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 0x7f827415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8273200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f827415ca20 0x7f82740cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8273200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8274153800 con 0x7f827406cd80 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8273200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827415b860 con 0x7f827415ca20 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8273200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827415bb40 con 0x7f827406ada0 2024-09-13T18:48:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 0x7f827415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 0x7f827415b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58114/0 (socket says 172.21.15.81:58114) 2024-09-13T18:48:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 -- 172.21.15.81:0/3633246633 learned_addr learned my addr 172.21.15.81:0/3633246633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271e00700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406ada0 0x7f82741f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8272800700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f827415ca20 0x7f82740cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 -- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406ada0 msgr2=0x7f82741f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406ada0 0x7f82741f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 -- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f827415ca20 msgr2=0x7f82740cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f827415ca20 0x7f82740cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 -- 172.21.15.81:0/3633246633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009b30 con 0x7f827406cd80 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.477+0000 7f8271400700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 0x7f827415b030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f826000ebe0 tx=0x7f826000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260009740 con 0x7f827406cd80 2024-09-13T18:48:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826000c850 con 0x7f827406cd80 2024-09-13T18:48:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000cbe0 con 0x7f827406cd80 2024-09-13T18:48:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82741531b0 con 0x7f827406cd80 2024-09-13T18:48:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827415b570 con 0x7f827406cd80 2024-09-13T18:48:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8274153970 con 0x7f827406cd80 2024-09-13T18:48:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.481+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f826000cd40 con 0x7f827406cd80 2024-09-13T18:48:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.485+0000 7f826a000700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8254066730 0x7f8254068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.485+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f82600844b0 con 0x7f827406cd80 2024-09-13T18:48:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.485+0000 7f8271e00700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8254066730 0x7f8254068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.485+0000 7f8271e00700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8254066730 0x7f8254068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8264009b70 tx=0x7f8264009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.493+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8260051460 con 0x7f827406cd80 2024-09-13T18:48:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.677+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82740b47d0 con 0x7f827406cd80 2024-09-13T18:48:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.677+0000 7f826a000700 1 -- 172.21.15.81:0/3633246633 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8260054a80 con 0x7f827406cd80 2024-09-13T18:48:14.689 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8254066730 msgr2=0x7f8254068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8254066730 0x7f8254068bf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8264009b70 tx=0x7f8264009240 comp rx=0 tx=0).stop 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 msgr2=0x7f827415b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 0x7f827415b030 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f826000ebe0 tx=0x7f826000eef0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 shutdown_connections 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8254066730 0x7f8254068bf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f827415ca20 0x7f82740cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827406cd80 0x7f827415b030 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 --2- 172.21.15.81:0/3633246633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f827406ada0 0x7f82741f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 >> 172.21.15.81:0/3633246633 conn(0x7f8274071d20 msgr2=0x7f82740b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 shutdown_connections 2024-09-13T18:48:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.681+0000 7f8273200700 1 -- 172.21.15.81:0/3633246633 wait complete. 2024-09-13T18:48:14.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.873+0000 7f3232c00700 1 Processor -- start 2024-09-13T18:48:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.873+0000 7f3232c00700 1 -- start start 2024-09-13T18:48:14.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3232c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f322c1601b0 0x7f322c0b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3232c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f322c160840 0x7f322c160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3232c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0ce1f0 con 0x7f322c1611f0 2024-09-13T18:48:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3232c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c0d0710 con 0x7f322c160840 2024-09-13T18:48:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3232c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c160590 con 0x7f322c1601b0 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3230e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f322c160840 0x7f322c160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3231800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f322c1601b0 0x7f322c0b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3230e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f322c160840 0x7f322c160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58124/0 (socket says 172.21.15.81:58124) 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.877+0000 7f3230e00700 1 -- 172.21.15.81:0/3614084358 learned_addr learned my addr 172.21.15.81:0/3614084358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f322be00700 1 -- 172.21.15.81:0/3614084358 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265767894 0 0) 0x7f322c0ce1f0 con 0x7f322c1611f0 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f322be00700 1 -- 172.21.15.81:0/3614084358 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32140035d0 con 0x7f322c1611f0 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3230e00700 1 -- 172.21.15.81:0/3614084358 >> v2:172.21.15.178:3300/0 conn(0x7f322c1601b0 msgr2=0x7f322c0b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3230e00700 1 --2- 172.21.15.81:0/3614084358 >> v2:172.21.15.178:3300/0 conn(0x7f322c1601b0 0x7f322c0b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3230e00700 1 -- 172.21.15.81:0/3614084358 >> v1:172.21.15.178:6789/0 conn(0x7f322c1611f0 legacy=0x7f322c0b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3230e00700 1 -- 172.21.15.81:0/3614084358 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0b3cb0 con 0x7f322c160840 2024-09-13T18:48:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3231800700 1 --2- 172.21.15.81:0/3614084358 >> v2:172.21.15.178:3300/0 conn(0x7f322c1601b0 0x7f322c0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3230e00700 1 --2- 172.21.15.81:0/3614084358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c160840 0x7f322c160cb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f322c06e1d0 tx=0x7f3218009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e955ba50d122ce3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f322be00700 1 -- 172.21.15.81:0/3614084358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218011830 con 0x7f322c160840 2024-09-13T18:48:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f322be00700 1 -- 172.21.15.81:0/3614084358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3218011990 con 0x7f322c160840 2024-09-13T18:48:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f322be00700 1 -- 172.21.15.81:0/3614084358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218011d20 con 0x7f322c160840 2024-09-13T18:48:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 -- 172.21.15.81:0/3614084358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c160840 msgr2=0x7f322c160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 --2- 172.21.15.81:0/3614084358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c160840 0x7f322c160cb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f322c06e1d0 tx=0x7f3218009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 -- 172.21.15.81:0/3614084358 shutdown_connections 2024-09-13T18:48:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 --2- 172.21.15.81:0/3614084358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c160840 0x7f322c160cb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 --2- 172.21.15.81:0/3614084358 >> v2:172.21.15.178:3300/0 conn(0x7f322c1601b0 0x7f322c0b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 -- 172.21.15.81:0/3614084358 >> 172.21.15.81:0/3614084358 conn(0x7f322c0d2b40 msgr2=0x7f322c0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 -- 172.21.15.81:0/3614084358 shutdown_connections 2024-09-13T18:48:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.881+0000 7f3232c00700 1 -- 172.21.15.81:0/3614084358 wait complete. 2024-09-13T18:48:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 Processor -- start 2024-09-13T18:48:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 -- start start 2024-09-13T18:48:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f322c1601b0 0x7f322c1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f322c160840 0x7f322c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 0x7f322c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0b78f0 con 0x7f322c1611f0 2024-09-13T18:48:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0b6c70 con 0x7f322c1601b0 2024-09-13T18:48:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c0b6f50 con 0x7f322c160840 2024-09-13T18:48:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 0x7f322c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 0x7f322c0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58132/0 (socket says 172.21.15.81:58132) 2024-09-13T18:48:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 -- 172.21.15.81:0/2847034110 learned_addr learned my addr 172.21.15.81:0/2847034110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3231800700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f322c1601b0 0x7f322c1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3230e00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f322c160840 0x7f322c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 -- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f322c160840 msgr2=0x7f322c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f322c160840 0x7f322c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 -- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f322c1601b0 msgr2=0x7f322c1f2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f322c1601b0 0x7f322c1f2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 -- 172.21.15.81:0/2847034110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200094b0 con 0x7f322c1611f0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3230e00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f322c160840 0x7f322c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.885+0000 7f3232200700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 0x7f322c0c8d10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f322400cbc0 tx=0x7f322400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224003c20 con 0x7f322c1611f0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3224003da0 con 0x7f322c1611f0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3218009570 con 0x7f322c1611f0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400ab50 con 0x7f322c1611f0 2024-09-13T18:48:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c0b7510 con 0x7f322c1611f0 2024-09-13T18:48:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c0b7a30 con 0x7f322c1611f0 2024-09-13T18:48:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.889+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f322400acb0 con 0x7f322c1611f0 2024-09-13T18:48:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.893+0000 7f3229600700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f320c066730 0x7f320c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.893+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3224084620 con 0x7f322c1611f0 2024-09-13T18:48:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.893+0000 7f3231800700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f320c066730 0x7f320c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.893+0000 7f3231800700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f320c066730 0x7f320c068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3220009d10 tx=0x7f3220008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:14.897+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f322c0b7a30 con 0x7f322c1611f0 2024-09-13T18:48:15.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.077+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f322c0b7a30 con 0x7f322c1611f0 2024-09-13T18:48:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.077+0000 7f3229600700 1 -- 172.21.15.81:0/2847034110 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f322c0b7a30 con 0x7f322c1611f0 2024-09-13T18:48:15.089 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.081+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f320c066730 msgr2=0x7f320c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.081+0000 7f3232c00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f320c066730 0x7f320c068bf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3220009d10 tx=0x7f3220008040 comp rx=0 tx=0).stop 2024-09-13T18:48:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.081+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 msgr2=0x7f322c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.081+0000 7f3232c00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 0x7f322c0c8d10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f322400cbc0 tx=0x7f322400cf80 comp rx=0 tx=0).stop 2024-09-13T18:48:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.081+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 shutdown_connections 2024-09-13T18:48:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f320c066730 0x7f320c068bf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c1611f0 0x7f322c0c8d10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f322c160840 0x7f322c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 --2- 172.21.15.81:0/2847034110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f322c1601b0 0x7f322c1f2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 >> 172.21.15.81:0/2847034110 conn(0x7f322c0d2b40 msgr2=0x7f322c0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 shutdown_connections 2024-09-13T18:48:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.085+0000 7f3232c00700 1 -- 172.21.15.81:0/2847034110 wait complete. 2024-09-13T18:48:15.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4591000700 1 Processor -- start 2024-09-13T18:48:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4591000700 1 -- start start 2024-09-13T18:48:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4591000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f458c15e030 0x7f458c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4591000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c0b57e0 con 0x7f458c0cd140 2024-09-13T18:48:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4591000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c0b3b80 con 0x7f458c157500 2024-09-13T18:48:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4591000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c0b5a80 con 0x7f458c15e030 2024-09-13T18:48:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f458a800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f458c0cd140 0x7f458c160ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38852/0 (socket says 172.21.15.81:38852) 2024-09-13T18:48:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4589400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f458c15e030 0x7f458c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f458a800700 1 -- 172.21.15.81:0/555423747 learned_addr learned my addr 172.21.15.81:0/555423747 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.281+0000 7f4588a00700 1 -- 172.21.15.81:0/555423747 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161061450 0 0) 0x7f458c0b57e0 con 0x7f458c0cd140 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4588a00700 1 -- 172.21.15.81:0/555423747 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45700035d0 con 0x7f458c0cd140 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4588a00700 1 -- 172.21.15.81:0/555423747 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152773686 0 0) 0x7f458c0b3b80 con 0x7f458c157500 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4589400700 1 -- 172.21.15.81:0/555423747 >> v1:172.21.15.178:6789/0 conn(0x7f458c157500 legacy=0x7f458c070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4589400700 1 -- 172.21.15.81:0/555423747 >> v1:172.21.15.81:6789/0 conn(0x7f458c0cd140 legacy=0x7f458c160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4589400700 1 -- 172.21.15.81:0/555423747 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c0b5d60 con 0x7f458c15e030 2024-09-13T18:48:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4589400700 1 --2- 172.21.15.81:0/555423747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c0ce700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4578009880 tx=0x7f4578009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1f858f3876d085 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4588a00700 1 -- 172.21.15.81:0/555423747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578011830 con 0x7f458c15e030 2024-09-13T18:48:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4588a00700 1 -- 172.21.15.81:0/555423747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4578011990 con 0x7f458c15e030 2024-09-13T18:48:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4588a00700 1 -- 172.21.15.81:0/555423747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578011d20 con 0x7f458c15e030 2024-09-13T18:48:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 -- 172.21.15.81:0/555423747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 msgr2=0x7f458c0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 --2- 172.21.15.81:0/555423747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c0ce700 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4578009880 tx=0x7f4578009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 -- 172.21.15.81:0/555423747 shutdown_connections 2024-09-13T18:48:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 --2- 172.21.15.81:0/555423747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c0ce700 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 -- 172.21.15.81:0/555423747 >> 172.21.15.81:0/555423747 conn(0x7f458c06e660 msgr2=0x7f458c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 -- 172.21.15.81:0/555423747 shutdown_connections 2024-09-13T18:48:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.285+0000 7f4591000700 1 -- 172.21.15.81:0/555423747 wait complete. 2024-09-13T18:48:15.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.289+0000 7f4591000700 1 Processor -- start 2024-09-13T18:48:15.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.289+0000 7f4591000700 1 -- start start 2024-09-13T18:48:15.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f458c0cd140 0x7f458c147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f458c157500 0x7f458c151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c1469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c152450 con 0x7f458c15e030 2024-09-13T18:48:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c151a80 con 0x7f458c0cd140 2024-09-13T18:48:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0cc380 con 0x7f458c157500 2024-09-13T18:48:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c1469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c1469d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58140/0 (socket says 172.21.15.81:58140) 2024-09-13T18:48:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 -- 172.21.15.81:0/4165551672 learned_addr learned my addr 172.21.15.81:0/4165551672 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4589e00700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f458c0cd140 0x7f458c147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4589400700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f458c157500 0x7f458c151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 -- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f458c157500 msgr2=0x7f458c151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f458c157500 0x7f458c151f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 -- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f458c0cd140 msgr2=0x7f458c147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f458c0cd140 0x7f458c147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 -- 172.21.15.81:0/4165551672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45780094b0 con 0x7f458c15e030 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4589400700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f458c157500 0x7f458c151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f458a800700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c1469d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f458400cb70 tx=0x7f458400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400a9a0 con 0x7f458c15e030 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458400ce90 con 0x7f458c15e030 2024-09-13T18:48:15.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400ad20 con 0x7f458c15e030 2024-09-13T18:48:15.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458c146f10 con 0x7f458c15e030 2024-09-13T18:48:15.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c0cc0a0 con 0x7f458c15e030 2024-09-13T18:48:15.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.293+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c151c10 con 0x7f458c15e030 2024-09-13T18:48:15.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.297+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f458401b3b0 con 0x7f458c15e030 2024-09-13T18:48:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.297+0000 7f4582000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f456c066730 0x7f456c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.297+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4584084050 con 0x7f458c15e030 2024-09-13T18:48:15.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.301+0000 7f4589e00700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f456c066730 0x7f456c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.301+0000 7f4589e00700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f456c066730 0x7f456c068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f60 tx=0x7f457c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.305+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45840b5db0 con 0x7f458c15e030 2024-09-13T18:48:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.489+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f458c0ceed0 con 0x7f458c15e030 2024-09-13T18:48:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.493+0000 7f4582000700 1 -- 172.21.15.81:0/4165551672 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45840170a0 con 0x7f458c15e030 2024-09-13T18:48:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f456c066730 msgr2=0x7f456c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f456c066730 0x7f456c068bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f457c000f60 tx=0x7f457c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 msgr2=0x7f458c1469d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c1469d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f458400cb70 tx=0x7f458400cc50 comp rx=0 tx=0).stop 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 shutdown_connections 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f456c066730 0x7f456c068bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f458c15e030 0x7f458c1469d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f458c157500 0x7f458c151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 --2- 172.21.15.81:0/4165551672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f458c0cd140 0x7f458c147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 >> 172.21.15.81:0/4165551672 conn(0x7f458c06e660 msgr2=0x7f458c153790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 shutdown_connections 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.497+0000 7f4591000700 1 -- 172.21.15.81:0/4165551672 wait complete. 2024-09-13T18:48:15.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:15.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.689+0000 7f05e6600700 1 Processor -- start 2024-09-13T18:48:15.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.689+0000 7f05e6600700 1 -- start start 2024-09-13T18:48:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e6600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e0071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e6600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f05e006d070 0x7f05e00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e6600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e0070da0 con 0x7f05e00b1980 2024-09-13T18:48:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e6600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00b2440 con 0x7f05e006d070 2024-09-13T18:48:15.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e6600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e00b2720 con 0x7f05e01464c0 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f05e006d070 0x7f05e00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f05e006d070 0x7f05e00b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:60310/0 (socket says 172.21.15.81:60310) 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 -- 172.21.15.81:0/2673081722 learned_addr learned my addr 172.21.15.81:0/2673081722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5200700 1 --2- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e0071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 -- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 msgr2=0x7f05e0071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 --2- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e0071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 -- 172.21.15.81:0/2673081722 >> v1:172.21.15.178:6789/0 conn(0x7f05e00b1980 legacy=0x7f05e006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 -- 172.21.15.81:0/2673081722 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0071060 con 0x7f05e006d070 2024-09-13T18:48:15.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05e5c00700 1 --2- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e00b1dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009e50 tx=0x7f05d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8859546ea0094ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05dfe00700 1 -- 172.21.15.81:0/2673081722 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d800e070 con 0x7f05e006d070 2024-09-13T18:48:15.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05dfe00700 1 -- 172.21.15.81:0/2673081722 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d800b910 con 0x7f05e006d070 2024-09-13T18:48:15.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.693+0000 7f05dfe00700 1 -- 172.21.15.81:0/2673081722 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d800bcc0 con 0x7f05e006d070 2024-09-13T18:48:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 -- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 msgr2=0x7f05e00b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 --2- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e00b1dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f05d8009e50 tx=0x7f05d800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 -- 172.21.15.81:0/2673081722 shutdown_connections 2024-09-13T18:48:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 --2- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e00b1dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 --2- 172.21.15.81:0/2673081722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e0071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 -- 172.21.15.81:0/2673081722 >> 172.21.15.81:0/2673081722 conn(0x7f05e006a390 msgr2=0x7f05e006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 -- 172.21.15.81:0/2673081722 shutdown_connections 2024-09-13T18:48:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 -- 172.21.15.81:0/2673081722 wait complete. 2024-09-13T18:48:15.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 Processor -- start 2024-09-13T18:48:15.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.697+0000 7f05e6600700 1 -- start start 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e015fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 0x7f05e013d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e013fe20 con 0x7f05e00b1980 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e0140100 con 0x7f05e006d070 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e01403e0 con 0x7f05e01464c0 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 0x7f05e013d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e015fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e5c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 0x7f05e013d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58146/0 (socket says 172.21.15.81:58146) 2024-09-13T18:48:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 -- 172.21.15.81:0/535606086 learned_addr learned my addr 172.21.15.81:0/535606086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 -- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 msgr2=0x7f05e013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 -- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 msgr2=0x7f05e015fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e015fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 -- 172.21.15.81:0/535606086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8009b30 con 0x7f05e00b1980 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e5200700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05d7e00700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 0x7f05e013d2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c4d0 tx=0x7f05c800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80052d0 con 0x7f05e00b1980 2024-09-13T18:48:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c8005430 con 0x7f05e00b1980 2024-09-13T18:48:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e01406c0 con 0x7f05e00b1980 2024-09-13T18:48:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.701+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80055a0 con 0x7f05e00b1980 2024-09-13T18:48:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.705+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e013d7e0 con 0x7f05e00b1980 2024-09-13T18:48:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.705+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0140be0 con 0x7f05e00b1980 2024-09-13T18:48:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.705+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05c80038c0 con 0x7f05e00b1980 2024-09-13T18:48:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.709+0000 7f05dd600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f05bc066730 0x7f05bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.709+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f05c8083890 con 0x7f05e00b1980 2024-09-13T18:48:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.709+0000 7f05e5200700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f05bc066730 0x7f05bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.709+0000 7f05e5200700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f05bc066730 0x7f05bc068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05e00cac90 tx=0x7f05d0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.713+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05e0140be0 con 0x7f05e00b1980 2024-09-13T18:48:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.897+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05e0140be0 con 0x7f05e00b1980 2024-09-13T18:48:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.901+0000 7f05dd600700 1 -- 172.21.15.81:0/535606086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05e0140be0 con 0x7f05e00b1980 2024-09-13T18:48:15.910 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f05bc066730 msgr2=0x7f05bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f05bc066730 0x7f05bc068bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f05e00cac90 tx=0x7f05d0009240 comp rx=0 tx=0).stop 2024-09-13T18:48:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 msgr2=0x7f05e013d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 0x7f05e013d2a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f05c800c4d0 tx=0x7f05c800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 shutdown_connections 2024-09-13T18:48:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f05bc066730 0x7f05bc068bf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05e01464c0 0x7f05e013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e00b1980 0x7f05e013d2a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 --2- 172.21.15.81:0/535606086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05e006d070 0x7f05e015fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 >> 172.21.15.81:0/535606086 conn(0x7f05e006a390 msgr2=0x7f05e00cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 shutdown_connections 2024-09-13T18:48:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:15.905+0000 7f05e6600700 1 -- 172.21.15.81:0/535606086 wait complete. 2024-09-13T18:48:15.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:48:16.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.097+0000 7f5f00c00700 1 Processor -- start 2024-09-13T18:48:16.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.097+0000 7f5f00c00700 1 -- start start 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5f00c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5efc0cc6f0 0x7f5efc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5f00c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5efc06aaa0 0x7f5efc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5f00c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc0ccb40 con 0x7f5efc0cb020 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5f00c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc06b430 con 0x7f5efc06aaa0 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5f00c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc0b2ad0 con 0x7f5efc0cc6f0 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5efc06aaa0 0x7f5efc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efaa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5efc0cc6f0 0x7f5efc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5efc06aaa0 0x7f5efc06aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58154/0 (socket says 172.21.15.81:58154) 2024-09-13T18:48:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 -- 172.21.15.81:0/1641016767 learned_addr learned my addr 172.21.15.81:0/1641016767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 -- 172.21.15.81:0/1641016767 >> v2:172.21.15.178:3300/0 conn(0x7f5efc0cc6f0 msgr2=0x7f5efc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 --2- 172.21.15.81:0/1641016767 >> v2:172.21.15.178:3300/0 conn(0x7f5efc0cc6f0 0x7f5efc15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 -- 172.21.15.81:0/1641016767 >> v1:172.21.15.178:6789/0 conn(0x7f5efc0cb020 legacy=0x7f5efc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.101+0000 7f5efbe00700 1 -- 172.21.15.81:0/1641016767 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc15b960 con 0x7f5efc06aaa0 2024-09-13T18:48:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5efbe00700 1 --2- 172.21.15.81:0/1641016767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc06aef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5efc15e630 tx=0x7f5ef400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f7a43beaa39535 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5efa000700 1 -- 172.21.15.81:0/1641016767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400e070 con 0x7f5efc06aaa0 2024-09-13T18:48:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5efa000700 1 -- 172.21.15.81:0/1641016767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef400b910 con 0x7f5efc06aaa0 2024-09-13T18:48:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5efa000700 1 -- 172.21.15.81:0/1641016767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef400bcc0 con 0x7f5efc06aaa0 2024-09-13T18:48:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 -- 172.21.15.81:0/1641016767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 msgr2=0x7f5efc06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 --2- 172.21.15.81:0/1641016767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc06aef0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5efc15e630 tx=0x7f5ef400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 -- 172.21.15.81:0/1641016767 shutdown_connections 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 --2- 172.21.15.81:0/1641016767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc06aef0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 --2- 172.21.15.81:0/1641016767 >> v2:172.21.15.178:3300/0 conn(0x7f5efc0cc6f0 0x7f5efc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 -- 172.21.15.81:0/1641016767 >> 172.21.15.81:0/1641016767 conn(0x7f5efc0b0c40 msgr2=0x7f5efc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 -- 172.21.15.81:0/1641016767 shutdown_connections 2024-09-13T18:48:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.105+0000 7f5f00c00700 1 -- 172.21.15.81:0/1641016767 wait complete. 2024-09-13T18:48:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 Processor -- start 2024-09-13T18:48:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 -- start start 2024-09-13T18:48:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc14b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5efc0cb020 0x7f5efc1486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5efc0cc6f0 0x7f5efc1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc14ba40 con 0x7f5efc06aaa0 2024-09-13T18:48:16.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc071d60 con 0x7f5efc0cc6f0 2024-09-13T18:48:16.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5f00c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0717e0 con 0x7f5efc0cb020 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc14b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc14b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58168/0 (socket says 172.21.15.81:58168) 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 -- 172.21.15.81:0/3103706849 learned_addr learned my addr 172.21.15.81:0/3103706849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efaa00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5efc0cb020 0x7f5efc1486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efbe00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5efc0cc6f0 0x7f5efc1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 -- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5efc0cb020 msgr2=0x7f5efc1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5efc0cb020 0x7f5efc1486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 -- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5efc0cc6f0 msgr2=0x7f5efc1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5efc0cc6f0 0x7f5efc1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.109+0000 7f5efb400700 1 -- 172.21.15.81:0/3103706849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef4009b30 con 0x7f5efc06aaa0 2024-09-13T18:48:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5efb400700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc14b500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c500 tx=0x7f5eec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0052d0 con 0x7f5efc06aaa0 2024-09-13T18:48:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec005430 con 0x7f5efc06aaa0 2024-09-13T18:48:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc149740 con 0x7f5efc06aaa0 2024-09-13T18:48:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0055a0 con 0x7f5efc06aaa0 2024-09-13T18:48:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc14ad00 con 0x7f5efc06aaa0 2024-09-13T18:48:16.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.113+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc0cb400 con 0x7f5efc06aaa0 2024-09-13T18:48:16.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.117+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5eec0038e0 con 0x7f5efc06aaa0 2024-09-13T18:48:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.117+0000 7f5ef3400700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5edc066760 0x7f5edc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.117+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5eec083980 con 0x7f5efc06aaa0 2024-09-13T18:48:16.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.117+0000 7f5efaa00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5edc066760 0x7f5edc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.117+0000 7f5efaa00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5edc066760 0x7f5edc068c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0c9200 tx=0x7f5ee8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.125+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5eec050890 con 0x7f5efc06aaa0 2024-09-13T18:48:16.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.321+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5efc0ce400 con 0x7f5efc06aaa0 2024-09-13T18:48:16.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.321+0000 7f5ef3400700 1 -- 172.21.15.81:0/3103706849 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5eec053eb0 con 0x7f5efc06aaa0 2024-09-13T18:48:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5edc066760 msgr2=0x7f5edc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5edc066760 0x7f5edc068c20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5efc0c9200 tx=0x7f5ee8009240 comp rx=0 tx=0).stop 2024-09-13T18:48:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 msgr2=0x7f5efc14b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc14b500 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c500 tx=0x7f5eec00c810 comp rx=0 tx=0).stop 2024-09-13T18:48:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 shutdown_connections 2024-09-13T18:48:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5edc066760 0x7f5edc068c20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5efc0cc6f0 0x7f5efc1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5efc0cb020 0x7f5efc1486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 --2- 172.21.15.81:0/3103706849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5efc06aaa0 0x7f5efc14b500 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 >> 172.21.15.81:0/3103706849 conn(0x7f5efc0b0c40 msgr2=0x7f5efc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 shutdown_connections 2024-09-13T18:48:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.325+0000 7f5f00c00700 1 -- 172.21.15.81:0/3103706849 wait complete. 2024-09-13T18:48:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:48:16.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:48:16.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:16.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T18:48:16.406 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:48:16.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:16.406 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:48:16.468 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:16.468 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:16.484 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:16.484 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:16.547 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:16.547 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:16.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 Processor -- start 2024-09-13T18:48:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 -- start start 2024-09-13T18:48:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f419413ebc0 0x7f419406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 0x7f419406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419413fcc0 con 0x7f41940703d0 2024-09-13T18:48:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419406af50 con 0x7f419406ab10 2024-09-13T18:48:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4199200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419413f0f0 con 0x7f419413ebc0 2024-09-13T18:48:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4191400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 0x7f419406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4191400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 0x7f419406fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47292/0 (socket says 172.21.15.81:47292) 2024-09-13T18:48:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4191400700 1 -- 172.21.15.81:0/2492612522 learned_addr learned my addr 172.21.15.81:0/2492612522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.777+0000 7f4191e00700 1 --2- 172.21.15.81:0/2492612522 >> v2:172.21.15.178:3300/0 conn(0x7f419413ebc0 0x7f419406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4191e00700 1 -- 172.21.15.81:0/2492612522 >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 msgr2=0x7f419406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4191e00700 1 --2- 172.21.15.81:0/2492612522 >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 0x7f419406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4191e00700 1 -- 172.21.15.81:0/2492612522 >> v1:172.21.15.178:6789/0 conn(0x7f41940703d0 legacy=0x7f419415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4191e00700 1 -- 172.21.15.81:0/2492612522 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419413f390 con 0x7f419413ebc0 2024-09-13T18:48:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4191400700 1 --2- 172.21.15.81:0/2492612522 >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 0x7f419406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4190a00700 1 -- 172.21.15.81:0/2492612522 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156858826 0 0) 0x7f419413fcc0 con 0x7f41940703d0 2024-09-13T18:48:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4191e00700 1 --2- 172.21.15.81:0/2492612522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419413ebc0 0x7f419406a5d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41940cc5b0 tx=0x7f4184009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b665f091e395087d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4190a00700 1 -- 172.21.15.81:0/2492612522 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184011830 con 0x7f419413ebc0 2024-09-13T18:48:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4190a00700 1 -- 172.21.15.81:0/2492612522 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4184011990 con 0x7f419413ebc0 2024-09-13T18:48:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4190a00700 1 -- 172.21.15.81:0/2492612522 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4184011d20 con 0x7f419413ebc0 2024-09-13T18:48:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4199200700 1 -- 172.21.15.81:0/2492612522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419413ebc0 msgr2=0x7f419406a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4199200700 1 --2- 172.21.15.81:0/2492612522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419413ebc0 0x7f419406a5d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f41940cc5b0 tx=0x7f4184009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4199200700 1 -- 172.21.15.81:0/2492612522 shutdown_connections 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4199200700 1 --2- 172.21.15.81:0/2492612522 >> v2:172.21.15.81:3300/0 conn(0x7f419406ab10 0x7f419406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4199200700 1 --2- 172.21.15.81:0/2492612522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419413ebc0 0x7f419406a5d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.781+0000 7f4199200700 1 -- 172.21.15.81:0/2492612522 >> 172.21.15.81:0/2492612522 conn(0x7f41940b08d0 msgr2=0x7f41940b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.785+0000 7f4199200700 1 -- 172.21.15.81:0/2492612522 shutdown_connections 2024-09-13T18:48:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.785+0000 7f4199200700 1 -- 172.21.15.81:0/2492612522 wait complete. 2024-09-13T18:48:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.785+0000 7f4199200700 1 Processor -- start 2024-09-13T18:48:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.785+0000 7f4199200700 1 -- start start 2024-09-13T18:48:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.785+0000 7f4199200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419406ab10 0x7f4194156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41940703d0 0x7f419413bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 0x7f419413c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41941520a0 con 0x7f419413ebc0 2024-09-13T18:48:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4194151000 con 0x7f419406ab10 2024-09-13T18:48:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41941512e0 con 0x7f41940703d0 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 0x7f419413c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 0x7f419413c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47302/0 (socket says 172.21.15.81:47302) 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 -- 172.21.15.81:0/3181552440 learned_addr learned my addr 172.21.15.81:0/3181552440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4191400700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41940703d0 0x7f419413bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4191e00700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419406ab10 0x7f4194156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 -- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41940703d0 msgr2=0x7f419413bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41940703d0 0x7f419413bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 -- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419406ab10 msgr2=0x7f4194156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419406ab10 0x7f4194156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 -- 172.21.15.81:0/3181552440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418000b810 con 0x7f419413ebc0 2024-09-13T18:48:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4191400700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41940703d0 0x7f419413bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4191e00700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419406ab10 0x7f4194156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4192800700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 0x7f419413c450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f418c00cc10 tx=0x7f418c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c003e50 con 0x7f419413ebc0 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00a7a0 con 0x7f419413ebc0 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00ab50 con 0x7f419413ebc0 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840094b0 con 0x7f419413ebc0 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41941518a0 con 0x7f419413ebc0 2024-09-13T18:48:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.789+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4194070860 con 0x7f419413ebc0 2024-09-13T18:48:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.793+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f418c00acb0 con 0x7f419413ebc0 2024-09-13T18:48:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.793+0000 7f418a000700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4174066730 0x7f4174068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.793+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f418c084040 con 0x7f419413ebc0 2024-09-13T18:48:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.793+0000 7f4191e00700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4174066730 0x7f4174068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.797+0000 7f4191e00700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4174066730 0x7f4174068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f41840090b0 tx=0x7f4184008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.801+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f418c050ff0 con 0x7f419413ebc0 2024-09-13T18:48:17.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.989+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41940b0f90 con 0x7f419413ebc0 2024-09-13T18:48:17.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.993+0000 7f418a000700 1 -- 172.21.15.81:0/3181552440 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f418c017090 con 0x7f419413ebc0 2024-09-13T18:48:17.005 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:17.005 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4174066730 msgr2=0x7f4174068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4174066730 0x7f4174068bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f41840090b0 tx=0x7f4184008030 comp rx=0 tx=0).stop 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 msgr2=0x7f419413c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 0x7f419413c450 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f418c00cc10 tx=0x7f418c00a060 comp rx=0 tx=0).stop 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 shutdown_connections 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4174066730 0x7f4174068bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f419413ebc0 0x7f419413c450 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41940703d0 0x7f419413bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 --2- 172.21.15.81:0/3181552440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f419406ab10 0x7f4194156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 >> 172.21.15.81:0/3181552440 conn(0x7f41940b08d0 msgr2=0x7f41940ae6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 shutdown_connections 2024-09-13T18:48:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:16.997+0000 7f4199200700 1 -- 172.21.15.81:0/3181552440 wait complete. 2024-09-13T18:48:17.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:17.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.189+0000 7f08f5000700 1 Processor -- start 2024-09-13T18:48:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.189+0000 7f08f5000700 1 -- start start 2024-09-13T18:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08f5000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08f00b5500 0x7f08f00cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08f5000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f0071f80 con 0x7f08f01519f0 2024-09-13T18:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08f5000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f006a760 con 0x7f08f015ad70 2024-09-13T18:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08f5000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f015b1e0 con 0x7f08f00b5500 2024-09-13T18:48:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08ef400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08f01519f0 0x7f08f00b4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41192/0 (socket says 172.21.15.81:41192) 2024-09-13T18:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08ef400700 1 -- 172.21.15.81:0/2949090513 learned_addr learned my addr 172.21.15.81:0/2949090513 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08eea00700 1 --2- 172.21.15.81:0/2949090513 >> v2:172.21.15.81:3300/0 conn(0x7f08f00b5500 0x7f08f00cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08eea00700 1 -- 172.21.15.81:0/2949090513 >> v1:172.21.15.178:6789/0 conn(0x7f08f015ad70 legacy=0x7f08f006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08ee000700 1 -- 172.21.15.81:0/2949090513 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166772076 0 0) 0x7f08f0071f80 con 0x7f08f01519f0 2024-09-13T18:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08eea00700 1 -- 172.21.15.81:0/2949090513 >> v1:172.21.15.81:6789/0 conn(0x7f08f01519f0 legacy=0x7f08f00b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.193+0000 7f08eea00700 1 -- 172.21.15.81:0/2949090513 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f015b3c0 con 0x7f08f00b5500 2024-09-13T18:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08eea00700 1 --2- 172.21.15.81:0/2949090513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f00b5500 0x7f08f00cf460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009850 tx=0x7f08dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946e789f6fad70f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08ee000700 1 -- 172.21.15.81:0/2949090513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011830 con 0x7f08f00b5500 2024-09-13T18:48:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08ee000700 1 -- 172.21.15.81:0/2949090513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc011990 con 0x7f08f00b5500 2024-09-13T18:48:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08ee000700 1 -- 172.21.15.81:0/2949090513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011d20 con 0x7f08f00b5500 2024-09-13T18:48:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 -- 172.21.15.81:0/2949090513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f00b5500 msgr2=0x7f08f00cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 --2- 172.21.15.81:0/2949090513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f00b5500 0x7f08f00cf460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009850 tx=0x7f08dc009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 -- 172.21.15.81:0/2949090513 shutdown_connections 2024-09-13T18:48:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 --2- 172.21.15.81:0/2949090513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f00b5500 0x7f08f00cf460 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 -- 172.21.15.81:0/2949090513 >> 172.21.15.81:0/2949090513 conn(0x7f08f0070d10 msgr2=0x7f08f00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 -- 172.21.15.81:0/2949090513 shutdown_connections 2024-09-13T18:48:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.197+0000 7f08f5000700 1 -- 172.21.15.81:0/2949090513 wait complete. 2024-09-13T18:48:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 Processor -- start 2024-09-13T18:48:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 -- start start 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08f00b5500 0x7f08f00c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08f01519f0 0x7f08f01e5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 0x7f08f0148750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01e5c60 con 0x7f08f015ad70 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01e6e40 con 0x7f08f00b5500 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01e6b60 con 0x7f08f01519f0 2024-09-13T18:48:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 0x7f08f0148750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 0x7f08f0148750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47328/0 (socket says 172.21.15.81:47328) 2024-09-13T18:48:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 -- 172.21.15.81:0/2127866096 learned_addr learned my addr 172.21.15.81:0/2127866096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08ef400700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08f00b5500 0x7f08f00c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08eea00700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08f01519f0 0x7f08f01e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 -- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08f01519f0 msgr2=0x7f08f01e5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08f01519f0 0x7f08f01e5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 -- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08f00b5500 msgr2=0x7f08f00c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08f00b5500 0x7f08f00c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 -- 172.21.15.81:0/2127866096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0094b0 con 0x7f08f015ad70 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08efe00700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 0x7f08f0148750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f08e800cb80 tx=0x7f08e800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8003c20 con 0x7f08f015ad70 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e8003d80 con 0x7f08f015ad70 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f01e4c40 con 0x7f08f015ad70 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800aaa0 con 0x7f08f015ad70 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.201+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f01e5200 con 0x7f08f015ad70 2024-09-13T18:48:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.205+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f00cf460 con 0x7f08f015ad70 2024-09-13T18:48:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.205+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08e800ac00 con 0x7f08f015ad70 2024-09-13T18:48:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.205+0000 7f08e7400700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08d0066730 0x7f08d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.209+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f08e8084410 con 0x7f08f015ad70 2024-09-13T18:48:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.209+0000 7f08ef400700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08d0066730 0x7f08d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.209+0000 7f08ef400700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08d0066730 0x7f08d0068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f08e00011e0 tx=0x7f08e0001130 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.213+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08e80513d0 con 0x7f08f015ad70 2024-09-13T18:48:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.385+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08f00721d0 con 0x7f08f015ad70 2024-09-13T18:48:17.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.385+0000 7f08e7400700 1 -- 172.21.15.81:0/2127866096 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08e80549f0 con 0x7f08f015ad70 2024-09-13T18:48:17.397 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08d0066730 msgr2=0x7f08d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08d0066730 0x7f08d0068bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f08e00011e0 tx=0x7f08e0001130 comp rx=0 tx=0).stop 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 msgr2=0x7f08f0148750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 0x7f08f0148750 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f08e800cb80 tx=0x7f08e800ce90 comp rx=0 tx=0).stop 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 shutdown_connections 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08d0066730 0x7f08d0068bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08f015ad70 0x7f08f0148750 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08f01519f0 0x7f08f01e5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 --2- 172.21.15.81:0/2127866096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08f00b5500 0x7f08f00c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 >> 172.21.15.81:0/2127866096 conn(0x7f08f0070d10 msgr2=0x7f08f014f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 shutdown_connections 2024-09-13T18:48:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.393+0000 7f08f5000700 1 -- 172.21.15.81:0/2127866096 wait complete. 2024-09-13T18:48:17.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.585+0000 7f06c7200700 1 Processor -- start 2024-09-13T18:48:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.585+0000 7f06c7200700 1 -- start start 2024-09-13T18:48:17.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 0x7f06c0167f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c7200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c00ce1f0 con 0x7f06c01601b0 2024-09-13T18:48:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c0161660 con 0x7f06c00b36d0 2024-09-13T18:48:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00d0710 con 0x7f06c0165b60 2024-09-13T18:48:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f06c01601b0 0x7f06c0160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41194/0 (socket says 172.21.15.81:41194) 2024-09-13T18:48:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 -- 172.21.15.81:0/3549025509 learned_addr learned my addr 172.21.15.81:0/3549025509 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c6800700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 0x7f06c0167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400964088 0 0) 0x7f06c00ce1f0 con 0x7f06c01601b0 2024-09-13T18:48:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a80035d0 con 0x7f06c01601b0 2024-09-13T18:48:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1095331254 0 0) 0x7f06a80035d0 con 0x7f06c01601b0 2024-09-13T18:48:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 msgr2=0x7f06c0167f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:17.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 0x7f06c0167f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 >> v1:172.21.15.178:6789/0 conn(0x7f06c00b36d0 legacy=0x7f06c0160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0160590 con 0x7f06c01601b0 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f06b4001670 con 0x7f06c01601b0 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 >> v1:172.21.15.81:6789/0 conn(0x7f06c01601b0 legacy=0x7f06c0160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a8003a50 0x7f06a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 0x7f06a8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8004db0 0x7f06a8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00d0710 con 0x7f06a8003a50 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a800bbf0 con 0x7f06a8004db0 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a800bdb0 con 0x7f06c0165b60 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a8003a50 0x7f06a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5400700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 0x7f06a8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c6800700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8004db0 0x7f06a8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 -- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 msgr2=0x7f06a8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:17.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c0165b60 0x7f06a8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 -- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8004db0 msgr2=0x7f06a8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:17.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8004db0 0x7f06a8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.589+0000 7f06c5e00700 1 -- 172.21.15.81:0/3549025509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80035d0 con 0x7f06a8003a50 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c5e00700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a8003a50 0x7f06a8003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f06b400c320 tx=0x7f06a80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5924d1719bd342fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4007c30 con 0x7f06a8003a50 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b400ce80 con 0x7f06a8003a50 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c4a00700 1 -- 172.21.15.81:0/3549025509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b4005bc0 con 0x7f06a8003a50 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c7200700 1 -- 172.21.15.81:0/3549025509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a8003a50 msgr2=0x7f06a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c7200700 1 --2- 172.21.15.81:0/3549025509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06a8003a50 0x7f06a8003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f06b400c320 tx=0x7f06a80058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c6800700 1 -- 172.21.15.81:0/3549025509 reap_dead start 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c7200700 1 -- 172.21.15.81:0/3549025509 shutdown_connections 2024-09-13T18:48:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c7200700 1 -- 172.21.15.81:0/3549025509 >> 172.21.15.81:0/3549025509 conn(0x7f06c00d2b40 msgr2=0x7f06c00d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c7200700 1 -- 172.21.15.81:0/3549025509 shutdown_connections 2024-09-13T18:48:17.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.593+0000 7f06c7200700 1 -- 172.21.15.81:0/3549025509 wait complete. 2024-09-13T18:48:17.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 Processor -- start 2024-09-13T18:48:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 -- start start 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8003a50 0x7f06c014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 0x7f06c015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c00cf6e0 0x7f06c00cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0157830 con 0x7f06c01503f0 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00d00a0 con 0x7f06c00cf6e0 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0150130 con 0x7f06a8003a50 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 0x7f06c015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 0x7f06c015c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47360/0 (socket says 172.21.15.81:47360) 2024-09-13T18:48:17.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 -- 172.21.15.81:0/1444622703 learned_addr learned my addr 172.21.15.81:0/1444622703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:17.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5e00700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8003a50 0x7f06c014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c6800700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c00cf6e0 0x7f06c00cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 -- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8003a50 msgr2=0x7f06c014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8003a50 0x7f06c014fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 -- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c00cf6e0 msgr2=0x7f06c00cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c00cf6e0 0x7f06c00cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 -- 172.21.15.81:0/1444622703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00cbc90 con 0x7f06c01503f0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c5400700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 0x7f06c015c0e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f06b000f820 tx=0x7f06b000fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b00052e0 con 0x7f06c01503f0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0005440 con 0x7f06c01503f0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c00cbf70 con 0x7f06c01503f0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b00038c0 con 0x7f06c01503f0 2024-09-13T18:48:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.597+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c00cc530 con 0x7f06c01503f0 2024-09-13T18:48:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.601+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c00d3840 con 0x7f06c01503f0 2024-09-13T18:48:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.601+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06b0003a20 con 0x7f06c01503f0 2024-09-13T18:48:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.601+0000 7f06ba000700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066760 0x7f06a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.605+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06b0084320 con 0x7f06c01503f0 2024-09-13T18:48:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.605+0000 7f06c5e00700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066760 0x7f06a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.605+0000 7f06c5e00700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066760 0x7f06a4068c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06b4015040 tx=0x7f06b4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.609+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06b00512c0 con 0x7f06c01503f0 2024-09-13T18:48:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.793+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06c008cc60 con 0x7f06c01503f0 2024-09-13T18:48:17.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.793+0000 7f06ba000700 1 -- 172.21.15.81:0/1444622703 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06b00548e0 con 0x7f06c01503f0 2024-09-13T18:48:17.804 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066760 msgr2=0x7f06a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066760 0x7f06a4068c20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06b4015040 tx=0x7f06b4007000 comp rx=0 tx=0).stop 2024-09-13T18:48:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 msgr2=0x7f06c015c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 0x7f06c015c0e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f06b000f820 tx=0x7f06b000fbe0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 shutdown_connections 2024-09-13T18:48:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066760 0x7f06a4068c20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c00cf6e0 0x7f06c00cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c01503f0 0x7f06c015c0e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 --2- 172.21.15.81:0/1444622703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8003a50 0x7f06c014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 >> 172.21.15.81:0/1444622703 conn(0x7f06c00d2b40 msgr2=0x7f06c00b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 shutdown_connections 2024-09-13T18:48:17.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.797+0000 7f06c7200700 1 -- 172.21.15.81:0/1444622703 wait complete. 2024-09-13T18:48:17.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:18.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.989+0000 7efff8800700 1 Processor -- start 2024-09-13T18:48:18.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.989+0000 7efff8800700 1 -- start start 2024-09-13T18:48:18.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff8800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efff015e030 0x7efff00ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff8800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff00b57e0 con 0x7efff0157500 2024-09-13T18:48:18.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff8800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff00b3b80 con 0x7efff00cd140 2024-09-13T18:48:18.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff8800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff00b5a80 con 0x7efff015e030 2024-09-13T18:48:18.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff5e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efff0157500 0x7efff0070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41204/0 (socket says 172.21.15.81:41204) 2024-09-13T18:48:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff5e00700 1 -- 172.21.15.81:0/1673362009 learned_addr learned my addr 172.21.15.81:0/1673362009 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff5400700 1 --2- 172.21.15.81:0/1673362009 >> v2:172.21.15.178:3300/0 conn(0x7efff015e030 0x7efff00ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff4a00700 1 -- 172.21.15.81:0/1673362009 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418379641 0 0) 0x7efff00b57e0 con 0x7efff0157500 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff4a00700 1 -- 172.21.15.81:0/1673362009 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd80035d0 con 0x7efff0157500 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff5400700 1 -- 172.21.15.81:0/1673362009 >> v1:172.21.15.178:6789/0 conn(0x7efff00cd140 legacy=0x7efff0160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff5400700 1 -- 172.21.15.81:0/1673362009 >> v1:172.21.15.81:6789/0 conn(0x7efff0157500 legacy=0x7efff0070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.993+0000 7efff5400700 1 -- 172.21.15.81:0/1673362009 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00b5d60 con 0x7efff015e030 2024-09-13T18:48:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff5400700 1 --2- 172.21.15.81:0/1673362009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff015e030 0x7efff00ce700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effe0009880 tx=0x7effe0009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=713a6c33a0435dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff4a00700 1 -- 172.21.15.81:0/1673362009 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011830 con 0x7efff015e030 2024-09-13T18:48:18.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff4a00700 1 -- 172.21.15.81:0/1673362009 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0011990 con 0x7efff015e030 2024-09-13T18:48:18.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff4a00700 1 -- 172.21.15.81:0/1673362009 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0011d20 con 0x7efff015e030 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 -- 172.21.15.81:0/1673362009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff015e030 msgr2=0x7efff00ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 --2- 172.21.15.81:0/1673362009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff015e030 0x7efff00ce700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7effe0009880 tx=0x7effe0009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 -- 172.21.15.81:0/1673362009 shutdown_connections 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 --2- 172.21.15.81:0/1673362009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff015e030 0x7efff00ce700 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 -- 172.21.15.81:0/1673362009 >> 172.21.15.81:0/1673362009 conn(0x7efff006e660 msgr2=0x7efff006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 -- 172.21.15.81:0/1673362009 shutdown_connections 2024-09-13T18:48:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:17.997+0000 7efff8800700 1 -- 172.21.15.81:0/1673362009 wait complete. 2024-09-13T18:48:18.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 Processor -- start 2024-09-13T18:48:18.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 -- start start 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff00cd140 0x7efff01486d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff0157500 0x7efff006a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 0x7efff006c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0148c10 con 0x7efff015e030 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0151610 con 0x7efff00cd140 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff8800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff006ad00 con 0x7efff0157500 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.001+0000 7efff6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 0x7efff006c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 0x7efff006c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47364/0 (socket says 172.21.15.81:47364) 2024-09-13T18:48:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 -- 172.21.15.81:0/3013606480 learned_addr learned my addr 172.21.15.81:0/3013606480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff5400700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff0157500 0x7efff006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff5e00700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff00cd140 0x7efff01486d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 -- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff0157500 msgr2=0x7efff006a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff0157500 0x7efff006a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 -- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff00cd140 msgr2=0x7efff01486d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff00cd140 0x7efff01486d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 -- 172.21.15.81:0/3013606480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00094b0 con 0x7efff015e030 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff5e00700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff00cd140 0x7efff01486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:18.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff6800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 0x7efff006c5b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effec00cc50 tx=0x7effec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003c20 con 0x7efff015e030 2024-09-13T18:48:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec003d80 con 0x7efff015e030 2024-09-13T18:48:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff0151880 con 0x7efff015e030 2024-09-13T18:48:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec00ab60 con 0x7efff015e030 2024-09-13T18:48:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff006afe0 con 0x7efff015e030 2024-09-13T18:48:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.005+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff006b170 con 0x7efff015e030 2024-09-13T18:48:18.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.009+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7effec00acc0 con 0x7efff015e030 2024-09-13T18:48:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.009+0000 7effea000700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7effd4066730 0x7effd4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.009+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7effec0846c0 con 0x7efff015e030 2024-09-13T18:48:18.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.009+0000 7efff5e00700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7effd4066730 0x7effd4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.009+0000 7efff5e00700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7effd4066730 0x7effd4068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effe40011e0 tx=0x7effe4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.017+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7effec051550 con 0x7efff015e030 2024-09-13T18:48:18.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.201+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efff0151da0 con 0x7efff015e030 2024-09-13T18:48:18.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.201+0000 7effea000700 1 -- 172.21.15.81:0/3013606480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7effec054b70 con 0x7efff015e030 2024-09-13T18:48:18.213 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7effd4066730 msgr2=0x7effd4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7effd4066730 0x7effd4068bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7effe40011e0 tx=0x7effe4009040 comp rx=0 tx=0).stop 2024-09-13T18:48:18.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 msgr2=0x7efff006c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 0x7efff006c5b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effec00cc50 tx=0x7effec00cf60 comp rx=0 tx=0).stop 2024-09-13T18:48:18.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 shutdown_connections 2024-09-13T18:48:18.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7effd4066730 0x7effd4068bf0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efff015e030 0x7efff006c5b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efff0157500 0x7efff006a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 --2- 172.21.15.81:0/3013606480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efff00cd140 0x7efff01486d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 >> 172.21.15.81:0/3013606480 conn(0x7efff006e660 msgr2=0x7efff0070380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 shutdown_connections 2024-09-13T18:48:18.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.205+0000 7efff8800700 1 -- 172.21.15.81:0/3013606480 wait complete. 2024-09-13T18:48:18.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.409+0000 7fdcaee00700 1 Processor -- start 2024-09-13T18:48:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.409+0000 7fdcaee00700 1 -- start start 2024-09-13T18:48:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdcaee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdca80cf3b0 0x7fdca815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdcaee00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca815df90 con 0x7fdca815a6b0 2024-09-13T18:48:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdcaee00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca815aea0 con 0x7fdca80ce280 2024-09-13T18:48:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdcaee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca815e420 con 0x7fdca80cf3b0 2024-09-13T18:48:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdca80cf3b0 0x7fdca815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdca80cf3b0 0x7fdca815a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47380/0 (socket says 172.21.15.81:47380) 2024-09-13T18:48:18.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 -- 172.21.15.81:0/2893844402 learned_addr learned my addr 172.21.15.81:0/2893844402 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 -- 172.21.15.81:0/2893844402 >> v1:172.21.15.178:6789/0 conn(0x7fdca80ce280 legacy=0x7fdca80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 -- 172.21.15.81:0/2893844402 >> v1:172.21.15.81:6789/0 conn(0x7fdca815a6b0 legacy=0x7fdca8070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 -- 172.21.15.81:0/2893844402 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca815d660 con 0x7fdca80cf3b0 2024-09-13T18:48:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca6a00700 1 -- 172.21.15.81:0/2893844402 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975691749 0 0) 0x7fdca815df90 con 0x7fdca815a6b0 2024-09-13T18:48:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca7400700 1 --2- 172.21.15.81:0/2893844402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80cf3b0 0x7fdca815a170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009910 tx=0x7fdc94009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08301126f6e3da1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca6a00700 1 -- 172.21.15.81:0/2893844402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400ba60 con 0x7fdca80cf3b0 2024-09-13T18:48:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca6a00700 1 -- 172.21.15.81:0/2893844402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9400bbc0 con 0x7fdca80cf3b0 2024-09-13T18:48:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.413+0000 7fdca6a00700 1 -- 172.21.15.81:0/2893844402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94009e60 con 0x7fdca80cf3b0 2024-09-13T18:48:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 -- 172.21.15.81:0/2893844402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80cf3b0 msgr2=0x7fdca815a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 --2- 172.21.15.81:0/2893844402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80cf3b0 0x7fdca815a170 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdc94009910 tx=0x7fdc94009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 -- 172.21.15.81:0/2893844402 shutdown_connections 2024-09-13T18:48:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 --2- 172.21.15.81:0/2893844402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80cf3b0 0x7fdca815a170 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 -- 172.21.15.81:0/2893844402 >> 172.21.15.81:0/2893844402 conn(0x7fdca806a570 msgr2=0x7fdca806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 -- 172.21.15.81:0/2893844402 shutdown_connections 2024-09-13T18:48:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.417+0000 7fdcaee00700 1 -- 172.21.15.81:0/2893844402 wait complete. 2024-09-13T18:48:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 Processor -- start 2024-09-13T18:48:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 -- start start 2024-09-13T18:48:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 0x7fdca81f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdca80cf3b0 0x7fdca80acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdca815a6b0 0x7fdca80aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80ad480 con 0x7fdca80ce280 2024-09-13T18:48:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80ad760 con 0x7fdca80cf3b0 2024-09-13T18:48:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcaee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80ada40 con 0x7fdca815a6b0 2024-09-13T18:48:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 0x7fdca81f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 0x7fdca81f0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47392/0 (socket says 172.21.15.81:47392) 2024-09-13T18:48:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 -- 172.21.15.81:0/428315693 learned_addr learned my addr 172.21.15.81:0/428315693 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdcace00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdca815a6b0 0x7fdca80aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7400700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdca80cf3b0 0x7fdca80acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 -- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdca815a6b0 msgr2=0x7fdca80aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdca815a6b0 0x7fdca80aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 -- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdca80cf3b0 msgr2=0x7fdca80acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdca80cf3b0 0x7fdca80acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 -- 172.21.15.81:0/428315693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94009570 con 0x7fdca80ce280 2024-09-13T18:48:18.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7400700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdca80cf3b0 0x7fdca80acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:18.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdca7e00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 0x7fdca81f0460 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c500 tx=0x7fdc9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.421+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980052d0 con 0x7fdca80ce280 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.425+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98005430 con 0x7fdca80ce280 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.425+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980055a0 con 0x7fdca80ce280 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.425+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca80add20 con 0x7fdca80ce280 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.425+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca80ad100 con 0x7fdca80ce280 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.425+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca80ae240 con 0x7fdca80ce280 2024-09-13T18:48:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.429+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc980038e0 con 0x7fdca80ce280 2024-09-13T18:48:18.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.429+0000 7fdc9fe00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc88066730 0x7fdc88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.429+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc98083980 con 0x7fdca80ce280 2024-09-13T18:48:18.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.429+0000 7fdca7400700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc88066730 0x7fdc88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.429+0000 7fdca7400700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc88066730 0x7fdc88068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdca80cf840 tx=0x7fdc94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.433+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdca80ae240 con 0x7fdca80ce280 2024-09-13T18:48:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.613+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdca80ae240 con 0x7fdca80ce280 2024-09-13T18:48:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.613+0000 7fdc9fe00700 1 -- 172.21.15.81:0/428315693 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc98050930 con 0x7fdca80ce280 2024-09-13T18:48:18.623 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.613+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc88066730 msgr2=0x7fdc88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc88066730 0x7fdc88068bf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdca80cf840 tx=0x7fdc94008030 comp rx=0 tx=0).stop 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 msgr2=0x7fdca81f0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 0x7fdca81f0460 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c500 tx=0x7fdc9800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 shutdown_connections 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdc88066730 0x7fdc88068bf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdca815a6b0 0x7fdca80aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdca80cf3b0 0x7fdca80acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 --2- 172.21.15.81:0/428315693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca80ce280 0x7fdca81f0460 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 >> 172.21.15.81:0/428315693 conn(0x7fdca806a570 msgr2=0x7fdca80b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 shutdown_connections 2024-09-13T18:48:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.617+0000 7fdcaee00700 1 -- 172.21.15.81:0/428315693 wait complete. 2024-09-13T18:48:18.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:48:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.805+0000 7f5e80a00700 1 Processor -- start 2024-09-13T18:48:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.805+0000 7f5e80a00700 1 -- start start 2024-09-13T18:48:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.805+0000 7f5e80a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06aaa0 0x7f5e7c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0b3980 0x7f5e7c06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5e7c06cbb0 0x7f5e7c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c0adf90 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7c15e560 con 0x7f5e7c06cbb0 2024-09-13T18:48:18.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c06b3c0 con 0x7f5e7c0b3980 2024-09-13T18:48:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06aaa0 0x7f5e7c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5e7c06aaa0 0x7f5e7c15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47396/0 (socket says 172.21.15.81:47396) 2024-09-13T18:48:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 -- 172.21.15.81:0/901936782 learned_addr learned my addr 172.21.15.81:0/901936782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7b200700 1 --2- 172.21.15.81:0/901936782 >> v2:172.21.15.178:3300/0 conn(0x7f5e7c06cbb0 0x7f5e7c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e73e00700 1 --2- 172.21.15.81:0/901936782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0b3980 0x7f5e7c06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 -- 172.21.15.81:0/901936782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0b3980 msgr2=0x7f5e7c06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 --2- 172.21.15.81:0/901936782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0b3980 0x7f5e7c06ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 -- 172.21.15.81:0/901936782 >> v2:172.21.15.178:3300/0 conn(0x7f5e7c06cbb0 msgr2=0x7f5e7c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 --2- 172.21.15.81:0/901936782 >> v2:172.21.15.178:3300/0 conn(0x7f5e7c06cbb0 0x7f5e7c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 -- 172.21.15.81:0/901936782 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c15d920 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e7a800700 1 --2- 172.21.15.81:0/901936782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c15d310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c06fb90 tx=0x7f5e6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55902b0381b097e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e79e00700 1 -- 172.21.15.81:0/901936782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c011830 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e79e00700 1 -- 172.21.15.81:0/901936782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c011990 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e79e00700 1 -- 172.21.15.81:0/901936782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c011d20 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 -- 172.21.15.81:0/901936782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 msgr2=0x7f5e7c15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 --2- 172.21.15.81:0/901936782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c15d310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c06fb90 tx=0x7f5e6c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 -- 172.21.15.81:0/901936782 shutdown_connections 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 --2- 172.21.15.81:0/901936782 >> v2:172.21.15.178:3300/0 conn(0x7f5e7c06cbb0 0x7f5e7c06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 --2- 172.21.15.81:0/901936782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c0b3980 0x7f5e7c06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 --2- 172.21.15.81:0/901936782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c15d310 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.809+0000 7f5e80a00700 1 -- 172.21.15.81:0/901936782 >> 172.21.15.81:0/901936782 conn(0x7f5e7c0b0c40 msgr2=0x7f5e7c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.813+0000 7f5e80a00700 1 -- 172.21.15.81:0/901936782 shutdown_connections 2024-09-13T18:48:18.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.813+0000 7f5e80a00700 1 -- 172.21.15.81:0/901936782 wait complete. 2024-09-13T18:48:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.813+0000 7f5e80a00700 1 Processor -- start 2024-09-13T18:48:18.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.813+0000 7f5e80a00700 1 -- start start 2024-09-13T18:48:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c13fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c06cbb0 0x7f5e7c144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c0b3980 0x7f5e7c1460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c143880 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c143b60 con 0x7f5e7c0b3980 2024-09-13T18:48:18.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7c143e40 con 0x7f5e7c06cbb0 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c13fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c13fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47398/0 (socket says 172.21.15.81:47398) 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 -- 172.21.15.81:0/1023600116 learned_addr learned my addr 172.21.15.81:0/1023600116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7b200700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c0b3980 0x7f5e7c1460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e73e00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c06cbb0 0x7f5e7c144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 -- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c06cbb0 msgr2=0x7f5e7c144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c06cbb0 0x7f5e7c144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 -- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c0b3980 msgr2=0x7f5e7c1460e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c0b3980 0x7f5e7c1460e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 -- 172.21.15.81:0/1023600116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009570 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e7a800700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c13fe10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0b1690 tx=0x7f5e6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c0044d0 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c01f070 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7c144120 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c003900 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.817+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7c1453c0 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.821+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7c145550 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.821+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e6c003a60 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.821+0000 7f5e72a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e58066730 0x7f5e58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.821+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e6c021070 con 0x7f5e7c06aaa0 2024-09-13T18:48:18.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.821+0000 7f5e73e00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e58066730 0x7f5e58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.821+0000 7f5e73e00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e58066730 0x7f5e58068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c140350 tx=0x7f5e64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:18.829+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e6c0528c0 con 0x7f5e7c06aaa0 2024-09-13T18:48:19.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.025+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5e7c144e60 con 0x7f5e7c06aaa0 2024-09-13T18:48:19.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.025+0000 7f5e72a00700 1 -- 172.21.15.81:0/1023600116 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5e6c00bea0 con 0x7f5e7c06aaa0 2024-09-13T18:48:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.025+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e58066730 msgr2=0x7f5e58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.025+0000 7f5e80a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e58066730 0x7f5e58068bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c140350 tx=0x7f5e64008040 comp rx=0 tx=0).stop 2024-09-13T18:48:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 msgr2=0x7f5e7c13fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c13fe10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0b1690 tx=0x7f5e6c004770 comp rx=0 tx=0).stop 2024-09-13T18:48:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 shutdown_connections 2024-09-13T18:48:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5e58066730 0x7f5e58068bf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e7c0b3980 0x7f5e7c1460e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e7c06cbb0 0x7f5e7c144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 --2- 172.21.15.81:0/1023600116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e7c06aaa0 0x7f5e7c13fe10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 >> 172.21.15.81:0/1023600116 conn(0x7f5e7c0b0c40 msgr2=0x7f5e7c15fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 shutdown_connections 2024-09-13T18:48:19.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.029+0000 7f5e80a00700 1 -- 172.21.15.81:0/1023600116 wait complete. 2024-09-13T18:48:19.040 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:48:19.058 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:48:19.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:19.058 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T18:48:19.112 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:48:19.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:19.112 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:48:19.135 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:19.135 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:19.152 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:19.152 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:19.210 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:19.210 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:19.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:19.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 Processor -- start 2024-09-13T18:48:19.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 -- start start 2024-09-13T18:48:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd1c15e070 0x7fcd1c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd1c0b2c50 0x7fcd1c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c0cd970 con 0x7fcd1c0d10f0 2024-09-13T18:48:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c15e450 con 0x7fcd1c0b2c50 2024-09-13T18:48:19.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c0d0050 con 0x7fcd1c15e070 2024-09-13T18:48:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd1c0b2c50 0x7fcd1c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd1c0b2c50 0x7fcd1c0b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47402/0 (socket says 172.21.15.81:47402) 2024-09-13T18:48:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 -- 172.21.15.81:0/2649233374 learned_addr learned my addr 172.21.15.81:0/2649233374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd1be00700 1 --2- 172.21.15.81:0/2649233374 >> v2:172.21.15.178:3300/0 conn(0x7fcd1c15e070 0x7fcd1c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 -- 172.21.15.81:0/2649233374 >> v2:172.21.15.178:3300/0 conn(0x7fcd1c15e070 msgr2=0x7fcd1c0cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 --2- 172.21.15.81:0/2649233374 >> v2:172.21.15.178:3300/0 conn(0x7fcd1c15e070 0x7fcd1c0cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 -- 172.21.15.81:0/2649233374 >> v1:172.21.15.81:6789/0 conn(0x7fcd1c0d10f0 legacy=0x7fcd1c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 -- 172.21.15.81:0/2649233374 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c0d0330 con 0x7fcd1c0b2c50 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.481+0000 7fcd21200700 1 --2- 172.21.15.81:0/2649233374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0b38b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0d1ac0 tx=0x7fcd1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26403b956d0f6440 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd1aa00700 1 -- 172.21.15.81:0/2649233374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400e070 con 0x7fcd1c0b2c50 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd1aa00700 1 -- 172.21.15.81:0/2649233374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1400b910 con 0x7fcd1c0b2c50 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd1aa00700 1 -- 172.21.15.81:0/2649233374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400bcc0 con 0x7fcd1c0b2c50 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 -- 172.21.15.81:0/2649233374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c0b2c50 msgr2=0x7fcd1c0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 --2- 172.21.15.81:0/2649233374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0b38b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0d1ac0 tx=0x7fcd1400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 -- 172.21.15.81:0/2649233374 shutdown_connections 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 --2- 172.21.15.81:0/2649233374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0b38b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 --2- 172.21.15.81:0/2649233374 >> v2:172.21.15.178:3300/0 conn(0x7fcd1c15e070 0x7fcd1c0cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 -- 172.21.15.81:0/2649233374 >> 172.21.15.81:0/2649233374 conn(0x7fcd1c071f00 msgr2=0x7fcd1c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 -- 172.21.15.81:0/2649233374 shutdown_connections 2024-09-13T18:48:19.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.485+0000 7fcd21c00700 1 -- 172.21.15.81:0/2649233374 wait complete. 2024-09-13T18:48:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 Processor -- start 2024-09-13T18:48:19.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 -- start start 2024-09-13T18:48:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd1c0d10f0 0x7fcd1c15cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 0x7fcd1c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0c65e0 con 0x7fcd1c15e070 2024-09-13T18:48:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0a89a0 con 0x7fcd1c0b2c50 2024-09-13T18:48:19.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0ace40 con 0x7fcd1c0d10f0 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 0x7fcd1c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 0x7fcd1c0c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47412/0 (socket says 172.21.15.81:47412) 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 -- 172.21.15.81:0/1856046499 learned_addr learned my addr 172.21.15.81:0/1856046499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd1be00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd1b400700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd1c0d10f0 0x7fcd1c15cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 -- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd1c0d10f0 msgr2=0x7fcd1c15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd1c0d10f0 0x7fcd1c15cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 -- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd1c0b2c50 msgr2=0x7fcd1c0ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 -- 172.21.15.81:0/1856046499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009b30 con 0x7fcd1c15e070 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd1b400700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd1c0d10f0 0x7fcd1c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.489+0000 7fcd21200700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 0x7fcd1c0c55a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c072b20 tx=0x7fcd14004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14004930 con 0x7fcd1c15e070 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd140099b0 con 0x7fcd1c15e070 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c0c6020 con 0x7fcd1c15e070 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1401b670 con 0x7fcd1c15e070 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c0a8630 con 0x7fcd1c15e070 2024-09-13T18:48:19.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c0a8490 con 0x7fcd1c15e070 2024-09-13T18:48:19.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.493+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd1401b7d0 con 0x7fcd1c15e070 2024-09-13T18:48:19.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.497+0000 7fcd13e00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fccfc066760 0x7fccfc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.497+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcd14085a80 con 0x7fcd1c15e070 2024-09-13T18:48:19.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.497+0000 7fcd1be00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fccfc066760 0x7fccfc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.497+0000 7fcd1be00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fccfc066760 0x7fccfc068c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009b50 tx=0x7fcd0c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.505+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd1c0a8490 con 0x7fcd1c15e070 2024-09-13T18:48:19.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.693+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd1c0a8490 con 0x7fcd1c15e070 2024-09-13T18:48:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.697+0000 7fcd13e00700 1 -- 172.21.15.81:0/1856046499 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7fcd1c0a8490 con 0x7fcd1c15e070 2024-09-13T18:48:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:19.707 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:19.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fccfc066760 msgr2=0x7fccfc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fccfc066760 0x7fccfc068c20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009b50 tx=0x7fcd0c009240 comp rx=0 tx=0).stop 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 msgr2=0x7fcd1c0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 0x7fcd1c0c55a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c072b20 tx=0x7fcd14004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 shutdown_connections 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fccfc066760 0x7fccfc068c20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c15e070 0x7fcd1c0c55a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd1c0d10f0 0x7fcd1c15cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 --2- 172.21.15.81:0/1856046499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd1c0b2c50 0x7fcd1c0ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 >> 172.21.15.81:0/1856046499 conn(0x7fcd1c071f00 msgr2=0x7fcd1c0b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 shutdown_connections 2024-09-13T18:48:19.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.701+0000 7fcd21c00700 1 -- 172.21.15.81:0/1856046499 wait complete. 2024-09-13T18:48:19.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:19.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:19.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.897+0000 7f2dc4e00700 1 Processor -- start 2024-09-13T18:48:19.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.897+0000 7f2dc4e00700 1 -- start start 2024-09-13T18:48:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dc4e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2dc0149eb0 0x7f2dc014ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dc4e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2dc014a290 0x7f2dc0070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dc4e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc0071250 con 0x7f2dc00cce40 2024-09-13T18:48:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dc4e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc0071480 con 0x7f2dc0149eb0 2024-09-13T18:48:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dc4e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc0071760 con 0x7f2dc014a290 2024-09-13T18:48:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2dc0149eb0 0x7f2dc014ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbfe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2dc00cce40 0x7f2dc0066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41248/0 (socket says 172.21.15.81:41248) 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbfe00700 1 -- 172.21.15.81:0/1415026401 learned_addr learned my addr 172.21.15.81:0/1415026401 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbea00700 1 --2- 172.21.15.81:0/1415026401 >> v2:172.21.15.178:3300/0 conn(0x7f2dc014a290 0x7f2dc0070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbe000700 1 -- 172.21.15.81:0/1415026401 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018772642 0 0) 0x7f2dc0071250 con 0x7f2dc00cce40 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbe000700 1 -- 172.21.15.81:0/1415026401 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da40035d0 con 0x7f2dc00cce40 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbf400700 1 -- 172.21.15.81:0/1415026401 >> v2:172.21.15.178:3300/0 conn(0x7f2dc014a290 msgr2=0x7f2dc0070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbf400700 1 --2- 172.21.15.81:0/1415026401 >> v2:172.21.15.178:3300/0 conn(0x7f2dc014a290 0x7f2dc0070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbf400700 1 -- 172.21.15.81:0/1415026401 >> v1:172.21.15.81:6789/0 conn(0x7f2dc00cce40 legacy=0x7f2dc0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.901+0000 7f2dbf400700 1 -- 172.21.15.81:0/1415026401 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc0071a40 con 0x7f2dc0149eb0 2024-09-13T18:48:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dbf400700 1 --2- 172.21.15.81:0/1415026401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc0149eb0 0x7f2dc014ab70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00af6d0 tx=0x7f2db0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739c8983859fc958 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dbe000700 1 -- 172.21.15.81:0/1415026401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0011830 con 0x7f2dc0149eb0 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dbe000700 1 -- 172.21.15.81:0/1415026401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db0011990 con 0x7f2dc0149eb0 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dbe000700 1 -- 172.21.15.81:0/1415026401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db0011d00 con 0x7f2dc0149eb0 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 -- 172.21.15.81:0/1415026401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc0149eb0 msgr2=0x7f2dc014ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/1415026401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc0149eb0 0x7f2dc014ab70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00af6d0 tx=0x7f2db0009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 -- 172.21.15.81:0/1415026401 shutdown_connections 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/1415026401 >> v2:172.21.15.178:3300/0 conn(0x7f2dc014a290 0x7f2dc0070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/1415026401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc0149eb0 0x7f2dc014ab70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 -- 172.21.15.81:0/1415026401 >> 172.21.15.81:0/1415026401 conn(0x7f2dc006cbe0 msgr2=0x7f2dc006cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 -- 172.21.15.81:0/1415026401 shutdown_connections 2024-09-13T18:48:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.905+0000 7f2dc4e00700 1 -- 172.21.15.81:0/1415026401 wait complete. 2024-09-13T18:48:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 Processor -- start 2024-09-13T18:48:19.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 -- start start 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2dc00cce40 0x7f2dc00ad050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2dc0149eb0 0x7f2dc0160730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 0x7f2dc00cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00ae4b0 con 0x7f2dc014a290 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00ad8a0 con 0x7f2dc00cce40 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dc4e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00adb80 con 0x7f2dc0149eb0 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 0x7f2dc00cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 0x7f2dc00cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47430/0 (socket says 172.21.15.81:47430) 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 -- 172.21.15.81:0/2284082470 learned_addr learned my addr 172.21.15.81:0/2284082470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbea00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2dc0149eb0 0x7f2dc0160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbf400700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2dc00cce40 0x7f2dc00ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 -- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2dc0149eb0 msgr2=0x7f2dc0160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2dc0149eb0 0x7f2dc0160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 -- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2dc00cce40 msgr2=0x7f2dc00ad050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2dc00cce40 0x7f2dc00ad050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.909+0000 7f2dbfe00700 1 -- 172.21.15.81:0/2284082470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00094b0 con 0x7f2dc014a290 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2dbfe00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 0x7f2dc00cd830 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2db800cb40 tx=0x7f2db800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db800a9e0 con 0x7f2dc014a290 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db800ab40 con 0x7f2dc014a290 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db800ce60 con 0x7f2dc014a290 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc00ade60 con 0x7f2dc014a290 2024-09-13T18:48:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc00ad590 con 0x7f2dc014a290 2024-09-13T18:48:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.913+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc00ae660 con 0x7f2dc014a290 2024-09-13T18:48:19.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.917+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2db801b3b0 con 0x7f2dc014a290 2024-09-13T18:48:19.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.917+0000 7f2db7400700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2da0066730 0x7f2da0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.917+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2db8084080 con 0x7f2dc014a290 2024-09-13T18:48:19.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.917+0000 7f2dbf400700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2da0066730 0x7f2da0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.917+0000 7f2dbf400700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2da0066730 0x7f2da0068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2db0000c00 tx=0x7f2db0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:19.925+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2db80b5db0 con 0x7f2dc014a290 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.105+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dc014ab70 con 0x7f2dc014a290 2024-09-13T18:48:20.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.105+0000 7f2db7400700 1 -- 172.21.15.81:0/2284082470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2db80170a0 con 0x7f2dc014a290 2024-09-13T18:48:20.116 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2da0066730 msgr2=0x7f2da0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2da0066730 0x7f2da0068bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2db0000c00 tx=0x7f2db0008030 comp rx=0 tx=0).stop 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 msgr2=0x7f2dc00cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 0x7f2dc00cd830 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2db800cb40 tx=0x7f2db800cc20 comp rx=0 tx=0).stop 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 shutdown_connections 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2da0066730 0x7f2da0068bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2dc014a290 0x7f2dc00cd830 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2dc0149eb0 0x7f2dc0160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 --2- 172.21.15.81:0/2284082470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2dc00cce40 0x7f2dc00ad050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.109+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 >> 172.21.15.81:0/2284082470 conn(0x7f2dc006cbe0 msgr2=0x7f2dc00680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.113+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 shutdown_connections 2024-09-13T18:48:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.113+0000 7f2dc4e00700 1 -- 172.21.15.81:0/2284082470 wait complete. 2024-09-13T18:48:20.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.309+0000 7f03f2e00700 1 Processor -- start 2024-09-13T18:48:20.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.309+0000 7f03f2e00700 1 -- start start 2024-09-13T18:48:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.309+0000 7f03f2e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec0b36d0 0x7f03ec160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f2e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f03ec0cf3c0 0x7f03ec0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f2e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ec0ce1f0 con 0x7f03ec1601b0 2024-09-13T18:48:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f2e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03ec0d0710 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f2e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec160590 con 0x7f03ec0b36d0 2024-09-13T18:48:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03ec1601b0 0x7f03ec160840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41260/0 (socket says 172.21.15.81:41260) 2024-09-13T18:48:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1a00700 1 -- 172.21.15.81:0/2676435341 learned_addr learned my addr 172.21.15.81:0/2676435341 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1000700 1 --2- 172.21.15.81:0/2676435341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec0b36d0 0x7f03ec160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f2400700 1 --2- 172.21.15.81:0/2676435341 >> v2:172.21.15.178:3300/0 conn(0x7f03ec0cf3c0 0x7f03ec0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03ebe00700 1 -- 172.21.15.81:0/2676435341 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206365334 0 0) 0x7f03ec0ce1f0 con 0x7f03ec1601b0 2024-09-13T18:48:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03ebe00700 1 -- 172.21.15.81:0/2676435341 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d40035d0 con 0x7f03ec1601b0 2024-09-13T18:48:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03ebe00700 1 -- 172.21.15.81:0/2676435341 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2008088605 0 0) 0x7f03d40035d0 con 0x7f03ec1601b0 2024-09-13T18:48:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1000700 1 -- 172.21.15.81:0/2676435341 >> v2:172.21.15.178:3300/0 conn(0x7f03ec0cf3c0 msgr2=0x7f03ec0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1000700 1 --2- 172.21.15.81:0/2676435341 >> v2:172.21.15.178:3300/0 conn(0x7f03ec0cf3c0 0x7f03ec0cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1000700 1 -- 172.21.15.81:0/2676435341 >> v1:172.21.15.81:6789/0 conn(0x7f03ec1601b0 legacy=0x7f03ec160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1000700 1 -- 172.21.15.81:0/2676435341 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec0b3cb0 con 0x7f03ec0b36d0 2024-09-13T18:48:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f2400700 1 --2- 172.21.15.81:0/2676435341 >> v2:172.21.15.178:3300/0 conn(0x7f03ec0cf3c0 0x7f03ec0cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03f1000700 1 --2- 172.21.15.81:0/2676435341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec0b36d0 0x7f03ec160f50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009850 tx=0x7f03d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=269ff3a883ec5320 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03ebe00700 1 -- 172.21.15.81:0/2676435341 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0001670 con 0x7f03ec0b36d0 2024-09-13T18:48:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03ebe00700 1 -- 172.21.15.81:0/2676435341 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8004030 con 0x7f03ec0b36d0 2024-09-13T18:48:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.313+0000 7f03ebe00700 1 -- 172.21.15.81:0/2676435341 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80043e0 con 0x7f03ec0b36d0 2024-09-13T18:48:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 -- 172.21.15.81:0/2676435341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec0b36d0 msgr2=0x7f03ec160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 --2- 172.21.15.81:0/2676435341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec0b36d0 0x7f03ec160f50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009850 tx=0x7f03d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 -- 172.21.15.81:0/2676435341 shutdown_connections 2024-09-13T18:48:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 --2- 172.21.15.81:0/2676435341 >> v2:172.21.15.178:3300/0 conn(0x7f03ec0cf3c0 0x7f03ec0cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 --2- 172.21.15.81:0/2676435341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec0b36d0 0x7f03ec160f50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 -- 172.21.15.81:0/2676435341 >> 172.21.15.81:0/2676435341 conn(0x7f03ec0d2b40 msgr2=0x7f03ec0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 -- 172.21.15.81:0/2676435341 shutdown_connections 2024-09-13T18:48:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 -- 172.21.15.81:0/2676435341 wait complete. 2024-09-13T18:48:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 Processor -- start 2024-09-13T18:48:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.317+0000 7f03f2e00700 1 -- start start 2024-09-13T18:48:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03ec0b36d0 0x7f03ec0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 0x7f03ec0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec1601b0 0x7f03ec149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec1598d0 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0ccc70 con 0x7f03ec0b36d0 2024-09-13T18:48:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec0cc060 con 0x7f03ec1601b0 2024-09-13T18:48:20.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 0x7f03ec0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 0x7f03ec0c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47440/0 (socket says 172.21.15.81:47440) 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 -- 172.21.15.81:0/4088084433 learned_addr learned my addr 172.21.15.81:0/4088084433 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2400700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec1601b0 0x7f03ec149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1a00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03ec0b36d0 0x7f03ec0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 -- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec1601b0 msgr2=0x7f03ec149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec1601b0 0x7f03ec149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 -- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03ec0b36d0 msgr2=0x7f03ec0cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03ec0b36d0 0x7f03ec0cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 -- 172.21.15.81:0/4088084433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4009a70 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f1000700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 0x7f03ec0c6a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f03d8000c00 tx=0x7f03d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8003b70 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80094b0 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d801f070 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8011630 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.321+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec0cc620 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.325+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec0cf830 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.325+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03d8021030 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.325+0000 7f03e9600700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03cc066730 0x7f03cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.325+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f03d80856e0 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.325+0000 7f03f1a00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03cc066730 0x7f03cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.329+0000 7f03f1a00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03cc066730 0x7f03cc068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03e0001820 tx=0x7f03e0001230 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.333+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03d8052720 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.521+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03ec0ccdb0 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.521+0000 7f03e9600700 1 -- 172.21.15.81:0/4088084433 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03d8055d40 con 0x7f03ec0cf3c0 2024-09-13T18:48:20.532 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03cc066730 msgr2=0x7f03cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03cc066730 0x7f03cc068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f03e0001820 tx=0x7f03e0001230 comp rx=0 tx=0).stop 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 msgr2=0x7f03ec0c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 0x7f03ec0c6a00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f03d8000c00 tx=0x7f03d8004770 comp rx=0 tx=0).stop 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 shutdown_connections 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03cc066730 0x7f03cc068bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03ec1601b0 0x7f03ec149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ec0cf3c0 0x7f03ec0c6a00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 --2- 172.21.15.81:0/4088084433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03ec0b36d0 0x7f03ec0cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 >> 172.21.15.81:0/4088084433 conn(0x7f03ec0d2b40 msgr2=0x7f03ec0cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:20.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 shutdown_connections 2024-09-13T18:48:20.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.525+0000 7f03f2e00700 1 -- 172.21.15.81:0/4088084433 wait complete. 2024-09-13T18:48:20.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:20.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.721+0000 7fb27d200700 1 Processor -- start 2024-09-13T18:48:20.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.721+0000 7fb27d200700 1 -- start start 2024-09-13T18:48:20.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb27d200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb278144710 0x7fb278165760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb27d200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27806bcf0 con 0x7fb27806d760 2024-09-13T18:48:20.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb27d200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27806cb50 con 0x7fb278144330 2024-09-13T18:48:20.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb27d200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2780cce10 con 0x7fb278144710 2024-09-13T18:48:20.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb275400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb27806d760 0x7fb2780b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41276/0 (socket says 172.21.15.81:41276) 2024-09-13T18:48:20.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb275400700 1 -- 172.21.15.81:0/3369822166 learned_addr learned my addr 172.21.15.81:0/3369822166 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:20.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb276800700 1 --2- 172.21.15.81:0/3369822166 >> v2:172.21.15.178:3300/0 conn(0x7fb278144710 0x7fb278165760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352369342 0 0) 0x7fb27806bcf0 con 0x7fb27806d760 2024-09-13T18:48:20.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb25c0035d0 con 0x7fb27806d760 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982870181 0 0) 0x7fb27806cb50 con 0x7fb278144330 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb27806bcf0 con 0x7fb278144330 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556295067 0 0) 0x7fb25c0035d0 con 0x7fb27806d760 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 >> v2:172.21.15.178:3300/0 conn(0x7fb278144710 msgr2=0x7fb278165760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 --2- 172.21.15.81:0/3369822166 >> v2:172.21.15.178:3300/0 conn(0x7fb278144710 0x7fb278165760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 >> v1:172.21.15.178:6789/0 conn(0x7fb278144330 legacy=0x7fb2780cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27806bf40 con 0x7fb27806d760 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fb264001670 con 0x7fb27806d760 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 >> v1:172.21.15.81:6789/0 conn(0x7fb27806d760 legacy=0x7fb2780b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb25c003bb0 0x7fb25c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb25c004870 0x7fb25c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb25c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780cce10 con 0x7fb25c005230 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c00c0b0 con 0x7fb25c004870 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.725+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c00c270 con 0x7fb25c003bb0 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb25c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb275400700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb25c004870 0x7fb25c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb275e00700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb25c003bb0 0x7fb25c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 -- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb25c003bb0 msgr2=0x7fb25c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:20.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb25c003bb0 0x7fb25c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 -- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb25c004870 msgr2=0x7fb25c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb25c004870 0x7fb25c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 -- 172.21.15.81:0/3369822166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c0035d0 con 0x7fb25c005230 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 -- 172.21.15.81:0/3369822166 reap_dead start 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb276800700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb25c00ba30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb27806cb00 tx=0x7fb25c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c49900b11fb4d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000e6c0 con 0x7fb25c005230 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000e820 con 0x7fb25c005230 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb274a00700 1 -- 172.21.15.81:0/3369822166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000eb90 con 0x7fb25c005230 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 -- 172.21.15.81:0/3369822166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 msgr2=0x7fb25c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb25c00ba30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb27806cb00 tx=0x7fb25c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 -- 172.21.15.81:0/3369822166 shutdown_connections 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 --2- 172.21.15.81:0/3369822166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb25c00ba30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 -- 172.21.15.81:0/3369822166 >> 172.21.15.81:0/3369822166 conn(0x7fb27806a570 msgr2=0x7fb27806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 -- 172.21.15.81:0/3369822166 shutdown_connections 2024-09-13T18:48:20.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.729+0000 7fb27d200700 1 -- 172.21.15.81:0/3369822166 wait complete. 2024-09-13T18:48:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 Processor -- start 2024-09-13T18:48:20.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 -- start start 2024-09-13T18:48:20.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb278127930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb278142470 0x7fb2781389c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb278151540 0x7fb278152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb278138f00 con 0x7fb25c005230 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb278152a70 con 0x7fb278142470 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb27d200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb278155460 con 0x7fb278151540 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb275e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb278127930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb275e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb278127930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47460/0 (socket says 172.21.15.81:47460) 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.733+0000 7fb275e00700 1 -- 172.21.15.81:0/192570679 learned_addr learned my addr 172.21.15.81:0/192570679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb276800700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb278151540 0x7fb278152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275400700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb278142470 0x7fb2781389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275e00700 1 -- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb278151540 msgr2=0x7fb278152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275e00700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb278151540 0x7fb278152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275e00700 1 -- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb278142470 msgr2=0x7fb2781389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275e00700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb278142470 0x7fb2781389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275e00700 1 -- 172.21.15.81:0/192570679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278152140 con 0x7fb25c005230 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb275e00700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb278127930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb26800d3b0 tx=0x7fb26800d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268001f50 con 0x7fb25c005230 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2680020b0 con 0x7fb25c005230 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268003c60 con 0x7fb25c005230 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb278152420 con 0x7fb25c005230 2024-09-13T18:48:20.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2781519f0 con 0x7fb25c005230 2024-09-13T18:48:20.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.737+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2780708d0 con 0x7fb25c005230 2024-09-13T18:48:20.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.741+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb2680050d0 con 0x7fb25c005230 2024-09-13T18:48:20.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.741+0000 7fb26e000700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb258066760 0x7fb258068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:20.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.741+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb268084ab0 con 0x7fb25c005230 2024-09-13T18:48:20.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.741+0000 7fb275400700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb258066760 0x7fb258068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:20.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.745+0000 7fb275400700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb258066760 0x7fb258068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb264001050 tx=0x7fb264009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:20.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.749+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb268051a50 con 0x7fb25c005230 2024-09-13T18:48:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.929+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2780cf300 con 0x7fb25c005230 2024-09-13T18:48:20.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.929+0000 7fb26e000700 1 -- 172.21.15.81:0/192570679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb268055070 con 0x7fb25c005230 2024-09-13T18:48:20.940 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb258066760 msgr2=0x7fb258068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb258066760 0x7fb258068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb264001050 tx=0x7fb264009040 comp rx=0 tx=0).stop 2024-09-13T18:48:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 msgr2=0x7fb278127930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb278127930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb26800d3b0 tx=0x7fb26800d770 comp rx=0 tx=0).stop 2024-09-13T18:48:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 shutdown_connections 2024-09-13T18:48:20.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb258066760 0x7fb258068c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb278151540 0x7fb278152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb278142470 0x7fb2781389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 --2- 172.21.15.81:0/192570679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c005230 0x7fb278127930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 >> 172.21.15.81:0/192570679 conn(0x7fb27806a570 msgr2=0x7fb2780718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 shutdown_connections 2024-09-13T18:48:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:20.933+0000 7fb27d200700 1 -- 172.21.15.81:0/192570679 wait complete. 2024-09-13T18:48:20.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.129+0000 7f0555a00700 1 Processor -- start 2024-09-13T18:48:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.129+0000 7f0555a00700 1 -- start start 2024-09-13T18:48:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0550145ac0 0x7f0550145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0550146490 0x7f055006b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05500aed70 con 0x7f0550066090 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055006a390 con 0x7f0550145ac0 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055006b600 con 0x7f0550146490 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0550145ac0 0x7f0550145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054f400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0550146490 0x7f055006b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054f400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0550146490 0x7f055006b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:52212/0 (socket says 172.21.15.81:52212) 2024-09-13T18:48:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054f400700 1 -- 172.21.15.81:0/4116659626 learned_addr learned my addr 172.21.15.81:0/4116659626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0550145ac0 0x7f0550145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47470/0 (socket says 172.21.15.81:47470) 2024-09-13T18:48:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 -- 172.21.15.81:0/4116659626 >> v2:172.21.15.178:3300/0 conn(0x7f0550146490 msgr2=0x7f055006b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 --2- 172.21.15.81:0/4116659626 >> v2:172.21.15.178:3300/0 conn(0x7f0550146490 0x7f055006b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 -- 172.21.15.81:0/4116659626 >> v1:172.21.15.178:6789/0 conn(0x7f0550066090 legacy=0x7f05500664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 -- 172.21.15.81:0/4116659626 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055006bc00 con 0x7f0550145ac0 2024-09-13T18:48:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054fe00700 1 --2- 172.21.15.81:0/4116659626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550145ac0 0x7f0550145ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f055006dd70 tx=0x7f0540009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30ecca2b5020983 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054ea00700 1 -- 172.21.15.81:0/4116659626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011830 con 0x7f0550145ac0 2024-09-13T18:48:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054ea00700 1 -- 172.21.15.81:0/4116659626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540011990 con 0x7f0550145ac0 2024-09-13T18:48:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f054ea00700 1 -- 172.21.15.81:0/4116659626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011d20 con 0x7f0550145ac0 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- 172.21.15.81:0/4116659626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550145ac0 msgr2=0x7f0550145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 --2- 172.21.15.81:0/4116659626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550145ac0 0x7f0550145ea0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f055006dd70 tx=0x7f0540009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- 172.21.15.81:0/4116659626 shutdown_connections 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 --2- 172.21.15.81:0/4116659626 >> v2:172.21.15.178:3300/0 conn(0x7f0550146490 0x7f055006b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 --2- 172.21.15.81:0/4116659626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550145ac0 0x7f0550145ea0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- 172.21.15.81:0/4116659626 >> 172.21.15.81:0/4116659626 conn(0x7f0550070d10 msgr2=0x7f05500710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- 172.21.15.81:0/4116659626 shutdown_connections 2024-09-13T18:48:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.137+0000 7f0555a00700 1 -- 172.21.15.81:0/4116659626 wait complete. 2024-09-13T18:48:21.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 Processor -- start 2024-09-13T18:48:21.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 -- start start 2024-09-13T18:48:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 0x7f05500cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0550145ac0 0x7f05500ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0550146490 0x7f055013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500cc660 con 0x7f0550066090 2024-09-13T18:48:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500cc940 con 0x7f0550145ac0 2024-09-13T18:48:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500ccc20 con 0x7f0550146490 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f054fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 0x7f05500cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f054fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 0x7f05500cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47486/0 (socket says 172.21.15.81:47486) 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f054fe00700 1 -- 172.21.15.81:0/2831940797 learned_addr learned my addr 172.21.15.81:0/2831940797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f0555000700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0550146490 0x7f055013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f054f400700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0550145ac0 0x7f05500ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.141+0000 7f054fe00700 1 -- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0550146490 msgr2=0x7f055013b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f054fe00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0550146490 0x7f055013b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f054fe00700 1 -- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0550145ac0 msgr2=0x7f05500ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f054fe00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0550145ac0 0x7f05500ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f054fe00700 1 -- 172.21.15.81:0/2831940797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400094b0 con 0x7f0550066090 2024-09-13T18:48:21.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0555000700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0550146490 0x7f055013b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f054f400700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0550145ac0 0x7f05500ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f054fe00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 0x7f05500cbe10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0540009b70 tx=0x7f0540004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540004530 con 0x7f0550066090 2024-09-13T18:48:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054001f070 con 0x7f0550066090 2024-09-13T18:48:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400038e0 con 0x7f0550066090 2024-09-13T18:48:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05500ccf00 con 0x7f0550066090 2024-09-13T18:48:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05500cd700 con 0x7f0550066090 2024-09-13T18:48:21.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.145+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05500cd420 con 0x7f0550066090 2024-09-13T18:48:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.149+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0540021030 con 0x7f0550066090 2024-09-13T18:48:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.149+0000 7f0547e00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0530066730 0x7f0530068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.149+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0540085960 con 0x7f0550066090 2024-09-13T18:48:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.149+0000 7f054f400700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0530066730 0x7f0530068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.153+0000 7f054f400700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0530066730 0x7f0530068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0550068330 tx=0x7f053c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:21.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.157+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f05500cd420 con 0x7f0550066090 2024-09-13T18:48:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.337+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05500b4730 con 0x7f0550066090 2024-09-13T18:48:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.341+0000 7f0547e00700 1 -- 172.21.15.81:0/2831940797 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0540052900 con 0x7f0550066090 2024-09-13T18:48:21.351 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0530066730 msgr2=0x7f0530068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0530066730 0x7f0530068bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0550068330 tx=0x7f053c008040 comp rx=0 tx=0).stop 2024-09-13T18:48:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 msgr2=0x7f05500cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 0x7f05500cbe10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0540009b70 tx=0x7f0540004770 comp rx=0 tx=0).stop 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 shutdown_connections 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0530066730 0x7f0530068bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0550146490 0x7f055013b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0550145ac0 0x7f05500ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 --2- 172.21.15.81:0/2831940797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0550066090 0x7f05500cbe10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 >> 172.21.15.81:0/2831940797 conn(0x7f0550070d10 msgr2=0x7f0550160660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 shutdown_connections 2024-09-13T18:48:21.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.345+0000 7f0555a00700 1 -- 172.21.15.81:0/2831940797 wait complete. 2024-09-13T18:48:21.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:48:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.537+0000 7fa87de00700 1 Processor -- start 2024-09-13T18:48:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.537+0000 7fa87de00700 1 -- start start 2024-09-13T18:48:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 0x7fa8780cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa878071870 0x7fa87806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780707d0 con 0x7fa87806afe0 2024-09-13T18:48:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87806b490 con 0x7fa878071870 2024-09-13T18:48:21.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780720a0 con 0x7fa878159bd0 2024-09-13T18:48:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa87806afe0 0x7fa8780b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41286/0 (socket says 172.21.15.81:41286) 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87d400700 1 -- 172.21.15.81:0/2238474694 learned_addr learned my addr 172.21.15.81:0/2238474694 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa86fe00700 1 --2- 172.21.15.81:0/2238474694 >> v2:172.21.15.178:3300/0 conn(0x7fa878071870 0x7fa87806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 0x7fa8780cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160020906 0 0) 0x7fa8780707d0 con 0x7fa87806afe0 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85c0035d0 con 0x7fa87806afe0 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255417812 0 0) 0x7fa85c0035d0 con 0x7fa87806afe0 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 msgr2=0x7fa8780cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 0x7fa8780cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 >> v2:172.21.15.178:3300/0 conn(0x7fa878071870 msgr2=0x7fa87806aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 --2- 172.21.15.81:0/2238474694 >> v2:172.21.15.178:3300/0 conn(0x7fa878071870 0x7fa87806aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87806fee0 con 0x7fa87806afe0 2024-09-13T18:48:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fa8700019f0 con 0x7fa87806afe0 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 >> v1:172.21.15.81:6789/0 conn(0x7fa87806afe0 legacy=0x7fa8780b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa85c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 0x7fa85c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa85c004db0 0x7fa85c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87806b490 con 0x7fa85c003ac0 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780720a0 con 0x7fa85c004db0 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c00dc40 con 0x7fa878159bd0 2024-09-13T18:48:21.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa85c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa86fe00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 0x7fa85c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87d400700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa85c004db0 0x7fa85c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 -- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 msgr2=0x7fa85c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878159bd0 0x7fa85c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 -- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa85c004db0 msgr2=0x7fa85c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa85c004db0 0x7fa85c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 -- 172.21.15.81:0/2238474694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c0035d0 con 0x7fa85c003ac0 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87ca00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa85c003ee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa868009b70 tx=0x7fa85c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a8e6e71cfe5d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800e6c0 con 0x7fa85c003ac0 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86800e820 con 0x7fa85c003ac0 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa877e00700 1 -- 172.21.15.81:0/2238474694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800eb90 con 0x7fa85c003ac0 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- 172.21.15.81:0/2238474694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 msgr2=0x7fa85c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 --2- 172.21.15.81:0/2238474694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa85c003ee0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa868009b70 tx=0x7fa85c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87d400700 1 -- 172.21.15.81:0/2238474694 reap_dead start 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- 172.21.15.81:0/2238474694 shutdown_connections 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- 172.21.15.81:0/2238474694 >> 172.21.15.81:0/2238474694 conn(0x7fa8780b0c40 msgr2=0x7fa87806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- 172.21.15.81:0/2238474694 shutdown_connections 2024-09-13T18:48:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.545+0000 7fa87de00700 1 -- 172.21.15.81:0/2238474694 wait complete. 2024-09-13T18:48:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 Processor -- start 2024-09-13T18:48:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 -- start start 2024-09-13T18:48:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa8781e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878150a60 0x7fa87814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87814f150 0x7fa87814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87814fb10 con 0x7fa85c003ac0 2024-09-13T18:48:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa878159fb0 con 0x7fa87814f150 2024-09-13T18:48:21.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87814d510 con 0x7fa878150a60 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa8781e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa8781e7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47500/0 (socket says 172.21.15.81:47500) 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 -- 172.21.15.81:0/3976423485 learned_addr learned my addr 172.21.15.81:0/3976423485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa86fe00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878150a60 0x7fa87814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87d400700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87814f150 0x7fa87814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 -- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878150a60 msgr2=0x7fa87814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878150a60 0x7fa87814ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 -- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87814f150 msgr2=0x7fa87814f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87814f150 0x7fa87814f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 -- 172.21.15.81:0/3976423485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87815a200 con 0x7fa85c003ac0 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa86fe00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878150a60 0x7fa87814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:21.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87ca00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa8781e7c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0047a0 tx=0x7fa8680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86800e6c0 con 0x7fa85c003ac0 2024-09-13T18:48:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa868013e90 con 0x7fa85c003ac0 2024-09-13T18:48:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.549+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87815a4e0 con 0x7fa85c003ac0 2024-09-13T18:48:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.553+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868004290 con 0x7fa85c003ac0 2024-09-13T18:48:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.553+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87815aaa0 con 0x7fa85c003ac0 2024-09-13T18:48:21.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.553+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8780673f0 con 0x7fa85c003ac0 2024-09-13T18:48:21.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.553+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8680043f0 con 0x7fa85c003ac0 2024-09-13T18:48:21.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.557+0000 7fa875600700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa854066730 0x7fa854068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:21.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.557+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa868085d70 con 0x7fa85c003ac0 2024-09-13T18:48:21.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.557+0000 7fa86fe00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa854066730 0x7fa854068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:21.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.557+0000 7fa86fe00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa854066730 0x7fa854068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa87814d6f0 tx=0x7fa860008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.561+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa868052e30 con 0x7fa85c003ac0 2024-09-13T18:48:21.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.757+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa87806aaa0 con 0x7fa85c003ac0 2024-09-13T18:48:21.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa875600700 1 -- 172.21.15.81:0/3976423485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa868056450 con 0x7fa85c003ac0 2024-09-13T18:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa854066730 msgr2=0x7fa854068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa854066730 0x7fa854068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa87814d6f0 tx=0x7fa860008040 comp rx=0 tx=0).stop 2024-09-13T18:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 msgr2=0x7fa8781e7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:21.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa8781e7c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0047a0 tx=0x7fa8680047e0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 shutdown_connections 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa854066730 0x7fa854068bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87814f150 0x7fa87814f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa878150a60 0x7fa87814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 --2- 172.21.15.81:0/3976423485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa85c003ac0 0x7fa8781e7c90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 >> 172.21.15.81:0/3976423485 conn(0x7fa8780b0c40 msgr2=0x7fa87806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 shutdown_connections 2024-09-13T18:48:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:21.761+0000 7fa87de00700 1 -- 172.21.15.81:0/3976423485 wait complete. 2024-09-13T18:48:21.776 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:48:21.793 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T18:48:21.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T18:48:21.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:48:21.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.828 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:48:21.892 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:21.892 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:21.910 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:21.911 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:21.966 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:48:21.967 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:22.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.205+0000 7f9764e00700 1 Processor -- start 2024-09-13T18:48:22.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.205+0000 7f9764e00700 1 -- start start 2024-09-13T18:48:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97601446c0 0x7f97600b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97600b4d10 con 0x7f97600cfcf0 2024-09-13T18:48:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9760144aa0 con 0x7f97600d0af0 2024-09-13T18:48:22.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97600b4100 con 0x7f97601446c0 2024-09-13T18:48:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97601446c0 0x7f97600b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97601446c0 0x7f97600b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47506/0 (socket says 172.21.15.81:47506) 2024-09-13T18:48:22.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 -- 172.21.15.81:0/3448142935 learned_addr learned my addr 172.21.15.81:0/3448142935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975ca00700 1 -- 172.21.15.81:0/3448142935 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017348967 0 0) 0x7f9760144aa0 con 0x7f97600d0af0 2024-09-13T18:48:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 -- 172.21.15.81:0/3448142935 >> v1:172.21.15.178:6789/0 conn(0x7f97600d0af0 legacy=0x7f97600d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 -- 172.21.15.81:0/3448142935 >> v1:172.21.15.81:6789/0 conn(0x7f97600cfcf0 legacy=0x7f97600cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 -- 172.21.15.81:0/3448142935 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600b43e0 con 0x7f97601446c0 2024-09-13T18:48:22.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975de00700 1 --2- 172.21.15.81:0/3448142935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97601446c0 0x7f97600b3a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9750009910 tx=0x7f9750009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6336633b82b933d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975ca00700 1 -- 172.21.15.81:0/3448142935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000ba60 con 0x7f97601446c0 2024-09-13T18:48:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975ca00700 1 -- 172.21.15.81:0/3448142935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000bbc0 con 0x7f97601446c0 2024-09-13T18:48:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f975ca00700 1 -- 172.21.15.81:0/3448142935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750009e60 con 0x7f97601446c0 2024-09-13T18:48:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- 172.21.15.81:0/3448142935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97601446c0 msgr2=0x7f97600b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 --2- 172.21.15.81:0/3448142935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97601446c0 0x7f97600b3a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9750009910 tx=0x7f9750009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- 172.21.15.81:0/3448142935 shutdown_connections 2024-09-13T18:48:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 --2- 172.21.15.81:0/3448142935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97601446c0 0x7f97600b3a70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- 172.21.15.81:0/3448142935 >> 172.21.15.81:0/3448142935 conn(0x7f97600726d0 msgr2=0x7f976006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- 172.21.15.81:0/3448142935 shutdown_connections 2024-09-13T18:48:22.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.213+0000 7f9764e00700 1 -- 172.21.15.81:0/3448142935 wait complete. 2024-09-13T18:48:22.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 Processor -- start 2024-09-13T18:48:22.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 -- start start 2024-09-13T18:48:22.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 0x7f97601f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97600d0af0 0x7f976015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97601446c0 0x7f97600c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760142840 con 0x7f97600cfcf0 2024-09-13T18:48:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97601f7020 con 0x7f97601446c0 2024-09-13T18:48:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f9764e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9760140750 con 0x7f97600d0af0 2024-09-13T18:48:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f975de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 0x7f97601f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f975de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 0x7f97601f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47522/0 (socket says 172.21.15.81:47522) 2024-09-13T18:48:22.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f975de00700 1 -- 172.21.15.81:0/2332092637 learned_addr learned my addr 172.21.15.81:0/2332092637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:22.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.217+0000 7f975e800700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97601446c0 0x7f97600c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975de00700 1 -- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97600d0af0 msgr2=0x7f976015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975de00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97600d0af0 0x7f976015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975de00700 1 -- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97601446c0 msgr2=0x7f97600c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975de00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97601446c0 0x7f97600c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975de00700 1 -- 172.21.15.81:0/2332092637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9750009570 con 0x7f97600cfcf0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975e800700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97601446c0 0x7f97600c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f975de00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 0x7f97601f6ae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9750009150 tx=0x7f9750004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500036c0 con 0x7f97600cfcf0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975001e070 con 0x7f97600cfcf0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750003a60 con 0x7f97600cfcf0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760142180 con 0x7f97600cfcf0 2024-09-13T18:48:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976015e110 con 0x7f97600cfcf0 2024-09-13T18:48:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.221+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9760141fe0 con 0x7f97600cfcf0 2024-09-13T18:48:22.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.225+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9750003bc0 con 0x7f97600cfcf0 2024-09-13T18:48:22.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.225+0000 7f9756000700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9740066730 0x7f9740068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.225+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9750020070 con 0x7f97600cfcf0 2024-09-13T18:48:22.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.225+0000 7f975d400700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9740066730 0x7f9740068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.229+0000 7f975d400700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9740066730 0x7f9740068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f974c000f60 tx=0x7f974c007a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.233+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9760141fe0 con 0x7f97600cfcf0 2024-09-13T18:48:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.421+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9760141fe0 con 0x7f97600cfcf0 2024-09-13T18:48:22.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.425+0000 7f9756000700 1 -- 172.21.15.81:0/2332092637 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f9760141fe0 con 0x7f97600cfcf0 2024-09-13T18:48:22.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:22.435 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.425+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9740066730 msgr2=0x7f9740068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.425+0000 7f9764e00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9740066730 0x7f9740068bf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f974c000f60 tx=0x7f974c007a60 comp rx=0 tx=0).stop 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.425+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 msgr2=0x7f97601f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.425+0000 7f9764e00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 0x7f97601f6ae0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9750009150 tx=0x7f9750004770 comp rx=0 tx=0).stop 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 shutdown_connections 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9740066730 0x7f9740068bf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97601446c0 0x7f97600c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97600d0af0 0x7f976015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 --2- 172.21.15.81:0/2332092637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97600cfcf0 0x7f97601f6ae0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 >> 172.21.15.81:0/2332092637 conn(0x7f97600726d0 msgr2=0x7f97600b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 shutdown_connections 2024-09-13T18:48:22.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.429+0000 7f9764e00700 1 -- 172.21.15.81:0/2332092637 wait complete. 2024-09-13T18:48:22.460 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:22.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.617+0000 7f3d42e00700 1 Processor -- start 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42e00700 1 -- start start 2024-09-13T18:48:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c159660 0x7f3d3c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d3c0b20a0 0x7f3d3c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3c15a020 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c15a300 con 0x7f3d3c0b20a0 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c15a5e0 con 0x7f3d3c159660 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d3c0b20a0 0x7f3d3c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d3c0b20a0 0x7f3d3c071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47532/0 (socket says 172.21.15.81:47532) 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 -- 172.21.15.81:0/1708017278 learned_addr learned my addr 172.21.15.81:0/1708017278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d41a00700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c159660 0x7f3d3c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 -- 172.21.15.81:0/1708017278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c159660 msgr2=0x7f3d3c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c159660 0x7f3d3c159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 -- 172.21.15.81:0/1708017278 >> v1:172.21.15.81:6789/0 conn(0x7f3d3c0b3c20 legacy=0x7f3d3c0b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d42400700 1 -- 172.21.15.81:0/1708017278 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c15a8c0 con 0x7f3d3c0b20a0 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.621+0000 7f3d41a00700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c159660 0x7f3d3c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42400700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b20a0 0x7f3d3c071070 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009e50 tx=0x7f3d3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9594c0a45f44ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d3be00700 1 -- 172.21.15.81:0/1708017278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400bb10 con 0x7f3d3c0b20a0 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d3be00700 1 -- 172.21.15.81:0/1708017278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400bc70 con 0x7f3d3c0b20a0 2024-09-13T18:48:22.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d3be00700 1 -- 172.21.15.81:0/1708017278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011460 con 0x7f3d3c0b20a0 2024-09-13T18:48:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 -- 172.21.15.81:0/1708017278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b20a0 msgr2=0x7f3d3c071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b20a0 0x7f3d3c071070 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009e50 tx=0x7f3d3400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 -- 172.21.15.81:0/1708017278 shutdown_connections 2024-09-13T18:48:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b20a0 0x7f3d3c071070 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1708017278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c159660 0x7f3d3c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 -- 172.21.15.81:0/1708017278 >> 172.21.15.81:0/1708017278 conn(0x7f3d3c06cb90 msgr2=0x7f3d3c06cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 -- 172.21.15.81:0/1708017278 shutdown_connections 2024-09-13T18:48:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.625+0000 7f3d42e00700 1 -- 172.21.15.81:0/1708017278 wait complete. 2024-09-13T18:48:22.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 Processor -- start 2024-09-13T18:48:22.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 -- start start 2024-09-13T18:48:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c0b20a0 0x7f3d3c14fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 0x7f3d3c144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d3c159660 0x7f3d3c0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c144850 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c1569b0 con 0x7f3d3c159660 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c155da0 con 0x7f3d3c0b20a0 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 0x7f3d3c144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 0x7f3d3c144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47540/0 (socket says 172.21.15.81:47540) 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 -- 172.21.15.81:0/1164116441 learned_addr learned my addr 172.21.15.81:0/1164116441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41a00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c0b20a0 0x7f3d3c14fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42400700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d3c159660 0x7f3d3c0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 -- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c0b20a0 msgr2=0x7f3d3c14fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c0b20a0 0x7f3d3c14fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 -- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d3c159660 msgr2=0x7f3d3c0b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d3c159660 0x7f3d3c0b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 -- 172.21.15.81:0/1164116441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d300094b0 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d41000700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 0x7f3d3c144310 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c500 tx=0x7f3d2800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280052d0 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28005430 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.629+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d34009b30 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.633+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280055a0 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.633+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c0b4200 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.633+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c0672a0 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.633+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d280038e0 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.637+0000 7f3d39600700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d1c066730 0x7f3d1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.637+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d28083a20 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.637+0000 7f3d41a00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d1c066730 0x7f3d1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.637+0000 7f3d41a00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d1c066730 0x7f3d1c068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009ce0 tx=0x7f3d30009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.641+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d28050950 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.821+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d3c155150 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.821+0000 7f3d39600700 1 -- 172.21.15.81:0/1164116441 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d28053f70 con 0x7f3d3c0b3c20 2024-09-13T18:48:22.828 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:22.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d1c066730 msgr2=0x7f3d1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d1c066730 0x7f3d1c068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d30009ce0 tx=0x7f3d30009240 comp rx=0 tx=0).stop 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 msgr2=0x7f3d3c144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 0x7f3d3c144310 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800c500 tx=0x7f3d2800c810 comp rx=0 tx=0).stop 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 shutdown_connections 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d1c066730 0x7f3d1c068bf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d3c159660 0x7f3d3c0b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d3c0b3c20 0x7f3d3c144310 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 --2- 172.21.15.81:0/1164116441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d3c0b20a0 0x7f3d3c14fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 >> 172.21.15.81:0/1164116441 conn(0x7f3d3c06cb90 msgr2=0x7f3d3c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 shutdown_connections 2024-09-13T18:48:22.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:22.825+0000 7f3d42e00700 1 -- 172.21.15.81:0/1164116441 wait complete. 2024-09-13T18:48:22.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.013+0000 7f9d7fe00700 1 Processor -- start 2024-09-13T18:48:23.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.013+0000 7f9d7fe00700 1 -- start start 2024-09-13T18:48:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.013+0000 7f9d7fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d801601b0 0x7f9d800b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.013+0000 7f9d7fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800ce1f0 con 0x7f9d801613c0 2024-09-13T18:48:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.013+0000 7f9d7fe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d800d0710 con 0x7f9d80160840 2024-09-13T18:48:23.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.013+0000 7f9d7fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d80160590 con 0x7f9d801601b0 2024-09-13T18:48:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7f400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d801613c0 0x7f9d800cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41304/0 (socket says 172.21.15.81:41304) 2024-09-13T18:48:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7f400700 1 -- 172.21.15.81:0/807092036 learned_addr learned my addr 172.21.15.81:0/807092036 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7ea00700 1 --2- 172.21.15.81:0/807092036 >> v2:172.21.15.178:3300/0 conn(0x7f9d801601b0 0x7f9d800b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655166010 0 0) 0x7f9d800ce1f0 con 0x7f9d801613c0 2024-09-13T18:48:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d640035d0 con 0x7f9d801613c0 2024-09-13T18:48:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185466582 0 0) 0x7f9d800d0710 con 0x7f9d80160840 2024-09-13T18:48:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d800ce1f0 con 0x7f9d80160840 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3627215805 0 0) 0x7f9d640035d0 con 0x7f9d801613c0 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 >> v2:172.21.15.178:3300/0 conn(0x7f9d801601b0 msgr2=0x7f9d800b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 --2- 172.21.15.81:0/807092036 >> v2:172.21.15.178:3300/0 conn(0x7f9d801601b0 0x7f9d800b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 >> v1:172.21.15.178:6789/0 conn(0x7f9d80160840 legacy=0x7f9d80160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800b3cb0 con 0x7f9d801613c0 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f9d780019f0 con 0x7f9d801613c0 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 >> v1:172.21.15.81:6789/0 conn(0x7f9d801613c0 legacy=0x7f9d800cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d64003c00 0x7f9d64004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d64004870 0x7f9d64004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d640052f0 0x7f9d6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d80160590 con 0x7f9d64003c00 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400c230 con 0x7f9d64004870 2024-09-13T18:48:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6400c3f0 con 0x7f9d640052f0 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d64004870 0x7f9d64004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7ea00700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d64003c00 0x7f9d64004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7f400700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d640052f0 0x7f9d6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 -- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d640052f0 msgr2=0x7f9d6400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d640052f0 0x7f9d6400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 -- 172.21.15.81:0/807092036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d64003c00 msgr2=0x7f9d64004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d64003c00 0x7f9d64004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 -- 172.21.15.81:0/807092036 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d640035d0 con 0x7f9d64004870 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d7f400700 1 -- 172.21.15.81:0/807092036 reap_dead start 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.017+0000 7f9d76000700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d64004870 0x7f9d64004cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d68001960 tx=0x7f9d640058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56c4d19c4c290c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68001450 con 0x7f9d64004870 2024-09-13T18:48:23.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d68006aa0 con 0x7f9d64004870 2024-09-13T18:48:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7e000700 1 -- 172.21.15.81:0/807092036 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d68006e50 con 0x7f9d64004870 2024-09-13T18:48:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 -- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d64004870 msgr2=0x7f9d64004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d64004870 0x7f9d64004cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d68001960 tx=0x7f9d640058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 -- 172.21.15.81:0/807092036 shutdown_connections 2024-09-13T18:48:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/807092036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d64004870 0x7f9d64004cf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 -- 172.21.15.81:0/807092036 >> 172.21.15.81:0/807092036 conn(0x7f9d800d2b40 msgr2=0x7f9d800d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 -- 172.21.15.81:0/807092036 shutdown_connections 2024-09-13T18:48:23.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.021+0000 7f9d7fe00700 1 -- 172.21.15.81:0/807092036 wait complete. 2024-09-13T18:48:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 Processor -- start 2024-09-13T18:48:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 -- start start 2024-09-13T18:48:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d64004870 0x7f9d801f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d800b0760 0x7f9d800b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 0x7f9d800ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800b1100 con 0x7f9d800c9c10 2024-09-13T18:48:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800cb510 con 0x7f9d800b0760 2024-09-13T18:48:23.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d800ca900 con 0x7f9d64004870 2024-09-13T18:48:23.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 0x7f9d800ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 0x7f9d800ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47546/0 (socket says 172.21.15.81:47546) 2024-09-13T18:48:23.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 -- 172.21.15.81:0/744687501 learned_addr learned my addr 172.21.15.81:0/744687501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:23.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d76000700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d800b0760 0x7f9d800b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7ea00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d64004870 0x7f9d801f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 -- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d64004870 msgr2=0x7f9d801f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d64004870 0x7f9d801f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 -- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d800b0760 msgr2=0x7f9d800b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d800b0760 0x7f9d800b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.025+0000 7f9d7f400700 1 -- 172.21.15.81:0/744687501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d800cabe0 con 0x7f9d800c9c10 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d7f400700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 0x7f9d800ca090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d8008be10 tx=0x7f9d78001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d780020b0 con 0x7f9d800c9c10 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7800e830 con 0x7f9d800c9c10 2024-09-13T18:48:23.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800ebe0 con 0x7f9d800c9c10 2024-09-13T18:48:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d800caec0 con 0x7f9d800c9c10 2024-09-13T18:48:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d800ca5d0 con 0x7f9d800c9c10 2024-09-13T18:48:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d800b36d0 con 0x7f9d800c9c10 2024-09-13T18:48:23.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.029+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d7800ed40 con 0x7f9d800c9c10 2024-09-13T18:48:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.033+0000 7f9d77400700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d5c066760 0x7f9d5c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.033+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9d78084620 con 0x7f9d800c9c10 2024-09-13T18:48:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.033+0000 7f9d7ea00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d5c066760 0x7f9d5c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.033+0000 7f9d7ea00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d5c066760 0x7f9d5c068c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d80067950 tx=0x7f9d70009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.037+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d78054f30 con 0x7f9d800c9c10 2024-09-13T18:48:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.217+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d8008cc60 con 0x7f9d800c9c10 2024-09-13T18:48:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.217+0000 7f9d77400700 1 -- 172.21.15.81:0/744687501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d78054ac0 con 0x7f9d800c9c10 2024-09-13T18:48:23.225 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d5c066760 msgr2=0x7f9d5c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d5c066760 0x7f9d5c068c20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d80067950 tx=0x7f9d70009240 comp rx=0 tx=0).stop 2024-09-13T18:48:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 msgr2=0x7f9d800ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 0x7f9d800ca090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9d8008be10 tx=0x7f9d78001a20 comp rx=0 tx=0).stop 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 shutdown_connections 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d5c066760 0x7f9d5c068c20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d800c9c10 0x7f9d800ca090 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d800b0760 0x7f9d800b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 --2- 172.21.15.81:0/744687501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d64004870 0x7f9d801f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 >> 172.21.15.81:0/744687501 conn(0x7f9d800d2b40 msgr2=0x7f9d8006c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 shutdown_connections 2024-09-13T18:48:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.221+0000 7f9d7fe00700 1 -- 172.21.15.81:0/744687501 wait complete. 2024-09-13T18:48:23.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:23.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.413+0000 7f03fac00700 1 Processor -- start 2024-09-13T18:48:23.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.413+0000 7f03fac00700 1 -- start start 2024-09-13T18:48:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fac00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03f40cd6f0 0x7f03f40b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fac00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f415e4e0 con 0x7f03f406a390 2024-09-13T18:48:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fac00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f415e7c0 con 0x7f03f40cd6f0 2024-09-13T18:48:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f415eaa0 con 0x7f03f4154df0 2024-09-13T18:48:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03f40cd6f0 0x7f03f40b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03f40cd6f0 0x7f03f40b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47562/0 (socket says 172.21.15.81:47562) 2024-09-13T18:48:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 -- 172.21.15.81:0/3180495980 learned_addr learned my addr 172.21.15.81:0/3180495980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03f9800700 1 --2- 172.21.15.81:0/3180495980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 -- 172.21.15.81:0/3180495980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 msgr2=0x7f03f40b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 --2- 172.21.15.81:0/3180495980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 -- 172.21.15.81:0/3180495980 >> v1:172.21.15.178:6789/0 conn(0x7f03f406a390 legacy=0x7f03f40ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 -- 172.21.15.81:0/3180495980 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f415ed80 con 0x7f03f40cd6f0 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03fa200700 1 --2- 172.21.15.81:0/3180495980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f40cd6f0 0x7f03f40b5330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009e50 tx=0x7f03ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57fbe8bd572866d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03f3e00700 1 -- 172.21.15.81:0/3180495980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00e070 con 0x7f03f40cd6f0 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03f3e00700 1 -- 172.21.15.81:0/3180495980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ec003a40 con 0x7f03f40cd6f0 2024-09-13T18:48:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.417+0000 7f03f3e00700 1 -- 172.21.15.81:0/3180495980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ec003df0 con 0x7f03f40cd6f0 2024-09-13T18:48:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- 172.21.15.81:0/3180495980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f40cd6f0 msgr2=0x7f03f40b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 --2- 172.21.15.81:0/3180495980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f40cd6f0 0x7f03f40b5330 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009e50 tx=0x7f03ec00b330 comp rx=0 tx=0).stop 2024-09-13T18:48:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- 172.21.15.81:0/3180495980 shutdown_connections 2024-09-13T18:48:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 --2- 172.21.15.81:0/3180495980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f40cd6f0 0x7f03f40b5330 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 --2- 172.21.15.81:0/3180495980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- 172.21.15.81:0/3180495980 >> 172.21.15.81:0/3180495980 conn(0x7f03f4070d10 msgr2=0x7f03f40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- 172.21.15.81:0/3180495980 shutdown_connections 2024-09-13T18:48:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- 172.21.15.81:0/3180495980 wait complete. 2024-09-13T18:48:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 Processor -- start 2024-09-13T18:48:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- start start 2024-09-13T18:48:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 0x7f03f40a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40cd6f0 0x7f03f4149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4149880 con 0x7f03f406a390 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40a8480 con 0x7f03f40cd6f0 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.421+0000 7f03fac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40a9000 con 0x7f03f4154df0 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 0x7f03f40a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 0x7f03f40a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47568/0 (socket says 172.21.15.81:47568) 2024-09-13T18:48:23.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 -- 172.21.15.81:0/3094721489 learned_addr learned my addr 172.21.15.81:0/3094721489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:23.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03fa200700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f8e00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40cd6f0 0x7f03f4149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 -- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 msgr2=0x7f03f40b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 -- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40cd6f0 msgr2=0x7f03f4149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40cd6f0 0x7f03f4149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 -- 172.21.15.81:0/3094721489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec009b30 con 0x7f03f406a390 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f9800700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 0x7f03f40a9490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f03e800d800 tx=0x7f03e800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80125f0 con 0x7f03f406a390 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8012750 con 0x7f03f406a390 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40a86d0 con 0x7f03f406a390 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8012b00 con 0x7f03f406a390 2024-09-13T18:48:23.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f40a8c90 con 0x7f03f406a390 2024-09-13T18:48:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.425+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f40ccfe0 con 0x7f03f406a390 2024-09-13T18:48:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.429+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03e8012c60 con 0x7f03f406a390 2024-09-13T18:48:23.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.429+0000 7f03f1600700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03d4066760 0x7f03d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.429+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f03e8084630 con 0x7f03f406a390 2024-09-13T18:48:23.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.429+0000 7f03f8e00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03d4066760 0x7f03d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.433+0000 7f03f8e00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03d4066760 0x7f03d4068c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03f40cbf90 tx=0x7f03e0007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.437+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03e8051540 con 0x7f03f406a390 2024-09-13T18:48:23.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.617+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03f406aad0 con 0x7f03f406a390 2024-09-13T18:48:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.617+0000 7f03f1600700 1 -- 172.21.15.81:0/3094721489 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03e8054b60 con 0x7f03f406a390 2024-09-13T18:48:23.678 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03d4066760 msgr2=0x7f03d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03d4066760 0x7f03d4068c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03f40cbf90 tx=0x7f03e0007ee0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 msgr2=0x7f03f40a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 0x7f03f40a9490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f03e800d800 tx=0x7f03e800db10 comp rx=0 tx=0).stop 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 shutdown_connections 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03d4066760 0x7f03d4068c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03f4154df0 0x7f03f40b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03f40cd6f0 0x7f03f4149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 --2- 172.21.15.81:0/3094721489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f406a390 0x7f03f40a9490 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 >> 172.21.15.81:0/3094721489 conn(0x7f03f4070d10 msgr2=0x7f03f40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 shutdown_connections 2024-09-13T18:48:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.621+0000 7f03fac00700 1 -- 172.21.15.81:0/3094721489 wait complete. 2024-09-13T18:48:23.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.845+0000 7f0806400700 1 Processor -- start 2024-09-13T18:48:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0806400700 1 -- start start 2024-09-13T18:48:23.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0806400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f080006c960 0x7f0800161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0806400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0800162340 con 0x7f08000b1980 2024-09-13T18:48:23.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0806400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000b2280 con 0x7f080006cd40 2024-09-13T18:48:23.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0806400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08000b2560 con 0x7f080006c960 2024-09-13T18:48:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f080006c960 0x7f0800161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f080006c960 0x7f0800161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:52328/0 (socket says 172.21.15.81:52328) 2024-09-13T18:48:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805000700 1 -- 172.21.15.81:0/3950620592 learned_addr learned my addr 172.21.15.81:0/3950620592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08000b1980 0x7f0800162560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41312/0 (socket says 172.21.15.81:41312) 2024-09-13T18:48:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805000700 1 -- 172.21.15.81:0/3950620592 >> v1:172.21.15.178:6789/0 conn(0x7f080006cd40 legacy=0x7f08000b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805000700 1 -- 172.21.15.81:0/3950620592 >> v1:172.21.15.81:6789/0 conn(0x7f08000b1980 legacy=0x7f0800162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.849+0000 7f0805000700 1 -- 172.21.15.81:0/3950620592 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000b2840 con 0x7f080006c960 2024-09-13T18:48:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0805000700 1 --2- 172.21.15.81:0/3950620592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080006c960 0x7f0800161e00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009910 tx=0x7f07f4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdb752da26669274 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f07ff400700 1 -- 172.21.15.81:0/3950620592 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400ba60 con 0x7f080006c960 2024-09-13T18:48:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f07ff400700 1 -- 172.21.15.81:0/3950620592 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400bbc0 con 0x7f080006c960 2024-09-13T18:48:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f07ff400700 1 -- 172.21.15.81:0/3950620592 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4009e60 con 0x7f080006c960 2024-09-13T18:48:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 -- 172.21.15.81:0/3950620592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080006c960 msgr2=0x7f0800161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 --2- 172.21.15.81:0/3950620592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080006c960 0x7f0800161e00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f07f4009910 tx=0x7f07f4009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 -- 172.21.15.81:0/3950620592 shutdown_connections 2024-09-13T18:48:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 --2- 172.21.15.81:0/3950620592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080006c960 0x7f0800161e00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 -- 172.21.15.81:0/3950620592 >> 172.21.15.81:0/3950620592 conn(0x7f080006a390 msgr2=0x7f080006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 -- 172.21.15.81:0/3950620592 shutdown_connections 2024-09-13T18:48:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.853+0000 7f0806400700 1 -- 172.21.15.81:0/3950620592 wait complete. 2024-09-13T18:48:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 Processor -- start 2024-09-13T18:48:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 -- start start 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 0x7f0800157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080006cd40 0x7f0800160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08000b1980 0x7f080015d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080015c240 con 0x7f080006c960 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080015c520 con 0x7f08000b1980 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0806400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080015c800 con 0x7f080006cd40 2024-09-13T18:48:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0805000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 0x7f0800157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0805000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 0x7f0800157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47570/0 (socket says 172.21.15.81:47570) 2024-09-13T18:48:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0805000700 1 -- 172.21.15.81:0/2670718749 learned_addr learned my addr 172.21.15.81:0/2670718749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.857+0000 7f0805a00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08000b1980 0x7f080015d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f07ffe00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080006cd40 0x7f0800160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805000700 1 -- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080006cd40 msgr2=0x7f0800160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805000700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080006cd40 0x7f0800160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805000700 1 -- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08000b1980 msgr2=0x7f080015d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805000700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08000b1980 0x7f080015d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805000700 1 -- 172.21.15.81:0/2670718749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4009570 con 0x7f080006c960 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805a00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08000b1980 0x7f080015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f07ffe00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080006cd40 0x7f0800160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0805000700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 0x7f0800157460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000c00 tx=0x7f07f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40036c0 con 0x7f080006c960 2024-09-13T18:48:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f401f070 con 0x7f080006c960 2024-09-13T18:48:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4003a80 con 0x7f080006c960 2024-09-13T18:48:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080015cae0 con 0x7f080006c960 2024-09-13T18:48:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08001579a0 con 0x7f080006c960 2024-09-13T18:48:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.861+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800161e00 con 0x7f080006c960 2024-09-13T18:48:23.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.865+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07f4003be0 con 0x7f080006c960 2024-09-13T18:48:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.865+0000 7f07fcc00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f07e0066760 0x7f07e0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.865+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07f4021070 con 0x7f080006c960 2024-09-13T18:48:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.865+0000 7f07ffe00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f07e0066760 0x7f07e0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.865+0000 7f07ffe00700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f07e0066760 0x7f07e0068c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08000caeb0 tx=0x7f07ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:23.873+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07f4052f30 con 0x7f080006c960 2024-09-13T18:48:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.069+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08000cca70 con 0x7f080006c960 2024-09-13T18:48:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.069+0000 7f07fcc00700 1 -- 172.21.15.81:0/2670718749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07f402b0a0 con 0x7f080006c960 2024-09-13T18:48:24.075 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f07e0066760 msgr2=0x7f07e0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f07e0066760 0x7f07e0068c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08000caeb0 tx=0x7f07ec009040 comp rx=0 tx=0).stop 2024-09-13T18:48:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 msgr2=0x7f0800157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 0x7f0800157460 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000c00 tx=0x7f07f4004770 comp rx=0 tx=0).stop 2024-09-13T18:48:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 shutdown_connections 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f07e0066760 0x7f07e0068c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08000b1980 0x7f080015d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080006cd40 0x7f0800160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 --2- 172.21.15.81:0/2670718749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080006c960 0x7f0800157460 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 >> 172.21.15.81:0/2670718749 conn(0x7f080006a390 msgr2=0x7f08000ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 shutdown_connections 2024-09-13T18:48:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.073+0000 7f0806400700 1 -- 172.21.15.81:0/2670718749 wait complete. 2024-09-13T18:48:24.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:48:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.273+0000 7f555fe00700 1 Processor -- start 2024-09-13T18:48:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.273+0000 7f555fe00700 1 -- start start 2024-09-13T18:48:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55600ce7f0 0x7f55600cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55600c9720 0x7f556006c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555fe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55600727e0 con 0x7f55600ae690 2024-09-13T18:48:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55600c9b00 con 0x7f55600c9720 2024-09-13T18:48:24.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556015a0f0 con 0x7f55600ce7f0 2024-09-13T18:48:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55600c9720 0x7f556006c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555ea00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f55600ae690 0x7f55600ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:51820/0 (socket says 172.21.15.81:51820) 2024-09-13T18:48:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555ea00700 1 -- 172.21.15.81:0/3434483645 learned_addr learned my addr 172.21.15.81:0/3434483645 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:24.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555e000700 1 --2- 172.21.15.81:0/3434483645 >> v2:172.21.15.178:3300/0 conn(0x7f55600ce7f0 0x7f55600cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555d600700 1 -- 172.21.15.81:0/3434483645 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479545724 0 0) 0x7f55600727e0 con 0x7f55600ae690 2024-09-13T18:48:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555d600700 1 -- 172.21.15.81:0/3434483645 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55440035d0 con 0x7f55600ae690 2024-09-13T18:48:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555f400700 1 -- 172.21.15.81:0/3434483645 >> v2:172.21.15.178:3300/0 conn(0x7f55600ce7f0 msgr2=0x7f55600cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555f400700 1 --2- 172.21.15.81:0/3434483645 >> v2:172.21.15.178:3300/0 conn(0x7f55600ce7f0 0x7f55600cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555f400700 1 -- 172.21.15.81:0/3434483645 >> v1:172.21.15.178:6789/0 conn(0x7f55600ae690 legacy=0x7f55600ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555f400700 1 -- 172.21.15.81:0/3434483645 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600c9ce0 con 0x7f55600c9720 2024-09-13T18:48:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555f400700 1 --2- 172.21.15.81:0/3434483645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600c9720 0x7f556006c580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f55600cba80 tx=0x7f555800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e3515e485b4308 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555d600700 1 -- 172.21.15.81:0/3434483645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800e070 con 0x7f55600c9720 2024-09-13T18:48:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555d600700 1 -- 172.21.15.81:0/3434483645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800bb20 con 0x7f55600c9720 2024-09-13T18:48:24.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.277+0000 7f555d600700 1 -- 172.21.15.81:0/3434483645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558012430 con 0x7f55600c9720 2024-09-13T18:48:24.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 -- 172.21.15.81:0/3434483645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600c9720 msgr2=0x7f556006c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 --2- 172.21.15.81:0/3434483645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600c9720 0x7f556006c580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f55600cba80 tx=0x7f555800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 -- 172.21.15.81:0/3434483645 shutdown_connections 2024-09-13T18:48:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 --2- 172.21.15.81:0/3434483645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600c9720 0x7f556006c580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 --2- 172.21.15.81:0/3434483645 >> v2:172.21.15.178:3300/0 conn(0x7f55600ce7f0 0x7f55600cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 -- 172.21.15.81:0/3434483645 >> 172.21.15.81:0/3434483645 conn(0x7f55600cf0d0 msgr2=0x7f55600cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 -- 172.21.15.81:0/3434483645 shutdown_connections 2024-09-13T18:48:24.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.281+0000 7f555fe00700 1 -- 172.21.15.81:0/3434483645 wait complete. 2024-09-13T18:48:24.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 Processor -- start 2024-09-13T18:48:24.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 -- start start 2024-09-13T18:48:24.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55600ae690 0x7f55600c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c9720 0x7f55601590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 0x7f5560159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c7cf0 con 0x7f55600ce7f0 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c7320 con 0x7f55600c9720 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600c6710 con 0x7f55600ae690 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 0x7f5560159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 0x7f5560159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47596/0 (socket says 172.21.15.81:47596) 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 -- 172.21.15.81:0/1856628180 learned_addr learned my addr 172.21.15.81:0/1856628180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555e000700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c9720 0x7f55601590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555ea00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55600ae690 0x7f55600c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 -- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55600ae690 msgr2=0x7f55600c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55600ae690 0x7f55600c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 -- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c9720 msgr2=0x7f55601590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c9720 0x7f55601590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 -- 172.21.15.81:0/1856628180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009a70 con 0x7f55600ce7f0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555ea00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55600ae690 0x7f55600c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f555f400700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 0x7f5560159630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5558014040 tx=0x7f5558004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.285+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558012430 con 0x7f55600ce7f0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.289+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600c69f0 con 0x7f55600ce7f0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.289+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558020070 con 0x7f55600ce7f0 2024-09-13T18:48:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.289+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558004280 con 0x7f55600ce7f0 2024-09-13T18:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.289+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55600c6fb0 con 0x7f55600ce7f0 2024-09-13T18:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.289+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600c74b0 con 0x7f55600ce7f0 2024-09-13T18:48:24.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.289+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55580043e0 con 0x7f55600ce7f0 2024-09-13T18:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.293+0000 7f5556a00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5540066730 0x7f5540068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.293+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5558022070 con 0x7f55600ce7f0 2024-09-13T18:48:24.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.293+0000 7f555ea00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5540066730 0x7f5540068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.293+0000 7f555ea00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5540066730 0x7f5540068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5550005930 tx=0x7f5550009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.297+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5558053050 con 0x7f55600ce7f0 2024-09-13T18:48:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.493+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f55600cfbf0 con 0x7f55600ce7f0 2024-09-13T18:48:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.493+0000 7f5556a00700 1 -- 172.21.15.81:0/1856628180 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5558056670 con 0x7f55600ce7f0 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5540066730 msgr2=0x7f5540068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5540066730 0x7f5540068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5550005930 tx=0x7f5550009040 comp rx=0 tx=0).stop 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 msgr2=0x7f5560159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 0x7f5560159630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5558014040 tx=0x7f5558004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 shutdown_connections 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5540066730 0x7f5540068bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55600ce7f0 0x7f5560159630 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55600c9720 0x7f55601590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 --2- 172.21.15.81:0/1856628180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55600ae690 0x7f55600c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 >> 172.21.15.81:0/1856628180 conn(0x7f55600cf0d0 msgr2=0x7f55600ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 shutdown_connections 2024-09-13T18:48:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.497+0000 7f555fe00700 1 -- 172.21.15.81:0/1856628180 wait complete. 2024-09-13T18:48:24.506 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:48:24.524 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T18:48:24.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:24.525 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T18:48:24.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:48:24.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:24.570 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:48:24.634 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:48:24.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:24.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.801+0000 7f1bd3e00700 1 Processor -- start 2024-09-13T18:48:24.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.801+0000 7f1bd3e00700 1 -- start start 2024-09-13T18:48:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.805+0000 7f1bd3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40b4ba0 0x7f1bd40ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.805+0000 7f1bd3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bd40ce660 0x7f1bd40ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.805+0000 7f1bd3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40b2fa0 con 0x7f1bd406c880 2024-09-13T18:48:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.805+0000 7f1bd3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40b3280 con 0x7f1bd40ce660 2024-09-13T18:48:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.805+0000 7f1bd3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40b3560 con 0x7f1bd40b4ba0 2024-09-13T18:48:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.805+0000 7f1bd3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bd40ce660 0x7f1bd40ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd2a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1bd406c880 0x7f1bd406cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:51826/0 (socket says 172.21.15.81:51826) 2024-09-13T18:48:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd2a00700 1 -- 172.21.15.81:0/517023607 learned_addr learned my addr 172.21.15.81:0/517023607 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd2000700 1 --2- 172.21.15.81:0/517023607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40b4ba0 0x7f1bd40ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3400700 1 -- 172.21.15.81:0/517023607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40b4ba0 msgr2=0x7f1bd40ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3400700 1 --2- 172.21.15.81:0/517023607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40b4ba0 0x7f1bd40ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3400700 1 -- 172.21.15.81:0/517023607 >> v1:172.21.15.178:6789/0 conn(0x7f1bd406c880 legacy=0x7f1bd406cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd1600700 1 -- 172.21.15.81:0/517023607 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749427886 0 0) 0x7f1bd40b2fa0 con 0x7f1bd406c880 2024-09-13T18:48:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3400700 1 -- 172.21.15.81:0/517023607 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40b3840 con 0x7f1bd40ce660 2024-09-13T18:48:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3400700 1 --2- 172.21.15.81:0/517023607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd40ce660 0x7f1bd40ceab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009d90 tx=0x7f1bcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9925af228d85b01b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd1600700 1 -- 172.21.15.81:0/517023607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc00e070 con 0x7f1bd40ce660 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd1600700 1 -- 172.21.15.81:0/517023607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc00bb20 con 0x7f1bd40ce660 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd1600700 1 -- 172.21.15.81:0/517023607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc012430 con 0x7f1bd40ce660 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 -- 172.21.15.81:0/517023607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd40ce660 msgr2=0x7f1bd40ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/517023607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd40ce660 0x7f1bd40ceab0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009d90 tx=0x7f1bcc00b330 comp rx=0 tx=0).stop 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 -- 172.21.15.81:0/517023607 shutdown_connections 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/517023607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd40ce660 0x7f1bd40ceab0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/517023607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40b4ba0 0x7f1bd40ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 -- 172.21.15.81:0/517023607 >> 172.21.15.81:0/517023607 conn(0x7f1bd406e660 msgr2=0x7f1bd406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 -- 172.21.15.81:0/517023607 shutdown_connections 2024-09-13T18:48:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.809+0000 7f1bd3e00700 1 -- 172.21.15.81:0/517023607 wait complete. 2024-09-13T18:48:24.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 Processor -- start 2024-09-13T18:48:24.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 -- start start 2024-09-13T18:48:24.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 0x7f1bd41e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd40b4ba0 0x7f1bd41e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40ce660 0x7f1bd413afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4138cd0 con 0x7f1bd406c880 2024-09-13T18:48:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4153000 con 0x7f1bd40b4ba0 2024-09-13T18:48:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41532e0 con 0x7f1bd40ce660 2024-09-13T18:48:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 0x7f1bd41e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 0x7f1bd41e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47614/0 (socket says 172.21.15.81:47614) 2024-09-13T18:48:24.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 -- 172.21.15.81:0/3470422287 learned_addr learned my addr 172.21.15.81:0/3470422287 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:24.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2000700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd40b4ba0 0x7f1bd41e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3400700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40ce660 0x7f1bd413afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 -- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40ce660 msgr2=0x7f1bd413afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40ce660 0x7f1bd413afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 -- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd40b4ba0 msgr2=0x7f1bd41e5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd40b4ba0 0x7f1bd41e5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 -- 172.21.15.81:0/3470422287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc009a70 con 0x7f1bd406c880 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd3400700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40ce660 0x7f1bd413afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.813+0000 7f1bd2a00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 0x7f1bd41e4b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c550 tx=0x7f1bc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.817+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004ca0 con 0x7f1bd406c880 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.817+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4004e00 con 0x7f1bd406c880 2024-09-13T18:48:24.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.817+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4007310 con 0x7f1bd406c880 2024-09-13T18:48:24.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.817+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd4139100 con 0x7f1bd406c880 2024-09-13T18:48:24.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.817+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd414c790 con 0x7f1bd406c880 2024-09-13T18:48:24.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.817+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd40cc6b0 con 0x7f1bd406c880 2024-09-13T18:48:24.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.821+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1bc4007470 con 0x7f1bd406c880 2024-09-13T18:48:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.821+0000 7f1bcaa00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bb4066730 0x7f1bb4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.821+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1bc4084330 con 0x7f1bd406c880 2024-09-13T18:48:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.821+0000 7f1bd2000700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bb4066730 0x7f1bb4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.821+0000 7f1bd2000700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bb4066730 0x7f1bb4068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40cf4f0 tx=0x7f1bc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:24.825+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1bc4051240 con 0x7f1bd406c880 2024-09-13T18:48:25.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.049+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bd406d190 con 0x7f1bd406c880 2024-09-13T18:48:25.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bcaa00700 1 -- 172.21.15.81:0/3470422287 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7f1bc4007720 con 0x7f1bd406c880 2024-09-13T18:48:25.058 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:25.058 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:48:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bb4066730 msgr2=0x7f1bb4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bb4066730 0x7f1bb4068bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40cf4f0 tx=0x7f1bc0008040 comp rx=0 tx=0).stop 2024-09-13T18:48:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 msgr2=0x7f1bd41e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 0x7f1bd41e4b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c550 tx=0x7f1bc400c910 comp rx=0 tx=0).stop 2024-09-13T18:48:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 shutdown_connections 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bb4066730 0x7f1bb4068bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bd40ce660 0x7f1bd413afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bd40b4ba0 0x7f1bd41e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 --2- 172.21.15.81:0/3470422287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bd406c880 0x7f1bd41e4b00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 >> 172.21.15.81:0/3470422287 conn(0x7f1bd406e660 msgr2=0x7f1bd406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 shutdown_connections 2024-09-13T18:48:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.053+0000 7f1bd3e00700 1 -- 172.21.15.81:0/3470422287 wait complete. 2024-09-13T18:48:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:48:25.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.237+0000 7f765f200700 1 Processor -- start 2024-09-13T18:48:25.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.237+0000 7f765f200700 1 -- start start 2024-09-13T18:48:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f765f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f76581446c0 0x7f76580b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f765f200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76580b4d10 con 0x7f76580cfcf0 2024-09-13T18:48:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f765f200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658144aa0 con 0x7f76580d0af0 2024-09-13T18:48:25.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f765f200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580b4100 con 0x7f76581446c0 2024-09-13T18:48:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f764fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f76580cfcf0 0x7f76580cc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41324/0 (socket says 172.21.15.81:41324) 2024-09-13T18:48:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f764fe00700 1 -- 172.21.15.81:0/3868315272 learned_addr learned my addr 172.21.15.81:0/3868315272 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:25.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657e00700 1 --2- 172.21.15.81:0/3868315272 >> v2:172.21.15.178:3300/0 conn(0x7f76581446c0 0x7f76580b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434600099 0 0) 0x7f76580b4d10 con 0x7f76580cfcf0 2024-09-13T18:48:25.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f763c0035d0 con 0x7f76580cfcf0 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3388668834 0 0) 0x7f763c0035d0 con 0x7f76580cfcf0 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 >> v2:172.21.15.178:3300/0 conn(0x7f76581446c0 msgr2=0x7f76580b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 --2- 172.21.15.81:0/3868315272 >> v2:172.21.15.178:3300/0 conn(0x7f76581446c0 0x7f76580b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 >> v1:172.21.15.178:6789/0 conn(0x7f76580d0af0 legacy=0x7f76580d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580b43e0 con 0x7f76580cfcf0 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f7640001670 con 0x7f76580cfcf0 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657e00700 1 --2- 172.21.15.81:0/3868315272 >> v2:172.21.15.178:3300/0 conn(0x7f76581446c0 0x7f76580b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 >> v1:172.21.15.81:6789/0 conn(0x7f76580cfcf0 legacy=0x7f76580cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f763c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f763c004870 0x7f763c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f763c005230 0x7f763c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580b4100 con 0x7f763c003a20 2024-09-13T18:48:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c00c0d0 con 0x7f763c005230 2024-09-13T18:48:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c00c290 con 0x7f763c004870 2024-09-13T18:48:25.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f7657e00700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f763c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.241+0000 7f765d200700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f763c005230 0x7f763c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f764fe00700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f763c004870 0x7f763c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657e00700 1 -- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f763c004870 msgr2=0x7f763c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657e00700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f763c004870 0x7f763c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657e00700 1 -- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f763c005230 msgr2=0x7f763c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657e00700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f763c005230 0x7f763c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657e00700 1 -- 172.21.15.81:0/3868315272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0035d0 con 0x7f763c003a20 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765d200700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f763c005230 0x7f763c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:25.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765d200700 1 -- 172.21.15.81:0/3868315272 reap_dead start 2024-09-13T18:48:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657e00700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f763c003e40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7648009d40 tx=0x7f763c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cb59f871d47f17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648009e90 con 0x7f763c003a20 2024-09-13T18:48:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764800e9a0 con 0x7f763c003a20 2024-09-13T18:48:25.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f7657400700 1 -- 172.21.15.81:0/3868315272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800ed10 con 0x7f763c003a20 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 -- 172.21.15.81:0/3868315272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 msgr2=0x7f763c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f763c003e40 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7648009d40 tx=0x7f763c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 -- 172.21.15.81:0/3868315272 shutdown_connections 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 --2- 172.21.15.81:0/3868315272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f763c003e40 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 -- 172.21.15.81:0/3868315272 >> 172.21.15.81:0/3868315272 conn(0x7f76580726d0 msgr2=0x7f765806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 -- 172.21.15.81:0/3868315272 shutdown_connections 2024-09-13T18:48:25.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.245+0000 7f765f200700 1 -- 172.21.15.81:0/3868315272 wait complete. 2024-09-13T18:48:25.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 Processor -- start 2024-09-13T18:48:25.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 -- start start 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f76581e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76581e7080 0x7f765815d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7658142ca0 0x7f7658143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76581e5140 con 0x7f763c003a20 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76581e5420 con 0x7f7658142ca0 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76581e5700 con 0x7f76581e7080 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f7657e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f76581e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f7657e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f76581e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47620/0 (socket says 172.21.15.81:47620) 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f7657e00700 1 -- 172.21.15.81:0/2972683724 learned_addr learned my addr 172.21.15.81:0/2972683724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f765d200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7658142ca0 0x7f7658143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.249+0000 7f764fe00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76581e7080 0x7f765815d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7657e00700 1 -- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76581e7080 msgr2=0x7f765815d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7657e00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76581e7080 0x7f765815d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7657e00700 1 -- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7658142ca0 msgr2=0x7f7658143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7657e00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7658142ca0 0x7f7658143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7657e00700 1 -- 172.21.15.81:0/2972683724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76581e59e0 con 0x7f763c003a20 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7657e00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f76581e4a40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76480090b0 tx=0x7f76480047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648003ad0 con 0x7f763c003a20 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648003c30 con 0x7f763c003a20 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76581e5cc0 con 0x7f763c003a20 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648009e90 con 0x7f763c003a20 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7658143650 con 0x7f763c003a20 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.253+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76580b3b00 con 0x7f763c003a20 2024-09-13T18:48:25.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.257+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7648013470 con 0x7f763c003a20 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.257+0000 7f7654c00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.257+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7648085bf0 con 0x7f763c003a20 2024-09-13T18:48:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.257+0000 7f764fe00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.257+0000 7f764fe00700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7634066730 0x7f7634068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7640005b60 tx=0x7f7640007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.261+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7648052b90 con 0x7f763c003a20 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.449+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7658067730 con 0x7f763c003a20 2024-09-13T18:48:25.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.453+0000 7f7654c00700 1 -- 172.21.15.81:0/2972683724 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f76480561b0 con 0x7f763c003a20 2024-09-13T18:48:25.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:25.461 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:25.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.457+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7634066730 msgr2=0x7f7634068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.457+0000 7f765f200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7634066730 0x7f7634068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7640005b60 tx=0x7f7640007040 comp rx=0 tx=0).stop 2024-09-13T18:48:25.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.457+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 msgr2=0x7f76581e4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.457+0000 7f765f200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f76581e4a40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76480090b0 tx=0x7f76480047e0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 shutdown_connections 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7634066730 0x7f7634068bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7658142ca0 0x7f7658143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76581e7080 0x7f765815d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 --2- 172.21.15.81:0/2972683724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763c003a20 0x7f76581e4a40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 >> 172.21.15.81:0/2972683724 conn(0x7f76580726d0 msgr2=0x7f765806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 shutdown_connections 2024-09-13T18:48:25.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.461+0000 7f765f200700 1 -- 172.21.15.81:0/2972683724 wait complete. 2024-09-13T18:48:25.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:13.295261+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:14.421707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T18:47:17.532954+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T18:48:25.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:25.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.669+0000 7fb1e2e00700 1 Processor -- start 2024-09-13T18:48:25.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.669+0000 7fb1e2e00700 1 -- start start 2024-09-13T18:48:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1dc15aa90 0x7fb1dc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1dc0cf830 0x7fb1dc0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc0b4680 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc15aee0 con 0x7fb1dc0cf830 2024-09-13T18:48:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc0b4960 con 0x7fb1dc15aa90 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1dc0cf830 0x7fb1dc0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb1dc0cf830 0x7fb1dc0cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47624/0 (socket says 172.21.15.81:47624) 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 -- 172.21.15.81:0/935774608 learned_addr learned my addr 172.21.15.81:0/935774608 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e1000700 1 --2- 172.21.15.81:0/935774608 >> v2:172.21.15.178:3300/0 conn(0x7fb1dc15aa90 0x7fb1dc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 -- 172.21.15.81:0/935774608 >> v2:172.21.15.178:3300/0 conn(0x7fb1dc15aa90 msgr2=0x7fb1dc0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 --2- 172.21.15.81:0/935774608 >> v2:172.21.15.178:3300/0 conn(0x7fb1dc15aa90 0x7fb1dc0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 -- 172.21.15.81:0/935774608 >> v1:172.21.15.178:6789/0 conn(0x7fb1dc06c5a0 legacy=0x7fb1dc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 -- 172.21.15.81:0/935774608 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0cf030 con 0x7fb1dc0cf830 2024-09-13T18:48:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2400700 1 --2- 172.21.15.81:0/935774608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0cfc40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc06d160 tx=0x7fb1d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31142b1e81e5c7f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1dbe00700 1 -- 172.21.15.81:0/935774608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400e070 con 0x7fb1dc0cf830 2024-09-13T18:48:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1dbe00700 1 -- 172.21.15.81:0/935774608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4003a40 con 0x7fb1dc0cf830 2024-09-13T18:48:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1dbe00700 1 -- 172.21.15.81:0/935774608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4003df0 con 0x7fb1dc0cf830 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- 172.21.15.81:0/935774608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc0cf830 msgr2=0x7fb1dc0cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/935774608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0cfc40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc06d160 tx=0x7fb1d400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- 172.21.15.81:0/935774608 shutdown_connections 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/935774608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0cfc40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/935774608 >> v2:172.21.15.178:3300/0 conn(0x7fb1dc15aa90 0x7fb1dc0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- 172.21.15.81:0/935774608 >> 172.21.15.81:0/935774608 conn(0x7fb1dc071d20 msgr2=0x7fb1dc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- 172.21.15.81:0/935774608 shutdown_connections 2024-09-13T18:48:25.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.673+0000 7fb1e2e00700 1 -- 172.21.15.81:0/935774608 wait complete. 2024-09-13T18:48:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.677+0000 7fb1e2e00700 1 Processor -- start 2024-09-13T18:48:25.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.677+0000 7fb1e2e00700 1 -- start start 2024-09-13T18:48:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 0x7fb1dc1f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1dc15aa90 0x7fb1dc06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc1f6910 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc1538b0 con 0x7fb1dc0cf830 2024-09-13T18:48:25.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc153b90 con 0x7fb1dc15aa90 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 0x7fb1dc1f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 0x7fb1dc1f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47632/0 (socket says 172.21.15.81:47632) 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 -- 172.21.15.81:0/2962073640 learned_addr learned my addr 172.21.15.81:0/2962073640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2400700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1dc15aa90 0x7fb1dc06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1000700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 -- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1dc15aa90 msgr2=0x7fb1dc06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1dc15aa90 0x7fb1dc06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 -- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc0cf830 msgr2=0x7fb1dc0c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 -- 172.21.15.81:0/2962073640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d4009b30 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e1a00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 0x7fb1dc1f5d20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b4a0 tx=0x7fb1d000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011830 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0011990 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc153e70 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0011d40 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.681+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc1f6260 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.685+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc1f6450 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.685+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1d001a400 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.685+0000 7fb1d9600700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1bc066730 0x7fb1bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.685+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb1d00841b0 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.689+0000 7fb1e1000700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1bc066730 0x7fb1bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.689+0000 7fb1e1000700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1bc066730 0x7fb1bc068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc149000 tx=0x7fb1c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.693+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1d00511f0 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.873+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1dc154390 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.873+0000 7fb1d9600700 1 -- 172.21.15.81:0/2962073640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1d0054810 con 0x7fb1dc06c5a0 2024-09-13T18:48:25.879 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1bc066730 msgr2=0x7fb1bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1bc066730 0x7fb1bc068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc149000 tx=0x7fb1c8008040 comp rx=0 tx=0).stop 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 msgr2=0x7fb1dc1f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 0x7fb1dc1f5d20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000b4a0 tx=0x7fb1d000b860 comp rx=0 tx=0).stop 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 shutdown_connections 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb1bc066730 0x7fb1bc068bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1dc15aa90 0x7fb1dc06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1dc0cf830 0x7fb1dc0c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 --2- 172.21.15.81:0/2962073640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1dc06c5a0 0x7fb1dc1f5d20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 >> 172.21.15.81:0/2962073640 conn(0x7fb1dc071d20 msgr2=0x7fb1dc0b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 shutdown_connections 2024-09-13T18:48:25.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:25.877+0000 7fb1e2e00700 1 -- 172.21.15.81:0/2962073640 wait complete. 2024-09-13T18:48:25.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:26.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.069+0000 7f4ff3e00700 1 Processor -- start 2024-09-13T18:48:26.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3e00700 1 -- start start 2024-09-13T18:48:26.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ff4143b70 0x7f4ff40cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff406d070 0x7f4ff40b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40b1980 con 0x7f4ff406d620 2024-09-13T18:48:26.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff40b2500 con 0x7f4ff4143b70 2024-09-13T18:48:26.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff40b1bd0 con 0x7f4ff406d070 2024-09-13T18:48:26.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ff4143b70 0x7f4ff40cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ff4143b70 0x7f4ff40cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47644/0 (socket says 172.21.15.81:47644) 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff2a00700 1 -- 172.21.15.81:0/1198195890 learned_addr learned my addr 172.21.15.81:0/1198195890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.073+0000 7f4ff3400700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff406d070 0x7f4ff40b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2a00700 1 -- 172.21.15.81:0/1198195890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff406d070 msgr2=0x7f4ff40b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2a00700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff406d070 0x7f4ff40b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2a00700 1 -- 172.21.15.81:0/1198195890 >> v1:172.21.15.81:6789/0 conn(0x7f4ff406d620 legacy=0x7f4ff406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2a00700 1 -- 172.21.15.81:0/1198195890 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40b1eb0 con 0x7f4ff4143b70 2024-09-13T18:48:26.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3400700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff406d070 0x7f4ff40b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:26.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2a00700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff4143b70 0x7f4ff40cde20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009910 tx=0x7f4fe4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965f61de46ac9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2000700 1 -- 172.21.15.81:0/1198195890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400ba60 con 0x7f4ff4143b70 2024-09-13T18:48:26.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2000700 1 -- 172.21.15.81:0/1198195890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe400bbc0 con 0x7f4ff4143b70 2024-09-13T18:48:26.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff2000700 1 -- 172.21.15.81:0/1198195890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4009e60 con 0x7f4ff4143b70 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 -- 172.21.15.81:0/1198195890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff4143b70 msgr2=0x7f4ff40cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff4143b70 0x7f4ff40cde20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009910 tx=0x7f4fe4009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 -- 172.21.15.81:0/1198195890 shutdown_connections 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff406d070 0x7f4ff40b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/1198195890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff4143b70 0x7f4ff40cde20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 -- 172.21.15.81:0/1198195890 >> 172.21.15.81:0/1198195890 conn(0x7f4ff406a390 msgr2=0x7f4ff406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 -- 172.21.15.81:0/1198195890 shutdown_connections 2024-09-13T18:48:26.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.077+0000 7f4ff3e00700 1 -- 172.21.15.81:0/1198195890 wait complete. 2024-09-13T18:48:26.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 Processor -- start 2024-09-13T18:48:26.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 -- start start 2024-09-13T18:48:26.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff406d070 0x7f4ff413eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 0x7f4ff415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff4143b70 0x7f4ff415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff41567e0 con 0x7f4ff406d620 2024-09-13T18:48:26.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4141250 con 0x7f4ff406d070 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.081+0000 7f4ff3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff4156a10 con 0x7f4ff4143b70 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 0x7f4ff415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 0x7f4ff415a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47646/0 (socket says 172.21.15.81:47646) 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 -- 172.21.15.81:0/3732730279 learned_addr learned my addr 172.21.15.81:0/3732730279 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4ff2a00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff406d070 0x7f4ff413eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4ff3400700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff4143b70 0x7f4ff415a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 -- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff4143b70 msgr2=0x7f4ff415a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff4143b70 0x7f4ff415a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 -- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff406d070 msgr2=0x7f4ff413eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff406d070 0x7f4ff413eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 -- 172.21.15.81:0/3732730279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe4009570 con 0x7f4ff406d620 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4febe00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 0x7f4ff415a010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c500 tx=0x7f4fdc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0052d0 con 0x7f4ff406d620 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc005430 con 0x7f4ff406d620 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff4156cf0 con 0x7f4ff406d620 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0055a0 con 0x7f4ff406d620 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff41572b0 con 0x7f4ff406d620 2024-09-13T18:48:26.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.085+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff4141410 con 0x7f4ff406d620 2024-09-13T18:48:26.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.089+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fdc0038e0 con 0x7f4ff406d620 2024-09-13T18:48:26.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.089+0000 7f4feaa00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.089+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4fdc083990 con 0x7f4ff406d620 2024-09-13T18:48:26.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.089+0000 7f4ff2a00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.089+0000 7f4ff2a00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000c00 tx=0x7f4fe4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.097+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4fdc0509d0 con 0x7f4ff406d620 2024-09-13T18:48:26.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.277+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ff40cde20 con 0x7f4ff406d620 2024-09-13T18:48:26.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.277+0000 7f4feaa00700 1 -- 172.21.15.81:0/3732730279 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fdc053ff0 con 0x7f4ff406d620 2024-09-13T18:48:26.285 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 msgr2=0x7f4fd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000c00 tx=0x7f4fe4008030 comp rx=0 tx=0).stop 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 msgr2=0x7f4ff415a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 0x7f4ff415a010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c500 tx=0x7f4fdc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 shutdown_connections 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff4143b70 0x7f4ff415a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff406d620 0x7f4ff415a010 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 --2- 172.21.15.81:0/3732730279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff406d070 0x7f4ff413eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 >> 172.21.15.81:0/3732730279 conn(0x7f4ff406a390 msgr2=0x7f4ff406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 shutdown_connections 2024-09-13T18:48:26.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.281+0000 7f4ff3e00700 1 -- 172.21.15.81:0/3732730279 wait complete. 2024-09-13T18:48:26.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.477+0000 7f81b7000700 1 Processor -- start 2024-09-13T18:48:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.477+0000 7f81b7000700 1 -- start start 2024-09-13T18:48:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b7000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b0160d30 0x7f81b006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b7000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81b006b340 0x7f81b00b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b7000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b00b0020 con 0x7f81b006d150 2024-09-13T18:48:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b7000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b00d1770 con 0x7f81b006b340 2024-09-13T18:48:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b7000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00d03f0 con 0x7f81b0160d30 2024-09-13T18:48:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81b006b340 0x7f81b00b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81b006b340 0x7f81b00b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47660/0 (socket says 172.21.15.81:47660) 2024-09-13T18:48:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 -- 172.21.15.81:0/2784068755 learned_addr learned my addr 172.21.15.81:0/2784068755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b5c00700 1 --2- 172.21.15.81:0/2784068755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b0160d30 0x7f81b006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 -- 172.21.15.81:0/2784068755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b0160d30 msgr2=0x7f81b006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 --2- 172.21.15.81:0/2784068755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b0160d30 0x7f81b006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 -- 172.21.15.81:0/2784068755 >> v1:172.21.15.178:6789/0 conn(0x7f81b006d150 legacy=0x7f81b006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 -- 172.21.15.81:0/2784068755 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b00d06d0 con 0x7f81b006b340 2024-09-13T18:48:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81b6600700 1 --2- 172.21.15.81:0/2784068755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b00b3ca0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009e50 tx=0x7f81a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0341d54da51de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81afe00700 1 -- 172.21.15.81:0/2784068755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a800e070 con 0x7f81b006b340 2024-09-13T18:48:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81afe00700 1 -- 172.21.15.81:0/2784068755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a800b910 con 0x7f81b006b340 2024-09-13T18:48:26.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.481+0000 7f81afe00700 1 -- 172.21.15.81:0/2784068755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a800bcc0 con 0x7f81b006b340 2024-09-13T18:48:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 -- 172.21.15.81:0/2784068755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 msgr2=0x7f81b00b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 --2- 172.21.15.81:0/2784068755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b00b3ca0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009e50 tx=0x7f81a800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 -- 172.21.15.81:0/2784068755 shutdown_connections 2024-09-13T18:48:26.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 --2- 172.21.15.81:0/2784068755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b00b3ca0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 --2- 172.21.15.81:0/2784068755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b0160d30 0x7f81b006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 -- 172.21.15.81:0/2784068755 >> 172.21.15.81:0/2784068755 conn(0x7f81b0071d20 msgr2=0x7f81b0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 -- 172.21.15.81:0/2784068755 shutdown_connections 2024-09-13T18:48:26.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 -- 172.21.15.81:0/2784068755 wait complete. 2024-09-13T18:48:26.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 Processor -- start 2024-09-13T18:48:26.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.485+0000 7f81b7000700 1 -- start start 2024-09-13T18:48:26.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b006d150 0x7f81b01e9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81b0160d30 0x7f81b01e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b0158aa0 con 0x7f81b006b340 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b01567a0 con 0x7f81b0160d30 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b01598c0 con 0x7f81b006d150 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b0156260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47670/0 (socket says 172.21.15.81:47670) 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 -- 172.21.15.81:0/646006443 learned_addr learned my addr 172.21.15.81:0/646006443 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b6600700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81b0160d30 0x7f81b01e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5200700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b006d150 0x7f81b01e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 -- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b006d150 msgr2=0x7f81b01e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b006d150 0x7f81b01e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 -- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81b0160d30 msgr2=0x7f81b01e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81b0160d30 0x7f81b01e9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 -- 172.21.15.81:0/646006443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a8009b30 con 0x7f81b006b340 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b6600700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81b0160d30 0x7f81b01e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5200700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b006d150 0x7f81b01e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b5c00700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b0156260 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81a400e840 tx=0x7f81a400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a40095a0 con 0x7f81b006b340 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a400c690 con 0x7f81b006b340 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a400ca00 con 0x7f81b006b340 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b0158cb0 con 0x7f81b006b340 2024-09-13T18:48:26.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.489+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b0159270 con 0x7f81b006b340 2024-09-13T18:48:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.493+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0161110 con 0x7f81b006b340 2024-09-13T18:48:26.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.493+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81a400cb60 con 0x7f81b006b340 2024-09-13T18:48:26.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.493+0000 7f81ad600700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8190066760 0x7f8190068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.493+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81a40844b0 con 0x7f81b006b340 2024-09-13T18:48:26.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.493+0000 7f81b5200700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8190066760 0x7f8190068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.497+0000 7f81b5200700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8190066760 0x7f8190068c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81b015a770 tx=0x7f819c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.501+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81a4051450 con 0x7f81b006b340 2024-09-13T18:48:26.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.677+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81b015c6a0 con 0x7f81b006b340 2024-09-13T18:48:26.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.677+0000 7f81ad600700 1 -- 172.21.15.81:0/646006443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81a4059e60 con 0x7f81b006b340 2024-09-13T18:48:26.685 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:48:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.681+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8190066760 msgr2=0x7f8190068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.681+0000 7f81b7000700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8190066760 0x7f8190068c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81b015a770 tx=0x7f819c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.681+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 msgr2=0x7f81b0156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.681+0000 7f81b7000700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b0156260 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81a400e840 tx=0x7f81a400ec00 comp rx=0 tx=0).stop 2024-09-13T18:48:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 shutdown_connections 2024-09-13T18:48:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8190066760 0x7f8190068c20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81b0160d30 0x7f81b01e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81b006d150 0x7f81b01e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 --2- 172.21.15.81:0/646006443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81b006b340 0x7f81b0156260 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 >> 172.21.15.81:0/646006443 conn(0x7f81b0071d20 msgr2=0x7f81b015f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 shutdown_connections 2024-09-13T18:48:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.685+0000 7f81b7000700 1 -- 172.21.15.81:0/646006443 wait complete. 2024-09-13T18:48:26.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T18:48:26.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.873+0000 7fea9fa00700 1 Processor -- start 2024-09-13T18:48:26.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.873+0000 7fea9fa00700 1 -- start start 2024-09-13T18:48:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea9816bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9fa00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9806d000 con 0x7fea9806be10 2024-09-13T18:48:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9fa00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9806c3f0 con 0x7fea98160fc0 2024-09-13T18:48:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9806c6d0 con 0x7fea980cf280 2024-09-13T18:48:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fea9806be10 0x7fea980ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60100/0 (socket says 172.21.15.81:60100) 2024-09-13T18:48:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97e00700 1 -- 172.21.15.81:0/3716837145 learned_addr learned my addr 172.21.15.81:0/3716837145 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:26.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9da00700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea9816bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231228201 0 0) 0x7fea9806d000 con 0x7fea9806be10 2024-09-13T18:48:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea7c0035d0 con 0x7fea9806be10 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610791009 0 0) 0x7fea7c0035d0 con 0x7fea9806be10 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 msgr2=0x7fea9816bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea9816bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 >> v1:172.21.15.178:6789/0 conn(0x7fea98160fc0 legacy=0x7fea980b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9806c9b0 con 0x7fea9806be10 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fea84001670 con 0x7fea9806be10 2024-09-13T18:48:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 >> v1:172.21.15.81:6789/0 conn(0x7fea9806be10 legacy=0x7fea980ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea7c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7c003fd0 0x7fea7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea7c004db0 0x7fea7c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9806c6d0 con 0x7fea7c003fd0 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c00bb10 con 0x7fea7c004db0 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7c00bcd0 con 0x7fea980cf280 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea97e00700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7c003fd0 0x7fea7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9d000700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea7c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.877+0000 7fea9da00700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea7c004db0 0x7fea7c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9d000700 1 -- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea7c004db0 msgr2=0x7fea7c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9d000700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea7c004db0 0x7fea7c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9d000700 1 -- 172.21.15.81:0/3716837145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7c003fd0 msgr2=0x7fea7c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9d000700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7c003fd0 0x7fea7c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9d000700 1 -- 172.21.15.81:0/3716837145 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7c0035d0 con 0x7fea980cf280 2024-09-13T18:48:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea97e00700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea7c003fd0 0x7fea7c004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9d000700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea7c003a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea880017e0 tx=0x7fea7c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7c7e2d308dce768 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880052d0 con 0x7fea980cf280 2024-09-13T18:48:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88005430 con 0x7fea980cf280 2024-09-13T18:48:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea97400700 1 -- 172.21.15.81:0/3716837145 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880055a0 con 0x7fea980cf280 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9fa00700 1 -- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 msgr2=0x7fea7c003a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9fa00700 1 --2- 172.21.15.81:0/3716837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea7c003a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea880017e0 tx=0x7fea7c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9da00700 1 -- 172.21.15.81:0/3716837145 reap_dead start 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9fa00700 1 -- 172.21.15.81:0/3716837145 shutdown_connections 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9fa00700 1 -- 172.21.15.81:0/3716837145 >> 172.21.15.81:0/3716837145 conn(0x7fea9806a570 msgr2=0x7fea9806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9fa00700 1 -- 172.21.15.81:0/3716837145 shutdown_connections 2024-09-13T18:48:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.881+0000 7fea9fa00700 1 -- 172.21.15.81:0/3716837145 wait complete. 2024-09-13T18:48:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 Processor -- start 2024-09-13T18:48:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 -- start start 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea981fa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea9815a2b0 0x7fea980a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 0x7fea9815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9815f2e0 con 0x7fea9815e920 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea981f67b0 con 0x7fea9815a2b0 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea981f69e0 con 0x7fea980cf280 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 0x7fea9815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 0x7fea9815eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36068/0 (socket says 172.21.15.81:36068) 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 -- 172.21.15.81:0/868672768 learned_addr learned my addr 172.21.15.81:0/868672768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea97e00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea9815a2b0 0x7fea980a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9d000700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea981fa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 -- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 msgr2=0x7fea981fa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea981fa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 -- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea9815a2b0 msgr2=0x7fea980a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea9815a2b0 0x7fea980a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.885+0000 7fea9da00700 1 -- 172.21.15.81:0/868672768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea981f6cc0 con 0x7fea9815e920 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea9da00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 0x7fea9815eda0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea98072250 tx=0x7fea90011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000e040 con 0x7fea9815e920 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9000f040 con 0x7fea9815e920 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9000f860 con 0x7fea9815e920 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea981f6fa0 con 0x7fea9815e920 2024-09-13T18:48:26.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9815a730 con 0x7fea9815e920 2024-09-13T18:48:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea980ceb70 con 0x7fea9815e920 2024-09-13T18:48:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.889+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea9000f9c0 con 0x7fea9815e920 2024-09-13T18:48:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.893+0000 7fea94c00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea78066760 0x7fea78068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.893+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fea900846e0 con 0x7fea9815e920 2024-09-13T18:48:26.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.893+0000 7fea9d000700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea78066760 0x7fea78068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.897+0000 7fea9d000700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea78066760 0x7fea78068c20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea9815f600 tx=0x7fea88009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:26.901+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea90051700 con 0x7fea9815e920 2024-09-13T18:48:27.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.077+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea9815f9a0 con 0x7fea9815e920 2024-09-13T18:48:27.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.077+0000 7fea94c00700 1 -- 172.21.15.81:0/868672768 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fea90054d20 con 0x7fea9815e920 2024-09-13T18:48:27.085 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:48:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea78066760 msgr2=0x7fea78068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea78066760 0x7fea78068c20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fea9815f600 tx=0x7fea88009030 comp rx=0 tx=0).stop 2024-09-13T18:48:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 msgr2=0x7fea9815eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 0x7fea9815eda0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea98072250 tx=0x7fea90011ed0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 shutdown_connections 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea78066760 0x7fea78068c20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea9815e920 0x7fea9815eda0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea9815a2b0 0x7fea980a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 --2- 172.21.15.81:0/868672768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea980cf280 0x7fea981fa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 >> 172.21.15.81:0/868672768 conn(0x7fea9806a570 msgr2=0x7fea9806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 shutdown_connections 2024-09-13T18:48:27.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.081+0000 7fea9fa00700 1 -- 172.21.15.81:0/868672768 wait complete. 2024-09-13T18:48:27.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.273+0000 7fa952000700 1 Processor -- start 2024-09-13T18:48:27.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.273+0000 7fa952000700 1 -- start start 2024-09-13T18:48:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa952000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa94c0d0af0 0x7fa94c0d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa952000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0b4d10 con 0x7fa94c0b3a70 2024-09-13T18:48:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa952000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94c0b3eb0 con 0x7fa94c1446c0 2024-09-13T18:48:27.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa952000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94c0d1450 con 0x7fa94c0d0af0 2024-09-13T18:48:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa942a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa94c0b3a70 0x7fa94c0cc110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60116/0 (socket says 172.21.15.81:60116) 2024-09-13T18:48:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa942a00700 1 -- 172.21.15.81:0/2208481090 learned_addr learned my addr 172.21.15.81:0/2208481090 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:27.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94be00700 1 --2- 172.21.15.81:0/2208481090 >> v2:172.21.15.178:3300/0 conn(0x7fa94c0d0af0 0x7fa94c0d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234332694 0 0) 0x7fa94c0b3eb0 con 0x7fa94c1446c0 2024-09-13T18:48:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9300035d0 con 0x7fa94c1446c0 2024-09-13T18:48:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057503842 0 0) 0x7fa94c0b4d10 con 0x7fa94c0b3a70 2024-09-13T18:48:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c0b3eb0 con 0x7fa94c0b3a70 2024-09-13T18:48:27.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94be00700 1 -- 172.21.15.81:0/2208481090 >> v1:172.21.15.178:6789/0 conn(0x7fa94c1446c0 legacy=0x7fa94c0cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94be00700 1 -- 172.21.15.81:0/2208481090 >> v1:172.21.15.81:6789/0 conn(0x7fa94c0b3a70 legacy=0x7fa94c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94be00700 1 -- 172.21.15.81:0/2208481090 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c144aa0 con 0x7fa94c0d0af0 2024-09-13T18:48:27.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94be00700 1 --2- 172.21.15.81:0/2208481090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0d0af0 0x7fa94c0d0f10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa944009850 tx=0x7fa944009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed56f46f1a3b3aac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011830 con 0x7fa94c0d0af0 2024-09-13T18:48:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944011990 con 0x7fa94c0d0af0 2024-09-13T18:48:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.277+0000 7fa94aa00700 1 -- 172.21.15.81:0/2208481090 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa944011d40 con 0x7fa94c0d0af0 2024-09-13T18:48:27.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 -- 172.21.15.81:0/2208481090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0d0af0 msgr2=0x7fa94c0d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 --2- 172.21.15.81:0/2208481090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0d0af0 0x7fa94c0d0f10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa944009850 tx=0x7fa944009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 -- 172.21.15.81:0/2208481090 shutdown_connections 2024-09-13T18:48:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 --2- 172.21.15.81:0/2208481090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0d0af0 0x7fa94c0d0f10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 -- 172.21.15.81:0/2208481090 >> 172.21.15.81:0/2208481090 conn(0x7fa94c0726d0 msgr2=0x7fa94c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 -- 172.21.15.81:0/2208481090 shutdown_connections 2024-09-13T18:48:27.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.281+0000 7fa952000700 1 -- 172.21.15.81:0/2208481090 wait complete. 2024-09-13T18:48:27.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 Processor -- start 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 -- start start 2024-09-13T18:48:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0b3a70 0x7fa94c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa94c0d0af0 0x7fa94c1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 0x7fa94c141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1f76c0 con 0x7fa94c1446c0 2024-09-13T18:48:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1f3220 con 0x7fa94c0b3a70 2024-09-13T18:48:27.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.285+0000 7fa952000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c1f7100 con 0x7fa94c0d0af0 2024-09-13T18:48:27.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 0x7fa94c141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 0x7fa94c141960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36076/0 (socket says 172.21.15.81:36076) 2024-09-13T18:48:27.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 -- 172.21.15.81:0/80436666 learned_addr learned my addr 172.21.15.81:0/80436666 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:27.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94b400700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0b3a70 0x7fa94c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa942a00700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa94c0d0af0 0x7fa94c1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 -- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa94c0d0af0 msgr2=0x7fa94c1f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa94c0d0af0 0x7fa94c1f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 -- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0b3a70 msgr2=0x7fa94c15a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0b3a70 0x7fa94c15a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 -- 172.21.15.81:0/80436666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440094b0 con 0x7fa94c1446c0 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa94be00700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 0x7fa94c141960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0d0ac0 tx=0x7fa944004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94401b840 con 0x7fa94c1446c0 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94401f070 con 0x7fa94c1446c0 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c1f73e0 con 0x7fa94c1446c0 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94401bc00 con 0x7fa94c1446c0 2024-09-13T18:48:27.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.289+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c13d050 con 0x7fa94c1446c0 2024-09-13T18:48:27.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.293+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c13cbd0 con 0x7fa94c1446c0 2024-09-13T18:48:27.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.293+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa94402f3f0 con 0x7fa94c1446c0 2024-09-13T18:48:27.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.293+0000 7fa943e00700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa928066730 0x7fa928068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.297+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa944021070 con 0x7fa94c1446c0 2024-09-13T18:48:27.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.297+0000 7fa94b400700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa928066730 0x7fa928068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.297+0000 7fa94b400700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa928066730 0x7fa928068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa93c001560 tx=0x7fa93c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.301+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa94c13cbd0 con 0x7fa94c1446c0 2024-09-13T18:48:27.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.525+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa94c13cbd0 con 0x7fa94c1446c0 2024-09-13T18:48:27.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.525+0000 7fa943e00700 1 -- 172.21.15.81:0/80436666 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7fa94c13cbd0 con 0x7fa94c1446c0 2024-09-13T18:48:27.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:27.534 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa928066730 msgr2=0x7fa928068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa928066730 0x7fa928068bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa93c001560 tx=0x7fa93c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 msgr2=0x7fa94c141960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 0x7fa94c141960 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0d0ac0 tx=0x7fa944004770 comp rx=0 tx=0).stop 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 shutdown_connections 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa928066730 0x7fa928068bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa94c1446c0 0x7fa94c141960 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa94c0d0af0 0x7fa94c1f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 --2- 172.21.15.81:0/80436666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa94c0b3a70 0x7fa94c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 >> 172.21.15.81:0/80436666 conn(0x7fa94c0726d0 msgr2=0x7fa94c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 shutdown_connections 2024-09-13T18:48:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.529+0000 7fa952000700 1 -- 172.21.15.81:0/80436666 wait complete. 2024-09-13T18:48:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:48:27.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.713+0000 7f6388400700 1 Processor -- start 2024-09-13T18:48:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.713+0000 7f6388400700 1 -- start start 2024-09-13T18:48:27.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6388400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6380071670 0x7f6380071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6388400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63800b19f0 0x7f63800b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6388400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6380070100 con 0x7f6380159080 2024-09-13T18:48:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6388400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638006bcd0 con 0x7f63800b19f0 2024-09-13T18:48:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6388400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638006bee0 con 0x7f6380071670 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6386400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63800b19f0 0x7f63800b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6386400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63800b19f0 0x7f63800b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36092/0 (socket says 172.21.15.81:36092) 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6386400700 1 -- 172.21.15.81:0/1733566489 learned_addr learned my addr 172.21.15.81:0/1733566489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6385000700 1 --2- 172.21.15.81:0/1733566489 >> v2:172.21.15.178:3300/0 conn(0x7f6380071670 0x7f6380071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.717+0000 7f6386400700 1 -- 172.21.15.81:0/1733566489 >> v2:172.21.15.178:3300/0 conn(0x7f6380071670 msgr2=0x7f6380071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6386400700 1 --2- 172.21.15.81:0/1733566489 >> v2:172.21.15.178:3300/0 conn(0x7f6380071670 0x7f6380071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6386400700 1 -- 172.21.15.81:0/1733566489 >> v1:172.21.15.178:6789/0 conn(0x7f6380159080 legacy=0x7f63800cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6386400700 1 -- 172.21.15.81:0/1733566489 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638006c1c0 con 0x7f63800b19f0 2024-09-13T18:48:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6386400700 1 --2- 172.21.15.81:0/1733566489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63800b19f0 0x7f63800b1e60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f63800b3440 tx=0x7f637800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f6a6c392a5977c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f637fe00700 1 -- 172.21.15.81:0/1733566489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800e070 con 0x7f63800b19f0 2024-09-13T18:48:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f637fe00700 1 -- 172.21.15.81:0/1733566489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800b9c0 con 0x7f63800b19f0 2024-09-13T18:48:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f637fe00700 1 -- 172.21.15.81:0/1733566489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800bd70 con 0x7f63800b19f0 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 -- 172.21.15.81:0/1733566489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63800b19f0 msgr2=0x7f63800b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 --2- 172.21.15.81:0/1733566489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63800b19f0 0x7f63800b1e60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f63800b3440 tx=0x7f637800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 -- 172.21.15.81:0/1733566489 shutdown_connections 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 --2- 172.21.15.81:0/1733566489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63800b19f0 0x7f63800b1e60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 --2- 172.21.15.81:0/1733566489 >> v2:172.21.15.178:3300/0 conn(0x7f6380071670 0x7f6380071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 -- 172.21.15.81:0/1733566489 >> 172.21.15.81:0/1733566489 conn(0x7f63800b08d0 msgr2=0x7f63800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 -- 172.21.15.81:0/1733566489 shutdown_connections 2024-09-13T18:48:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.721+0000 7f6388400700 1 -- 172.21.15.81:0/1733566489 wait complete. 2024-09-13T18:48:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 Processor -- start 2024-09-13T18:48:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 -- start start 2024-09-13T18:48:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6380071670 0x7f63801e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63800b19f0 0x7f638014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 0x7f6380152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63801e6e80 con 0x7f6380159080 2024-09-13T18:48:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638014f640 con 0x7f6380071670 2024-09-13T18:48:27.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6388400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63801e6200 con 0x7f63800b19f0 2024-09-13T18:48:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 0x7f6380152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 0x7f6380152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36100/0 (socket says 172.21.15.81:36100) 2024-09-13T18:48:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 -- 172.21.15.81:0/2908560508 learned_addr learned my addr 172.21.15.81:0/2908560508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:27.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6385000700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63800b19f0 0x7f638014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6385a00700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6380071670 0x7f63801e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 -- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63800b19f0 msgr2=0x7f638014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63800b19f0 0x7f638014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 -- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6380071670 msgr2=0x7f63801e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6380071670 0x7f63801e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.725+0000 7f6386400700 1 -- 172.21.15.81:0/2908560508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6378009b30 con 0x7f6380159080 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f6386400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 0x7f6380152190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f637800b370 tx=0x7f6378004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63780092e0 con 0x7f6380159080 2024-09-13T18:48:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637801c440 con 0x7f6380159080 2024-09-13T18:48:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63801e64e0 con 0x7f6380159080 2024-09-13T18:48:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637801c7f0 con 0x7f6380159080 2024-09-13T18:48:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63801e6aa0 con 0x7f6380159080 2024-09-13T18:48:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.729+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63800cc580 con 0x7f6380159080 2024-09-13T18:48:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.733+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f637801c950 con 0x7f6380159080 2024-09-13T18:48:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.733+0000 7f637d600700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6360066730 0x7f6360068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.733+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6378085ea0 con 0x7f6380159080 2024-09-13T18:48:27.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.733+0000 7f6385a00700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6360066730 0x7f6360068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.733+0000 7f6385a00700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6360066730 0x7f6360068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6374000f60 tx=0x7f6374009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.737+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6378052e40 con 0x7f6380159080 2024-09-13T18:48:27.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.925+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f638006cca0 con 0x7f6380159080 2024-09-13T18:48:27.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.929+0000 7f637d600700 1 -- 172.21.15.81:0/2908560508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7f6378056460 con 0x7f6380159080 2024-09-13T18:48:27.936 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:27.936 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:27.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.929+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6360066730 msgr2=0x7f6360068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.929+0000 7f6388400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6360066730 0x7f6360068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6374000f60 tx=0x7f6374009040 comp rx=0 tx=0).stop 2024-09-13T18:48:27.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.929+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 msgr2=0x7f6380152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.929+0000 7f6388400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 0x7f6380152190 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f637800b370 tx=0x7f6378004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 shutdown_connections 2024-09-13T18:48:27.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6360066730 0x7f6360068bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6380159080 0x7f6380152190 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63800b19f0 0x7f638014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 --2- 172.21.15.81:0/2908560508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6380071670 0x7f63801e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 >> 172.21.15.81:0/2908560508 conn(0x7f63800b08d0 msgr2=0x7f63800aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 shutdown_connections 2024-09-13T18:48:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:27.933+0000 7f6388400700 1 -- 172.21.15.81:0/2908560508 wait complete. 2024-09-13T18:48:27.959 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:48:27.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 Processor -- start 2024-09-13T18:48:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 -- start start 2024-09-13T18:48:28.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c3c1446c0 0x7f8c3c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c3c0cfcf0 0x7f8c3c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0b4d10 con 0x7f8c3c0cc650 2024-09-13T18:48:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c144aa0 con 0x7f8c3c1446c0 2024-09-13T18:48:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c41e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b4100 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c3aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c3c1446c0 0x7f8c3c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c3aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c3c1446c0 0x7f8c3c0b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36102/0 (socket says 172.21.15.81:36102) 2024-09-13T18:48:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c3aa00700 1 -- 172.21.15.81:0/1646590985 learned_addr learned my addr 172.21.15.81:0/1646590985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.133+0000 7f8c3a000700 1 --2- 172.21.15.81:0/1646590985 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c0cfcf0 0x7f8c3c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c3aa00700 1 -- 172.21.15.81:0/1646590985 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c0cfcf0 msgr2=0x7f8c3c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c3aa00700 1 --2- 172.21.15.81:0/1646590985 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c0cfcf0 0x7f8c3c0cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c3aa00700 1 -- 172.21.15.81:0/1646590985 >> v1:172.21.15.178:6789/0 conn(0x7f8c3c0cc650 legacy=0x7f8c3c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c3aa00700 1 -- 172.21.15.81:0/1646590985 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0b43e0 con 0x7f8c3c1446c0 2024-09-13T18:48:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c39600700 1 -- 172.21.15.81:0/1646590985 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574044897 0 0) 0x7f8c3c0b4d10 con 0x7f8c3c0cc650 2024-09-13T18:48:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c3aa00700 1 --2- 172.21.15.81:0/1646590985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c1446c0 0x7f8c3c0b3a70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c15e7d0 tx=0x7f8c2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e568ceeef39684 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c39600700 1 -- 172.21.15.81:0/1646590985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011830 con 0x7f8c3c1446c0 2024-09-13T18:48:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c39600700 1 -- 172.21.15.81:0/1646590985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c011990 con 0x7f8c3c1446c0 2024-09-13T18:48:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c39600700 1 -- 172.21.15.81:0/1646590985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c011d20 con 0x7f8c3c1446c0 2024-09-13T18:48:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 -- 172.21.15.81:0/1646590985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c1446c0 msgr2=0x7f8c3c0b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 --2- 172.21.15.81:0/1646590985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c1446c0 0x7f8c3c0b3a70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c15e7d0 tx=0x7f8c2c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 -- 172.21.15.81:0/1646590985 shutdown_connections 2024-09-13T18:48:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 --2- 172.21.15.81:0/1646590985 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c0cfcf0 0x7f8c3c0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 --2- 172.21.15.81:0/1646590985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c1446c0 0x7f8c3c0b3a70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 -- 172.21.15.81:0/1646590985 >> 172.21.15.81:0/1646590985 conn(0x7f8c3c0726d0 msgr2=0x7f8c3c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 -- 172.21.15.81:0/1646590985 shutdown_connections 2024-09-13T18:48:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.137+0000 7f8c41e00700 1 -- 172.21.15.81:0/1646590985 wait complete. 2024-09-13T18:48:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 Processor -- start 2024-09-13T18:48:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 -- start start 2024-09-13T18:48:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c0cc650 0x7f8c3c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 0x7f8c3c140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c1446c0 0x7f8c3c13e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c14e8f0 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c14dce0 con 0x7f8c3c0cc650 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.141+0000 7f8c41e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c14dfc0 con 0x7f8c3c1446c0 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 0x7f8c3c140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 0x7f8c3c140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36114/0 (socket says 172.21.15.81:36114) 2024-09-13T18:48:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 -- 172.21.15.81:0/2648172643 learned_addr learned my addr 172.21.15.81:0/2648172643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3aa00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c0cc650 0x7f8c3c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3b400700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c1446c0 0x7f8c3c13e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 -- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c1446c0 msgr2=0x7f8c3c13e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c1446c0 0x7f8c3c13e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 -- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c0cc650 msgr2=0x7f8c3c15a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c0cc650 0x7f8c3c15a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 -- 172.21.15.81:0/2648172643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c009570 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c3a000700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 0x7f8c3c140b60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800e9d0 tx=0x7f8c2800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28009720 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2800ee70 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c14e2a0 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800ca50 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c15ac40 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.145+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c14ea60 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.149+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c2800cbb0 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.149+0000 7f8c33400700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c1c066730 0x7f8c1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.149+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8c28084580 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.149+0000 7f8c3aa00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c1c066730 0x7f8c1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.149+0000 7f8c3aa00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c1c066730 0x7f8c1c068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c000c00 tx=0x7f8c2c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.157+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c28051520 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.385+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3c0cc110 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.385+0000 7f8c33400700 1 -- 172.21.15.81:0/2648172643 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7f8c2800ce60 con 0x7f8c3c0cfcf0 2024-09-13T18:48:28.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:28.392 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:48:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c1c066730 msgr2=0x7f8c1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c1c066730 0x7f8c1c068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c000c00 tx=0x7f8c2c008030 comp rx=0 tx=0).stop 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 msgr2=0x7f8c3c140b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 0x7f8c3c140b60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800e9d0 tx=0x7f8c2800ece0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 shutdown_connections 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c1c066730 0x7f8c1c068bf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c1446c0 0x7f8c3c13e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cfcf0 0x7f8c3c140b60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 --2- 172.21.15.81:0/2648172643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c0cc650 0x7f8c3c15a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 >> 172.21.15.81:0/2648172643 conn(0x7f8c3c0726d0 msgr2=0x7f8c3c0caa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 shutdown_connections 2024-09-13T18:48:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.389+0000 7f8c41e00700 1 -- 172.21.15.81:0/2648172643 wait complete. 2024-09-13T18:48:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:48:28.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:28.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.585+0000 7fe384e00700 1 Processor -- start 2024-09-13T18:48:28.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.585+0000 7fe384e00700 1 -- start start 2024-09-13T18:48:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe384e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3800b2d80 0x7fe38006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe384e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800b3560 con 0x7fe38006aaa0 2024-09-13T18:48:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe384e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800b3280 con 0x7fe3801610b0 2024-09-13T18:48:28.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe384e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380070b30 con 0x7fe3800b2d80 2024-09-13T18:48:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37ea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe38006aaa0 0x7fe3800b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60132/0 (socket says 172.21.15.81:60132) 2024-09-13T18:48:28.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37ea00700 1 -- 172.21.15.81:0/308367886 learned_addr learned my addr 172.21.15.81:0/308367886 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37fe00700 1 --2- 172.21.15.81:0/308367886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3800b2d80 0x7fe38006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695253288 0 0) 0x7fe3800b3560 con 0x7fe38006aaa0 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3640035d0 con 0x7fe38006aaa0 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907158088 0 0) 0x7fe3800b3280 con 0x7fe3801610b0 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3800b3560 con 0x7fe3801610b0 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37fe00700 1 -- 172.21.15.81:0/308367886 >> v1:172.21.15.178:6789/0 conn(0x7fe3801610b0 legacy=0x7fe3800719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37fe00700 1 -- 172.21.15.81:0/308367886 >> v1:172.21.15.81:6789/0 conn(0x7fe38006aaa0 legacy=0x7fe3800b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37fe00700 1 -- 172.21.15.81:0/308367886 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe380070ee0 con 0x7fe3800b2d80 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.589+0000 7fe37fe00700 1 --2- 172.21.15.81:0/308367886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3800b2d80 0x7fe38006af10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe378009df0 tx=0x7fe37800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=862f88d11cc2d499 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800e070 con 0x7fe3800b2d80 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800bae0 con 0x7fe3800b2d80 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe37e000700 1 -- 172.21.15.81:0/308367886 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800be50 con 0x7fe3800b2d80 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 -- 172.21.15.81:0/308367886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3800b2d80 msgr2=0x7fe38006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 --2- 172.21.15.81:0/308367886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3800b2d80 0x7fe38006af10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe378009df0 tx=0x7fe37800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 -- 172.21.15.81:0/308367886 shutdown_connections 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 --2- 172.21.15.81:0/308367886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3800b2d80 0x7fe38006af10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 -- 172.21.15.81:0/308367886 >> 172.21.15.81:0/308367886 conn(0x7fe3800b0c40 msgr2=0x7fe38006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 -- 172.21.15.81:0/308367886 shutdown_connections 2024-09-13T18:48:28.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.593+0000 7fe384e00700 1 -- 172.21.15.81:0/308367886 wait complete. 2024-09-13T18:48:28.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 Processor -- start 2024-09-13T18:48:28.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 -- start start 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe38006aaa0 0x7fe3800cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3800b2d80 0x7fe3800a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 0x7fe3800a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38015d0a0 con 0x7fe3801610b0 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38014d740 con 0x7fe3800b2d80 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe384e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38014dd00 con 0x7fe38006aaa0 2024-09-13T18:48:28.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe37fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 0x7fe3800a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe37fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 0x7fe3800a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36128/0 (socket says 172.21.15.81:36128) 2024-09-13T18:48:28.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe37fe00700 1 -- 172.21.15.81:0/2742673271 learned_addr learned my addr 172.21.15.81:0/2742673271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe37ea00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3800b2d80 0x7fe3800a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.597+0000 7fe37f400700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe38006aaa0 0x7fe3800cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe37fe00700 1 -- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe38006aaa0 msgr2=0x7fe3800cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe37fe00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe38006aaa0 0x7fe3800cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe37fe00700 1 -- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3800b2d80 msgr2=0x7fe3800a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe37fe00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3800b2d80 0x7fe3800a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe37fe00700 1 -- 172.21.15.81:0/2742673271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009a70 con 0x7fe3801610b0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe37fe00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 0x7fe3800a89c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe378013000 tx=0x7fe378004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780098f0 con 0x7fe3801610b0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3800a9040 con 0x7fe3801610b0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378020070 con 0x7fe3801610b0 2024-09-13T18:48:28.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780276a0 con 0x7fe3801610b0 2024-09-13T18:48:28.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38014d990 con 0x7fe3801610b0 2024-09-13T18:48:28.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.601+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38006af10 con 0x7fe3801610b0 2024-09-13T18:48:28.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.605+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe378012430 con 0x7fe3801610b0 2024-09-13T18:48:28.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.605+0000 7fe377400700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe360066730 0x7fe360068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.605+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe378022070 con 0x7fe3801610b0 2024-09-13T18:48:28.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.605+0000 7fe37f400700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe360066730 0x7fe360068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.605+0000 7fe37f400700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe360066730 0x7fe360068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3700011e0 tx=0x7fe370009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.609+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3780531d0 con 0x7fe3801610b0 2024-09-13T18:48:28.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.837+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe38014de40 con 0x7fe3801610b0 2024-09-13T18:48:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.837+0000 7fe377400700 1 -- 172.21.15.81:0/2742673271 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4730 (secure 0 0 0) 0x7fe3780567f0 con 0x7fe3801610b0 2024-09-13T18:48:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:28.844 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/571231535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":571231535},{"type":"v1","addr":"172.21.15.178:6833","nonce":571231535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1707379725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1707379725},{"type":"v1","addr":"172.21.15.178:6835","nonce":1707379725}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1577110951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1577110951},{"type":"v1","addr":"172.21.15.81:6837","nonce":1577110951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:15.438108+0000","modified":"2024-09-13T18:47:35.558150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6835/968984617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":968984617},{"type":"v1","addr":"172.21.15.81:6835","nonce":968984617}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:48:28.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe360066730 msgr2=0x7fe360068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe360066730 0x7fe360068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe3700011e0 tx=0x7fe370009040 comp rx=0 tx=0).stop 2024-09-13T18:48:28.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 msgr2=0x7fe3800a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 0x7fe3800a89c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe378013000 tx=0x7fe378004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 shutdown_connections 2024-09-13T18:48:28.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe360066730 0x7fe360068bf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3801610b0 0x7fe3800a89c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3800b2d80 0x7fe3800a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 --2- 172.21.15.81:0/2742673271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe38006aaa0 0x7fe3800cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 >> 172.21.15.81:0/2742673271 conn(0x7fe3800b0c40 msgr2=0x7fe3800cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 shutdown_connections 2024-09-13T18:48:28.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:28.841+0000 7fe384e00700 1 -- 172.21.15.81:0/2742673271 wait complete. 2024-09-13T18:48:28.849 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-09-13T18:48:28.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 Processor -- start 2024-09-13T18:48:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 -- start start 2024-09-13T18:48:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf10143d60 0x7fcf100cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf100cf480 0x7fcf1006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1006a430 con 0x7fcf1006ba10 2024-09-13T18:48:29.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1006a710 con 0x7fcf10143d60 2024-09-13T18:48:29.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf16800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1006a9f0 con 0x7fcf100cf480 2024-09-13T18:48:29.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf15400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf10143d60 0x7fcf100cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf15e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcf1006ba10 0x7fcf1015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60146/0 (socket says 172.21.15.81:60146) 2024-09-13T18:48:29.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf15e00700 1 -- 172.21.15.81:0/751141926 learned_addr learned my addr 172.21.15.81:0/751141926 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:29.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.037+0000 7fcf14a00700 1 --2- 172.21.15.81:0/751141926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf100cf480 0x7fcf1006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf15400700 1 -- 172.21.15.81:0/751141926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf100cf480 msgr2=0x7fcf1006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf15400700 1 --2- 172.21.15.81:0/751141926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf100cf480 0x7fcf1006b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf15400700 1 -- 172.21.15.81:0/751141926 >> v1:172.21.15.81:6789/0 conn(0x7fcf1006ba10 legacy=0x7fcf1015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf15400700 1 -- 172.21.15.81:0/751141926 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1006acd0 con 0x7fcf10143d60 2024-09-13T18:48:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf0fe00700 1 -- 172.21.15.81:0/751141926 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502344781 0 0) 0x7fcf1006a430 con 0x7fcf1006ba10 2024-09-13T18:48:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf15400700 1 --2- 172.21.15.81:0/751141926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf10143d60 0x7fcf100cef40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009850 tx=0x7fcf04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766ff33405d1aac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf0fe00700 1 -- 172.21.15.81:0/751141926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011830 con 0x7fcf10143d60 2024-09-13T18:48:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf0fe00700 1 -- 172.21.15.81:0/751141926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf04011990 con 0x7fcf10143d60 2024-09-13T18:48:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf0fe00700 1 -- 172.21.15.81:0/751141926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf04011d40 con 0x7fcf10143d60 2024-09-13T18:48:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 -- 172.21.15.81:0/751141926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf10143d60 msgr2=0x7fcf100cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 --2- 172.21.15.81:0/751141926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf10143d60 0x7fcf100cef40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009850 tx=0x7fcf04009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 -- 172.21.15.81:0/751141926 shutdown_connections 2024-09-13T18:48:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 --2- 172.21.15.81:0/751141926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf100cf480 0x7fcf1006b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 --2- 172.21.15.81:0/751141926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf10143d60 0x7fcf100cef40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 -- 172.21.15.81:0/751141926 >> 172.21.15.81:0/751141926 conn(0x7fcf1006ca10 msgr2=0x7fcf1006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 -- 172.21.15.81:0/751141926 shutdown_connections 2024-09-13T18:48:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.041+0000 7fcf16800700 1 -- 172.21.15.81:0/751141926 wait complete. 2024-09-13T18:48:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 Processor -- start 2024-09-13T18:48:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 -- start start 2024-09-13T18:48:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf1006ba10 0x7fcf101f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 0x7fcf1013f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf10143d60 0x7fcf100b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1013f810 con 0x7fcf100cf480 2024-09-13T18:48:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100b2e40 con 0x7fcf1006ba10 2024-09-13T18:48:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf16800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100b3100 con 0x7fcf10143d60 2024-09-13T18:48:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf14a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 0x7fcf1013f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf14a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 0x7fcf1013f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36140/0 (socket says 172.21.15.81:36140) 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf14a00700 1 -- 172.21.15.81:0/400631581 learned_addr learned my addr 172.21.15.81:0/400631581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf15400700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf1006ba10 0x7fcf101f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.045+0000 7fcf15e00700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf10143d60 0x7fcf100b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf14a00700 1 -- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf10143d60 msgr2=0x7fcf100b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf14a00700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf10143d60 0x7fcf100b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf14a00700 1 -- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf1006ba10 msgr2=0x7fcf101f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf14a00700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf1006ba10 0x7fcf101f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf14a00700 1 -- 172.21.15.81:0/400631581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040094b0 con 0x7fcf100cf480 2024-09-13T18:48:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf15400700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf1006ba10 0x7fcf101f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf15e00700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf10143d60 0x7fcf100b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf14a00700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 0x7fcf1013f2d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00e9a0 tx=0x7fcefc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc009720 con 0x7fcf100cf480 2024-09-13T18:48:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc00c850 con 0x7fcf100cf480 2024-09-13T18:48:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf100b33e0 con 0x7fcf100cf480 2024-09-13T18:48:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc00cbe0 con 0x7fcf100cf480 2024-09-13T18:48:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf100b39a0 con 0x7fcf100cf480 2024-09-13T18:48:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.049+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1006b4d0 con 0x7fcf100cf480 2024-09-13T18:48:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.053+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcefc00cd40 con 0x7fcf100cf480 2024-09-13T18:48:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.053+0000 7fcf0d600700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcef0066730 0x7fcef0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.053+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcefc0846d0 con 0x7fcf100cf480 2024-09-13T18:48:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.053+0000 7fcf15400700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcef0066730 0x7fcef0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.053+0000 7fcf15400700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcef0066730 0x7fcef0068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009ba0 tx=0x7fcf04008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.061+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcefc0515e0 con 0x7fcf100cf480 2024-09-13T18:48:29.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.253+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf100af3a0 con 0x7fcf100cf480 2024-09-13T18:48:29.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.257+0000 7fcf0d600700 1 -- 172.21.15.81:0/400631581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18676 (secure 0 0 0) 0x7fcefc054c00 con 0x7fcf100cf480 2024-09-13T18:48:29.262 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:29.263 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:47:58.053753+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:13.295261+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:14.421707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T18:47:17.532954+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcef0066730 msgr2=0x7fcef0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcef0066730 0x7fcef0068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fcf04009ba0 tx=0x7fcf04008030 comp rx=0 tx=0).stop 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 msgr2=0x7fcf1013f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 0x7fcf1013f2d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00e9a0 tx=0x7fcefc00ed60 comp rx=0 tx=0).stop 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 shutdown_connections 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcef0066730 0x7fcef0068bf0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf10143d60 0x7fcf100b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf100cf480 0x7fcf1013f2d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 --2- 172.21.15.81:0/400631581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf1006ba10 0x7fcf101f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 >> 172.21.15.81:0/400631581 conn(0x7fcf1006ca10 msgr2=0x7fcf1015e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 shutdown_connections 2024-09-13T18:48:29.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.261+0000 7fcf16800700 1 -- 172.21.15.81:0/400631581 wait complete. 2024-09-13T18:48:29.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:48:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.445+0000 7fa4a9200700 1 Processor -- start 2024-09-13T18:48:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.445+0000 7fa4a9200700 1 -- start start 2024-09-13T18:48:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406a5d0 0x7fa4a406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a9200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a40cdd90 con 0x7fa4a406c460 2024-09-13T18:48:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a9200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a406ce10 con 0x7fa4a415b700 2024-09-13T18:48:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a406afa0 con 0x7fa4a406a5d0 2024-09-13T18:48:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a1400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa4a406c460 0x7fa4a406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60156/0 (socket says 172.21.15.81:60156) 2024-09-13T18:48:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a1400700 1 -- 172.21.15.81:0/477562757 learned_addr learned my addr 172.21.15.81:0/477562757 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:29.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a2800700 1 --2- 172.21.15.81:0/477562757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406a5d0 0x7fa4a406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a0a00700 1 -- 172.21.15.81:0/477562757 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647056457 0 0) 0x7fa4a40cdd90 con 0x7fa4a406c460 2024-09-13T18:48:29.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a0a00700 1 -- 172.21.15.81:0/477562757 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4880035d0 con 0x7fa4a406c460 2024-09-13T18:48:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a2800700 1 -- 172.21.15.81:0/477562757 >> v1:172.21.15.178:6789/0 conn(0x7fa4a415b700 legacy=0x7fa4a415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a2800700 1 -- 172.21.15.81:0/477562757 >> v1:172.21.15.81:6789/0 conn(0x7fa4a406c460 legacy=0x7fa4a406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a0a00700 1 -- 172.21.15.81:0/477562757 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909023896 0 0) 0x7fa4a406ce10 con 0x7fa4a415b700 2024-09-13T18:48:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a2800700 1 -- 172.21.15.81:0/477562757 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a40cd4f0 con 0x7fa4a406a5d0 2024-09-13T18:48:29.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.449+0000 7fa4a2800700 1 --2- 172.21.15.81:0/477562757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406a5d0 0x7fa4a406aa60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009880 tx=0x7fa49c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2aa251f3639562 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a0a00700 1 -- 172.21.15.81:0/477562757 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c011830 con 0x7fa4a406a5d0 2024-09-13T18:48:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a0a00700 1 -- 172.21.15.81:0/477562757 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c011990 con 0x7fa4a406a5d0 2024-09-13T18:48:29.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a0a00700 1 -- 172.21.15.81:0/477562757 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c011d20 con 0x7fa4a406a5d0 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 -- 172.21.15.81:0/477562757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406a5d0 msgr2=0x7fa4a406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 --2- 172.21.15.81:0/477562757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406a5d0 0x7fa4a406aa60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009880 tx=0x7fa49c009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 -- 172.21.15.81:0/477562757 shutdown_connections 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 --2- 172.21.15.81:0/477562757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406a5d0 0x7fa4a406aa60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 -- 172.21.15.81:0/477562757 >> 172.21.15.81:0/477562757 conn(0x7fa4a40b08d0 msgr2=0x7fa4a40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 -- 172.21.15.81:0/477562757 shutdown_connections 2024-09-13T18:48:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 -- 172.21.15.81:0/477562757 wait complete. 2024-09-13T18:48:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 Processor -- start 2024-09-13T18:48:29.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.453+0000 7fa4a9200700 1 -- start start 2024-09-13T18:48:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4a406a5d0 0x7fa4a40714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406c460 0x7fa4a41494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 0x7fa4a4070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4149a30 con 0x7fa4a415b700 2024-09-13T18:48:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a4070950 con 0x7fa4a406a5d0 2024-09-13T18:48:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a414d4e0 con 0x7fa4a406c460 2024-09-13T18:48:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 0x7fa4a4070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 0x7fa4a4070410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36156/0 (socket says 172.21.15.81:36156) 2024-09-13T18:48:29.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 -- 172.21.15.81:0/3591225318 learned_addr learned my addr 172.21.15.81:0/3591225318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a1400700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406c460 0x7fa4a41494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a1e00700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4a406a5d0 0x7fa4a40714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 -- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406c460 msgr2=0x7fa4a41494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406c460 0x7fa4a41494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 -- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4a406a5d0 msgr2=0x7fa4a40714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4a406a5d0 0x7fa4a40714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 -- 172.21.15.81:0/3591225318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0094b0 con 0x7fa4a415b700 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a1400700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406c460 0x7fa4a41494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a2800700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 0x7fa4a4070410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097d0 tx=0x7fa49c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c019950 con 0x7fa4a415b700 2024-09-13T18:48:29.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a4071be0 con 0x7fa4a415b700 2024-09-13T18:48:29.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c01e070 con 0x7fa4a415b700 2024-09-13T18:48:29.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c019d10 con 0x7fa4a415b700 2024-09-13T18:48:29.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.457+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a414da10 con 0x7fa4a415b700 2024-09-13T18:48:29.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.461+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a406aa60 con 0x7fa4a415b700 2024-09-13T18:48:29.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.461+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa49c02d450 con 0x7fa4a415b700 2024-09-13T18:48:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.461+0000 7fa49a000700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa484066730 0x7fa484068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.461+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa49c085500 con 0x7fa4a415b700 2024-09-13T18:48:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.461+0000 7fa4a1e00700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa484066730 0x7fa484068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.465+0000 7fa4a1e00700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa484066730 0x7fa484068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4940012e0 tx=0x7fa494009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.469+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa49c0524d0 con 0x7fa4a415b700 2024-09-13T18:48:29.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.689+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa4a406c240 con 0x7fa4a415b700 2024-09-13T18:48:29.696 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:48:29.689+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:48:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.701+0000 7fa49a000700 1 -- 172.21.15.81:0/3591225318 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa49c055af0 con 0x7fa4a415b700 2024-09-13T18:48:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa484066730 msgr2=0x7fa484068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa484066730 0x7fa484068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4940012e0 tx=0x7fa494009040 comp rx=0 tx=0).stop 2024-09-13T18:48:29.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 msgr2=0x7fa4a4070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 0x7fa4a4070410 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097d0 tx=0x7fa49c004770 comp rx=0 tx=0).stop 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 shutdown_connections 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa484066730 0x7fa484068bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4a415b700 0x7fa4a4070410 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4a406c460 0x7fa4a41494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 --2- 172.21.15.81:0/3591225318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4a406a5d0 0x7fa4a40714e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 >> 172.21.15.81:0/3591225318 conn(0x7fa4a40b08d0 msgr2=0x7fa4a40b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 shutdown_connections 2024-09-13T18:48:29.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.705+0000 7fa4a9200700 1 -- 172.21.15.81:0/3591225318 wait complete. 2024-09-13T18:48:29.714 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:48:29.721 INFO:tasks.ceph.mds.c.smithi081.stderr: -5421> 2024-09-13T18:47:19.918+0000 7f34c9800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:48:29.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:48:29.777 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:48:29.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 Processor -- start 2024-09-13T18:48:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 -- start start 2024-09-13T18:48:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6401464c0 0x7fa640071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6400b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa64006c960 0x7fa64006cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64006d330 con 0x7fa64006c960 2024-09-13T18:48:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa640070da0 con 0x7fa6401464c0 2024-09-13T18:48:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa645200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400b2440 con 0x7fa6400b1980 2024-09-13T18:48:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.893+0000 7fa63fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa64006c960 0x7fa64006cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa64006c960 0x7fa64006cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36168/0 (socket says 172.21.15.81:36168) 2024-09-13T18:48:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 -- 172.21.15.81:0/805702461 learned_addr learned my addr 172.21.15.81:0/805702461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63f400700 1 --2- 172.21.15.81:0/805702461 >> v2:172.21.15.178:3300/0 conn(0x7fa6401464c0 0x7fa640071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa636a00700 1 --2- 172.21.15.81:0/805702461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6400b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 -- 172.21.15.81:0/805702461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 msgr2=0x7fa6400b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 --2- 172.21.15.81:0/805702461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6400b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 -- 172.21.15.81:0/805702461 >> v2:172.21.15.178:3300/0 conn(0x7fa6401464c0 msgr2=0x7fa640071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 --2- 172.21.15.81:0/805702461 >> v2:172.21.15.178:3300/0 conn(0x7fa6401464c0 0x7fa640071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 -- 172.21.15.81:0/805702461 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400b2720 con 0x7fa64006c960 2024-09-13T18:48:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63fe00700 1 --2- 172.21.15.81:0/805702461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64006c960 0x7fa64006cdf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa64006d740 tx=0x7fa63800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cde814ed4b4e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63ea00700 1 -- 172.21.15.81:0/805702461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800e070 con 0x7fa64006c960 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63ea00700 1 -- 172.21.15.81:0/805702461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63800b910 con 0x7fa64006c960 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa63ea00700 1 -- 172.21.15.81:0/805702461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63800bcc0 con 0x7fa64006c960 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 -- 172.21.15.81:0/805702461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64006c960 msgr2=0x7fa64006cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 --2- 172.21.15.81:0/805702461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64006c960 0x7fa64006cdf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa64006d740 tx=0x7fa63800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 -- 172.21.15.81:0/805702461 shutdown_connections 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 --2- 172.21.15.81:0/805702461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa64006c960 0x7fa64006cdf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 --2- 172.21.15.81:0/805702461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6400b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 --2- 172.21.15.81:0/805702461 >> v2:172.21.15.178:3300/0 conn(0x7fa6401464c0 0x7fa640071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 -- 172.21.15.81:0/805702461 >> 172.21.15.81:0/805702461 conn(0x7fa64006a390 msgr2=0x7fa64006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 -- 172.21.15.81:0/805702461 shutdown_connections 2024-09-13T18:48:29.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.897+0000 7fa645200700 1 -- 172.21.15.81:0/805702461 wait complete. 2024-09-13T18:48:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.901+0000 7fa645200700 1 Processor -- start 2024-09-13T18:48:29.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.901+0000 7fa645200700 1 -- start start 2024-09-13T18:48:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa645200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64006c960 0x7fa64013ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa645200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6401f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa645200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 0x7fa6401f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa645200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64013e820 con 0x7fa6401464c0 2024-09-13T18:48:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa645200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64013dba0 con 0x7fa64006c960 2024-09-13T18:48:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa645200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64013de80 con 0x7fa6400b1980 2024-09-13T18:48:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 0x7fa6401f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 0x7fa6401f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36184/0 (socket says 172.21.15.81:36184) 2024-09-13T18:48:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 -- 172.21.15.81:0/2273673410 learned_addr learned my addr 172.21.15.81:0/2273673410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa636a00700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6401f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63f400700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64006c960 0x7fa64013ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 -- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 msgr2=0x7fa6401f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6401f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 -- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64006c960 msgr2=0x7fa64013ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64006c960 0x7fa64013ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.905+0000 7fa63fe00700 1 -- 172.21.15.81:0/2273673410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638009b30 con 0x7fa6401464c0 2024-09-13T18:48:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.909+0000 7fa63fe00700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 0x7fa6401f28d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa640072150 tx=0x7fa638004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.909+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380099b0 con 0x7fa6401464c0 2024-09-13T18:48:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.909+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380092e0 con 0x7fa6401464c0 2024-09-13T18:48:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.909+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638004450 con 0x7fa6401464c0 2024-09-13T18:48:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.909+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64013e160 con 0x7fa6401464c0 2024-09-13T18:48:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.909+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64013f180 con 0x7fa6401464c0 2024-09-13T18:48:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.913+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64013e960 con 0x7fa6401464c0 2024-09-13T18:48:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.913+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6380045b0 con 0x7fa6401464c0 2024-09-13T18:48:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.913+0000 7fa637e00700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa61c066730 0x7fa61c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.913+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fa638085ef0 con 0x7fa6401464c0 2024-09-13T18:48:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.913+0000 7fa63f400700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa61c066730 0x7fa61c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.913+0000 7fa63f400700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa61c066730 0x7fa61c068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa630009b70 tx=0x7fa630009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:29.917+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa6380569f0 con 0x7fa6401464c0 2024-09-13T18:48:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.129+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa64013e960 con 0x7fa6401464c0 2024-09-13T18:48:30.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.709+0000 7fa637e00700 1 -- 172.21.15.81:0/2273673410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa64013e960 con 0x7fa6401464c0 2024-09-13T18:48:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa61c066730 msgr2=0x7fa61c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa61c066730 0x7fa61c068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa630009b70 tx=0x7fa630009240 comp rx=0 tx=0).stop 2024-09-13T18:48:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 msgr2=0x7fa6401f28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 0x7fa6401f28d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa640072150 tx=0x7fa638004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 shutdown_connections 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa61c066730 0x7fa61c068bf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6401464c0 0x7fa6401f28d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6400b1980 0x7fa6401f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 --2- 172.21.15.81:0/2273673410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa64006c960 0x7fa64013ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 >> 172.21.15.81:0/2273673410 conn(0x7fa64006a390 msgr2=0x7fa6400ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 shutdown_connections 2024-09-13T18:48:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.713+0000 7fa645200700 1 -- 172.21.15.81:0/2273673410 wait complete. 2024-09-13T18:48:30.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.969+0000 7f2d20e00700 1 Processor -- start 2024-09-13T18:48:30.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.969+0000 7f2d20e00700 1 -- start start 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d20e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d1c066300 0x7f2d1c160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d20e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d1c15dd10 0x7f2d1c160b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d20e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c161260 con 0x7f2d1c0666e0 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d20e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c161540 con 0x7f2d1c066300 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d20e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c15d020 con 0x7f2d1c15dd10 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d1b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d1c066300 0x7f2d1c160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d1b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d1c066300 0x7f2d1c160610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36194/0 (socket says 172.21.15.81:36194) 2024-09-13T18:48:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d1b400700 1 -- 172.21.15.81:0/1461479268 learned_addr learned my addr 172.21.15.81:0/1461479268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d1aa00700 1 --2- 172.21.15.81:0/1461479268 >> v2:172.21.15.178:3300/0 conn(0x7f2d1c15dd10 0x7f2d1c160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d1b400700 1 -- 172.21.15.81:0/1461479268 >> v2:172.21.15.178:3300/0 conn(0x7f2d1c15dd10 msgr2=0x7f2d1c160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:30.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.973+0000 7f2d1b400700 1 --2- 172.21.15.81:0/1461479268 >> v2:172.21.15.178:3300/0 conn(0x7f2d1c15dd10 0x7f2d1c160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d1b400700 1 -- 172.21.15.81:0/1461479268 >> v1:172.21.15.81:6789/0 conn(0x7f2d1c0666e0 legacy=0x7f2d1c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d1b400700 1 -- 172.21.15.81:0/1461479268 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c15d230 con 0x7f2d1c066300 2024-09-13T18:48:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d1b400700 1 --2- 172.21.15.81:0/1461479268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c066300 0x7f2d1c160610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0acb60 tx=0x7f2d0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501e212493ac9ad4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d1a000700 1 -- 172.21.15.81:0/1461479268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00e070 con 0x7f2d1c066300 2024-09-13T18:48:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d1a000700 1 -- 172.21.15.81:0/1461479268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c00b9c0 con 0x7f2d1c066300 2024-09-13T18:48:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d1a000700 1 -- 172.21.15.81:0/1461479268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c00bd70 con 0x7f2d1c066300 2024-09-13T18:48:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 -- 172.21.15.81:0/1461479268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c066300 msgr2=0x7f2d1c160610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1461479268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c066300 0x7f2d1c160610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0acb60 tx=0x7f2d0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:48:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 -- 172.21.15.81:0/1461479268 shutdown_connections 2024-09-13T18:48:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1461479268 >> v2:172.21.15.178:3300/0 conn(0x7f2d1c15dd10 0x7f2d1c160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1461479268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c066300 0x7f2d1c160610 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 -- 172.21.15.81:0/1461479268 >> 172.21.15.81:0/1461479268 conn(0x7f2d1c0b2430 msgr2=0x7f2d1c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 -- 172.21.15.81:0/1461479268 shutdown_connections 2024-09-13T18:48:30.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.977+0000 7f2d20e00700 1 -- 172.21.15.81:0/1461479268 wait complete. 2024-09-13T18:48:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 Processor -- start 2024-09-13T18:48:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 -- start start 2024-09-13T18:48:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d1c066300 0x7f2d1c1f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 0x7f2d1c1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d1c15dd10 0x7f2d1c155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c1f2740 con 0x7f2d1c0666e0 2024-09-13T18:48:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c1f55b0 con 0x7f2d1c066300 2024-09-13T18:48:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d20e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c146d00 con 0x7f2d1c15dd10 2024-09-13T18:48:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d1aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 0x7f2d1c1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d1aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 0x7f2d1c1f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36204/0 (socket says 172.21.15.81:36204) 2024-09-13T18:48:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d1aa00700 1 -- 172.21.15.81:0/1813381325 learned_addr learned my addr 172.21.15.81:0/1813381325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d1b400700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d1c066300 0x7f2d1c1f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:30.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.981+0000 7f2d1be00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d1c15dd10 0x7f2d1c155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d1aa00700 1 -- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d1c15dd10 msgr2=0x7f2d1c155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d1aa00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d1c15dd10 0x7f2d1c155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d1aa00700 1 -- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d1c066300 msgr2=0x7f2d1c1f2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d1aa00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d1c066300 0x7f2d1c1f2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d1aa00700 1 -- 172.21.15.81:0/1813381325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009b30 con 0x7f2d1c0666e0 2024-09-13T18:48:30.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d1aa00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 0x7f2d1c1f5070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800d830 tx=0x7f2d0800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080125f0 con 0x7f2d1c0666e0 2024-09-13T18:48:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08012770 con 0x7f2d1c0666e0 2024-09-13T18:48:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c146fe0 con 0x7f2d1c0666e0 2024-09-13T18:48:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08012b20 con 0x7f2d1c0666e0 2024-09-13T18:48:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c1475a0 con 0x7f2d1c0666e0 2024-09-13T18:48:30.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.985+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c067790 con 0x7f2d1c0666e0 2024-09-13T18:48:30.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.989+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d08012c80 con 0x7f2d1c0666e0 2024-09-13T18:48:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.989+0000 7f2d13400700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2cfc066730 0x7f2cfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.989+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2d08084790 con 0x7f2d1c0666e0 2024-09-13T18:48:30.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.989+0000 7f2d1b400700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2cfc066730 0x7f2cfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:30.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.989+0000 7f2d1b400700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2cfc066730 0x7f2cfc068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c000f80 tx=0x7f2d0c009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:31.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:30.997+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d08051660 con 0x7f2d1c0666e0 2024-09-13T18:48:31.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.181+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d1c06f670 con 0x7f2d1c0666e0 2024-09-13T18:48:31.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.717+0000 7f2d13400700 1 -- 172.21.15.81:0/1813381325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2d08054c80 con 0x7f2d1c0666e0 2024-09-13T18:48:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.721+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2cfc066730 msgr2=0x7f2cfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.721+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2cfc066730 0x7f2cfc068bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c000f80 tx=0x7f2d0c009000 comp rx=0 tx=0).stop 2024-09-13T18:48:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.721+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 msgr2=0x7f2d1c1f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:31.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.721+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 0x7f2d1c1f5070 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800d830 tx=0x7f2d0800db40 comp rx=0 tx=0).stop 2024-09-13T18:48:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 shutdown_connections 2024-09-13T18:48:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2cfc066730 0x7f2cfc068bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d1c15dd10 0x7f2d1c155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d1c0666e0 0x7f2d1c1f5070 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 --2- 172.21.15.81:0/1813381325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d1c066300 0x7f2d1c1f2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 >> 172.21.15.81:0/1813381325 conn(0x7f2d1c0b2430 msgr2=0x7f2d1c0ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:31.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 shutdown_connections 2024-09-13T18:48:31.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.725+0000 7f2d20e00700 1 -- 172.21.15.81:0/1813381325 wait complete. 2024-09-13T18:48:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:48:31.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:48:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.925+0000 7f6516400700 1 Processor -- start 2024-09-13T18:48:31.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f6516400700 1 -- start start 2024-09-13T18:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f6516400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f651006d760 0x7f65100b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:31.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f6516400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6510144710 0x7f65100b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f6516400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651006bcf0 con 0x7f6510144330 2024-09-13T18:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f6516400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65100cce10 con 0x7f651006d760 2024-09-13T18:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f6516400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651006cb50 con 0x7f6510144710 2024-09-13T18:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f650f400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6510144330 0x7f65100cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60178/0 (socket says 172.21.15.81:60178) 2024-09-13T18:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f650f400700 1 -- 172.21.15.81:0/3432170113 learned_addr learned my addr 172.21.15.81:0/3432170113 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:31.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f650ea00700 1 --2- 172.21.15.81:0/3432170113 >> v2:172.21.15.178:3300/0 conn(0x7f651006d760 0x7f65100b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f650fe00700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6510144710 0x7f65100b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.929+0000 7f650e000700 1 -- 172.21.15.81:0/3432170113 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561101928 0 0) 0x7f651006bcf0 con 0x7f6510144330 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650e000700 1 -- 172.21.15.81:0/3432170113 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f40035d0 con 0x7f6510144330 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650ea00700 1 -- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6510144710 msgr2=0x7f65100b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650ea00700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6510144710 0x7f65100b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650ea00700 1 -- 172.21.15.81:0/3432170113 >> v1:172.21.15.81:6789/0 conn(0x7f6510144330 legacy=0x7f65100cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:31.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650ea00700 1 -- 172.21.15.81:0/3432170113 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651006bf40 con 0x7f651006d760 2024-09-13T18:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650fe00700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6510144710 0x7f65100b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650ea00700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f651006d760 0x7f65100b35a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009850 tx=0x7f64fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6aa5ad8d9bdc43a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650e000700 1 -- 172.21.15.81:0/3432170113 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011830 con 0x7f651006d760 2024-09-13T18:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650e000700 1 -- 172.21.15.81:0/3432170113 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc011990 con 0x7f651006d760 2024-09-13T18:48:31.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f650e000700 1 -- 172.21.15.81:0/3432170113 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011d40 con 0x7f651006d760 2024-09-13T18:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 -- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f651006d760 msgr2=0x7f65100b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f651006d760 0x7f65100b35a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009850 tx=0x7f64fc009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:31.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 -- 172.21.15.81:0/3432170113 shutdown_connections 2024-09-13T18:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6510144710 0x7f65100b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 --2- 172.21.15.81:0/3432170113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f651006d760 0x7f65100b35a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 -- 172.21.15.81:0/3432170113 >> 172.21.15.81:0/3432170113 conn(0x7f651006a570 msgr2=0x7f651006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 -- 172.21.15.81:0/3432170113 shutdown_connections 2024-09-13T18:48:31.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.933+0000 7f6516400700 1 -- 172.21.15.81:0/3432170113 wait complete. 2024-09-13T18:48:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 Processor -- start 2024-09-13T18:48:31.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 -- start start 2024-09-13T18:48:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 0x7f65100afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:31.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6510144330 0x7f6510139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f651013c2f0 0x7f65101528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65101f02b0 con 0x7f651006d760 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100af5a0 con 0x7f6510144330 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f6516400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65100ae990 con 0x7f651013c2f0 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 0x7f65100afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 0x7f65100afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36214/0 (socket says 172.21.15.81:36214) 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 -- 172.21.15.81:0/2231465963 learned_addr learned my addr 172.21.15.81:0/2231465963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650fe00700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f651013c2f0 0x7f65101528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650ea00700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6510144330 0x7f6510139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 -- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f651013c2f0 msgr2=0x7f65101528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f651013c2f0 0x7f65101528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 -- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6510144330 msgr2=0x7f6510139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:31.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6510144330 0x7f6510139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:31.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 -- 172.21.15.81:0/2231465963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6508009a70 con 0x7f651006d760 2024-09-13T18:48:31.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.937+0000 7f650f400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 0x7f65100afa30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f650000c700 tx=0x7f650000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:31.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500005d90 con 0x7f651006d760 2024-09-13T18:48:31.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65000070d0 con 0x7f651006d760 2024-09-13T18:48:31.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0094b0 con 0x7f651006d760 2024-09-13T18:48:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500007480 con 0x7f651006d760 2024-09-13T18:48:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65100aef50 con 0x7f651006d760 2024-09-13T18:48:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65100cef70 con 0x7f651006d760 2024-09-13T18:48:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.941+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65000075e0 con 0x7f651006d760 2024-09-13T18:48:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.945+0000 7f6507400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64f0066730 0x7f64f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.945+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f65000838d0 con 0x7f651006d760 2024-09-13T18:48:31.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.945+0000 7f650ea00700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64f0066730 0x7f64f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:31.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.945+0000 7f650ea00700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64f0066730 0x7f64f0068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65100ae610 tx=0x7f64fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:31.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:31.953+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65000508b0 con 0x7f651006d760 2024-09-13T18:48:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.137+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f651015e340 con 0x7f651006d760 2024-09-13T18:48:32.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.729+0000 7f6507400700 1 -- 172.21.15.81:0/2231465963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6500017020 con 0x7f651006d760 2024-09-13T18:48:32.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64f0066730 msgr2=0x7f64f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:32.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64f0066730 0x7f64f0068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65100ae610 tx=0x7f64fc008030 comp rx=0 tx=0).stop 2024-09-13T18:48:32.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 msgr2=0x7f65100afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:32.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 0x7f65100afa30 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f650000c700 tx=0x7f650000ca10 comp rx=0 tx=0).stop 2024-09-13T18:48:32.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 shutdown_connections 2024-09-13T18:48:32.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64f0066730 0x7f64f0068bf0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f65100ae610 tx=0x7f64fc008030 comp rx=0 tx=0).stop 2024-09-13T18:48:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f651013c2f0 0x7f65101528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6510144330 0x7f6510139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 --2- 172.21.15.81:0/2231465963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f651006d760 0x7f65100afa30 secure :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f650000c700 tx=0x7f650000ca10 comp rx=0 tx=0).stop 2024-09-13T18:48:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 >> 172.21.15.81:0/2231465963 conn(0x7f651006a570 msgr2=0x7f651015e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 shutdown_connections 2024-09-13T18:48:32.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.733+0000 7f6516400700 1 -- 172.21.15.81:0/2231465963 wait complete. 2024-09-13T18:48:32.745 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:48:32.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T18:48:32.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.929+0000 7f125d000700 1 Processor -- start 2024-09-13T18:48:32.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.929+0000 7f125d000700 1 -- start start 2024-09-13T18:48:32.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f125d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:32.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f125d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12580cd530 0x7f1258071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:32.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f125d000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12580cf7a0 con 0x7f125815ad60 2024-09-13T18:48:32.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f125d000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125815b5d0 con 0x7f12580cd530 2024-09-13T18:48:32.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f125d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125815b8b0 con 0x7f125815a980 2024-09-13T18:48:32.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12580cd530 0x7f1258071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:32.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1256a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f125815ad60 0x7f12580cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60190/0 (socket says 172.21.15.81:60190) 2024-09-13T18:48:32.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1256a00700 1 -- 172.21.15.81:0/626534763 learned_addr learned my addr 172.21.15.81:0/626534763 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:32.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257400700 1 --2- 172.21.15.81:0/626534763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:32.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257e00700 1 -- 172.21.15.81:0/626534763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 msgr2=0x7f12580cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:32.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257e00700 1 --2- 172.21.15.81:0/626534763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257e00700 1 -- 172.21.15.81:0/626534763 >> v1:172.21.15.81:6789/0 conn(0x7f125815ad60 legacy=0x7f12580cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:32.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257e00700 1 -- 172.21.15.81:0/626534763 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125815bb90 con 0x7f12580cd530 2024-09-13T18:48:32.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.933+0000 7f1257e00700 1 --2- 172.21.15.81:0/626534763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258071360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1250009d90 tx=0x7f125000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de942c55a98847a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f1256000700 1 -- 172.21.15.81:0/626534763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000e070 con 0x7f12580cd530 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f1256000700 1 -- 172.21.15.81:0/626534763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000bbd0 con 0x7f12580cd530 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f1256000700 1 -- 172.21.15.81:0/626534763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250012430 con 0x7f12580cd530 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 -- 172.21.15.81:0/626534763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 msgr2=0x7f1258071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 --2- 172.21.15.81:0/626534763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258071360 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1250009d90 tx=0x7f125000b330 comp rx=0 tx=0).stop 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 -- 172.21.15.81:0/626534763 shutdown_connections 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 --2- 172.21.15.81:0/626534763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258071360 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 --2- 172.21.15.81:0/626534763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 -- 172.21.15.81:0/626534763 >> 172.21.15.81:0/626534763 conn(0x7f125806d4b0 msgr2=0x7f125806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:32.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 -- 172.21.15.81:0/626534763 shutdown_connections 2024-09-13T18:48:32.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 -- 172.21.15.81:0/626534763 wait complete. 2024-09-13T18:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 Processor -- start 2024-09-13T18:48:32.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.937+0000 7f125d000700 1 -- start start 2024-09-13T18:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:32.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f125815ad60 0x7f12580c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:32.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580c67c0 con 0x7f12580cd530 2024-09-13T18:48:32.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12580ace50 con 0x7f125815ad60 2024-09-13T18:48:32.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12580ac090 con 0x7f125815a980 2024-09-13T18:48:32.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:32.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36230/0 (socket says 172.21.15.81:36230) 2024-09-13T18:48:32.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 -- 172.21.15.81:0/4143294512 learned_addr learned my addr 172.21.15.81:0/4143294512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:32.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1256a00700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:32.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257e00700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f125815ad60 0x7f12580c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 -- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 msgr2=0x7f12580c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 -- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f125815ad60 msgr2=0x7f12580c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f125815ad60 0x7f12580c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 -- 172.21.15.81:0/4143294512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1250009a70 con 0x7f12580cd530 2024-09-13T18:48:32.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257e00700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f125815ad60 0x7f12580c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:32.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f1257400700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258150390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f124800e790 tx=0x7f124800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248013610 con 0x7f12580cd530 2024-09-13T18:48:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1248013770 con 0x7f12580cd530 2024-09-13T18:48:32.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1248013ae0 con 0x7f12580cd530 2024-09-13T18:48:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12580ac370 con 0x7f12580cd530 2024-09-13T18:48:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.941+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12580ac930 con 0x7f12580cd530 2024-09-13T18:48:32.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.945+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1258071360 con 0x7f12580cd530 2024-09-13T18:48:32.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.945+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1248013c40 con 0x7f12580cd530 2024-09-13T18:48:32.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.945+0000 7f124f400700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1238066730 0x7f1238068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.945+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f1248083d80 con 0x7f12580cd530 2024-09-13T18:48:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.945+0000 7f1256a00700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1238066730 0x7f1238068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:32.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.949+0000 7f1256a00700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1238066730 0x7f1238068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1258159e40 tx=0x7f1244009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:32.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:32.953+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1248051130 con 0x7f12580cd530 2024-09-13T18:48:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.137+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f12580b06e0 con 0x7f12580cd530 2024-09-13T18:48:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.733+0000 7f124f400700 1 -- 172.21.15.81:0/4143294512 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f12480210d0 con 0x7f12580cd530 2024-09-13T18:48:33.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1238066730 msgr2=0x7f1238068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:33.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1238066730 0x7f1238068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1258159e40 tx=0x7f1244009040 comp rx=0 tx=0).stop 2024-09-13T18:48:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 msgr2=0x7f1258150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258150390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f124800e790 tx=0x7f124800eaa0 comp rx=0 tx=0).stop 2024-09-13T18:48:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 shutdown_connections 2024-09-13T18:48:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1238066730 0x7f1238068bf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f125815ad60 0x7f12580c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f125815a980 0x7f12580c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:33.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 --2- 172.21.15.81:0/4143294512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12580cd530 0x7f1258150390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:33.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 >> 172.21.15.81:0/4143294512 conn(0x7f125806d4b0 msgr2=0x7f12580ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:33.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 shutdown_connections 2024-09-13T18:48:33.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:33.741+0000 7f125d000700 1 -- 172.21.15.81:0/4143294512 wait complete. 2024-09-13T18:48:33.753 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data_ec' removed 2024-09-13T18:48:33.773 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:48:33.773 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:48:33.773 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:48:33.774 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:33.774 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:48:33.774 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:48:33.775 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:48:33.775 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:33.775 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:48:33.776 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:48:33.776 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:48:33.776 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:33.776 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:48:33.777 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:48:33.777 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:48:33.777 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:33.797 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:48:33.797 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:48:33.798 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:48:33.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:48:33.800 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:48:33.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:48:33.803 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:48:33.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:48:33.850 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:48:33.851 DEBUG:teuthology.parallel:result is None 2024-09-13T18:48:33.852 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:48:33.852 DEBUG:teuthology.parallel:result is None 2024-09-13T18:48:33.855 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:48:33.855 DEBUG:teuthology.parallel:result is None 2024-09-13T18:48:33.857 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:48:33.857 DEBUG:teuthology.parallel:result is None 2024-09-13T18:48:33.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:48:33.962 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:48:33.964 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:48:33.970 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:48:33.974 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:48:34.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.013+0000 7f0827200700 1 Processor -- start 2024-09-13T18:48:34.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.013+0000 7f0827200700 1 -- start start 2024-09-13T18:48:34.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0827200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f082806aaa0 0x7f082815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0827200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f082815e9f0 0x7f082815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0827200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082815e560 con 0x7f08280b3980 2024-09-13T18:48:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0827200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08280adf90 con 0x7f082806aaa0 2024-09-13T18:48:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0827200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f082815d920 con 0x7f082815e9f0 2024-09-13T18:48:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08280b3980 0x7f082806ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60206/0 (socket says 172.21.15.81:60206) 2024-09-13T18:48:34.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 -- 172.21.15.81:0/1265535399 learned_addr learned my addr 172.21.15.81:0/1265535399 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825e00700 1 --2- 172.21.15.81:0/1265535399 >> v2:172.21.15.81:3300/0 conn(0x7f082806aaa0 0x7f082815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0826800700 1 --2- 172.21.15.81:0/1265535399 >> v2:172.21.15.178:3300/0 conn(0x7f082815e9f0 0x7f082815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326536688 0 0) 0x7f082815e560 con 0x7f08280b3980 2024-09-13T18:48:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f080c0035d0 con 0x7f08280b3980 2024-09-13T18:48:34.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84711874 0 0) 0x7f080c0035d0 con 0x7f08280b3980 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 >> v2:172.21.15.178:3300/0 conn(0x7f082815e9f0 msgr2=0x7f082815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 --2- 172.21.15.81:0/1265535399 >> v2:172.21.15.178:3300/0 conn(0x7f082815e9f0 0x7f082815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 >> v2:172.21.15.81:3300/0 conn(0x7f082806aaa0 msgr2=0x7f082815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 --2- 172.21.15.81:0/1265535399 >> v2:172.21.15.81:3300/0 conn(0x7f082806aaa0 0x7f082815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082815dc00 con 0x7f08280b3980 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f0810001670 con 0x7f08280b3980 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 >> v1:172.21.15.81:6789/0 conn(0x7f08280b3980 legacy=0x7f082806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080c003a90 0x7f080c003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f080c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c005230 0x7f080c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08280adf90 con 0x7f080c005230 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082815d920 con 0x7f080c003a90 2024-09-13T18:48:34.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c00c050 con 0x7f080c004870 2024-09-13T18:48:34.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0826800700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c005230 0x7f080c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f080c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825e00700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080c003a90 0x7f080c003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 -- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080c003a90 msgr2=0x7f080c003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080c003a90 0x7f080c003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 -- 172.21.15.81:0/1265535399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c005230 msgr2=0x7f080c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c005230 0x7f080c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f081d400700 1 -- 172.21.15.81:0/1265535399 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0035d0 con 0x7f080c004870 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0826800700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f080c005230 0x7f080c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0825e00700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f080c003a90 0x7f080c003eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.017+0000 7f0826800700 1 -- 172.21.15.81:0/1265535399 reap_dead start 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f081d400700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f080c004cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f081000c320 tx=0x7f080c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c323009951a942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000cde0 con 0x7f080c004870 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810005980 con 0x7f080c004870 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0825400700 1 -- 172.21.15.81:0/1265535399 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810005d30 con 0x7f080c004870 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 -- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 msgr2=0x7f080c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f080c004cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f081000c320 tx=0x7f080c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 -- 172.21.15.81:0/1265535399 shutdown_connections 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 --2- 172.21.15.81:0/1265535399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f080c004cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 -- 172.21.15.81:0/1265535399 >> 172.21.15.81:0/1265535399 conn(0x7f08280b0c40 msgr2=0x7f082806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 -- 172.21.15.81:0/1265535399 shutdown_connections 2024-09-13T18:48:34.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 -- 172.21.15.81:0/1265535399 wait complete. 2024-09-13T18:48:34.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.021+0000 7f0827200700 1 Processor -- start 2024-09-13T18:48:34.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 -- start start 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f0828146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 0x7f0828144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f082813e150 0x7f08281e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082813e9f0 con 0x7f0828131200 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08281451e0 con 0x7f082813e150 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0828145a70 con 0x7f080c004870 2024-09-13T18:48:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 0x7f0828144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 0x7f0828144ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36300/0 (socket says 172.21.15.81:36300) 2024-09-13T18:48:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 -- 172.21.15.81:0/1286249052 learned_addr learned my addr 172.21.15.81:0/1286249052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0825e00700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f0828146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 -- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 msgr2=0x7f0828146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0826800700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f082813e150 0x7f08281e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f0828146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 -- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f082813e150 msgr2=0x7f08281e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f082813e150 0x7f08281e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 -- 172.21.15.81:0/1286249052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828144250 con 0x7f0828131200 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0826800700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f082813e150 0x7f08281e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081d400700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 0x7f0828144ca0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f081000c910 tx=0x7f0810001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000ce50 con 0x7f0828131200 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0810004aa0 con 0x7f0828131200 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810004e10 con 0x7f0828131200 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0828145cc0 con 0x7f0828131200 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.025+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08281444a0 con 0x7f0828131200 2024-09-13T18:48:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.029+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082815ce90 con 0x7f0828131200 2024-09-13T18:48:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.029+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08100070d0 con 0x7f0828131200 2024-09-13T18:48:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.029+0000 7f081ea00700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0804066730 0x7f0804068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:34.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.029+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f08100852b0 con 0x7f0828131200 2024-09-13T18:48:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.029+0000 7f0825e00700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0804066730 0x7f0804068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:34.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.033+0000 7f0825e00700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0804066730 0x7f0804068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08280691d0 tx=0x7f081800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.037+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f08100528f0 con 0x7f0828131200 2024-09-13T18:48:34.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:34.229+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f08280703a0 con 0x7f0828131200 2024-09-13T18:48:35.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.005+0000 7f081ea00700 1 -- 172.21.15.81:0/1286249052 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0810007dc0 con 0x7f0828131200 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0804066730 msgr2=0x7f0804068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0804066730 0x7f0804068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f08280691d0 tx=0x7f081800b040 comp rx=0 tx=0).stop 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 msgr2=0x7f0828144ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 0x7f0828144ca0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f081000c910 tx=0x7f0810001a00 comp rx=0 tx=0).stop 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 shutdown_connections 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0804066730 0x7f0804068bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f082813e150 0x7f08281e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0828131200 0x7f0828144ca0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 --2- 172.21.15.81:0/1286249052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f080c004870 0x7f0828146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 >> 172.21.15.81:0/1286249052 conn(0x7f08280b0c40 msgr2=0x7f08280b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:35.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 shutdown_connections 2024-09-13T18:48:35.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.009+0000 7f0827200700 1 -- 172.21.15.81:0/1286249052 wait complete. 2024-09-13T18:48:35.020 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-13T18:48:35.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:48:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.201+0000 7ff142c00700 1 Processor -- start 2024-09-13T18:48:35.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.201+0000 7ff142c00700 1 -- start start 2024-09-13T18:48:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff142c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c15b700 0x7ff13c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff142c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 0x7ff13c06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff142c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff13c06a5d0 0x7ff13c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff142c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c06afa0 con 0x7ff13c06a5d0 2024-09-13T18:48:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff142c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0cdd90 con 0x7ff13c06c460 2024-09-13T18:48:35.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff142c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c06ce10 con 0x7ff13c15b700 2024-09-13T18:48:35.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff13c06a5d0 0x7ff13c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 0x7ff13c06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c15b700 0x7ff13c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff13c06a5d0 0x7ff13c06aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36302/0 (socket says 172.21.15.81:36302) 2024-09-13T18:48:35.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 0x7ff13c06d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:42704/0 (socket says 172.21.15.81:42704) 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 -- 172.21.15.81:0/2576605060 learned_addr learned my addr 172.21.15.81:0/2576605060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 -- 172.21.15.81:0/2576605060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c15b700 msgr2=0x7ff13c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 --2- 172.21.15.81:0/2576605060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c15b700 0x7ff13c15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 -- 172.21.15.81:0/2576605060 >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 msgr2=0x7ff13c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 --2- 172.21.15.81:0/2576605060 >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 0x7ff13c06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 -- 172.21.15.81:0/2576605060 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c15c020 con 0x7ff13c06a5d0 2024-09-13T18:48:35.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13b400700 1 --2- 172.21.15.81:0/2576605060 >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 0x7ff13c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff140c00700 1 --2- 172.21.15.81:0/2576605060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c06a5d0 0x7ff13c06aa60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0cc590 tx=0x7ff134009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e2ad72b04b6b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13aa00700 1 -- 172.21.15.81:0/2576605060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011830 con 0x7ff13c06a5d0 2024-09-13T18:48:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13aa00700 1 -- 172.21.15.81:0/2576605060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134011990 con 0x7ff13c06a5d0 2024-09-13T18:48:35.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.205+0000 7ff13aa00700 1 -- 172.21.15.81:0/2576605060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134011d20 con 0x7ff13c06a5d0 2024-09-13T18:48:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 -- 172.21.15.81:0/2576605060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c06a5d0 msgr2=0x7ff13c06aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 --2- 172.21.15.81:0/2576605060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c06a5d0 0x7ff13c06aa60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0cc590 tx=0x7ff134009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 -- 172.21.15.81:0/2576605060 shutdown_connections 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 --2- 172.21.15.81:0/2576605060 >> v2:172.21.15.178:3300/0 conn(0x7ff13c06c460 0x7ff13c06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 --2- 172.21.15.81:0/2576605060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c06a5d0 0x7ff13c06aa60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 --2- 172.21.15.81:0/2576605060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c15b700 0x7ff13c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 -- 172.21.15.81:0/2576605060 >> 172.21.15.81:0/2576605060 conn(0x7ff13c0b08d0 msgr2=0x7ff13c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 -- 172.21.15.81:0/2576605060 shutdown_connections 2024-09-13T18:48:35.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 -- 172.21.15.81:0/2576605060 wait complete. 2024-09-13T18:48:35.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 Processor -- start 2024-09-13T18:48:35.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.209+0000 7ff142c00700 1 -- start start 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff13c06a5d0 0x7ff13c148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c06c460 0x7ff13c06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 0x7ff13c0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c14ed50 con 0x7ff13c15b700 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0713d0 con 0x7ff13c06a5d0 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0707c0 con 0x7ff13c06c460 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 0x7ff13c0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 0x7ff13c0aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36304/0 (socket says 172.21.15.81:36304) 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 -- 172.21.15.81:0/2665919850 learned_addr learned my addr 172.21.15.81:0/2665919850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff13b400700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c06c460 0x7ff13c06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff13be00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff13c06a5d0 0x7ff13c148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 -- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c06c460 msgr2=0x7ff13c06fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c06c460 0x7ff13c06fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 -- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff13c06a5d0 msgr2=0x7ff13c148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff13c06a5d0 0x7ff13c148690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 -- 172.21.15.81:0/2665919850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280094b0 con 0x7ff13c15b700 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff140c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 0x7ff13c0aeac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0721e0 tx=0x7ff134004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134004300 con 0x7ff13c15b700 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13401f070 con 0x7ff13c15b700 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340036c0 con 0x7ff13c15b700 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff134009570 con 0x7ff13c15b700 2024-09-13T18:48:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.213+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c070d80 con 0x7ff13c15b700 2024-09-13T18:48:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.217+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c1f2800 con 0x7ff13c15b700 2024-09-13T18:48:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.217+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff134021030 con 0x7ff13c15b700 2024-09-13T18:48:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.217+0000 7ff133e00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff11c066730 0x7ff11c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.217+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff134085160 con 0x7ff13c15b700 2024-09-13T18:48:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.221+0000 7ff13be00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff11c066730 0x7ff11c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.221+0000 7ff13be00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff11c066730 0x7ff11c068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0073f0 tx=0x7ff12c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:35.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.225+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff13c1f2800 con 0x7ff13c15b700 2024-09-13T18:48:35.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.477+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff13c1f2800 con 0x7ff13c15b700 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.477+0000 7ff133e00700 1 -- 172.21.15.81:0/2665919850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff13c1f2800 con 0x7ff13c15b700 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-13T18:48:35.485 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw==", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw==", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.486 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q==", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g==", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g==", 2024-09-13T18:48:35.488 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw==", 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA==", 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg==", 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.490 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw==", 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.491 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw==", 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A==", 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q==", 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ==", 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.495 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:48:35.495 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:48:35.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:48:35.495 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg==", 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.496 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg==", 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng==", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB2iORm9hwhIRAASJc+x3PH9tdxfNlBIxr8ZA==", 2024-09-13T18:48:35.498 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCaiORmLqoAIxAAzGS2nc6wsZBQNC129vZsdQ==", 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCaiORmwsEAIxAAaD0wLj1zn/VJkYe16ox81w==", 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCaiORmj9MAIxAAECuy4tRa1HnFR3qHMN7Zrw==", 2024-09-13T18:48:35.500 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCaiORmiuYAIxAAvrEzyrgcGbcnApYZzCpeng==", 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCaiORmkPgAIxAA4oVm5a0C0tZR91+vFJc+JQ==", 2024-09-13T18:48:35.501 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCaiORmwwoBIxAAq0G1vAhm5kkQ2872sp7lFQ==", 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA==", 2024-09-13T18:48:35.502 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g==", 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:35.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T18:48:35.504 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff11c066730 msgr2=0x7ff11c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff11c066730 0x7ff11c068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff12c0073f0 tx=0x7ff12c00b040 comp rx=0 tx=0).stop 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 msgr2=0x7ff13c0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 0x7ff13c0aeac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0721e0 tx=0x7ff134004770 comp rx=0 tx=0).stop 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 shutdown_connections 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff11c066730 0x7ff11c068bf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff13c15b700 0x7ff13c0aeac0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff13c06c460 0x7ff13c06fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 --2- 172.21.15.81:0/2665919850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff13c06a5d0 0x7ff13c148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 >> 172.21.15.81:0/2665919850 conn(0x7ff13c0b08d0 msgr2=0x7ff13c15d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 shutdown_connections 2024-09-13T18:48:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.485+0000 7ff142c00700 1 -- 172.21.15.81:0/2665919850 wait complete. 2024-09-13T18:48:35.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T18:48:35.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.693+0000 7f2dbf400700 1 Processor -- start 2024-09-13T18:48:35.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.693+0000 7f2dbf400700 1 -- start start 2024-09-13T18:48:35.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2dbf400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db80b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2dbf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2db815d480 0x7f2db815d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2dbf400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db815e960 con 0x7f2db815de20 2024-09-13T18:48:35.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2dbf400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80ca4f0 con 0x7f2db815d480 2024-09-13T18:48:35.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2dbf400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80ca7d0 con 0x7f2db815d0a0 2024-09-13T18:48:35.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2db815d480 0x7f2db815d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2dbca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db80b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2db815d480 0x7f2db815d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36312/0 (socket says 172.21.15.81:36312) 2024-09-13T18:48:35.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 -- 172.21.15.81:0/3837505056 learned_addr learned my addr 172.21.15.81:0/3837505056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:35.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 -- 172.21.15.81:0/3837505056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 msgr2=0x7f2db80b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:35.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 --2- 172.21.15.81:0/3837505056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db80b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 -- 172.21.15.81:0/3837505056 >> v1:172.21.15.178:6789/0 conn(0x7f2db815de20 legacy=0x7f2db815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 -- 172.21.15.81:0/3837505056 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db80caab0 con 0x7f2db815d480 2024-09-13T18:48:35.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7e00700 1 --2- 172.21.15.81:0/3837505056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db815d8e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009910 tx=0x7f2da4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d7a7a0a11f55fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:35.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7400700 1 -- 172.21.15.81:0/3837505056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4011830 con 0x7f2db815d480 2024-09-13T18:48:35.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7400700 1 -- 172.21.15.81:0/3837505056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4011990 con 0x7f2db815d480 2024-09-13T18:48:35.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.697+0000 7f2db7400700 1 -- 172.21.15.81:0/3837505056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4011d40 con 0x7f2db815d480 2024-09-13T18:48:35.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 -- 172.21.15.81:0/3837505056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 msgr2=0x7f2db815d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 --2- 172.21.15.81:0/3837505056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db815d8e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2da4009910 tx=0x7f2da4009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 -- 172.21.15.81:0/3837505056 shutdown_connections 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 --2- 172.21.15.81:0/3837505056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db815d8e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 --2- 172.21.15.81:0/3837505056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db80b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 -- 172.21.15.81:0/3837505056 >> 172.21.15.81:0/3837505056 conn(0x7f2db8071960 msgr2=0x7f2db8071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 -- 172.21.15.81:0/3837505056 shutdown_connections 2024-09-13T18:48:35.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 -- 172.21.15.81:0/3837505056 wait complete. 2024-09-13T18:48:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 Processor -- start 2024-09-13T18:48:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.701+0000 7f2dbf400700 1 -- start start 2024-09-13T18:48:35.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db809b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db809ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db815de20 0x7f2db8156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8156fb0 con 0x7f2db815d480 2024-09-13T18:48:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db809bc50 con 0x7f2db815de20 2024-09-13T18:48:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db809a670 con 0x7f2db815d0a0 2024-09-13T18:48:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db809ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db809ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36324/0 (socket says 172.21.15.81:36324) 2024-09-13T18:48:35.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 -- 172.21.15.81:0/374228817 learned_addr learned my addr 172.21.15.81:0/374228817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbca00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db809b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbd400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db815de20 0x7f2db8156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 -- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 msgr2=0x7f2db809b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db809b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 -- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db815de20 msgr2=0x7f2db8156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db815de20 0x7f2db8156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 -- 172.21.15.81:0/374228817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4009570 con 0x7f2db815d480 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbca00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db809b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db7e00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db809ca60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2da4000c00 tx=0x7f2da4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004610 con 0x7f2db815d480 2024-09-13T18:48:35.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da40036c0 con 0x7f2db815d480 2024-09-13T18:48:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db809a950 con 0x7f2db815d480 2024-09-13T18:48:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4003a50 con 0x7f2db815d480 2024-09-13T18:48:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.705+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db809af10 con 0x7f2db815d480 2024-09-13T18:48:35.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.709+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db80b3e10 con 0x7f2db815d480 2024-09-13T18:48:35.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.709+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2da4003bb0 con 0x7f2db815d480 2024-09-13T18:48:35.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.709+0000 7f2db4c00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d98066730 0x7f2d98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:35.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.709+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2da4021030 con 0x7f2db815d480 2024-09-13T18:48:35.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.713+0000 7f2dbca00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d98066730 0x7f2d98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:35.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.713+0000 7f2dbca00700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d98066730 0x7f2d98068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c40 tx=0x7f2dac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.717+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2da4052c60 con 0x7f2db815d480 2024-09-13T18:48:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.957+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2db80b19d0 con 0x7f2db815d480 2024-09-13T18:48:35.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.965+0000 7f2db4c00700 1 -- 172.21.15.81:0/374228817 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2da40150a0 con 0x7f2db815d480 2024-09-13T18:48:35.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d98066730 msgr2=0x7f2d98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d98066730 0x7f2d98068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c40 tx=0x7f2dac008040 comp rx=0 tx=0).stop 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 msgr2=0x7f2db809ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db809ca60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2da4000c00 tx=0x7f2da4004770 comp rx=0 tx=0).stop 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 shutdown_connections 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d98066730 0x7f2d98068bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2db815de20 0x7f2db8156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2db815d480 0x7f2db809ca60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 --2- 172.21.15.81:0/374228817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2db815d0a0 0x7f2db809b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 >> 172.21.15.81:0/374228817 conn(0x7f2db8071960 msgr2=0x7f2db80b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 shutdown_connections 2024-09-13T18:48:35.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:35.969+0000 7f2dbf400700 1 -- 172.21.15.81:0/374228817 wait complete. 2024-09-13T18:48:35.998 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T18:48:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 Processor -- start 2024-09-13T18:48:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 -- start start 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efdb00cc6f0 0x7efdb015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efdb006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb00ccb40 con 0x7efdb00cb020 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb006b430 con 0x7efdb00cc6f0 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdb4c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00b2ad0 con 0x7efdb006aaa0 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdaf400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efdb00cb020 0x7efdb015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60212/0 (socket says 172.21.15.81:60212) 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdaf400700 1 -- 172.21.15.81:0/1579516704 learned_addr learned my addr 172.21.15.81:0/1579516704 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdafe00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efdb006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdaea00700 1 --2- 172.21.15.81:0/1579516704 >> v2:172.21.15.178:3300/0 conn(0x7efdb00cc6f0 0x7efdb015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423151786 0 0) 0x7efdb00ccb40 con 0x7efdb00cb020 2024-09-13T18:48:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd940035d0 con 0x7efdb00cb020 2024-09-13T18:48:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140185355 0 0) 0x7efd940035d0 con 0x7efdb00cb020 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 msgr2=0x7efdb006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efdb006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 >> v2:172.21.15.178:3300/0 conn(0x7efdb00cc6f0 msgr2=0x7efdb015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 --2- 172.21.15.81:0/1579516704 >> v2:172.21.15.178:3300/0 conn(0x7efdb00cc6f0 0x7efdb015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb015b960 con 0x7efdb00cb020 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7efda0001670 con 0x7efdb00cb020 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.165+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 >> v1:172.21.15.81:6789/0 conn(0x7efdb00cb020 legacy=0x7efdb015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efd94003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94004010 0x7efd94004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004db0 0x7efd94005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb006b430 con 0x7efd94004010 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00b2ad0 con 0x7efd94004db0 2024-09-13T18:48:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd9400ba60 con 0x7efdb006aaa0 2024-09-13T18:48:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94004010 0x7efd94004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdafe00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004db0 0x7efd94005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaf400700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efd94003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 -- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 msgr2=0x7efd94003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efd94003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 -- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004db0 msgr2=0x7efd94005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004db0 0x7efd94005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 -- 172.21.15.81:0/1579516704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940035d0 con 0x7efd94004010 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaf400700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb006aaa0 0x7efd94003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdaea00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94004010 0x7efd94004870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009b70 tx=0x7efd940058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39627d86fcb51c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e6c0 con 0x7efd94004010 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00e820 con 0x7efd94004010 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdae000700 1 -- 172.21.15.81:0/1579516704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00eb90 con 0x7efd94004010 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdb4c00700 1 -- 172.21.15.81:0/1579516704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94004010 msgr2=0x7efd94004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdb4c00700 1 --2- 172.21.15.81:0/1579516704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd94004010 0x7efd94004870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efd9c009b70 tx=0x7efd940058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdafe00700 1 -- 172.21.15.81:0/1579516704 reap_dead start 2024-09-13T18:48:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdb4c00700 1 -- 172.21.15.81:0/1579516704 shutdown_connections 2024-09-13T18:48:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdb4c00700 1 -- 172.21.15.81:0/1579516704 >> 172.21.15.81:0/1579516704 conn(0x7efdb00b0c40 msgr2=0x7efdb006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdb4c00700 1 -- 172.21.15.81:0/1579516704 shutdown_connections 2024-09-13T18:48:36.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.169+0000 7efdb4c00700 1 -- 172.21.15.81:0/1579516704 wait complete. 2024-09-13T18:48:36.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.173+0000 7efdb4c00700 1 Processor -- start 2024-09-13T18:48:36.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.173+0000 7efdb4c00700 1 -- start start 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004010 0x7efdb01472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 0x7efdb00c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb0156820 0x7efdb0156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01e3d00 con 0x7efdb00c8ce0 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00c96a0 con 0x7efd94004010 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb01571e0 con 0x7efdb0156820 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 0x7efdb00c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 0x7efdb00c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36342/0 (socket says 172.21.15.81:36342) 2024-09-13T18:48:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 -- 172.21.15.81:0/3135073633 learned_addr learned my addr 172.21.15.81:0/3135073633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdafe00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb0156820 0x7efdb0156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaf400700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004010 0x7efdb01472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 -- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb0156820 msgr2=0x7efdb0156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb0156820 0x7efdb0156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 -- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004010 msgr2=0x7efdb01472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004010 0x7efdb01472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 -- 172.21.15.81:0/3135073633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0157ff0 con 0x7efdb00c8ce0 2024-09-13T18:48:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdafe00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb0156820 0x7efdb0156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdaea00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 0x7efdb00c9160 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efd94004780 tx=0x7efd9c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00e6c0 con 0x7efdb00c8ce0 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c004030 con 0x7efdb00c8ce0 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb0157470 con 0x7efdb00c8ce0 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c0043e0 con 0x7efdb00c8ce0 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.177+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0157a30 con 0x7efdb00c8ce0 2024-09-13T18:48:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.181+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb00673f0 con 0x7efdb00c8ce0 2024-09-13T18:48:36.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.181+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efd9c0036c0 con 0x7efdb00c8ce0 2024-09-13T18:48:36.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.181+0000 7efda7400700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd90066760 0x7efd90068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.181+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7efd9c085970 con 0x7efdb00c8ce0 2024-09-13T18:48:36.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.181+0000 7efdaf400700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd90066760 0x7efd90068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.185+0000 7efdaf400700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd90066760 0x7efd90068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efda0000ff0 tx=0x7efda0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:36.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.189+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efd9c053000 con 0x7efdb00c8ce0 2024-09-13T18:48:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.437+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7efdb00cb400 con 0x7efdb00c8ce0 2024-09-13T18:48:36.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.445+0000 7efda7400700 1 -- 172.21.15.81:0/3135073633 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7efd9c056620 con 0x7efdb00c8ce0 2024-09-13T18:48:36.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd90066760 msgr2=0x7efd90068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd90066760 0x7efd90068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efda0000ff0 tx=0x7efda0009040 comp rx=0 tx=0).stop 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 msgr2=0x7efdb00c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 0x7efdb00c9160 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efd94004780 tx=0x7efd9c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 shutdown_connections 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd90066760 0x7efd90068c20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efdb0156820 0x7efdb0156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdb00c8ce0 0x7efdb00c9160 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 --2- 172.21.15.81:0/3135073633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd94004010 0x7efdb01472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 >> 172.21.15.81:0/3135073633 conn(0x7efdb00b0c40 msgr2=0x7efdb00b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 shutdown_connections 2024-09-13T18:48:36.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.449+0000 7efdb4c00700 1 -- 172.21.15.81:0/3135073633 wait complete. 2024-09-13T18:48:36.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T18:48:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.649+0000 7f1cdfe00700 1 Processor -- start 2024-09-13T18:48:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.649+0000 7f1cdfe00700 1 -- start start 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.649+0000 7f1cdfe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ce00cb700 0x7f1ce006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.649+0000 7f1cdfe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce00707d0 con 0x7f1ce006afe0 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.649+0000 7f1cdfe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce006fee0 con 0x7f1ce0159bd0 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdfe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce006b470 con 0x7f1ce00cb700 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdf400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1ce006afe0 0x7f1ce01636b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46492/0 (socket says 172.21.15.81:46492) 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdf400700 1 -- 172.21.15.81:0/444115887 learned_addr learned my addr 172.21.15.81:0/444115887 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:36.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cde000700 1 --2- 172.21.15.81:0/444115887 >> v2:172.21.15.178:3300/0 conn(0x7f1ce00cb700 0x7f1ce006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8726015 0 0) 0x7f1ce00707d0 con 0x7f1ce006afe0 2024-09-13T18:48:36.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cc40035d0 con 0x7f1ce006afe0 2024-09-13T18:48:36.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613984381 0 0) 0x7f1ce006fee0 con 0x7f1ce0159bd0 2024-09-13T18:48:36.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce00707d0 con 0x7f1ce0159bd0 2024-09-13T18:48:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cde000700 1 -- 172.21.15.81:0/444115887 >> v1:172.21.15.178:6789/0 conn(0x7f1ce0159bd0 legacy=0x7f1ce0071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cde000700 1 -- 172.21.15.81:0/444115887 >> v1:172.21.15.81:6789/0 conn(0x7f1ce006afe0 legacy=0x7f1ce01636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cde000700 1 -- 172.21.15.81:0/444115887 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce00b2ef0 con 0x7f1ce00cb700 2024-09-13T18:48:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cde000700 1 --2- 172.21.15.81:0/444115887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce00cb700 0x7f1ce006aaa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009850 tx=0x7f1ccc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3319816452968c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc011830 con 0x7f1ce00cb700 2024-09-13T18:48:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc011990 con 0x7f1ce00cb700 2024-09-13T18:48:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.653+0000 7f1cdd600700 1 -- 172.21.15.81:0/444115887 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc011d40 con 0x7f1ce00cb700 2024-09-13T18:48:36.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 -- 172.21.15.81:0/444115887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce00cb700 msgr2=0x7f1ce006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/444115887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce00cb700 0x7f1ce006aaa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc009850 tx=0x7f1ccc009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 -- 172.21.15.81:0/444115887 shutdown_connections 2024-09-13T18:48:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/444115887 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce00cb700 0x7f1ce006aaa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 -- 172.21.15.81:0/444115887 >> 172.21.15.81:0/444115887 conn(0x7f1ce00b0c40 msgr2=0x7f1ce006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 -- 172.21.15.81:0/444115887 shutdown_connections 2024-09-13T18:48:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 -- 172.21.15.81:0/444115887 wait complete. 2024-09-13T18:48:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 Processor -- start 2024-09-13T18:48:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.657+0000 7f1cdfe00700 1 -- start start 2024-09-13T18:48:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce006afe0 0x7f1ce015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 0x7f1ce0140f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce0159bd0 0x7f1ce00afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce014d9e0 con 0x7f1ce00cb700 2024-09-13T18:48:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce014dbc0 con 0x7f1ce006afe0 2024-09-13T18:48:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce014dea0 con 0x7f1ce0159bd0 2024-09-13T18:48:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 0x7f1ce0140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 0x7f1ce0140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60498/0 (socket says 172.21.15.81:60498) 2024-09-13T18:48:36.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 -- 172.21.15.81:0/2957852338 learned_addr learned my addr 172.21.15.81:0/2957852338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdea00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce006afe0 0x7f1ce015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdf400700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce0159bd0 0x7f1ce00afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 -- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce0159bd0 msgr2=0x7f1ce00afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce0159bd0 0x7f1ce00afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 -- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce006afe0 msgr2=0x7f1ce015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce006afe0 0x7f1ce015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 -- 172.21.15.81:0/2957852338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ccc0094b0 con 0x7f1ce00cb700 2024-09-13T18:48:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cde000700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 0x7f1ce0140f40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ce006e050 tx=0x7f1ccc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc01aa10 con 0x7f1ce00cb700 2024-09-13T18:48:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc01f070 con 0x7f1ce00cb700 2024-09-13T18:48:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc01adb0 con 0x7f1ce00cb700 2024-09-13T18:48:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce014e180 con 0x7f1ce00cb700 2024-09-13T18:48:36.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.661+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce014e740 con 0x7f1ce00cb700 2024-09-13T18:48:36.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.665+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce014e960 con 0x7f1ce00cb700 2024-09-13T18:48:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.665+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1ccc01b430 con 0x7f1ce00cb700 2024-09-13T18:48:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.669+0000 7f1cd7400700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc0066730 0x7f1cc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.669+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1ccc084ef0 con 0x7f1ce00cb700 2024-09-13T18:48:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.669+0000 7f1cdea00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc0066730 0x7f1cc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.669+0000 7f1cdea00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc0066730 0x7f1cc0068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00011e0 tx=0x7f1cd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.677+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ccc052500 con 0x7f1ce00cb700 2024-09-13T18:48:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.917+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1ce006aaa0 con 0x7f1ce00cb700 2024-09-13T18:48:36.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.925+0000 7f1cd7400700 1 -- 172.21.15.81:0/2957852338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1ccc0150a0 con 0x7f1ce00cb700 2024-09-13T18:48:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc0066730 msgr2=0x7f1cc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc0066730 0x7f1cc0068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00011e0 tx=0x7f1cd0009040 comp rx=0 tx=0).stop 2024-09-13T18:48:36.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 msgr2=0x7f1ce0140f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 0x7f1ce0140f40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ce006e050 tx=0x7f1ccc004770 comp rx=0 tx=0).stop 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 shutdown_connections 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc0066730 0x7f1cc0068bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce0159bd0 0x7f1ce00afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce00cb700 0x7f1ce0140f40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 --2- 172.21.15.81:0/2957852338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce006afe0 0x7f1ce015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 >> 172.21.15.81:0/2957852338 conn(0x7f1ce00b0c40 msgr2=0x7f1ce0157970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 shutdown_connections 2024-09-13T18:48:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:36.929+0000 7f1cdfe00700 1 -- 172.21.15.81:0/2957852338 wait complete. 2024-09-13T18:48:36.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T18:48:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.121+0000 7ff35be00700 1 Processor -- start 2024-09-13T18:48:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.121+0000 7ff35be00700 1 -- start start 2024-09-13T18:48:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff35c0cb020 0x7ff35c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0b2ad0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c15b960 con 0x7ff35c06aaa0 2024-09-13T18:48:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35be00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c15bc40 con 0x7ff35c0cb020 2024-09-13T18:48:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35a000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff35c15c2a0 0x7ff35c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46496/0 (socket says 172.21.15.81:46496) 2024-09-13T18:48:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35a000700 1 -- 172.21.15.81:0/2234917072 learned_addr learned my addr 172.21.15.81:0/2234917072 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:37.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35aa00700 1 --2- 172.21.15.81:0/2234917072 >> v2:172.21.15.81:3300/0 conn(0x7ff35c0cb020 0x7ff35c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff359600700 1 -- 172.21.15.81:0/2234917072 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514974227 0 0) 0x7ff35c0b2ad0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff359600700 1 -- 172.21.15.81:0/2234917072 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3400035d0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35aa00700 1 -- 172.21.15.81:0/2234917072 >> v1:172.21.15.178:6789/0 conn(0x7ff35c06aaa0 legacy=0x7ff35c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35aa00700 1 -- 172.21.15.81:0/2234917072 >> v1:172.21.15.81:6789/0 conn(0x7ff35c15c2a0 legacy=0x7ff35c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.125+0000 7ff35aa00700 1 -- 172.21.15.81:0/2234917072 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c15bf20 con 0x7ff35c0cb020 2024-09-13T18:48:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35aa00700 1 --2- 172.21.15.81:0/2234917072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c0cb020 0x7ff35c0cc6f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009850 tx=0x7ff34c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e81b3a5b078901 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff359600700 1 -- 172.21.15.81:0/2234917072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011830 con 0x7ff35c0cb020 2024-09-13T18:48:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff359600700 1 -- 172.21.15.81:0/2234917072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c011990 con 0x7ff35c0cb020 2024-09-13T18:48:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff359600700 1 -- 172.21.15.81:0/2234917072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011d00 con 0x7ff35c0cb020 2024-09-13T18:48:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 -- 172.21.15.81:0/2234917072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c0cb020 msgr2=0x7ff35c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 --2- 172.21.15.81:0/2234917072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c0cb020 0x7ff35c0cc6f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009850 tx=0x7ff34c009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 -- 172.21.15.81:0/2234917072 shutdown_connections 2024-09-13T18:48:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 --2- 172.21.15.81:0/2234917072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c0cb020 0x7ff35c0cc6f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 -- 172.21.15.81:0/2234917072 >> 172.21.15.81:0/2234917072 conn(0x7ff35c0b0c40 msgr2=0x7ff35c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 -- 172.21.15.81:0/2234917072 shutdown_connections 2024-09-13T18:48:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.129+0000 7ff35be00700 1 -- 172.21.15.81:0/2234917072 wait complete. 2024-09-13T18:48:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 Processor -- start 2024-09-13T18:48:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 -- start start 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c06aaa0 0x7ff35c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0cb020 0x7ff35c1f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 0x7ff35c1f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0b0410 con 0x7ff35c15c2a0 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1f2ea0 con 0x7ff35c0cb020 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1f3180 con 0x7ff35c06aaa0 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 0x7ff35c1f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 0x7ff35c1f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60510/0 (socket says 172.21.15.81:60510) 2024-09-13T18:48:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35b400700 1 -- 172.21.15.81:0/430519810 learned_addr learned my addr 172.21.15.81:0/430519810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35aa00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c06aaa0 0x7ff35c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.133+0000 7ff35a000700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0cb020 0x7ff35c1f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35b400700 1 -- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c06aaa0 msgr2=0x7ff35c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35b400700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c06aaa0 0x7ff35c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35b400700 1 -- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0cb020 msgr2=0x7ff35c1f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35b400700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0cb020 0x7ff35c1f36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35b400700 1 -- 172.21.15.81:0/430519810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0094b0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35b400700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 0x7ff35c1f2530 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff35400cc50 tx=0x7ff35400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400ad80 con 0x7ff35c15c2a0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35400ce50 con 0x7ff35c15c2a0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354003c60 con 0x7ff35c15c2a0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c1f3460 con 0x7ff35c15c2a0 2024-09-13T18:48:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c155b20 con 0x7ff35c15c2a0 2024-09-13T18:48:37.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.137+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c0b3ce0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.141+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3540050d0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.141+0000 7ff352a00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff33c066730 0x7ff33c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.141+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff354084100 con 0x7ff35c15c2a0 2024-09-13T18:48:37.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.141+0000 7ff35aa00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff33c066730 0x7ff33c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.141+0000 7ff35aa00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff33c066730 0x7ff33c068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009ba0 tx=0x7ff34c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:37.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.149+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3540515e0 con 0x7ff35c15c2a0 2024-09-13T18:48:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.393+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff35c068480 con 0x7ff35c15c2a0 2024-09-13T18:48:37.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.401+0000 7ff352a00700 1 -- 172.21.15.81:0/430519810 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff354054c00 con 0x7ff35c15c2a0 2024-09-13T18:48:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff33c066730 msgr2=0x7ff33c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff33c066730 0x7ff33c068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009ba0 tx=0x7ff34c008030 comp rx=0 tx=0).stop 2024-09-13T18:48:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 msgr2=0x7ff35c1f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 0x7ff35c1f2530 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff35400cc50 tx=0x7ff35400a340 comp rx=0 tx=0).stop 2024-09-13T18:48:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 shutdown_connections 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff33c066730 0x7ff33c068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c15c2a0 0x7ff35c1f2530 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff35c0cb020 0x7ff35c1f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 --2- 172.21.15.81:0/430519810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff35c06aaa0 0x7ff35c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 >> 172.21.15.81:0/430519810 conn(0x7ff35c0b0c40 msgr2=0x7ff35c06d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 shutdown_connections 2024-09-13T18:48:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.405+0000 7ff35be00700 1 -- 172.21.15.81:0/430519810 wait complete. 2024-09-13T18:48:37.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T18:48:37.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 Processor -- start 2024-09-13T18:48:37.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 -- start start 2024-09-13T18:48:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f81f00cf1b0 0x7f81f00cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00b3a10 0x7f81f00cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f00b2c50 con 0x7f81f015ac60 2024-09-13T18:48:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f00b2f30 con 0x7f81f00cf1b0 2024-09-13T18:48:37.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81f5000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00b3210 con 0x7f81f00b3a10 2024-09-13T18:48:37.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81ede00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f81f015ac60 0x7f81f00ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46502/0 (socket says 172.21.15.81:46502) 2024-09-13T18:48:37.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81ede00700 1 -- 172.21.15.81:0/2169299221 learned_addr learned my addr 172.21.15.81:0/2169299221 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.597+0000 7f81e5400700 1 --2- 172.21.15.81:0/2169299221 >> v2:172.21.15.81:3300/0 conn(0x7f81f00cf1b0 0x7f81f00cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81ee800700 1 --2- 172.21.15.81:0/2169299221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00b3a10 0x7f81f00cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81ed400700 1 -- 172.21.15.81:0/2169299221 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881179796 0 0) 0x7f81f00b2c50 con 0x7f81f015ac60 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81ed400700 1 -- 172.21.15.81:0/2169299221 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d40035d0 con 0x7f81f015ac60 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81e5400700 1 -- 172.21.15.81:0/2169299221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00b3a10 msgr2=0x7f81f00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81e5400700 1 --2- 172.21.15.81:0/2169299221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00b3a10 0x7f81f00cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81e5400700 1 -- 172.21.15.81:0/2169299221 >> v1:172.21.15.81:6789/0 conn(0x7f81f015ac60 legacy=0x7f81f00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81e5400700 1 -- 172.21.15.81:0/2169299221 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f00b34f0 con 0x7f81f00cf1b0 2024-09-13T18:48:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81e5400700 1 --2- 172.21.15.81:0/2169299221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00cf1b0 0x7f81f00cb830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009850 tx=0x7f81d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc3c07ba61839c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81ed400700 1 -- 172.21.15.81:0/2169299221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8011830 con 0x7f81f00cf1b0 2024-09-13T18:48:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81ed400700 1 -- 172.21.15.81:0/2169299221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8011990 con 0x7f81f00cf1b0 2024-09-13T18:48:37.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81ed400700 1 -- 172.21.15.81:0/2169299221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8011d40 con 0x7f81f00cf1b0 2024-09-13T18:48:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 -- 172.21.15.81:0/2169299221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00cf1b0 msgr2=0x7f81f00cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 --2- 172.21.15.81:0/2169299221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00cf1b0 0x7f81f00cb830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009850 tx=0x7f81d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 -- 172.21.15.81:0/2169299221 shutdown_connections 2024-09-13T18:48:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 --2- 172.21.15.81:0/2169299221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00b3a10 0x7f81f00cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 --2- 172.21.15.81:0/2169299221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00cf1b0 0x7f81f00cb830 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 -- 172.21.15.81:0/2169299221 >> 172.21.15.81:0/2169299221 conn(0x7f81f00b0a40 msgr2=0x7f81f00b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 -- 172.21.15.81:0/2169299221 shutdown_connections 2024-09-13T18:48:37.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.601+0000 7f81f5000700 1 -- 172.21.15.81:0/2169299221 wait complete. 2024-09-13T18:48:37.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.605+0000 7f81f5000700 1 Processor -- start 2024-09-13T18:48:37.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.605+0000 7f81f5000700 1 -- start start 2024-09-13T18:48:37.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 0x7f81f00c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf1b0 0x7f81f01f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f015ac60 0x7f81f01f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c69a0 con 0x7f81f00b3a10 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f01f17a0 con 0x7f81f015ac60 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f00c63e0 con 0x7f81f00cf1b0 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 0x7f81f00c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 0x7f81f00c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60538/0 (socket says 172.21.15.81:60538) 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 -- 172.21.15.81:0/3289735223 learned_addr learned my addr 172.21.15.81:0/3289735223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81e5400700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf1b0 0x7f81f01f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ee800700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f015ac60 0x7f81f01f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 -- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf1b0 msgr2=0x7f81f01f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf1b0 0x7f81f01f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 -- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f015ac60 msgr2=0x7f81f01f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f015ac60 0x7f81f01f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 -- 172.21.15.81:0/3289735223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80094b0 con 0x7f81f00b3a10 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81ede00700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 0x7f81f00c5990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c4d0 tx=0x7f81e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0005d90 con 0x7f81f00b3a10 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f00c66c0 con 0x7f81f00b3a10 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e00070d0 con 0x7f81f00b3a10 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0007480 con 0x7f81f00b3a10 2024-09-13T18:48:37.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f00a8640 con 0x7f81f00b3a10 2024-09-13T18:48:37.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.609+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f00a87d0 con 0x7f81f00b3a10 2024-09-13T18:48:37.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.613+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81e00075e0 con 0x7f81f00b3a10 2024-09-13T18:48:37.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.613+0000 7f81e6a00700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f81cc066730 0x7f81cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:37.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.613+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f81e0083540 con 0x7f81f00b3a10 2024-09-13T18:48:37.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.613+0000 7f81e5400700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f81cc066730 0x7f81cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:37.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.613+0000 7f81e5400700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f81cc066730 0x7f81cc068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f81d80090b0 tx=0x7f81d8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:37.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.617+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81e0050a30 con 0x7f81f00b3a10 2024-09-13T18:48:37.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.861+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f81f00ce410 con 0x7f81f00b3a10 2024-09-13T18:48:37.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.869+0000 7f81e6a00700 1 -- 172.21.15.81:0/3289735223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f81e0054050 con 0x7f81f00b3a10 2024-09-13T18:48:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f81cc066730 msgr2=0x7f81cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f81cc066730 0x7f81cc068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f81d80090b0 tx=0x7f81d8008030 comp rx=0 tx=0).stop 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 msgr2=0x7f81f00c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 0x7f81f00c5990 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f81e000c4d0 tx=0x7f81e000c890 comp rx=0 tx=0).stop 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 shutdown_connections 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f81cc066730 0x7f81cc068bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81f015ac60 0x7f81f01f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81f00cf1b0 0x7f81f01f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 --2- 172.21.15.81:0/3289735223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f00b3a10 0x7f81f00c5990 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 >> 172.21.15.81:0/3289735223 conn(0x7f81f00b0a40 msgr2=0x7f81f01599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 shutdown_connections 2024-09-13T18:48:37.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:37.873+0000 7f81f5000700 1 -- 172.21.15.81:0/3289735223 wait complete. 2024-09-13T18:48:37.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T18:48:38.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.065+0000 7f880d600700 1 Processor -- start 2024-09-13T18:48:38.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.065+0000 7f880d600700 1 -- start start 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f880d600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88080cc6f0 0x7f880815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f880d600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f880806aaa0 0x7f880806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f880d600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88080ccb40 con 0x7f88080cb020 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f880d600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880806b430 con 0x7f88080cc6f0 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f880d600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88080b2ad0 con 0x7f880806aaa0 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88080cc6f0 0x7f880815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f88080cb020 0x7f880815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46504/0 (socket says 172.21.15.81:46504) 2024-09-13T18:48:38.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807e00700 1 -- 172.21.15.81:0/706682401 learned_addr learned my addr 172.21.15.81:0/706682401 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f880cc00700 1 --2- 172.21.15.81:0/706682401 >> v2:172.21.15.178:3300/0 conn(0x7f880806aaa0 0x7f880806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807400700 1 -- 172.21.15.81:0/706682401 >> v2:172.21.15.178:3300/0 conn(0x7f880806aaa0 msgr2=0x7f880806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807400700 1 --2- 172.21.15.81:0/706682401 >> v2:172.21.15.178:3300/0 conn(0x7f880806aaa0 0x7f880806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807400700 1 -- 172.21.15.81:0/706682401 >> v1:172.21.15.81:6789/0 conn(0x7f88080cb020 legacy=0x7f880815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807400700 1 -- 172.21.15.81:0/706682401 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880815b960 con 0x7f88080cc6f0 2024-09-13T18:48:38.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8806a00700 1 -- 172.21.15.81:0/706682401 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610675403 0 0) 0x7f88080ccb40 con 0x7f88080cb020 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.069+0000 7f8807400700 1 --2- 172.21.15.81:0/706682401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cc6f0 0x7f880815b0e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f88080cd7e0 tx=0x7f87f4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fd03e02c21200a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f8806a00700 1 -- 172.21.15.81:0/706682401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011830 con 0x7f88080cc6f0 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f8806a00700 1 -- 172.21.15.81:0/706682401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4011990 con 0x7f88080cc6f0 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f8806a00700 1 -- 172.21.15.81:0/706682401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4011d20 con 0x7f88080cc6f0 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 -- 172.21.15.81:0/706682401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cc6f0 msgr2=0x7f880815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 --2- 172.21.15.81:0/706682401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cc6f0 0x7f880815b0e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f88080cd7e0 tx=0x7f87f4009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:38.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 -- 172.21.15.81:0/706682401 shutdown_connections 2024-09-13T18:48:38.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 --2- 172.21.15.81:0/706682401 >> v2:172.21.15.178:3300/0 conn(0x7f880806aaa0 0x7f880806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 --2- 172.21.15.81:0/706682401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88080cc6f0 0x7f880815b0e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 -- 172.21.15.81:0/706682401 >> 172.21.15.81:0/706682401 conn(0x7f88080b0c40 msgr2=0x7f880806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:38.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 -- 172.21.15.81:0/706682401 shutdown_connections 2024-09-13T18:48:38.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.073+0000 7f880d600700 1 -- 172.21.15.81:0/706682401 wait complete. 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 Processor -- start 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 -- start start 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 0x7f88080ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88080cb020 0x7f8808140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88080cc6f0 0x7f88081433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880813eb80 con 0x7f880806aaa0 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880813edd0 con 0x7f88080cb020 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880d600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880813f0b0 con 0x7f88080cc6f0 2024-09-13T18:48:38.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 0x7f88080ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 0x7f88080ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60548/0 (socket says 172.21.15.81:60548) 2024-09-13T18:48:38.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 -- 172.21.15.81:0/3835307071 learned_addr learned my addr 172.21.15.81:0/3835307071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807400700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88080cb020 0x7f8808140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f880cc00700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88080cc6f0 0x7f88081433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 -- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88080cc6f0 msgr2=0x7f88081433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88080cc6f0 0x7f88081433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 -- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88080cb020 msgr2=0x7f8808140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88080cb020 0x7f8808140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.077+0000 7f8807e00700 1 -- 172.21.15.81:0/3835307071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40094b0 con 0x7f880806aaa0 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f8807e00700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 0x7f88080ca420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f87f800c580 tx=0x7f87f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8004ca0 con 0x7f880806aaa0 2024-09-13T18:48:38.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8004e20 con 0x7f880806aaa0 2024-09-13T18:48:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8007310 con 0x7f880806aaa0 2024-09-13T18:48:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880813f390 con 0x7f880806aaa0 2024-09-13T18:48:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808140a30 con 0x7f880806aaa0 2024-09-13T18:48:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88080cb400 con 0x7f880806aaa0 2024-09-13T18:48:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.081+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87f8007470 con 0x7f880806aaa0 2024-09-13T18:48:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.085+0000 7f87ffe00700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f87e8066730 0x7f87e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.085+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f87f8083ce0 con 0x7f880806aaa0 2024-09-13T18:48:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.085+0000 7f8807400700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f87e8066730 0x7f87e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.085+0000 7f8807400700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f87e8066730 0x7f87e8068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009fd0 tx=0x7f87f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.089+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f87f8051260 con 0x7f880806aaa0 2024-09-13T18:48:38.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.341+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f880806cb40 con 0x7f880806aaa0 2024-09-13T18:48:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.345+0000 7f87ffe00700 1 -- 172.21.15.81:0/3835307071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f87f8007720 con 0x7f880806aaa0 2024-09-13T18:48:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f87e8066730 msgr2=0x7f87e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f87e8066730 0x7f87e8068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009fd0 tx=0x7f87f4008030 comp rx=0 tx=0).stop 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 msgr2=0x7f88080ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 0x7f88080ca420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f87f800c580 tx=0x7f87f800c940 comp rx=0 tx=0).stop 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 shutdown_connections 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f87e8066730 0x7f87e8068bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88080cc6f0 0x7f88081433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88080cb020 0x7f8808140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 --2- 172.21.15.81:0/3835307071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880806aaa0 0x7f88080ca420 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 >> 172.21.15.81:0/3835307071 conn(0x7f88080b0c40 msgr2=0x7f880806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 shutdown_connections 2024-09-13T18:48:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.349+0000 7f880d600700 1 -- 172.21.15.81:0/3835307071 wait complete. 2024-09-13T18:48:38.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 Processor -- start 2024-09-13T18:48:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 -- start start 2024-09-13T18:48:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12b406aaa0 0x7f12b406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b40b2ad0 con 0x7f12b415c2a0 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b406b450 con 0x7f12b406aaa0 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12bac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b415b960 con 0x7f12b40cb020 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12b8e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f12b415c2a0 0x7f12b415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46510/0 (socket says 172.21.15.81:46510) 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12b8e00700 1 -- 172.21.15.81:0/3457798000 learned_addr learned my addr 172.21.15.81:0/3457798000 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12b9800700 1 --2- 172.21.15.81:0/3457798000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.532+0000 7f12ba200700 1 --2- 172.21.15.81:0/3457798000 >> v2:172.21.15.178:3300/0 conn(0x7f12b406aaa0 0x7f12b406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b3e00700 1 -- 172.21.15.81:0/3457798000 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931468237 0 0) 0x7f12b40b2ad0 con 0x7f12b415c2a0 2024-09-13T18:48:38.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b3e00700 1 -- 172.21.15.81:0/3457798000 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f129c0035d0 con 0x7f12b415c2a0 2024-09-13T18:48:38.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b9800700 1 -- 172.21.15.81:0/3457798000 >> v2:172.21.15.178:3300/0 conn(0x7f12b406aaa0 msgr2=0x7f12b406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:38.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b9800700 1 --2- 172.21.15.81:0/3457798000 >> v2:172.21.15.178:3300/0 conn(0x7f12b406aaa0 0x7f12b406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b9800700 1 -- 172.21.15.81:0/3457798000 >> v1:172.21.15.81:6789/0 conn(0x7f12b415c2a0 legacy=0x7f12b415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b9800700 1 -- 172.21.15.81:0/3457798000 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b415bc40 con 0x7f12b40cb020 2024-09-13T18:48:38.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b9800700 1 --2- 172.21.15.81:0/3457798000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b40cc6f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009d90 tx=0x7f12a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7adf522bcb9c0b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b3e00700 1 -- 172.21.15.81:0/3457798000 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800e070 con 0x7f12b40cb020 2024-09-13T18:48:38.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b3e00700 1 -- 172.21.15.81:0/3457798000 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a800bb20 con 0x7f12b40cb020 2024-09-13T18:48:38.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12b3e00700 1 -- 172.21.15.81:0/3457798000 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8012430 con 0x7f12b40cb020 2024-09-13T18:48:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 -- 172.21.15.81:0/3457798000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 msgr2=0x7f12b40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 --2- 172.21.15.81:0/3457798000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b40cc6f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009d90 tx=0x7f12a800b330 comp rx=0 tx=0).stop 2024-09-13T18:48:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 -- 172.21.15.81:0/3457798000 shutdown_connections 2024-09-13T18:48:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 --2- 172.21.15.81:0/3457798000 >> v2:172.21.15.178:3300/0 conn(0x7f12b406aaa0 0x7f12b406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 --2- 172.21.15.81:0/3457798000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b40cc6f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 -- 172.21.15.81:0/3457798000 >> 172.21.15.81:0/3457798000 conn(0x7f12b40b0c40 msgr2=0x7f12b406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 -- 172.21.15.81:0/3457798000 shutdown_connections 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.536+0000 7f12bac00700 1 -- 172.21.15.81:0/3457798000 wait complete. 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 Processor -- start 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 -- start start 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 0x7f12b413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b41f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b415c2a0 0x7f12b40c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b41557a0 con 0x7f12b406aaa0 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b40ca130 con 0x7f12b415c2a0 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12bac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b41559f0 con 0x7f12b40cb020 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12b9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 0x7f12b413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12b9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 0x7f12b413e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60556/0 (socket says 172.21.15.81:60556) 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12b9800700 1 -- 172.21.15.81:0/781965069 learned_addr learned my addr 172.21.15.81:0/781965069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12ba200700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b415c2a0 0x7f12b40c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.540+0000 7f12b8e00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b41f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b9800700 1 -- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 msgr2=0x7f12b41f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b9800700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b41f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b9800700 1 -- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b415c2a0 msgr2=0x7f12b40c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b9800700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b415c2a0 0x7f12b40c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b9800700 1 -- 172.21.15.81:0/781965069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009a70 con 0x7f12b406aaa0 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12ba200700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b415c2a0 0x7f12b40c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b9800700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 0x7f12b413e360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f12a8014040 tx=0x7f12a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8012430 con 0x7f12b406aaa0 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a8020070 con 0x7f12b406aaa0 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b4155cd0 con 0x7f12b406aaa0 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a8004280 con 0x7f12b406aaa0 2024-09-13T18:48:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b40b00d0 con 0x7f12b406aaa0 2024-09-13T18:48:38.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.544+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b41561f0 con 0x7f12b406aaa0 2024-09-13T18:48:38.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.548+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12a80043e0 con 0x7f12b406aaa0 2024-09-13T18:48:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.548+0000 7f12b1600700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1294066730 0x7f1294068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.548+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f12a8022070 con 0x7f12b406aaa0 2024-09-13T18:48:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.548+0000 7f12b8e00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1294066730 0x7f1294068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.548+0000 7f12b8e00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1294066730 0x7f1294068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12b41f5a40 tx=0x7f12a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.556+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12a80531e0 con 0x7f12b406aaa0 2024-09-13T18:48:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.744+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12b406af10 con 0x7f12b406aaa0 2024-09-13T18:48:38.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.748+0000 7f12b1600700 1 -- 172.21.15.81:0/781965069 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f12a8056800 con 0x7f12b406aaa0 2024-09-13T18:48:38.755 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:38.755 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:34.998732+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1294066730 msgr2=0x7f1294068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1294066730 0x7f1294068bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12b41f5a40 tx=0x7f12a0009040 comp rx=0 tx=0).stop 2024-09-13T18:48:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 msgr2=0x7f12b413e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 0x7f12b413e360 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f12a8014040 tx=0x7f12a8004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 shutdown_connections 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1294066730 0x7f1294068bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12b415c2a0 0x7f12b40c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12b40cb020 0x7f12b41f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 --2- 172.21.15.81:0/781965069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12b406aaa0 0x7f12b413e360 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 >> 172.21.15.81:0/781965069 conn(0x7f12b40b0c40 msgr2=0x7f12b40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 shutdown_connections 2024-09-13T18:48:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.752+0000 7f12bac00700 1 -- 172.21.15.81:0/781965069 wait complete. 2024-09-13T18:48:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:48:38.782 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.952+0000 7fc442e00700 1 Processor -- start 2024-09-13T18:48:38.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.952+0000 7fc442e00700 1 -- start start 2024-09-13T18:48:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc43c0cd450 0x7fc43c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43c06ef00 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc43c0cc900 con 0x7fc43c0cd450 2024-09-13T18:48:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c0b3a70 con 0x7fc43c06f6a0 2024-09-13T18:48:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc43c0cd450 0x7fc43c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc43c0cd450 0x7fc43c0cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60558/0 (socket says 172.21.15.81:60558) 2024-09-13T18:48:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 -- 172.21.15.81:0/1649501769 learned_addr learned my addr 172.21.15.81:0/1649501769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441000700 1 --1- 172.21.15.81:0/1649501769 >> v1:172.21.15.178:6789/0 conn(0x7fc43c0cf8b0 0x7fc43c0cc1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:52092/0 (socket says 172.21.15.81:52092) 2024-09-13T18:48:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442400700 1 --2- 172.21.15.81:0/1649501769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 -- 172.21.15.81:0/1649501769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 msgr2=0x7fc43c06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 --2- 172.21.15.81:0/1649501769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 -- 172.21.15.81:0/1649501769 >> v1:172.21.15.178:6789/0 conn(0x7fc43c0cf8b0 legacy=0x7fc43c0cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 -- 172.21.15.81:0/1649501769 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c0cdd70 con 0x7fc43c0cd450 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc441a00700 1 --2- 172.21.15.81:0/1649501769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cd450 0x7fc43c0cd830 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc430009910 tx=0x7fc430009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78598b4c9c2c2d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc43be00700 1 -- 172.21.15.81:0/1649501769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430011830 con 0x7fc43c0cd450 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc43be00700 1 -- 172.21.15.81:0/1649501769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430011990 con 0x7fc43c0cd450 2024-09-13T18:48:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc43be00700 1 -- 172.21.15.81:0/1649501769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430011d40 con 0x7fc43c0cd450 2024-09-13T18:48:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.956+0000 7fc442e00700 1 -- 172.21.15.81:0/1649501769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cd450 msgr2=0x7fc43c0cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 --2- 172.21.15.81:0/1649501769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cd450 0x7fc43c0cd830 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc430009910 tx=0x7fc430009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 -- 172.21.15.81:0/1649501769 shutdown_connections 2024-09-13T18:48:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 --2- 172.21.15.81:0/1649501769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 --2- 172.21.15.81:0/1649501769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cd450 0x7fc43c0cd830 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 -- 172.21.15.81:0/1649501769 >> 172.21.15.81:0/1649501769 conn(0x7fc43c072530 msgr2=0x7fc43c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 -- 172.21.15.81:0/1649501769 shutdown_connections 2024-09-13T18:48:38.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 -- 172.21.15.81:0/1649501769 wait complete. 2024-09-13T18:48:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 Processor -- start 2024-09-13T18:48:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.960+0000 7fc442e00700 1 -- start start 2024-09-13T18:48:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c1e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc43c0cd450 0x7fc43c1e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 0x7fc43c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1e5f00 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1e61e0 con 0x7fc43c0cd450 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c1e64c0 con 0x7fc43c06f6a0 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 0x7fc43c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 0x7fc43c142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60560/0 (socket says 172.21.15.81:60560) 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 -- 172.21.15.81:0/2250665434 learned_addr learned my addr 172.21.15.81:0/2250665434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc441a00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c1e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc441000700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc43c0cd450 0x7fc43c1e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 -- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 msgr2=0x7fc43c1e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c1e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 -- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc43c0cd450 msgr2=0x7fc43c1e6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc43c0cd450 0x7fc43c1e6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:38.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 -- 172.21.15.81:0/2250665434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc430009570 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442400700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 0x7fc43c142800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc43400efc0 tx=0x7fc43400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43400cd40 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43400f040 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43c1e67a0 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4340146c0 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43c1e7e20 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.964+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43c1d1610 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.968+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc434014820 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.968+0000 7fc439600700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc41c066730 0x7fc41c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.968+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc4340847f0 con 0x7fc43c0cf8b0 2024-09-13T18:48:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.968+0000 7fc441a00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc41c066730 0x7fc41c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.972+0000 7fc441a00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc41c066730 0x7fc41c068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc43c1e4c50 tx=0x7fc430008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:38.972+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc43c1d1610 con 0x7fc43c0cf8b0 2024-09-13T18:48:39.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.160+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc43c1d1610 con 0x7fc43c0cf8b0 2024-09-13T18:48:39.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.160+0000 7fc439600700 1 -- 172.21.15.81:0/2250665434 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc43c1d1610 con 0x7fc43c0cf8b0 2024-09-13T18:48:39.169 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:48:39.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc41c066730 msgr2=0x7fc41c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc41c066730 0x7fc41c068bf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc43c1e4c50 tx=0x7fc430008030 comp rx=0 tx=0).stop 2024-09-13T18:48:39.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 msgr2=0x7fc43c142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 0x7fc43c142800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc43400efc0 tx=0x7fc43400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 shutdown_connections 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc41c066730 0x7fc41c068bf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc43c0cf8b0 0x7fc43c142800 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc43c0cd450 0x7fc43c1e6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 --2- 172.21.15.81:0/2250665434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc43c06f6a0 0x7fc43c1e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 >> 172.21.15.81:0/2250665434 conn(0x7fc43c072530 msgr2=0x7fc43c0b3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 shutdown_connections 2024-09-13T18:48:39.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.164+0000 7fc442e00700 1 -- 172.21.15.81:0/2250665434 wait complete. 2024-09-13T18:48:39.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:48:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.352+0000 7ff0ebc00700 1 Processor -- start 2024-09-13T18:48:39.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.352+0000 7ff0ebc00700 1 -- start start 2024-09-13T18:48:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0ebc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0e41573b0 0x7ff0e40cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0ebc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e40ce2f0 0x7ff0e406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0ebc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e40ad480 con 0x7ff0e406ab10 2024-09-13T18:48:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0ebc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40ce750 con 0x7ff0e41573b0 2024-09-13T18:48:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0ebc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e406af80 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0e41573b0 0x7ff0e40cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0e41573b0 0x7ff0e40cddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:56092/0 (socket says 172.21.15.81:56092) 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e40ce2f0 0x7ff0e406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 -- 172.21.15.81:0/855538731 learned_addr learned my addr 172.21.15.81:0/855538731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9c00700 1 --1- 172.21.15.81:0/855538731 >> v1:172.21.15.178:6789/0 conn(0x7ff0e406ab10 0x7ff0e4160890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:52104/0 (socket says 172.21.15.81:52104) 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 -- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e40ce2f0 msgr2=0x7ff0e406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:39.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 --2- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e40ce2f0 0x7ff0e406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 -- 172.21.15.81:0/855538731 >> v1:172.21.15.178:6789/0 conn(0x7ff0e406ab10 legacy=0x7ff0e4160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e9200700 1 -- 172.21.15.81:0/855538731 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4157790 con 0x7ff0e41573b0 2024-09-13T18:48:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.356+0000 7ff0e3400700 1 -- 172.21.15.81:0/855538731 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496403966 0 0) 0x7ff0e40ad480 con 0x7ff0e406ab10 2024-09-13T18:48:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0e9200700 1 --2- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e41573b0 0x7ff0e40cddb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e50 tx=0x7ff0d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80f0ec6e8ece483 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0e3400700 1 -- 172.21.15.81:0/855538731 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400e070 con 0x7ff0e41573b0 2024-09-13T18:48:39.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0e3400700 1 -- 172.21.15.81:0/855538731 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400b910 con 0x7ff0e41573b0 2024-09-13T18:48:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0e3400700 1 -- 172.21.15.81:0/855538731 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400bcc0 con 0x7ff0e41573b0 2024-09-13T18:48:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 -- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e41573b0 msgr2=0x7ff0e40cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e41573b0 0x7ff0e40cddb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009e50 tx=0x7ff0d400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 -- 172.21.15.81:0/855538731 shutdown_connections 2024-09-13T18:48:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e40ce2f0 0x7ff0e406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/855538731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e41573b0 0x7ff0e40cddb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 -- 172.21.15.81:0/855538731 >> 172.21.15.81:0/855538731 conn(0x7ff0e40b08d0 msgr2=0x7ff0e40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 -- 172.21.15.81:0/855538731 shutdown_connections 2024-09-13T18:48:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.360+0000 7ff0ebc00700 1 -- 172.21.15.81:0/855538731 wait complete. 2024-09-13T18:48:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 Processor -- start 2024-09-13T18:48:39.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 -- start start 2024-09-13T18:48:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e406ab10 0x7ff0e414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 0x7ff0e414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e41573b0 0x7ff0e406fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41532d0 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41535b0 con 0x7ff0e406ab10 2024-09-13T18:48:39.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0ebc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e4153890 con 0x7ff0e41573b0 2024-09-13T18:48:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 0x7ff0e414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 0x7ff0e414e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60562/0 (socket says 172.21.15.81:60562) 2024-09-13T18:48:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 -- 172.21.15.81:0/4244231328 learned_addr learned my addr 172.21.15.81:0/4244231328 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e9200700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e406ab10 0x7ff0e414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e9c00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e41573b0 0x7ff0e406fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 -- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e41573b0 msgr2=0x7ff0e406fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e41573b0 0x7ff0e406fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 -- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e406ab10 msgr2=0x7ff0e414d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e406ab10 0x7ff0e414d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.364+0000 7ff0e3e00700 1 -- 172.21.15.81:0/4244231328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d4009b30 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0e3e00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 0x7ff0e414e990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9d0 tx=0x7ff0d000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0009720 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000c850 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e4153b70 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000cbc0 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e4154130 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e40ae250 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.368+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0d000cd20 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.372+0000 7ff0e0c00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0c4066730 0x7ff0c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.372+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff0d00840e0 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.372+0000 7ff0e9200700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0c4066730 0x7ff0c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.372+0000 7ff0e9200700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0c4066730 0x7ff0c4068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400b370 tx=0x7ff0d4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:39.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.380+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0d00515c0 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.568+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff0e414e690 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.568+0000 7ff0e0c00700 1 -- 172.21.15.81:0/4244231328 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff0d0054be0 con 0x7ff0e40ce2f0 2024-09-13T18:48:39.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:39.577 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:48:39.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:48:39.578 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:48:39.578 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:48:39.578 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:48:39.578 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:48:39.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0c4066730 msgr2=0x7ff0c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0c4066730 0x7ff0c4068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400b370 tx=0x7ff0d4009000 comp rx=0 tx=0).stop 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 msgr2=0x7ff0e414e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 0x7ff0e414e990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000e9d0 tx=0x7ff0d000ece0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 shutdown_connections 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff0c4066730 0x7ff0c4068bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0e41573b0 0x7ff0e406fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0e40ce2f0 0x7ff0e414e990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 --2- 172.21.15.81:0/4244231328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0e406ab10 0x7ff0e414d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 >> 172.21.15.81:0/4244231328 conn(0x7ff0e40b08d0 msgr2=0x7ff0e40af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 shutdown_connections 2024-09-13T18:48:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.572+0000 7ff0ebc00700 1 -- 172.21.15.81:0/4244231328 wait complete. 2024-09-13T18:48:39.602 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:48:39.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:48:39.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.772+0000 7ff223e00700 1 Processor -- start 2024-09-13T18:48:39.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.772+0000 7ff223e00700 1 -- start start 2024-09-13T18:48:39.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.772+0000 7ff223e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff224070b60 0x7ff2240ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.772+0000 7ff223e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff224072460 con 0x7ff224158570 2024-09-13T18:48:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.772+0000 7ff223e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2240728f0 con 0x7ff22415b970 2024-09-13T18:48:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.772+0000 7ff223e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff22406de30 con 0x7ff224070b60 2024-09-13T18:48:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff224158570 0x7ff224070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46514/0 (socket says 172.21.15.81:46514) 2024-09-13T18:48:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222a00700 1 -- 172.21.15.81:0/628310816 learned_addr learned my addr 172.21.15.81:0/628310816 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222000700 1 --2- 172.21.15.81:0/628310816 >> v2:172.21.15.178:3300/0 conn(0x7ff224070b60 0x7ff2240ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff221600700 1 -- 172.21.15.81:0/628310816 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2235255844 0 0) 0x7ff224072460 con 0x7ff224158570 2024-09-13T18:48:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff221600700 1 -- 172.21.15.81:0/628310816 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2080035d0 con 0x7ff224158570 2024-09-13T18:48:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff221600700 1 -- 172.21.15.81:0/628310816 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961560773 0 0) 0x7ff2240728f0 con 0x7ff22415b970 2024-09-13T18:48:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222000700 1 -- 172.21.15.81:0/628310816 >> v1:172.21.15.178:6789/0 conn(0x7ff22415b970 legacy=0x7ff2240adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222000700 1 -- 172.21.15.81:0/628310816 >> v1:172.21.15.81:6789/0 conn(0x7ff224158570 legacy=0x7ff224070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222000700 1 -- 172.21.15.81:0/628310816 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff224071b30 con 0x7ff224070b60 2024-09-13T18:48:39.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff222000700 1 --2- 172.21.15.81:0/628310816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff224070b60 0x7ff2240ad5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff210009850 tx=0x7ff210009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b998c05ed09b0407 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:39.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff221600700 1 -- 172.21.15.81:0/628310816 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210011830 con 0x7ff224070b60 2024-09-13T18:48:39.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff221600700 1 -- 172.21.15.81:0/628310816 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff210011990 con 0x7ff224070b60 2024-09-13T18:48:39.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff221600700 1 -- 172.21.15.81:0/628310816 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff210011d40 con 0x7ff224070b60 2024-09-13T18:48:39.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 -- 172.21.15.81:0/628310816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff224070b60 msgr2=0x7ff2240ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 --2- 172.21.15.81:0/628310816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff224070b60 0x7ff2240ad5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff210009850 tx=0x7ff210009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:39.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 -- 172.21.15.81:0/628310816 shutdown_connections 2024-09-13T18:48:39.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 --2- 172.21.15.81:0/628310816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff224070b60 0x7ff2240ad5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 -- 172.21.15.81:0/628310816 >> 172.21.15.81:0/628310816 conn(0x7ff2240b0c30 msgr2=0x7ff2240b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:39.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 -- 172.21.15.81:0/628310816 shutdown_connections 2024-09-13T18:48:39.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.776+0000 7ff223e00700 1 -- 172.21.15.81:0/628310816 wait complete. 2024-09-13T18:48:39.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.780+0000 7ff223e00700 1 Processor -- start 2024-09-13T18:48:39.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.780+0000 7ff223e00700 1 -- start start 2024-09-13T18:48:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff224070b60 0x7ff224156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 0x7ff22409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff22415b970 0x7ff22409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22415be70 con 0x7ff224158570 2024-09-13T18:48:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240cd590 con 0x7ff22415b970 2024-09-13T18:48:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240cc910 con 0x7ff224070b60 2024-09-13T18:48:39.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 0x7ff22409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 0x7ff22409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60570/0 (socket says 172.21.15.81:60570) 2024-09-13T18:48:39.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 -- 172.21.15.81:0/2733890541 learned_addr learned my addr 172.21.15.81:0/2733890541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222a00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff224070b60 0x7ff224156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223400700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff22415b970 0x7ff22409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 -- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff224070b60 msgr2=0x7ff224156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff224070b60 0x7ff224156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 -- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff22415b970 msgr2=0x7ff22409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff22415b970 0x7ff22409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 -- 172.21.15.81:0/2733890541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100094b0 con 0x7ff224158570 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222a00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff224070b60 0x7ff224156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223400700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff22415b970 0x7ff22409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff222000700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 0x7ff22409c480 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff2240d0140 tx=0x7ff210004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21001ab70 con 0x7ff224158570 2024-09-13T18:48:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21001f070 con 0x7ff224158570 2024-09-13T18:48:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2240ccbf0 con 0x7ff224158570 2024-09-13T18:48:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21001b430 con 0x7ff224158570 2024-09-13T18:48:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.784+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2240cd1b0 con 0x7ff224158570 2024-09-13T18:48:39.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.788+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff224073660 con 0x7ff224158570 2024-09-13T18:48:39.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.788+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff21001b590 con 0x7ff224158570 2024-09-13T18:48:39.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.792+0000 7ff21aa00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff204066730 0x7ff204068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:39.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.792+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff210085180 con 0x7ff224158570 2024-09-13T18:48:39.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.792+0000 7ff222a00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff204066730 0x7ff204068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:39.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.792+0000 7ff222a00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff204066730 0x7ff204068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff214005cb0 tx=0x7ff214009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.796+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff210052670 con 0x7ff224158570 2024-09-13T18:48:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:39.976+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff2240ae540 con 0x7ff224158570 2024-09-13T18:48:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.780+0000 7ff21aa00700 1 -- 172.21.15.81:0/2733890541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff210055c90 con 0x7ff224158570 2024-09-13T18:48:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff204066730 msgr2=0x7ff204068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff204066730 0x7ff204068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff214005cb0 tx=0x7ff214009040 comp rx=0 tx=0).stop 2024-09-13T18:48:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 msgr2=0x7ff22409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 0x7ff22409c480 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff2240d0140 tx=0x7ff210004770 comp rx=0 tx=0).stop 2024-09-13T18:48:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 shutdown_connections 2024-09-13T18:48:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff204066730 0x7ff204068bf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff22415b970 0x7ff22409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff224158570 0x7ff22409c480 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 --2- 172.21.15.81:0/2733890541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff224070b60 0x7ff224156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.784+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 >> 172.21.15.81:0/2733890541 conn(0x7ff2240b0c30 msgr2=0x7ff22415af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.788+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 shutdown_connections 2024-09-13T18:48:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.788+0000 7ff223e00700 1 -- 172.21.15.81:0/2733890541 wait complete. 2024-09-13T18:48:40.796 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:48:40.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:48:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.988+0000 7f2c84600700 1 Processor -- start 2024-09-13T18:48:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.988+0000 7f2c84600700 1 -- start start 2024-09-13T18:48:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c7c15cc40 0x7f2c7c06bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c7c06c040 0x7f2c7c0d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15d020 0x7f2c7c0d1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0b48f0 con 0x7f2c7c06c040 2024-09-13T18:48:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7c0d08c0 con 0x7f2c7c15cc40 2024-09-13T18:48:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0b3a00 con 0x7f2c7c15d020 2024-09-13T18:48:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c7c06c040 0x7f2c7c0d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c82600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15d020 0x7f2c7c0d1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2c7c06c040 0x7f2c7c0d0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60580/0 (socket says 172.21.15.81:60580) 2024-09-13T18:48:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c7c15cc40 0x7f2c7c06bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 -- 172.21.15.81:0/211297867 learned_addr learned my addr 172.21.15.81:0/211297867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 -- 172.21.15.81:0/211297867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15d020 msgr2=0x7f2c7c0d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 --2- 172.21.15.81:0/211297867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15d020 0x7f2c7c0d1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 -- 172.21.15.81:0/211297867 >> v2:172.21.15.178:3300/0 conn(0x7f2c7c15cc40 msgr2=0x7f2c7c06bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 --2- 172.21.15.81:0/211297867 >> v2:172.21.15.178:3300/0 conn(0x7f2c7c15cc40 0x7f2c7c06bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 -- 172.21.15.81:0/211297867 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7c0b3ce0 con 0x7f2c7c06c040 2024-09-13T18:48:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c81200700 1 --2- 172.21.15.81:0/211297867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0d0ac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0ce5c0 tx=0x7f2c68009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa75c25d88b85c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c7be00700 1 -- 172.21.15.81:0/211297867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011830 con 0x7f2c7c06c040 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c7be00700 1 -- 172.21.15.81:0/211297867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c68011990 con 0x7f2c7c06c040 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c7be00700 1 -- 172.21.15.81:0/211297867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68011d20 con 0x7f2c7c06c040 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 -- 172.21.15.81:0/211297867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c06c040 msgr2=0x7f2c7c0d0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- 172.21.15.81:0/211297867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0d0ac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c0ce5c0 tx=0x7f2c68009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 -- 172.21.15.81:0/211297867 shutdown_connections 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- 172.21.15.81:0/211297867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15d020 0x7f2c7c0d1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- 172.21.15.81:0/211297867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0d0ac0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 --2- 172.21.15.81:0/211297867 >> v2:172.21.15.178:3300/0 conn(0x7f2c7c15cc40 0x7f2c7c06bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.992+0000 7f2c84600700 1 -- 172.21.15.81:0/211297867 >> 172.21.15.81:0/211297867 conn(0x7f2c7c06c5a0 msgr2=0x7f2c7c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.996+0000 7f2c84600700 1 -- 172.21.15.81:0/211297867 shutdown_connections 2024-09-13T18:48:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.996+0000 7f2c84600700 1 -- 172.21.15.81:0/211297867 wait complete. 2024-09-13T18:48:41.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.996+0000 7f2c84600700 1 Processor -- start 2024-09-13T18:48:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:40.996+0000 7f2c84600700 1 -- start start 2024-09-13T18:48:41.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:41.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15cc40 0x7f2c7c1f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:41.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 0x7f2c7c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:41.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1525c0 con 0x7f2c7c15d020 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c0b1e40 con 0x7f2c7c06c040 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7c1f7040 con 0x7f2c7c15cc40 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 0x7f2c7c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 0x7f2c7c0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60584/0 (socket says 172.21.15.81:60584) 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 -- 172.21.15.81:0/109068746 learned_addr learned my addr 172.21.15.81:0/109068746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c81200700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15cc40 0x7f2c7c1f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c81c00700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 -- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15cc40 msgr2=0x7f2c7c1f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15cc40 0x7f2c7c1f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 -- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7c06c040 msgr2=0x7f2c7c0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:41.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 -- 172.21.15.81:0/109068746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009570 con 0x7f2c7c15d020 2024-09-13T18:48:41.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c81c00700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c82600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 0x7f2c7c0cb0f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400efc0 tx=0x7f2c7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74009b20 con 0x7f2c7c15d020 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7400f040 con 0x7f2c7c15d020 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0b1510 con 0x7f2c7c15d020 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c74009e50 con 0x7f2c7c15d020 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7c0b1ad0 con 0x7f2c7c15d020 2024-09-13T18:48:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.000+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7c0b1fb0 con 0x7f2c7c15d020 2024-09-13T18:48:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.004+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c74014480 con 0x7f2c7c15d020 2024-09-13T18:48:41.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.004+0000 7f2c79600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c5c066730 0x7f2c5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:41.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.004+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f2c74084b60 con 0x7f2c7c15d020 2024-09-13T18:48:41.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.004+0000 7f2c81c00700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c5c066730 0x7f2c5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:41.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.008+0000 7f2c81c00700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c5c066730 0x7f2c5c068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009af0 tx=0x7f2c70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:41.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.012+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c740520b0 con 0x7f2c7c15d020 2024-09-13T18:48:41.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.192+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2c7c06bb00 con 0x7f2c7c15d020 2024-09-13T18:48:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.788+0000 7f2c79600700 1 -- 172.21.15.81:0/109068746 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2c74018070 con 0x7f2c7c15d020 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c5c066730 msgr2=0x7f2c5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c5c066730 0x7f2c5c068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2c70009af0 tx=0x7f2c70008040 comp rx=0 tx=0).stop 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 msgr2=0x7f2c7c0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 0x7f2c7c0cb0f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400efc0 tx=0x7f2c7400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 shutdown_connections 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c5c066730 0x7f2c5c068bf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c7c15d020 0x7f2c7c0cb0f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c7c15cc40 0x7f2c7c1f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 --2- 172.21.15.81:0/109068746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7c06c040 0x7f2c7c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:41.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.796+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 >> 172.21.15.81:0/109068746 conn(0x7f2c7c06c5a0 msgr2=0x7f2c7c0ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:41.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.800+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 shutdown_connections 2024-09-13T18:48:41.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.800+0000 7f2c84600700 1 -- 172.21.15.81:0/109068746 wait complete. 2024-09-13T18:48:41.813 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:48:41.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:48:42.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.992+0000 7f1bede00700 1 Processor -- start 2024-09-13T18:48:42.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.992+0000 7f1bede00700 1 -- start start 2024-09-13T18:48:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1bede00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 0x7f1be806b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1bede00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1be806b830 0x7f1be815e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1bede00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be80b4380 con 0x7f1be815e780 2024-09-13T18:48:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1bede00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be815ec30 con 0x7f1be80cf200 2024-09-13T18:48:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1bede00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be806a530 con 0x7f1be806b830 2024-09-13T18:48:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1beca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 0x7f1be806b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1be7e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1be806b830 0x7f1be815e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1beca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 0x7f1be806b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60596/0 (socket says 172.21.15.81:60596) 2024-09-13T18:48:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1beca00700 1 -- 172.21.15.81:0/3857755839 learned_addr learned my addr 172.21.15.81:0/3857755839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1be7e00700 1 -- 172.21.15.81:0/3857755839 >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 msgr2=0x7f1be806b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1be7e00700 1 --2- 172.21.15.81:0/3857755839 >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 0x7f1be806b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1be7e00700 1 -- 172.21.15.81:0/3857755839 >> v1:172.21.15.178:6789/0 conn(0x7f1be815e780 legacy=0x7f1be8066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1be7e00700 1 -- 172.21.15.81:0/3857755839 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be806a810 con 0x7f1be806b830 2024-09-13T18:48:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1beca00700 1 --2- 172.21.15.81:0/3857755839 >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 0x7f1be806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:41.996+0000 7f1be7e00700 1 --2- 172.21.15.81:0/3857755839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be806b830 0x7f1be815e240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009850 tx=0x7f1bd4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d8e3fb4d5f050b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1be7400700 1 -- 172.21.15.81:0/3857755839 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4011830 con 0x7f1be806b830 2024-09-13T18:48:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1be7400700 1 -- 172.21.15.81:0/3857755839 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd4011990 con 0x7f1be806b830 2024-09-13T18:48:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1be7400700 1 -- 172.21.15.81:0/3857755839 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4011d20 con 0x7f1be806b830 2024-09-13T18:48:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 -- 172.21.15.81:0/3857755839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be806b830 msgr2=0x7f1be815e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 --2- 172.21.15.81:0/3857755839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be806b830 0x7f1be815e240 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009850 tx=0x7f1bd4009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 -- 172.21.15.81:0/3857755839 shutdown_connections 2024-09-13T18:48:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 --2- 172.21.15.81:0/3857755839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be806b830 0x7f1be815e240 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 --2- 172.21.15.81:0/3857755839 >> v2:172.21.15.81:3300/0 conn(0x7f1be80cf200 0x7f1be806b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 -- 172.21.15.81:0/3857755839 >> 172.21.15.81:0/3857755839 conn(0x7f1be80b1b70 msgr2=0x7f1be80b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 -- 172.21.15.81:0/3857755839 shutdown_connections 2024-09-13T18:48:42.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.000+0000 7f1bede00700 1 -- 172.21.15.81:0/3857755839 wait complete. 2024-09-13T18:48:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.004+0000 7f1bede00700 1 Processor -- start 2024-09-13T18:48:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.004+0000 7f1bede00700 1 -- start start 2024-09-13T18:48:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 0x7f1be81f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be80cf200 0x7f1be8151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 0x7f1be81f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 0x7f1be81f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60600/0 (socket says 172.21.15.81:60600) 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be815e780 0x7f1be80abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 -- 172.21.15.81:0/2884684510 learned_addr learned my addr 172.21.15.81:0/2884684510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be81f6f50 con 0x7f1be806b830 2024-09-13T18:48:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8153390 con 0x7f1be815e780 2024-09-13T18:48:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be8153670 con 0x7f1be80cf200 2024-09-13T18:48:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1be7e00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be80cf200 0x7f1be8151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bed400700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be815e780 0x7f1be80abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 -- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be80cf200 msgr2=0x7f1be8151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be80cf200 0x7f1be8151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 -- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be815e780 msgr2=0x7f1be80abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be815e780 0x7f1be80abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc009570 con 0x7f1be806b830 2024-09-13T18:48:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bed400700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be815e780 0x7f1be80abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1beca00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 0x7f1be81f6a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00ebe0 tx=0x7f1bdc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00c850 con 0x7f1be806b830 2024-09-13T18:48:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bdc00c9b0 con 0x7f1be806b830 2024-09-13T18:48:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd40094b0 con 0x7f1be806b830 2024-09-13T18:48:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc00cd20 con 0x7f1be806b830 2024-09-13T18:48:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.008+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be8153c30 con 0x7f1be806b830 2024-09-13T18:48:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.012+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be815e240 con 0x7f1be806b830 2024-09-13T18:48:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.012+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1bdc004020 con 0x7f1be806b830 2024-09-13T18:48:42.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.016+0000 7f1be4c00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bc8066730 0x7f1bc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.016+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f1bdc084880 con 0x7f1be806b830 2024-09-13T18:48:42.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.016+0000 7f1be7e00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bc8066730 0x7f1bc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.020+0000 7f1be7e00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bc8066730 0x7f1bc8068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1be806bc60 tx=0x7f1bd4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.024+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1bdc051a60 con 0x7f1be806b830 2024-09-13T18:48:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.236+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1be80cf710 con 0x7f1be806b830 2024-09-13T18:48:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.252+0000 7f1be4c00700 1 -- 172.21.15.81:0/2884684510 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1bdc0170c0 con 0x7f1be806b830 2024-09-13T18:48:42.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bc8066730 msgr2=0x7f1bc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bc8066730 0x7f1bc8068bf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1be806bc60 tx=0x7f1bd4008030 comp rx=0 tx=0).stop 2024-09-13T18:48:42.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 msgr2=0x7f1be81f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 0x7f1be81f6a10 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00ebe0 tx=0x7f1bdc00eef0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 shutdown_connections 2024-09-13T18:48:42.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1bc8066730 0x7f1bc8068bf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1be815e780 0x7f1be80abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.260+0000 7f1bede00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1be80cf200 0x7f1be8151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.264+0000 7f1bede00700 1 --2- 172.21.15.81:0/2884684510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1be806b830 0x7f1be81f6a10 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.264+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 >> 172.21.15.81:0/2884684510 conn(0x7f1be80b1b70 msgr2=0x7f1be80ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:42.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.264+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 shutdown_connections 2024-09-13T18:48:42.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.264+0000 7f1bede00700 1 -- 172.21.15.81:0/2884684510 wait complete. 2024-09-13T18:48:42.282 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 5 and data pool 6 2024-09-13T18:48:42.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:42.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.456+0000 7f4cc9000700 1 Processor -- start 2024-09-13T18:48:42.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.456+0000 7f4cc9000700 1 -- start start 2024-09-13T18:48:42.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc9000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cc415b700 0x7f4cc415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc9000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4cc406a5d0 0x7f4cc406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc9000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc406afa0 con 0x7f4cc415b700 2024-09-13T18:48:42.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc9000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40cdd90 con 0x7f4cc406a5d0 2024-09-13T18:48:42.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc406ce10 con 0x7f4cc406c460 2024-09-13T18:48:42.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cc415b700 0x7f4cc415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4cc415b700 0x7f4cc415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60610/0 (socket says 172.21.15.81:60610) 2024-09-13T18:48:42.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 -- 172.21.15.81:0/2046169030 learned_addr learned my addr 172.21.15.81:0/2046169030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:42.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 -- 172.21.15.81:0/2046169030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 msgr2=0x7f4cc406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:42.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cb9400700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc2800700 1 --2- 172.21.15.81:0/2046169030 >> v2:172.21.15.178:3300/0 conn(0x7f4cc406a5d0 0x7f4cc406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc406d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 -- 172.21.15.81:0/2046169030 >> v2:172.21.15.178:3300/0 conn(0x7f4cc406a5d0 msgr2=0x7f4cc406aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:42.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 --2- 172.21.15.81:0/2046169030 >> v2:172.21.15.178:3300/0 conn(0x7f4cc406a5d0 0x7f4cc406aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 -- 172.21.15.81:0/2046169030 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc415c020 con 0x7f4cc415b700 2024-09-13T18:48:42.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cb9400700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:42.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc2800700 1 --2- 172.21.15.81:0/2046169030 >> v2:172.21.15.178:3300/0 conn(0x7f4cc406a5d0 0x7f4cc406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1e00700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc415b700 0x7f4cc415bae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40722a0 tx=0x7f4cb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b47ef9a12a2174 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1400700 1 -- 172.21.15.81:0/2046169030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400e070 con 0x7f4cc415b700 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1400700 1 -- 172.21.15.81:0/2046169030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb400b9c0 con 0x7f4cc415b700 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.460+0000 7f4cc1400700 1 -- 172.21.15.81:0/2046169030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400bd70 con 0x7f4cc415b700 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 -- 172.21.15.81:0/2046169030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc415b700 msgr2=0x7f4cc415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc415b700 0x7f4cc415bae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4cc40722a0 tx=0x7f4cb400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:42.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 -- 172.21.15.81:0/2046169030 shutdown_connections 2024-09-13T18:48:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 --2- 172.21.15.81:0/2046169030 >> v2:172.21.15.178:3300/0 conn(0x7f4cc406a5d0 0x7f4cc406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 --2- 172.21.15.81:0/2046169030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc415b700 0x7f4cc415bae0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 -- 172.21.15.81:0/2046169030 >> 172.21.15.81:0/2046169030 conn(0x7f4cc40b08d0 msgr2=0x7f4cc40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 -- 172.21.15.81:0/2046169030 shutdown_connections 2024-09-13T18:48:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 -- 172.21.15.81:0/2046169030 wait complete. 2024-09-13T18:48:42.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 Processor -- start 2024-09-13T18:48:42.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.464+0000 7f4cc9000700 1 -- start start 2024-09-13T18:48:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 0x7f4cc4150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc41e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cc415b700 0x7f4cc41e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4071e80 con 0x7f4cc406a5d0 2024-09-13T18:48:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4150af0 con 0x7f4cc415b700 2024-09-13T18:48:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40ad470 con 0x7f4cc406c460 2024-09-13T18:48:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 0x7f4cc4150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 0x7f4cc4150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60624/0 (socket says 172.21.15.81:60624) 2024-09-13T18:48:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 -- 172.21.15.81:0/3580795777 learned_addr learned my addr 172.21.15.81:0/3580795777 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc2800700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cc415b700 0x7f4cc41e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cb9400700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc41e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 -- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 msgr2=0x7f4cc41e6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc41e6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 -- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cc415b700 msgr2=0x7f4cc41e65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cc415b700 0x7f4cc41e65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 -- 172.21.15.81:0/3580795777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4009b30 con 0x7f4cc406a5d0 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc1e00700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 0x7f4cc4150010 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400b370 tx=0x7f4cb4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004350 con 0x7f4cc406a5d0 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb40044b0 con 0x7f4cc406a5d0 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc40ad750 con 0x7f4cc406a5d0 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004860 con 0x7f4cc406a5d0 2024-09-13T18:48:42.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc40add10 con 0x7f4cc406a5d0 2024-09-13T18:48:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.468+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc406caa0 con 0x7f4cc406a5d0 2024-09-13T18:48:42.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.472+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4cb401b430 con 0x7f4cc406a5d0 2024-09-13T18:48:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.472+0000 7f4cbaa00700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ca0066730 0x7f4ca0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.472+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4cb4085640 con 0x7f4cc406a5d0 2024-09-13T18:48:42.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.472+0000 7f4cb9400700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ca0066730 0x7f4ca0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.476+0000 7f4cb9400700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ca0066730 0x7f4ca0068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4152a40 tx=0x7f4cac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.480+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4cb4052860 con 0x7f4cc406a5d0 2024-09-13T18:48:42.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:42.607 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:42.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.680+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cc406c240 con 0x7f4cc406a5d0 2024-09-13T18:48:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cbaa00700 1 -- 172.21.15.81:0/3580795777 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f4cb4055e80 con 0x7f4cc406a5d0 2024-09-13T18:48:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:42.695 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:42.241250+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ca0066730 msgr2=0x7f4ca0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ca0066730 0x7f4ca0068bf0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4152a40 tx=0x7f4cac008040 comp rx=0 tx=0).stop 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 msgr2=0x7f4cc4150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 0x7f4cc4150010 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400b370 tx=0x7f4cb4004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 shutdown_connections 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ca0066730 0x7f4ca0068bf0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cc415b700 0x7f4cc41e65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cc406c460 0x7f4cc41e6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 --2- 172.21.15.81:0/3580795777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc406a5d0 0x7f4cc4150010 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 >> 172.21.15.81:0/3580795777 conn(0x7f4cc40b08d0 msgr2=0x7f4cc40ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 shutdown_connections 2024-09-13T18:48:42.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.684+0000 7f4cc9000700 1 -- 172.21.15.81:0/3580795777 wait complete. 2024-09-13T18:48:42.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.936+0000 7fe9a7200700 1 Processor -- start 2024-09-13T18:48:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.936+0000 7fe9a7200700 1 -- start start 2024-09-13T18:48:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.936+0000 7fe9a7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9a8161150 0x7fe9a80cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a806aaa0 0x7fe9a80ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a80cb1a0 con 0x7fe9a80cc740 2024-09-13T18:48:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a80cb440 con 0x7fe9a8161150 2024-09-13T18:48:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80cb720 con 0x7fe9a806aaa0 2024-09-13T18:48:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9a8161150 0x7fe9a80cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe9a8161150 0x7fe9a80cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60640/0 (socket says 172.21.15.81:60640) 2024-09-13T18:48:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 -- 172.21.15.81:0/1184351761 learned_addr learned my addr 172.21.15.81:0/1184351761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a6800700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a806aaa0 0x7fe9a80ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 -- 172.21.15.81:0/1184351761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a806aaa0 msgr2=0x7fe9a80ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a806aaa0 0x7fe9a80ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 -- 172.21.15.81:0/1184351761 >> v1:172.21.15.178:6789/0 conn(0x7fe9a80cc740 legacy=0x7fe9a806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 -- 172.21.15.81:0/1184351761 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a80cba00 con 0x7fe9a8161150 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a6800700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a806aaa0 0x7fe9a80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:42.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a5e00700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8161150 0x7fe9a80cc200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe998009910 tx=0x7fe998009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfa53b93934e1f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a4a00700 1 -- 172.21.15.81:0/1184351761 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800ba60 con 0x7fe9a8161150 2024-09-13T18:48:42.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a4a00700 1 -- 172.21.15.81:0/1184351761 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99800bbc0 con 0x7fe9a8161150 2024-09-13T18:48:42.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a4a00700 1 -- 172.21.15.81:0/1184351761 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998009e60 con 0x7fe9a8161150 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 -- 172.21.15.81:0/1184351761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8161150 msgr2=0x7fe9a80cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8161150 0x7fe9a80cc200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe998009910 tx=0x7fe998009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 -- 172.21.15.81:0/1184351761 shutdown_connections 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a806aaa0 0x7fe9a80ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 --2- 172.21.15.81:0/1184351761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a8161150 0x7fe9a80cc200 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.940+0000 7fe9a7200700 1 -- 172.21.15.81:0/1184351761 >> 172.21.15.81:0/1184351761 conn(0x7fe9a8071f00 msgr2=0x7fe9a80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.944+0000 7fe9a7200700 1 -- 172.21.15.81:0/1184351761 shutdown_connections 2024-09-13T18:48:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.944+0000 7fe9a7200700 1 -- 172.21.15.81:0/1184351761 wait complete. 2024-09-13T18:48:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.944+0000 7fe9a7200700 1 Processor -- start 2024-09-13T18:48:42.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 -- start start 2024-09-13T18:48:42.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 0x7fe9a8162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cc740 0x7fe9a81626d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8161150 0x7fe9a81f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81f72b0 con 0x7fe9a806aaa0 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81f7590 con 0x7fe9a8161150 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a81f7870 con 0x7fe9a80cc740 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 0x7fe9a8162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 0x7fe9a8162190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60656/0 (socket says 172.21.15.81:60656) 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 -- 172.21.15.81:0/3068814386 learned_addr learned my addr 172.21.15.81:0/3068814386 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5400700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cc740 0x7fe9a81626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a6800700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8161150 0x7fe9a81f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 -- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cc740 msgr2=0x7fe9a81626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cc740 0x7fe9a81626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 -- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8161150 msgr2=0x7fe9a81f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:42.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8161150 0x7fe9a81f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 -- 172.21.15.81:0/3068814386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998009570 con 0x7fe9a806aaa0 2024-09-13T18:48:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a6800700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8161150 0x7fe9a81f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe9a5e00700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 0x7fe9a8162190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe998014040 tx=0x7fe998004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9980036c0 con 0x7fe9a806aaa0 2024-09-13T18:48:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99801e070 con 0x7fe9a806aaa0 2024-09-13T18:48:42.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.948+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998003a80 con 0x7fe9a806aaa0 2024-09-13T18:48:42.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.952+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a81f7e50 con 0x7fe9a806aaa0 2024-09-13T18:48:42.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.952+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a81f9fa0 con 0x7fe9a806aaa0 2024-09-13T18:48:42.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.952+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a81f8040 con 0x7fe9a806aaa0 2024-09-13T18:48:42.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.952+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe998003be0 con 0x7fe9a806aaa0 2024-09-13T18:48:42.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.956+0000 7fe99e000700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe988066730 0x7fe988068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:42.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.956+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe998020070 con 0x7fe9a806aaa0 2024-09-13T18:48:42.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.956+0000 7fe9a5400700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe988066730 0x7fe988068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:42.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.956+0000 7fe9a5400700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe988066730 0x7fe988068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9a806d460 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:42.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:42.964+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe998052ad0 con 0x7fe9a806aaa0 2024-09-13T18:48:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.152+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9a80ccdb0 con 0x7fe9a806aaa0 2024-09-13T18:48:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe99e000700 1 -- 172.21.15.81:0/3068814386 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16787 (secure 0 0 0) 0x7fe998015090 con 0x7fe9a806aaa0 2024-09-13T18:48:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:43.163 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:42.241250+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe988066730 msgr2=0x7fe988068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe988066730 0x7fe988068bf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe9a806d460 tx=0x7fe994009040 comp rx=0 tx=0).stop 2024-09-13T18:48:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 msgr2=0x7fe9a8162190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 0x7fe9a8162190 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe998014040 tx=0x7fe998004770 comp rx=0 tx=0).stop 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 shutdown_connections 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe988066730 0x7fe988068bf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9a8161150 0x7fe9a81f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9a80cc740 0x7fe9a81626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 --2- 172.21.15.81:0/3068814386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9a806aaa0 0x7fe9a8162190 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 >> 172.21.15.81:0/3068814386 conn(0x7fe9a8071f00 msgr2=0x7fe9a80cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 shutdown_connections 2024-09-13T18:48:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.156+0000 7fe9a7200700 1 -- 172.21.15.81:0/3068814386 wait complete. 2024-09-13T18:48:43.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:48:43.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.364+0000 7f938fc00700 1 Processor -- start 2024-09-13T18:48:43.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.364+0000 7f938fc00700 1 -- start start 2024-09-13T18:48:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f938815e500 0x7f938815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f938806d6b0 0x7f938806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938815b2a0 con 0x7f938815a980 2024-09-13T18:48:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938815f430 con 0x7f938815e500 2024-09-13T18:48:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938815c6f0 con 0x7f938806d6b0 2024-09-13T18:48:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938d200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f938815a980 0x7f938815bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46522/0 (socket says 172.21.15.81:46522) 2024-09-13T18:48:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938d200700 1 -- 172.21.15.81:0/3374267342 learned_addr learned my addr 172.21.15.81:0/3374267342 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f938815e500 0x7f938815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938dc00700 1 --2- 172.21.15.81:0/3374267342 >> v2:172.21.15.178:3300/0 conn(0x7f938806d6b0 0x7f938806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387e00700 1 -- 172.21.15.81:0/3374267342 >> v2:172.21.15.178:3300/0 conn(0x7f938806d6b0 msgr2=0x7f938806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387e00700 1 --2- 172.21.15.81:0/3374267342 >> v2:172.21.15.178:3300/0 conn(0x7f938806d6b0 0x7f938806dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387e00700 1 -- 172.21.15.81:0/3374267342 >> v1:172.21.15.81:6789/0 conn(0x7f938815a980 legacy=0x7f938815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387e00700 1 -- 172.21.15.81:0/3374267342 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93880ad5a0 con 0x7f938815e500 2024-09-13T18:48:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387e00700 1 --2- 172.21.15.81:0/3374267342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f938815ad60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f938809d0b0 tx=0x7f9374009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a6fe01ee417adf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387400700 1 -- 172.21.15.81:0/3374267342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374011830 con 0x7f938815e500 2024-09-13T18:48:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387400700 1 -- 172.21.15.81:0/3374267342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9374011990 con 0x7f938815e500 2024-09-13T18:48:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f9387400700 1 -- 172.21.15.81:0/3374267342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374011d40 con 0x7f938815e500 2024-09-13T18:48:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- 172.21.15.81:0/3374267342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 msgr2=0x7f938815ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 --2- 172.21.15.81:0/3374267342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f938815ad60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f938809d0b0 tx=0x7f9374009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- 172.21.15.81:0/3374267342 shutdown_connections 2024-09-13T18:48:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 --2- 172.21.15.81:0/3374267342 >> v2:172.21.15.178:3300/0 conn(0x7f938806d6b0 0x7f938806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 --2- 172.21.15.81:0/3374267342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f938815ad60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- 172.21.15.81:0/3374267342 >> 172.21.15.81:0/3374267342 conn(0x7f93880cedd0 msgr2=0x7f93880cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:43.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- 172.21.15.81:0/3374267342 shutdown_connections 2024-09-13T18:48:43.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.368+0000 7f938fc00700 1 -- 172.21.15.81:0/3374267342 wait complete. 2024-09-13T18:48:43.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 Processor -- start 2024-09-13T18:48:43.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 -- start start 2024-09-13T18:48:43.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938806d6b0 0x7f9388152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:43.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938815a980 0x7f93881519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:43.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f93880adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:43.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938809a6b0 con 0x7f938815e500 2024-09-13T18:48:43.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93880cc270 con 0x7f938806d6b0 2024-09-13T18:48:43.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938fc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93880cc7f0 con 0x7f938815a980 2024-09-13T18:48:43.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f93880adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:43.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938806d6b0 0x7f9388152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:43.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f93880adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60666/0 (socket says 172.21.15.81:60666) 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938806d6b0 0x7f9388152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:56180/0 (socket says 172.21.15.81:56180) 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 -- 172.21.15.81:0/1840978484 learned_addr learned my addr 172.21.15.81:0/1840978484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f9387e00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938815a980 0x7f93881519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 -- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938815a980 msgr2=0x7f93881519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938815a980 0x7f93881519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 -- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938806d6b0 msgr2=0x7f9388152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938806d6b0 0x7f9388152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.372+0000 7f938dc00700 1 -- 172.21.15.81:0/1840978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93740094b0 con 0x7f938815e500 2024-09-13T18:48:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f938dc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f93880adcb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9380007e40 tx=0x7f938000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938000ed30 con 0x7f938815e500 2024-09-13T18:48:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93880cc510 con 0x7f938815e500 2024-09-13T18:48:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380014420 con 0x7f938815e500 2024-09-13T18:48:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93800147d0 con 0x7f938815e500 2024-09-13T18:48:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9388151f30 con 0x7f938815e500 2024-09-13T18:48:43.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938809a820 con 0x7f938815e500 2024-09-13T18:48:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.376+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9380014930 con 0x7f938815e500 2024-09-13T18:48:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.380+0000 7f9384c00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9368066760 0x7f9368068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.380+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9380084a20 con 0x7f938815e500 2024-09-13T18:48:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.380+0000 7f938d200700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9368066760 0x7f9368068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:43.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.380+0000 7f938d200700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9368066760 0x7f9368068c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f937c000f60 tx=0x7f937c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.388+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9380051bd0 con 0x7f938815e500 2024-09-13T18:48:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:43.608+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f938815f150 con 0x7f938815e500 2024-09-13T18:48:44.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.264+0000 7f9384c00700 1 -- 172.21.15.81:0/1840978484 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f93800551f0 con 0x7f938815e500 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9368066760 msgr2=0x7f9368068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9368066760 0x7f9368068c20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f937c000f60 tx=0x7f937c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 msgr2=0x7f93880adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f93880adcb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9380007e40 tx=0x7f938000e3c0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 shutdown_connections 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9368066760 0x7f9368068c20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f938815e500 0x7f93880adcb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938815a980 0x7f93881519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 --2- 172.21.15.81:0/1840978484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938806d6b0 0x7f9388152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 >> 172.21.15.81:0/1840978484 conn(0x7f93880cedd0 msgr2=0x7f93880aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:44.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 shutdown_connections 2024-09-13T18:48:44.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.268+0000 7f938fc00700 1 -- 172.21.15.81:0/1840978484 wait complete. 2024-09-13T18:48:44.298 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:48:44.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:48:44.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 Processor -- start 2024-09-13T18:48:44.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 -- start start 2024-09-13T18:48:44.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa73c15ca20 0x7fa73c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:44.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa73c06ada0 0x7fa73c06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:44.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c06b710 con 0x7fa73c06cd80 2024-09-13T18:48:44.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0b4a20 con 0x7fa73c15ca20 2024-09-13T18:48:44.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa741c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c160680 con 0x7fa73c06ada0 2024-09-13T18:48:44.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa73be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa73c15ca20 0x7fa73c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa73be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa73c15ca20 0x7fa73c15ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60682/0 (socket says 172.21.15.81:60682) 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.472+0000 7fa73be00700 1 -- 172.21.15.81:0/1951218274 learned_addr learned my addr 172.21.15.81:0/1951218274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741200700 1 --2- 172.21.15.81:0/1951218274 >> v2:172.21.15.178:3300/0 conn(0x7fa73c06ada0 0x7fa73c06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73be00700 1 -- 172.21.15.81:0/1951218274 >> v2:172.21.15.178:3300/0 conn(0x7fa73c06ada0 msgr2=0x7fa73c06b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73be00700 1 --2- 172.21.15.81:0/1951218274 >> v2:172.21.15.178:3300/0 conn(0x7fa73c06ada0 0x7fa73c06b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73be00700 1 -- 172.21.15.81:0/1951218274 >> v1:172.21.15.178:6789/0 conn(0x7fa73c06cd80 legacy=0x7fa73c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:44.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73be00700 1 -- 172.21.15.81:0/1951218274 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c15d670 con 0x7fa73c15ca20 2024-09-13T18:48:44.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741200700 1 --2- 172.21.15.81:0/1951218274 >> v2:172.21.15.178:3300/0 conn(0x7fa73c06ada0 0x7fa73c06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:44.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73be00700 1 --2- 172.21.15.81:0/1951218274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c15ca20 0x7fa73c15ce00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0b3290 tx=0x7fa72c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ef091e46c3fc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:44.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73aa00700 1 -- 172.21.15.81:0/1951218274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00b8a0 con 0x7fa73c15ca20 2024-09-13T18:48:44.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73aa00700 1 -- 172.21.15.81:0/1951218274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00ba00 con 0x7fa73c15ca20 2024-09-13T18:48:44.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa73aa00700 1 -- 172.21.15.81:0/1951218274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00bd90 con 0x7fa73c15ca20 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 -- 172.21.15.81:0/1951218274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c15ca20 msgr2=0x7fa73c15ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 --2- 172.21.15.81:0/1951218274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c15ca20 0x7fa73c15ce00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0b3290 tx=0x7fa72c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 -- 172.21.15.81:0/1951218274 shutdown_connections 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 --2- 172.21.15.81:0/1951218274 >> v2:172.21.15.178:3300/0 conn(0x7fa73c06ada0 0x7fa73c06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 --2- 172.21.15.81:0/1951218274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c15ca20 0x7fa73c15ce00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 -- 172.21.15.81:0/1951218274 >> 172.21.15.81:0/1951218274 conn(0x7fa73c071d20 msgr2=0x7fa73c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 -- 172.21.15.81:0/1951218274 shutdown_connections 2024-09-13T18:48:44.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.476+0000 7fa741c00700 1 -- 172.21.15.81:0/1951218274 wait complete. 2024-09-13T18:48:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 Processor -- start 2024-09-13T18:48:44.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 -- start start 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c06ada0 0x7fa73c0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 0x7fa73c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa73c15ca20 0x7fa73c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0cf5f0 con 0x7fa73c06cd80 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0cf8d0 con 0x7fa73c06ada0 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.480+0000 7fa741c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0cfbb0 con 0x7fa73c15ca20 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 0x7fa73c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 0x7fa73c147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60692/0 (socket says 172.21.15.81:60692) 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 -- 172.21.15.81:0/187681449 learned_addr learned my addr 172.21.15.81:0/187681449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73be00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c06ada0 0x7fa73c0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa741200700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa73c15ca20 0x7fa73c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 -- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa73c15ca20 msgr2=0x7fa73c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:44.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa73c15ca20 0x7fa73c0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 -- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c06ada0 msgr2=0x7fa73c0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c06ada0 0x7fa73c0cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 -- 172.21.15.81:0/187681449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c009570 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa73b400700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 0x7fa73c147300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa72800c500 tx=0x7fa72800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280052d0 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa728005430 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0c9c30 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7280055a0 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0cf300 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.484+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c0ca150 con 0x7fa73c06cd80 2024-09-13T18:48:44.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.488+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7280038e0 con 0x7fa73c06cd80 2024-09-13T18:48:44.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.488+0000 7fa733e00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa71c066760 0x7fa71c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.488+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa7280836f0 con 0x7fa73c06cd80 2024-09-13T18:48:44.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.488+0000 7fa73be00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa71c066760 0x7fa71c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:44.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.488+0000 7fa73be00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa71c066760 0x7fa71c068c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa72c014040 tx=0x7fa72c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:44.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.492+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa73c0ca150 con 0x7fa73c06cd80 2024-09-13T18:48:44.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:44.712+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa73c0ca150 con 0x7fa73c06cd80 2024-09-13T18:48:44.753 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:48:44.744+0000 7f99e3c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:48:45.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.264+0000 7fa733e00700 1 -- 172.21.15.81:0/187681449 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa73c0ca150 con 0x7fa73c06cd80 2024-09-13T18:48:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa71c066760 msgr2=0x7fa71c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa71c066760 0x7fa71c068c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa72c014040 tx=0x7fa72c008030 comp rx=0 tx=0).stop 2024-09-13T18:48:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 msgr2=0x7fa73c147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 0x7fa73c147300 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa72800c500 tx=0x7fa72800c810 comp rx=0 tx=0).stop 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 shutdown_connections 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa71c066760 0x7fa71c068c20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa73c15ca20 0x7fa73c0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa73c06cd80 0x7fa73c147300 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 --2- 172.21.15.81:0/187681449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c06ada0 0x7fa73c0cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 >> 172.21.15.81:0/187681449 conn(0x7fa73c071d20 msgr2=0x7fa73c15bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 shutdown_connections 2024-09-13T18:48:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.268+0000 7fa741c00700 1 -- 172.21.15.81:0/187681449 wait complete. 2024-09-13T18:48:45.301 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:48:45.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:45.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.468+0000 7f193fe00700 1 Processor -- start 2024-09-13T18:48:45.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.468+0000 7f193fe00700 1 -- start start 2024-09-13T18:48:45.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f194006aaa0 0x7f194006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19400b2670 0x7f19400b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19400b3560 con 0x7f19401610b0 2024-09-13T18:48:45.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1940070b30 con 0x7f194006aaa0 2024-09-13T18:48:45.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194006b450 con 0x7f19400b2670 2024-09-13T18:48:45.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193ea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19401610b0 0x7f19400719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46524/0 (socket says 172.21.15.81:46524) 2024-09-13T18:48:45.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193ea00700 1 -- 172.21.15.81:0/3006152383 learned_addr learned my addr 172.21.15.81:0/3006152383 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:45.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193e000700 1 --2- 172.21.15.81:0/3006152383 >> v2:172.21.15.81:3300/0 conn(0x7f194006aaa0 0x7f194006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193f400700 1 --2- 172.21.15.81:0/3006152383 >> v2:172.21.15.178:3300/0 conn(0x7f19400b2670 0x7f19400b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193e000700 1 -- 172.21.15.81:0/3006152383 >> v2:172.21.15.178:3300/0 conn(0x7f19400b2670 msgr2=0x7f19400b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193e000700 1 --2- 172.21.15.81:0/3006152383 >> v2:172.21.15.178:3300/0 conn(0x7f19400b2670 0x7f19400b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193e000700 1 -- 172.21.15.81:0/3006152383 >> v1:172.21.15.81:6789/0 conn(0x7f19401610b0 legacy=0x7f19400719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193e000700 1 -- 172.21.15.81:0/3006152383 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400b3000 con 0x7f194006aaa0 2024-09-13T18:48:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193e000700 1 --2- 172.21.15.81:0/3006152383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194006aaa0 0x7f194006af10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f192c009880 tx=0x7f192c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2656462d3ad9faa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193d600700 1 -- 172.21.15.81:0/3006152383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011830 con 0x7f194006aaa0 2024-09-13T18:48:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193d600700 1 -- 172.21.15.81:0/3006152383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c011990 con 0x7f194006aaa0 2024-09-13T18:48:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193d600700 1 -- 172.21.15.81:0/3006152383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c011d20 con 0x7f194006aaa0 2024-09-13T18:48:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 -- 172.21.15.81:0/3006152383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194006aaa0 msgr2=0x7f194006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 --2- 172.21.15.81:0/3006152383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194006aaa0 0x7f194006af10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f192c009880 tx=0x7f192c009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 -- 172.21.15.81:0/3006152383 shutdown_connections 2024-09-13T18:48:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 --2- 172.21.15.81:0/3006152383 >> v2:172.21.15.178:3300/0 conn(0x7f19400b2670 0x7f19400b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 --2- 172.21.15.81:0/3006152383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194006aaa0 0x7f194006af10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.472+0000 7f193fe00700 1 -- 172.21.15.81:0/3006152383 >> 172.21.15.81:0/3006152383 conn(0x7f19400b0c40 msgr2=0x7f194006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.476+0000 7f193fe00700 1 -- 172.21.15.81:0/3006152383 shutdown_connections 2024-09-13T18:48:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.476+0000 7f193fe00700 1 -- 172.21.15.81:0/3006152383 wait complete. 2024-09-13T18:48:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.476+0000 7f193fe00700 1 Processor -- start 2024-09-13T18:48:45.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 -- start start 2024-09-13T18:48:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194006aaa0 0x7f194014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 0x7f19400a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19401610b0 0x7f19400aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194014e5c0 con 0x7f19400b2670 2024-09-13T18:48:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194014e8a0 con 0x7f194006aaa0 2024-09-13T18:48:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194014eb80 con 0x7f19401610b0 2024-09-13T18:48:45.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 0x7f19400a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 0x7f19400a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60712/0 (socket says 172.21.15.81:60712) 2024-09-13T18:48:45.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 -- 172.21.15.81:0/3462652858 learned_addr learned my addr 172.21.15.81:0/3462652858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193ea00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194006aaa0 0x7f194014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193f400700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19401610b0 0x7f19400aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 -- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19401610b0 msgr2=0x7f19400aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19401610b0 0x7f19400aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 -- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194006aaa0 msgr2=0x7f194014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194006aaa0 0x7f194014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 -- 172.21.15.81:0/3462652858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c0094b0 con 0x7f19400b2670 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193f400700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19401610b0 0x7f19400aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193ea00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194006aaa0 0x7f194014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:45.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.480+0000 7f193e000700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 0x7f19400a9eb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f192c009bd0 tx=0x7f192c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.484+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c0036c0 con 0x7f19400b2670 2024-09-13T18:48:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.484+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c01e070 con 0x7f19400b2670 2024-09-13T18:48:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.484+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c003a20 con 0x7f19400b2670 2024-09-13T18:48:45.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.484+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194014ee60 con 0x7f19400b2670 2024-09-13T18:48:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.484+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194014f420 con 0x7f19400b2670 2024-09-13T18:48:45.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.484+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194014f610 con 0x7f19400b2670 2024-09-13T18:48:45.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.488+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f192c003b80 con 0x7f19400b2670 2024-09-13T18:48:45.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.488+0000 7f1936a00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1920066730 0x7f1920068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.488+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f192c0852b0 con 0x7f19400b2670 2024-09-13T18:48:45.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.488+0000 7f193ea00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1920066730 0x7f1920068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.488+0000 7f193ea00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1920066730 0x7f1920068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1930007fd0 tx=0x7f1930009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:45.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.496+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f192c0524f0 con 0x7f19400b2670 2024-09-13T18:48:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.728+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1940161490 con 0x7f19400b2670 2024-09-13T18:48:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.728+0000 7f1936a00700 1 -- 172.21.15.81:0/3462652858 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f192c055b10 con 0x7f19400b2670 2024-09-13T18:48:45.736 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:45.736 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:48:45.260734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1920066730 msgr2=0x7f1920068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1920066730 0x7f1920068bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1930007fd0 tx=0x7f1930009040 comp rx=0 tx=0).stop 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 msgr2=0x7f19400a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 0x7f19400a9eb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f192c009bd0 tx=0x7f192c004770 comp rx=0 tx=0).stop 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 shutdown_connections 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1920066730 0x7f1920068bf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19401610b0 0x7f19400aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19400b2670 0x7f19400a9eb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 --2- 172.21.15.81:0/3462652858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194006aaa0 0x7f194014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 >> 172.21.15.81:0/3462652858 conn(0x7f19400b0c40 msgr2=0x7f194006d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:45.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 shutdown_connections 2024-09-13T18:48:45.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.732+0000 7f193fe00700 1 -- 172.21.15.81:0/3462652858 wait complete. 2024-09-13T18:48:45.741 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-13T18:48:45.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 Processor -- start 2024-09-13T18:48:45.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 -- start start 2024-09-13T18:48:45.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 0x7f13840cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f138415c2a0 0x7f138415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840b2ad0 con 0x7f138406aaa0 2024-09-13T18:48:45.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138415b960 con 0x7f138415c2a0 2024-09-13T18:48:45.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.920+0000 7f138a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138415bc40 con 0x7f13840cb020 2024-09-13T18:48:45.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 0x7f13840cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 0x7f13840cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:52598/0 (socket says 172.21.15.81:52598) 2024-09-13T18:48:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 -- 172.21.15.81:0/3908672175 learned_addr learned my addr 172.21.15.81:0/3908672175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f137be00700 1 --2- 172.21.15.81:0/3908672175 >> v2:172.21.15.178:3300/0 conn(0x7f138415c2a0 0x7f138415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 -- 172.21.15.81:0/3908672175 >> v2:172.21.15.178:3300/0 conn(0x7f138415c2a0 msgr2=0x7f138415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 --2- 172.21.15.81:0/3908672175 >> v2:172.21.15.178:3300/0 conn(0x7f138415c2a0 0x7f138415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 -- 172.21.15.81:0/3908672175 >> v1:172.21.15.178:6789/0 conn(0x7f138406aaa0 legacy=0x7f13840b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 -- 172.21.15.81:0/3908672175 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138415bf20 con 0x7f13840cb020 2024-09-13T18:48:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1388c00700 1 --2- 172.21.15.81:0/3908672175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 0x7f13840cc6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f1374009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ae63422f33a4e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1383e00700 1 -- 172.21.15.81:0/3908672175 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374011830 con 0x7f13840cb020 2024-09-13T18:48:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1383e00700 1 -- 172.21.15.81:0/3908672175 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1374011990 con 0x7f13840cb020 2024-09-13T18:48:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f1383e00700 1 -- 172.21.15.81:0/3908672175 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374011d40 con 0x7f13840cb020 2024-09-13T18:48:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f138a000700 1 -- 172.21.15.81:0/3908672175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 msgr2=0x7f13840cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.924+0000 7f138a000700 1 --2- 172.21.15.81:0/3908672175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 0x7f13840cc6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1374009910 tx=0x7f1374009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 -- 172.21.15.81:0/3908672175 shutdown_connections 2024-09-13T18:48:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 --2- 172.21.15.81:0/3908672175 >> v2:172.21.15.178:3300/0 conn(0x7f138415c2a0 0x7f138415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 --2- 172.21.15.81:0/3908672175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13840cb020 0x7f13840cc6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 -- 172.21.15.81:0/3908672175 >> 172.21.15.81:0/3908672175 conn(0x7f13840b0c40 msgr2=0x7f138406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 -- 172.21.15.81:0/3908672175 shutdown_connections 2024-09-13T18:48:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 -- 172.21.15.81:0/3908672175 wait complete. 2024-09-13T18:48:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 Processor -- start 2024-09-13T18:48:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.928+0000 7f138a000700 1 -- start start 2024-09-13T18:48:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f138406aaa0 0x7f138413a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 0x7f138413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c2a0 0x7f138413f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138413a740 con 0x7f138415c2a0 2024-09-13T18:48:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138413a8f0 con 0x7f13840cb020 2024-09-13T18:48:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138413c360 con 0x7f138406aaa0 2024-09-13T18:48:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f138406aaa0 0x7f138413a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1389600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c2a0 0x7f138413f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f137be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 0x7f138413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f137be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 0x7f138413f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:56226/0 (socket says 172.21.15.81:56226) 2024-09-13T18:48:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f137be00700 1 -- 172.21.15.81:0/3788430092 learned_addr learned my addr 172.21.15.81:0/3788430092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 -- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 msgr2=0x7f138413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 0x7f138413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 -- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c2a0 msgr2=0x7f138413f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c2a0 0x7f138413f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 -- 172.21.15.81:0/3788430092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374009570 con 0x7f138406aaa0 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f137be00700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 0x7f138413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:45.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1388c00700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f138406aaa0 0x7f138413a200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1384158cb0 tx=0x7f1374004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:45.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374004510 con 0x7f138406aaa0 2024-09-13T18:48:45.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740036c0 con 0x7f138406aaa0 2024-09-13T18:48:45.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1374003a70 con 0x7f138406aaa0 2024-09-13T18:48:45.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138413afe0 con 0x7f138406aaa0 2024-09-13T18:48:45.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.932+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138413bff0 con 0x7f138406aaa0 2024-09-13T18:48:45.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.936+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138415dfe0 con 0x7f138406aaa0 2024-09-13T18:48:45.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.936+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1374003bd0 con 0x7f138406aaa0 2024-09-13T18:48:45.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.936+0000 7f1381600700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1360066730 0x7f1360068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:45.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.936+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1374021030 con 0x7f138406aaa0 2024-09-13T18:48:45.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.936+0000 7f137be00700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1360066730 0x7f1360068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:45.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.940+0000 7f137be00700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1360066730 0x7f1360068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f136c00dfd0 tx=0x7f136c00f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:45.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:45.944+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1374052a20 con 0x7f138406aaa0 2024-09-13T18:48:46.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.136+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f138413c180 con 0x7f138406aaa0 2024-09-13T18:48:46.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.140+0000 7f1381600700 1 -- 172.21.15.81:0/3788430092 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f1374056040 con 0x7f138406aaa0 2024-09-13T18:48:46.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:46.149 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:43.247419+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1360066730 msgr2=0x7f1360068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1360066730 0x7f1360068bf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f136c00dfd0 tx=0x7f136c00f040 comp rx=0 tx=0).stop 2024-09-13T18:48:46.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f138406aaa0 msgr2=0x7f138413a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f138406aaa0 0x7f138413a200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1384158cb0 tx=0x7f1374004770 comp rx=0 tx=0).stop 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 shutdown_connections 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1360066730 0x7f1360068bf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c2a0 0x7f138413f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13840cb020 0x7f138413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 --2- 172.21.15.81:0/3788430092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f138406aaa0 0x7f138413a200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 >> 172.21.15.81:0/3788430092 conn(0x7f13840b0c40 msgr2=0x7f138415d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 shutdown_connections 2024-09-13T18:48:46.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.144+0000 7f138a000700 1 -- 172.21.15.81:0/3788430092 wait complete. 2024-09-13T18:48:46.173 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:48:46.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.340+0000 7fb7d3800700 1 Processor -- start 2024-09-13T18:48:46.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.340+0000 7fb7d3800700 1 -- start start 2024-09-13T18:48:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d3800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc15b700 0x7fb7cc15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d3800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7cc06a5d0 0x7fb7cc06aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d3800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7cc0cdd90 con 0x7fb7cc06c460 2024-09-13T18:48:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d3800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7cc06afc0 con 0x7fb7cc06a5d0 2024-09-13T18:48:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d3800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc06ce10 con 0x7fb7cc15b700 2024-09-13T18:48:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7cc06a5d0 0x7fb7cc06aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7cc06a5d0 0x7fb7cc06aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60724/0 (socket says 172.21.15.81:60724) 2024-09-13T18:48:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 -- 172.21.15.81:0/2116882595 learned_addr learned my addr 172.21.15.81:0/2116882595 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:46.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d0e00700 1 --2- 172.21.15.81:0/2116882595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc15b700 0x7fb7cc15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 -- 172.21.15.81:0/2116882595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc15b700 msgr2=0x7fb7cc15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 --2- 172.21.15.81:0/2116882595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc15b700 0x7fb7cc15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 -- 172.21.15.81:0/2116882595 >> v1:172.21.15.178:6789/0 conn(0x7fb7cc06c460 legacy=0x7fb7cc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 -- 172.21.15.81:0/2116882595 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc15c020 con 0x7fb7cc06a5d0 2024-09-13T18:48:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7cb400700 1 -- 172.21.15.81:0/2116882595 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085800843 0 0) 0x7fb7cc0cdd90 con 0x7fb7cc06c460 2024-09-13T18:48:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.344+0000 7fb7d1800700 1 --2- 172.21.15.81:0/2116882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc06a5d0 0x7fb7cc06aa80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009910 tx=0x7fb7c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390b7a7c5cffdb4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7cb400700 1 -- 172.21.15.81:0/2116882595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4011830 con 0x7fb7cc06a5d0 2024-09-13T18:48:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7cb400700 1 -- 172.21.15.81:0/2116882595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4011990 con 0x7fb7cc06a5d0 2024-09-13T18:48:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7cb400700 1 -- 172.21.15.81:0/2116882595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4011d40 con 0x7fb7cc06a5d0 2024-09-13T18:48:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 -- 172.21.15.81:0/2116882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc06a5d0 msgr2=0x7fb7cc06aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 --2- 172.21.15.81:0/2116882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc06a5d0 0x7fb7cc06aa80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009910 tx=0x7fb7c4009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:46.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 -- 172.21.15.81:0/2116882595 shutdown_connections 2024-09-13T18:48:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 --2- 172.21.15.81:0/2116882595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc06a5d0 0x7fb7cc06aa80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 --2- 172.21.15.81:0/2116882595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc15b700 0x7fb7cc15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 -- 172.21.15.81:0/2116882595 >> 172.21.15.81:0/2116882595 conn(0x7fb7cc0b08d0 msgr2=0x7fb7cc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 -- 172.21.15.81:0/2116882595 shutdown_connections 2024-09-13T18:48:46.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.348+0000 7fb7d3800700 1 -- 172.21.15.81:0/2116882595 wait complete. 2024-09-13T18:48:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 Processor -- start 2024-09-13T18:48:46.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 -- start start 2024-09-13T18:48:46.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc06a5d0 0x7fb7cc070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7cc06c460 0x7fb7cc159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 0x7fb7cc0716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc06ff50 con 0x7fb7cc15b700 2024-09-13T18:48:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0701f0 con 0x7fb7cc06c460 2024-09-13T18:48:46.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.352+0000 7fb7d3800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7cc0704d0 con 0x7fb7cc06a5d0 2024-09-13T18:48:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 0x7fb7cc0716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 0x7fb7cc0716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60732/0 (socket says 172.21.15.81:60732) 2024-09-13T18:48:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 -- 172.21.15.81:0/4246041334 learned_addr learned my addr 172.21.15.81:0/4246041334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d0e00700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc06a5d0 0x7fb7cc070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7cbe00700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7cc06c460 0x7fb7cc159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 -- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc06a5d0 msgr2=0x7fb7cc070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc06a5d0 0x7fb7cc070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 -- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7cc06c460 msgr2=0x7fb7cc159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7cc06c460 0x7fb7cc159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 -- 172.21.15.81:0/4246041334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c4009570 con 0x7fb7cc15b700 2024-09-13T18:48:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d1800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 0x7fb7cc0716d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009f70 tx=0x7fb7c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4004590 con 0x7fb7cc15b700 2024-09-13T18:48:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c40036c0 con 0x7fb7cc15b700 2024-09-13T18:48:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7cc0707b0 con 0x7fb7cc15b700 2024-09-13T18:48:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c4003a50 con 0x7fb7cc15b700 2024-09-13T18:48:46.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.356+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7cc0a8640 con 0x7fb7cc15b700 2024-09-13T18:48:46.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.360+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7cc070c70 con 0x7fb7cc15b700 2024-09-13T18:48:46.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.360+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7c4021070 con 0x7fb7cc15b700 2024-09-13T18:48:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.364+0000 7fb7c8c00700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7ac066730 0x7fb7ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.364+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb7c4085630 con 0x7fb7cc15b700 2024-09-13T18:48:46.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.364+0000 7fb7d0e00700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7ac066730 0x7fb7ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.364+0000 7fb7d0e00700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7ac066730 0x7fb7ac068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0011340 tx=0x7fb7c000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.368+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7c4052970 con 0x7fb7cc15b700 2024-09-13T18:48:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.556+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7cc0cdab0 con 0x7fb7ac066730 2024-09-13T18:48:46.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.564+0000 7fb7c8c00700 1 -- 172.21.15.81:0/4246041334 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286311 (secure 0 0 0) 0x7fb7c000f040 con 0x7fb7ac066730 2024-09-13T18:48:46.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.572+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7ac066730 msgr2=0x7fb7ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.572+0000 7fb7d3800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7ac066730 0x7fb7ac068bf0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0011340 tx=0x7fb7c000b040 comp rx=0 tx=0).stop 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.572+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 msgr2=0x7fb7cc0716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.572+0000 7fb7d3800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 0x7fb7cc0716d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009f70 tx=0x7fb7c4004770 comp rx=0 tx=0).stop 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.572+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 shutdown_connections 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7ac066730 0x7fb7ac068bf0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7cc15b700 0x7fb7cc0716d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7cc06c460 0x7fb7cc159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 --2- 172.21.15.81:0/4246041334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7cc06a5d0 0x7fb7cc070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 >> 172.21.15.81:0/4246041334 conn(0x7fb7cc0b08d0 msgr2=0x7fb7cc0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 shutdown_connections 2024-09-13T18:48:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.576+0000 7fb7d3800700 1 -- 172.21.15.81:0/4246041334 wait complete. 2024-09-13T18:48:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:48:46.605 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-13T18:48:44.999014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233104,"kb_used_data":4604,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754741616,"statfs":{"total":773094113280,"available":772855414784,"internally_reserved":0,"allocated":4714496,"data_stored":2675093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":233819707},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.222719"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284837+0000","last_change":"2024-09-13T18:48:42.281113+0000","last_active":"2024-09-13T18:48:42.284837+0000","last_peered":"2024-09-13T18:48:42.284837+0000","last_clean":"2024-09-13T18:48:42.284837+0000","last_became_active":"2024-09-13T18:48:42.280857+0000","last_became_peered":"2024-09-13T18:48:42.280857+0000","last_unstale":"2024-09-13T18:48:42.284837+0000","last_undegraded":"2024-09-13T18:48:42.284837+0000","last_fullsized":"2024-09-13T18:48:42.284837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:59.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284187+0000","last_change":"2024-09-13T18:48:42.278290+0000","last_active":"2024-09-13T18:48:42.284187+0000","last_peered":"2024-09-13T18:48:42.284187+0000","last_clean":"2024-09-13T18:48:42.284187+0000","last_became_active":"2024-09-13T18:48:42.278061+0000","last_became_peered":"2024-09-13T18:48:42.278061+0000","last_unstale":"2024-09-13T18:48:42.284187+0000","last_undegraded":"2024-09-13T18:48:42.284187+0000","last_fullsized":"2024-09-13T18:48:42.284187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:09.097929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279115+0000","last_change":"2024-09-13T18:48:42.273535+0000","last_active":"2024-09-13T18:48:42.279115+0000","last_peered":"2024-09-13T18:48:42.279115+0000","last_clean":"2024-09-13T18:48:42.279115+0000","last_became_active":"2024-09-13T18:48:42.273277+0000","last_became_peered":"2024-09-13T18:48:42.273277+0000","last_unstale":"2024-09-13T18:48:42.279115+0000","last_undegraded":"2024-09-13T18:48:42.279115+0000","last_fullsized":"2024-09-13T18:48:42.279115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.285277+0000","last_change":"2024-09-13T18:48:42.282021+0000","last_active":"2024-09-13T18:48:42.285277+0000","last_peered":"2024-09-13T18:48:42.285277+0000","last_clean":"2024-09-13T18:48:42.285277+0000","last_became_active":"2024-09-13T18:48:42.281767+0000","last_became_peered":"2024-09-13T18:48:42.281767+0000","last_unstale":"2024-09-13T18:48:42.285277+0000","last_undegraded":"2024-09-13T18:48:42.285277+0000","last_fullsized":"2024-09-13T18:48:42.285277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:00.596192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284693+0000","last_change":"2024-09-13T18:48:42.279997+0000","last_active":"2024-09-13T18:48:42.284693+0000","last_peered":"2024-09-13T18:48:42.284693+0000","last_clean":"2024-09-13T18:48:42.284693+0000","last_became_active":"2024-09-13T18:48:42.279739+0000","last_became_peered":"2024-09-13T18:48:42.279739+0000","last_unstale":"2024-09-13T18:48:42.284693+0000","last_undegraded":"2024-09-13T18:48:42.284693+0000","last_fullsized":"2024-09-13T18:48:42.284693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:47.903325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.281725+0000","last_change":"2024-09-13T18:48:42.274305+0000","last_active":"2024-09-13T18:48:42.281725+0000","last_peered":"2024-09-13T18:48:42.281725+0000","last_clean":"2024-09-13T18:48:42.281725+0000","last_became_active":"2024-09-13T18:48:42.274082+0000","last_became_peered":"2024-09-13T18:48:42.274082+0000","last_unstale":"2024-09-13T18:48:42.281725+0000","last_undegraded":"2024-09-13T18:48:42.281725+0000","last_fullsized":"2024-09-13T18:48:42.281725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:13.280109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286825+0000","last_change":"2024-09-13T18:48:42.274454+0000","last_active":"2024-09-13T18:48:42.286825+0000","last_peered":"2024-09-13T18:48:42.286825+0000","last_clean":"2024-09-13T18:48:42.286825+0000","last_became_active":"2024-09-13T18:48:42.273141+0000","last_became_peered":"2024-09-13T18:48:42.273141+0000","last_unstale":"2024-09-13T18:48:42.286825+0000","last_undegraded":"2024-09-13T18:48:42.286825+0000","last_fullsized":"2024-09-13T18:48:42.286825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.752921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280090+0000","last_change":"2024-09-13T18:48:42.274523+0000","last_active":"2024-09-13T18:48:42.280090+0000","last_peered":"2024-09-13T18:48:42.280090+0000","last_clean":"2024-09-13T18:48:42.280090+0000","last_became_active":"2024-09-13T18:48:42.274269+0000","last_became_peered":"2024-09-13T18:48:42.274269+0000","last_unstale":"2024-09-13T18:48:42.280090+0000","last_undegraded":"2024-09-13T18:48:42.280090+0000","last_fullsized":"2024-09-13T18:48:42.280090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:16.273448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286659+0000","last_change":"2024-09-13T18:48:42.284838+0000","last_active":"2024-09-13T18:48:42.286659+0000","last_peered":"2024-09-13T18:48:42.286659+0000","last_clean":"2024-09-13T18:48:42.286659+0000","last_became_active":"2024-09-13T18:48:42.284616+0000","last_became_peered":"2024-09-13T18:48:42.284616+0000","last_unstale":"2024-09-13T18:48:42.286659+0000","last_undegraded":"2024-09-13T18:48:42.286659+0000","last_fullsized":"2024-09-13T18:48:42.286659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295274+0000","last_change":"2024-09-13T18:48:42.292479+0000","last_active":"2024-09-13T18:48:42.295274+0000","last_peered":"2024-09-13T18:48:42.295274+0000","last_clean":"2024-09-13T18:48:42.295274+0000","last_became_active":"2024-09-13T18:48:42.292186+0000","last_became_peered":"2024-09-13T18:48:42.292186+0000","last_unstale":"2024-09-13T18:48:42.295274+0000","last_undegraded":"2024-09-13T18:48:42.295274+0000","last_fullsized":"2024-09-13T18:48:42.295274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:25.509854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.296444+0000","last_change":"2024-09-13T18:48:42.291726+0000","last_active":"2024-09-13T18:48:42.296444+0000","last_peered":"2024-09-13T18:48:42.296444+0000","last_clean":"2024-09-13T18:48:42.296444+0000","last_became_active":"2024-09-13T18:48:42.287695+0000","last_became_peered":"2024-09-13T18:48:42.287695+0000","last_unstale":"2024-09-13T18:48:42.296444+0000","last_undegraded":"2024-09-13T18:48:42.296444+0000","last_fullsized":"2024-09-13T18:48:42.296444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.266113+0000","last_change":"2024-09-13T18:48:42.264125+0000","last_active":"2024-09-13T18:48:42.266113+0000","last_peered":"2024-09-13T18:48:42.266113+0000","last_clean":"2024-09-13T18:48:42.266113+0000","last_became_active":"2024-09-13T18:48:42.263707+0000","last_became_peered":"2024-09-13T18:48:42.263707+0000","last_unstale":"2024-09-13T18:48:42.266113+0000","last_undegraded":"2024-09-13T18:48:42.266113+0000","last_fullsized":"2024-09-13T18:48:42.266113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:04.196002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295910+0000","last_change":"2024-09-13T18:48:42.294690+0000","last_active":"2024-09-13T18:48:42.295910+0000","last_peered":"2024-09-13T18:48:42.295910+0000","last_clean":"2024-09-13T18:48:42.295910+0000","last_became_active":"2024-09-13T18:48:42.293298+0000","last_became_peered":"2024-09-13T18:48:42.293298+0000","last_unstale":"2024-09-13T18:48:42.295910+0000","last_undegraded":"2024-09-13T18:48:42.295910+0000","last_fullsized":"2024-09-13T18:48:42.295910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284330+0000","last_change":"2024-09-13T18:48:42.277143+0000","last_active":"2024-09-13T18:48:42.284330+0000","last_peered":"2024-09-13T18:48:42.284330+0000","last_clean":"2024-09-13T18:48:42.284330+0000","last_became_active":"2024-09-13T18:48:42.276865+0000","last_became_peered":"2024-09-13T18:48:42.276865+0000","last_unstale":"2024-09-13T18:48:42.284330+0000","last_undegraded":"2024-09-13T18:48:42.284330+0000","last_fullsized":"2024-09-13T18:48:42.284330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:01.079912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293401+0000","last_change":"2024-09-13T18:48:42.286663+0000","last_active":"2024-09-13T18:48:42.293401+0000","last_peered":"2024-09-13T18:48:42.293401+0000","last_clean":"2024-09-13T18:48:42.293401+0000","last_became_active":"2024-09-13T18:48:42.279817+0000","last_became_peered":"2024-09-13T18:48:42.279817+0000","last_unstale":"2024-09-13T18:48:42.293401+0000","last_undegraded":"2024-09-13T18:48:42.293401+0000","last_fullsized":"2024-09-13T18:48:42.293401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:14.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291151+0000","last_change":"2024-09-13T18:48:42.286186+0000","last_active":"2024-09-13T18:48:42.291151+0000","last_peered":"2024-09-13T18:48:42.291151+0000","last_clean":"2024-09-13T18:48:42.291151+0000","last_became_active":"2024-09-13T18:48:42.283323+0000","last_became_peered":"2024-09-13T18:48:42.283323+0000","last_unstale":"2024-09-13T18:48:42.291151+0000","last_undegraded":"2024-09-13T18:48:42.291151+0000","last_fullsized":"2024-09-13T18:48:42.291151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:50.137504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291944+0000","last_change":"2024-09-13T18:48:42.288314+0000","last_active":"2024-09-13T18:48:42.291944+0000","last_peered":"2024-09-13T18:48:42.291944+0000","last_clean":"2024-09-13T18:48:42.291944+0000","last_became_active":"2024-09-13T18:48:42.286418+0000","last_became_peered":"2024-09-13T18:48:42.286418+0000","last_unstale":"2024-09-13T18:48:42.291944+0000","last_undegraded":"2024-09-13T18:48:42.291944+0000","last_fullsized":"2024-09-13T18:48:42.291944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:22.781068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291647+0000","last_change":"2024-09-13T18:48:42.286412+0000","last_active":"2024-09-13T18:48:42.291647+0000","last_peered":"2024-09-13T18:48:42.291647+0000","last_clean":"2024-09-13T18:48:42.291647+0000","last_became_active":"2024-09-13T18:48:42.278907+0000","last_became_peered":"2024-09-13T18:48:42.278907+0000","last_unstale":"2024-09-13T18:48:42.291647+0000","last_undegraded":"2024-09-13T18:48:42.291647+0000","last_fullsized":"2024-09-13T18:48:42.291647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:42.257077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.289405+0000","last_change":"2024-09-13T18:48:42.285288+0000","last_active":"2024-09-13T18:48:42.289405+0000","last_peered":"2024-09-13T18:48:42.289405+0000","last_clean":"2024-09-13T18:48:42.289405+0000","last_became_active":"2024-09-13T18:48:42.284289+0000","last_became_peered":"2024-09-13T18:48:42.284289+0000","last_unstale":"2024-09-13T18:48:42.289405+0000","last_undegraded":"2024-09-13T18:48:42.289405+0000","last_fullsized":"2024-09-13T18:48:42.289405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:27.199230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.275655+0000","last_change":"2024-09-13T18:48:42.272680+0000","last_active":"2024-09-13T18:48:42.275655+0000","last_peered":"2024-09-13T18:48:42.275655+0000","last_clean":"2024-09-13T18:48:42.275655+0000","last_became_active":"2024-09-13T18:48:42.272435+0000","last_became_peered":"2024-09-13T18:48:42.272435+0000","last_unstale":"2024-09-13T18:48:42.275655+0000","last_undegraded":"2024-09-13T18:48:42.275655+0000","last_fullsized":"2024-09-13T18:48:42.275655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293115+0000","last_change":"2024-09-13T18:48:42.278887+0000","last_active":"2024-09-13T18:48:42.293115+0000","last_peered":"2024-09-13T18:48:42.293115+0000","last_clean":"2024-09-13T18:48:42.293115+0000","last_became_active":"2024-09-13T18:48:42.278559+0000","last_became_peered":"2024-09-13T18:48:42.278559+0000","last_unstale":"2024-09-13T18:48:42.293115+0000","last_undegraded":"2024-09-13T18:48:42.293115+0000","last_fullsized":"2024-09-13T18:48:42.293115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.829905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284162+0000","last_change":"2024-09-13T18:48:42.273649+0000","last_active":"2024-09-13T18:48:42.284162+0000","last_peered":"2024-09-13T18:48:42.284162+0000","last_clean":"2024-09-13T18:48:42.284162+0000","last_became_active":"2024-09-13T18:48:42.273319+0000","last_became_peered":"2024-09-13T18:48:42.273319+0000","last_unstale":"2024-09-13T18:48:42.284162+0000","last_undegraded":"2024-09-13T18:48:42.284162+0000","last_fullsized":"2024-09-13T18:48:42.284162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:14.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290754+0000","last_change":"2024-09-13T18:48:42.283191+0000","last_active":"2024-09-13T18:48:42.290754+0000","last_peered":"2024-09-13T18:48:42.290754+0000","last_clean":"2024-09-13T18:48:42.290754+0000","last_became_active":"2024-09-13T18:48:42.282893+0000","last_became_peered":"2024-09-13T18:48:42.282893+0000","last_unstale":"2024-09-13T18:48:42.290754+0000","last_undegraded":"2024-09-13T18:48:42.290754+0000","last_fullsized":"2024-09-13T18:48:42.290754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:33.133600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.278333+0000","last_change":"2024-09-13T18:48:42.269708+0000","last_active":"2024-09-13T18:48:42.278333+0000","last_peered":"2024-09-13T18:48:42.278333+0000","last_clean":"2024-09-13T18:48:42.278333+0000","last_became_active":"2024-09-13T18:48:42.269458+0000","last_became_peered":"2024-09-13T18:48:42.269458+0000","last_unstale":"2024-09-13T18:48:42.278333+0000","last_undegraded":"2024-09-13T18:48:42.278333+0000","last_fullsized":"2024-09-13T18:48:42.278333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:16.593320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.272101+0000","last_change":"2024-09-13T18:48:42.267343+0000","last_active":"2024-09-13T18:48:42.272101+0000","last_peered":"2024-09-13T18:48:42.272101+0000","last_clean":"2024-09-13T18:48:42.272101+0000","last_became_active":"2024-09-13T18:48:42.267033+0000","last_became_peered":"2024-09-13T18:48:42.267033+0000","last_unstale":"2024-09-13T18:48:42.272101+0000","last_undegraded":"2024-09-13T18:48:42.272101+0000","last_fullsized":"2024-09-13T18:48:42.272101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:14.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288854+0000","last_change":"2024-09-13T18:48:42.283606+0000","last_active":"2024-09-13T18:48:42.288854+0000","last_peered":"2024-09-13T18:48:42.288854+0000","last_clean":"2024-09-13T18:48:42.288854+0000","last_became_active":"2024-09-13T18:48:42.283286+0000","last_became_peered":"2024-09-13T18:48:42.283286+0000","last_unstale":"2024-09-13T18:48:42.288854+0000","last_undegraded":"2024-09-13T18:48:42.288854+0000","last_fullsized":"2024-09-13T18:48:42.288854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:42.257077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.271744+0000","last_change":"2024-09-13T18:48:42.267575+0000","last_active":"2024-09-13T18:48:42.271744+0000","last_peered":"2024-09-13T18:48:42.271744+0000","last_clean":"2024-09-13T18:48:42.271744+0000","last_became_active":"2024-09-13T18:48:42.267411+0000","last_became_peered":"2024-09-13T18:48:42.267411+0000","last_unstale":"2024-09-13T18:48:42.271744+0000","last_undegraded":"2024-09-13T18:48:42.271744+0000","last_fullsized":"2024-09-13T18:48:42.271744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295312+0000","last_change":"2024-09-13T18:48:42.292612+0000","last_active":"2024-09-13T18:48:42.295312+0000","last_peered":"2024-09-13T18:48:42.295312+0000","last_clean":"2024-09-13T18:48:42.295312+0000","last_became_active":"2024-09-13T18:48:42.292281+0000","last_became_peered":"2024-09-13T18:48:42.292281+0000","last_unstale":"2024-09-13T18:48:42.295312+0000","last_undegraded":"2024-09-13T18:48:42.295312+0000","last_fullsized":"2024-09-13T18:48:42.295312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:39.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286356+0000","last_change":"2024-09-13T18:48:42.276580+0000","last_active":"2024-09-13T18:48:42.286356+0000","last_peered":"2024-09-13T18:48:42.286356+0000","last_clean":"2024-09-13T18:48:42.286356+0000","last_became_active":"2024-09-13T18:48:42.276309+0000","last_became_peered":"2024-09-13T18:48:42.276309+0000","last_unstale":"2024-09-13T18:48:42.286356+0000","last_undegraded":"2024-09-13T18:48:42.286356+0000","last_fullsized":"2024-09-13T18:48:42.286356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.273856+0000","last_change":"2024-09-13T18:48:42.270248+0000","last_active":"2024-09-13T18:48:42.273856+0000","last_peered":"2024-09-13T18:48:42.273856+0000","last_clean":"2024-09-13T18:48:42.273856+0000","last_became_active":"2024-09-13T18:48:42.269988+0000","last_became_peered":"2024-09-13T18:48:42.269988+0000","last_unstale":"2024-09-13T18:48:42.273856+0000","last_undegraded":"2024-09-13T18:48:42.273856+0000","last_fullsized":"2024-09-13T18:48:42.273856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.752921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291119+0000","last_change":"2024-09-13T18:48:42.285861+0000","last_active":"2024-09-13T18:48:42.291119+0000","last_peered":"2024-09-13T18:48:42.291119+0000","last_clean":"2024-09-13T18:48:42.291119+0000","last_became_active":"2024-09-13T18:48:42.285548+0000","last_became_peered":"2024-09-13T18:48:42.285548+0000","last_unstale":"2024-09-13T18:48:42.291119+0000","last_undegraded":"2024-09-13T18:48:42.291119+0000","last_fullsized":"2024-09-13T18:48:42.291119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:17.179093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.282961+0000","last_change":"2024-09-13T18:48:42.276242+0000","last_active":"2024-09-13T18:48:42.282961+0000","last_peered":"2024-09-13T18:48:42.282961+0000","last_clean":"2024-09-13T18:48:42.282961+0000","last_became_active":"2024-09-13T18:48:42.275991+0000","last_became_peered":"2024-09-13T18:48:42.275991+0000","last_unstale":"2024-09-13T18:48:42.282961+0000","last_undegraded":"2024-09-13T18:48:42.282961+0000","last_fullsized":"2024-09-13T18:48:42.282961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291428+0000","last_change":"2024-09-13T18:48:42.287632+0000","last_active":"2024-09-13T18:48:42.291428+0000","last_peered":"2024-09-13T18:48:42.291428+0000","last_clean":"2024-09-13T18:48:42.291428+0000","last_became_active":"2024-09-13T18:48:42.287385+0000","last_became_peered":"2024-09-13T18:48:42.287385+0000","last_unstale":"2024-09-13T18:48:42.291428+0000","last_undegraded":"2024-09-13T18:48:42.291428+0000","last_fullsized":"2024-09-13T18:48:42.291428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:39.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291429+0000","last_change":"2024-09-13T18:48:41.810105+0000","last_active":"2024-09-13T18:48:42.291429+0000","last_peered":"2024-09-13T18:48:42.291429+0000","last_clean":"2024-09-13T18:48:42.291429+0000","last_became_active":"2024-09-13T18:48:41.809739+0000","last_became_peered":"2024-09-13T18:48:41.809739+0000","last_unstale":"2024-09-13T18:48:42.291429+0000","last_undegraded":"2024-09-13T18:48:42.291429+0000","last_fullsized":"2024-09-13T18:48:42.291429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:33.593062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288904+0000","last_change":"2024-09-13T18:48:42.283700+0000","last_active":"2024-09-13T18:48:42.288904+0000","last_peered":"2024-09-13T18:48:42.288904+0000","last_clean":"2024-09-13T18:48:42.288904+0000","last_became_active":"2024-09-13T18:48:42.283461+0000","last_became_peered":"2024-09-13T18:48:42.283461+0000","last_unstale":"2024-09-13T18:48:42.288904+0000","last_undegraded":"2024-09-13T18:48:42.288904+0000","last_fullsized":"2024-09-13T18:48:42.288904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288664+0000","last_change":"2024-09-13T18:48:41.811834+0000","last_active":"2024-09-13T18:48:42.288664+0000","last_peered":"2024-09-13T18:48:42.288664+0000","last_clean":"2024-09-13T18:48:42.288664+0000","last_became_active":"2024-09-13T18:48:41.811039+0000","last_became_peered":"2024-09-13T18:48:41.811039+0000","last_unstale":"2024-09-13T18:48:42.288664+0000","last_undegraded":"2024-09-13T18:48:42.288664+0000","last_fullsized":"2024-09-13T18:48:42.288664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:15.584432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284119+0000","last_change":"2024-09-13T18:48:42.273324+0000","last_active":"2024-09-13T18:48:42.284119+0000","last_peered":"2024-09-13T18:48:42.284119+0000","last_clean":"2024-09-13T18:48:42.284119+0000","last_became_active":"2024-09-13T18:48:42.272921+0000","last_became_peered":"2024-09-13T18:48:42.272921+0000","last_unstale":"2024-09-13T18:48:42.284119+0000","last_undegraded":"2024-09-13T18:48:42.284119+0000","last_fullsized":"2024-09-13T18:48:42.284119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:49.572894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288086+0000","last_change":"2024-09-13T18:48:41.812734+0000","last_active":"2024-09-13T18:48:42.288086+0000","last_peered":"2024-09-13T18:48:42.288086+0000","last_clean":"2024-09-13T18:48:42.288086+0000","last_became_active":"2024-09-13T18:48:41.812406+0000","last_became_peered":"2024-09-13T18:48:41.812406+0000","last_unstale":"2024-09-13T18:48:42.288086+0000","last_undegraded":"2024-09-13T18:48:42.288086+0000","last_fullsized":"2024-09-13T18:48:42.288086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:07.584505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279386+0000","last_change":"2024-09-13T18:48:42.274367+0000","last_active":"2024-09-13T18:48:42.279386+0000","last_peered":"2024-09-13T18:48:42.279386+0000","last_clean":"2024-09-13T18:48:42.279386+0000","last_became_active":"2024-09-13T18:48:42.274117+0000","last_became_peered":"2024-09-13T18:48:42.274117+0000","last_unstale":"2024-09-13T18:48:42.279386+0000","last_undegraded":"2024-09-13T18:48:42.279386+0000","last_fullsized":"2024-09-13T18:48:42.279386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:40.066880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295134+0000","last_change":"2024-09-13T18:48:41.813426+0000","last_active":"2024-09-13T18:48:42.295134+0000","last_peered":"2024-09-13T18:48:42.295134+0000","last_clean":"2024-09-13T18:48:42.295134+0000","last_became_active":"2024-09-13T18:48:41.813157+0000","last_became_peered":"2024-09-13T18:48:41.813157+0000","last_unstale":"2024-09-13T18:48:42.295134+0000","last_undegraded":"2024-09-13T18:48:42.295134+0000","last_fullsized":"2024-09-13T18:48:42.295134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:03.191247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.275740+0000","last_change":"2024-09-13T18:48:42.268149+0000","last_active":"2024-09-13T18:48:42.275740+0000","last_peered":"2024-09-13T18:48:42.275740+0000","last_clean":"2024-09-13T18:48:42.275740+0000","last_became_active":"2024-09-13T18:48:42.266872+0000","last_became_peered":"2024-09-13T18:48:42.266872+0000","last_unstale":"2024-09-13T18:48:42.275740+0000","last_undegraded":"2024-09-13T18:48:42.275740+0000","last_fullsized":"2024-09-13T18:48:42.275740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.752921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293011+0000","last_change":"2024-09-13T18:48:41.813333+0000","last_active":"2024-09-13T18:48:42.293011+0000","last_peered":"2024-09-13T18:48:42.293011+0000","last_clean":"2024-09-13T18:48:42.293011+0000","last_became_active":"2024-09-13T18:48:41.812302+0000","last_became_peered":"2024-09-13T18:48:41.812302+0000","last_unstale":"2024-09-13T18:48:42.293011+0000","last_undegraded":"2024-09-13T18:48:42.293011+0000","last_fullsized":"2024-09-13T18:48:42.293011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:26.194475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286806+0000","last_change":"2024-09-13T18:48:42.270909+0000","last_active":"2024-09-13T18:48:42.286806+0000","last_peered":"2024-09-13T18:48:42.286806+0000","last_clean":"2024-09-13T18:48:42.286806+0000","last_became_active":"2024-09-13T18:48:42.270554+0000","last_became_peered":"2024-09-13T18:48:42.270554+0000","last_unstale":"2024-09-13T18:48:42.286806+0000","last_undegraded":"2024-09-13T18:48:42.286806+0000","last_fullsized":"2024-09-13T18:48:42.286806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.292872+0000","last_change":"2024-09-13T18:48:41.816636+0000","last_active":"2024-09-13T18:48:42.292872+0000","last_peered":"2024-09-13T18:48:42.292872+0000","last_clean":"2024-09-13T18:48:42.292872+0000","last_became_active":"2024-09-13T18:48:41.816399+0000","last_became_peered":"2024-09-13T18:48:41.816399+0000","last_unstale":"2024-09-13T18:48:42.292872+0000","last_undegraded":"2024-09-13T18:48:42.292872+0000","last_fullsized":"2024-09-13T18:48:42.292872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:31.148556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284243+0000","last_change":"2024-09-13T18:48:42.275819+0000","last_active":"2024-09-13T18:48:42.284243+0000","last_peered":"2024-09-13T18:48:42.284243+0000","last_clean":"2024-09-13T18:48:42.284243+0000","last_became_active":"2024-09-13T18:48:42.275556+0000","last_became_peered":"2024-09-13T18:48:42.275556+0000","last_unstale":"2024-09-13T18:48:42.284243+0000","last_undegraded":"2024-09-13T18:48:42.284243+0000","last_fullsized":"2024-09-13T18:48:42.284243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:50.837445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.267423+0000","last_change":"2024-09-13T18:48:41.821424+0000","last_active":"2024-09-13T18:48:42.267423+0000","last_peered":"2024-09-13T18:48:42.267423+0000","last_clean":"2024-09-13T18:48:42.267423+0000","last_became_active":"2024-09-13T18:48:41.821109+0000","last_became_peered":"2024-09-13T18:48:41.821109+0000","last_unstale":"2024-09-13T18:48:42.267423+0000","last_undegraded":"2024-09-13T18:48:42.267423+0000","last_fullsized":"2024-09-13T18:48:42.267423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:16.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.289128+0000","last_change":"2024-09-13T18:48:42.287792+0000","last_active":"2024-09-13T18:48:42.289128+0000","last_peered":"2024-09-13T18:48:42.289128+0000","last_clean":"2024-09-13T18:48:42.289128+0000","last_became_active":"2024-09-13T18:48:42.287522+0000","last_became_peered":"2024-09-13T18:48:42.287522+0000","last_unstale":"2024-09-13T18:48:42.289128+0000","last_undegraded":"2024-09-13T18:48:42.289128+0000","last_fullsized":"2024-09-13T18:48:42.289128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:37.304015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.270851+0000","last_change":"2024-09-13T18:48:41.806936+0000","last_active":"2024-09-13T18:48:42.270851+0000","last_peered":"2024-09-13T18:48:42.270851+0000","last_clean":"2024-09-13T18:48:42.270851+0000","last_became_active":"2024-09-13T18:48:41.806582+0000","last_became_peered":"2024-09-13T18:48:41.806582+0000","last_unstale":"2024-09-13T18:48:42.270851+0000","last_undegraded":"2024-09-13T18:48:42.270851+0000","last_fullsized":"2024-09-13T18:48:42.270851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:40.306360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.285012+0000","last_change":"2024-09-13T18:48:42.281622+0000","last_active":"2024-09-13T18:48:42.285012+0000","last_peered":"2024-09-13T18:48:42.285012+0000","last_clean":"2024-09-13T18:48:42.285012+0000","last_became_active":"2024-09-13T18:48:42.281368+0000","last_became_peered":"2024-09-13T18:48:42.281368+0000","last_unstale":"2024-09-13T18:48:42.285012+0000","last_undegraded":"2024-09-13T18:48:42.285012+0000","last_fullsized":"2024-09-13T18:48:42.285012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:19.954013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.267511+0000","last_change":"2024-09-13T18:48:41.812525+0000","last_active":"2024-09-13T18:48:42.267511+0000","last_peered":"2024-09-13T18:48:42.267511+0000","last_clean":"2024-09-13T18:48:42.267511+0000","last_became_active":"2024-09-13T18:48:41.812145+0000","last_became_peered":"2024-09-13T18:48:41.812145+0000","last_unstale":"2024-09-13T18:48:42.267511+0000","last_undegraded":"2024-09-13T18:48:42.267511+0000","last_fullsized":"2024-09-13T18:48:42.267511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:18.375130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291896+0000","last_change":"2024-09-13T18:48:42.288419+0000","last_active":"2024-09-13T18:48:42.291896+0000","last_peered":"2024-09-13T18:48:42.291896+0000","last_clean":"2024-09-13T18:48:42.291896+0000","last_became_active":"2024-09-13T18:48:42.283614+0000","last_became_peered":"2024-09-13T18:48:42.283614+0000","last_unstale":"2024-09-13T18:48:42.291896+0000","last_undegraded":"2024-09-13T18:48:42.291896+0000","last_fullsized":"2024-09-13T18:48:42.291896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:04.196002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.265598+0000","last_change":"2024-09-13T18:48:41.813521+0000","last_active":"2024-09-13T18:48:42.265598+0000","last_peered":"2024-09-13T18:48:42.265598+0000","last_clean":"2024-09-13T18:48:42.265598+0000","last_became_active":"2024-09-13T18:48:41.812029+0000","last_became_peered":"2024-09-13T18:48:41.812029+0000","last_unstale":"2024-09-13T18:48:42.265598+0000","last_undegraded":"2024-09-13T18:48:42.265598+0000","last_fullsized":"2024-09-13T18:48:42.265598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:42.526172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280334+0000","last_change":"2024-09-13T18:48:42.277506+0000","last_active":"2024-09-13T18:48:42.280334+0000","last_peered":"2024-09-13T18:48:42.280334+0000","last_clean":"2024-09-13T18:48:42.280334+0000","last_became_active":"2024-09-13T18:48:42.277261+0000","last_became_peered":"2024-09-13T18:48:42.277261+0000","last_unstale":"2024-09-13T18:48:42.280334+0000","last_undegraded":"2024-09-13T18:48:42.280334+0000","last_fullsized":"2024-09-13T18:48:42.280334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:13.280109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.292625+0000","last_change":"2024-09-13T18:48:41.817429+0000","last_active":"2024-09-13T18:48:42.292625+0000","last_peered":"2024-09-13T18:48:42.292625+0000","last_clean":"2024-09-13T18:48:42.292625+0000","last_became_active":"2024-09-13T18:48:41.817091+0000","last_became_peered":"2024-09-13T18:48:41.817091+0000","last_unstale":"2024-09-13T18:48:42.292625+0000","last_undegraded":"2024-09-13T18:48:42.292625+0000","last_fullsized":"2024-09-13T18:48:42.292625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:29.489101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284196+0000","last_change":"2024-09-13T18:48:42.275042+0000","last_active":"2024-09-13T18:48:42.284196+0000","last_peered":"2024-09-13T18:48:42.284196+0000","last_clean":"2024-09-13T18:48:42.284196+0000","last_became_active":"2024-09-13T18:48:42.274752+0000","last_became_peered":"2024-09-13T18:48:42.274752+0000","last_unstale":"2024-09-13T18:48:42.284196+0000","last_undegraded":"2024-09-13T18:48:42.284196+0000","last_fullsized":"2024-09-13T18:48:42.284196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:10.935768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293918+0000","last_change":"2024-09-13T18:48:41.806371+0000","last_active":"2024-09-13T18:48:42.293918+0000","last_peered":"2024-09-13T18:48:42.293918+0000","last_clean":"2024-09-13T18:48:42.293918+0000","last_became_active":"2024-09-13T18:48:41.806150+0000","last_became_peered":"2024-09-13T18:48:41.806150+0000","last_unstale":"2024-09-13T18:48:42.293918+0000","last_undegraded":"2024-09-13T18:48:42.293918+0000","last_fullsized":"2024-09-13T18:48:42.293918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:13.748156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.277473+0000","last_change":"2024-09-13T18:48:42.271535+0000","last_active":"2024-09-13T18:48:42.277473+0000","last_peered":"2024-09-13T18:48:42.277473+0000","last_clean":"2024-09-13T18:48:42.277473+0000","last_became_active":"2024-09-13T18:48:42.270576+0000","last_became_peered":"2024-09-13T18:48:42.270576+0000","last_unstale":"2024-09-13T18:48:42.277473+0000","last_undegraded":"2024-09-13T18:48:42.277473+0000","last_fullsized":"2024-09-13T18:48:42.277473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.281087+0000","last_change":"2024-09-13T18:48:41.799183+0000","last_active":"2024-09-13T18:48:42.281087+0000","last_peered":"2024-09-13T18:48:42.281087+0000","last_clean":"2024-09-13T18:48:42.281087+0000","last_became_active":"2024-09-13T18:48:41.798908+0000","last_became_peered":"2024-09-13T18:48:41.798908+0000","last_unstale":"2024-09-13T18:48:42.281087+0000","last_undegraded":"2024-09-13T18:48:42.281087+0000","last_fullsized":"2024-09-13T18:48:42.281087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.505099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280553+0000","last_change":"2024-09-13T18:48:42.273149+0000","last_active":"2024-09-13T18:48:42.280553+0000","last_peered":"2024-09-13T18:48:42.280553+0000","last_clean":"2024-09-13T18:48:42.280553+0000","last_became_active":"2024-09-13T18:48:42.272735+0000","last_became_peered":"2024-09-13T18:48:42.272735+0000","last_unstale":"2024-09-13T18:48:42.280553+0000","last_undegraded":"2024-09-13T18:48:42.280553+0000","last_fullsized":"2024-09-13T18:48:42.280553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:18.608032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.267612+0000","last_change":"2024-09-13T18:48:41.821426+0000","last_active":"2024-09-13T18:48:42.267612+0000","last_peered":"2024-09-13T18:48:42.267612+0000","last_clean":"2024-09-13T18:48:42.267612+0000","last_became_active":"2024-09-13T18:48:41.821130+0000","last_became_peered":"2024-09-13T18:48:41.821130+0000","last_unstale":"2024-09-13T18:48:42.267612+0000","last_undegraded":"2024-09-13T18:48:42.267612+0000","last_fullsized":"2024-09-13T18:48:42.267612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:33.593062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290392+0000","last_change":"2024-09-13T18:48:42.281151+0000","last_active":"2024-09-13T18:48:42.290392+0000","last_peered":"2024-09-13T18:48:42.290392+0000","last_clean":"2024-09-13T18:48:42.290392+0000","last_became_active":"2024-09-13T18:48:42.280884+0000","last_became_peered":"2024-09-13T18:48:42.280884+0000","last_unstale":"2024-09-13T18:48:42.290392+0000","last_undegraded":"2024-09-13T18:48:42.290392+0000","last_fullsized":"2024-09-13T18:48:42.290392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:06.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.256588+0000","last_change":"2024-09-13T18:48:41.816339+0000","last_active":"2024-09-13T18:48:42.256588+0000","last_peered":"2024-09-13T18:48:42.256588+0000","last_clean":"2024-09-13T18:48:42.256588+0000","last_became_active":"2024-09-13T18:48:41.816042+0000","last_became_peered":"2024-09-13T18:48:41.816042+0000","last_unstale":"2024-09-13T18:48:42.256588+0000","last_undegraded":"2024-09-13T18:48:42.256588+0000","last_fullsized":"2024-09-13T18:48:42.256588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:16.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.283808+0000","last_change":"2024-09-13T18:48:42.278037+0000","last_active":"2024-09-13T18:48:42.283808+0000","last_peered":"2024-09-13T18:48:42.283808+0000","last_clean":"2024-09-13T18:48:42.283808+0000","last_became_active":"2024-09-13T18:48:42.277743+0000","last_became_peered":"2024-09-13T18:48:42.277743+0000","last_unstale":"2024-09-13T18:48:42.283808+0000","last_undegraded":"2024-09-13T18:48:42.283808+0000","last_fullsized":"2024-09-13T18:48:42.283808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.968275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.296741+0000","last_change":"2024-09-13T18:48:41.817585+0000","last_active":"2024-09-13T18:48:42.296741+0000","last_peered":"2024-09-13T18:48:42.296741+0000","last_clean":"2024-09-13T18:48:42.296741+0000","last_became_active":"2024-09-13T18:48:41.817321+0000","last_became_peered":"2024-09-13T18:48:41.817321+0000","last_unstale":"2024-09-13T18:48:42.296741+0000","last_undegraded":"2024-09-13T18:48:42.296741+0000","last_fullsized":"2024-09-13T18:48:42.296741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:22.318581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.283126+0000","last_change":"2024-09-13T18:48:42.276406+0000","last_active":"2024-09-13T18:48:42.283126+0000","last_peered":"2024-09-13T18:48:42.283126+0000","last_clean":"2024-09-13T18:48:42.283126+0000","last_became_active":"2024-09-13T18:48:42.275992+0000","last_became_peered":"2024-09-13T18:48:42.275992+0000","last_unstale":"2024-09-13T18:48:42.283126+0000","last_undegraded":"2024-09-13T18:48:42.283126+0000","last_fullsized":"2024-09-13T18:48:42.283126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:18.332423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293382+0000","last_change":"2024-09-13T18:48:41.816586+0000","last_active":"2024-09-13T18:48:42.293382+0000","last_peered":"2024-09-13T18:48:42.293382+0000","last_clean":"2024-09-13T18:48:42.293382+0000","last_became_active":"2024-09-13T18:48:41.816022+0000","last_became_peered":"2024-09-13T18:48:41.816022+0000","last_unstale":"2024-09-13T18:48:42.293382+0000","last_undegraded":"2024-09-13T18:48:42.293382+0000","last_fullsized":"2024-09-13T18:48:42.293382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:45.197685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293312+0000","last_change":"2024-09-13T18:48:42.285483+0000","last_active":"2024-09-13T18:48:42.293312+0000","last_peered":"2024-09-13T18:48:42.293312+0000","last_clean":"2024-09-13T18:48:42.293312+0000","last_became_active":"2024-09-13T18:48:42.285199+0000","last_became_peered":"2024-09-13T18:48:42.285199+0000","last_unstale":"2024-09-13T18:48:42.293312+0000","last_undegraded":"2024-09-13T18:48:42.293312+0000","last_fullsized":"2024-09-13T18:48:42.293312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:42.257077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.294402+0000","last_change":"2024-09-13T18:48:41.823242+0000","last_active":"2024-09-13T18:48:42.294402+0000","last_peered":"2024-09-13T18:48:42.294402+0000","last_clean":"2024-09-13T18:48:42.294402+0000","last_became_active":"2024-09-13T18:48:41.822946+0000","last_became_peered":"2024-09-13T18:48:41.822946+0000","last_unstale":"2024-09-13T18:48:42.294402+0000","last_undegraded":"2024-09-13T18:48:42.294402+0000","last_fullsized":"2024-09-13T18:48:42.294402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:21.776313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290979+0000","last_change":"2024-09-13T18:48:42.283965+0000","last_active":"2024-09-13T18:48:42.290979+0000","last_peered":"2024-09-13T18:48:42.290979+0000","last_clean":"2024-09-13T18:48:42.290979+0000","last_became_active":"2024-09-13T18:48:42.283692+0000","last_became_peered":"2024-09-13T18:48:42.283692+0000","last_unstale":"2024-09-13T18:48:42.290979+0000","last_undegraded":"2024-09-13T18:48:42.290979+0000","last_fullsized":"2024-09-13T18:48:42.290979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:05.508995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.287690+0000","last_change":"2024-09-13T18:48:41.807156+0000","last_active":"2024-09-13T18:48:42.287690+0000","last_peered":"2024-09-13T18:48:42.287690+0000","last_clean":"2024-09-13T18:48:42.287690+0000","last_became_active":"2024-09-13T18:48:41.806873+0000","last_became_peered":"2024-09-13T18:48:41.806873+0000","last_unstale":"2024-09-13T18:48:42.287690+0000","last_undegraded":"2024-09-13T18:48:42.287690+0000","last_fullsized":"2024-09-13T18:48:42.287690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.772486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279877+0000","last_change":"2024-09-13T18:48:42.274139+0000","last_active":"2024-09-13T18:48:42.279877+0000","last_peered":"2024-09-13T18:48:42.279877+0000","last_clean":"2024-09-13T18:48:42.279877+0000","last_became_active":"2024-09-13T18:48:42.273946+0000","last_became_peered":"2024-09-13T18:48:42.273946+0000","last_unstale":"2024-09-13T18:48:42.279877+0000","last_undegraded":"2024-09-13T18:48:42.279877+0000","last_fullsized":"2024-09-13T18:48:42.279877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:20.370330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.271968+0000","last_change":"2024-09-13T18:48:41.806447+0000","last_active":"2024-09-13T18:48:42.271968+0000","last_peered":"2024-09-13T18:48:42.271968+0000","last_clean":"2024-09-13T18:48:42.271968+0000","last_became_active":"2024-09-13T18:48:41.805617+0000","last_became_peered":"2024-09-13T18:48:41.805617+0000","last_unstale":"2024-09-13T18:48:42.271968+0000","last_undegraded":"2024-09-13T18:48:42.271968+0000","last_fullsized":"2024-09-13T18:48:42.271968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:22.339536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290681+0000","last_change":"2024-09-13T18:48:42.282602+0000","last_active":"2024-09-13T18:48:42.290681+0000","last_peered":"2024-09-13T18:48:42.290681+0000","last_clean":"2024-09-13T18:48:42.290681+0000","last_became_active":"2024-09-13T18:48:42.281208+0000","last_became_peered":"2024-09-13T18:48:42.281208+0000","last_unstale":"2024-09-13T18:48:42.290681+0000","last_undegraded":"2024-09-13T18:48:42.290681+0000","last_fullsized":"2024-09-13T18:48:42.290681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:08.589260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280844+0000","last_change":"2024-09-13T18:48:41.801221+0000","last_active":"2024-09-13T18:48:42.280844+0000","last_peered":"2024-09-13T18:48:42.280844+0000","last_clean":"2024-09-13T18:48:42.280844+0000","last_became_active":"2024-09-13T18:48:41.800971+0000","last_became_peered":"2024-09-13T18:48:41.800971+0000","last_unstale":"2024-09-13T18:48:42.280844+0000","last_undegraded":"2024-09-13T18:48:42.280844+0000","last_fullsized":"2024-09-13T18:48:42.280844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:05.312921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.277075+0000","last_change":"2024-09-13T18:48:42.273409+0000","last_active":"2024-09-13T18:48:42.277075+0000","last_peered":"2024-09-13T18:48:42.277075+0000","last_clean":"2024-09-13T18:48:42.277075+0000","last_became_active":"2024-09-13T18:48:42.271245+0000","last_became_peered":"2024-09-13T18:48:42.271245+0000","last_unstale":"2024-09-13T18:48:42.277075+0000","last_undegraded":"2024-09-13T18:48:42.277075+0000","last_fullsized":"2024-09-13T18:48:42.277075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.829905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.257195+0000","last_change":"2024-09-13T18:48:41.801923+0000","last_active":"2024-09-13T18:48:42.257195+0000","last_peered":"2024-09-13T18:48:42.257195+0000","last_clean":"2024-09-13T18:48:42.257195+0000","last_became_active":"2024-09-13T18:48:41.801627+0000","last_became_peered":"2024-09-13T18:48:41.801627+0000","last_unstale":"2024-09-13T18:48:42.257195+0000","last_undegraded":"2024-09-13T18:48:42.257195+0000","last_fullsized":"2024-09-13T18:48:42.257195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:46.370557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293597+0000","last_change":"2024-09-13T18:48:42.285952+0000","last_active":"2024-09-13T18:48:42.293597+0000","last_peered":"2024-09-13T18:48:42.293597+0000","last_clean":"2024-09-13T18:48:42.293597+0000","last_became_active":"2024-09-13T18:48:42.279565+0000","last_became_peered":"2024-09-13T18:48:42.279565+0000","last_unstale":"2024-09-13T18:48:42.293597+0000","last_undegraded":"2024-09-13T18:48:42.293597+0000","last_fullsized":"2024-09-13T18:48:42.293597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:41.311115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.265606+0000","last_change":"2024-09-13T18:48:41.817025+0000","last_active":"2024-09-13T18:48:42.265606+0000","last_peered":"2024-09-13T18:48:42.265606+0000","last_clean":"2024-09-13T18:48:42.265606+0000","last_became_active":"2024-09-13T18:48:41.816771+0000","last_became_peered":"2024-09-13T18:48:41.816771+0000","last_unstale":"2024-09-13T18:48:42.265606+0000","last_undegraded":"2024-09-13T18:48:42.265606+0000","last_fullsized":"2024-09-13T18:48:42.265606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:46.898570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.289108+0000","last_change":"2024-09-13T18:48:42.287750+0000","last_active":"2024-09-13T18:48:42.289108+0000","last_peered":"2024-09-13T18:48:42.289108+0000","last_clean":"2024-09-13T18:48:42.289108+0000","last_became_active":"2024-09-13T18:48:42.287501+0000","last_became_peered":"2024-09-13T18:48:42.287501+0000","last_unstale":"2024-09-13T18:48:42.289108+0000","last_undegraded":"2024-09-13T18:48:42.289108+0000","last_fullsized":"2024-09-13T18:48:42.289108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:31.058353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.257986+0000","last_change":"2024-09-13T18:48:41.806022+0000","last_active":"2024-09-13T18:48:42.257986+0000","last_peered":"2024-09-13T18:48:42.257986+0000","last_clean":"2024-09-13T18:48:42.257986+0000","last_became_active":"2024-09-13T18:48:41.805173+0000","last_became_peered":"2024-09-13T18:48:41.805173+0000","last_unstale":"2024-09-13T18:48:42.257986+0000","last_undegraded":"2024-09-13T18:48:42.257986+0000","last_fullsized":"2024-09-13T18:48:42.257986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:47.481900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288843+0000","last_change":"2024-09-13T18:48:42.283386+0000","last_active":"2024-09-13T18:48:42.288843+0000","last_peered":"2024-09-13T18:48:42.288843+0000","last_clean":"2024-09-13T18:48:42.288843+0000","last_became_active":"2024-09-13T18:48:42.283131+0000","last_became_peered":"2024-09-13T18:48:42.283131+0000","last_unstale":"2024-09-13T18:48:42.288843+0000","last_undegraded":"2024-09-13T18:48:42.288843+0000","last_fullsized":"2024-09-13T18:48:42.288843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286042+0000","last_change":"2024-09-13T18:48:41.816752+0000","last_active":"2024-09-13T18:48:42.286042+0000","last_peered":"2024-09-13T18:48:42.286042+0000","last_clean":"2024-09-13T18:48:42.286042+0000","last_became_active":"2024-09-13T18:48:41.816358+0000","last_became_peered":"2024-09-13T18:48:41.816358+0000","last_unstale":"2024-09-13T18:48:42.286042+0000","last_undegraded":"2024-09-13T18:48:42.286042+0000","last_fullsized":"2024-09-13T18:48:42.286042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:42.033131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290643+0000","last_change":"2024-09-13T18:48:42.282718+0000","last_active":"2024-09-13T18:48:42.290643+0000","last_peered":"2024-09-13T18:48:42.290643+0000","last_clean":"2024-09-13T18:48:42.290643+0000","last_became_active":"2024-09-13T18:48:42.282420+0000","last_became_peered":"2024-09-13T18:48:42.282420+0000","last_unstale":"2024-09-13T18:48:42.290643+0000","last_undegraded":"2024-09-13T18:48:42.290643+0000","last_fullsized":"2024-09-13T18:48:42.290643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:34.597817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.257254+0000","last_change":"2024-09-13T18:48:41.807449+0000","last_active":"2024-09-13T18:48:42.257254+0000","last_peered":"2024-09-13T18:48:42.257254+0000","last_clean":"2024-09-13T18:48:42.257254+0000","last_became_active":"2024-09-13T18:48:41.807174+0000","last_became_peered":"2024-09-13T18:48:41.807174+0000","last_unstale":"2024-09-13T18:48:42.257254+0000","last_undegraded":"2024-09-13T18:48:42.257254+0000","last_fullsized":"2024-09-13T18:48:42.257254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:03.653468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291400+0000","last_change":"2024-09-13T18:48:42.289612+0000","last_active":"2024-09-13T18:48:42.291400+0000","last_peered":"2024-09-13T18:48:42.291400+0000","last_clean":"2024-09-13T18:48:42.291400+0000","last_became_active":"2024-09-13T18:48:42.289313+0000","last_became_peered":"2024-09-13T18:48:42.289313+0000","last_unstale":"2024-09-13T18:48:42.291400+0000","last_undegraded":"2024-09-13T18:48:42.291400+0000","last_fullsized":"2024-09-13T18:48:42.291400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:08.635687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.254594+0000","last_change":"2024-09-13T18:48:41.808833+0000","last_active":"2024-09-13T18:48:42.254594+0000","last_peered":"2024-09-13T18:48:42.254594+0000","last_clean":"2024-09-13T18:48:42.254594+0000","last_became_active":"2024-09-13T18:48:41.808526+0000","last_became_peered":"2024-09-13T18:48:41.808526+0000","last_unstale":"2024-09-13T18:48:42.254594+0000","last_undegraded":"2024-09-13T18:48:42.254594+0000","last_fullsized":"2024-09-13T18:48:42.254594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:32.565861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.275757+0000","last_change":"2024-09-13T18:48:42.268608+0000","last_active":"2024-09-13T18:48:42.275757+0000","last_peered":"2024-09-13T18:48:42.275757+0000","last_clean":"2024-09-13T18:48:42.275757+0000","last_became_active":"2024-09-13T18:48:42.268386+0000","last_became_peered":"2024-09-13T18:48:42.268386+0000","last_unstale":"2024-09-13T18:48:42.275757+0000","last_undegraded":"2024-09-13T18:48:42.275757+0000","last_fullsized":"2024-09-13T18:48:42.275757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:39.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.255496+0000","last_change":"2024-09-13T18:48:41.804300+0000","last_active":"2024-09-13T18:48:42.255496+0000","last_peered":"2024-09-13T18:48:42.255496+0000","last_clean":"2024-09-13T18:48:42.255496+0000","last_became_active":"2024-09-13T18:48:41.803917+0000","last_became_peered":"2024-09-13T18:48:41.803917+0000","last_unstale":"2024-09-13T18:48:42.255496+0000","last_undegraded":"2024-09-13T18:48:42.255496+0000","last_fullsized":"2024-09-13T18:48:42.255496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:44.741081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279391+0000","last_change":"2024-09-13T18:48:42.272776+0000","last_active":"2024-09-13T18:48:42.279391+0000","last_peered":"2024-09-13T18:48:42.279391+0000","last_clean":"2024-09-13T18:48:42.279391+0000","last_became_active":"2024-09-13T18:48:42.272528+0000","last_became_peered":"2024-09-13T18:48:42.272528+0000","last_unstale":"2024-09-13T18:48:42.279391+0000","last_undegraded":"2024-09-13T18:48:42.279391+0000","last_fullsized":"2024-09-13T18:48:42.279391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.829905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.256514+0000","last_change":"2024-09-13T18:48:41.814294+0000","last_active":"2024-09-13T18:48:42.256514+0000","last_peered":"2024-09-13T18:48:42.256514+0000","last_clean":"2024-09-13T18:48:42.256514+0000","last_became_active":"2024-09-13T18:48:41.813996+0000","last_became_peered":"2024-09-13T18:48:41.813996+0000","last_unstale":"2024-09-13T18:48:42.256514+0000","last_undegraded":"2024-09-13T18:48:42.256514+0000","last_fullsized":"2024-09-13T18:48:42.256514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:07.584505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284210+0000","last_change":"2024-09-13T18:48:42.275079+0000","last_active":"2024-09-13T18:48:42.284210+0000","last_peered":"2024-09-13T18:48:42.284210+0000","last_clean":"2024-09-13T18:48:42.284210+0000","last_became_active":"2024-09-13T18:48:42.274794+0000","last_became_peered":"2024-09-13T18:48:42.274794+0000","last_unstale":"2024-09-13T18:48:42.284210+0000","last_undegraded":"2024-09-13T18:48:42.284210+0000","last_fullsized":"2024-09-13T18:48:42.284210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:25.509854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.271368+0000","last_change":"2024-09-13T18:48:41.811101+0000","last_active":"2024-09-13T18:48:42.271368+0000","last_peered":"2024-09-13T18:48:42.271368+0000","last_clean":"2024-09-13T18:48:42.271368+0000","last_became_active":"2024-09-13T18:48:41.810749+0000","last_became_peered":"2024-09-13T18:48:41.810749+0000","last_unstale":"2024-09-13T18:48:42.271368+0000","last_undegraded":"2024-09-13T18:48:42.271368+0000","last_fullsized":"2024-09-13T18:48:42.271368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:49.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290215+0000","last_change":"2024-09-13T18:48:42.280144+0000","last_active":"2024-09-13T18:48:42.290215+0000","last_peered":"2024-09-13T18:48:42.290215+0000","last_clean":"2024-09-13T18:48:42.290215+0000","last_became_active":"2024-09-13T18:48:42.279855+0000","last_became_peered":"2024-09-13T18:48:42.279855+0000","last_unstale":"2024-09-13T18:48:42.290215+0000","last_undegraded":"2024-09-13T18:48:42.290215+0000","last_fullsized":"2024-09-13T18:48:42.290215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:41.311115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.265731+0000","last_change":"2024-09-13T18:48:41.800780+0000","last_active":"2024-09-13T18:48:42.265731+0000","last_peered":"2024-09-13T18:48:42.265731+0000","last_clean":"2024-09-13T18:48:42.265731+0000","last_became_active":"2024-09-13T18:48:41.800374+0000","last_became_peered":"2024-09-13T18:48:41.800374+0000","last_unstale":"2024-09-13T18:48:42.265731+0000","last_undegraded":"2024-09-13T18:48:42.265731+0000","last_fullsized":"2024-09-13T18:48:42.265731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:41.252322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293561+0000","last_change":"2024-09-13T18:48:42.285210+0000","last_active":"2024-09-13T18:48:42.293561+0000","last_peered":"2024-09-13T18:48:42.293561+0000","last_clean":"2024-09-13T18:48:42.293561+0000","last_became_active":"2024-09-13T18:48:42.279824+0000","last_became_peered":"2024-09-13T18:48:42.279824+0000","last_unstale":"2024-09-13T18:48:42.293561+0000","last_undegraded":"2024-09-13T18:48:42.293561+0000","last_fullsized":"2024-09-13T18:48:42.293561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:13.280109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.266322+0000","last_change":"2024-09-13T18:48:41.819213+0000","last_active":"2024-09-13T18:48:42.266322+0000","last_peered":"2024-09-13T18:48:42.266322+0000","last_clean":"2024-09-13T18:48:42.266322+0000","last_became_active":"2024-09-13T18:48:41.818792+0000","last_became_peered":"2024-09-13T18:48:41.818792+0000","last_unstale":"2024-09-13T18:48:42.266322+0000","last_undegraded":"2024-09-13T18:48:42.266322+0000","last_fullsized":"2024-09-13T18:48:42.266322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:18.949258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T18:48:41.809274+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:48:41.809274+0000","last_peered":"2024-09-13T18:48:41.809274+0000","last_clean":"2024-09-13T18:48:41.809274+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:48:41.809274+0000","last_undegraded":"2024-09-13T18:48:41.809274+0000","last_fullsized":"2024-09-13T18:48:41.809274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":1032192,"data_stored":777863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.5309999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.232},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.395},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.367},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.5800000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.4319999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":442368,"data_stored":188077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.208},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":3.7480000000000002,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.075},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":5.0490000000000004,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.2889999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":4.8630000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.1619999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.1240000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.2470000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":446464,"data_stored":187607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.294}]},{"osd":1,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3600000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.4630000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.996},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.222}]},{"osd":6,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.268}]},{"osd":7,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.131},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.3129999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":188099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.873}]},{"osd":2,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.107},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.1319999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.626},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.036},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.0129999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.079,"5min":1.079,"15min":1.079},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.1659999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":180400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":4.0149999999999997,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.90700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":187565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.95699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.7009999999999996,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.2190000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.252},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.0129999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":8.6989999999999998,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.081},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.296}]},{"osd":5,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":4.7590000000000003,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.347},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":4.335,"5min":4.335,"15min":4.335},"last":1.3839999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":8.6300000000000008,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.474}]},{"osd":7,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":4.6699999999999999,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":4.4050000000000002,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.6699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":187585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":6.1760000000000002,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.878}]},{"osd":2,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.466},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":1.411}]},{"osd":3,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":10.368,"5min":10.368,"15min":10.368},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.1639999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":6.032,"5min":6.032,"15min":6.032},"last":1.252},{"interface":"front","average":{"1min":1.95,"5min":1.95,"15min":1.95},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":10.112,"5min":10.112,"15min":10.112},"last":1.3540000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3939999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":777897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":4.2039999999999997,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.98699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.073},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":4.093,"5min":4.093,"15min":4.093},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.7439999999999998,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.157}]},{"osd":4,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.4060000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.264}]},{"osd":5,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.345},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.651,"15min":1.651},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":3.056,"5min":3.056,"15min":3.056},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":4.5019999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:48:46.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.812+0000 7fbf46600700 1 Processor -- start 2024-09-13T18:48:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.812+0000 7fbf46600700 1 -- start start 2024-09-13T18:48:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf46600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf40071670 0x7fbf40071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf46600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf40070100 con 0x7fbf400b19f0 2024-09-13T18:48:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf46600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4006bee0 con 0x7fbf40159080 2024-09-13T18:48:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf46600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4006bcd0 con 0x7fbf40071670 2024-09-13T18:48:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf3fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbf400b19f0 0x7fbf400b1ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47822/0 (socket says 172.21.15.81:47822) 2024-09-13T18:48:46.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf3fe00700 1 -- 172.21.15.81:0/4032360544 learned_addr learned my addr 172.21.15.81:0/4032360544 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:46.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf36a00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf40071670 0x7fbf40071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774477515 0 0) 0x7fbf40070100 con 0x7fbf400b19f0 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.816+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf240035d0 con 0x7fbf400b19f0 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473665185 0 0) 0x7fbf4006bee0 con 0x7fbf40159080 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf40070100 con 0x7fbf40159080 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4211635548 0 0) 0x7fbf240035d0 con 0x7fbf400b19f0 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf40071670 msgr2=0x7fbf40071ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf40071670 0x7fbf40071ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 >> v1:172.21.15.178:6789/0 conn(0x7fbf40159080 legacy=0x7fbf400cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4006c1c0 con 0x7fbf400b19f0 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fbf38001670 con 0x7fbf400b19f0 2024-09-13T18:48:46.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 >> v1:172.21.15.81:6789/0 conn(0x7fbf400b19f0 legacy=0x7fbf400b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf24003be0 0x7fbf24003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24004870 0x7fbf24004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf24005230 0x7fbf2400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4006bcd0 con 0x7fbf24005230 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2400e230 con 0x7fbf24004870 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2400c0a0 con 0x7fbf24003be0 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf36a00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf40071670 0x7fbf40071ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf24005230 0x7fbf2400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3f400700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf24003be0 0x7fbf24003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf36a00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24004870 0x7fbf24004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 -- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf24003be0 msgr2=0x7fbf24003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf24003be0 0x7fbf24003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 -- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24004870 msgr2=0x7fbf24004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24004870 0x7fbf24004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 -- 172.21.15.81:0/4032360544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240035d0 con 0x7fbf24005230 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf36a00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24004870 0x7fbf24004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf24005230 0x7fbf2400ba30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c240 tx=0x7fbf240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414a2e39d51a12b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3800cd80 con 0x7fbf24005230 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38005980 con 0x7fbf24005230 2024-09-13T18:48:46.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3ea00700 1 -- 172.21.15.81:0/4032360544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38005d30 con 0x7fbf24005230 2024-09-13T18:48:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf46600700 1 -- 172.21.15.81:0/4032360544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf24005230 msgr2=0x7fbf2400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf46600700 1 --2- 172.21.15.81:0/4032360544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf24005230 0x7fbf2400ba30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c240 tx=0x7fbf240058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf3fe00700 1 -- 172.21.15.81:0/4032360544 reap_dead start 2024-09-13T18:48:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf46600700 1 -- 172.21.15.81:0/4032360544 shutdown_connections 2024-09-13T18:48:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf46600700 1 -- 172.21.15.81:0/4032360544 >> 172.21.15.81:0/4032360544 conn(0x7fbf400b08d0 msgr2=0x7fbf400b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf46600700 1 -- 172.21.15.81:0/4032360544 shutdown_connections 2024-09-13T18:48:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.820+0000 7fbf46600700 1 -- 172.21.15.81:0/4032360544 wait complete. 2024-09-13T18:48:46.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 Processor -- start 2024-09-13T18:48:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 -- start start 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24005230 0x7fbf4014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 0x7fbf4015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4014f1d0 0x7fbf4014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4015c4b0 con 0x7fbf400cc840 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40141b00 con 0x7fbf24005230 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf46600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4014ddc0 con 0x7fbf4014f1d0 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf36a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 0x7fbf4015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf36a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 0x7fbf4015bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58796/0 (socket says 172.21.15.81:58796) 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf36a00700 1 -- 172.21.15.81:0/2170712723 learned_addr learned my addr 172.21.15.81:0/2170712723 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf3fe00700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4014f1d0 0x7fbf4014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.824+0000 7fbf3f400700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24005230 0x7fbf4014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf36a00700 1 -- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4014f1d0 msgr2=0x7fbf4014f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf36a00700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4014f1d0 0x7fbf4014f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf36a00700 1 -- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24005230 msgr2=0x7fbf4014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf36a00700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24005230 0x7fbf4014ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf36a00700 1 -- 172.21.15.81:0/2170712723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400cd490 con 0x7fbf400cc840 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf3fe00700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4014f1d0 0x7fbf4014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf3f400700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24005230 0x7fbf4014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf36a00700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 0x7fbf4015bf70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbf28010950 tx=0x7fbf28010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800ea10 con 0x7fbf400cc840 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2800eb70 con 0x7fbf400cc840 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf400cda50 con 0x7fbf400cc840 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800eee0 con 0x7fbf400cc840 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4014dae0 con 0x7fbf400cc840 2024-09-13T18:48:46.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.828+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf400cdbe0 con 0x7fbf400cc840 2024-09-13T18:48:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.832+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf280143f0 con 0x7fbf400cc840 2024-09-13T18:48:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.832+0000 7fbf37e00700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf1c066730 0x7fbf1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.832+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbf28084400 con 0x7fbf400cc840 2024-09-13T18:48:46.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.832+0000 7fbf3f400700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf1c066730 0x7fbf1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:46.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.832+0000 7fbf3f400700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf1c066730 0x7fbf1c068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbf30001ed0 tx=0x7fbf30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:46.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:46.840+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf28051590 con 0x7fbf400cc840 2024-09-13T18:48:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.028+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf4006c780 con 0x7fbf1c066730 2024-09-13T18:48:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.036+0000 7fbf37e00700 1 -- 172.21.15.81:0/2170712723 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286311 (secure 0 0 0) 0x7fbf30001fb0 con 0x7fbf1c066730 2024-09-13T18:48:47.050 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf1c066730 msgr2=0x7fbf1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf1c066730 0x7fbf1c068bf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbf30001ed0 tx=0x7fbf30009040 comp rx=0 tx=0).stop 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 msgr2=0x7fbf4015bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 0x7fbf4015bf70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fbf28010950 tx=0x7fbf28010d10 comp rx=0 tx=0).stop 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 shutdown_connections 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf1c066730 0x7fbf1c068bf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4014f1d0 0x7fbf4014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf400cc840 0x7fbf4015bf70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 --2- 172.21.15.81:0/2170712723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf24005230 0x7fbf4014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 >> 172.21.15.81:0/2170712723 conn(0x7fbf400b08d0 msgr2=0x7fbf40152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 shutdown_connections 2024-09-13T18:48:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.044+0000 7fbf46600700 1 -- 172.21.15.81:0/2170712723 wait complete. 2024-09-13T18:48:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:48:47.075 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-13T18:48:46.999674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":40,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233104,"kb_used_data":4604,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754741616,"statfs":{"total":773094113280,"available":772855414784,"internally_reserved":0,"allocated":4714496,"data_stored":2675093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":233819707},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001691"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284837+0000","last_change":"2024-09-13T18:48:42.281113+0000","last_active":"2024-09-13T18:48:42.284837+0000","last_peered":"2024-09-13T18:48:42.284837+0000","last_clean":"2024-09-13T18:48:42.284837+0000","last_became_active":"2024-09-13T18:48:42.280857+0000","last_became_peered":"2024-09-13T18:48:42.280857+0000","last_unstale":"2024-09-13T18:48:42.284837+0000","last_undegraded":"2024-09-13T18:48:42.284837+0000","last_fullsized":"2024-09-13T18:48:42.284837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:59.059169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284187+0000","last_change":"2024-09-13T18:48:42.278290+0000","last_active":"2024-09-13T18:48:42.284187+0000","last_peered":"2024-09-13T18:48:42.284187+0000","last_clean":"2024-09-13T18:48:42.284187+0000","last_became_active":"2024-09-13T18:48:42.278061+0000","last_became_peered":"2024-09-13T18:48:42.278061+0000","last_unstale":"2024-09-13T18:48:42.284187+0000","last_undegraded":"2024-09-13T18:48:42.284187+0000","last_fullsized":"2024-09-13T18:48:42.284187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:09.097929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279115+0000","last_change":"2024-09-13T18:48:42.273535+0000","last_active":"2024-09-13T18:48:42.279115+0000","last_peered":"2024-09-13T18:48:42.279115+0000","last_clean":"2024-09-13T18:48:42.279115+0000","last_became_active":"2024-09-13T18:48:42.273277+0000","last_became_peered":"2024-09-13T18:48:42.273277+0000","last_unstale":"2024-09-13T18:48:42.279115+0000","last_undegraded":"2024-09-13T18:48:42.279115+0000","last_fullsized":"2024-09-13T18:48:42.279115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.285277+0000","last_change":"2024-09-13T18:48:42.282021+0000","last_active":"2024-09-13T18:48:42.285277+0000","last_peered":"2024-09-13T18:48:42.285277+0000","last_clean":"2024-09-13T18:48:42.285277+0000","last_became_active":"2024-09-13T18:48:42.281767+0000","last_became_peered":"2024-09-13T18:48:42.281767+0000","last_unstale":"2024-09-13T18:48:42.285277+0000","last_undegraded":"2024-09-13T18:48:42.285277+0000","last_fullsized":"2024-09-13T18:48:42.285277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:00.596192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284693+0000","last_change":"2024-09-13T18:48:42.279997+0000","last_active":"2024-09-13T18:48:42.284693+0000","last_peered":"2024-09-13T18:48:42.284693+0000","last_clean":"2024-09-13T18:48:42.284693+0000","last_became_active":"2024-09-13T18:48:42.279739+0000","last_became_peered":"2024-09-13T18:48:42.279739+0000","last_unstale":"2024-09-13T18:48:42.284693+0000","last_undegraded":"2024-09-13T18:48:42.284693+0000","last_fullsized":"2024-09-13T18:48:42.284693+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:47.903325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.281725+0000","last_change":"2024-09-13T18:48:42.274305+0000","last_active":"2024-09-13T18:48:42.281725+0000","last_peered":"2024-09-13T18:48:42.281725+0000","last_clean":"2024-09-13T18:48:42.281725+0000","last_became_active":"2024-09-13T18:48:42.274082+0000","last_became_peered":"2024-09-13T18:48:42.274082+0000","last_unstale":"2024-09-13T18:48:42.281725+0000","last_undegraded":"2024-09-13T18:48:42.281725+0000","last_fullsized":"2024-09-13T18:48:42.281725+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:13.280109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286825+0000","last_change":"2024-09-13T18:48:42.274454+0000","last_active":"2024-09-13T18:48:42.286825+0000","last_peered":"2024-09-13T18:48:42.286825+0000","last_clean":"2024-09-13T18:48:42.286825+0000","last_became_active":"2024-09-13T18:48:42.273141+0000","last_became_peered":"2024-09-13T18:48:42.273141+0000","last_unstale":"2024-09-13T18:48:42.286825+0000","last_undegraded":"2024-09-13T18:48:42.286825+0000","last_fullsized":"2024-09-13T18:48:42.286825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.752921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280090+0000","last_change":"2024-09-13T18:48:42.274523+0000","last_active":"2024-09-13T18:48:42.280090+0000","last_peered":"2024-09-13T18:48:42.280090+0000","last_clean":"2024-09-13T18:48:42.280090+0000","last_became_active":"2024-09-13T18:48:42.274269+0000","last_became_peered":"2024-09-13T18:48:42.274269+0000","last_unstale":"2024-09-13T18:48:42.280090+0000","last_undegraded":"2024-09-13T18:48:42.280090+0000","last_fullsized":"2024-09-13T18:48:42.280090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:16.273448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286659+0000","last_change":"2024-09-13T18:48:42.284838+0000","last_active":"2024-09-13T18:48:42.286659+0000","last_peered":"2024-09-13T18:48:42.286659+0000","last_clean":"2024-09-13T18:48:42.286659+0000","last_became_active":"2024-09-13T18:48:42.284616+0000","last_became_peered":"2024-09-13T18:48:42.284616+0000","last_unstale":"2024-09-13T18:48:42.286659+0000","last_undegraded":"2024-09-13T18:48:42.286659+0000","last_fullsized":"2024-09-13T18:48:42.286659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295274+0000","last_change":"2024-09-13T18:48:42.292479+0000","last_active":"2024-09-13T18:48:42.295274+0000","last_peered":"2024-09-13T18:48:42.295274+0000","last_clean":"2024-09-13T18:48:42.295274+0000","last_became_active":"2024-09-13T18:48:42.292186+0000","last_became_peered":"2024-09-13T18:48:42.292186+0000","last_unstale":"2024-09-13T18:48:42.295274+0000","last_undegraded":"2024-09-13T18:48:42.295274+0000","last_fullsized":"2024-09-13T18:48:42.295274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:25.509854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.296444+0000","last_change":"2024-09-13T18:48:42.291726+0000","last_active":"2024-09-13T18:48:42.296444+0000","last_peered":"2024-09-13T18:48:42.296444+0000","last_clean":"2024-09-13T18:48:42.296444+0000","last_became_active":"2024-09-13T18:48:42.287695+0000","last_became_peered":"2024-09-13T18:48:42.287695+0000","last_unstale":"2024-09-13T18:48:42.296444+0000","last_undegraded":"2024-09-13T18:48:42.296444+0000","last_fullsized":"2024-09-13T18:48:42.296444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.266113+0000","last_change":"2024-09-13T18:48:42.264125+0000","last_active":"2024-09-13T18:48:42.266113+0000","last_peered":"2024-09-13T18:48:42.266113+0000","last_clean":"2024-09-13T18:48:42.266113+0000","last_became_active":"2024-09-13T18:48:42.263707+0000","last_became_peered":"2024-09-13T18:48:42.263707+0000","last_unstale":"2024-09-13T18:48:42.266113+0000","last_undegraded":"2024-09-13T18:48:42.266113+0000","last_fullsized":"2024-09-13T18:48:42.266113+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:04.196002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295910+0000","last_change":"2024-09-13T18:48:42.294690+0000","last_active":"2024-09-13T18:48:42.295910+0000","last_peered":"2024-09-13T18:48:42.295910+0000","last_clean":"2024-09-13T18:48:42.295910+0000","last_became_active":"2024-09-13T18:48:42.293298+0000","last_became_peered":"2024-09-13T18:48:42.293298+0000","last_unstale":"2024-09-13T18:48:42.295910+0000","last_undegraded":"2024-09-13T18:48:42.295910+0000","last_fullsized":"2024-09-13T18:48:42.295910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284330+0000","last_change":"2024-09-13T18:48:42.277143+0000","last_active":"2024-09-13T18:48:42.284330+0000","last_peered":"2024-09-13T18:48:42.284330+0000","last_clean":"2024-09-13T18:48:42.284330+0000","last_became_active":"2024-09-13T18:48:42.276865+0000","last_became_peered":"2024-09-13T18:48:42.276865+0000","last_unstale":"2024-09-13T18:48:42.284330+0000","last_undegraded":"2024-09-13T18:48:42.284330+0000","last_fullsized":"2024-09-13T18:48:42.284330+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:47:01.079912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293401+0000","last_change":"2024-09-13T18:48:42.286663+0000","last_active":"2024-09-13T18:48:42.293401+0000","last_peered":"2024-09-13T18:48:42.293401+0000","last_clean":"2024-09-13T18:48:42.293401+0000","last_became_active":"2024-09-13T18:48:42.279817+0000","last_became_peered":"2024-09-13T18:48:42.279817+0000","last_unstale":"2024-09-13T18:48:42.293401+0000","last_undegraded":"2024-09-13T18:48:42.293401+0000","last_fullsized":"2024-09-13T18:48:42.293401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:14.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291151+0000","last_change":"2024-09-13T18:48:42.286186+0000","last_active":"2024-09-13T18:48:42.291151+0000","last_peered":"2024-09-13T18:48:42.291151+0000","last_clean":"2024-09-13T18:48:42.291151+0000","last_became_active":"2024-09-13T18:48:42.283323+0000","last_became_peered":"2024-09-13T18:48:42.283323+0000","last_unstale":"2024-09-13T18:48:42.291151+0000","last_undegraded":"2024-09-13T18:48:42.291151+0000","last_fullsized":"2024-09-13T18:48:42.291151+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:50.137504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291944+0000","last_change":"2024-09-13T18:48:42.288314+0000","last_active":"2024-09-13T18:48:42.291944+0000","last_peered":"2024-09-13T18:48:42.291944+0000","last_clean":"2024-09-13T18:48:42.291944+0000","last_became_active":"2024-09-13T18:48:42.286418+0000","last_became_peered":"2024-09-13T18:48:42.286418+0000","last_unstale":"2024-09-13T18:48:42.291944+0000","last_undegraded":"2024-09-13T18:48:42.291944+0000","last_fullsized":"2024-09-13T18:48:42.291944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:22.781068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291647+0000","last_change":"2024-09-13T18:48:42.286412+0000","last_active":"2024-09-13T18:48:42.291647+0000","last_peered":"2024-09-13T18:48:42.291647+0000","last_clean":"2024-09-13T18:48:42.291647+0000","last_became_active":"2024-09-13T18:48:42.278907+0000","last_became_peered":"2024-09-13T18:48:42.278907+0000","last_unstale":"2024-09-13T18:48:42.291647+0000","last_undegraded":"2024-09-13T18:48:42.291647+0000","last_fullsized":"2024-09-13T18:48:42.291647+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:42.257077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.289405+0000","last_change":"2024-09-13T18:48:42.285288+0000","last_active":"2024-09-13T18:48:42.289405+0000","last_peered":"2024-09-13T18:48:42.289405+0000","last_clean":"2024-09-13T18:48:42.289405+0000","last_became_active":"2024-09-13T18:48:42.284289+0000","last_became_peered":"2024-09-13T18:48:42.284289+0000","last_unstale":"2024-09-13T18:48:42.289405+0000","last_undegraded":"2024-09-13T18:48:42.289405+0000","last_fullsized":"2024-09-13T18:48:42.289405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:27.199230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.275655+0000","last_change":"2024-09-13T18:48:42.272680+0000","last_active":"2024-09-13T18:48:42.275655+0000","last_peered":"2024-09-13T18:48:42.275655+0000","last_clean":"2024-09-13T18:48:42.275655+0000","last_became_active":"2024-09-13T18:48:42.272435+0000","last_became_peered":"2024-09-13T18:48:42.272435+0000","last_unstale":"2024-09-13T18:48:42.275655+0000","last_undegraded":"2024-09-13T18:48:42.275655+0000","last_fullsized":"2024-09-13T18:48:42.275655+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293115+0000","last_change":"2024-09-13T18:48:42.278887+0000","last_active":"2024-09-13T18:48:42.293115+0000","last_peered":"2024-09-13T18:48:42.293115+0000","last_clean":"2024-09-13T18:48:42.293115+0000","last_became_active":"2024-09-13T18:48:42.278559+0000","last_became_peered":"2024-09-13T18:48:42.278559+0000","last_unstale":"2024-09-13T18:48:42.293115+0000","last_undegraded":"2024-09-13T18:48:42.293115+0000","last_fullsized":"2024-09-13T18:48:42.293115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.829905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284162+0000","last_change":"2024-09-13T18:48:42.273649+0000","last_active":"2024-09-13T18:48:42.284162+0000","last_peered":"2024-09-13T18:48:42.284162+0000","last_clean":"2024-09-13T18:48:42.284162+0000","last_became_active":"2024-09-13T18:48:42.273319+0000","last_became_peered":"2024-09-13T18:48:42.273319+0000","last_unstale":"2024-09-13T18:48:42.284162+0000","last_undegraded":"2024-09-13T18:48:42.284162+0000","last_fullsized":"2024-09-13T18:48:42.284162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:14.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290754+0000","last_change":"2024-09-13T18:48:42.283191+0000","last_active":"2024-09-13T18:48:42.290754+0000","last_peered":"2024-09-13T18:48:42.290754+0000","last_clean":"2024-09-13T18:48:42.290754+0000","last_became_active":"2024-09-13T18:48:42.282893+0000","last_became_peered":"2024-09-13T18:48:42.282893+0000","last_unstale":"2024-09-13T18:48:42.290754+0000","last_undegraded":"2024-09-13T18:48:42.290754+0000","last_fullsized":"2024-09-13T18:48:42.290754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:33.133600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.278333+0000","last_change":"2024-09-13T18:48:42.269708+0000","last_active":"2024-09-13T18:48:42.278333+0000","last_peered":"2024-09-13T18:48:42.278333+0000","last_clean":"2024-09-13T18:48:42.278333+0000","last_became_active":"2024-09-13T18:48:42.269458+0000","last_became_peered":"2024-09-13T18:48:42.269458+0000","last_unstale":"2024-09-13T18:48:42.278333+0000","last_undegraded":"2024-09-13T18:48:42.278333+0000","last_fullsized":"2024-09-13T18:48:42.278333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:16.593320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.272101+0000","last_change":"2024-09-13T18:48:42.267343+0000","last_active":"2024-09-13T18:48:42.272101+0000","last_peered":"2024-09-13T18:48:42.272101+0000","last_clean":"2024-09-13T18:48:42.272101+0000","last_became_active":"2024-09-13T18:48:42.267033+0000","last_became_peered":"2024-09-13T18:48:42.267033+0000","last_unstale":"2024-09-13T18:48:42.272101+0000","last_undegraded":"2024-09-13T18:48:42.272101+0000","last_fullsized":"2024-09-13T18:48:42.272101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:14.752911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288854+0000","last_change":"2024-09-13T18:48:42.283606+0000","last_active":"2024-09-13T18:48:42.288854+0000","last_peered":"2024-09-13T18:48:42.288854+0000","last_clean":"2024-09-13T18:48:42.288854+0000","last_became_active":"2024-09-13T18:48:42.283286+0000","last_became_peered":"2024-09-13T18:48:42.283286+0000","last_unstale":"2024-09-13T18:48:42.288854+0000","last_undegraded":"2024-09-13T18:48:42.288854+0000","last_fullsized":"2024-09-13T18:48:42.288854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:42.257077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.271744+0000","last_change":"2024-09-13T18:48:42.267575+0000","last_active":"2024-09-13T18:48:42.271744+0000","last_peered":"2024-09-13T18:48:42.271744+0000","last_clean":"2024-09-13T18:48:42.271744+0000","last_became_active":"2024-09-13T18:48:42.267411+0000","last_became_peered":"2024-09-13T18:48:42.267411+0000","last_unstale":"2024-09-13T18:48:42.271744+0000","last_undegraded":"2024-09-13T18:48:42.271744+0000","last_fullsized":"2024-09-13T18:48:42.271744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295312+0000","last_change":"2024-09-13T18:48:42.292612+0000","last_active":"2024-09-13T18:48:42.295312+0000","last_peered":"2024-09-13T18:48:42.295312+0000","last_clean":"2024-09-13T18:48:42.295312+0000","last_became_active":"2024-09-13T18:48:42.292281+0000","last_became_peered":"2024-09-13T18:48:42.292281+0000","last_unstale":"2024-09-13T18:48:42.295312+0000","last_undegraded":"2024-09-13T18:48:42.295312+0000","last_fullsized":"2024-09-13T18:48:42.295312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:39.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286356+0000","last_change":"2024-09-13T18:48:42.276580+0000","last_active":"2024-09-13T18:48:42.286356+0000","last_peered":"2024-09-13T18:48:42.286356+0000","last_clean":"2024-09-13T18:48:42.286356+0000","last_became_active":"2024-09-13T18:48:42.276309+0000","last_became_peered":"2024-09-13T18:48:42.276309+0000","last_unstale":"2024-09-13T18:48:42.286356+0000","last_undegraded":"2024-09-13T18:48:42.286356+0000","last_fullsized":"2024-09-13T18:48:42.286356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.273856+0000","last_change":"2024-09-13T18:48:42.270248+0000","last_active":"2024-09-13T18:48:42.273856+0000","last_peered":"2024-09-13T18:48:42.273856+0000","last_clean":"2024-09-13T18:48:42.273856+0000","last_became_active":"2024-09-13T18:48:42.269988+0000","last_became_peered":"2024-09-13T18:48:42.269988+0000","last_unstale":"2024-09-13T18:48:42.273856+0000","last_undegraded":"2024-09-13T18:48:42.273856+0000","last_fullsized":"2024-09-13T18:48:42.273856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.752921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291119+0000","last_change":"2024-09-13T18:48:42.285861+0000","last_active":"2024-09-13T18:48:42.291119+0000","last_peered":"2024-09-13T18:48:42.291119+0000","last_clean":"2024-09-13T18:48:42.291119+0000","last_became_active":"2024-09-13T18:48:42.285548+0000","last_became_peered":"2024-09-13T18:48:42.285548+0000","last_unstale":"2024-09-13T18:48:42.291119+0000","last_undegraded":"2024-09-13T18:48:42.291119+0000","last_fullsized":"2024-09-13T18:48:42.291119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:17.179093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.282961+0000","last_change":"2024-09-13T18:48:42.276242+0000","last_active":"2024-09-13T18:48:42.282961+0000","last_peered":"2024-09-13T18:48:42.282961+0000","last_clean":"2024-09-13T18:48:42.282961+0000","last_became_active":"2024-09-13T18:48:42.275991+0000","last_became_peered":"2024-09-13T18:48:42.275991+0000","last_unstale":"2024-09-13T18:48:42.282961+0000","last_undegraded":"2024-09-13T18:48:42.282961+0000","last_fullsized":"2024-09-13T18:48:42.282961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:51.877103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291428+0000","last_change":"2024-09-13T18:48:42.287632+0000","last_active":"2024-09-13T18:48:42.291428+0000","last_peered":"2024-09-13T18:48:42.291428+0000","last_clean":"2024-09-13T18:48:42.291428+0000","last_became_active":"2024-09-13T18:48:42.287385+0000","last_became_peered":"2024-09-13T18:48:42.287385+0000","last_unstale":"2024-09-13T18:48:42.291428+0000","last_undegraded":"2024-09-13T18:48:42.291428+0000","last_fullsized":"2024-09-13T18:48:42.291428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:39.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291429+0000","last_change":"2024-09-13T18:48:41.810105+0000","last_active":"2024-09-13T18:48:42.291429+0000","last_peered":"2024-09-13T18:48:42.291429+0000","last_clean":"2024-09-13T18:48:42.291429+0000","last_became_active":"2024-09-13T18:48:41.809739+0000","last_became_peered":"2024-09-13T18:48:41.809739+0000","last_unstale":"2024-09-13T18:48:42.291429+0000","last_undegraded":"2024-09-13T18:48:42.291429+0000","last_fullsized":"2024-09-13T18:48:42.291429+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:33.593062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288904+0000","last_change":"2024-09-13T18:48:42.283700+0000","last_active":"2024-09-13T18:48:42.288904+0000","last_peered":"2024-09-13T18:48:42.288904+0000","last_clean":"2024-09-13T18:48:42.288904+0000","last_became_active":"2024-09-13T18:48:42.283461+0000","last_became_peered":"2024-09-13T18:48:42.283461+0000","last_unstale":"2024-09-13T18:48:42.288904+0000","last_undegraded":"2024-09-13T18:48:42.288904+0000","last_fullsized":"2024-09-13T18:48:42.288904+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288664+0000","last_change":"2024-09-13T18:48:41.811834+0000","last_active":"2024-09-13T18:48:42.288664+0000","last_peered":"2024-09-13T18:48:42.288664+0000","last_clean":"2024-09-13T18:48:42.288664+0000","last_became_active":"2024-09-13T18:48:41.811039+0000","last_became_peered":"2024-09-13T18:48:41.811039+0000","last_unstale":"2024-09-13T18:48:42.288664+0000","last_undegraded":"2024-09-13T18:48:42.288664+0000","last_fullsized":"2024-09-13T18:48:42.288664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:15.584432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284119+0000","last_change":"2024-09-13T18:48:42.273324+0000","last_active":"2024-09-13T18:48:42.284119+0000","last_peered":"2024-09-13T18:48:42.284119+0000","last_clean":"2024-09-13T18:48:42.284119+0000","last_became_active":"2024-09-13T18:48:42.272921+0000","last_became_peered":"2024-09-13T18:48:42.272921+0000","last_unstale":"2024-09-13T18:48:42.284119+0000","last_undegraded":"2024-09-13T18:48:42.284119+0000","last_fullsized":"2024-09-13T18:48:42.284119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:49.572894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288086+0000","last_change":"2024-09-13T18:48:41.812734+0000","last_active":"2024-09-13T18:48:42.288086+0000","last_peered":"2024-09-13T18:48:42.288086+0000","last_clean":"2024-09-13T18:48:42.288086+0000","last_became_active":"2024-09-13T18:48:41.812406+0000","last_became_peered":"2024-09-13T18:48:41.812406+0000","last_unstale":"2024-09-13T18:48:42.288086+0000","last_undegraded":"2024-09-13T18:48:42.288086+0000","last_fullsized":"2024-09-13T18:48:42.288086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:07.584505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279386+0000","last_change":"2024-09-13T18:48:42.274367+0000","last_active":"2024-09-13T18:48:42.279386+0000","last_peered":"2024-09-13T18:48:42.279386+0000","last_clean":"2024-09-13T18:48:42.279386+0000","last_became_active":"2024-09-13T18:48:42.274117+0000","last_became_peered":"2024-09-13T18:48:42.274117+0000","last_unstale":"2024-09-13T18:48:42.279386+0000","last_undegraded":"2024-09-13T18:48:42.279386+0000","last_fullsized":"2024-09-13T18:48:42.279386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:40.066880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.295134+0000","last_change":"2024-09-13T18:48:41.813426+0000","last_active":"2024-09-13T18:48:42.295134+0000","last_peered":"2024-09-13T18:48:42.295134+0000","last_clean":"2024-09-13T18:48:42.295134+0000","last_became_active":"2024-09-13T18:48:41.813157+0000","last_became_peered":"2024-09-13T18:48:41.813157+0000","last_unstale":"2024-09-13T18:48:42.295134+0000","last_undegraded":"2024-09-13T18:48:42.295134+0000","last_fullsized":"2024-09-13T18:48:42.295134+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:03.191247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.275740+0000","last_change":"2024-09-13T18:48:42.268149+0000","last_active":"2024-09-13T18:48:42.275740+0000","last_peered":"2024-09-13T18:48:42.275740+0000","last_clean":"2024-09-13T18:48:42.275740+0000","last_became_active":"2024-09-13T18:48:42.266872+0000","last_became_peered":"2024-09-13T18:48:42.266872+0000","last_unstale":"2024-09-13T18:48:42.275740+0000","last_undegraded":"2024-09-13T18:48:42.275740+0000","last_fullsized":"2024-09-13T18:48:42.275740+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:29.752921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293011+0000","last_change":"2024-09-13T18:48:41.813333+0000","last_active":"2024-09-13T18:48:42.293011+0000","last_peered":"2024-09-13T18:48:42.293011+0000","last_clean":"2024-09-13T18:48:42.293011+0000","last_became_active":"2024-09-13T18:48:41.812302+0000","last_became_peered":"2024-09-13T18:48:41.812302+0000","last_unstale":"2024-09-13T18:48:42.293011+0000","last_undegraded":"2024-09-13T18:48:42.293011+0000","last_fullsized":"2024-09-13T18:48:42.293011+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:26.194475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286806+0000","last_change":"2024-09-13T18:48:42.270909+0000","last_active":"2024-09-13T18:48:42.286806+0000","last_peered":"2024-09-13T18:48:42.286806+0000","last_clean":"2024-09-13T18:48:42.286806+0000","last_became_active":"2024-09-13T18:48:42.270554+0000","last_became_peered":"2024-09-13T18:48:42.270554+0000","last_unstale":"2024-09-13T18:48:42.286806+0000","last_undegraded":"2024-09-13T18:48:42.286806+0000","last_fullsized":"2024-09-13T18:48:42.286806+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.292872+0000","last_change":"2024-09-13T18:48:41.816636+0000","last_active":"2024-09-13T18:48:42.292872+0000","last_peered":"2024-09-13T18:48:42.292872+0000","last_clean":"2024-09-13T18:48:42.292872+0000","last_became_active":"2024-09-13T18:48:41.816399+0000","last_became_peered":"2024-09-13T18:48:41.816399+0000","last_unstale":"2024-09-13T18:48:42.292872+0000","last_undegraded":"2024-09-13T18:48:42.292872+0000","last_fullsized":"2024-09-13T18:48:42.292872+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:31.148556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284243+0000","last_change":"2024-09-13T18:48:42.275819+0000","last_active":"2024-09-13T18:48:42.284243+0000","last_peered":"2024-09-13T18:48:42.284243+0000","last_clean":"2024-09-13T18:48:42.284243+0000","last_became_active":"2024-09-13T18:48:42.275556+0000","last_became_peered":"2024-09-13T18:48:42.275556+0000","last_unstale":"2024-09-13T18:48:42.284243+0000","last_undegraded":"2024-09-13T18:48:42.284243+0000","last_fullsized":"2024-09-13T18:48:42.284243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:50.837445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.267423+0000","last_change":"2024-09-13T18:48:41.821424+0000","last_active":"2024-09-13T18:48:42.267423+0000","last_peered":"2024-09-13T18:48:42.267423+0000","last_clean":"2024-09-13T18:48:42.267423+0000","last_became_active":"2024-09-13T18:48:41.821109+0000","last_became_peered":"2024-09-13T18:48:41.821109+0000","last_unstale":"2024-09-13T18:48:42.267423+0000","last_undegraded":"2024-09-13T18:48:42.267423+0000","last_fullsized":"2024-09-13T18:48:42.267423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:16.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.289128+0000","last_change":"2024-09-13T18:48:42.287792+0000","last_active":"2024-09-13T18:48:42.289128+0000","last_peered":"2024-09-13T18:48:42.289128+0000","last_clean":"2024-09-13T18:48:42.289128+0000","last_became_active":"2024-09-13T18:48:42.287522+0000","last_became_peered":"2024-09-13T18:48:42.287522+0000","last_unstale":"2024-09-13T18:48:42.289128+0000","last_undegraded":"2024-09-13T18:48:42.289128+0000","last_fullsized":"2024-09-13T18:48:42.289128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:37.304015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.270851+0000","last_change":"2024-09-13T18:48:41.806936+0000","last_active":"2024-09-13T18:48:42.270851+0000","last_peered":"2024-09-13T18:48:42.270851+0000","last_clean":"2024-09-13T18:48:42.270851+0000","last_became_active":"2024-09-13T18:48:41.806582+0000","last_became_peered":"2024-09-13T18:48:41.806582+0000","last_unstale":"2024-09-13T18:48:42.270851+0000","last_undegraded":"2024-09-13T18:48:42.270851+0000","last_fullsized":"2024-09-13T18:48:42.270851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:40.306360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.285012+0000","last_change":"2024-09-13T18:48:42.281622+0000","last_active":"2024-09-13T18:48:42.285012+0000","last_peered":"2024-09-13T18:48:42.285012+0000","last_clean":"2024-09-13T18:48:42.285012+0000","last_became_active":"2024-09-13T18:48:42.281368+0000","last_became_peered":"2024-09-13T18:48:42.281368+0000","last_unstale":"2024-09-13T18:48:42.285012+0000","last_undegraded":"2024-09-13T18:48:42.285012+0000","last_fullsized":"2024-09-13T18:48:42.285012+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:19.954013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.267511+0000","last_change":"2024-09-13T18:48:41.812525+0000","last_active":"2024-09-13T18:48:42.267511+0000","last_peered":"2024-09-13T18:48:42.267511+0000","last_clean":"2024-09-13T18:48:42.267511+0000","last_became_active":"2024-09-13T18:48:41.812145+0000","last_became_peered":"2024-09-13T18:48:41.812145+0000","last_unstale":"2024-09-13T18:48:42.267511+0000","last_undegraded":"2024-09-13T18:48:42.267511+0000","last_fullsized":"2024-09-13T18:48:42.267511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:18.375130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291896+0000","last_change":"2024-09-13T18:48:42.288419+0000","last_active":"2024-09-13T18:48:42.291896+0000","last_peered":"2024-09-13T18:48:42.291896+0000","last_clean":"2024-09-13T18:48:42.291896+0000","last_became_active":"2024-09-13T18:48:42.283614+0000","last_became_peered":"2024-09-13T18:48:42.283614+0000","last_unstale":"2024-09-13T18:48:42.291896+0000","last_undegraded":"2024-09-13T18:48:42.291896+0000","last_fullsized":"2024-09-13T18:48:42.291896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:04.196002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.265598+0000","last_change":"2024-09-13T18:48:41.813521+0000","last_active":"2024-09-13T18:48:42.265598+0000","last_peered":"2024-09-13T18:48:42.265598+0000","last_clean":"2024-09-13T18:48:42.265598+0000","last_became_active":"2024-09-13T18:48:41.812029+0000","last_became_peered":"2024-09-13T18:48:41.812029+0000","last_unstale":"2024-09-13T18:48:42.265598+0000","last_undegraded":"2024-09-13T18:48:42.265598+0000","last_fullsized":"2024-09-13T18:48:42.265598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:42.526172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280334+0000","last_change":"2024-09-13T18:48:42.277506+0000","last_active":"2024-09-13T18:48:42.280334+0000","last_peered":"2024-09-13T18:48:42.280334+0000","last_clean":"2024-09-13T18:48:42.280334+0000","last_became_active":"2024-09-13T18:48:42.277261+0000","last_became_peered":"2024-09-13T18:48:42.277261+0000","last_unstale":"2024-09-13T18:48:42.280334+0000","last_undegraded":"2024-09-13T18:48:42.280334+0000","last_fullsized":"2024-09-13T18:48:42.280334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:13.280109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.292625+0000","last_change":"2024-09-13T18:48:41.817429+0000","last_active":"2024-09-13T18:48:42.292625+0000","last_peered":"2024-09-13T18:48:42.292625+0000","last_clean":"2024-09-13T18:48:42.292625+0000","last_became_active":"2024-09-13T18:48:41.817091+0000","last_became_peered":"2024-09-13T18:48:41.817091+0000","last_unstale":"2024-09-13T18:48:42.292625+0000","last_undegraded":"2024-09-13T18:48:42.292625+0000","last_fullsized":"2024-09-13T18:48:42.292625+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:29.489101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284196+0000","last_change":"2024-09-13T18:48:42.275042+0000","last_active":"2024-09-13T18:48:42.284196+0000","last_peered":"2024-09-13T18:48:42.284196+0000","last_clean":"2024-09-13T18:48:42.284196+0000","last_became_active":"2024-09-13T18:48:42.274752+0000","last_became_peered":"2024-09-13T18:48:42.274752+0000","last_unstale":"2024-09-13T18:48:42.284196+0000","last_undegraded":"2024-09-13T18:48:42.284196+0000","last_fullsized":"2024-09-13T18:48:42.284196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:10.935768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293918+0000","last_change":"2024-09-13T18:48:41.806371+0000","last_active":"2024-09-13T18:48:42.293918+0000","last_peered":"2024-09-13T18:48:42.293918+0000","last_clean":"2024-09-13T18:48:42.293918+0000","last_became_active":"2024-09-13T18:48:41.806150+0000","last_became_peered":"2024-09-13T18:48:41.806150+0000","last_unstale":"2024-09-13T18:48:42.293918+0000","last_undegraded":"2024-09-13T18:48:42.293918+0000","last_fullsized":"2024-09-13T18:48:42.293918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:13.748156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.277473+0000","last_change":"2024-09-13T18:48:42.271535+0000","last_active":"2024-09-13T18:48:42.277473+0000","last_peered":"2024-09-13T18:48:42.277473+0000","last_clean":"2024-09-13T18:48:42.277473+0000","last_became_active":"2024-09-13T18:48:42.270576+0000","last_became_peered":"2024-09-13T18:48:42.270576+0000","last_unstale":"2024-09-13T18:48:42.277473+0000","last_undegraded":"2024-09-13T18:48:42.277473+0000","last_fullsized":"2024-09-13T18:48:42.277473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:19.379885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.281087+0000","last_change":"2024-09-13T18:48:41.799183+0000","last_active":"2024-09-13T18:48:42.281087+0000","last_peered":"2024-09-13T18:48:42.281087+0000","last_clean":"2024-09-13T18:48:42.281087+0000","last_became_active":"2024-09-13T18:48:41.798908+0000","last_became_peered":"2024-09-13T18:48:41.798908+0000","last_unstale":"2024-09-13T18:48:42.281087+0000","last_undegraded":"2024-09-13T18:48:42.281087+0000","last_fullsized":"2024-09-13T18:48:42.281087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:24.505099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280553+0000","last_change":"2024-09-13T18:48:42.273149+0000","last_active":"2024-09-13T18:48:42.280553+0000","last_peered":"2024-09-13T18:48:42.280553+0000","last_clean":"2024-09-13T18:48:42.280553+0000","last_became_active":"2024-09-13T18:48:42.272735+0000","last_became_peered":"2024-09-13T18:48:42.272735+0000","last_unstale":"2024-09-13T18:48:42.280553+0000","last_undegraded":"2024-09-13T18:48:42.280553+0000","last_fullsized":"2024-09-13T18:48:42.280553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:18.608032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.267612+0000","last_change":"2024-09-13T18:48:41.821426+0000","last_active":"2024-09-13T18:48:42.267612+0000","last_peered":"2024-09-13T18:48:42.267612+0000","last_clean":"2024-09-13T18:48:42.267612+0000","last_became_active":"2024-09-13T18:48:41.821130+0000","last_became_peered":"2024-09-13T18:48:41.821130+0000","last_unstale":"2024-09-13T18:48:42.267612+0000","last_undegraded":"2024-09-13T18:48:42.267612+0000","last_fullsized":"2024-09-13T18:48:42.267612+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:33.593062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290392+0000","last_change":"2024-09-13T18:48:42.281151+0000","last_active":"2024-09-13T18:48:42.290392+0000","last_peered":"2024-09-13T18:48:42.290392+0000","last_clean":"2024-09-13T18:48:42.290392+0000","last_became_active":"2024-09-13T18:48:42.280884+0000","last_became_peered":"2024-09-13T18:48:42.280884+0000","last_unstale":"2024-09-13T18:48:42.290392+0000","last_undegraded":"2024-09-13T18:48:42.290392+0000","last_fullsized":"2024-09-13T18:48:42.290392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:06.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.256588+0000","last_change":"2024-09-13T18:48:41.816339+0000","last_active":"2024-09-13T18:48:42.256588+0000","last_peered":"2024-09-13T18:48:42.256588+0000","last_clean":"2024-09-13T18:48:42.256588+0000","last_became_active":"2024-09-13T18:48:41.816042+0000","last_became_peered":"2024-09-13T18:48:41.816042+0000","last_unstale":"2024-09-13T18:48:42.256588+0000","last_undegraded":"2024-09-13T18:48:42.256588+0000","last_fullsized":"2024-09-13T18:48:42.256588+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:16.174338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.283808+0000","last_change":"2024-09-13T18:48:42.278037+0000","last_active":"2024-09-13T18:48:42.283808+0000","last_peered":"2024-09-13T18:48:42.283808+0000","last_clean":"2024-09-13T18:48:42.283808+0000","last_became_active":"2024-09-13T18:48:42.277743+0000","last_became_peered":"2024-09-13T18:48:42.277743+0000","last_unstale":"2024-09-13T18:48:42.283808+0000","last_undegraded":"2024-09-13T18:48:42.283808+0000","last_fullsized":"2024-09-13T18:48:42.283808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.968275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":18,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.296741+0000","last_change":"2024-09-13T18:48:41.817585+0000","last_active":"2024-09-13T18:48:42.296741+0000","last_peered":"2024-09-13T18:48:42.296741+0000","last_clean":"2024-09-13T18:48:42.296741+0000","last_became_active":"2024-09-13T18:48:41.817321+0000","last_became_peered":"2024-09-13T18:48:41.817321+0000","last_unstale":"2024-09-13T18:48:42.296741+0000","last_undegraded":"2024-09-13T18:48:42.296741+0000","last_fullsized":"2024-09-13T18:48:42.296741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:22.318581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.283126+0000","last_change":"2024-09-13T18:48:42.276406+0000","last_active":"2024-09-13T18:48:42.283126+0000","last_peered":"2024-09-13T18:48:42.283126+0000","last_clean":"2024-09-13T18:48:42.283126+0000","last_became_active":"2024-09-13T18:48:42.275992+0000","last_became_peered":"2024-09-13T18:48:42.275992+0000","last_unstale":"2024-09-13T18:48:42.283126+0000","last_undegraded":"2024-09-13T18:48:42.283126+0000","last_fullsized":"2024-09-13T18:48:42.283126+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:18.332423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293382+0000","last_change":"2024-09-13T18:48:41.816586+0000","last_active":"2024-09-13T18:48:42.293382+0000","last_peered":"2024-09-13T18:48:42.293382+0000","last_clean":"2024-09-13T18:48:42.293382+0000","last_became_active":"2024-09-13T18:48:41.816022+0000","last_became_peered":"2024-09-13T18:48:41.816022+0000","last_unstale":"2024-09-13T18:48:42.293382+0000","last_undegraded":"2024-09-13T18:48:42.293382+0000","last_fullsized":"2024-09-13T18:48:42.293382+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:45.197685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293312+0000","last_change":"2024-09-13T18:48:42.285483+0000","last_active":"2024-09-13T18:48:42.293312+0000","last_peered":"2024-09-13T18:48:42.293312+0000","last_clean":"2024-09-13T18:48:42.293312+0000","last_became_active":"2024-09-13T18:48:42.285199+0000","last_became_peered":"2024-09-13T18:48:42.285199+0000","last_unstale":"2024-09-13T18:48:42.293312+0000","last_undegraded":"2024-09-13T18:48:42.293312+0000","last_fullsized":"2024-09-13T18:48:42.293312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:42.257077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.294402+0000","last_change":"2024-09-13T18:48:41.823242+0000","last_active":"2024-09-13T18:48:42.294402+0000","last_peered":"2024-09-13T18:48:42.294402+0000","last_clean":"2024-09-13T18:48:42.294402+0000","last_became_active":"2024-09-13T18:48:41.822946+0000","last_became_peered":"2024-09-13T18:48:41.822946+0000","last_unstale":"2024-09-13T18:48:42.294402+0000","last_undegraded":"2024-09-13T18:48:42.294402+0000","last_fullsized":"2024-09-13T18:48:42.294402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:41:21.776313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290979+0000","last_change":"2024-09-13T18:48:42.283965+0000","last_active":"2024-09-13T18:48:42.290979+0000","last_peered":"2024-09-13T18:48:42.290979+0000","last_clean":"2024-09-13T18:48:42.290979+0000","last_became_active":"2024-09-13T18:48:42.283692+0000","last_became_peered":"2024-09-13T18:48:42.283692+0000","last_unstale":"2024-09-13T18:48:42.290979+0000","last_undegraded":"2024-09-13T18:48:42.290979+0000","last_fullsized":"2024-09-13T18:48:42.290979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:05.508995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.287690+0000","last_change":"2024-09-13T18:48:41.807156+0000","last_active":"2024-09-13T18:48:42.287690+0000","last_peered":"2024-09-13T18:48:42.287690+0000","last_clean":"2024-09-13T18:48:42.287690+0000","last_became_active":"2024-09-13T18:48:41.806873+0000","last_became_peered":"2024-09-13T18:48:41.806873+0000","last_unstale":"2024-09-13T18:48:42.287690+0000","last_undegraded":"2024-09-13T18:48:42.287690+0000","last_fullsized":"2024-09-13T18:48:42.287690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:57.772486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279877+0000","last_change":"2024-09-13T18:48:42.274139+0000","last_active":"2024-09-13T18:48:42.279877+0000","last_peered":"2024-09-13T18:48:42.279877+0000","last_clean":"2024-09-13T18:48:42.279877+0000","last_became_active":"2024-09-13T18:48:42.273946+0000","last_became_peered":"2024-09-13T18:48:42.273946+0000","last_unstale":"2024-09-13T18:48:42.279877+0000","last_undegraded":"2024-09-13T18:48:42.279877+0000","last_fullsized":"2024-09-13T18:48:42.279877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:20.370330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.271968+0000","last_change":"2024-09-13T18:48:41.806447+0000","last_active":"2024-09-13T18:48:42.271968+0000","last_peered":"2024-09-13T18:48:42.271968+0000","last_clean":"2024-09-13T18:48:42.271968+0000","last_became_active":"2024-09-13T18:48:41.805617+0000","last_became_peered":"2024-09-13T18:48:41.805617+0000","last_unstale":"2024-09-13T18:48:42.271968+0000","last_undegraded":"2024-09-13T18:48:42.271968+0000","last_fullsized":"2024-09-13T18:48:42.271968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:22.339536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290681+0000","last_change":"2024-09-13T18:48:42.282602+0000","last_active":"2024-09-13T18:48:42.290681+0000","last_peered":"2024-09-13T18:48:42.290681+0000","last_clean":"2024-09-13T18:48:42.290681+0000","last_became_active":"2024-09-13T18:48:42.281208+0000","last_became_peered":"2024-09-13T18:48:42.281208+0000","last_unstale":"2024-09-13T18:48:42.290681+0000","last_undegraded":"2024-09-13T18:48:42.290681+0000","last_fullsized":"2024-09-13T18:48:42.290681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:08.589260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.280844+0000","last_change":"2024-09-13T18:48:41.801221+0000","last_active":"2024-09-13T18:48:42.280844+0000","last_peered":"2024-09-13T18:48:42.280844+0000","last_clean":"2024-09-13T18:48:42.280844+0000","last_became_active":"2024-09-13T18:48:41.800971+0000","last_became_peered":"2024-09-13T18:48:41.800971+0000","last_unstale":"2024-09-13T18:48:42.280844+0000","last_undegraded":"2024-09-13T18:48:42.280844+0000","last_fullsized":"2024-09-13T18:48:42.280844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:05.312921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.277075+0000","last_change":"2024-09-13T18:48:42.273409+0000","last_active":"2024-09-13T18:48:42.277075+0000","last_peered":"2024-09-13T18:48:42.277075+0000","last_clean":"2024-09-13T18:48:42.277075+0000","last_became_active":"2024-09-13T18:48:42.271245+0000","last_became_peered":"2024-09-13T18:48:42.271245+0000","last_unstale":"2024-09-13T18:48:42.277075+0000","last_undegraded":"2024-09-13T18:48:42.277075+0000","last_fullsized":"2024-09-13T18:48:42.277075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.829905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.257195+0000","last_change":"2024-09-13T18:48:41.801923+0000","last_active":"2024-09-13T18:48:42.257195+0000","last_peered":"2024-09-13T18:48:42.257195+0000","last_clean":"2024-09-13T18:48:42.257195+0000","last_became_active":"2024-09-13T18:48:41.801627+0000","last_became_peered":"2024-09-13T18:48:41.801627+0000","last_unstale":"2024-09-13T18:48:42.257195+0000","last_undegraded":"2024-09-13T18:48:42.257195+0000","last_fullsized":"2024-09-13T18:48:42.257195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:46.370557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293597+0000","last_change":"2024-09-13T18:48:42.285952+0000","last_active":"2024-09-13T18:48:42.293597+0000","last_peered":"2024-09-13T18:48:42.293597+0000","last_clean":"2024-09-13T18:48:42.293597+0000","last_became_active":"2024-09-13T18:48:42.279565+0000","last_became_peered":"2024-09-13T18:48:42.279565+0000","last_unstale":"2024-09-13T18:48:42.293597+0000","last_undegraded":"2024-09-13T18:48:42.293597+0000","last_fullsized":"2024-09-13T18:48:42.293597+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:41.311115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.265606+0000","last_change":"2024-09-13T18:48:41.817025+0000","last_active":"2024-09-13T18:48:42.265606+0000","last_peered":"2024-09-13T18:48:42.265606+0000","last_clean":"2024-09-13T18:48:42.265606+0000","last_became_active":"2024-09-13T18:48:41.816771+0000","last_became_peered":"2024-09-13T18:48:41.816771+0000","last_unstale":"2024-09-13T18:48:42.265606+0000","last_undegraded":"2024-09-13T18:48:42.265606+0000","last_fullsized":"2024-09-13T18:48:42.265606+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:46.898570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.289108+0000","last_change":"2024-09-13T18:48:42.287750+0000","last_active":"2024-09-13T18:48:42.289108+0000","last_peered":"2024-09-13T18:48:42.289108+0000","last_clean":"2024-09-13T18:48:42.289108+0000","last_became_active":"2024-09-13T18:48:42.287501+0000","last_became_peered":"2024-09-13T18:48:42.287501+0000","last_unstale":"2024-09-13T18:48:42.289108+0000","last_undegraded":"2024-09-13T18:48:42.289108+0000","last_fullsized":"2024-09-13T18:48:42.289108+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:31.058353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.257986+0000","last_change":"2024-09-13T18:48:41.806022+0000","last_active":"2024-09-13T18:48:42.257986+0000","last_peered":"2024-09-13T18:48:42.257986+0000","last_clean":"2024-09-13T18:48:42.257986+0000","last_became_active":"2024-09-13T18:48:41.805173+0000","last_became_peered":"2024-09-13T18:48:41.805173+0000","last_unstale":"2024-09-13T18:48:42.257986+0000","last_undegraded":"2024-09-13T18:48:42.257986+0000","last_fullsized":"2024-09-13T18:48:42.257986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:43:47.481900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.288843+0000","last_change":"2024-09-13T18:48:42.283386+0000","last_active":"2024-09-13T18:48:42.288843+0000","last_peered":"2024-09-13T18:48:42.288843+0000","last_clean":"2024-09-13T18:48:42.288843+0000","last_became_active":"2024-09-13T18:48:42.283131+0000","last_became_peered":"2024-09-13T18:48:42.283131+0000","last_unstale":"2024-09-13T18:48:42.288843+0000","last_undegraded":"2024-09-13T18:48:42.288843+0000","last_fullsized":"2024-09-13T18:48:42.288843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:36.572254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.286042+0000","last_change":"2024-09-13T18:48:41.816752+0000","last_active":"2024-09-13T18:48:42.286042+0000","last_peered":"2024-09-13T18:48:42.286042+0000","last_clean":"2024-09-13T18:48:42.286042+0000","last_became_active":"2024-09-13T18:48:41.816358+0000","last_became_peered":"2024-09-13T18:48:41.816358+0000","last_unstale":"2024-09-13T18:48:42.286042+0000","last_undegraded":"2024-09-13T18:48:42.286042+0000","last_fullsized":"2024-09-13T18:48:42.286042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:42.033131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290643+0000","last_change":"2024-09-13T18:48:42.282718+0000","last_active":"2024-09-13T18:48:42.290643+0000","last_peered":"2024-09-13T18:48:42.290643+0000","last_clean":"2024-09-13T18:48:42.290643+0000","last_became_active":"2024-09-13T18:48:42.282420+0000","last_became_peered":"2024-09-13T18:48:42.282420+0000","last_unstale":"2024-09-13T18:48:42.290643+0000","last_undegraded":"2024-09-13T18:48:42.290643+0000","last_fullsized":"2024-09-13T18:48:42.290643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:34.597817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.257254+0000","last_change":"2024-09-13T18:48:41.807449+0000","last_active":"2024-09-13T18:48:42.257254+0000","last_peered":"2024-09-13T18:48:42.257254+0000","last_clean":"2024-09-13T18:48:42.257254+0000","last_became_active":"2024-09-13T18:48:41.807174+0000","last_became_peered":"2024-09-13T18:48:41.807174+0000","last_unstale":"2024-09-13T18:48:42.257254+0000","last_undegraded":"2024-09-13T18:48:42.257254+0000","last_fullsized":"2024-09-13T18:48:42.257254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:03.653468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.291400+0000","last_change":"2024-09-13T18:48:42.289612+0000","last_active":"2024-09-13T18:48:42.291400+0000","last_peered":"2024-09-13T18:48:42.291400+0000","last_clean":"2024-09-13T18:48:42.291400+0000","last_became_active":"2024-09-13T18:48:42.289313+0000","last_became_peered":"2024-09-13T18:48:42.289313+0000","last_unstale":"2024-09-13T18:48:42.291400+0000","last_undegraded":"2024-09-13T18:48:42.291400+0000","last_fullsized":"2024-09-13T18:48:42.291400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:08.635687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.254594+0000","last_change":"2024-09-13T18:48:41.808833+0000","last_active":"2024-09-13T18:48:42.254594+0000","last_peered":"2024-09-13T18:48:42.254594+0000","last_clean":"2024-09-13T18:48:42.254594+0000","last_became_active":"2024-09-13T18:48:41.808526+0000","last_became_peered":"2024-09-13T18:48:41.808526+0000","last_unstale":"2024-09-13T18:48:42.254594+0000","last_undegraded":"2024-09-13T18:48:42.254594+0000","last_fullsized":"2024-09-13T18:48:42.254594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:32.565861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.275757+0000","last_change":"2024-09-13T18:48:42.268608+0000","last_active":"2024-09-13T18:48:42.275757+0000","last_peered":"2024-09-13T18:48:42.275757+0000","last_clean":"2024-09-13T18:48:42.275757+0000","last_became_active":"2024-09-13T18:48:42.268386+0000","last_became_peered":"2024-09-13T18:48:42.268386+0000","last_unstale":"2024-09-13T18:48:42.275757+0000","last_undegraded":"2024-09-13T18:48:42.275757+0000","last_fullsized":"2024-09-13T18:48:42.275757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:24:39.010471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.255496+0000","last_change":"2024-09-13T18:48:41.804300+0000","last_active":"2024-09-13T18:48:42.255496+0000","last_peered":"2024-09-13T18:48:42.255496+0000","last_clean":"2024-09-13T18:48:42.255496+0000","last_became_active":"2024-09-13T18:48:41.803917+0000","last_became_peered":"2024-09-13T18:48:41.803917+0000","last_unstale":"2024-09-13T18:48:42.255496+0000","last_undegraded":"2024-09-13T18:48:42.255496+0000","last_fullsized":"2024-09-13T18:48:42.255496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:44.741081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.279391+0000","last_change":"2024-09-13T18:48:42.272776+0000","last_active":"2024-09-13T18:48:42.279391+0000","last_peered":"2024-09-13T18:48:42.279391+0000","last_clean":"2024-09-13T18:48:42.279391+0000","last_became_active":"2024-09-13T18:48:42.272528+0000","last_became_peered":"2024-09-13T18:48:42.272528+0000","last_unstale":"2024-09-13T18:48:42.279391+0000","last_undegraded":"2024-09-13T18:48:42.279391+0000","last_fullsized":"2024-09-13T18:48:42.279391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:37.829905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.256514+0000","last_change":"2024-09-13T18:48:41.814294+0000","last_active":"2024-09-13T18:48:42.256514+0000","last_peered":"2024-09-13T18:48:42.256514+0000","last_clean":"2024-09-13T18:48:42.256514+0000","last_became_active":"2024-09-13T18:48:41.813996+0000","last_became_peered":"2024-09-13T18:48:41.813996+0000","last_unstale":"2024-09-13T18:48:42.256514+0000","last_undegraded":"2024-09-13T18:48:42.256514+0000","last_fullsized":"2024-09-13T18:48:42.256514+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:07.584505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.284210+0000","last_change":"2024-09-13T18:48:42.275079+0000","last_active":"2024-09-13T18:48:42.284210+0000","last_peered":"2024-09-13T18:48:42.284210+0000","last_clean":"2024-09-13T18:48:42.284210+0000","last_became_active":"2024-09-13T18:48:42.274794+0000","last_became_peered":"2024-09-13T18:48:42.274794+0000","last_unstale":"2024-09-13T18:48:42.284210+0000","last_undegraded":"2024-09-13T18:48:42.284210+0000","last_fullsized":"2024-09-13T18:48:42.284210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:25.509854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.271368+0000","last_change":"2024-09-13T18:48:41.811101+0000","last_active":"2024-09-13T18:48:42.271368+0000","last_peered":"2024-09-13T18:48:42.271368+0000","last_clean":"2024-09-13T18:48:42.271368+0000","last_became_active":"2024-09-13T18:48:41.810749+0000","last_became_peered":"2024-09-13T18:48:41.810749+0000","last_unstale":"2024-09-13T18:48:42.271368+0000","last_undegraded":"2024-09-13T18:48:42.271368+0000","last_fullsized":"2024-09-13T18:48:42.271368+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:49.132749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.290215+0000","last_change":"2024-09-13T18:48:42.280144+0000","last_active":"2024-09-13T18:48:42.290215+0000","last_peered":"2024-09-13T18:48:42.290215+0000","last_clean":"2024-09-13T18:48:42.290215+0000","last_became_active":"2024-09-13T18:48:42.279855+0000","last_became_peered":"2024-09-13T18:48:42.279855+0000","last_unstale":"2024-09-13T18:48:42.290215+0000","last_undegraded":"2024-09-13T18:48:42.290215+0000","last_fullsized":"2024-09-13T18:48:42.290215+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:41.311115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.265731+0000","last_change":"2024-09-13T18:48:41.800780+0000","last_active":"2024-09-13T18:48:42.265731+0000","last_peered":"2024-09-13T18:48:42.265731+0000","last_clean":"2024-09-13T18:48:42.265731+0000","last_became_active":"2024-09-13T18:48:41.800374+0000","last_became_peered":"2024-09-13T18:48:41.800374+0000","last_unstale":"2024-09-13T18:48:42.265731+0000","last_undegraded":"2024-09-13T18:48:42.265731+0000","last_fullsized":"2024-09-13T18:48:42.265731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:41.252322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.293561+0000","last_change":"2024-09-13T18:48:42.285210+0000","last_active":"2024-09-13T18:48:42.293561+0000","last_peered":"2024-09-13T18:48:42.293561+0000","last_clean":"2024-09-13T18:48:42.293561+0000","last_became_active":"2024-09-13T18:48:42.279824+0000","last_became_peered":"2024-09-13T18:48:42.279824+0000","last_unstale":"2024-09-13T18:48:42.293561+0000","last_undegraded":"2024-09-13T18:48:42.293561+0000","last_fullsized":"2024-09-13T18:48:42.293561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:41.773336+0000","last_clean_scrub_stamp":"2024-09-13T18:48:41.773336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:13.280109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-13T18:48:42.266322+0000","last_change":"2024-09-13T18:48:41.819213+0000","last_active":"2024-09-13T18:48:42.266322+0000","last_peered":"2024-09-13T18:48:42.266322+0000","last_clean":"2024-09-13T18:48:42.266322+0000","last_became_active":"2024-09-13T18:48:41.818792+0000","last_became_peered":"2024-09-13T18:48:41.818792+0000","last_unstale":"2024-09-13T18:48:42.266322+0000","last_undegraded":"2024-09-13T18:48:42.266322+0000","last_fullsized":"2024-09-13T18:48:42.266322+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:48:40.768581+0000","last_clean_scrub_stamp":"2024-09-13T18:48:40.768581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:18.949258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":177,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-13T18:48:41.809274+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:48:41.809274+0000","last_peered":"2024-09-13T18:48:41.809274+0000","last_clean":"2024-09-13T18:48:41.809274+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:48:41.809274+0000","last_undegraded":"2024-09-13T18:48:41.809274+0000","last_fullsized":"2024-09-13T18:48:41.809274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":1032192,"data_stored":777863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.73399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":1.121,"5min":1.121,"15min":1.121},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.5309999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.232},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.274}]},{"osd":4,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.395},{"interface":"front","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.3080000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.367},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.5800000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.4319999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":442368,"data_stored":188077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":3.0369999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.208},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":3.7480000000000002,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.075},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":5.0490000000000004,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.2889999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":4.8630000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.1619999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.6819999999999999,"5min":2.6819999999999999,"15min":2.6819999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":1.1240000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":2.367,"5min":2.367,"15min":2.367},"last":1.2470000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":446464,"data_stored":187607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.294}]},{"osd":1,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.048}]},{"osd":2,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.3600000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.9470000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.4630000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.25,"15min":1.25},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.996},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.222}]},{"osd":6,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.268}]},{"osd":7,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.169,"5min":2.169,"15min":2.169},"last":1.131},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":2.8140000000000001,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.3129999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":446464,"data_stored":188099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.6930000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.873}]},{"osd":2,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.107},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.1319999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":0.626},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":2.4710000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.036},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":1.0129999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":2.395,"5min":2.395,"15min":2.395},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.079,"5min":1.079,"15min":1.079},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":1.1659999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":180400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.497}]},{"osd":1,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":4.0149999999999997,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.52200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":1.044,"5min":1.044,"15min":1.044},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.90700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":187565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.048,"15min":1.048},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":4.6349999999999998,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.95699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.1479999999999997,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.7009999999999996,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.2190000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":4.1920000000000002,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.252},{"interface":"front","average":{"1min":1.3,"5min":1.3,"15min":1.3},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":3.4590000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.0129999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":8.6989999999999998,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.081},{"interface":"front","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.296}]},{"osd":5,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":4.7590000000000003,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.347},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":4.335,"5min":4.335,"15min":4.335},"last":1.3839999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":4.3730000000000002,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":8.6300000000000008,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.474}]},{"osd":7,"last update":"Fri Sep 13 18:48:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":4.6699999999999999,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"min":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"max":{"1min":4.4050000000000002,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.6699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":187585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":6.1760000000000002,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.878}]},{"osd":2,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.24,"15min":1.24},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.466},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":1.411}]},{"osd":3,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":10.368,"5min":10.368,"15min":10.368},"last":1.143}]},{"osd":4,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.911,"5min":2.911,"15min":2.911},"last":1.1639999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":10.214,"5min":10.214,"15min":10.214},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.8849999999999998,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2010000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":1.6799999999999999,"5min":1.6799999999999999,"15min":1.6799999999999999},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":6.032,"5min":6.032,"15min":6.032},"last":1.252},{"interface":"front","average":{"1min":1.95,"5min":1.95,"15min":1.95},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":10.112,"5min":10.112,"15min":10.112},"last":1.3540000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:48:06 2024","interfaces":[{"interface":"back","average":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":10.172000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":1.117,"5min":1.117,"15min":1.117},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3939999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":1036288,"data_stored":777897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":4.2039999999999997,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":2.7450000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.98699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.234,"15min":1.234},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":3.7349999999999999,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.073},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":1.111}]},{"osd":3,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":4.093,"5min":4.093,"15min":4.093},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":4.7439999999999998,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.157}]},{"osd":4,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":3.4060000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":1.087,"5min":1.087,"15min":1.087},"max":{"1min":4.5449999999999999,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.264}]},{"osd":5,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":4.9390000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.345},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.651,"15min":1.651},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.8320000000000001},"min":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"max":{"1min":4.8570000000000002,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:48:05 2024","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":3.056,"5min":3.056,"15min":3.056},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"min":{"1min":1.133,"5min":1.133,"15min":1.133},"max":{"1min":4.5019999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:48:47.080 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:48:47.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:48:47.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.288+0000 7f3a5b200700 1 Processor -- start 2024-09-13T18:48:47.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a5b200700 1 -- start start 2024-09-13T18:48:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a5b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3a5c0b41c0 0x7f3a5c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a5b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c0b5780 con 0x7f3a5c0cd380 2024-09-13T18:48:47.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a59400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3a5c0cd380 0x7f3a5c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47836/0 (socket says 172.21.15.81:47836) 2024-09-13T18:48:47.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a59400700 1 -- 172.21.15.81:0/3888768242 learned_addr learned my addr 172.21.15.81:0/3888768242 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:47.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c0b5a60 con 0x7f3a5c06c5a0 2024-09-13T18:48:47.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.292+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c0b39c0 con 0x7f3a5c0b41c0 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 --2- 172.21.15.81:0/3888768242 >> v2:172.21.15.178:3300/0 conn(0x7f3a5c0b41c0 0x7f3a5c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818293349 0 0) 0x7f3a5c0b5780 con 0x7f3a5c0cd380 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a400035d0 con 0x7f3a5c0cd380 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920697136 0 0) 0x7f3a5c0b5a60 con 0x7f3a5c06c5a0 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a5c0b5780 con 0x7f3a5c06c5a0 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970308553 0 0) 0x7f3a400035d0 con 0x7f3a5c0cd380 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 >> v2:172.21.15.178:3300/0 conn(0x7f3a5c0b41c0 msgr2=0x7f3a5c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 --2- 172.21.15.81:0/3888768242 >> v2:172.21.15.178:3300/0 conn(0x7f3a5c0b41c0 0x7f3a5c0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 >> v1:172.21.15.178:6789/0 conn(0x7f3a5c06c5a0 legacy=0x7f3a5c15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c0b3ca0 con 0x7f3a5c0cd380 2024-09-13T18:48:47.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f3a48001670 con 0x7f3a5c0cd380 2024-09-13T18:48:47.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 --2- 172.21.15.81:0/3888768242 >> v2:172.21.15.178:3300/0 conn(0x7f3a5c0b41c0 0x7f3a5c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:47.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 >> v1:172.21.15.81:6789/0 conn(0x7f3a5c0cd380 legacy=0x7f3a5c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a40003bb0 0x7f3a40003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40004870 0x7f3a40004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40005230 0x7f3a4000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0b39c0 con 0x7f3a40005230 2024-09-13T18:48:47.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4000c160 con 0x7f3a40003bb0 2024-09-13T18:48:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4000c320 con 0x7f3a40004870 2024-09-13T18:48:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40005230 0x7f3a4000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a59400700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40004870 0x7f3a40004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a59e00700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a40003bb0 0x7f3a40003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 -- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40004870 msgr2=0x7f3a40004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40004870 0x7f3a40004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 -- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a40003bb0 msgr2=0x7f3a40003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a40003bb0 0x7f3a40003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 -- 172.21.15.81:0/3888768242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a400035d0 con 0x7f3a40005230 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 -- 172.21.15.81:0/3888768242 reap_dead start 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a5a800700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40005230 0x7f3a4000ba30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400e350 tx=0x7f3a400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5058067844fd179 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5400edf0 con 0x7f3a40005230 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5400f040 con 0x7f3a40005230 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.296+0000 7f3a58a00700 1 -- 172.21.15.81:0/3888768242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540146c0 con 0x7f3a40005230 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40005230 msgr2=0x7f3a4000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40005230 0x7f3a4000ba30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400e350 tx=0x7f3a400058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 shutdown_connections 2024-09-13T18:48:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 --2- 172.21.15.81:0/3888768242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40005230 0x7f3a4000ba30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 >> 172.21.15.81:0/3888768242 conn(0x7f3a5c066270 msgr2=0x7f3a5c071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 shutdown_connections 2024-09-13T18:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 -- 172.21.15.81:0/3888768242 wait complete. 2024-09-13T18:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.300+0000 7f3a5b200700 1 Processor -- start 2024-09-13T18:48:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 -- start start 2024-09-13T18:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40005230 0x7f3a5c151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 0x7f3a5c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a5c153b80 0x7f3a5c1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c153220 con 0x7f3a5c0b2400 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1525a0 con 0x7f3a5c153b80 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c152880 con 0x7f3a40005230 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 0x7f3a5c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 0x7f3a5c153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58814/0 (socket says 172.21.15.81:58814) 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 -- 172.21.15.81:0/844777913 learned_addr learned my addr 172.21.15.81:0/844777913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59e00700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40005230 0x7f3a5c151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5a800700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a5c153b80 0x7f3a5c1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 -- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40005230 msgr2=0x7f3a5c151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40005230 0x7f3a5c151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 -- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a5c153b80 msgr2=0x7f3a5c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a5c153b80 0x7f3a5c1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 -- 172.21.15.81:0/844777913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c152b60 con 0x7f3a5c0b2400 2024-09-13T18:48:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a5a800700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a5c153b80 0x7f3a5c1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a59400700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 0x7f3a5c153640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3a48007090 tx=0x7f3a480073a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.304+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a48000f80 con 0x7f3a5c0b2400 2024-09-13T18:48:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.308+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a48012560 con 0x7f3a5c0b2400 2024-09-13T18:48:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.308+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c152e40 con 0x7f3a5c0b2400 2024-09-13T18:48:47.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.308+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a480128f0 con 0x7f3a5c0b2400 2024-09-13T18:48:47.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.308+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c152350 con 0x7f3a5c0b2400 2024-09-13T18:48:47.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.308+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c0b5a60 con 0x7f3a5c0b2400 2024-09-13T18:48:47.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.308+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a48012a50 con 0x7f3a5c0b2400 2024-09-13T18:48:47.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.312+0000 7f3a52000700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a3c066730 0x7f3a3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.312+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3a480840a0 con 0x7f3a5c0b2400 2024-09-13T18:48:47.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.312+0000 7f3a59e00700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a3c066730 0x7f3a3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.312+0000 7f3a59e00700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a3c066730 0x7f3a3c068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c007900 tx=0x7f3a4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:47.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.320+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a480512d0 con 0x7f3a5c0b2400 2024-09-13T18:48:47.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.564+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3a5c0aff70 con 0x7f3a5c0b2400 2024-09-13T18:48:47.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.572+0000 7f3a52000700 1 -- 172.21.15.81:0/844777913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3a480548f0 con 0x7f3a5c0b2400 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a3c066730 msgr2=0x7f3a3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a3c066730 0x7f3a3c068bf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c007900 tx=0x7f3a4c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 msgr2=0x7f3a5c153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 0x7f3a5c153640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3a48007090 tx=0x7f3a480073a0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 shutdown_connections 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a3c066730 0x7f3a3c068bf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a5c153b80 0x7f3a5c1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a5c0b2400 0x7f3a5c153640 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 --2- 172.21.15.81:0/844777913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a40005230 0x7f3a5c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 >> 172.21.15.81:0/844777913 conn(0x7f3a5c066270 msgr2=0x7f3a5c158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 shutdown_connections 2024-09-13T18:48:47.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.576+0000 7f3a5b200700 1 -- 172.21.15.81:0/844777913 wait complete. 2024-09-13T18:48:47.587 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-13T18:48:47.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:47.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.768+0000 7f34cca00700 1 Processor -- start 2024-09-13T18:48:47.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.768+0000 7f34cca00700 1 -- start start 2024-09-13T18:48:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c81444f0 0x7f34c80ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34c80b5500 0x7f34c80cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c806aa40 con 0x7f34c806bae0 2024-09-13T18:48:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c806ad20 con 0x7f34c81444f0 2024-09-13T18:48:47.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c806b000 con 0x7f34c80b5500 2024-09-13T18:48:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f34c81444f0 0x7f34c80ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f34c806bae0 0x7f34c80b4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47838/0 (socket says 172.21.15.81:47838) 2024-09-13T18:48:47.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6a00700 1 -- 172.21.15.81:0/2547378460 learned_addr learned my addr 172.21.15.81:0/2547378460 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7e00700 1 --2- 172.21.15.81:0/2547378460 >> v2:172.21.15.178:3300/0 conn(0x7f34c80b5500 0x7f34c80cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6000700 1 -- 172.21.15.81:0/2547378460 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386039106 0 0) 0x7f34c806aa40 con 0x7f34c806bae0 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6000700 1 -- 172.21.15.81:0/2547378460 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34ac0035d0 con 0x7f34c806bae0 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7400700 1 -- 172.21.15.81:0/2547378460 >> v2:172.21.15.178:3300/0 conn(0x7f34c80b5500 msgr2=0x7f34c80cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7400700 1 --2- 172.21.15.81:0/2547378460 >> v2:172.21.15.178:3300/0 conn(0x7f34c80b5500 0x7f34c80cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7400700 1 -- 172.21.15.81:0/2547378460 >> v1:172.21.15.81:6789/0 conn(0x7f34c806bae0 legacy=0x7f34c80b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7400700 1 -- 172.21.15.81:0/2547378460 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c806b2e0 con 0x7f34c81444f0 2024-09-13T18:48:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c7400700 1 --2- 172.21.15.81:0/2547378460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c81444f0 0x7f34c80ceec0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34c80cc4d0 tx=0x7f34b8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb6c46611575671 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6000700 1 -- 172.21.15.81:0/2547378460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8011830 con 0x7f34c81444f0 2024-09-13T18:48:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6000700 1 -- 172.21.15.81:0/2547378460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b8011990 con 0x7f34c81444f0 2024-09-13T18:48:47.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34c6000700 1 -- 172.21.15.81:0/2547378460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8011d20 con 0x7f34c81444f0 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 -- 172.21.15.81:0/2547378460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c81444f0 msgr2=0x7f34c80ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.772+0000 7f34cca00700 1 --2- 172.21.15.81:0/2547378460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c81444f0 0x7f34c80ceec0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f34c80cc4d0 tx=0x7f34b8009b30 comp rx=0 tx=0).stop 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- 172.21.15.81:0/2547378460 shutdown_connections 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 --2- 172.21.15.81:0/2547378460 >> v2:172.21.15.178:3300/0 conn(0x7f34c80b5500 0x7f34c80cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 --2- 172.21.15.81:0/2547378460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c81444f0 0x7f34c80ceec0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- 172.21.15.81:0/2547378460 >> 172.21.15.81:0/2547378460 conn(0x7f34c8070d10 msgr2=0x7f34c80710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- 172.21.15.81:0/2547378460 shutdown_connections 2024-09-13T18:48:47.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- 172.21.15.81:0/2547378460 wait complete. 2024-09-13T18:48:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 Processor -- start 2024-09-13T18:48:47.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- start start 2024-09-13T18:48:47.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 0x7f34c81f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34c80b5500 0x7f34c80c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34c81444f0 0x7f34c8142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8140e60 con 0x7f34c806bae0 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81f2900 con 0x7f34c80b5500 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34cca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81f2be0 con 0x7f34c81444f0 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 0x7f34c81f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 0x7f34c81f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58824/0 (socket says 172.21.15.81:58824) 2024-09-13T18:48:47.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.776+0000 7f34c7400700 1 -- 172.21.15.81:0/1046588250 learned_addr learned my addr 172.21.15.81:0/1046588250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:47.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c7400700 1 -- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34c81444f0 msgr2=0x7f34c8142a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c7400700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34c81444f0 0x7f34c8142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c6a00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34c80b5500 0x7f34c80c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c7400700 1 -- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34c80b5500 msgr2=0x7f34c80c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c7400700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34c80b5500 0x7f34c80c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c7400700 1 -- 172.21.15.81:0/1046588250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80094b0 con 0x7f34c806bae0 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c6a00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34c80b5500 0x7f34c80c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34c7400700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 0x7f34c81f22f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f34b8014040 tx=0x7f34b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8004590 con 0x7f34c806bae0 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b801e070 con 0x7f34c806bae0 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c81f2ec0 con 0x7f34c806bae0 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80038e0 con 0x7f34c806bae0 2024-09-13T18:48:47.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c80c4f90 con 0x7f34c806bae0 2024-09-13T18:48:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c80b4df0 con 0x7f34c806bae0 2024-09-13T18:48:47.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.780+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34b8003a40 con 0x7f34c806bae0 2024-09-13T18:48:47.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.784+0000 7f34bf400700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f34a8066730 0x7f34a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:47.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.784+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f34b8085180 con 0x7f34c806bae0 2024-09-13T18:48:47.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.784+0000 7f34c6a00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f34a8066730 0x7f34a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:47.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.784+0000 7f34c6a00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f34a8066730 0x7f34a8068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34c81f2830 tx=0x7f34b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:47.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:47.788+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34b8052440 con 0x7f34c806bae0 2024-09-13T18:48:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.016+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34c80af470 con 0x7f34c806bae0 2024-09-13T18:48:48.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.016+0000 7f34bf400700 1 -- 172.21.15.81:0/1046588250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f34b8055a60 con 0x7f34c806bae0 2024-09-13T18:48:48.025 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:48.025 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5314,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:48:45.260734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5388},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:48:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f34a8066730 msgr2=0x7f34a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f34a8066730 0x7f34a8068bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f34c81f2830 tx=0x7f34b4009040 comp rx=0 tx=0).stop 2024-09-13T18:48:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 msgr2=0x7f34c81f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 0x7f34c81f22f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f34b8014040 tx=0x7f34b8004770 comp rx=0 tx=0).stop 2024-09-13T18:48:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 shutdown_connections 2024-09-13T18:48:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f34a8066730 0x7f34a8068bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34c81444f0 0x7f34c8142a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34c80b5500 0x7f34c80c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 --2- 172.21.15.81:0/1046588250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34c806bae0 0x7f34c81f22f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.020+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 >> 172.21.15.81:0/1046588250 conn(0x7f34c8070d10 msgr2=0x7f34c80af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.024+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 shutdown_connections 2024-09-13T18:48:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.024+0000 7f34cca00700 1 -- 172.21.15.81:0/1046588250 wait complete. 2024-09-13T18:48:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-13T18:48:48.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:48:42.242082+0000', 'modified': '2024-09-13T18:48:45.260734+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5388}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5388': {'gid': 5388, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6836/2473824789', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2473824789}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 2473824789}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:48:48.455 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:48:48.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:48:48.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.640+0000 7fb697000700 1 Processor -- start 2024-09-13T18:48:48.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.640+0000 7fb697000700 1 -- start start 2024-09-13T18:48:48.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6900cb700 0x7fb69006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb69006afe0 0x7fb6901636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900707d0 con 0x7fb690159bd0 2024-09-13T18:48:48.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69006b470 con 0x7fb6900cb700 2024-09-13T18:48:48.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900720a0 con 0x7fb69006afe0 2024-09-13T18:48:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6900cb700 0x7fb69006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695c00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb690159bd0 0x7fb690071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:37858/0 (socket says 172.21.15.81:37858) 2024-09-13T18:48:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695c00700 1 -- 172.21.15.81:0/2623270393 learned_addr learned my addr 172.21.15.81:0/2623270393 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:48.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6900cb700 0x7fb69006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58840/0 (socket says 172.21.15.81:58840) 2024-09-13T18:48:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb696600700 1 --2- 172.21.15.81:0/2623270393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb69006afe0 0x7fb6901636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 -- 172.21.15.81:0/2623270393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb69006afe0 msgr2=0x7fb6901636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb68fe00700 1 -- 172.21.15.81:0/2623270393 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072613885 0 0) 0x7fb6900707d0 con 0x7fb690159bd0 2024-09-13T18:48:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 --2- 172.21.15.81:0/2623270393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb69006afe0 0x7fb6901636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 -- 172.21.15.81:0/2623270393 >> v1:172.21.15.178:6789/0 conn(0x7fb690159bd0 legacy=0x7fb690071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 -- 172.21.15.81:0/2623270393 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69006fee0 con 0x7fb6900cb700 2024-09-13T18:48:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb695200700 1 --2- 172.21.15.81:0/2623270393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb69006aaa0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00bb20 tx=0x7fb67c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582294acac14e203 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb68fe00700 1 -- 172.21.15.81:0/2623270393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00dc30 con 0x7fb6900cb700 2024-09-13T18:48:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb68fe00700 1 -- 172.21.15.81:0/2623270393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c00dd90 con 0x7fb6900cb700 2024-09-13T18:48:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb68fe00700 1 -- 172.21.15.81:0/2623270393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c010690 con 0x7fb6900cb700 2024-09-13T18:48:48.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- 172.21.15.81:0/2623270393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 msgr2=0x7fb69006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 --2- 172.21.15.81:0/2623270393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb69006aaa0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00bb20 tx=0x7fb67c00be30 comp rx=0 tx=0).stop 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- 172.21.15.81:0/2623270393 shutdown_connections 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 --2- 172.21.15.81:0/2623270393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb69006afe0 0x7fb6901636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 --2- 172.21.15.81:0/2623270393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb69006aaa0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- 172.21.15.81:0/2623270393 >> 172.21.15.81:0/2623270393 conn(0x7fb6900b0c40 msgr2=0x7fb69006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- 172.21.15.81:0/2623270393 shutdown_connections 2024-09-13T18:48:48.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.644+0000 7fb697000700 1 -- 172.21.15.81:0/2623270393 wait complete. 2024-09-13T18:48:48.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.648+0000 7fb697000700 1 Processor -- start 2024-09-13T18:48:48.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.648+0000 7fb697000700 1 -- start start 2024-09-13T18:48:48.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb69006afe0 0x7fb690155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb6901f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb690159bd0 0x7fb6900c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900c5720 con 0x7fb6900cb700 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901556c0 con 0x7fb69006afe0 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901f3360 con 0x7fb690159bd0 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb6901f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb6901f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58850/0 (socket says 172.21.15.81:58850) 2024-09-13T18:48:48.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 -- 172.21.15.81:0/3295044782 learned_addr learned my addr 172.21.15.81:0/3295044782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695c00700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb69006afe0 0x7fb690155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 -- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb690159bd0 msgr2=0x7fb6900c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb696600700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb690159bd0 0x7fb6900c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb690159bd0 0x7fb6900c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 -- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb69006afe0 msgr2=0x7fb690155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb69006afe0 0x7fb690155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 -- 172.21.15.81:0/3295044782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c00b750 con 0x7fb6900cb700 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695c00700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb69006afe0 0x7fb690155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb696600700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb690159bd0 0x7fb6900c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb695200700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb6901f2370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00b2c0 tx=0x7fb67c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb68d600700 1 -- 172.21.15.81:0/3295044782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c003d00 con 0x7fb6900cb700 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb68d600700 1 -- 172.21.15.81:0/3295044782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c003e60 con 0x7fb6900cb700 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6901f2da0 con 0x7fb6900cb700 2024-09-13T18:48:48.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb68d600700 1 -- 172.21.15.81:0/3295044782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c010690 con 0x7fb6900cb700 2024-09-13T18:48:48.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.652+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6900c53b0 con 0x7fb6900cb700 2024-09-13T18:48:48.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.656+0000 7fb68d600700 1 -- 172.21.15.81:0/3295044782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb67c019400 con 0x7fb6900cb700 2024-09-13T18:48:48.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb68d600700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb670066780 0x7fb670068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb68d600700 1 -- 172.21.15.81:0/3295044782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb67c085d20 con 0x7fb6900cb700 2024-09-13T18:48:48.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695c00700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb670066780 0x7fb670068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 Processor -- start 2024-09-13T18:48:48.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 -- start start 2024-09-13T18:48:48.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695c00700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb670066780 0x7fb670068c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb684000f60 tx=0x7fb684009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x367a5da0 0x367a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 0x3676e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a66c0 0x3676edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x366cdd80 con 0x36784d00 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x366cb510 con 0x367a66c0 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x366c6e00 con 0x367a5da0 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 0x3676e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 0x3676e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58860/0 (socket says 172.21.15.81:58860) 2024-09-13T18:48:48.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 -- 172.21.15.81:0/1178434803 learned_addr learned my addr 172.21.15.81:0/1178434803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695c00700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x367a5da0 0x367a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb696600700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a66c0 0x3676edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 -- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x367a5da0 msgr2=0x367a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x367a5da0 0x367a6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 -- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a66c0 msgr2=0x3676edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a66c0 0x3676edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.660+0000 7fb695200700 1 -- 172.21.15.81:0/1178434803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x36539960 con 0x36784d00 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb696600700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a66c0 0x3676edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb695c00700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x367a5da0 0x367a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb695200700 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 0x3676e890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb67c056c10 tx=0x7fb67c056660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d254b8dda71a30c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb682000700 1 -- 172.21.15.81:0/1178434803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c05aab0 con 0x36784d00 2024-09-13T18:48:48.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb682000700 1 -- 172.21.15.81:0/1178434803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c05f070 con 0x36784d00 2024-09-13T18:48:48.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb682000700 1 -- 172.21.15.81:0/1178434803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c053390 con 0x36784d00 2024-09-13T18:48:48.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- 172.21.15.81:0/1178434803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 msgr2=0x3676e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 0x3676e890 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb67c056c10 tx=0x7fb67c056660 comp rx=0 tx=0).stop 2024-09-13T18:48:48.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- 172.21.15.81:0/1178434803 shutdown_connections 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a66c0 0x3676edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x36784d00 0x3676e890 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- 172.21.15.81:0/1178434803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x367a5da0 0x367a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- 172.21.15.81:0/1178434803 >> 172.21.15.81:0/1178434803 conn(0x364ee4d0 msgr2=0x36787c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- 172.21.15.81:0/1178434803 shutdown_connections 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- 172.21.15.81:0/1178434803 wait complete. 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- start start 2024-09-13T18:48:48.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 Processor -- start 2024-09-13T18:48:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x3675f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x3675c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x3675c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x36684730 con 0x367a66c0 2024-09-13T18:48:48.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3668a5b0 con 0x367a5da0 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.664+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x36572aa0 con 0x36784d00 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 10 client.0 _ll_register_callbacks cb 0x366c0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x3675c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x3675c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58862/0 (socket says 172.21.15.81:58862) 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 -- 172.21.15.81:0/1860498571 learned_addr learned my addr 172.21.15.81:0/1860498571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb695c00700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x3675f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb695200700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x3675c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 -- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 msgr2=0x3675f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x3675f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 -- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 msgr2=0x3675c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x3675c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 -- 172.21.15.81:0/1860498571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6900c53b0 con 0x367a66c0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb696600700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x3675c600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb688007da0 tx=0x7fb6880104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4df3621813c977f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 1 -- 172.21.15.81:0/1860498571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800e050 con 0x367a66c0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 1 -- 172.21.15.81:0/1860498571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb688010b80 con 0x367a66c0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x364fb1e0 con 0x367a66c0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 1 -- 172.21.15.81:0/1860498571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb688010d40 con 0x367a66c0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 10 client.5571 fetch_fsmap learned FSMap version 17 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x3668d220 con 0x367a66c0 2024-09-13T18:48:48.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 1 -- 172.21.15.81:0/1860498571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x364fb1e0 con 0x367a66c0 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 1 -- 172.21.15.81:0/1860498571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb688015440 con 0x367a66c0 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 10 client.5571 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 10 client.5571 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 20 client.5571 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x367afd10 0x367b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 4 client.5571 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:48:48.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x36545460 con 0x367afd10 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb695c00700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x367afd10 0x367b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb695c00700 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x367afd10 0x367b00f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20985ce26393240f server_cookie=ab16a1e00963276f in_seq=0 out_seq=0 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.668+0000 7fb676a00700 10 client.5571 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb676a00700 1 -- 172.21.15.81:0/1860498571 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x36545460 con 0x367afd10 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb676a00700 10 client.5571 handle_command_reply: tid=0 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 client.5571 shutdown 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 msgr2=0x3675c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x3675c600 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb688007da0 tx=0x7fb6880104a0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 shutdown_connections 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x367afd10 0x367b00f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x3675c600 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x3675c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 --2- 172.21.15.81:0/1860498571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x3675f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb676a00700 0 client.5571 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:48.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 >> 172.21.15.81:0/1860498571 conn(0x364ee4d0 msgr2=0x36781470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 shutdown_connections 2024-09-13T18:48:48.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 1 -- 172.21.15.81:0/1860498571 wait complete. 2024-09-13T18:48:48.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.672+0000 7fb69b998740 20 client.5571 trim_cache size 0 max 16384 2024-09-13T18:48:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.688+0000 7fb69b998740 1 Processor -- start 2024-09-13T18:48:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.688+0000 7fb69b998740 1 -- start start 2024-09-13T18:48:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.688+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x36783480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.688+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x367839c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.688+0000 7fb69b998740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x367a1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x366cb510 con 0x367a66c0 2024-09-13T18:48:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x366f5ec0 con 0x367a5da0 2024-09-13T18:48:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x367a2360 con 0x36784d00 2024-09-13T18:48:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x367a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x367a1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58866/0 (socket says 172.21.15.81:58866) 2024-09-13T18:48:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 -- 172.21.15.81:0/1824875932 learned_addr learned my addr 172.21.15.81:0/1824875932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb695200700 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x367839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb695c00700 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x36783480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 -- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 msgr2=0x36783480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x36783480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 -- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 msgr2=0x367839c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x367839c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 -- 172.21.15.81:0/1824875932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x36673450 con 0x367a66c0 2024-09-13T18:48:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb696600700 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x367a1110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb688007a40 tx=0x7fb688016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a107754d5d31019f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb682a00700 1 -- 172.21.15.81:0/1824875932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68800e040 con 0x367a66c0 2024-09-13T18:48:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb682a00700 1 -- 172.21.15.81:0/1824875932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68800f040 con 0x367a66c0 2024-09-13T18:48:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb682a00700 1 -- 172.21.15.81:0/1824875932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688009950 con 0x367a66c0 2024-09-13T18:48:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- 172.21.15.81:0/1824875932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 msgr2=0x367a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x367a1110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb688007a40 tx=0x7fb688016000 comp rx=0 tx=0).stop 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- 172.21.15.81:0/1824875932 shutdown_connections 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x367a1110 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x367839c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 --2- 172.21.15.81:0/1824875932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x36783480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- 172.21.15.81:0/1824875932 >> 172.21.15.81:0/1824875932 conn(0x364ee4d0 msgr2=0x367be3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- 172.21.15.81:0/1824875932 shutdown_connections 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.692+0000 7fb69b998740 1 -- 172.21.15.81:0/1824875932 wait complete. 2024-09-13T18:48:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 -- start start 2024-09-13T18:48:48.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 Processor -- start 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x367bd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x368084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x36806cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x366cdd80 con 0x367a66c0 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x36761b00 con 0x367a5da0 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x36785c80 con 0x36784d00 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 10 client.0 _ll_register_callbacks cb 0x3671d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x36806cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x36806cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58868/0 (socket says 172.21.15.81:58868) 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 -- 172.21.15.81:0/2118164132 learned_addr learned my addr 172.21.15.81:0/2118164132 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb695200700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x368084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb695c00700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x367bd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 -- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 msgr2=0x367bd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x367bd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 -- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 msgr2=0x368084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x368084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 -- 172.21.15.81:0/2118164132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3668d220 con 0x367a66c0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb695200700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x368084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb696600700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x36806cb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb68800b010 tx=0x7fb688004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327ad36571aec2eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb676a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb676a00700 1 -- 172.21.15.81:0/2118164132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688010ab0 con 0x367a66c0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb676a00700 1 -- 172.21.15.81:0/2118164132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb688010c10 con 0x367a66c0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb67c05f070 con 0x367a66c0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb676a00700 1 -- 172.21.15.81:0/2118164132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb688010df0 con 0x367a66c0 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 10 client.5577 fetch_fsmap learned FSMap version 17 2024-09-13T18:48:48.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.696+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x36667720 con 0x367a66c0 2024-09-13T18:48:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb676a00700 1 -- 172.21.15.81:0/2118164132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c05f070 con 0x367a66c0 2024-09-13T18:48:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb676a00700 1 -- 172.21.15.81:0/2118164132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb68802e020 con 0x367a66c0 2024-09-13T18:48:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 10 client.5577 fetch_fsmap finished waiting for FSMap version 17 2024-09-13T18:48:48.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 10 client.5577 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:48:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 20 client.5577 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x36808a60 0x368071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 4 client.5577 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:48:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "status"}) v1 -- 0x3656a1e0 con 0x36808a60 2024-09-13T18:48:48.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb695c00700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x36808a60 0x368071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb676a00700 10 client.5577 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb695c00700 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x36808a60 0x368071f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e754beb53c2dc10 server_cookie=b636e50e431769ca in_seq=0 out_seq=0 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb676a00700 1 -- 172.21.15.81:0/2118164132 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x3656a1e0 con 0x36808a60 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb676a00700 10 client.5577 handle_command_reply: tid=0 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 client.5577 shutdown 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 msgr2=0x36806cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x36806cb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb68800b010 tx=0x7fb688004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 shutdown_connections 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x36808a60 0x368071f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x367a66c0 0x36806cb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x367a5da0 0x368084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb676a00700 0 client.5577 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 --2- 172.21.15.81:0/2118164132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x36784d00 0x367bd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 >> 172.21.15.81:0/2118164132 conn(0x364ee4d0 msgr2=0x36780040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 shutdown_connections 2024-09-13T18:48:48.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 1 -- 172.21.15.81:0/2118164132 wait complete. 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.700+0000 7fb69b998740 20 client.5577 trim_cache size 0 max 16384 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5388, 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.4555218249999999, 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 17, 2024-09-13T18:48:48.711 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 39, 2024-09-13T18:48:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 39, 2024-09-13T18:48:48.712 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 14.739987960000001 2024-09-13T18:48:48.712 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:48:48.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb670066780 msgr2=0x7fb670068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb670066780 0x7fb670068c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb684000f60 tx=0x7fb684009040 comp rx=0 tx=0).stop 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 msgr2=0x7fb6901f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb6901f2370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00b2c0 tx=0x7fb67c004770 comp rx=0 tx=0).stop 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 shutdown_connections 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb670066780 0x7fb670068c40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb690159bd0 0x7fb6900c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6900cb700 0x7fb6901f2370 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 --2- 172.21.15.81:0/3295044782 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb69006afe0 0x7fb690155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 >> 172.21.15.81:0/3295044782 conn(0x7fb6900b0c40 msgr2=0x7fb6900afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 shutdown_connections 2024-09-13T18:48:48.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.704+0000 7fb697000700 1 -- 172.21.15.81:0/3295044782 wait complete. 2024-09-13T18:48:48.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:48:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.892+0000 7ff061600700 1 Processor -- start 2024-09-13T18:48:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.892+0000 7ff061600700 1 -- start start 2024-09-13T18:48:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff061600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff05c071d20 0x7ff05c0b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff061600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff061600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c0ce140 con 0x7ff05c06a5d0 2024-09-13T18:48:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff061600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c0cde60 con 0x7ff05c071d20 2024-09-13T18:48:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff061600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c06c3b0 con 0x7ff05c0cd610 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff05c071d20 0x7ff05c0b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff05c071d20 0x7ff05c0b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58880/0 (socket says 172.21.15.81:58880) 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 -- 172.21.15.81:0/2517892953 learned_addr learned my addr 172.21.15.81:0/2517892953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff05b400700 1 --2- 172.21.15.81:0/2517892953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 -- 172.21.15.81:0/2517892953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 msgr2=0x7ff05c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 --2- 172.21.15.81:0/2517892953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c06ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 -- 172.21.15.81:0/2517892953 >> v1:172.21.15.178:6789/0 conn(0x7ff05c06a5d0 legacy=0x7ff05c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 -- 172.21.15.81:0/2517892953 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c06c690 con 0x7ff05c071d20 2024-09-13T18:48:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.896+0000 7ff053e00700 1 --2- 172.21.15.81:0/2517892953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c071d20 0x7ff05c0b19f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff044009910 tx=0x7ff044009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b4ba486190fc6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff05a000700 1 -- 172.21.15.81:0/2517892953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044011830 con 0x7ff05c071d20 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff05a000700 1 -- 172.21.15.81:0/2517892953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044011990 con 0x7ff05c071d20 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff05a000700 1 -- 172.21.15.81:0/2517892953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044011d40 con 0x7ff05c071d20 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 -- 172.21.15.81:0/2517892953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c071d20 msgr2=0x7ff05c0b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 --2- 172.21.15.81:0/2517892953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c071d20 0x7ff05c0b19f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff044009910 tx=0x7ff044009c20 comp rx=0 tx=0).stop 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 -- 172.21.15.81:0/2517892953 shutdown_connections 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 --2- 172.21.15.81:0/2517892953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c06ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 --2- 172.21.15.81:0/2517892953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c071d20 0x7ff05c0b19f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 -- 172.21.15.81:0/2517892953 >> 172.21.15.81:0/2517892953 conn(0x7ff05c0b08d0 msgr2=0x7ff05c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 -- 172.21.15.81:0/2517892953 shutdown_connections 2024-09-13T18:48:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 -- 172.21.15.81:0/2517892953 wait complete. 2024-09-13T18:48:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 Processor -- start 2024-09-13T18:48:48.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.900+0000 7ff061600700 1 -- start start 2024-09-13T18:48:48.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 0x7ff05c143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c071d20 0x7ff05c1f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c1f7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1440a0 con 0x7ff05c06a5d0 2024-09-13T18:48:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c144380 con 0x7ff05c071d20 2024-09-13T18:48:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c144660 con 0x7ff05c0cd610 2024-09-13T18:48:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 0x7ff05c143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 0x7ff05c143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58892/0 (socket says 172.21.15.81:58892) 2024-09-13T18:48:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 -- 172.21.15.81:0/3682787145 learned_addr learned my addr 172.21.15.81:0/3682787145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05b400700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c1f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff053e00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c071d20 0x7ff05c1f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 -- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 msgr2=0x7ff05c1f7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c1f7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 -- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c071d20 msgr2=0x7ff05c1f9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c071d20 0x7ff05c1f9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 -- 172.21.15.81:0/3682787145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044009570 con 0x7ff05c06a5d0 2024-09-13T18:48:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff05aa00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 0x7ff05c143710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c500 tx=0x7ff04c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0052d0 con 0x7ff05c06a5d0 2024-09-13T18:48:48.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c005430 con 0x7ff05c06a5d0 2024-09-13T18:48:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c144940 con 0x7ff05c06a5d0 2024-09-13T18:48:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0055a0 con 0x7ff05c06a5d0 2024-09-13T18:48:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.904+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c143c50 con 0x7ff05c06a5d0 2024-09-13T18:48:48.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.908+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c144e60 con 0x7ff05c06a5d0 2024-09-13T18:48:48.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.908+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff04c0038e0 con 0x7ff05c06a5d0 2024-09-13T18:48:48.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.912+0000 7ff052a00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff038066730 0x7ff038068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:48.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.912+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff04c0836e0 con 0x7ff05c06a5d0 2024-09-13T18:48:48.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.912+0000 7ff053e00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff038066730 0x7ff038068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:48.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.912+0000 7ff053e00700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff038066730 0x7ff038068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff044000c00 tx=0x7ff044008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:48.916+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff05c144e60 con 0x7ff05c06a5d0 2024-09-13T18:48:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.152+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff05c144e60 con 0x7ff05c06a5d0 2024-09-13T18:48:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.152+0000 7ff052a00700 1 -- 172.21.15.81:0/3682787145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff05c144e60 con 0x7ff05c06a5d0 2024-09-13T18:48:49.161 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:48:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff038066730 msgr2=0x7ff038068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff038066730 0x7ff038068bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff044000c00 tx=0x7ff044008030 comp rx=0 tx=0).stop 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 msgr2=0x7ff05c143710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 0x7ff05c143710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c500 tx=0x7ff04c00c810 comp rx=0 tx=0).stop 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 shutdown_connections 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff038066730 0x7ff038068bf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0cd610 0x7ff05c1f7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c071d20 0x7ff05c1f9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 --2- 172.21.15.81:0/3682787145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff05c06a5d0 0x7ff05c143710 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 >> 172.21.15.81:0/3682787145 conn(0x7ff05c0b08d0 msgr2=0x7ff05c149cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 shutdown_connections 2024-09-13T18:48:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:49.156+0000 7ff061600700 1 -- 172.21.15.81:0/3682787145 wait complete. 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:48:49.190 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:48:49.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:48:49.191 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:48:49.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.191 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:48:49.206 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:48:49.207 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42363sec preferred_lft 42363sec 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:48:49.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::3069:26ff:fefd:eadb/64 scope link 2024-09-13T18:48:49.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:48:49.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.210 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:48:49.292 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:48:49.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.295 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:48:49.364 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:48:49.365 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:48:49.365 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:48:49.365 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:48:49.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:48:49.365 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:48:49.366 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:48:49.366 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:48:49.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.366 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:48:49.367 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:48:49.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:48:49.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:48:49.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:48:49.367 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:48:49.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.491 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:48:49.505 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:48:49.505 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:48:49.507 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:48:49.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:48:49.584 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:48:49.584 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:48:49.644 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:48:49.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:48:49.645 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:48:49.703 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:48:49.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:48:49.832 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:48:49.833 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:48:49.858 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:48:49.859 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:48:49.859 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:48:49.859 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:48:49.859 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:48:49.865 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:48:49.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:48:49.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:49.899 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:48:49.980 INFO:teuthology.orchestra.run.smithi081.stdout:client5491 2024-09-13T18:48:49.981 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:48:49.981 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:50.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:48:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.260+0000 7f79e3400700 1 Processor -- start 2024-09-13T18:48:50.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.260+0000 7f79e3400700 1 -- start start 2024-09-13T18:48:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e3400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79dc157500 0x7f79dc0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e3400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc0b57e0 con 0x7f79dc15e030 2024-09-13T18:48:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e3400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc0b3b80 con 0x7f79dc0cd140 2024-09-13T18:48:50.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e3400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc0b5a80 con 0x7f79dc157500 2024-09-13T18:48:50.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79dbe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79dc15e030 0x7f79dc070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47840/0 (socket says 172.21.15.81:47840) 2024-09-13T18:48:50.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79dbe00700 1 -- 172.21.15.81:0/4245162567 learned_addr learned my addr 172.21.15.81:0/4245162567 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:50.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e0a00700 1 --2- 172.21.15.81:0/4245162567 >> v2:172.21.15.178:3300/0 conn(0x7f79dc157500 0x7f79dc0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274947260 0 0) 0x7f79dc0b57e0 con 0x7f79dc15e030 2024-09-13T18:48:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c40035d0 con 0x7f79dc15e030 2024-09-13T18:48:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054032960 0 0) 0x7f79dc0b3b80 con 0x7f79dc0cd140 2024-09-13T18:48:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc0b57e0 con 0x7f79dc0cd140 2024-09-13T18:48:50.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e0a00700 1 -- 172.21.15.81:0/4245162567 >> v1:172.21.15.178:6789/0 conn(0x7f79dc0cd140 legacy=0x7f79dc160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e0a00700 1 -- 172.21.15.81:0/4245162567 >> v1:172.21.15.81:6789/0 conn(0x7f79dc15e030 legacy=0x7f79dc070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.264+0000 7f79e0a00700 1 -- 172.21.15.81:0/4245162567 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0b5d60 con 0x7f79dc157500 2024-09-13T18:48:50.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e0a00700 1 --2- 172.21.15.81:0/4245162567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0ce700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009880 tx=0x7f79d0009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47e89362cca75254 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0011830 con 0x7f79dc157500 2024-09-13T18:48:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0011990 con 0x7f79dc157500 2024-09-13T18:48:50.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79db400700 1 -- 172.21.15.81:0/4245162567 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0011d00 con 0x7f79dc157500 2024-09-13T18:48:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 -- 172.21.15.81:0/4245162567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 msgr2=0x7f79dc0ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 --2- 172.21.15.81:0/4245162567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0ce700 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f79d0009880 tx=0x7f79d0009b90 comp rx=0 tx=0).stop 2024-09-13T18:48:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 -- 172.21.15.81:0/4245162567 shutdown_connections 2024-09-13T18:48:50.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 --2- 172.21.15.81:0/4245162567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0ce700 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 -- 172.21.15.81:0/4245162567 >> 172.21.15.81:0/4245162567 conn(0x7f79dc06e660 msgr2=0x7f79dc06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 -- 172.21.15.81:0/4245162567 shutdown_connections 2024-09-13T18:48:50.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.268+0000 7f79e3400700 1 -- 172.21.15.81:0/4245162567 wait complete. 2024-09-13T18:48:50.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.272+0000 7f79e3400700 1 Processor -- start 2024-09-13T18:48:50.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.272+0000 7f79e3400700 1 -- start start 2024-09-13T18:48:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 0x7f79dc147170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79dc15e030 0x7f79dc06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc1476b0 con 0x7f79dc0cd140 2024-09-13T18:48:50.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0cb2a0 con 0x7f79dc157500 2024-09-13T18:48:50.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0c9fa0 con 0x7f79dc15e030 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 0x7f79dc147170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 0x7f79dc147170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58902/0 (socket says 172.21.15.81:58902) 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e0a00700 1 -- 172.21.15.81:0/2021884552 learned_addr learned my addr 172.21.15.81:0/2021884552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e1400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79dc15e030 0x7f79dc06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 -- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79dc15e030 msgr2=0x7f79dc06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79dc15e030 0x7f79dc06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 -- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 msgr2=0x7f79dc147170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 0x7f79dc147170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 -- 172.21.15.81:0/2021884552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00094b0 con 0x7f79dc157500 2024-09-13T18:48:50.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e0a00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 0x7f79dc147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79dbe00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0cad60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79c80011e0 tx=0x7f79c800c700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8005b40 con 0x7f79dc157500 2024-09-13T18:48:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c8005ca0 con 0x7f79dc157500 2024-09-13T18:48:50.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc0ca280 con 0x7f79dc157500 2024-09-13T18:48:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79c8007310 con 0x7f79dc157500 2024-09-13T18:48:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.276+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc0ca840 con 0x7f79dc157500 2024-09-13T18:48:50.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.280+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc0caa60 con 0x7f79dc157500 2024-09-13T18:48:50.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.280+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79c8007470 con 0x7f79dc157500 2024-09-13T18:48:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.280+0000 7f79d8c00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79bc066730 0x7f79bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:50.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.284+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f79c8083510 con 0x7f79dc157500 2024-09-13T18:48:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.284+0000 7f79e0a00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79bc066730 0x7f79bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:50.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.284+0000 7f79e0a00700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79bc066730 0x7f79bc068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f79d0000c00 tx=0x7f79d0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:50.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.288+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79c80507d0 con 0x7f79dc157500 2024-09-13T18:48:50.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:50.508+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f79dc0ce700 con 0x7f79dc157500 2024-09-13T18:48:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.300+0000 7f79d8c00700 1 -- 172.21.15.81:0/2021884552 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f79c8053df0 con 0x7f79dc157500 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79bc066730 msgr2=0x7f79bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79bc066730 0x7f79bc068bf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f79d0000c00 tx=0x7f79d0008030 comp rx=0 tx=0).stop 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 msgr2=0x7f79dc0cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0cad60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79c80011e0 tx=0x7f79c800c700 comp rx=0 tx=0).stop 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 shutdown_connections 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79bc066730 0x7f79bc068bf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79dc15e030 0x7f79dc06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79dc157500 0x7f79dc0cad60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 --2- 172.21.15.81:0/2021884552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc0cd140 0x7f79dc147170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 >> 172.21.15.81:0/2021884552 conn(0x7f79dc06e660 msgr2=0x7f79dc0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 shutdown_connections 2024-09-13T18:48:51.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.304+0000 7f79e3400700 1 -- 172.21.15.81:0/2021884552 wait complete. 2024-09-13T18:48:51.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2f800700 1 Processor -- start 2024-09-13T18:48:51.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2f800700 1 -- start start 2024-09-13T18:48:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2f800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d2806a5d0 0x7f2d2806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2f800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d280cdd90 con 0x7f2d2806c460 2024-09-13T18:48:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2f800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2806ce10 con 0x7f2d2815b700 2024-09-13T18:48:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2f800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2806afa0 con 0x7f2d2806a5d0 2024-09-13T18:48:51.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d2806c460 0x7f2d2806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47854/0 (socket says 172.21.15.81:47854) 2024-09-13T18:48:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27e00700 1 -- 172.21.15.81:0/1275405558 learned_addr learned my addr 172.21.15.81:0/1275405558 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402541182 0 0) 0x7f2d280cdd90 con 0x7f2d2806c460 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d100035d0 con 0x7f2d2806c460 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d2d800700 1 --2- 172.21.15.81:0/1275405558 >> v2:172.21.15.178:3300/0 conn(0x7f2d2806a5d0 0x7f2d2806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877312828 0 0) 0x7f2d100035d0 con 0x7f2d2806c460 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 >> v2:172.21.15.178:3300/0 conn(0x7f2d2806a5d0 msgr2=0x7f2d2806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 --2- 172.21.15.81:0/1275405558 >> v2:172.21.15.178:3300/0 conn(0x7f2d2806a5d0 0x7f2d2806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 >> v1:172.21.15.178:6789/0 conn(0x7f2d2815b700 legacy=0x7f2d2815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280cd4f0 con 0x7f2d2806c460 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f2d18001670 con 0x7f2d2806c460 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 >> v1:172.21.15.81:6789/0 conn(0x7f2d2806c460 legacy=0x7f2d2806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d10003a20 0x7f2d10003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d10004870 0x7f2d10004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10005350 0x7f2d1000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.496+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2806afa0 con 0x7f2d10004870 2024-09-13T18:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1000c220 con 0x7f2d10003a20 2024-09-13T18:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1000c3e0 con 0x7f2d10005350 2024-09-13T18:48:51.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d10004870 0x7f2d10004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2ce00700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d10003a20 0x7f2d10003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 -- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10005350 msgr2=0x7f2d1000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10005350 0x7f2d1000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 -- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d10003a20 msgr2=0x7f2d10003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:51.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d10003a20 0x7f2d10003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 -- 172.21.15.81:0/1275405558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100035d0 con 0x7f2d10004870 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2d800700 1 -- 172.21.15.81:0/1275405558 reap_dead start 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2ce00700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d10003a20 0x7f2d10003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27e00700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d10004870 0x7f2d10004cf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800c2f0 tx=0x7f2d100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5d8d165c3dabc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18007c30 con 0x7f2d10004870 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1800ce50 con 0x7f2d10004870 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d27400700 1 -- 172.21.15.81:0/1275405558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18005bc0 con 0x7f2d10004870 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 -- 172.21.15.81:0/1275405558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d10004870 msgr2=0x7f2d10004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d10004870 0x7f2d10004cf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800c2f0 tx=0x7f2d100058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 -- 172.21.15.81:0/1275405558 shutdown_connections 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 --2- 172.21.15.81:0/1275405558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d10004870 0x7f2d10004cf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 -- 172.21.15.81:0/1275405558 >> 172.21.15.81:0/1275405558 conn(0x7f2d280b08d0 msgr2=0x7f2d280b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 -- 172.21.15.81:0/1275405558 shutdown_connections 2024-09-13T18:48:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.500+0000 7f2d2f800700 1 -- 172.21.15.81:0/1275405558 wait complete. 2024-09-13T18:48:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 Processor -- start 2024-09-13T18:48:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 -- start start 2024-09-13T18:48:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10004870 0x7f2d2814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d28147230 0x7f2d280af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 0x7f2d2814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28148be0 con 0x7f2d281476b0 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28147f60 con 0x7f2d28147230 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2f800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d28148240 con 0x7f2d10004870 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 0x7f2d2814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 0x7f2d2814dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58912/0 (socket says 172.21.15.81:58912) 2024-09-13T18:48:51.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 -- 172.21.15.81:0/55561669 learned_addr learned my addr 172.21.15.81:0/55561669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2ce00700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10004870 0x7f2d2814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d27e00700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d28147230 0x7f2d280af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 -- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10004870 msgr2=0x7f2d2814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10004870 0x7f2d2814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 -- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d28147230 msgr2=0x7f2d280af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d28147230 0x7f2d280af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.504+0000 7f2d2d800700 1 -- 172.21.15.81:0/55561669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d28148520 con 0x7f2d281476b0 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d2d800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 0x7f2d2814dac0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2d280cc710 tx=0x7f2d20007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2000ea70 con 0x7f2d281476b0 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2000ebf0 con 0x7f2d281476b0 2024-09-13T18:48:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d28148800 con 0x7f2d281476b0 2024-09-13T18:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20014420 con 0x7f2d281476b0 2024-09-13T18:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2814b6d0 con 0x7f2d281476b0 2024-09-13T18:48:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.508+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d28148d20 con 0x7f2d281476b0 2024-09-13T18:48:51.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.512+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d20014580 con 0x7f2d281476b0 2024-09-13T18:48:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.512+0000 7f2d24c00700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d0c066730 0x7f2d0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.512+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2d20084560 con 0x7f2d281476b0 2024-09-13T18:48:51.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.512+0000 7f2d2ce00700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d0c066730 0x7f2d0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:51.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.512+0000 7f2d2ce00700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d0c066730 0x7f2d0c068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007fd0 tx=0x7f2d1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:51.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.516+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d28148d20 con 0x7f2d281476b0 2024-09-13T18:48:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.752+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d28148d20 con 0x7f2d281476b0 2024-09-13T18:48:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.752+0000 7f2d24c00700 1 -- 172.21.15.81:0/55561669 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4753 (secure 0 0 0) 0x7f2d28148d20 con 0x7f2d281476b0 2024-09-13T18:48:51.760 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:51.760 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5006,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:48:51.301304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5388,"mds_1":5314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:creating","state_seq":1,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d0c066730 msgr2=0x7f2d0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d0c066730 0x7f2d0c068bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007fd0 tx=0x7f2d1c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 msgr2=0x7f2d2814dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 0x7f2d2814dac0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2d280cc710 tx=0x7f2d20007ef0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 shutdown_connections 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d0c066730 0x7f2d0c068bf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d281476b0 0x7f2d2814dac0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d28147230 0x7f2d280af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 --2- 172.21.15.81:0/55561669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d10004870 0x7f2d2814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 >> 172.21.15.81:0/55561669 conn(0x7f2d280b08d0 msgr2=0x7f2d2815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 shutdown_connections 2024-09-13T18:48:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:51.756+0000 7f2d2f800700 1 -- 172.21.15.81:0/55561669 wait complete. 2024-09-13T18:48:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 19 2024-09-13T18:48:52.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:48:42.242082+0000', 'modified': '2024-09-13T18:48:51.301304+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5388, 'mds_1': 5314}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5314': {'gid': 5314, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.81:6837/3633246084', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3633246084}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3633246084}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5388': {'gid': 5388, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6836/2473824789', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2473824789}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 2473824789}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:48:52.188 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5314:up:creating 2024-09-13T18:48:53.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.356+0000 7fee2be00700 1 Processor -- start 2024-09-13T18:48:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.356+0000 7fee2be00700 1 -- start start 2024-09-13T18:48:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee2c0cb020 0x7fee2c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c06aaa0 0x7fee2c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c06b430 con 0x7fee2c15c2a0 2024-09-13T18:48:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2be00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0b2ad0 con 0x7fee2c0cb020 2024-09-13T18:48:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c15b960 con 0x7fee2c06aaa0 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee2c0cb020 0x7fee2c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee2c0cb020 0x7fee2c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58914/0 (socket says 172.21.15.81:58914) 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 -- 172.21.15.81:0/2036235831 learned_addr learned my addr 172.21.15.81:0/2036235831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2b400700 1 --2- 172.21.15.81:0/2036235831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c06aaa0 0x7fee2c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 -- 172.21.15.81:0/2036235831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c06aaa0 msgr2=0x7fee2c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 --2- 172.21.15.81:0/2036235831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c06aaa0 0x7fee2c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 -- 172.21.15.81:0/2036235831 >> v1:172.21.15.178:6789/0 conn(0x7fee2c15c2a0 legacy=0x7fee2c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 -- 172.21.15.81:0/2036235831 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c15bc40 con 0x7fee2c0cb020 2024-09-13T18:48:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee29600700 1 -- 172.21.15.81:0/2036235831 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804521891 0 0) 0x7fee18001110 con 0x7fee2c15c2a0 2024-09-13T18:48:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.360+0000 7fee2aa00700 1 --2- 172.21.15.81:0/2036235831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c0cb020 0x7fee2c0cc6f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009e50 tx=0x7fee1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e92a380e00ea74d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee29600700 1 -- 172.21.15.81:0/2036235831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00e070 con 0x7fee2c0cb020 2024-09-13T18:48:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee29600700 1 -- 172.21.15.81:0/2036235831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c00b9c0 con 0x7fee2c0cb020 2024-09-13T18:48:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee29600700 1 -- 172.21.15.81:0/2036235831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00bd70 con 0x7fee2c0cb020 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 -- 172.21.15.81:0/2036235831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c0cb020 msgr2=0x7fee2c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 --2- 172.21.15.81:0/2036235831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c0cb020 0x7fee2c0cc6f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009e50 tx=0x7fee1c00b330 comp rx=0 tx=0).stop 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 -- 172.21.15.81:0/2036235831 shutdown_connections 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 --2- 172.21.15.81:0/2036235831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c06aaa0 0x7fee2c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 --2- 172.21.15.81:0/2036235831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c0cb020 0x7fee2c0cc6f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 -- 172.21.15.81:0/2036235831 >> 172.21.15.81:0/2036235831 conn(0x7fee2c0b0c40 msgr2=0x7fee2c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:53.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 -- 172.21.15.81:0/2036235831 shutdown_connections 2024-09-13T18:48:53.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.364+0000 7fee2be00700 1 -- 172.21.15.81:0/2036235831 wait complete. 2024-09-13T18:48:53.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 Processor -- start 2024-09-13T18:48:53.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 -- start start 2024-09-13T18:48:53.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 0x7fee2c14bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0cb020 0x7fee2c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c15c2a0 0x7fee2c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14e100 con 0x7fee2c06aaa0 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14e3e0 con 0x7fee2c0cb020 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.368+0000 7fee2be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14e6c0 con 0x7fee2c15c2a0 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 0x7fee2c14bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 0x7fee2c14bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58926/0 (socket says 172.21.15.81:58926) 2024-09-13T18:48:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 -- 172.21.15.81:0/3894990738 learned_addr learned my addr 172.21.15.81:0/3894990738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2b400700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c15c2a0 0x7fee2c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2a000700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0cb020 0x7fee2c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 -- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c15c2a0 msgr2=0x7fee2c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c15c2a0 0x7fee2c1577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 -- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0cb020 msgr2=0x7fee2c150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0cb020 0x7fee2c150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 -- 172.21.15.81:0/3894990738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c009b30 con 0x7fee2c06aaa0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2aa00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 0x7fee2c14bbb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0b1690 tx=0x7fee1c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0099b0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0092e0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c14e9a0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c01c640 con 0x7fee2c06aaa0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c14c0f0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.372+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c06aef0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.376+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee1c01c7a0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.376+0000 7fee22a00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee0c066760 0x7fee0c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.376+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fee1c085d50 con 0x7fee2c06aaa0 2024-09-13T18:48:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.376+0000 7fee2a000700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee0c066760 0x7fee0c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:53.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.376+0000 7fee2a000700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee0c066760 0x7fee0c068c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee2c1e6c60 tx=0x7fee18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:53.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.384+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee1c052ef0 con 0x7fee2c06aaa0 2024-09-13T18:48:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.604+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee2c14e240 con 0x7fee2c06aaa0 2024-09-13T18:48:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee22a00700 1 -- 172.21.15.81:0/3894990738 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4765 (secure 0 0 0) 0x7fee2c14e240 con 0x7fee2c06aaa0 2024-09-13T18:48:53.614 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:53.614 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:48:53.315224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5388,"mds_1":5314,"mds_2":5006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5006":{"gid":5006,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee0c066760 msgr2=0x7fee0c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee0c066760 0x7fee0c068c20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fee2c1e6c60 tx=0x7fee18009040 comp rx=0 tx=0).stop 2024-09-13T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 msgr2=0x7fee2c14bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 0x7fee2c14bbb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0b1690 tx=0x7fee1c004af0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 shutdown_connections 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee0c066760 0x7fee0c068c20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee2c15c2a0 0x7fee2c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee2c0cb020 0x7fee2c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 --2- 172.21.15.81:0/3894990738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2c06aaa0 0x7fee2c14bbb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 >> 172.21.15.81:0/3894990738 conn(0x7fee2c0b0c40 msgr2=0x7fee2c15a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 shutdown_connections 2024-09-13T18:48:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:53.608+0000 7fee2be00700 1 -- 172.21.15.81:0/3894990738 wait complete. 2024-09-13T18:48:53.619 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-13T18:48:54.039 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:48:42.242082+0000', 'modified': '2024-09-13T18:48:53.315224+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5388, 'mds_1': 5314, 'mds_2': 5006}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5006': {'gid': 5006, 'name': 'd', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.178:6835/628924969', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 628924969}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 628924969}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5314': {'gid': 5314, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.81:6837/3633246084', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 3633246084}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3633246084}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_5388': {'gid': 5388, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.81:6836/2473824789', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 2473824789}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 2473824789}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:48:54.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:48:54.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:48:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.212+0000 7f83ed600700 1 Processor -- start 2024-09-13T18:48:54.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.212+0000 7f83ed600700 1 -- start start 2024-09-13T18:48:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ed600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f83e80cb020 0x7f83e80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ed600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ed600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e80b2ad0 con 0x7f83e806aaa0 2024-09-13T18:48:54.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ed600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e815b960 con 0x7f83e80cb020 2024-09-13T18:48:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ed600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e815bc40 con 0x7f83e815c2a0 2024-09-13T18:48:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ecc00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f83e806aaa0 0x7f83e80b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47868/0 (socket says 172.21.15.81:47868) 2024-09-13T18:48:54.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83ecc00700 1 -- 172.21.15.81:0/2280052585 learned_addr learned my addr 172.21.15.81:0/2280052585 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2280052585 >> v2:172.21.15.81:3300/0 conn(0x7f83e80cb020 0x7f83e80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7400700 1 --2- 172.21.15.81:0/2280052585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e6a00700 1 -- 172.21.15.81:0/2280052585 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464437070 0 0) 0x7f83e80b2ad0 con 0x7f83e806aaa0 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e6a00700 1 -- 172.21.15.81:0/2280052585 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83cc0035d0 con 0x7f83e806aaa0 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7e00700 1 -- 172.21.15.81:0/2280052585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 msgr2=0x7f83e815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2280052585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7e00700 1 -- 172.21.15.81:0/2280052585 >> v1:172.21.15.81:6789/0 conn(0x7f83e806aaa0 legacy=0x7f83e80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7e00700 1 -- 172.21.15.81:0/2280052585 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e815bf20 con 0x7f83e80cb020 2024-09-13T18:48:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.216+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2280052585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e80cb020 0x7f83e80cc6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009850 tx=0x7f83d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ddb55b8fe7abd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83e6a00700 1 -- 172.21.15.81:0/2280052585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8011830 con 0x7f83e80cb020 2024-09-13T18:48:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83e6a00700 1 -- 172.21.15.81:0/2280052585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8011990 con 0x7f83e80cb020 2024-09-13T18:48:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83e6a00700 1 -- 172.21.15.81:0/2280052585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8011d00 con 0x7f83e80cb020 2024-09-13T18:48:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 -- 172.21.15.81:0/2280052585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e80cb020 msgr2=0x7f83e80cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 --2- 172.21.15.81:0/2280052585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e80cb020 0x7f83e80cc6f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009850 tx=0x7f83d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 -- 172.21.15.81:0/2280052585 shutdown_connections 2024-09-13T18:48:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 --2- 172.21.15.81:0/2280052585 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 --2- 172.21.15.81:0/2280052585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e80cb020 0x7f83e80cc6f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 -- 172.21.15.81:0/2280052585 >> 172.21.15.81:0/2280052585 conn(0x7f83e80b0c40 msgr2=0x7f83e806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 -- 172.21.15.81:0/2280052585 shutdown_connections 2024-09-13T18:48:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.220+0000 7f83ed600700 1 -- 172.21.15.81:0/2280052585 wait complete. 2024-09-13T18:48:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 Processor -- start 2024-09-13T18:48:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 -- start start 2024-09-13T18:48:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 0x7f83e813eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83e80cb020 0x7f83e81efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e81f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e813e660 con 0x7f83e806aaa0 2024-09-13T18:48:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e813dae0 con 0x7f83e80cb020 2024-09-13T18:48:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ed600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e813ddc0 con 0x7f83e815c2a0 2024-09-13T18:48:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 0x7f83e813eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 0x7f83e813eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58952/0 (socket says 172.21.15.81:58952) 2024-09-13T18:48:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 -- 172.21.15.81:0/1811890838 learned_addr learned my addr 172.21.15.81:0/1811890838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7400700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83e80cb020 0x7f83e81efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83ecc00700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e81f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 -- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 msgr2=0x7f83e81f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e81f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 -- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83e80cb020 msgr2=0x7f83e81efeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83e80cb020 0x7f83e81efeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 -- 172.21.15.81:0/1811890838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d80094b0 con 0x7f83e806aaa0 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7400700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83e80cb020 0x7f83e81efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83e7e00700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 0x7f83e813eda0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f83d80090b0 tx=0x7f83d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.224+0000 7f83dfe00700 1 -- 172.21.15.81:0/1811890838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d80036c0 con 0x7f83e806aaa0 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.228+0000 7f83dfe00700 1 -- 172.21.15.81:0/1811890838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d801f070 con 0x7f83e806aaa0 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.228+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e813e0a0 con 0x7f83e806aaa0 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.228+0000 7f83dfe00700 1 -- 172.21.15.81:0/1811890838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d8003a80 con 0x7f83e806aaa0 2024-09-13T18:48:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.228+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e813f2e0 con 0x7f83e806aaa0 2024-09-13T18:48:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.228+0000 7f83dfe00700 1 -- 172.21.15.81:0/1811890838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83d8003be0 con 0x7f83e806aaa0 2024-09-13T18:48:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.232+0000 7f83dfe00700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f83c8066730 0x7f83c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.232+0000 7f83dfe00700 1 -- 172.21.15.81:0/1811890838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f83d8021070 con 0x7f83e806aaa0 2024-09-13T18:48:54.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.232+0000 7f83e7400700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f83c8066730 0x7f83c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.232+0000 7f83e7400700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f83c8066730 0x7f83c8068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f83e8157c60 tx=0x7f83d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 Processor -- start 2024-09-13T18:48:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 -- start start 2024-09-13T18:48:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd2d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd0bd00 0x3dcf5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 0x3dcf5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc54d80 con 0x3dd2d6c0 2024-09-13T18:48:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc52510 con 0x3dd0bd00 2024-09-13T18:48:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dc4de00 con 0x3dd2cda0 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 0x3dcf5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 0x3dcf5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58954/0 (socket says 172.21.15.81:58954) 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 -- 172.21.15.81:0/2201294141 learned_addr learned my addr 172.21.15.81:0/2201294141 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd2d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83e7400700 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd0bd00 0x3dcf5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 -- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 msgr2=0x3dd2d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd2d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 -- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd0bd00 msgr2=0x3dcf5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd0bd00 0x3dcf5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 -- 172.21.15.81:0/2201294141 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3dac0960 con 0x3dd2d6c0 2024-09-13T18:48:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83ecc00700 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 0x3dcf5dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001fb0 tx=0x7f83e0001fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83578325bf6a6b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83d3e00700 1 -- 172.21.15.81:0/2201294141 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000b070 con 0x3dd2d6c0 2024-09-13T18:48:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83d3e00700 1 -- 172.21.15.81:0/2201294141 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e000da30 con 0x3dd2d6c0 2024-09-13T18:48:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.236+0000 7f83d3e00700 1 -- 172.21.15.81:0/2201294141 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e000dda0 con 0x3dd2d6c0 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 -- 172.21.15.81:0/2201294141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 msgr2=0x3dcf5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 0x3dcf5dd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001fb0 tx=0x7f83e0001fe0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 -- 172.21.15.81:0/2201294141 shutdown_connections 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2d6c0 0x3dcf5dd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd0bd00 0x3dcf5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 --2- 172.21.15.81:0/2201294141 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd2d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 -- 172.21.15.81:0/2201294141 >> 172.21.15.81:0/2201294141 conn(0x3da754d0 msgr2=0x3dd0ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 -- 172.21.15.81:0/2201294141 shutdown_connections 2024-09-13T18:48:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 -- 172.21.15.81:0/2201294141 wait complete. 2024-09-13T18:48:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 -- start start 2024-09-13T18:48:54.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.240+0000 7f83f2031740 1 Processor -- start 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd0bd00 0x3dce5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 0x3dce18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2d6c0 0x3dce1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc0b730 con 0x3dd2cda0 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc115b0 con 0x3dd2d6c0 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3daf9aa0 con 0x3dd0bd00 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 10 client.0 _ll_register_callbacks cb 0x3dc47610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 0x3dce18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 0x3dce18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58962/0 (socket says 172.21.15.81:58962) 2024-09-13T18:48:54.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 -- 172.21.15.81:0/2314706898 learned_addr learned my addr 172.21.15.81:0/2314706898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd0bd00 0x3dce5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83ecc00700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2d6c0 0x3dce1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 -- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd0bd00 msgr2=0x3dce5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd0bd00 0x3dce5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 -- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2d6c0 msgr2=0x3dce1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2d6c0 0x3dce1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 -- 172.21.15.81:0/2314706898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc0035d0 con 0x3dd2cda0 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd0bd00 0x3dce5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83e7400700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 0x3dce18f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f83d40156f0 tx=0x7f83d40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e1b7844a2999f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83d0c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83d0c00700 1 -- 172.21.15.81:0/2314706898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4022830 con 0x3dd2cda0 2024-09-13T18:48:54.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83d0c00700 1 -- 172.21.15.81:0/2314706898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f83d4022990 con 0x3dd2cda0 2024-09-13T18:48:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3da821e0 con 0x3dd2cda0 2024-09-13T18:48:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83d0c00700 1 -- 172.21.15.81:0/2314706898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83d4022b50 con 0x3dd2cda0 2024-09-13T18:48:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 10 client.5616 fetch_fsmap learned FSMap version 22 2024-09-13T18:48:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x3dc14220 con 0x3dd2cda0 2024-09-13T18:48:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83d0c00700 1 -- 172.21.15.81:0/2314706898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3da821e0 con 0x3dd2cda0 2024-09-13T18:48:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83d0c00700 1 -- 172.21.15.81:0/2314706898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f83d4022cb0 con 0x3dd2cda0 2024-09-13T18:48:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 10 client.5616 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:48:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 10 client.5616 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:48:54.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 20 client.5616 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.244+0000 7f83f2031740 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd33150 0x3dce2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83f2031740 4 client.5616 mds_command: new command op to 5006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:48:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 --> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3dacc460 con 0x3dd33150 2024-09-13T18:48:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd33150 0x3dce2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83d0c00700 10 client.5616 ms_handle_connect on v2:172.21.15.178:6834/628924969 2024-09-13T18:48:54.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83e7e00700 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd33150 0x3dce2b70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d886caf690d63d58 server_cookie=fb7cff6b28d9abad in_seq=0 out_seq=0 2024-09-13T18:48:54.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83d0c00700 1 -- 172.21.15.81:0/2314706898 <== mds.2 v2:172.21.15.178:6834/628924969 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3dacc460 con 0x3dd33150 2024-09-13T18:48:54.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.248+0000 7f83d0c00700 10 client.5616 handle_command_reply: tid=0 2024-09-13T18:48:54.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 client.5616 shutdown 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 msgr2=0x3dce18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 0x3dce18f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f83d40156f0 tx=0x7f83d40047e0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 shutdown_connections 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd33150 0x3dce2b70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2d6c0 0x3dce1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd2cda0 0x3dce18f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 --2- 172.21.15.81:0/2314706898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd0bd00 0x3dce5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 >> 172.21.15.81:0/2314706898 conn(0x3da754d0 msgr2=0x3dd2daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83d0c00700 0 client.5616 ms_handle_reset on v2:172.21.15.178:6834/628924969 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 shutdown_connections 2024-09-13T18:48:54.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 1 -- 172.21.15.81:0/2314706898 wait complete. 2024-09-13T18:48:54.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.252+0000 7f83f2031740 20 client.5616 trim_cache size 0 max 16384 2024-09-13T18:48:54.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 Processor -- start 2024-09-13T18:48:54.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 -- start start 2024-09-13T18:48:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3da754d0 0x3dd31ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd26ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd27010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc7cec0 con 0x3dd0bd00 2024-09-13T18:48:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dd2d3a0 con 0x3da754d0 2024-09-13T18:48:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dbf4950 con 0x3dd2cda0 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.272+0000 7f83e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd26ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd26ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58976/0 (socket says 172.21.15.81:58976) 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 -- 172.21.15.81:0/1968649768 learned_addr learned my addr 172.21.15.81:0/1968649768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7e00700 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3da754d0 0x3dd31ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83ecc00700 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd27010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 -- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 msgr2=0x3dd27010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd27010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 -- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3da754d0 msgr2=0x3dd31ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3da754d0 0x3dd31ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 -- 172.21.15.81:0/1968649768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3dbfa450 con 0x3dd0bd00 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83e7400700 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd26ad0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f83d4011010 tx=0x7f83d4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f161f9f1e93cdfb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83dd200700 1 -- 172.21.15.81:0/1968649768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4015d90 con 0x3dd0bd00 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83dd200700 1 -- 172.21.15.81:0/1968649768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d40092b0 con 0x3dd0bd00 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83dd200700 1 -- 172.21.15.81:0/1968649768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4014e70 con 0x3dd0bd00 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 -- 172.21.15.81:0/1968649768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 msgr2=0x3dd26ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd26ad0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f83d4011010 tx=0x7f83d4021000 comp rx=0 tx=0).stop 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 -- 172.21.15.81:0/1968649768 shutdown_connections 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3dd2cda0 0x3dd27010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd26ad0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 --2- 172.21.15.81:0/1968649768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3da754d0 0x3dd31ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 -- 172.21.15.81:0/1968649768 >> 172.21.15.81:0/1968649768 conn(0x3dce2050 msgr2=0x3dd2b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 -- 172.21.15.81:0/1968649768 shutdown_connections 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.276+0000 7f83f2031740 1 -- 172.21.15.81:0/1968649768 wait complete. 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 -- start start 2024-09-13T18:48:54.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 Processor -- start 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3da754d0 0x3dd50290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd4f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2cda0 0x3dd92270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dd507d0 con 0x3dd0bd00 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dd32f60 con 0x3dd2cda0 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dd328e0 con 0x3da754d0 2024-09-13T18:48:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83f2031740 10 client.0 _ll_register_callbacks cb 0x3dca4710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd4f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd4f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58984/0 (socket says 172.21.15.81:58984) 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 -- 172.21.15.81:0/3565559240 learned_addr learned my addr 172.21.15.81:0/3565559240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7e00700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3da754d0 0x3dd50290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83ecc00700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2cda0 0x3dd92270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 -- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3da754d0 msgr2=0x3dd50290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3da754d0 0x3dd50290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 -- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2cda0 msgr2=0x3dd92270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2cda0 0x3dd92270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7400700 1 -- 172.21.15.81:0/3565559240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3dc14220 con 0x3dd0bd00 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.280+0000 7f83e7e00700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3da754d0 0x3dd50290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83e7400700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd4f240 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009760 tx=0x7f83d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797724841421defe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:54.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 1 -- 172.21.15.81:0/3565559240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83d4015d90 con 0x3dd0bd00 2024-09-13T18:48:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 1 -- 172.21.15.81:0/3565559240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f83d4016540 con 0x3dd0bd00 2024-09-13T18:48:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83e000da30 con 0x3dd0bd00 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 1 -- 172.21.15.81:0/3565559240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83d4016700 con 0x3dd0bd00 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 10 client.5622 fetch_fsmap learned FSMap version 22 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x3dbee720 con 0x3dd0bd00 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 1 -- 172.21.15.81:0/3565559240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e000da30 con 0x3dd0bd00 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 1 -- 172.21.15.81:0/3565559240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f83d4016860 con 0x3dd0bd00 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 10 client.5622 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 10 client.5622 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 20 client.5622 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd2d6c0 0x3dd93a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 4 client.5622 mds_command: new command op to 5006 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 --> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] -- command(tid 0: {"prefix": "status"}) v1 -- 0x3daf11e0 con 0x3dd2d6c0 2024-09-13T18:48:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83e7e00700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd2d6c0 0x3dd93a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 10 client.5622 ms_handle_connect on v2:172.21.15.178:6834/628924969 2024-09-13T18:48:54.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83e7e00700 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd2d6c0 0x3dd93a90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8075682d36682c4 server_cookie=206212ad8be8d32b in_seq=0 out_seq=0 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 1 -- 172.21.15.81:0/3565559240 <== mds.2 v2:172.21.15.178:6834/628924969 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x3daf11e0 con 0x3dd2d6c0 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 10 client.5622 handle_command_reply: tid=0 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 client.5622 shutdown 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 msgr2=0x3dd4f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd4f240 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009760 tx=0x7f83d4004770 comp rx=0 tx=0).stop 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 shutdown_connections 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x3dd2d6c0 0x3dd93a90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd2cda0 0x3dd92270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd0bd00 0x3dd4f240 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 --2- 172.21.15.81:0/3565559240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3da754d0 0x3dd50290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 >> 172.21.15.81:0/3565559240 conn(0x3dce2050 msgr2=0x3dd2bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.284+0000 7f83d0c00700 0 client.5622 ms_handle_reset on v2:172.21.15.178:6834/628924969 2024-09-13T18:48:54.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 shutdown_connections 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83f2031740 1 -- 172.21.15.81:0/3565559240 wait complete. 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83f2031740 20 client.5622 trim_cache size 0 max 16384 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5006, 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:48:54.296 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 1.9718736750000001, 2024-09-13T18:48:54.297 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 22, 2024-09-13T18:48:54.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 39, 2024-09-13T18:48:54.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 39, 2024-09-13T18:48:54.297 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 20.31392778 2024-09-13T18:48:54.297 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f83c8066730 msgr2=0x7f83c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f83c8066730 0x7f83c8068bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f83e8157c60 tx=0x7f83d4008040 comp rx=0 tx=0).stop 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 msgr2=0x7f83e813eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 0x7f83e813eda0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f83d80090b0 tx=0x7f83d8004770 comp rx=0 tx=0).stop 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 shutdown_connections 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f83c8066730 0x7f83c8068bf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83e815c2a0 0x7f83e81f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83e80cb020 0x7f83e81efeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 --2- 172.21.15.81:0/1811890838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83e806aaa0 0x7f83e813eda0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 >> 172.21.15.81:0/1811890838 conn(0x7f83e80b0c40 msgr2=0x7f83e806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 shutdown_connections 2024-09-13T18:48:54.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.288+0000 7f83ed600700 1 -- 172.21.15.81:0/1811890838 wait complete. 2024-09-13T18:48:54.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:48:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.480+0000 7f5e0be00700 1 Processor -- start 2024-09-13T18:48:54.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.480+0000 7f5e0be00700 1 -- start start 2024-09-13T18:48:54.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0cde20 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0b4420 con 0x7f5e0c1597b0 2024-09-13T18:48:54.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0b49e0 con 0x7f5e0c06a390 2024-09-13T18:48:54.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e02000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5e0c0b3f80 0x7f5e0c159b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47876/0 (socket says 172.21.15.81:47876) 2024-09-13T18:48:54.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e02000700 1 -- 172.21.15.81:0/4245361557 learned_addr learned my addr 172.21.15.81:0/4245361557 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:54.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0b400700 1 --2- 172.21.15.81:0/4245361557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067840846 0 0) 0x7f5e0c0cde20 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df00035d0 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401664197 0 0) 0x7f5e0c0b4420 con 0x7f5e0c1597b0 2024-09-13T18:48:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e0c0cde20 con 0x7f5e0c1597b0 2024-09-13T18:48:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0b400700 1 -- 172.21.15.81:0/4245361557 >> v1:172.21.15.178:6789/0 conn(0x7f5e0c1597b0 legacy=0x7f5e0c0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0b400700 1 -- 172.21.15.81:0/4245361557 >> v1:172.21.15.81:6789/0 conn(0x7f5e0c0b3f80 legacy=0x7f5e0c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0b400700 1 -- 172.21.15.81:0/4245361557 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0b4700 con 0x7f5e0c06a390 2024-09-13T18:48:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0b400700 1 --2- 172.21.15.81:0/4245361557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c15a2a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009dc0 tx=0x7f5e0400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151722e16f89d0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400e070 con 0x7f5e0c06a390 2024-09-13T18:48:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0400bb20 con 0x7f5e0c06a390 2024-09-13T18:48:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.484+0000 7f5e0a000700 1 -- 172.21.15.81:0/4245361557 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400be90 con 0x7f5e0c06a390 2024-09-13T18:48:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 -- 172.21.15.81:0/4245361557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 msgr2=0x7f5e0c15a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 --2- 172.21.15.81:0/4245361557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c15a2a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009dc0 tx=0x7f5e0400b330 comp rx=0 tx=0).stop 2024-09-13T18:48:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 -- 172.21.15.81:0/4245361557 shutdown_connections 2024-09-13T18:48:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 --2- 172.21.15.81:0/4245361557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c15a2a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 -- 172.21.15.81:0/4245361557 >> 172.21.15.81:0/4245361557 conn(0x7f5e0c06c8e0 msgr2=0x7f5e0c06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 -- 172.21.15.81:0/4245361557 shutdown_connections 2024-09-13T18:48:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 -- 172.21.15.81:0/4245361557 wait complete. 2024-09-13T18:48:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.488+0000 7f5e0be00700 1 Processor -- start 2024-09-13T18:48:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 -- start start 2024-09-13T18:48:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c13c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 0x7f5e0c0b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c1597b0 0x7f5e0c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c138510 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c137890 con 0x7f5e0c1597b0 2024-09-13T18:48:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c137b70 con 0x7f5e0c06a390 2024-09-13T18:48:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 0x7f5e0c0b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 0x7f5e0c0b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58988/0 (socket says 172.21.15.81:58988) 2024-09-13T18:48:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 -- 172.21.15.81:0/94766428 learned_addr learned my addr 172.21.15.81:0/94766428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c13c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 -- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 msgr2=0x7f5e0c13c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0b400700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c1597b0 0x7f5e0c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c13c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 -- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c1597b0 msgr2=0x7f5e0c0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c1597b0 0x7f5e0c0b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 -- 172.21.15.81:0/94766428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009a70 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c13c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0b400700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c1597b0 0x7f5e0c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e02000700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 0x7f5e0c0b06a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5df400c580 tx=0x7f5df400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e03400700 1 -- 172.21.15.81:0/94766428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4005d90 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e03400700 1 -- 172.21.15.81:0/94766428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df40070d0 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c137e50 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e03400700 1 -- 172.21.15.81:0/94766428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4007440 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.492+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c1374b0 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.496+0000 7f5e03400700 1 -- 172.21.15.81:0/94766428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5df40075a0 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.496+0000 7f5e03400700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5de8066730 0x7f5de8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.500+0000 7f5e03400700 1 -- 172.21.15.81:0/94766428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5df40837c0 con 0x7f5e0c0b3f80 2024-09-13T18:48:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.500+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5de8066730 0x7f5de8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.500+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5de8066730 0x7f5de8068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0011e0 tx=0x7f5dfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.500+0000 7f5e14eb6740 1 Processor -- start 2024-09-13T18:48:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.500+0000 7f5e14eb6740 1 -- start start 2024-09-13T18:48:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb803da0 0xb804180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 0xb7cc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb8046c0 0xb7ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb72bd80 con 0xb7e2d00 2024-09-13T18:48:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb729510 con 0xb8046c0 2024-09-13T18:48:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb724e00 con 0xb803da0 2024-09-13T18:48:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 0xb7cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 0xb7cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58990/0 (socket says 172.21.15.81:58990) 2024-09-13T18:48:54.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 -- 172.21.15.81:0/2112363186 learned_addr learned my addr 172.21.15.81:0/2112363186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb803da0 0xb804180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e0b400700 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb8046c0 0xb7ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 -- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb803da0 msgr2=0xb804180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb803da0 0xb804180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 -- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb8046c0 msgr2=0xb7ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb8046c0 0xb7ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 -- 172.21.15.81:0/2112363186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb597960 con 0xb7e2d00 2024-09-13T18:48:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e02000700 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 0xb7cc890 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5df40546e0 tx=0x7f5df4054130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a230b68bcfbda2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5dfb400700 1 -- 172.21.15.81:0/2112363186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40584d0 con 0xb7e2d00 2024-09-13T18:48:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5dfb400700 1 -- 172.21.15.81:0/2112363186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df405ca90 con 0xb7e2d00 2024-09-13T18:48:54.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5dfb400700 1 -- 172.21.15.81:0/2112363186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4058170 con 0xb7e2d00 2024-09-13T18:48:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- 172.21.15.81:0/2112363186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 msgr2=0xb7cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 0xb7cc890 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5df40546e0 tx=0x7f5df4054130 comp rx=0 tx=0).stop 2024-09-13T18:48:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- 172.21.15.81:0/2112363186 shutdown_connections 2024-09-13T18:48:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb8046c0 0xb7ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7e2d00 0xb7cc890 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/2112363186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb803da0 0xb804180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- 172.21.15.81:0/2112363186 >> 172.21.15.81:0/2112363186 conn(0xb54c4d0 msgr2=0xb7e5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- 172.21.15.81:0/2112363186 shutdown_connections 2024-09-13T18:48:54.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.504+0000 7f5e14eb6740 1 -- 172.21.15.81:0/2112363186 wait complete. 2024-09-13T18:48:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 -- start start 2024-09-13T18:48:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 Processor -- start 2024-09-13T18:48:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb7e2d00 0xb7de590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb803da0 0xb80de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 0xb80e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb6e2730 con 0xb8046c0 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb6e85b0 con 0xb803da0 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb5d0aa0 con 0xb7e2d00 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 10 client.0 _ll_register_callbacks cb 0xb71e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 0xb80e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 0xb80e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58992/0 (socket says 172.21.15.81:58992) 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 -- 172.21.15.81:0/3137945304 learned_addr learned my addr 172.21.15.81:0/3137945304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb7e2d00 0xb7de590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e02000700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb803da0 0xb80de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 -- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb7e2d00 msgr2=0xb7de590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb7e2d00 0xb7de590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 -- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb803da0 msgr2=0xb80de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb803da0 0xb80de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 -- 172.21.15.81:0/3137945304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c1374b0 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e0b400700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 0xb80e360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c06bf60 tx=0x7f5e0400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb1e551c9c6003c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5defe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5defe00700 1 -- 172.21.15.81:0/3137945304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04012e20 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5defe00700 1 -- 172.21.15.81:0/3137945304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e04025410 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.508+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb5591e0 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5defe00700 1 -- 172.21.15.81:0/3137945304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e040255d0 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 10 client.5634 fetch_fsmap learned FSMap version 22 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0xb6eb220 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5defe00700 1 -- 172.21.15.81:0/3137945304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb5591e0 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5defe00700 1 -- 172.21.15.81:0/3137945304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f5e04025730 con 0xb8046c0 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 10 client.5634 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:48:54.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 10 client.5634 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 20 client.5634 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb7dead0 0xb7b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 4 client.5634 mds_command: new command op to 5314 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 --> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb5a3460 con 0xb7dead0 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb7dead0 0xb7b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb7dead0 0xb7b8780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=974dfae223eed3b8 server_cookie=aba25168ac96bef3 in_seq=0 out_seq=0 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5defe00700 10 client.5634 ms_handle_connect on v2:172.21.15.81:6835/3633246084 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5defe00700 1 -- 172.21.15.81:0/3137945304 <== mds.1 v2:172.21.15.81:6835/3633246084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xb5a3460 con 0xb7dead0 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5defe00700 10 client.5634 handle_command_reply: tid=0 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 1 client.5634 shutdown 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 msgr2=0xb80e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.512+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 0xb80e360 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c06bf60 tx=0x7f5e0400e000 comp rx=0 tx=0).stop 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 shutdown_connections 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb8046c0 0xb80e360 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb803da0 0xb80de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb7dead0 0xb7b8780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/3137945304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb7e2d00 0xb7de590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 >> 172.21.15.81:0/3137945304 conn(0xb54c4d0 msgr2=0xb7df940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5defe00700 0 client.5634 ms_handle_reset on v2:172.21.15.81:6835/3633246084 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 shutdown_connections 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 1 -- 172.21.15.81:0/3137945304 wait complete. 2024-09-13T18:48:54.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.516+0000 7f5e14eb6740 20 client.5634 trim_cache size 0 max 16384 2024-09-13T18:48:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 Processor -- start 2024-09-13T18:48:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 -- start start 2024-09-13T18:48:54.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb85ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb8604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb80cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb7bb180 con 0xb803da0 2024-09-13T18:48:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb6cb5a0 con 0xb7e2d00 2024-09-13T18:48:54.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.536+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb6ec4c0 con 0xb8046c0 2024-09-13T18:48:54.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb8604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e0aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb85ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb8604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59000/0 (socket says 172.21.15.81:59000) 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 -- 172.21.15.81:0/1939732361 learned_addr learned my addr 172.21.15.81:0/1939732361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e0b400700 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb80cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 -- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 msgr2=0xb80cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb80cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 -- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 msgr2=0xb85ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb85ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 -- 172.21.15.81:0/1939732361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb7bb5e0 con 0xb803da0 2024-09-13T18:48:54.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e02000700 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb8604d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5df4054450 tx=0x7f5df401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecd3dbfeded7abf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5dfbe00700 1 -- 172.21.15.81:0/1939732361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df40012f0 con 0xb803da0 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5dfbe00700 1 -- 172.21.15.81:0/1939732361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4054520 con 0xb803da0 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5dfbe00700 1 -- 172.21.15.81:0/1939732361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4050a90 con 0xb803da0 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 -- 172.21.15.81:0/1939732361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 msgr2=0xb8604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb8604d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5df4054450 tx=0x7f5df401e000 comp rx=0 tx=0).stop 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 -- 172.21.15.81:0/1939732361 shutdown_connections 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb80cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb8604d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/1939732361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb85ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 -- 172.21.15.81:0/1939732361 >> 172.21.15.81:0/1939732361 conn(0xb54c4d0 msgr2=0xb7e2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 -- 172.21.15.81:0/1939732361 shutdown_connections 2024-09-13T18:48:54.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.540+0000 7f5e14eb6740 1 -- 172.21.15.81:0/1939732361 wait complete. 2024-09-13T18:48:54.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 -- start start 2024-09-13T18:48:54.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 Processor -- start 2024-09-13T18:48:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb8228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb814870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb85f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb821850 con 0xb803da0 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb7e2a00 con 0xb7e2d00 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.544+0000 7f5e14eb6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb821a80 con 0xb8046c0 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 10 client.0 _ll_register_callbacks cb 0xb77b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb814870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb814870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59016/0 (socket says 172.21.15.81:59016) 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 -- 172.21.15.81:0/679249622 learned_addr learned my addr 172.21.15.81:0/679249622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb8228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e0b400700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb85f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 -- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 msgr2=0xb85f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb85f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 -- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 msgr2=0xb8228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb8228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 -- 172.21.15.81:0/679249622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb597960 con 0xb803da0 2024-09-13T18:48:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e0b400700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb85f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e02000700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb814870 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000f60 tx=0x7f5df4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2fb725a485d0ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5defe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5defe00700 1 -- 172.21.15.81:0/679249622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4050a90 con 0xb803da0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5defe00700 1 -- 172.21.15.81:0/679249622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5df40584d0 con 0xb803da0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5df405ca90 con 0xb803da0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5defe00700 1 -- 172.21.15.81:0/679249622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5df405c600 con 0xb803da0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 10 client.5640 fetch_fsmap learned FSMap version 22 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0xb6d1450 con 0xb803da0 2024-09-13T18:48:54.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5defe00700 1 -- 172.21.15.81:0/679249622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df4076070 con 0xb803da0 2024-09-13T18:48:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5defe00700 1 -- 172.21.15.81:0/679249622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f5df406d030 con 0xb803da0 2024-09-13T18:48:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 10 client.5640 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:48:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 10 client.5640 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:48:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 20 client.5640 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb860ea0 0xb812390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 4 client.5640 mds_command: new command op to 5314 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:48:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 --> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] -- command(tid 0: {"prefix": "status"}) v1 -- 0xb5c81e0 con 0xb860ea0 2024-09-13T18:48:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.548+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb860ea0 0xb812390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0aa00700 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb860ea0 0xb812390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f310185c7f222bb2 server_cookie=318b71df2d94bd94 in_seq=0 out_seq=0 2024-09-13T18:48:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5defe00700 10 client.5640 ms_handle_connect on v2:172.21.15.81:6835/3633246084 2024-09-13T18:48:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5defe00700 1 -- 172.21.15.81:0/679249622 <== mds.1 v2:172.21.15.81:6835/3633246084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+315 (crc 0 0 0) 0xb5c81e0 con 0xb860ea0 2024-09-13T18:48:54.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5defe00700 10 client.5640 handle_command_reply: tid=0 2024-09-13T18:48:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 client.5640 shutdown 2024-09-13T18:48:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 msgr2=0xb814870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb814870 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5df4000f60 tx=0x7f5df4000ed0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 shutdown_connections 2024-09-13T18:48:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0xb860ea0 0xb812390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb8046c0 0xb85f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb803da0 0xb814870 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5defe00700 0 client.5640 ms_handle_reset on v2:172.21.15.81:6835/3633246084 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 --2- 172.21.15.81:0/679249622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7e2d00 0xb8228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 >> 172.21.15.81:0/679249622 conn(0xb54c4d0 msgr2=0xb7e2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 shutdown_connections 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 1 -- 172.21.15.81:0/679249622 wait complete. 2024-09-13T18:48:54.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e14eb6740 20 client.5640 trim_cache size 0 max 16384 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5314, 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:48:54.565 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 3.2471405, 2024-09-13T18:48:54.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 22, 2024-09-13T18:48:54.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 39, 2024-09-13T18:48:54.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 39, 2024-09-13T18:48:54.566 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 20.58977105 2024-09-13T18:48:54.566 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5de8066730 msgr2=0x7f5de8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5de8066730 0x7f5de8068bf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0011e0 tx=0x7f5dfc009040 comp rx=0 tx=0).stop 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 msgr2=0x7f5e0c0b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 0x7f5e0c0b06a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5df400c580 tx=0x7f5df400c940 comp rx=0 tx=0).stop 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 shutdown_connections 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5de8066730 0x7f5de8068bf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5e0c1597b0 0x7f5e0c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e0c0b3f80 0x7f5e0c0b06a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 --2- 172.21.15.81:0/94766428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5e0c06a390 0x7f5e0c13c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 >> 172.21.15.81:0/94766428 conn(0x7f5e0c06c8e0 msgr2=0x7f5e0c159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 shutdown_connections 2024-09-13T18:48:54.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.552+0000 7f5e0be00700 1 -- 172.21.15.81:0/94766428 wait complete. 2024-09-13T18:48:54.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:48:54.753 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:48:54.744+0000 7f99e3c00700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:48:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.756+0000 7fa82b200700 1 Processor -- start 2024-09-13T18:48:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.756+0000 7fa82b200700 1 -- start start 2024-09-13T18:48:54.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa82c0b2700 0x7fa82c0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b2ae0 0x7fa82c0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0b3a70 con 0x7fa82c0b5b30 2024-09-13T18:48:54.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82c0cef50 con 0x7fa82c0b2700 2024-09-13T18:48:54.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0cf920 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82a800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa82c0b5b30 0x7fa82c0cffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47878/0 (socket says 172.21.15.81:47878) 2024-09-13T18:48:54.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82a800700 1 -- 172.21.15.81:0/2665797738 learned_addr learned my addr 172.21.15.81:0/2665797738 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829e00700 1 --2- 172.21.15.81:0/2665797738 >> v2:172.21.15.81:3300/0 conn(0x7fa82c0b2700 0x7fa82c0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829400700 1 --2- 172.21.15.81:0/2665797738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b2ae0 0x7fa82c0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa828a00700 1 -- 172.21.15.81:0/2665797738 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 721004377 0 0) 0x7fa82c0b3a70 con 0x7fa82c0b5b30 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa828a00700 1 -- 172.21.15.81:0/2665797738 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8100035d0 con 0x7fa82c0b5b30 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829e00700 1 -- 172.21.15.81:0/2665797738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b2ae0 msgr2=0x7fa82c0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829e00700 1 --2- 172.21.15.81:0/2665797738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b2ae0 0x7fa82c0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829e00700 1 -- 172.21.15.81:0/2665797738 >> v1:172.21.15.81:6789/0 conn(0x7fa82c0b5b30 legacy=0x7fa82c0cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829e00700 1 -- 172.21.15.81:0/2665797738 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0b3cc0 con 0x7fa82c0b2700 2024-09-13T18:48:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa829e00700 1 --2- 172.21.15.81:0/2665797738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2700 0x7fa82c0cf3e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009850 tx=0x7fa81c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5243c6507616b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa828a00700 1 -- 172.21.15.81:0/2665797738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c011830 con 0x7fa82c0b2700 2024-09-13T18:48:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa828a00700 1 -- 172.21.15.81:0/2665797738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c011990 con 0x7fa82c0b2700 2024-09-13T18:48:54.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa828a00700 1 -- 172.21.15.81:0/2665797738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c011d00 con 0x7fa82c0b2700 2024-09-13T18:48:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 -- 172.21.15.81:0/2665797738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2700 msgr2=0x7fa82c0cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.760+0000 7fa82b200700 1 --2- 172.21.15.81:0/2665797738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2700 0x7fa82c0cf3e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009850 tx=0x7fa81c009b60 comp rx=0 tx=0).stop 2024-09-13T18:48:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 -- 172.21.15.81:0/2665797738 shutdown_connections 2024-09-13T18:48:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 --2- 172.21.15.81:0/2665797738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b2ae0 0x7fa82c0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 --2- 172.21.15.81:0/2665797738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2700 0x7fa82c0cf3e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 -- 172.21.15.81:0/2665797738 >> 172.21.15.81:0/2665797738 conn(0x7fa82c071d90 msgr2=0x7fa82c072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 -- 172.21.15.81:0/2665797738 shutdown_connections 2024-09-13T18:48:54.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 -- 172.21.15.81:0/2665797738 wait complete. 2024-09-13T18:48:54.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 Processor -- start 2024-09-13T18:48:54.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.764+0000 7fa82b200700 1 -- start start 2024-09-13T18:48:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa82c0b2700 0x7fa82c13bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 0x7fa82c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b5b30 0x7fa82c1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c145df0 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c13f350 con 0x7fa82c0b2700 2024-09-13T18:48:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c145830 con 0x7fa82c0b5b30 2024-09-13T18:48:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 0x7fa82c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 0x7fa82c06c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59028/0 (socket says 172.21.15.81:59028) 2024-09-13T18:48:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 -- 172.21.15.81:0/3138471784 learned_addr learned my addr 172.21.15.81:0/3138471784 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829e00700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa82c0b2700 0x7fa82c13bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82a800700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b5b30 0x7fa82c1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 -- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b5b30 msgr2=0x7fa82c1447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b5b30 0x7fa82c1447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 -- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa82c0b2700 msgr2=0x7fa82c13bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa82c0b2700 0x7fa82c13bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 -- 172.21.15.81:0/3138471784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0094b0 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa829400700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 0x7fa82c06c690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa81800e9d0 tx=0x7fa81800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa822000700 1 -- 172.21.15.81:0/3138471784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818009720 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa822000700 1 -- 172.21.15.81:0/3138471784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81800c850 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa822000700 1 -- 172.21.15.81:0/3138471784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800cbc0 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c145b10 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.768+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c13db80 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.772+0000 7fa822000700 1 -- 172.21.15.81:0/3138471784 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa81800cd20 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.772+0000 7fa822000700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa80c066730 0x7fa80c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.772+0000 7fa822000700 1 -- 172.21.15.81:0/3138471784 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa818084410 con 0x7fa82c0b2ae0 2024-09-13T18:48:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.772+0000 7fa829e00700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa80c066730 0x7fa80c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa829e00700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa80c066730 0x7fa80c068bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0090b0 tx=0x7fa81c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 Processor -- start 2024-09-13T18:48:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 -- start start 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1419f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x14167890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x14167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x140c6d80 con 0x1419eda0 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x140c4510 con 0x1417dd00 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x140bfe00 con 0x1419f6c0 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.776+0000 7fa829e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1419f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1419f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59032/0 (socket says 172.21.15.81:59032) 2024-09-13T18:48:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 -- 172.21.15.81:0/3111281389 learned_addr learned my addr 172.21.15.81:0/3111281389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829400700 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x14167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa82a800700 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x14167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 -- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 msgr2=0x14167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x14167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 -- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 msgr2=0x14167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x14167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 -- 172.21.15.81:0/3111281389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13f32960 con 0x1419eda0 2024-09-13T18:48:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa829e00700 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1419f180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0b5f40 tx=0x7fa81c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30690e53c0b3d53d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa816a00700 1 -- 172.21.15.81:0/3111281389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c02c070 con 0x1419eda0 2024-09-13T18:48:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa816a00700 1 -- 172.21.15.81:0/3111281389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c011730 con 0x1419eda0 2024-09-13T18:48:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa816a00700 1 -- 172.21.15.81:0/3111281389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c020070 con 0x1419eda0 2024-09-13T18:48:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 -- 172.21.15.81:0/3111281389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 msgr2=0x1419f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1419f180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0b5f40 tx=0x7fa81c010000 comp rx=0 tx=0).stop 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 -- 172.21.15.81:0/3111281389 shutdown_connections 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x14167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x14167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 --2- 172.21.15.81:0/3111281389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1419f180 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 -- 172.21.15.81:0/3111281389 >> 172.21.15.81:0/3111281389 conn(0x13ee74d0 msgr2=0x14180c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 -- 172.21.15.81:0/3111281389 shutdown_connections 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.780+0000 7fa834140740 1 -- 172.21.15.81:0/3111281389 wait complete. 2024-09-13T18:48:54.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 -- start start 2024-09-13T18:48:54.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 Processor -- start 2024-09-13T18:48:54.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x1419e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x141a5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1407d730 con 0x1419eda0 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x140835b0 con 0x1417dd00 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x13f6baa0 con 0x1419f6c0 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa834140740 10 client.0 _ll_register_callbacks cb 0x140b9610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x141a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x141a5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59048/0 (socket says 172.21.15.81:59048) 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 -- 172.21.15.81:0/2875411027 learned_addr learned my addr 172.21.15.81:0/2875411027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa82a800700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829e00700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x1419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 -- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 msgr2=0x1419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 -- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 msgr2=0x1419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x1419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 -- 172.21.15.81:0/2875411027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c0b3cc0 con 0x1419eda0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa82a800700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa829400700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x141a5340 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa81800cfd0 tx=0x7fa8180552e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb2adcb509671ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.784+0000 7fa80b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 1 -- 172.21.15.81:0/2875411027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180556c0 con 0x1419eda0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13ef41e0 con 0x1419eda0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 1 -- 172.21.15.81:0/2875411027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa81807de50 con 0x1419eda0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 1 -- 172.21.15.81:0/2875411027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa818082260 con 0x1419eda0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 10 client.5655 fetch_fsmap learned FSMap version 22 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x14086220 con 0x1419eda0 2024-09-13T18:48:54.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 1 -- 172.21.15.81:0/2875411027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa818070030 con 0x1419eda0 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 1 -- 172.21.15.81:0/2875411027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fa818054750 con 0x1419eda0 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 10 client.5655 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 10 client.5655 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 20 client.5655 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x14157510 0x141578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 4 client.5655 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13f3e460 con 0x14157510 2024-09-13T18:48:54.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa829e00700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x14157510 0x141578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa829e00700 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x14157510 0x141578f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4df27307991ec3d server_cookie=94c45d2efc7460ba in_seq=0 out_seq=0 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 10 client.5655 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 1 -- 172.21.15.81:0/2875411027 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x13f3e460 con 0x14157510 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa80b400700 10 client.5655 handle_command_reply: tid=0 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 client.5655 shutdown 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 msgr2=0x141a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x141a5340 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa81800cfd0 tx=0x7fa8180552e0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 shutdown_connections 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x14157510 0x141578f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.788+0000 7fa834140740 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x141a5340 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.792+0000 7fa834140740 1 --2- 172.21.15.81:0/2875411027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x1419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.792+0000 7fa80b400700 0 client.5655 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.792+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 >> 172.21.15.81:0/2875411027 conn(0x13ee74d0 msgr2=0x1417a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.792+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 shutdown_connections 2024-09-13T18:48:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.792+0000 7fa834140740 1 -- 172.21.15.81:0/2875411027 wait complete. 2024-09-13T18:48:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.792+0000 7fa834140740 20 client.5655 trim_cache size 0 max 16384 2024-09-13T18:48:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.808+0000 7fa834140740 1 Processor -- start 2024-09-13T18:48:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.808+0000 7fa834140740 1 -- start start 2024-09-13T18:48:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1417dd00 0x1417c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1419eda0 0x1417cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa834140740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 0x141ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa834140740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x140beab0 con 0x1419f6c0 2024-09-13T18:48:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14088190 con 0x1419eda0 2024-09-13T18:48:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x140c3670 con 0x1417dd00 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 0x141ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 0x141ad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59056/0 (socket says 172.21.15.81:59056) 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa829400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1419eda0 0x1417cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 -- 172.21.15.81:0/1977857944 learned_addr learned my addr 172.21.15.81:0/1977857944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa829e00700 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1417dd00 0x1417c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 -- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1417dd00 msgr2=0x1417c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1417dd00 0x1417c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 -- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1419eda0 msgr2=0x1417cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1419eda0 0x1417cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 -- 172.21.15.81:0/1977857944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1406c450 con 0x1419f6c0 2024-09-13T18:48:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa82a800700 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 0x141ad950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa824001fb0 tx=0x7fa824000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc068c9a33f1135 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa817400700 1 -- 172.21.15.81:0/1977857944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824002100 con 0x1419f6c0 2024-09-13T18:48:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa817400700 1 -- 172.21.15.81:0/1977857944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa824007540 con 0x1419f6c0 2024-09-13T18:48:54.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.812+0000 7fa817400700 1 -- 172.21.15.81:0/1977857944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8240078b0 con 0x1419f6c0 2024-09-13T18:48:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- 172.21.15.81:0/1977857944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 msgr2=0x141ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 0x141ad950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa824001fb0 tx=0x7fa824000f40 comp rx=0 tx=0).stop 2024-09-13T18:48:54.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- 172.21.15.81:0/1977857944 shutdown_connections 2024-09-13T18:48:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419f6c0 0x141ad950 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1419eda0 0x1417cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- 172.21.15.81:0/1977857944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1417dd00 0x1417c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- 172.21.15.81:0/1977857944 >> 172.21.15.81:0/1977857944 conn(0x13ee74d0 msgr2=0x14179860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- 172.21.15.81:0/1977857944 shutdown_connections 2024-09-13T18:48:54.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- 172.21.15.81:0/1977857944 wait complete. 2024-09-13T18:48:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- start start 2024-09-13T18:48:54.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 Processor -- start 2024-09-13T18:48:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x141ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1417cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1417d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x141be370 con 0x1419eda0 2024-09-13T18:48:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x142005c0 con 0x1417dd00 2024-09-13T18:48:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x141a3e50 con 0x1419f6c0 2024-09-13T18:48:54.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa834140740 10 client.0 _ll_register_callbacks cb 0x14116710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:48:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa829400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1417cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa829400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1417cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59058/0 (socket says 172.21.15.81:59058) 2024-09-13T18:48:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.816+0000 7fa829400700 1 -- 172.21.15.81:0/2620555363 learned_addr learned my addr 172.21.15.81:0/2620555363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829e00700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x141ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829400700 1 -- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 msgr2=0x1417d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa82a800700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1417d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829400700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1417d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829400700 1 -- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 msgr2=0x141ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829400700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x141ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829400700 1 -- 172.21.15.81:0/2620555363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82400f040 con 0x1419eda0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829e00700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x141ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa82a800700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1417d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829400700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1417cd20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa8180558c0 tx=0x7fa81801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aefd8f4e593925 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 1 -- 172.21.15.81:0/2620555363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818082460 con 0x1419eda0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 1 -- 172.21.15.81:0/2620555363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa818055960 con 0x1419eda0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa81c011730 con 0x1419eda0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 1 -- 172.21.15.81:0/2620555363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa818059090 con 0x1419eda0 2024-09-13T18:48:54.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 10 client.5661 fetch_fsmap learned FSMap version 22 2024-09-13T18:48:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x14060720 con 0x1419eda0 2024-09-13T18:48:54.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 1 -- 172.21.15.81:0/2620555363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c011730 con 0x1419eda0 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 1 -- 172.21.15.81:0/2620555363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fa81805d1c0 con 0x1419eda0 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 10 client.5661 fetch_fsmap finished waiting for FSMap version 22 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 10 client.5661 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 20 client.5661 populate_metadata read hostname 'smithi081' 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x141a2b00 0x141a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 4 client.5661 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "status"}) v1 -- 0x13f631e0 con 0x141a2b00 2024-09-13T18:48:54.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829e00700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x141a2b00 0x141a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 10 client.5661 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa829e00700 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x141a2b00 0x141a2ee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd89d2425072a4ed server_cookie=c8932d504abe675a in_seq=0 out_seq=0 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 1 -- 172.21.15.81:0/2620555363 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x13f631e0 con 0x141a2b00 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 10 client.5661 handle_command_reply: tid=0 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 client.5661 shutdown 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 msgr2=0x1417cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1417cd20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa8180558c0 tx=0x7fa81801e040 comp rx=0 tx=0).stop 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 shutdown_connections 2024-09-13T18:48:54.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x141a2b00 0x141a2ee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1419f6c0 0x1417d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1419eda0 0x1417cd20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa80b400700 0 client.5661 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 --2- 172.21.15.81:0/2620555363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1417dd00 0x141ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.820+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 >> 172.21.15.81:0/2620555363 conn(0x13ee74d0 msgr2=0x1417c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 shutdown_connections 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa834140740 1 -- 172.21.15.81:0/2620555363 wait complete. 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa834140740 20 client.5661 trim_cache size 0 max 16384 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:48:54.834 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5388, 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 12.576625674000001, 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 22, 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 39, 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 39, 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 20.861067050999999 2024-09-13T18:48:54.835 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa80c066730 msgr2=0x7fa80c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa80c066730 0x7fa80c068bf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa81c0090b0 tx=0x7fa81c008030 comp rx=0 tx=0).stop 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 msgr2=0x7fa82c06c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 0x7fa82c06c690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa81800e9d0 tx=0x7fa81800ece0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 shutdown_connections 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa80c066730 0x7fa80c068bf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa82c0b5b30 0x7fa82c1447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa82c0b2ae0 0x7fa82c06c690 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 --2- 172.21.15.81:0/3138471784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa82c0b2700 0x7fa82c13bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 >> 172.21.15.81:0/3138471784 conn(0x7fa82c071d90 msgr2=0x7fa82c15fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 shutdown_connections 2024-09-13T18:48:54.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:54.824+0000 7fa82b200700 1 -- 172.21.15.81:0/3138471784 wait complete. 2024-09-13T18:48:54.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:55.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 Processor -- start 2024-09-13T18:48:55.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 -- start start 2024-09-13T18:48:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7840cb020 0x7ff7840cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff78406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78406b430 con 0x7ff78415c2a0 2024-09-13T18:48:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7840b2ad0 con 0x7ff7840cb020 2024-09-13T18:48:55.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff788a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415b960 con 0x7ff78406aaa0 2024-09-13T18:48:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff77aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff78415c2a0 0x7ff78415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47888/0 (socket says 172.21.15.81:47888) 2024-09-13T18:48:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.020+0000 7ff77aa00700 1 -- 172.21.15.81:0/131755116 learned_addr learned my addr 172.21.15.81:0/131755116 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:48:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 --2- 172.21.15.81:0/131755116 >> v2:172.21.15.178:3300/0 conn(0x7ff7840cb020 0x7ff7840cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783e00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff78406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316345633 0 0) 0x7ff76c001110 con 0x7ff78415c2a0 2024-09-13T18:48:55.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7640035d0 con 0x7ff78415c2a0 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1668954678 0 0) 0x7ff7640035d0 con 0x7ff78415c2a0 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 msgr2=0x7ff78406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff78406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 >> v2:172.21.15.178:3300/0 conn(0x7ff7840cb020 msgr2=0x7ff7840cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 --2- 172.21.15.81:0/131755116 >> v2:172.21.15.178:3300/0 conn(0x7ff7840cb020 0x7ff7840cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78415bc40 con 0x7ff78415c2a0 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7ff76c001800 con 0x7ff78415c2a0 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783e00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff78406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 >> v1:172.21.15.81:6789/0 conn(0x7ff78415c2a0 legacy=0x7ff78415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:55.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff764003a90 0x7ff764003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff764004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764004db0 0x7ff764005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7840b2ad0 con 0x7ff764003a90 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78415b960 con 0x7ff764004db0 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76400ba30 con 0x7ff78406aaa0 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff764003a90 0x7ff764003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff77aa00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff764004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783e00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764004db0 0x7ff764005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 -- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 msgr2=0x7ff764004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff78406aaa0 0x7ff764004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 -- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764004db0 msgr2=0x7ff764005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764004db0 0x7ff764005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 -- 172.21.15.81:0/131755116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c009a70 con 0x7ff764003a90 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783e00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764004db0 0x7ff764005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff783400700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff764003a90 0x7ff764003eb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff774009ba0 tx=0x7ff7640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf465caeebc7bcb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400e6c0 con 0x7ff764003a90 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77400e820 con 0x7ff764003a90 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.024+0000 7ff782a00700 1 -- 172.21.15.81:0/131755116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77400eb90 con 0x7ff764003a90 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 -- 172.21.15.81:0/131755116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff764003a90 msgr2=0x7ff764003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 --2- 172.21.15.81:0/131755116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff764003a90 0x7ff764003eb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff774009ba0 tx=0x7ff7640058a0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff783e00700 1 -- 172.21.15.81:0/131755116 reap_dead start 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 -- 172.21.15.81:0/131755116 shutdown_connections 2024-09-13T18:48:55.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 -- 172.21.15.81:0/131755116 >> 172.21.15.81:0/131755116 conn(0x7ff7840b0c40 msgr2=0x7ff78406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 -- 172.21.15.81:0/131755116 shutdown_connections 2024-09-13T18:48:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 -- 172.21.15.81:0/131755116 wait complete. 2024-09-13T18:48:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 Processor -- start 2024-09-13T18:48:55.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.028+0000 7ff788a00700 1 -- start start 2024-09-13T18:48:55.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764003a90 0x7ff7841443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 0x7ff784141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff784156d40 0x7ff7841e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7841571f0 con 0x7ff7841557a0 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff784155ca0 con 0x7ff764003a90 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff784155f80 con 0x7ff784156d40 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 0x7ff784141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 0x7ff784141270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59080/0 (socket says 172.21.15.81:59080) 2024-09-13T18:48:55.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 -- 172.21.15.81:0/446441398 learned_addr learned my addr 172.21.15.81:0/446441398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:48:55.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff783400700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764003a90 0x7ff7841443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff783e00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff784156d40 0x7ff7841e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 -- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff784156d40 msgr2=0x7ff7841e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff784156d40 0x7ff7841e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 -- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764003a90 msgr2=0x7ff7841443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764003a90 0x7ff7841443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 -- 172.21.15.81:0/446441398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784156260 con 0x7ff7841557a0 2024-09-13T18:48:55.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff783e00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff784156d40 0x7ff7841e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77aa00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 0x7ff784141270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff76c007310 tx=0x7ff76c007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00f6c0 con 0x7ff7841557a0 2024-09-13T18:48:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c00f820 con 0x7ff7841557a0 2024-09-13T18:48:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff784156540 con 0x7ff7841557a0 2024-09-13T18:48:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00fbd0 con 0x7ff7841557a0 2024-09-13T18:48:55.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.032+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff784143fe0 con 0x7ff7841557a0 2024-09-13T18:48:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.036+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff784156a60 con 0x7ff7841557a0 2024-09-13T18:48:55.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.036+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff76c00fd30 con 0x7ff7841557a0 2024-09-13T18:48:55.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.040+0000 7ff77be00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff760066760 0x7ff760068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:55.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.040+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff76c084080 con 0x7ff7841557a0 2024-09-13T18:48:55.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.040+0000 7ff783400700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff760066760 0x7ff760068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.040+0000 7ff783400700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff760066760 0x7ff760068c20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff7740090b0 tx=0x7ff77401e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:55.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.044+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff76c0b5db0 con 0x7ff7841557a0 2024-09-13T18:48:55.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.272+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff78406b430 con 0x7ff7841557a0 2024-09-13T18:48:55.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.272+0000 7ff77be00700 1 -- 172.21.15.81:0/446441398 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4765 (secure 0 0 0) 0x7ff78406b430 con 0x7ff7841557a0 2024-09-13T18:48:55.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:48:55.282 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:48:53.315224+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5388,"mds_1":5314,"mds_2":5006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5006":{"gid":5006,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:48:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff760066760 msgr2=0x7ff760068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff760066760 0x7ff760068c20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff7740090b0 tx=0x7ff77401e040 comp rx=0 tx=0).stop 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 msgr2=0x7ff784141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 0x7ff784141270 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff76c007310 tx=0x7ff76c007620 comp rx=0 tx=0).stop 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 shutdown_connections 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff760066760 0x7ff760068c20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff784156d40 0x7ff7841e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7841557a0 0x7ff784141270 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 --2- 172.21.15.81:0/446441398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff764003a90 0x7ff7841443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 >> 172.21.15.81:0/446441398 conn(0x7ff7840b0c40 msgr2=0x7ff7840c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 shutdown_connections 2024-09-13T18:48:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:48:55.280+0000 7ff788a00700 1 -- 172.21.15.81:0/446441398 wait complete. 2024-09-13T18:48:55.289 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-13T18:48:55.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:55.311 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:48:55.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:55.346 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:48:55.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:55.424 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-13T18:48:55.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:55.490 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-13T18:48:55.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:55.554 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-13T18:48:55.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:48:55.861 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:48:55.861 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:48:55.862 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:48:57.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:48:58.052 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:48:58.053 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:48:58.053 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:49:00.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:49:00.227 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:49:00.228 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:49:00.228 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:49:02.229 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:49:02.411 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:49:02.411 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:49:02.411 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:49:04.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:49:04.587 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-13T18:49:04.588 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:49:04.588 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:49:04.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:49:04.765 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:49:04.765 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:49:04.766 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:49:06.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:49:06.955 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:49:06.956 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:49:06.956 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:49:08.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:49:09.146 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:49:09.147 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:49:09.147 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:49:11.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:49:11.341 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-13T18:49:11.342 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:49:11.342 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:49:11.342 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:49:11.539 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:49:11.539 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:49:11.540 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:49:11.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 flush journal 2024-09-13T18:49:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.708+0000 7fe581400700 1 Processor -- start 2024-09-13T18:49:11.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe581400700 1 -- start start 2024-09-13T18:49:11.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe581400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe57c0ce280 0x7fe57c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe581400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c15df90 con 0x7fe57c15a880 2024-09-13T18:49:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe581400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c15aea0 con 0x7fe57c0cf1e0 2024-09-13T18:49:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe581400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c0cf670 con 0x7fe57c0ce280 2024-09-13T18:49:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe57b200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe57c15a880 0x7fe57c070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41640/0 (socket says 172.21.15.81:41640) 2024-09-13T18:49:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe57b200700 1 -- 172.21.15.81:0/4085168379 learned_addr learned my addr 172.21.15.81:0/4085168379 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:11.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe57a800700 1 --2- 172.21.15.81:0/4085168379 >> v2:172.21.15.81:3300/0 conn(0x7fe57c0ce280 0x7fe57c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.712+0000 7fe579e00700 1 -- 172.21.15.81:0/4085168379 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650859980 0 0) 0x7fe57c15df90 con 0x7fe57c15a880 2024-09-13T18:49:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe579e00700 1 -- 172.21.15.81:0/4085168379 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5600035d0 con 0x7fe57c15a880 2024-09-13T18:49:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe579e00700 1 -- 172.21.15.81:0/4085168379 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741230240 0 0) 0x7fe57c15aea0 con 0x7fe57c0cf1e0 2024-09-13T18:49:11.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe57a800700 1 -- 172.21.15.81:0/4085168379 >> v1:172.21.15.178:6789/0 conn(0x7fe57c0cf1e0 legacy=0x7fe57c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe57a800700 1 -- 172.21.15.81:0/4085168379 >> v1:172.21.15.81:6789/0 conn(0x7fe57c15a880 legacy=0x7fe57c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe57a800700 1 -- 172.21.15.81:0/4085168379 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c15d660 con 0x7fe57c0ce280 2024-09-13T18:49:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe57a800700 1 --2- 172.21.15.81:0/4085168379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c0ceca0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009850 tx=0x7fe56c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8287860094c14f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe579e00700 1 -- 172.21.15.81:0/4085168379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c011830 con 0x7fe57c0ce280 2024-09-13T18:49:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe579e00700 1 -- 172.21.15.81:0/4085168379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c011990 con 0x7fe57c0ce280 2024-09-13T18:49:11.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe579e00700 1 -- 172.21.15.81:0/4085168379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c011d00 con 0x7fe57c0ce280 2024-09-13T18:49:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 -- 172.21.15.81:0/4085168379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 msgr2=0x7fe57c0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 --2- 172.21.15.81:0/4085168379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c0ceca0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009850 tx=0x7fe56c009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:11.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 -- 172.21.15.81:0/4085168379 shutdown_connections 2024-09-13T18:49:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 --2- 172.21.15.81:0/4085168379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c0ceca0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 -- 172.21.15.81:0/4085168379 >> 172.21.15.81:0/4085168379 conn(0x7fe57c06a570 msgr2=0x7fe57c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 -- 172.21.15.81:0/4085168379 shutdown_connections 2024-09-13T18:49:11.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.716+0000 7fe581400700 1 -- 172.21.15.81:0/4085168379 wait complete. 2024-09-13T18:49:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.720+0000 7fe581400700 1 Processor -- start 2024-09-13T18:49:11.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.720+0000 7fe581400700 1 -- start start 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c1efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c0cf1e0 0x7fe57c1410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c15a880 0x7fe57c1415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c13f0d0 con 0x7fe57c0ce280 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0a94c0 con 0x7fe57c15a880 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0a97a0 con 0x7fe57c0cf1e0 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c1efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c1efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40594/0 (socket says 172.21.15.81:40594) 2024-09-13T18:49:11.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 -- 172.21.15.81:0/1399882166 learned_addr learned my addr 172.21.15.81:0/1399882166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57b200700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c15a880 0x7fe57c1415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe573e00700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c0cf1e0 0x7fe57c1410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 -- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c0cf1e0 msgr2=0x7fe57c1410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c0cf1e0 0x7fe57c1410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 -- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c15a880 msgr2=0x7fe57c1415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c15a880 0x7fe57c1415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 -- 172.21.15.81:0/1399882166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c0094b0 con 0x7fe57c0ce280 2024-09-13T18:49:11.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57b200700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c15a880 0x7fe57c1415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe573e00700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c0cf1e0 0x7fe57c1410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe57a800700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c1efb60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0090b0 tx=0x7fe56c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe572a00700 1 -- 172.21.15.81:0/1399882166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0036c0 con 0x7fe57c0ce280 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe572a00700 1 -- 172.21.15.81:0/1399882166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c01e070 con 0x7fe57c0ce280 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c0a9a80 con 0x7fe57c0ce280 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe572a00700 1 -- 172.21.15.81:0/1399882166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003a20 con 0x7fe57c0ce280 2024-09-13T18:49:11.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.724+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c1f00a0 con 0x7fe57c0ce280 2024-09-13T18:49:11.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.728+0000 7fe572a00700 1 -- 172.21.15.81:0/1399882166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe56c003b80 con 0x7fe57c0ce280 2024-09-13T18:49:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe572a00700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe558066730 0x7fe558068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe572a00700 1 -- 172.21.15.81:0/1399882166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe56c085250 con 0x7fe57c0ce280 2024-09-13T18:49:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe573e00700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe558066730 0x7fe558068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 Processor -- start 2024-09-13T18:49:11.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 -- start start 2024-09-13T18:49:11.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe573e00700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe558066730 0x7fe558068bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe57c159100 tx=0x7fe564009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 0x216dd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216fed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21646010 con 0x216fe950 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x215d3f40 con 0x216ff270 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21626e30 con 0x216dcd00 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe57a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 0x216dd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe57a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 0x216dd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40600/0 (socket says 172.21.15.81:40600) 2024-09-13T18:49:11.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.732+0000 7fe57a800700 1 -- 172.21.15.81:0/3056644483 learned_addr learned my addr 172.21.15.81:0/3056644483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57b200700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57a800700 1 -- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 msgr2=0x216fed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe573e00700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57a800700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216fed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57a800700 1 -- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 msgr2=0x216b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57a800700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57a800700 1 -- 172.21.15.81:0/3056644483 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21492a40 con 0x216fe950 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57b200700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe573e00700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe57a800700 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 0x216dd240 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009eb0 tx=0x7fe56c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7189da8e5cb1d566 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe56b000700 1 -- 172.21.15.81:0/3056644483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c056810 con 0x216fe950 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe56b000700 1 -- 172.21.15.81:0/3056644483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c056110 con 0x216fe950 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe56b000700 1 -- 172.21.15.81:0/3056644483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56c059f40 con 0x216fe950 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 -- 172.21.15.81:0/3056644483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 msgr2=0x216dd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 0x216dd240 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009eb0 tx=0x7fe56c009240 comp rx=0 tx=0).stop 2024-09-13T18:49:11.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 -- 172.21.15.81:0/3056644483 shutdown_connections 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216fed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 --2- 172.21.15.81:0/3056644483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216fe950 0x216dd240 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 -- 172.21.15.81:0/3056644483 >> 172.21.15.81:0/3056644483 conn(0x214475b0 msgr2=0x216b89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 -- 172.21.15.81:0/3056644483 shutdown_connections 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 -- 172.21.15.81:0/3056644483 wait complete. 2024-09-13T18:49:11.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 -- start start 2024-09-13T18:49:11.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.736+0000 7fe584858740 1 Processor -- start 2024-09-13T18:49:11.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216dcd00 0x216dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x216fd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21622150 con 0x216ff270 2024-09-13T18:49:11.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2161feb0 con 0x216dcd00 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x215dd8e0 con 0x216fe950 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 10 client.0 _ll_register_callbacks cb 0x215bc670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x216fd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x216fd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40604/0 (socket says 172.21.15.81:40604) 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 -- 172.21.15.81:0/169234450 learned_addr learned my addr 172.21.15.81:0/169234450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57a800700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216dcd00 0x216dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe573e00700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 -- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 msgr2=0x216df6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216df6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 -- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216dcd00 msgr2=0x216dc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216dcd00 0x216dc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 -- 172.21.15.81:0/169234450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c1f00a0 con 0x216ff270 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe573e00700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216df6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe57b200700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x216fd530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe57400e7e0 tx=0x7fe57400e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fed44e884da3d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe55f400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe55f400700 1 -- 172.21.15.81:0/169234450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740074e0 con 0x216ff270 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe55f400700 1 -- 172.21.15.81:0/169234450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe574007640 con 0x216ff270 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.740+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x214542c0 con 0x216ff270 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 1 -- 172.21.15.81:0/169234450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe574001bf0 con 0x216ff270 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 10 client.5682 fetch_fsmap learned FSMap version 24 2024-09-13T18:49:11.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x215e6290 con 0x216ff270 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 1 -- 172.21.15.81:0/169234450 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x214542c0 con 0x216ff270 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 1 -- 172.21.15.81:0/169234450 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fe574007800 con 0x216ff270 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 10 client.5682 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 10 client.5682 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 20 client.5682 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x216ddca0 0x216de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 4 client.5682 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2149e540 con 0x216ddca0 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe57a800700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x216ddca0 0x216de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe57a800700 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x216ddca0 0x216de0b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c14779d37209ae5 server_cookie=496c016afdf37bd7 in_seq=0 out_seq=0 2024-09-13T18:49:11.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 10 client.5682 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 1 -- 172.21.15.81:0/169234450 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2149e540 con 0x216ddca0 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 10 client.5682 handle_command_reply: tid=0 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 client.5682 shutdown 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 msgr2=0x216fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x216fd530 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe57400e7e0 tx=0x7fe57400e810 comp rx=0 tx=0).stop 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 shutdown_connections 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x216ddca0 0x216de0b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x216fd530 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216df6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe55f400700 0 client.5682 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 --2- 172.21.15.81:0/169234450 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216dcd00 0x216dc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 >> 172.21.15.81:0/169234450 conn(0x214475b0 msgr2=0x216b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 shutdown_connections 2024-09-13T18:49:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 1 -- 172.21.15.81:0/169234450 wait complete. 2024-09-13T18:49:11.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.744+0000 7fe584858740 20 client.5682 trim_cache size 0 max 16384 2024-09-13T18:49:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 Processor -- start 2024-09-13T18:49:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 -- start start 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216dcd00 0x21757e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216de080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216de5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x216e1e50 con 0x216dcd00 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x214cbb80 con 0x216ff270 2024-09-13T18:49:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x216fe760 con 0x216fe950 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216de5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216dcd00 0x21757e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216de5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:49568/0 (socket says 172.21.15.81:49568) 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 -- 172.21.15.81:0/1304679208 learned_addr learned my addr 172.21.15.81:0/1304679208 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe573e00700 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 -- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 msgr2=0x216de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216de080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 -- 172.21.15.81:0/1304679208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216dcd00 msgr2=0x21757e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216dcd00 0x21757e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.764+0000 7fe57b200700 1 -- 172.21.15.81:0/1304679208 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x215cc4c0 con 0x216ff270 2024-09-13T18:49:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe57b200700 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216de5c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe574001560 tx=0x7fe57400c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530cb7010353c513 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe56ba00700 1 -- 172.21.15.81:0/1304679208 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740074e0 con 0x216ff270 2024-09-13T18:49:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe56ba00700 1 -- 172.21.15.81:0/1304679208 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57400d040 con 0x216ff270 2024-09-13T18:49:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe56ba00700 1 -- 172.21.15.81:0/1304679208 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574007840 con 0x216ff270 2024-09-13T18:49:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 -- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 msgr2=0x216de5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216de5c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe574001560 tx=0x7fe57400c000 comp rx=0 tx=0).stop 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 -- 172.21.15.81:0/1304679208 shutdown_connections 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216ff270 0x216de5c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216fe950 0x216de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 --2- 172.21.15.81:0/1304679208 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216dcd00 0x21757e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 -- 172.21.15.81:0/1304679208 >> 172.21.15.81:0/1304679208 conn(0x214475b0 msgr2=0x2170ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 -- 172.21.15.81:0/1304679208 shutdown_connections 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 -- 172.21.15.81:0/1304679208 wait complete. 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 -- start start 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.768+0000 7fe584858740 1 Processor -- start 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216dbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216fe950 0x217565a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x217167f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21761520 con 0x216ff270 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21761750 con 0x216fe950 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x216fae40 con 0x216dcd00 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 10 client.0 _ll_register_callbacks cb 0x215ef8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x217167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x217167f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40610/0 (socket says 172.21.15.81:40610) 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 -- 172.21.15.81:0/2217842767 learned_addr learned my addr 172.21.15.81:0/2217842767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe573e00700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216fe950 0x217565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57a800700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216dbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 -- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 msgr2=0x216dbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216dbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 -- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216fe950 msgr2=0x217565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216fe950 0x217565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 -- 172.21.15.81:0/2217842767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x215e6290 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe573e00700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216fe950 0x217565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe57b200700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x217167f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe574001330 tx=0x7fe5740014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2608c2eb7a4784e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe55f400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe55f400700 1 -- 172.21.15.81:0/2217842767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574007980 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe56c056110 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe55f400700 1 -- 172.21.15.81:0/2217842767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe574013440 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe55f400700 1 -- 172.21.15.81:0/2217842767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe574013a60 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 10 client.5688 fetch_fsmap learned FSMap version 24 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x215c0790 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe55f400700 1 -- 172.21.15.81:0/2217842767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c056110 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe55f400700 1 -- 172.21.15.81:0/2217842767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fe574035070 con 0x216ff270 2024-09-13T18:49:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 10 client.5688 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:49:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 10 client.5688 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 20 client.5688 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x21756ae0 0x21714dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 4 client.5688 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:49:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.772+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x214c32c0 con 0x21756ae0 2024-09-13T18:49:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.776+0000 7fe57a800700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x21756ae0 0x21714dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.776+0000 7fe57a800700 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x21756ae0 0x21714dd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a873a8bde25cd4 server_cookie=a9e7ce01bb6f0c67 in_seq=0 out_seq=0 2024-09-13T18:49:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.776+0000 7fe55f400700 10 client.5688 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe55f400700 1 -- 172.21.15.81:0/2217842767 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x214c32c0 con 0x21756ae0 2024-09-13T18:49:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe55f400700 10 client.5688 handle_command_reply: tid=0 2024-09-13T18:49:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 client.5688 shutdown 2024-09-13T18:49:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 msgr2=0x217167f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x217167f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe574001330 tx=0x7fe5740014d0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 shutdown_connections 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x21756ae0 0x21714dd0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x216ff270 0x217167f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe55f400700 0 client.5688 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x216fe950 0x217565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 --2- 172.21.15.81:0/2217842767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x216dcd00 0x216dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 >> 172.21.15.81:0/2217842767 conn(0x214475b0 msgr2=0x216dfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 shutdown_connections 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 1 -- 172.21.15.81:0/2217842767 wait complete. 2024-09-13T18:49:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe584858740 20 client.5688 trim_cache size 0 max 16384 2024-09-13T18:49:11.806 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:49:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:49:11.806 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:49:11.806 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:49:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe558066730 msgr2=0x7fe558068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe558066730 0x7fe558068bf0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe57c159100 tx=0x7fe564009040 comp rx=0 tx=0).stop 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 msgr2=0x7fe57c1efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c1efb60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0090b0 tx=0x7fe56c004770 comp rx=0 tx=0).stop 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 shutdown_connections 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe558066730 0x7fe558068bf0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c15a880 0x7fe57c1415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c0cf1e0 0x7fe57c1410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 --2- 172.21.15.81:0/1399882166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe57c0ce280 0x7fe57c1efb60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 >> 172.21.15.81:0/1399882166 conn(0x7fe57c06a570 msgr2=0x7fe57c0b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 shutdown_connections 2024-09-13T18:49:11.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.796+0000 7fe581400700 1 -- 172.21.15.81:0/1399882166 wait complete. 2024-09-13T18:49:11.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:1 flush journal 2024-09-13T18:49:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.984+0000 7f3f26a00700 1 Processor -- start 2024-09-13T18:49:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.984+0000 7f3f26a00700 1 -- start start 2024-09-13T18:49:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f20159920 0x7f3f200b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3f200b30d0 0x7f3f2006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f200ce740 con 0x7f3f2006cea0 2024-09-13T18:49:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f200cd2a0 con 0x7f3f200b30d0 2024-09-13T18:49:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2006d2d0 con 0x7f3f20159920 2024-09-13T18:49:11.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3f2006cea0 0x7f3f2006fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41642/0 (socket says 172.21.15.81:41642) 2024-09-13T18:49:11.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f26000700 1 -- 172.21.15.81:0/2972272115 learned_addr learned my addr 172.21.15.81:0/2972272115 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:11.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f24c00700 1 --2- 172.21.15.81:0/2972272115 >> v2:172.21.15.178:3300/0 conn(0x7f3f200b30d0 0x7f3f2006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f25600700 1 --2- 172.21.15.81:0/2972272115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f20159920 0x7f3f200b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:11.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f1fe00700 1 -- 172.21.15.81:0/2972272115 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684730198 0 0) 0x7f3f200ce740 con 0x7f3f2006cea0 2024-09-13T18:49:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f25600700 1 -- 172.21.15.81:0/2972272115 >> v2:172.21.15.178:3300/0 conn(0x7f3f200b30d0 msgr2=0x7f3f2006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f25600700 1 --2- 172.21.15.81:0/2972272115 >> v2:172.21.15.178:3300/0 conn(0x7f3f200b30d0 0x7f3f2006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f25600700 1 -- 172.21.15.81:0/2972272115 >> v1:172.21.15.81:6789/0 conn(0x7f3f2006cea0 legacy=0x7f3f2006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f25600700 1 -- 172.21.15.81:0/2972272115 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f200ccc90 con 0x7f3f20159920 2024-09-13T18:49:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f25600700 1 --2- 172.21.15.81:0/2972272115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f20159920 0x7f3f200b2b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009850 tx=0x7f3f14009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff954c0cc7167b0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:11.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f1fe00700 1 -- 172.21.15.81:0/2972272115 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011830 con 0x7f3f20159920 2024-09-13T18:49:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.988+0000 7f3f1fe00700 1 -- 172.21.15.81:0/2972272115 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14011990 con 0x7f3f20159920 2024-09-13T18:49:11.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f1fe00700 1 -- 172.21.15.81:0/2972272115 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011d40 con 0x7f3f20159920 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 -- 172.21.15.81:0/2972272115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f20159920 msgr2=0x7f3f200b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 --2- 172.21.15.81:0/2972272115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f20159920 0x7f3f200b2b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009850 tx=0x7f3f14009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 -- 172.21.15.81:0/2972272115 shutdown_connections 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 --2- 172.21.15.81:0/2972272115 >> v2:172.21.15.178:3300/0 conn(0x7f3f200b30d0 0x7f3f2006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 --2- 172.21.15.81:0/2972272115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f20159920 0x7f3f200b2b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 -- 172.21.15.81:0/2972272115 >> 172.21.15.81:0/2972272115 conn(0x7f3f2006a390 msgr2=0x7f3f2006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 -- 172.21.15.81:0/2972272115 shutdown_connections 2024-09-13T18:49:11.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 -- 172.21.15.81:0/2972272115 wait complete. 2024-09-13T18:49:12.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 Processor -- start 2024-09-13T18:49:12.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.992+0000 7f3f26a00700 1 -- start start 2024-09-13T18:49:12.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f2006cea0 0x7f3f200ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f200b30d0 0x7f3f200714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 0x7f3f20151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200c9dc0 con 0x7f3f200c8c40 2024-09-13T18:49:12.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f201499b0 con 0x7f3f200b30d0 2024-09-13T18:49:12.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f200719e0 con 0x7f3f2006cea0 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 0x7f3f20151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f24c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f200b30d0 0x7f3f200714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 0x7f3f20151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40626/0 (socket says 172.21.15.81:40626) 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 -- 172.21.15.81:0/3424543231 learned_addr learned my addr 172.21.15.81:0/3424543231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f25600700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f2006cea0 0x7f3f200ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 -- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f2006cea0 msgr2=0x7f3f200ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f2006cea0 0x7f3f200ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 -- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f200b30d0 msgr2=0x7f3f200714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f200b30d0 0x7f3f200714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 -- 172.21.15.81:0/3424543231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140094b0 con 0x7f3f200c8c40 2024-09-13T18:49:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f200b30d0 0x7f3f200714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26000700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 0x7f3f20151b70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800cbd0 tx=0x7f3f1800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f1d600700 1 -- 172.21.15.81:0/3424543231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800aa60 con 0x7f3f200c8c40 2024-09-13T18:49:12.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2014cc30 con 0x7f3f200c8c40 2024-09-13T18:49:12.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f1d600700 1 -- 172.21.15.81:0/3424543231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1800abe0 con 0x7f3f200c8c40 2024-09-13T18:49:12.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f1d600700 1 -- 172.21.15.81:0/3424543231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f180070d0 con 0x7f3f200c8c40 2024-09-13T18:49:12.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:11.996+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200c9420 con 0x7f3f200c8c40 2024-09-13T18:49:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.000+0000 7f3f1d600700 1 -- 172.21.15.81:0/3424543231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f18007230 con 0x7f3f200c8c40 2024-09-13T18:49:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.000+0000 7f3f1d600700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f00066730 0x7f3f00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.000+0000 7f3f1d600700 1 -- 172.21.15.81:0/3424543231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f18083ff0 con 0x7f3f200c8c40 2024-09-13T18:49:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.000+0000 7f3f25600700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f00066730 0x7f3f00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.000+0000 7f3f25600700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f00066730 0x7f3f00068bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3f140090b0 tx=0x7f3f14008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.004+0000 7f3f2b418740 1 Processor -- start 2024-09-13T18:49:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.004+0000 7f3f2b418740 1 -- start start 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x43b1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43b0310 0x43d9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fb170 0x43fb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4342010 con 0x43fad90 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x42cff40 con 0x43b0310 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4322e30 con 0x43fb170 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x43b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x43b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40640/0 (socket says 172.21.15.81:40640) 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 -- 172.21.15.81:0/3335737387 learned_addr learned my addr 172.21.15.81:0/3335737387 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43b0310 0x43d9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f26000700 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fb170 0x43fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 -- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fb170 msgr2=0x43fb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fb170 0x43fb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 -- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43b0310 msgr2=0x43d9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43b0310 0x43d9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 -- 172.21.15.81:0/3335737387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x418ea40 con 0x43fad90 2024-09-13T18:49:12.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f25600700 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x43b1810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3f2006d410 tx=0x7f3f14010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2737b14155ce2b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f11c00700 1 -- 172.21.15.81:0/3335737387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1402c070 con 0x43fad90 2024-09-13T18:49:12.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f11c00700 1 -- 172.21.15.81:0/3335737387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14027ae0 con 0x43fad90 2024-09-13T18:49:12.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f11c00700 1 -- 172.21.15.81:0/3335737387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14020070 con 0x43fad90 2024-09-13T18:49:12.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- 172.21.15.81:0/3335737387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 msgr2=0x43b1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x43b1810 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3f2006d410 tx=0x7f3f14010000 comp rx=0 tx=0).stop 2024-09-13T18:49:12.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- 172.21.15.81:0/3335737387 shutdown_connections 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fb170 0x43fb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43b0310 0x43d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3335737387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x43b1810 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- 172.21.15.81:0/3335737387 >> 172.21.15.81:0/3335737387 conn(0x41435b0 msgr2=0x43b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- 172.21.15.81:0/3335737387 shutdown_connections 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.008+0000 7f3f2b418740 1 -- 172.21.15.81:0/3335737387 wait complete. 2024-09-13T18:49:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 -- start start 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 Processor -- start 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 0x43da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fad90 0x43f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fb170 0x43dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x431e150 con 0x43b0310 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x431beb0 con 0x43fb170 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x42d98e0 con 0x43fad90 2024-09-13T18:49:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 10 client.0 _ll_register_callbacks cb 0x42b8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 0x43da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 0x43da880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40650/0 (socket says 172.21.15.81:40650) 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 -- 172.21.15.81:0/2136508671 learned_addr learned my addr 172.21.15.81:0/2136508671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f26000700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fb170 0x43dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f24c00700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fad90 0x43f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 -- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fad90 msgr2=0x43f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fad90 0x43f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 -- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fb170 msgr2=0x43dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fb170 0x43dc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 -- 172.21.15.81:0/2136508671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200ccc90 con 0x43b0310 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f25600700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 0x43da880 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006df0 tx=0x7f3f140047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3896f7f99c8917f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f06000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f06000700 1 -- 172.21.15.81:0/2136508671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1402c040 con 0x43b0310 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f06000700 1 -- 172.21.15.81:0/2136508671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f14027e10 con 0x43b0310 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.012+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x41502c0 con 0x43b0310 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 1 -- 172.21.15.81:0/2136508671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f1403d660 con 0x43b0310 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 10 client.5700 fetch_fsmap learned FSMap version 24 2024-09-13T18:49:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x42e2290 con 0x43b0310 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 1 -- 172.21.15.81:0/2136508671 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x41502c0 con 0x43b0310 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 1 -- 172.21.15.81:0/2136508671 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3f1403d7c0 con 0x43b0310 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 10 client.5700 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 10 client.5700 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.a 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 20 client.5700 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43d8ec0 0x43d7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 4 client.5700 mds_command: new command op to 5314 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:49:12.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 --> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x419a540 con 0x43d8ec0 2024-09-13T18:49:12.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f24c00700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43d8ec0 0x43d7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f24c00700 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43d8ec0 0x43d7e40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4503cc1fe48e6cfe server_cookie=f4da418276a08484 in_seq=0 out_seq=0 2024-09-13T18:49:12.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 10 client.5700 ms_handle_connect on v2:172.21.15.81:6835/3633246084 2024-09-13T18:49:12.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 1 -- 172.21.15.81:0/2136508671 <== mds.1 v2:172.21.15.81:6835/3633246084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x419a540 con 0x43d8ec0 2024-09-13T18:49:12.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 10 client.5700 handle_command_reply: tid=0 2024-09-13T18:49:12.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 client.5700 shutdown 2024-09-13T18:49:12.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 msgr2=0x43da880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 0x43da880 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3f14006df0 tx=0x7f3f140047e0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 shutdown_connections 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fb170 0x43dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43d8ec0 0x43d7e40 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43fad90 0x43f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 --2- 172.21.15.81:0/2136508671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43b0310 0x43da880 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 >> 172.21.15.81:0/2136508671 conn(0x41435b0 msgr2=0x43d94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.016+0000 7f3f06000700 0 client.5700 ms_handle_reset on v2:172.21.15.81:6835/3633246084 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.020+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 shutdown_connections 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.020+0000 7f3f2b418740 1 -- 172.21.15.81:0/2136508671 wait complete. 2024-09-13T18:49:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.020+0000 7f3f2b418740 20 client.5700 trim_cache size 0 max 16384 2024-09-13T18:49:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 Processor -- start 2024-09-13T18:49:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 -- start start 2024-09-13T18:49:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x41435b0 0x43f8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x43f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x44027e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x41c7b80 con 0x43fad90 2024-09-13T18:49:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x431c760 con 0x41435b0 2024-09-13T18:49:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x42c0bd0 con 0x43b0310 2024-09-13T18:49:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x44027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x44027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40652/0 (socket says 172.21.15.81:40652) 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 -- 172.21.15.81:0/3079921035 learned_addr learned my addr 172.21.15.81:0/3079921035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x43f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f25600700 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x41435b0 0x43f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 -- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 msgr2=0x43f8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x43f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 -- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x41435b0 msgr2=0x43f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x41435b0 0x43f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f26000700 1 -- 172.21.15.81:0/3079921035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x42c84c0 con 0x43fad90 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.036+0000 7f3f25600700 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x41435b0 0x43f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f26000700 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x44027e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3f18054db0 tx=0x7f3f1805b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc788af249f5622d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f12600700 1 -- 172.21.15.81:0/3079921035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18058c50 con 0x43fad90 2024-09-13T18:49:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f12600700 1 -- 172.21.15.81:0/3079921035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1805d210 con 0x43fad90 2024-09-13T18:49:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f12600700 1 -- 172.21.15.81:0/3079921035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18054310 con 0x43fad90 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 -- 172.21.15.81:0/3079921035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 msgr2=0x44027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x44027e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3f18054db0 tx=0x7f3f1805b040 comp rx=0 tx=0).stop 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 -- 172.21.15.81:0/3079921035 shutdown_connections 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad90 0x44027e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x43f8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3079921035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x41435b0 0x43f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 -- 172.21.15.81:0/3079921035 >> 172.21.15.81:0/3079921035 conn(0x43b4f10 msgr2=0x440ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 -- 172.21.15.81:0/3079921035 shutdown_connections 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 -- 172.21.15.81:0/3079921035 wait complete. 2024-09-13T18:49:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 -- start start 2024-09-13T18:49:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.040+0000 7f3f2b418740 1 Processor -- start 2024-09-13T18:49:12.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 0x43da6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x445b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad90 0x445bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4412bf0 con 0x41435b0 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x441a150 con 0x43fad90 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4411840 con 0x43b0310 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 10 client.0 _ll_register_callbacks cb 0x431a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 0x43da6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 0x43da6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40664/0 (socket says 172.21.15.81:40664) 2024-09-13T18:49:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 -- 172.21.15.81:0/3548406153 learned_addr learned my addr 172.21.15.81:0/3548406153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x445b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f26000700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad90 0x445bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 -- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 msgr2=0x445b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x445b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 -- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad90 msgr2=0x445bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad90 0x445bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 -- 172.21.15.81:0/3548406153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f200c9420 con 0x41435b0 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x445b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f25600700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 0x43da6b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3f1403da60 tx=0x7f3f14011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf9d0f2ac2486a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f06000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f06000700 1 -- 172.21.15.81:0/3548406153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1402c040 con 0x41435b0 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f06000700 1 -- 172.21.15.81:0/3548406153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f1403dc80 con 0x41435b0 2024-09-13T18:49:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.044+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f14027ae0 con 0x41435b0 2024-09-13T18:49:12.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f06000700 1 -- 172.21.15.81:0/3548406153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f14027e10 con 0x41435b0 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 10 client.5706 fetch_fsmap learned FSMap version 24 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x42bc790 con 0x41435b0 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f06000700 1 -- 172.21.15.81:0/3548406153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14027ae0 con 0x41435b0 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f06000700 1 -- 172.21.15.81:0/3548406153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3f14032830 con 0x41435b0 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 10 client.5706 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 10 client.5706 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.a 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 20 client.5706 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43fb170 0x440f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 4 client.5706 mds_command: new command op to 5314 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 --> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x41bf2c0 con 0x43fb170 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43fb170 0x440f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f06000700 10 client.5706 ms_handle_connect on v2:172.21.15.81:6835/3633246084 2024-09-13T18:49:12.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.048+0000 7f3f24c00700 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43fb170 0x440f870 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd76ec191f341b68 server_cookie=8243f8196f9cd363 in_seq=0 out_seq=0 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f06000700 1 -- 172.21.15.81:0/3548406153 <== mds.1 v2:172.21.15.81:6835/3633246084 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x41bf2c0 con 0x43fb170 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f06000700 10 client.5706 handle_command_reply: tid=0 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 client.5706 shutdown 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 msgr2=0x43da6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 0x43da6b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3f1403da60 tx=0x7f3f14011000 comp rx=0 tx=0).stop 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 shutdown_connections 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad90 0x445bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:6835/3633246084,v1:172.21.15.81:6837/3633246084] conn(0x43fb170 0x440f870 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x43b0310 0x445b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 --2- 172.21.15.81:0/3548406153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x41435b0 0x43da6b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f06000700 0 client.5706 ms_handle_reset on v2:172.21.15.81:6835/3633246084 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 >> 172.21.15.81:0/3548406153 conn(0x43b4f10 msgr2=0x440ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 shutdown_connections 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.064+0000 7f3f2b418740 1 -- 172.21.15.81:0/3548406153 wait complete. 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f2b418740 20 client.5706 trim_cache size 0 max 16384 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:49:12.075 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:49:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f00066730 msgr2=0x7f3f00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f00066730 0x7f3f00068bf0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3f140090b0 tx=0x7f3f14008030 comp rx=0 tx=0).stop 2024-09-13T18:49:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 msgr2=0x7f3f20151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 0x7f3f20151b70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800cbd0 tx=0x7f3f1800cee0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 shutdown_connections 2024-09-13T18:49:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f00066730 0x7f3f00068bf0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f200c8c40 0x7f3f20151b70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f200b30d0 0x7f3f200714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 --2- 172.21.15.81:0/3424543231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f2006cea0 0x7f3f200ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 >> 172.21.15.81:0/3424543231 conn(0x7f3f2006a390 msgr2=0x7f3f2014f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 shutdown_connections 2024-09-13T18:49:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.068+0000 7f3f26a00700 1 -- 172.21.15.81:0/3424543231 wait complete. 2024-09-13T18:49:12.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:2 flush journal 2024-09-13T18:49:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.276+0000 7f3f3fc00700 1 Processor -- start 2024-09-13T18:49:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.276+0000 7f3f3fc00700 1 -- start start 2024-09-13T18:49:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3fc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f3806ff00 0x7f3f38070340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3fc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f38070880 con 0x7f3f3806ab90 2024-09-13T18:49:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3fc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380b3c20 con 0x7f3f381612c0 2024-09-13T18:49:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3fc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f380d0810 con 0x7f3f3806ff00 2024-09-13T18:49:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3dc00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3f3806ab90 0x7f3f3806b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41646/0 (socket says 172.21.15.81:41646) 2024-09-13T18:49:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3d200700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3f381612c0 0x7f3f380d0100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:57150/0 (socket says 172.21.15.81:57150) 2024-09-13T18:49:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f3dc00700 1 -- 172.21.15.81:0/3754135409 learned_addr learned my addr 172.21.15.81:0/3754135409 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3f3806ff00 0x7f3f38070340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336617053 0 0) 0x7f3f380b3c20 con 0x7f3f381612c0 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f200035d0 con 0x7f3f381612c0 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042611238 0 0) 0x7f3f38070880 con 0x7f3f3806ab90 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f380b3c20 con 0x7f3f3806ab90 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37e00700 1 -- 172.21.15.81:0/3754135409 >> v1:172.21.15.178:6789/0 conn(0x7f3f381612c0 legacy=0x7f3f380d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37e00700 1 -- 172.21.15.81:0/3754135409 >> v1:172.21.15.81:6789/0 conn(0x7f3f3806ab90 legacy=0x7f3f3806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37e00700 1 -- 172.21.15.81:0/3754135409 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380b3f00 con 0x7f3f3806ff00 2024-09-13T18:49:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3754135409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3806ff00 0x7f3f38070340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009850 tx=0x7f3f24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2907c82257a9ed36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24011830 con 0x7f3f3806ff00 2024-09-13T18:49:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24011990 con 0x7f3f3806ff00 2024-09-13T18:49:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.280+0000 7f3f37400700 1 -- 172.21.15.81:0/3754135409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24011d00 con 0x7f3f3806ff00 2024-09-13T18:49:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 -- 172.21.15.81:0/3754135409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3806ff00 msgr2=0x7f3f38070340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/3754135409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3806ff00 0x7f3f38070340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3f24009850 tx=0x7f3f24009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 -- 172.21.15.81:0/3754135409 shutdown_connections 2024-09-13T18:49:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/3754135409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f3806ff00 0x7f3f38070340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 -- 172.21.15.81:0/3754135409 >> 172.21.15.81:0/3754135409 conn(0x7f3f3806e660 msgr2=0x7f3f3806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 -- 172.21.15.81:0/3754135409 shutdown_connections 2024-09-13T18:49:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 -- 172.21.15.81:0/3754135409 wait complete. 2024-09-13T18:49:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.284+0000 7f3f3fc00700 1 Processor -- start 2024-09-13T18:49:12.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 -- start start 2024-09-13T18:49:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f3806ab90 0x7f3f38153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f3806ff00 0x7f3f38154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 0x7f3f3814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38155050 con 0x7f3f381612c0 2024-09-13T18:49:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3814eeb0 con 0x7f3f3806ab90 2024-09-13T18:49:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3fc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f38161700 con 0x7f3f3806ff00 2024-09-13T18:49:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 0x7f3f3814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 0x7f3f3814e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40694/0 (socket says 172.21.15.81:40694) 2024-09-13T18:49:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2130283573 learned_addr learned my addr 172.21.15.81:0/2130283573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3d200700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f3806ab90 0x7f3f38153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f37e00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f3806ff00 0x7f3f38154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f3806ff00 msgr2=0x7f3f38154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f3806ff00 0x7f3f38154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f3806ab90 msgr2=0x7f3f38153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f3806ab90 0x7f3f38153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2130283573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240094b0 con 0x7f3f381612c0 2024-09-13T18:49:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.288+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 0x7f3f3814e970 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000caf0 tx=0x7f3f3000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.292+0000 7f3f34c00700 1 -- 172.21.15.81:0/2130283573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30007480 con 0x7f3f381612c0 2024-09-13T18:49:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.292+0000 7f3f34c00700 1 -- 172.21.15.81:0/2130283573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300075e0 con 0x7f3f381612c0 2024-09-13T18:49:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.292+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f38153ed0 con 0x7f3f381612c0 2024-09-13T18:49:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.292+0000 7f3f34c00700 1 -- 172.21.15.81:0/2130283573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f30007970 con 0x7f3f381612c0 2024-09-13T18:49:12.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.292+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f381619a0 con 0x7f3f381612c0 2024-09-13T18:49:12.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.292+0000 7f3f34c00700 1 -- 172.21.15.81:0/2130283573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f3001b3b0 con 0x7f3f381612c0 2024-09-13T18:49:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.296+0000 7f3f34c00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f18066730 0x7f3f18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.296+0000 7f3f34c00700 1 -- 172.21.15.81:0/2130283573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f30083cc0 con 0x7f3f381612c0 2024-09-13T18:49:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.296+0000 7f3f3d200700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f18066730 0x7f3f18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.296+0000 7f3f3d200700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f18066730 0x7f3f18068bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000f60 tx=0x7f3f2c007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.296+0000 7f3f42efd740 1 Processor -- start 2024-09-13T18:49:12.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 -- start start 2024-09-13T18:49:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1bfd0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 0x1bff1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bfa55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf39010 con 0x1bfcfd00 2024-09-13T18:49:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bec6f40 con 0x1bff1950 2024-09-13T18:49:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bf19e30 con 0x1bff2270 2024-09-13T18:49:12.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 0x1bff1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 0x1bff1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40700/0 (socket says 172.21.15.81:40700) 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 -- 172.21.15.81:0/3462640803 learned_addr learned my addr 172.21.15.81:0/3462640803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f3d200700 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1bfd0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bfa55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 -- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 msgr2=0x1bfa55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bfa55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 -- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 msgr2=0x1bfd0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1bfd0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 -- 172.21.15.81:0/3462640803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bd85a40 con 0x1bfcfd00 2024-09-13T18:49:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 0x1bff1d30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3f24013000 tx=0x7f3f24010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dffc88a8fb29b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f29600700 1 -- 172.21.15.81:0/3462640803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24020070 con 0x1bfcfd00 2024-09-13T18:49:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f29600700 1 -- 172.21.15.81:0/3462640803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24011c00 con 0x1bfcfd00 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f29600700 1 -- 172.21.15.81:0/3462640803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24004040 con 0x1bfcfd00 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 -- 172.21.15.81:0/3462640803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 msgr2=0x1bff1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.300+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 0x1bff1d30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3f24013000 tx=0x7f3f24010000 comp rx=0 tx=0).stop 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- 172.21.15.81:0/3462640803 shutdown_connections 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bfa55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bfcfd00 0x1bff1d30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3462640803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1bfd0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- 172.21.15.81:0/3462640803 >> 172.21.15.81:0/3462640803 conn(0x1bd3a5b0 msgr2=0x1bfab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- 172.21.15.81:0/3462640803 shutdown_connections 2024-09-13T18:49:12.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- 172.21.15.81:0/3462640803 wait complete. 2024-09-13T18:49:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- start start 2024-09-13T18:49:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 Processor -- start 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1bfcf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff1950 0x1bfce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfcb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf15150 con 0x1bff2270 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf12eb0 con 0x1bfcfd00 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bed08e0 con 0x1bff1950 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f42efd740 10 client.0 _ll_register_callbacks cb 0x1beaf670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfcb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfcb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40716/0 (socket says 172.21.15.81:40716) 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 -- 172.21.15.81:0/1184640029 learned_addr learned my addr 172.21.15.81:0/1184640029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f37e00700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff1950 0x1bfce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 -- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff1950 msgr2=0x1bfce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff1950 0x1bfce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 -- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 msgr2=0x1bfcf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3d200700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1bfcf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1bfcf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 -- 172.21.15.81:0/1184640029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380b3f00 con 0x1bff2270 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f37e00700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff1950 0x1bfce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfcb940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3f30050ff0 tx=0x7f3f30055030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e8b7b67947d140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f1e000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.304+0000 7f3f1e000700 1 -- 172.21.15.81:0/1184640029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3005cee0 con 0x1bff2270 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f1e000700 1 -- 172.21.15.81:0/1184640029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f3005ca50 con 0x1bff2270 2024-09-13T18:49:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bd472c0 con 0x1bff2270 2024-09-13T18:49:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f1e000700 1 -- 172.21.15.81:0/1184640029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f3005cc30 con 0x1bff2270 2024-09-13T18:49:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 10 client.5721 fetch_fsmap learned FSMap version 24 2024-09-13T18:49:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x1bed9290 con 0x1bff2270 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f1e000700 1 -- 172.21.15.81:0/1184640029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30070020 con 0x1bff2270 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f1e000700 1 -- 172.21.15.81:0/1184640029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3f30055b00 con 0x1bff2270 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 10 client.5721 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 10 client.5721 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.d 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 20 client.5721 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1bffb7c0 0x1bffbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 4 client.5721 mds_command: new command op to 5006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 --> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bd91540 con 0x1bffb7c0 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f3d200700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1bffb7c0 0x1bffbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f3d200700 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1bffb7c0 0x1bffbbd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=959dd3c082fd1c28 server_cookie=ae6cddd020fc4e3b in_seq=0 out_seq=0 2024-09-13T18:49:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.308+0000 7f3f1e000700 10 client.5721 ms_handle_connect on v2:172.21.15.178:6834/628924969 2024-09-13T18:49:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f1e000700 1 -- 172.21.15.81:0/1184640029 <== mds.2 v2:172.21.15.178:6834/628924969 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1bd91540 con 0x1bffb7c0 2024-09-13T18:49:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f1e000700 10 client.5721 handle_command_reply: tid=0 2024-09-13T18:49:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 client.5721 shutdown 2024-09-13T18:49:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 msgr2=0x1bfcb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfcb940 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3f30050ff0 tx=0x7f3f30055030 comp rx=0 tx=0).stop 2024-09-13T18:49:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 shutdown_connections 2024-09-13T18:49:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1bffb7c0 0x1bffbbd0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfcb940 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff1950 0x1bfce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 --2- 172.21.15.81:0/1184640029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1bfcf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f1e000700 0 client.5721 ms_handle_reset on v2:172.21.15.178:6834/628924969 2024-09-13T18:49:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 >> 172.21.15.81:0/1184640029 conn(0x1bd3a5b0 msgr2=0x1bfaa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 shutdown_connections 2024-09-13T18:49:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 1 -- 172.21.15.81:0/1184640029 wait complete. 2024-09-13T18:49:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.312+0000 7f3f42efd740 20 client.5721 trim_cache size 0 max 16384 2024-09-13T18:49:12.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 Processor -- start 2024-09-13T18:49:12.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 -- start start 2024-09-13T18:49:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfcfd00 0x1c001c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1c002140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bdbeb80 con 0x1bff2270 2024-09-13T18:49:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bee3c00 con 0x1bff1950 2024-09-13T18:49:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1beb1620 con 0x1bfcfd00 2024-09-13T18:49:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfebfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40724/0 (socket says 172.21.15.81:40724) 2024-09-13T18:49:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2189685781 learned_addr learned my addr 172.21.15.81:0/2189685781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f37e00700 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1c002140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3d200700 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfcfd00 0x1c001c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfcfd00 msgr2=0x1c001c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfcfd00 0x1c001c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 msgr2=0x1c002140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1c002140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 -- 172.21.15.81:0/2189685781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bebf4c0 con 0x1bff2270 2024-09-13T18:49:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfebfb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3f30055150 tx=0x7f3f3001e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383f2cf616459e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f2a000700 1 -- 172.21.15.81:0/2189685781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000e040 con 0x1bff2270 2024-09-13T18:49:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f2a000700 1 -- 172.21.15.81:0/2189685781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30070040 con 0x1bff2270 2024-09-13T18:49:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.332+0000 7f3f2a000700 1 -- 172.21.15.81:0/2189685781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3005cee0 con 0x1bff2270 2024-09-13T18:49:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- 172.21.15.81:0/2189685781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 msgr2=0x1bfebfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfebfb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3f30055150 tx=0x7f3f3001e070 comp rx=0 tx=0).stop 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- 172.21.15.81:0/2189685781 shutdown_connections 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff2270 0x1bfebfb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff1950 0x1c002140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- 172.21.15.81:0/2189685781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfcfd00 0x1c001c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- 172.21.15.81:0/2189685781 >> 172.21.15.81:0/2189685781 conn(0x1bd3a5b0 msgr2=0x1bfee690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- 172.21.15.81:0/2189685781 shutdown_connections 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- 172.21.15.81:0/2189685781 wait complete. 2024-09-13T18:49:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- start start 2024-09-13T18:49:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 Processor -- start 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1c052f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 0x1bffaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bffb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bfef040 con 0x1bff1950 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf106c0 con 0x1bfcfd00 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1be9ca50 con 0x1bff2270 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f42efd740 10 client.0 _ll_register_callbacks cb 0x1bee28f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 0x1bffaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 0x1bffaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40728/0 (socket says 172.21.15.81:40728) 2024-09-13T18:49:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 -- 172.21.15.81:0/3751072874 learned_addr learned my addr 172.21.15.81:0/3751072874 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f3d200700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1c052f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f3dc00700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bffb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 -- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 msgr2=0x1bffb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bffb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 -- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 msgr2=0x1c052f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.336+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1c052f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f37e00700 1 -- 172.21.15.81:0/3751072874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1bed9290 con 0x1bff1950 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f37e00700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 0x1bffaba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3f3806f5c0 tx=0x7f3f240047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361a097ef6637681 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 1 -- 172.21.15.81:0/3751072874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f24004510 con 0x1bff1950 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 1 -- 172.21.15.81:0/3751072874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f240036c0 con 0x1bff1950 2024-09-13T18:49:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f24011c00 con 0x1bff1950 2024-09-13T18:49:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 1 -- 172.21.15.81:0/3751072874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f24003880 con 0x1bff1950 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 10 client.5727 fetch_fsmap learned FSMap version 24 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x1beb3790 con 0x1bff1950 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 1 -- 172.21.15.81:0/3751072874 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24011c00 con 0x1bff1950 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 1 -- 172.21.15.81:0/3751072874 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3f240039e0 con 0x1bff1950 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 10 client.5727 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 10 client.5727 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.d 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 20 client.5727 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1c053480 0x1c006cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 4 client.5727 mds_command: new command op to 5006 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 --> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x1bdb62c0 con 0x1c053480 2024-09-13T18:49:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f3d200700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1c053480 0x1c006cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f3d200700 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1c053480 0x1c006cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2aefc2ca19fc5bbb server_cookie=95aa6a3e77a316a1 in_seq=0 out_seq=0 2024-09-13T18:49:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.340+0000 7f3f1e000700 10 client.5727 ms_handle_connect on v2:172.21.15.178:6834/628924969 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f1e000700 1 -- 172.21.15.81:0/3751072874 <== mds.2 v2:172.21.15.178:6834/628924969 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x1bdb62c0 con 0x1c053480 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f1e000700 10 client.5727 handle_command_reply: tid=0 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 client.5727 shutdown 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 msgr2=0x1bffaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 0x1bffaba0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3f3806f5c0 tx=0x7f3f240047e0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 shutdown_connections 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:6834/628924969,v1:172.21.15.178:6835/628924969] conn(0x1c053480 0x1c006cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff2270 0x1bffb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bff1950 0x1bffaba0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 --2- 172.21.15.81:0/3751072874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfcfd00 0x1c052f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f1e000700 0 client.5727 ms_handle_reset on v2:172.21.15.178:6834/628924969 2024-09-13T18:49:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.356+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 >> 172.21.15.81:0/3751072874 conn(0x1bd3a5b0 msgr2=0x1bfee690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 shutdown_connections 2024-09-13T18:49:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f42efd740 1 -- 172.21.15.81:0/3751072874 wait complete. 2024-09-13T18:49:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f42efd740 20 client.5727 trim_cache size 0 max 16384 2024-09-13T18:49:12.367 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:49:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:49:12.368 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:49:12.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:49:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f18066730 msgr2=0x7f3f18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f18066730 0x7f3f18068bf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000f60 tx=0x7f3f2c007e00 comp rx=0 tx=0).stop 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 msgr2=0x7f3f3814e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 0x7f3f3814e970 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000caf0 tx=0x7f3f3000cb20 comp rx=0 tx=0).stop 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 shutdown_connections 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3f18066730 0x7f3f18068bf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f381612c0 0x7f3f3814e970 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f3806ff00 0x7f3f38154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 --2- 172.21.15.81:0/2130283573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f3806ab90 0x7f3f38153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 >> 172.21.15.81:0/2130283573 conn(0x7f3f3806e660 msgr2=0x7f3f381604e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 shutdown_connections 2024-09-13T18:49:12.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:12.360+0000 7f3f3fc00700 1 -- 172.21.15.81:0/2130283573 wait complete. 2024-09-13T18:49:12.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:49:12.392 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-13T18:49:12.428 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/ 2024-09-13T18:49:12.428 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4 2024-09-13T18:49:12.428 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5 2024-09-13T18:49:12.428 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6 2024-09-13T18:49:12.428 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-13T18:49:12.428 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-13T18:49:12.430 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:49:12.430 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:49:12.430 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:49:12.430 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:49:12.431 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-13T18:49:12.431 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:49:12.569 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2024-09-13T18:49:12.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:12.679 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:12.758 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:49:12.759 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:49:12.759 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:49:12.759 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:49:12.759 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-13T18:49:12.759 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:49:12.902 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627779 2024-09-13T18:49:13.087 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:49:13.088 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:49:13.088 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:49:13.088 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:49:13.088 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-13T18:49:13.088 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:49:13.224 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627780 2024-09-13T18:49:13.411 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:49:13.412 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:49:13.412 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:49:13.412 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:49:13.412 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-13T18:49:13.412 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:49:13.556 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627781 2024-09-13T18:49:13.744 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:49:13.745 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:49:13.745 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:49:13.745 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:49:13.745 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-13T18:49:13.745 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:49:13.883 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627782 2024-09-13T18:49:14.073 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:49:14.073 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:49:14.073 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:49:14.073 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:49:14.073 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-13T18:49:14.073 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:49:14.209 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627783 2024-09-13T18:49:14.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 tag path /d1/d2/d3 tag123 2024-09-13T18:49:14.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.612+0000 7f98c4e00700 1 Processor -- start 2024-09-13T18:49:14.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.612+0000 7f98c4e00700 1 -- start start 2024-09-13T18:49:14.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98c4e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98c0159940 0x7f98c006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98c4e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c00ac640 con 0x7f98c006d910 2024-09-13T18:49:14.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98c4e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c006dd30 con 0x7f98c00b3050 2024-09-13T18:49:14.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98c4e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c00ac4b0 con 0x7f98c0159940 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98bf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98c0159940 0x7f98c006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98bf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f98c0159940 0x7f98c006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40736/0 (socket says 172.21.15.81:40736) 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98bf400700 1 -- 172.21.15.81:0/1062049314 learned_addr learned my addr 172.21.15.81:0/1062049314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.616+0000 7f98bea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98c006d910 0x7f98c00b2940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41648/0 (socket says 172.21.15.81:41648) 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98bf400700 1 -- 172.21.15.81:0/1062049314 >> v1:172.21.15.178:6789/0 conn(0x7f98c00b3050 legacy=0x7f98c00acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98bf400700 1 -- 172.21.15.81:0/1062049314 >> v1:172.21.15.81:6789/0 conn(0x7f98c006d910 legacy=0x7f98c00b2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98bf400700 1 -- 172.21.15.81:0/1062049314 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00b3650 con 0x7f98c0159940 2024-09-13T18:49:14.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98bf400700 1 --2- 172.21.15.81:0/1062049314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c006d3d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009910 tx=0x7f98b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e017597cbc46c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98be000700 1 -- 172.21.15.81:0/1062049314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b000ba60 con 0x7f98c0159940 2024-09-13T18:49:14.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98be000700 1 -- 172.21.15.81:0/1062049314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b000bbc0 con 0x7f98c0159940 2024-09-13T18:49:14.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98be000700 1 -- 172.21.15.81:0/1062049314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0009e60 con 0x7f98c0159940 2024-09-13T18:49:14.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 -- 172.21.15.81:0/1062049314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 msgr2=0x7f98c006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 --2- 172.21.15.81:0/1062049314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c006d3d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009910 tx=0x7f98b0009c20 comp rx=0 tx=0).stop 2024-09-13T18:49:14.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 -- 172.21.15.81:0/1062049314 shutdown_connections 2024-09-13T18:49:14.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 --2- 172.21.15.81:0/1062049314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c006d3d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 -- 172.21.15.81:0/1062049314 >> 172.21.15.81:0/1062049314 conn(0x7f98c00b0c30 msgr2=0x7f98c00b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 -- 172.21.15.81:0/1062049314 shutdown_connections 2024-09-13T18:49:14.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.620+0000 7f98c4e00700 1 -- 172.21.15.81:0/1062049314 wait complete. 2024-09-13T18:49:14.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 Processor -- start 2024-09-13T18:49:14.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 -- start start 2024-09-13T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c006d910 0x7f98c0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c00b3050 0x7f98c009c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c00cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0099a20 con 0x7f98c0159940 2024-09-13T18:49:14.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c009a560 con 0x7f98c006d910 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c0154150 con 0x7f98c00b3050 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c00cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c00cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40752/0 (socket says 172.21.15.81:40752) 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 -- 172.21.15.81:0/3823219847 learned_addr learned my addr 172.21.15.81:0/3823219847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bea00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c00b3050 0x7f98c009c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bf400700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c006d910 0x7f98c0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 -- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c00b3050 msgr2=0x7f98c009c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c00b3050 0x7f98c009c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 -- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c006d910 msgr2=0x7f98c0153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c006d910 0x7f98c0153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 -- 172.21.15.81:0/3823219847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0009570 con 0x7f98c0159940 2024-09-13T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98bfe00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c00cbf60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f98b800cc80 tx=0x7f98b800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98b7400700 1 -- 172.21.15.81:0/3823219847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800ad40 con 0x7f98c0159940 2024-09-13T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98b7400700 1 -- 172.21.15.81:0/3823219847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800ce80 con 0x7f98c0159940 2024-09-13T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c0099c30 con 0x7f98c0159940 2024-09-13T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98b7400700 1 -- 172.21.15.81:0/3823219847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800aea0 con 0x7f98c0159940 2024-09-13T18:49:14.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.624+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c009a1f0 con 0x7f98c0159940 2024-09-13T18:49:14.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.628+0000 7f98b7400700 1 -- 172.21.15.81:0/3823219847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98b8003c60 con 0x7f98c0159940 2024-09-13T18:49:14.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.632+0000 7f98b7400700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f98a0066730 0x7f98a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.632+0000 7f98b7400700 1 -- 172.21.15.81:0/3823219847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98b8084440 con 0x7f98c0159940 2024-09-13T18:49:14.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.632+0000 7f98bf400700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f98a0066730 0x7f98a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.632+0000 7f98bf400700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f98a0066730 0x7f98a0068bf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f98b0006f80 tx=0x7f98b0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.632+0000 7f98c9807740 1 Processor -- start 2024-09-13T18:49:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.632+0000 7f98c9807740 1 -- start start 2024-09-13T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfacc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfacd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfb15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa3dda0 con 0xfaccc70 2024-09-13T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa3b530 con 0xfacbca0 2024-09-13T18:49:14.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xfa36e20 con 0xfacd590 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfacd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfacd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40756/0 (socket says 172.21.15.81:40756) 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 -- 172.21.15.81:0/4192880935 learned_addr learned my addr 172.21.15.81:0/4192880935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bfe00700 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfb15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bf400700 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfacc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 -- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 msgr2=0xfb15090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfb15090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 -- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 msgr2=0xfacc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfacc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 -- 172.21.15.81:0/4192880935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf8a9bd0 con 0xfaccc70 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bf400700 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfacc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:14.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98bea00700 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfacd050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f98ac005e40 tx=0x7f98ac007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef19180a749219ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98abe00700 1 -- 172.21.15.81:0/4192880935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0114f0 con 0xfaccc70 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98abe00700 1 -- 172.21.15.81:0/4192880935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac011650 con 0xfaccc70 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98abe00700 1 -- 172.21.15.81:0/4192880935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0119c0 con 0xfaccc70 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 -- 172.21.15.81:0/4192880935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 msgr2=0xfacd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.636+0000 7f98c9807740 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfacd050 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f98ac005e40 tx=0x7f98ac007330 comp rx=0 tx=0).stop 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 -- 172.21.15.81:0/4192880935 shutdown_connections 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfb15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfacd050 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 --2- 172.21.15.81:0/4192880935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfacc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 -- 172.21.15.81:0/4192880935 >> 172.21.15.81:0/4192880935 conn(0xf85e740 msgr2=0xfaf83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 -- 172.21.15.81:0/4192880935 shutdown_connections 2024-09-13T18:49:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 -- 172.21.15.81:0/4192880935 wait complete. 2024-09-13T18:49:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 -- start start 2024-09-13T18:49:14.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.640+0000 7f98c9807740 1 Processor -- start 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 0xfafc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfaccc70 0xfafa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfafaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9d5260 con 0xfacbca0 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9fa5f0 con 0xfaccc70 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf8e2d10 con 0xfacd590 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 10 client.0 _ll_register_callbacks cb 0xfa3f640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 0xfafc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 0xfafc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40766/0 (socket says 172.21.15.81:40766) 2024-09-13T18:49:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 -- 172.21.15.81:0/3182586536 learned_addr learned my addr 172.21.15.81:0/3182586536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bea00700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfaccc70 0xfafa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bfe00700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfafaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 -- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 msgr2=0xfafaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfafaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 -- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfaccc70 msgr2=0xfafa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfaccc70 0xfafa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 -- 172.21.15.81:0/3182586536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac00f040 con 0xfacbca0 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98bf400700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 0xfafc4a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c010 tx=0x7f98b00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9803379f96671a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98a8c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98a8c00700 1 -- 172.21.15.81:0/3182586536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b0031430 con 0xfacbca0 2024-09-13T18:49:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98a8c00700 1 -- 172.21.15.81:0/3182586536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98b0031590 con 0xfacbca0 2024-09-13T18:49:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf86b450 con 0xfacbca0 2024-09-13T18:49:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98a8c00700 1 -- 172.21.15.81:0/3182586536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98b0031790 con 0xfacbca0 2024-09-13T18:49:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 10 client.5742 fetch_fsmap learned FSMap version 25 2024-09-13T18:49:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0xf9fd330 con 0xfacbca0 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98a8c00700 1 -- 172.21.15.81:0/3182586536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf86b450 con 0xfacbca0 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98a8c00700 1 -- 172.21.15.81:0/3182586536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f98b00318f0 con 0xfacbca0 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 10 client.5742 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.644+0000 7f98c9807740 10 client.5742 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 20 client.5742 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfaf51a0 0xfaf8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 4 client.5742 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:49:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf8b56d0 con 0xfaf51a0 2024-09-13T18:49:14.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98bea00700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfaf51a0 0xfaf8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98bea00700 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfaf51a0 0xfaf8720 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255f2199fbb22e26 server_cookie=9a397e02001bdc51 in_seq=0 out_seq=0 2024-09-13T18:49:14.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98a8c00700 10 client.5742 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98a8c00700 1 -- 172.21.15.81:0/3182586536 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xf8b56d0 con 0xfaf51a0 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98a8c00700 10 client.5742 handle_command_reply: tid=0 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 client.5742 shutdown 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 msgr2=0xfafc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 0xfafc4a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f98b000c010 tx=0x7f98b00047e0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 shutdown_connections 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfaf51a0 0xfaf8720 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacd590 0xfafaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfaccc70 0xfafa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 --2- 172.21.15.81:0/3182586536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacbca0 0xfafc4a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98a8c00700 0 client.5742 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 >> 172.21.15.81:0/3182586536 conn(0xf85e740 msgr2=0xfacb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 shutdown_connections 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 1 -- 172.21.15.81:0/3182586536 wait complete. 2024-09-13T18:49:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.648+0000 7f98c9807740 20 client.5742 trim_cache size 0 max 16384 2024-09-13T18:49:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 Processor -- start 2024-09-13T18:49:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 -- start start 2024-09-13T18:49:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfb25a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfaccc70 0xfb12ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 0xfb13410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa075f0 con 0xfacd590 2024-09-13T18:49:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9f9ef0 con 0xfacbca0 2024-09-13T18:49:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xfa060f0 con 0xfaccc70 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 0xfb13410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 0xfb13410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40774/0 (socket says 172.21.15.81:40774) 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98bfe00700 1 -- 172.21.15.81:0/1318071533 learned_addr learned my addr 172.21.15.81:0/1318071533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98bea00700 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfaccc70 0xfb12ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.672+0000 7f98bf400700 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfb25a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98bfe00700 1 -- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfaccc70 msgr2=0xfb12ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98bfe00700 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfaccc70 0xfb12ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98bfe00700 1 -- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 msgr2=0xfb25a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98bfe00700 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfb25a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98bfe00700 1 -- 172.21.15.81:0/1318071533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf9e3560 con 0xfacd590 2024-09-13T18:49:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98bfe00700 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 0xfb13410 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f98b8055200 tx=0x7f98b8005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0376ad28bb7611 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98b4c00700 1 -- 172.21.15.81:0/1318071533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b805d660 con 0xfacd590 2024-09-13T18:49:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98b4c00700 1 -- 172.21.15.81:0/1318071533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8053610 con 0xfacd590 2024-09-13T18:49:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98b4c00700 1 -- 172.21.15.81:0/1318071533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8051980 con 0xfacd590 2024-09-13T18:49:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 -- 172.21.15.81:0/1318071533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 msgr2=0xfb13410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 0xfb13410 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f98b8055200 tx=0x7f98b8005040 comp rx=0 tx=0).stop 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 -- 172.21.15.81:0/1318071533 shutdown_connections 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfacd590 0xfb13410 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfaccc70 0xfb12ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 --2- 172.21.15.81:0/1318071533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacbca0 0xfb25a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 -- 172.21.15.81:0/1318071533 >> 172.21.15.81:0/1318071533 conn(0xf85e740 msgr2=0xfacfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 -- 172.21.15.81:0/1318071533 shutdown_connections 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 -- 172.21.15.81:0/1318071533 wait complete. 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 -- start start 2024-09-13T18:49:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.676+0000 7f98c9807740 1 Processor -- start 2024-09-13T18:49:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacbca0 0xfb2d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfb78bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacd590 0xfb2c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa66b90 con 0xfaccc70 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9c2140 con 0xfacd590 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xfa383b0 con 0xfacbca0 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 10 client.0 _ll_register_callbacks cb 0xfa01320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfb78bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfb78bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40786/0 (socket says 172.21.15.81:40786) 2024-09-13T18:49:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 -- 172.21.15.81:0/2269692288 learned_addr learned my addr 172.21.15.81:0/2269692288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bfe00700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacd590 0xfb2c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bf400700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacbca0 0xfb2d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 -- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacbca0 msgr2=0xfb2d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacbca0 0xfb2d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 -- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacd590 msgr2=0xfb2c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacd590 0xfb2c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 -- 172.21.15.81:0/2269692288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c009a1f0 con 0xfaccc70 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bfe00700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacd590 0xfb2c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bf400700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacbca0 0xfb2d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98bea00700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfb78bd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98ac017040 tx=0x7f98ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0952b85206709e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98a8c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98a8c00700 1 -- 172.21.15.81:0/2269692288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac025040 con 0xfaccc70 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98ac011650 con 0xfaccc70 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98a8c00700 1 -- 172.21.15.81:0/2269692288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f98ac028df0 con 0xfaccc70 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98a8c00700 1 -- 172.21.15.81:0/2269692288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98ac028290 con 0xfaccc70 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 10 client.5748 fetch_fsmap learned FSMap version 25 2024-09-13T18:49:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0xf9d7830 con 0xfaccc70 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98a8c00700 1 -- 172.21.15.81:0/2269692288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac011650 con 0xfaccc70 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98a8c00700 1 -- 172.21.15.81:0/2269692288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f98ac0283f0 con 0xfaccc70 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 10 client.5748 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 10 client.5748 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 20 client.5748 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfb2cc20 0xfb77740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 4 client.5748 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}] 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.680+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}) v1 -- 0xf8da450 con 0xfb2cc20 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98bf400700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfb2cc20 0xfb77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98bf400700 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfb2cc20 0xfb77740 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff1d7d69d5c1db server_cookie=917fdf56fe4274f0 in_seq=0 out_seq=0 2024-09-13T18:49:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98a8c00700 10 client.5748 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98a8c00700 1 -- 172.21.15.81:0/2269692288 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+80 (crc 0 0 0) 0xf8da450 con 0xfb2cc20 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98a8c00700 10 client.5748 handle_command_reply: tid=0 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 client.5748 shutdown 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 msgr2=0xfb78bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfb78bd0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f98ac017040 tx=0x7f98ac000ed0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 shutdown_connections 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0xfb2cc20 0xfb77740 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xfacd590 0xfb2c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xfaccc70 0xfb78bd0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 --2- 172.21.15.81:0/2269692288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfacbca0 0xfb2d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98a8c00700 0 client.5748 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 >> 172.21.15.81:0/2269692288 conn(0xf85e740 msgr2=0xfb13d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 shutdown_connections 2024-09-13T18:49:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.684+0000 7f98c9807740 1 -- 172.21.15.81:0/2269692288 wait complete. 2024-09-13T18:49:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c9807740 20 client.5748 trim_cache size 0 max 16384 2024-09-13T18:49:14.695 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:49:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-13T18:49:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "tag123", 2024-09-13T18:49:14.695 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-13T18:49:14.696 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:49:14.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f98a0066730 msgr2=0x7f98a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f98a0066730 0x7f98a0068bf0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f98b0006f80 tx=0x7f98b0008030 comp rx=0 tx=0).stop 2024-09-13T18:49:14.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 msgr2=0x7f98c00cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c00cbf60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f98b800cc80 tx=0x7f98b800a340 comp rx=0 tx=0).stop 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 shutdown_connections 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f98a0066730 0x7f98a0068bf0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98c0159940 0x7f98c00cbf60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c00b3050 0x7f98c009c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 --2- 172.21.15.81:0/3823219847 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c006d910 0x7f98c0153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 >> 172.21.15.81:0/3823219847 conn(0x7f98c00b0c30 msgr2=0x7f98c00b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 shutdown_connections 2024-09-13T18:49:14.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.688+0000 7f98c4e00700 1 -- 172.21.15.81:0/3823219847 wait complete. 2024-09-13T18:49:14.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-13T18:49:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.884+0000 7f56d3e00700 1 Processor -- start 2024-09-13T18:49:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d3e00700 1 -- start start 2024-09-13T18:49:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56d406c5a0 0x7f56d415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f56d40cf830 0x7f56d40cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d40b4680 con 0x7f56d406c980 2024-09-13T18:49:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40b5dd0 con 0x7f56d406c5a0 2024-09-13T18:49:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40b4960 con 0x7f56d40cf830 2024-09-13T18:49:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d2000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f56d406c980 0x7f56d40b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41652/0 (socket says 172.21.15.81:41652) 2024-09-13T18:49:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d2000700 1 -- 172.21.15.81:0/548777837 learned_addr learned my addr 172.21.15.81:0/548777837 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.888+0000 7f56d2a00700 1 --2- 172.21.15.81:0/548777837 >> v2:172.21.15.81:3300/0 conn(0x7f56d406c5a0 0x7f56d415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3400700 1 --2- 172.21.15.81:0/548777837 >> v2:172.21.15.178:3300/0 conn(0x7f56d40cf830 0x7f56d40cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d2a00700 1 -- 172.21.15.81:0/548777837 >> v2:172.21.15.178:3300/0 conn(0x7f56d40cf830 msgr2=0x7f56d40cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d2a00700 1 --2- 172.21.15.81:0/548777837 >> v2:172.21.15.178:3300/0 conn(0x7f56d40cf830 0x7f56d40cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d2a00700 1 -- 172.21.15.81:0/548777837 >> v1:172.21.15.81:6789/0 conn(0x7f56d406c980 legacy=0x7f56d40b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d1600700 1 -- 172.21.15.81:0/548777837 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947280687 0 0) 0x7f56d40b4680 con 0x7f56d406c980 2024-09-13T18:49:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d2a00700 1 -- 172.21.15.81:0/548777837 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40cf030 con 0x7f56d406c5a0 2024-09-13T18:49:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d2a00700 1 --2- 172.21.15.81:0/548777837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c5a0 0x7f56d415aa90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f56d40d1210 tx=0x7f56c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c570bc27c4cf17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d1600700 1 -- 172.21.15.81:0/548777837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4011830 con 0x7f56d406c5a0 2024-09-13T18:49:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d1600700 1 -- 172.21.15.81:0/548777837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c4011990 con 0x7f56d406c5a0 2024-09-13T18:49:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d1600700 1 -- 172.21.15.81:0/548777837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c4011d20 con 0x7f56d406c5a0 2024-09-13T18:49:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 -- 172.21.15.81:0/548777837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c5a0 msgr2=0x7f56d415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 --2- 172.21.15.81:0/548777837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c5a0 0x7f56d415aa90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f56d40d1210 tx=0x7f56c4009b30 comp rx=0 tx=0).stop 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 -- 172.21.15.81:0/548777837 shutdown_connections 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 --2- 172.21.15.81:0/548777837 >> v2:172.21.15.178:3300/0 conn(0x7f56d40cf830 0x7f56d40cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 --2- 172.21.15.81:0/548777837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c5a0 0x7f56d415aa90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 -- 172.21.15.81:0/548777837 >> 172.21.15.81:0/548777837 conn(0x7f56d4071d20 msgr2=0x7f56d4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 -- 172.21.15.81:0/548777837 shutdown_connections 2024-09-13T18:49:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.892+0000 7f56d3e00700 1 -- 172.21.15.81:0/548777837 wait complete. 2024-09-13T18:49:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 Processor -- start 2024-09-13T18:49:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 -- start start 2024-09-13T18:49:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56d406c5a0 0x7f56d413a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 0x7f56d415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56d40cf830 0x7f56d415d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d414cc80 con 0x7f56d406c980 2024-09-13T18:49:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d414c000 con 0x7f56d40cf830 2024-09-13T18:49:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d414c2e0 con 0x7f56d406c5a0 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 0x7f56d415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 0x7f56d415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40806/0 (socket says 172.21.15.81:40806) 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 -- 172.21.15.81:0/3237717111 learned_addr learned my addr 172.21.15.81:0/3237717111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d3400700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56d40cf830 0x7f56d415d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56d406c5a0 0x7f56d413a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 -- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56d406c5a0 msgr2=0x7f56d413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56d406c5a0 0x7f56d413a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 -- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56d40cf830 msgr2=0x7f56d415d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56d40cf830 0x7f56d415d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2000700 1 -- 172.21.15.81:0/3237717111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40094b0 con 0x7f56d406c980 2024-09-13T18:49:14.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.896+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56d406c5a0 0x7f56d413a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:14.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56d2000700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 0x7f56d415d040 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f56c000c580 tx=0x7f56c000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56caa00700 1 -- 172.21.15.81:0/3237717111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004ca0 con 0x7f56d406c980 2024-09-13T18:49:14.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56caa00700 1 -- 172.21.15.81:0/3237717111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0004e20 con 0x7f56d406c980 2024-09-13T18:49:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d414c5c0 con 0x7f56d406c980 2024-09-13T18:49:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56caa00700 1 -- 172.21.15.81:0/3237717111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0007310 con 0x7f56d406c980 2024-09-13T18:49:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d413a830 con 0x7f56d406c980 2024-09-13T18:49:14.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.900+0000 7f56caa00700 1 -- 172.21.15.81:0/3237717111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56c0007470 con 0x7f56d406c980 2024-09-13T18:49:14.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.904+0000 7f56caa00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f56b4066760 0x7f56b4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.904+0000 7f56caa00700 1 -- 172.21.15.81:0/3237717111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56c0083f80 con 0x7f56d406c980 2024-09-13T18:49:14.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.904+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f56b4066760 0x7f56b4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.904+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f56b4066760 0x7f56b4068c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f56c4000c00 tx=0x7f56c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.904+0000 7f56dce91740 1 Processor -- start 2024-09-13T18:49:14.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.904+0000 7f56dce91740 1 -- start start 2024-09-13T18:49:14.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b8c7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b8ef520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b911550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b858010 con 0x1b911170 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b7e5f40 con 0x1b910d90 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b838e30 con 0x1b8c6310 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b911550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b911550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40808/0 (socket says 172.21.15.81:40808) 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 -- 172.21.15.81:0/2316656050 learned_addr learned my addr 172.21.15.81:0/2316656050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d2a00700 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b8c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d2000700 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b8ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 -- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 msgr2=0x1b8ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b8ef520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 -- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 msgr2=0x1b8c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b8c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 -- 172.21.15.81:0/2316656050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b6a4a40 con 0x1b911170 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56d3400700 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b911550 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f56cc011550 tx=0x7f56cc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3e0677bd3fc1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56bf400700 1 -- 172.21.15.81:0/2316656050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00e040 con 0x1b911170 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56bf400700 1 -- 172.21.15.81:0/2316656050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc00f040 con 0x1b911170 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56bf400700 1 -- 172.21.15.81:0/2316656050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc015830 con 0x1b911170 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- 172.21.15.81:0/2316656050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 msgr2=0x1b911550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b911550 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f56cc011550 tx=0x7f56cc009750 comp rx=0 tx=0).stop 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- 172.21.15.81:0/2316656050 shutdown_connections 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b911550 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b8ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 --2- 172.21.15.81:0/2316656050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b8c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- 172.21.15.81:0/2316656050 >> 172.21.15.81:0/2316656050 conn(0x1b6595b0 msgr2=0x1b8cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- 172.21.15.81:0/2316656050 shutdown_connections 2024-09-13T18:49:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- 172.21.15.81:0/2316656050 wait complete. 2024-09-13T18:49:14.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.908+0000 7f56dce91740 1 -- start start 2024-09-13T18:49:14.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 Processor -- start 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 0x1b8edb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b910d90 0x1b8ea830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b8e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b834150 con 0x1b8c6310 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b831eb0 con 0x1b911170 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b7ef8e0 con 0x1b910d90 2024-09-13T18:49:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 10 client.0 _ll_register_callbacks cb 0x1b7ce670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 0x1b8edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 0x1b8edb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40810/0 (socket says 172.21.15.81:40810) 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 -- 172.21.15.81:0/1688106295 learned_addr learned my addr 172.21.15.81:0/1688106295 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2000700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b910d90 0x1b8ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d3400700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b8e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 -- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b910d90 msgr2=0x1b8ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b910d90 0x1b8ea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 -- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 msgr2=0x1b8e8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b8e8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 -- 172.21.15.81:0/1688106295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc011230 con 0x1b8c6310 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d3400700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b8e8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:14.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56d2a00700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 0x1b8edb60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f56c4013000 tx=0x7f56c40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d068cd73df75c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56b3e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56b3e00700 1 -- 172.21.15.81:0/1688106295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c402c070 con 0x1b8c6310 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b6662c0 con 0x1b8c6310 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.912+0000 7f56b3e00700 1 -- 172.21.15.81:0/1688106295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56c4003cb0 con 0x1b8c6310 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 1 -- 172.21.15.81:0/1688106295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c4003e70 con 0x1b8c6310 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 10 client.5763 fetch_fsmap learned FSMap version 25 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1b7f8290 con 0x1b8c6310 2024-09-13T18:49:14.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 1 -- 172.21.15.81:0/1688106295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b6662c0 con 0x1b8c6310 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 1 -- 172.21.15.81:0/1688106295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f56c4025450 con 0x1b8c6310 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 10 client.5763 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 10 client.5763 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 20 client.5763 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b8e9570 0x1b91ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 4 client.5763 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b6b0540 con 0x1b8e9570 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56d2000700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b8e9570 0x1b91ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56d2000700 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b8e9570 0x1b91ab20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf96f2619fad080b server_cookie=871752827bf8f756 in_seq=0 out_seq=0 2024-09-13T18:49:14.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 10 client.5763 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 1 -- 172.21.15.81:0/1688106295 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1b6b0540 con 0x1b8e9570 2024-09-13T18:49:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 10 client.5763 handle_command_reply: tid=0 2024-09-13T18:49:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 client.5763 shutdown 2024-09-13T18:49:14.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 msgr2=0x1b8edb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 0x1b8edb60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f56c4013000 tx=0x7f56c40047e0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 shutdown_connections 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b8e9570 0x1b91ab20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b8e8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b910d90 0x1b8ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 --2- 172.21.15.81:0/1688106295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b8c6310 0x1b8edb60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56b3e00700 0 client.5763 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.916+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 >> 172.21.15.81:0/1688106295 conn(0x1b6595b0 msgr2=0x1b8ef4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.920+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 shutdown_connections 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.920+0000 7f56dce91740 1 -- 172.21.15.81:0/1688106295 wait complete. 2024-09-13T18:49:14.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.920+0000 7f56dce91740 20 client.5763 trim_cache size 0 max 16384 2024-09-13T18:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 Processor -- start 2024-09-13T18:49:14.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 -- start start 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b96ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b96cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b8ec380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b8ca150 con 0x1b911170 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b6ddb80 con 0x1b910d90 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b7bba50 con 0x1b8c6310 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b8ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b8ec380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40818/0 (socket says 172.21.15.81:40818) 2024-09-13T18:49:14.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d3400700 1 -- 172.21.15.81:0/2528304424 learned_addr learned my addr 172.21.15.81:0/2528304424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d2000700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b96cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d2a00700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b96ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d3400700 1 -- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 msgr2=0x1b96ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d3400700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b96ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.940+0000 7f56d3400700 1 -- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 msgr2=0x1b96cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56d3400700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b96cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56d3400700 1 -- 172.21.15.81:0/2528304424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b7de4c0 con 0x1b911170 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56d2a00700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b96ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56d2000700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b96cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:14.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56d3400700 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b8ec380 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f56cc011bf0 tx=0x7f56cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37e5cb3cbfa5176 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56bfe00700 1 -- 172.21.15.81:0/2528304424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00e070 con 0x1b911170 2024-09-13T18:49:14.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56bfe00700 1 -- 172.21.15.81:0/2528304424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc003c60 con 0x1b911170 2024-09-13T18:49:14.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56bfe00700 1 -- 172.21.15.81:0/2528304424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc004030 con 0x1b911170 2024-09-13T18:49:14.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 -- 172.21.15.81:0/2528304424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 msgr2=0x1b8ec380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b8ec380 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f56cc011bf0 tx=0x7f56cc016000 comp rx=0 tx=0).stop 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 -- 172.21.15.81:0/2528304424 shutdown_connections 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b911170 0x1b8ec380 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b910d90 0x1b96cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 --2- 172.21.15.81:0/2528304424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b96ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 -- 172.21.15.81:0/2528304424 >> 172.21.15.81:0/2528304424 conn(0x1b6595b0 msgr2=0x1b90ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 -- 172.21.15.81:0/2528304424 shutdown_connections 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 -- 172.21.15.81:0/2528304424 wait complete. 2024-09-13T18:49:14.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 -- start start 2024-09-13T18:49:14.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.944+0000 7f56dce91740 1 Processor -- start 2024-09-13T18:49:14.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b92e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 0x1b96bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b96c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b90fc30 con 0x1b910d90 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b7d0620 con 0x1b911170 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b8ca010 con 0x1b8c6310 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 10 client.0 _ll_register_callbacks cb 0x1b830610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 0x1b96bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 0x1b96bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40824/0 (socket says 172.21.15.81:40824) 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 -- 172.21.15.81:0/3370621769 learned_addr learned my addr 172.21.15.81:0/3370621769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b92e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d3400700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b96c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 -- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 msgr2=0x1b92e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b92e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 -- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 msgr2=0x1b96c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b96c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 -- 172.21.15.81:0/3370621769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1b6a4a40 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2000700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 0x1b96bd40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f56c00011e0 tx=0x7f56c001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78af833eb2e6f140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 1 -- 172.21.15.81:0/3370621769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0058c70 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 1 -- 172.21.15.81:0/3370621769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f56c005d230 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f56cc00f040 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 1 -- 172.21.15.81:0/3370621769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c00550a0 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 10 client.5769 fetch_fsmap learned FSMap version 25 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1b7d2790 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 1 -- 172.21.15.81:0/3370621769 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc00f040 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 1 -- 172.21.15.81:0/3370621769 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f56c0054330 con 0x1b910d90 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 10 client.5769 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 10 client.5769 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:14.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 20 client.5769 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:14.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b92ebe0 0x1b9272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:14.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 4 client.5769 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:49:14.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1b6d52c0 con 0x1b92ebe0 2024-09-13T18:49:14.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b92ebe0 0x1b9272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56d2a00700 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b92ebe0 0x1b9272b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=458513473156356e server_cookie=9214533b2079a170 in_seq=0 out_seq=0 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.948+0000 7f56b3e00700 10 client.5769 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56b3e00700 1 -- 172.21.15.81:0/3370621769 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+207 (crc 0 0 0) 0x1b6d52c0 con 0x1b92ebe0 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56b3e00700 10 client.5769 handle_command_reply: tid=0 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 client.5769 shutdown 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 msgr2=0x1b96bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 0x1b96bd40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f56c00011e0 tx=0x7f56c001f040 comp rx=0 tx=0).stop 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 shutdown_connections 2024-09-13T18:49:14.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1b92ebe0 0x1b9272b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b911170 0x1b96c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b910d90 0x1b96bd40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 --2- 172.21.15.81:0/3370621769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b8c6310 0x1b92e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56b3e00700 0 client.5769 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 >> 172.21.15.81:0/3370621769 conn(0x1b6595b0 msgr2=0x1b8e9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 shutdown_connections 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 1 -- 172.21.15.81:0/3370621769 wait complete. 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56dce91740 20 client.5769 trim_cache size 0 max 16384 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:49:14.961 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tag123": { 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "tag123", 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:49:14.962 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:49:14.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f56b4066760 msgr2=0x7f56b4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f56b4066760 0x7f56b4068c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f56c4000c00 tx=0x7f56c4008030 comp rx=0 tx=0).stop 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 msgr2=0x7f56d415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 0x7f56d415d040 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f56c000c580 tx=0x7f56c000c890 comp rx=0 tx=0).stop 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 shutdown_connections 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f56b4066760 0x7f56b4068c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56d40cf830 0x7f56d415d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56d406c980 0x7f56d415d040 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 --2- 172.21.15.81:0/3237717111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56d406c5a0 0x7f56d413a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 >> 172.21.15.81:0/3237717111 conn(0x7f56d4071d20 msgr2=0x7f56d406b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 shutdown_connections 2024-09-13T18:49:14.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:14.952+0000 7f56d3e00700 1 -- 172.21.15.81:0/3237717111 wait complete. 2024-09-13T18:49:14.982 INFO:tasks.cephfs.filesystem:scrub status for tag:tag123 - {'path': '/d1/d2/d3', 'tag': 'tag123', 'options': 'recursive,force'} 2024-09-13T18:49:42.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:42.768 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:49:44.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-13T18:49:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.151+0000 7fdf9dc00700 1 Processor -- start 2024-09-13T18:49:45.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.151+0000 7fdf9dc00700 1 -- start start 2024-09-13T18:49:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf9dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf9815abc0 0x7fdf980ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf9dc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9815afa0 con 0x7fdf9815e6e0 2024-09-13T18:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf9dc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf98073be0 con 0x7fdf98073660 2024-09-13T18:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf9dc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980b3df0 con 0x7fdf9815abc0 2024-09-13T18:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf96000700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdf98073660 0x7fdf98072190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:51200/0 (socket says 172.21.15.81:51200) 2024-09-13T18:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf96000700 1 -- 172.21.15.81:0/3010746474 learned_addr learned my addr 172.21.15.81:0/3010746474 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf96a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf9815abc0 0x7fdf980ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804017192 0 0) 0x7fdf9815afa0 con 0x7fdf9815e6e0 2024-09-13T18:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c0035d0 con 0x7fdf9815e6e0 2024-09-13T18:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252686369 0 0) 0x7fdf98073be0 con 0x7fdf98073660 2024-09-13T18:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf9815afa0 con 0x7fdf98073660 2024-09-13T18:49:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf96a00700 1 -- 172.21.15.81:0/3010746474 >> v1:172.21.15.178:6789/0 conn(0x7fdf98073660 legacy=0x7fdf98072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf96a00700 1 -- 172.21.15.81:0/3010746474 >> v1:172.21.15.81:6789/0 conn(0x7fdf9815e6e0 legacy=0x7fdf980b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.155+0000 7fdf96a00700 1 -- 172.21.15.81:0/3010746474 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980b40d0 con 0x7fdf9815abc0 2024-09-13T18:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf96a00700 1 --2- 172.21.15.81:0/3010746474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf9815abc0 0x7fdf980ae6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009880 tx=0x7fdf88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38565bb479e49cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011830 con 0x7fdf9815abc0 2024-09-13T18:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf88011990 con 0x7fdf9815abc0 2024-09-13T18:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf95600700 1 -- 172.21.15.81:0/3010746474 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88011d20 con 0x7fdf9815abc0 2024-09-13T18:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 -- 172.21.15.81:0/3010746474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf9815abc0 msgr2=0x7fdf980ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/3010746474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf9815abc0 0x7fdf980ae6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009880 tx=0x7fdf88009b90 comp rx=0 tx=0).stop 2024-09-13T18:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 -- 172.21.15.81:0/3010746474 shutdown_connections 2024-09-13T18:49:45.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/3010746474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf9815abc0 0x7fdf980ae6d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 -- 172.21.15.81:0/3010746474 >> 172.21.15.81:0/3010746474 conn(0x7fdf980b47e0 msgr2=0x7fdf98071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 -- 172.21.15.81:0/3010746474 shutdown_connections 2024-09-13T18:49:45.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 -- 172.21.15.81:0/3010746474 wait complete. 2024-09-13T18:49:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 Processor -- start 2024-09-13T18:49:45.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.159+0000 7fdf9dc00700 1 -- start start 2024-09-13T18:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 0x7fdf980ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9815abc0 0x7fdf981f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf9815e6e0 0x7fdf981f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980aeb10 con 0x7fdf9815e6e0 2024-09-13T18:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980cab90 con 0x7fdf9815abc0 2024-09-13T18:49:45.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980cae70 con 0x7fdf98073660 2024-09-13T18:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 0x7fdf980ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9815abc0 0x7fdf981f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 0x7fdf980ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:32876/0 (socket says 172.21.15.81:32876) 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 -- 172.21.15.81:0/513831574 learned_addr learned my addr 172.21.15.81:0/513831574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf97400700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf9815e6e0 0x7fdf981f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 -- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9815abc0 msgr2=0x7fdf981f2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9815abc0 0x7fdf981f2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 -- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf9815e6e0 msgr2=0x7fdf981f6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf9815e6e0 0x7fdf981f6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 -- 172.21.15.81:0/513831574 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880094b0 con 0x7fdf98073660 2024-09-13T18:49:45.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf96a00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 0x7fdf980ca570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf88013040 tx=0x7fdf88004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf8ea00700 1 -- 172.21.15.81:0/513831574 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801a8c0 con 0x7fdf98073660 2024-09-13T18:49:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf8ea00700 1 -- 172.21.15.81:0/513831574 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8801e070 con 0x7fdf98073660 2024-09-13T18:49:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf8ea00700 1 -- 172.21.15.81:0/513831574 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801ac60 con 0x7fdf98073660 2024-09-13T18:49:45.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf980cb150 con 0x7fdf98073660 2024-09-13T18:49:45.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.163+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980c84b0 con 0x7fdf98073660 2024-09-13T18:49:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.167+0000 7fdf8ea00700 1 -- 172.21.15.81:0/513831574 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf8802d450 con 0x7fdf98073660 2024-09-13T18:49:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdf8ea00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf78066730 0x7fdf78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdf8ea00700 1 -- 172.21.15.81:0/513831574 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf88084ff0 con 0x7fdf98073660 2024-09-13T18:49:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdf96000700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf78066730 0x7fdf78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdf96000700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf78066730 0x7fdf78068bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf981f6490 tx=0x7fdf84007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 Processor -- start 2024-09-13T18:49:45.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 -- start start 2024-09-13T18:49:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed7ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed2e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ecc2010 con 0x1ed58d00 2024-09-13T18:49:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec4ff40 con 0x1ed7b270 2024-09-13T18:49:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.171+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eca2e30 con 0x1ed7a950 2024-09-13T18:49:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed7ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed7ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38900/0 (socket says 172.21.15.81:38900) 2024-09-13T18:49:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 -- 172.21.15.81:0/1768796985 learned_addr learned my addr 172.21.15.81:0/1768796985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96a00700 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf97400700 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed2e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 -- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 msgr2=0x1ed59240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed59240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 -- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 msgr2=0x1ed2e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed2e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 -- 172.21.15.81:0/1768796985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1eb0ea40 con 0x1ed58d00 2024-09-13T18:49:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf96000700 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed7ad30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdf84005b10 tx=0x7fdf84012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d095be18ede302 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf83400700 1 -- 172.21.15.81:0/1768796985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84006240 con 0x1ed58d00 2024-09-13T18:49:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf83400700 1 -- 172.21.15.81:0/1768796985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840063a0 con 0x1ed58d00 2024-09-13T18:49:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdf83400700 1 -- 172.21.15.81:0/1768796985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84006730 con 0x1ed58d00 2024-09-13T18:49:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 -- 172.21.15.81:0/1768796985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 msgr2=0x1ed7ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed7ad30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fdf84005b10 tx=0x7fdf84012000 comp rx=0 tx=0).stop 2024-09-13T18:49:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 -- 172.21.15.81:0/1768796985 shutdown_connections 2024-09-13T18:49:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed2e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed7ad30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/1768796985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed59240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 -- 172.21.15.81:0/1768796985 >> 172.21.15.81:0/1768796985 conn(0x1eac35b0 msgr2=0x1ed349b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 -- 172.21.15.81:0/1768796985 shutdown_connections 2024-09-13T18:49:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.175+0000 7fdfa0f75740 1 -- 172.21.15.81:0/1768796985 wait complete. 2024-09-13T18:49:45.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 -- start start 2024-09-13T18:49:45.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 Processor -- start 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed58d00 0x1ed438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 0x1ed44060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b270 0x1ed41de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec9e150 con 0x1ed7a950 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec9beb0 con 0x1ed58d00 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ec598e0 con 0x1ed7b270 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 10 client.0 _ll_register_callbacks cb 0x1ec38670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 0x1ed44060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 0x1ed44060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38908/0 (socket says 172.21.15.81:38908) 2024-09-13T18:49:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 -- 172.21.15.81:0/461486560 learned_addr learned my addr 172.21.15.81:0/461486560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96a00700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed58d00 0x1ed438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf97400700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b270 0x1ed41de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 -- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b270 msgr2=0x1ed41de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b270 0x1ed41de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 -- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed58d00 msgr2=0x1ed438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed58d00 0x1ed438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 -- 172.21.15.81:0/461486560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9815afa0 con 0x1ed7a950 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf97400700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b270 0x1ed41de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf96000700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 0x1ed44060 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdf840011e0 tx=0x7fdf84000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba283a8465e12b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf77e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf77e00700 1 -- 172.21.15.81:0/461486560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf84006240 con 0x1ed7a950 2024-09-13T18:49:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdf77e00700 1 -- 172.21.15.81:0/461486560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf8401b050 con 0x1ed7a950 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.179+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ead02c0 con 0x1ed7a950 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 1 -- 172.21.15.81:0/461486560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf84006bf0 con 0x1ed7a950 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 10 client.5781 fetch_fsmap learned FSMap version 25 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1ec62290 con 0x1ed7a950 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 1 -- 172.21.15.81:0/461486560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ead02c0 con 0x1ed7a950 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 1 -- 172.21.15.81:0/461486560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fdf84028070 con 0x1ed7a950 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 10 client.5781 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 10 client.5781 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 20 client.5781 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed45760 0x1ed45b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 4 client.5781 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1eb1a540 con 0x1ed45760 2024-09-13T18:49:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf96a00700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed45760 0x1ed45b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 10 client.5781 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf96a00700 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed45760 0x1ed45b70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ce51ca8b81a08 server_cookie=db36eab577fe2a50 in_seq=0 out_seq=0 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 1 -- 172.21.15.81:0/461486560 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1eb1a540 con 0x1ed45760 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 10 client.5781 handle_command_reply: tid=0 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 client.5781 shutdown 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 msgr2=0x1ed44060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 0x1ed44060 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdf840011e0 tx=0x7fdf84000ed0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 shutdown_connections 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed45760 0x1ed45b70 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b270 0x1ed41de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7a950 0x1ed44060 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdf77e00700 0 client.5781 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/461486560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed58d00 0x1ed438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 >> 172.21.15.81:0/461486560 conn(0x1eac35b0 msgr2=0x1ed2fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 shutdown_connections 2024-09-13T18:49:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.183+0000 7fdfa0f75740 1 -- 172.21.15.81:0/461486560 wait complete. 2024-09-13T18:49:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.187+0000 7fdfa0f75740 20 client.5781 trim_cache size 0 max 16384 2024-09-13T18:49:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 Processor -- start 2024-09-13T18:49:45.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 -- start start 2024-09-13T18:49:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed34780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed41e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eb47b80 con 0x1ed58d00 2024-09-13T18:49:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec992b0 con 0x1ed7b270 2024-09-13T18:49:45.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ec6cc00 con 0x1ed7a950 2024-09-13T18:49:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdf96a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed34780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdf96a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed34780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38916/0 (socket says 172.21.15.81:38916) 2024-09-13T18:49:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdf96a00700 1 -- 172.21.15.81:0/2794787428 learned_addr learned my addr 172.21.15.81:0/2794787428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.203+0000 7fdf96000700 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf97400700 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed41e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf96a00700 1 -- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 msgr2=0x1ed418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf96a00700 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf96a00700 1 -- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 msgr2=0x1ed41e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf96a00700 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed41e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf96a00700 1 -- 172.21.15.81:0/2794787428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ec484c0 con 0x1ed58d00 2024-09-13T18:49:45.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf96a00700 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed34780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdf88055e50 tx=0x7fdf880832e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb3f640e30be4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf83e00700 1 -- 172.21.15.81:0/2794787428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88055f10 con 0x1ed58d00 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf83e00700 1 -- 172.21.15.81:0/2794787428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8806d070 con 0x1ed58d00 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdf83e00700 1 -- 172.21.15.81:0/2794787428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88059d40 con 0x1ed58d00 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 -- 172.21.15.81:0/2794787428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 msgr2=0x1ed34780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed34780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdf88055e50 tx=0x7fdf880832e0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 -- 172.21.15.81:0/2794787428 shutdown_connections 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b270 0x1ed41e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ed418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/2794787428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed58d00 0x1ed34780 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 -- 172.21.15.81:0/2794787428 >> 172.21.15.81:0/2794787428 conn(0x1eac35b0 msgr2=0x1ed943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 -- 172.21.15.81:0/2794787428 shutdown_connections 2024-09-13T18:49:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 -- 172.21.15.81:0/2794787428 wait complete. 2024-09-13T18:49:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.207+0000 7fdfa0f75740 1 -- start start 2024-09-13T18:49:45.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 Processor -- start 2024-09-13T18:49:45.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ede8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 0x1ed79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed795d0 0x1ed924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec3a620 con 0x1ed7b270 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec996c0 con 0x1ed795d0 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ec9a530 con 0x1ed7a950 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdfa0f75740 10 client.0 _ll_register_callbacks cb 0x1ec6b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 0x1ed79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 0x1ed79090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38928/0 (socket says 172.21.15.81:38928) 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 -- 172.21.15.81:0/223955321 learned_addr learned my addr 172.21.15.81:0/223955321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96a00700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ede8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf97400700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed795d0 0x1ed924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 -- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 msgr2=0x1ede8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ede8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 -- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed795d0 msgr2=0x1ed924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed795d0 0x1ed924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 -- 172.21.15.81:0/223955321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980c84b0 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf97400700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed795d0 0x1ed924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf96000700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 0x1ed79090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdf840011e0 tx=0x7fdf8400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c22c7f9ce63cf50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf77e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.211+0000 7fdf77e00700 1 -- 172.21.15.81:0/223955321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf840017a0 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf840063a0 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 1 -- 172.21.15.81:0/223955321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf8401b040 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 1 -- 172.21.15.81:0/223955321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf84005730 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 10 client.5787 fetch_fsmap learned FSMap version 25 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x1ec3c790 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 1 -- 172.21.15.81:0/223955321 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf840063a0 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 1 -- 172.21.15.81:0/223955321 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 25) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fdf8402b040 con 0x1ed7b270 2024-09-13T18:49:45.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 10 client.5787 fetch_fsmap finished waiting for FSMap version 25 2024-09-13T18:49:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 10 client.5787 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-13T18:49:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 20 client.5787 populate_metadata read hostname 'smithi081' 2024-09-13T18:49:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed92a00 0x1ed92de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 4 client.5787 mds_command: new command op to 5388 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:49:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 --> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1eb3f2c0 con 0x1ed92a00 2024-09-13T18:49:45.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf96a00700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed92a00 0x1ed92de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf96a00700 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed92a00 0x1ed92de0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d075564850f7a8 server_cookie=183786abe9f74c36 in_seq=0 out_seq=0 2024-09-13T18:49:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 10 client.5787 ms_handle_connect on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 1 -- 172.21.15.81:0/223955321 <== mds.0 v2:172.21.15.81:6834/2473824789 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1eb3f2c0 con 0x1ed92a00 2024-09-13T18:49:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 10 client.5787 handle_command_reply: tid=0 2024-09-13T18:49:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 client.5787 shutdown 2024-09-13T18:49:45.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 msgr2=0x1ed79090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 0x1ed79090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdf840011e0 tx=0x7fdf8400a000 comp rx=0 tx=0).stop 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 shutdown_connections 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:6834/2473824789,v1:172.21.15.81:6836/2473824789] conn(0x1ed92a00 0x1ed92de0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed795d0 0x1ed924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7b270 0x1ed79090 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdf77e00700 0 client.5787 ms_handle_reset on v2:172.21.15.81:6834/2473824789 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 --2- 172.21.15.81:0/223955321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7a950 0x1ede8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 >> 172.21.15.81:0/223955321 conn(0x1eac35b0 msgr2=0x1ed943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 shutdown_connections 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 1 -- 172.21.15.81:0/223955321 wait complete. 2024-09-13T18:49:45.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.215+0000 7fdfa0f75740 20 client.5787 trim_cache size 0 max 16384 2024-09-13T18:49:45.228 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:49:45.228 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-13T18:49:45.228 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-13T18:49:45.228 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf78066730 msgr2=0x7fdf78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf78066730 0x7fdf78068bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdf981f6490 tx=0x7fdf84007de0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 msgr2=0x7fdf980ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 0x7fdf980ca570 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdf88013040 tx=0x7fdf88004770 comp rx=0 tx=0).stop 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 shutdown_connections 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdf78066730 0x7fdf78068bf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf9815e6e0 0x7fdf981f6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf9815abc0 0x7fdf981f2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 --2- 172.21.15.81:0/513831574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf98073660 0x7fdf980ca570 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 >> 172.21.15.81:0/513831574 conn(0x7fdf980b47e0 msgr2=0x7fdf980b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 shutdown_connections 2024-09-13T18:49:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.219+0000 7fdf9dc00700 1 -- 172.21.15.81:0/513831574 wait complete. 2024-09-13T18:49:45.249 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:49:45.249 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000002.00000000 scrub_tag 2024-09-13T18:49:45.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.307+0000 7f9e210c7140 1 Processor -- start 2024-09-13T18:49:45.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.307+0000 7f9e210c7140 1 -- start start 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 0x562fd7038f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd703d0b0 0x562fd70394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d490 0x562fd6f95520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6ef92f0 con 0x562fd6f99da0 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6eb58e0 con 0x562fd703d490 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fd6eb5580 con 0x562fd703d0b0 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 0x562fd7038f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 0x562fd7038f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38960/0 (socket says 172.21.15.81:38960) 2024-09-13T18:49:45.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 -- 172.21.15.81:0/1937302976 learned_addr learned my addr 172.21.15.81:0/1937302976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1ee00700 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d490 0x562fd6f95520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1da00700 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd703d0b0 0x562fd70394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 -- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd703d0b0 msgr2=0x562fd70394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd703d0b0 0x562fd70394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 -- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d490 msgr2=0x562fd6f95520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d490 0x562fd6f95520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 -- 172.21.15.81:0/1937302976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e08005d20 con 0x562fd6f99da0 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1ee00700 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d490 0x562fd6f95520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e1e400700 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 0x562fd7038f90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800a870 tx=0x7f9e0800d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=666ffee8ebd29bac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e17e00700 1 -- 172.21.15.81:0/1937302976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08008690 con 0x562fd6f99da0 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e17e00700 1 -- 172.21.15.81:0/1937302976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e08008b80 con 0x562fd6f99da0 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e17e00700 1 -- 172.21.15.81:0/1937302976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0801e450 con 0x562fd6f99da0 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- 172.21.15.81:0/1937302976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 msgr2=0x562fd7038f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 0x562fd7038f90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9e0800a870 tx=0x7f9e0800d000 comp rx=0 tx=0).stop 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- 172.21.15.81:0/1937302976 shutdown_connections 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d490 0x562fd6f95520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd703d0b0 0x562fd70394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 --2- 172.21.15.81:0/1937302976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd6f99da0 0x562fd7038f90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- 172.21.15.81:0/1937302976 >> 172.21.15.81:0/1937302976 conn(0x562fd6f668c0 msgr2=0x562fd6f93d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- 172.21.15.81:0/1937302976 shutdown_connections 2024-09-13T18:49:45.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.311+0000 7f9e210c7140 1 -- 172.21.15.81:0/1937302976 wait complete. 2024-09-13T18:49:45.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 Processor -- start 2024-09-13T18:49:45.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 -- start start 2024-09-13T18:49:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd6f99da0 0x562fd7036150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d0b0 0x562fd6fae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd703d490 0x562fd7039020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6e8b8d0 con 0x562fd703d490 2024-09-13T18:49:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd6fad5f0 con 0x562fd703d0b0 2024-09-13T18:49:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e210c7140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562fd6fad890 con 0x562fd6f99da0 2024-09-13T18:49:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd703d490 0x562fd7039020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd703d490 0x562fd7039020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38970/0 (socket says 172.21.15.81:38970) 2024-09-13T18:49:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 -- 172.21.15.81:0/2224356894 learned_addr learned my addr 172.21.15.81:0/2224356894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1da00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d0b0 0x562fd6fae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1e400700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd6f99da0 0x562fd7036150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 -- 172.21.15.81:0/2224356894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd6f99da0 msgr2=0x562fd7036150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562fd6f99da0 0x562fd7036150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 -- 172.21.15.81:0/2224356894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d0b0 msgr2=0x562fd6fae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562fd703d0b0 0x562fd6fae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 -- 172.21.15.81:0/2224356894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562fd6ebdca0 con 0x562fd703d490 2024-09-13T18:49:45.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e1ee00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd703d490 0x562fd7039020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800caf0 tx=0x7f9e1800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e16a00700 1 -- 172.21.15.81:0/2224356894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800abc0 con 0x562fd703d490 2024-09-13T18:49:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e16a00700 1 -- 172.21.15.81:0/2224356894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800ad40 con 0x562fd703d490 2024-09-13T18:49:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.315+0000 7f9e16a00700 1 -- 172.21.15.81:0/2224356894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800e680 con 0x562fd703d490 2024-09-13T18:49:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.319+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562fd6ea3b00 con 0x562fd703d490 2024-09-13T18:49:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.319+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562fd6e96f40 con 0x562fd703d490 2024-09-13T18:49:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.319+0000 7f9e16a00700 1 -- 172.21.15.81:0/2224356894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e1800e7e0 con 0x562fd703d490 2024-09-13T18:49:45.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e16a00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9dfc065090 0x7f9dfc067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e16a00700 1 -- 172.21.15.81:0/2224356894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e18082c80 con 0x562fd703d490 2024-09-13T18:49:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x562fd6faea50 0x562fd6facdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e1e400700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9dfc065090 0x7f9dfc067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x562fd70d2400 con 0x562fd6faea50 2024-09-13T18:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e1da00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x562fd6faea50 0x562fd6facdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e1e400700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9dfc065090 0x7f9dfc067550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e08020000 tx=0x7f9e08008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e1da00700 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x562fd6faea50 0x562fd6facdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e1da00700 1 -- 172.21.15.81:0/2224356894 <== osd.1 v2:172.21.15.81:6824/2924937371 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (10) out=10b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f9e10002a90 con 0x562fd6faea50 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x562fd6faea50 msgr2=0x562fd6facdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x562fd6faea50 0x562fd6facdb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9dfc065090 msgr2=0x7f9dfc067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9dfc065090 0x7f9dfc067550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e08020000 tx=0x7f9e08008000 comp rx=0 tx=0).stop 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd703d490 msgr2=0x562fd7039020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 --2- 172.21.15.81:0/2224356894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562fd703d490 0x562fd7039020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800caf0 tx=0x7f9e1800ce00 comp rx=0 tx=0).stop 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e1ee00700 1 -- 172.21.15.81:0/2224356894 reap_dead start 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 shutdown_connections 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 >> 172.21.15.81:0/2224356894 conn(0x562fd6f668c0 msgr2=0x562fd6f93850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 shutdown_connections 2024-09-13T18:49:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.323+0000 7f9e210c7140 1 -- 172.21.15.81:0/2224356894 wait complete. 2024-09-13T18:49:45.342 INFO:teuthology.orchestra.run.smithi081.stdout:tag123 2024-09-13T18:49:45.343 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000003.00000000 scrub_tag 2024-09-13T18:49:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.399+0000 7f5cf02a3140 1 Processor -- start 2024-09-13T18:49:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.399+0000 7f5cf02a3140 1 -- start start 2024-09-13T18:49:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e40c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 0x55863e40b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e4e1070 0x55863e572ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55863e3598e0 con 0x55863e451890 2024-09-13T18:49:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55863e359580 con 0x55863e4e1070 2024-09-13T18:49:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55863e32f8d0 con 0x55863e44dc20 2024-09-13T18:49:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 0x55863e40b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 0x55863e40b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38980/0 (socket says 172.21.15.81:38980) 2024-09-13T18:49:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 -- 172.21.15.81:0/806162304 learned_addr learned my addr 172.21.15.81:0/806162304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ced400700 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e40c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cede00700 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e4e1070 0x55863e572ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 -- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 msgr2=0x55863e40c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e40c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 -- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e4e1070 msgr2=0x55863e572ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e4e1070 0x55863e572ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 -- 172.21.15.81:0/806162304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc005de0 con 0x55863e451890 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ceca00700 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 0x55863e40b080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc015040 tx=0x7f5cdc00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d185fad0239865 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ce7400700 1 -- 172.21.15.81:0/806162304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc008690 con 0x55863e451890 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ce7400700 1 -- 172.21.15.81:0/806162304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc008b60 con 0x55863e451890 2024-09-13T18:49:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5ce7400700 1 -- 172.21.15.81:0/806162304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc01c410 con 0x55863e451890 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- 172.21.15.81:0/806162304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 msgr2=0x55863e40b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 0x55863e40b080 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc015040 tx=0x7f5cdc00d000 comp rx=0 tx=0).stop 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- 172.21.15.81:0/806162304 shutdown_connections 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e4e1070 0x55863e572ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e451890 0x55863e40b080 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/806162304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e40c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- 172.21.15.81:0/806162304 >> 172.21.15.81:0/806162304 conn(0x55863e4360e0 msgr2=0x55863e4e1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- 172.21.15.81:0/806162304 shutdown_connections 2024-09-13T18:49:45.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.403+0000 7f5cf02a3140 1 -- 172.21.15.81:0/806162304 wait complete. 2024-09-13T18:49:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 Processor -- start 2024-09-13T18:49:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 -- start start 2024-09-13T18:49:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e439cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e451890 0x55863e4de8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e4e1070 0x55863e42c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55863e4da400 con 0x55863e4e1070 2024-09-13T18:49:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55863e4da5e0 con 0x55863e451890 2024-09-13T18:49:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cf02a3140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55863e4da880 con 0x55863e44dc20 2024-09-13T18:49:45.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e4e1070 0x55863e42c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e4e1070 0x55863e42c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38996/0 (socket says 172.21.15.81:38996) 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 -- 172.21.15.81:0/4175137029 learned_addr learned my addr 172.21.15.81:0/4175137029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5ceca00700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e451890 0x55863e4de8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5ced400700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e439cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 -- 172.21.15.81:0/4175137029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 msgr2=0x55863e439cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55863e44dc20 0x55863e439cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 -- 172.21.15.81:0/4175137029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e451890 msgr2=0x55863e4de8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55863e451890 0x55863e4de8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.407+0000 7f5cede00700 1 -- 172.21.15.81:0/4175137029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55863e33abb0 con 0x55863e4e1070 2024-09-13T18:49:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5cede00700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e4e1070 0x55863e42c700 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009f50 tx=0x7f5ce80086e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5ce6000700 1 -- 172.21.15.81:0/4175137029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800f050 con 0x55863e4e1070 2024-09-13T18:49:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5ce6000700 1 -- 172.21.15.81:0/4175137029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8010040 con 0x55863e4e1070 2024-09-13T18:49:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5ce6000700 1 -- 172.21.15.81:0/4175137029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce80158c0 con 0x55863e4e1070 2024-09-13T18:49:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55863e361ca0 con 0x55863e4e1070 2024-09-13T18:49:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55863e347b00 con 0x55863e4e1070 2024-09-13T18:49:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.411+0000 7f5ce6000700 1 -- 172.21.15.81:0/4175137029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ce8005020 con 0x55863e4e1070 2024-09-13T18:49:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ce6000700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5cd0065090 0x7f5cd0067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ce6000700 1 -- 172.21.15.81:0/4175137029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ce8082f20 con 0x55863e4e1070 2024-09-13T18:49:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ced400700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5cd0065090 0x7f5cd0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55863e43a210 0x55863e4db770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- osd_op(unknown.0.0:1 5.12 5:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55863e4dedf0 con 0x55863e43a210 2024-09-13T18:49:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ceca00700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55863e43a210 0x55863e4db770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ced400700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5cd0065090 0x7f5cd0067550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0005fd0 tx=0x7f5ce0007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ceca00700 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55863e43a210 0x55863e4db770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5ceca00700 1 -- 172.21.15.81:0/4175137029 <== osd.1 v2:172.21.15.81:6824/2924937371 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr (10) out=10b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f5cdc008cd0 con 0x55863e43a210 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55863e43a210 msgr2=0x55863e4db770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55863e43a210 0x55863e4db770 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5cd0065090 msgr2=0x7f5cd0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5cd0065090 0x7f5cd0067550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0005fd0 tx=0x7f5ce0007040 comp rx=0 tx=0).stop 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e4e1070 msgr2=0x55863e42c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 --2- 172.21.15.81:0/4175137029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55863e4e1070 0x55863e42c700 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009f50 tx=0x7f5ce80086e0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cede00700 1 -- 172.21.15.81:0/4175137029 reap_dead start 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 shutdown_connections 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 >> 172.21.15.81:0/4175137029 conn(0x55863e4360e0 msgr2=0x55863e4e1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.415+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 shutdown_connections 2024-09-13T18:49:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.419+0000 7f5cf02a3140 1 -- 172.21.15.81:0/4175137029 wait complete. 2024-09-13T18:49:45.433 INFO:teuthology.orchestra.run.smithi081.stdout:tag123 2024-09-13T18:49:45.433 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000004.00000000 scrub_tag 2024-09-13T18:49:45.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.495+0000 7f9a3d6b2140 1 Processor -- start 2024-09-13T18:49:45.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.495+0000 7f9a3d6b2140 1 -- start start 2024-09-13T18:49:45.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6bee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6bd6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6bcccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be6b3ca00 con 0x564be6bd5040 2024-09-13T18:49:45.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be6b382f0 con 0x564be6bf06f0 2024-09-13T18:49:45.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be6af48e0 con 0x564be6c607a0 2024-09-13T18:49:45.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6bee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6bee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38998/0 (socket says 172.21.15.81:38998) 2024-09-13T18:49:45.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 -- 172.21.15.81:0/2488159733 learned_addr learned my addr 172.21.15.81:0/2488159733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a39e00700 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6bd6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3b200700 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6bcccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 -- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 msgr2=0x564be6bcccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6bcccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 -- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 msgr2=0x564be6bd6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6bd6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 -- 172.21.15.81:0/2488159733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3400a100 con 0x564be6bd5040 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3a800700 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6bee670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c001d00 tx=0x7f9a2c00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a556da2b3f6b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a38a00700 1 -- 172.21.15.81:0/2488159733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00bde0 con 0x564be6bd5040 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a38a00700 1 -- 172.21.15.81:0/2488159733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00e470 con 0x564be6bd5040 2024-09-13T18:49:45.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a38a00700 1 -- 172.21.15.81:0/2488159733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00e820 con 0x564be6bd5040 2024-09-13T18:49:45.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2488159733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 msgr2=0x564be6bee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6bee670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c001d00 tx=0x7f9a2c00b5d0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2488159733 shutdown_connections 2024-09-13T18:49:45.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6bcccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6bd6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2488159733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6bee670 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2488159733 >> 172.21.15.81:0/2488159733 conn(0x564be6ba7d90 msgr2=0x564be6c5f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2488159733 shutdown_connections 2024-09-13T18:49:45.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.499+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2488159733 wait complete. 2024-09-13T18:49:45.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 Processor -- start 2024-09-13T18:49:45.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 -- start start 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6d11090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6be5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6c5f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be6af4580 con 0x564be6bd5040 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564be6aca8d0 con 0x564be6bf06f0 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3d6b2140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564be6bcf6e0 con 0x564be6c607a0 2024-09-13T18:49:45.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6d11090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6d11090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39000/0 (socket says 172.21.15.81:39000) 2024-09-13T18:49:45.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 -- 172.21.15.81:0/2560962116 learned_addr learned my addr 172.21.15.81:0/2560962116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a39e00700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6be5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3b200700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6c5f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 -- 172.21.15.81:0/2560962116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 msgr2=0x564be6c5f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564be6c607a0 0x564be6c5f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 -- 172.21.15.81:0/2560962116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 msgr2=0x564be6be5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564be6bf06f0 0x564be6be5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.503+0000 7f9a3a800700 1 -- 172.21.15.81:0/2560962116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20001e10 con 0x564be6bd5040 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.507+0000 7f9a3a800700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6d11090 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b9d0 tx=0x7f9a2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.507+0000 7f9a33400700 1 -- 172.21.15.81:0/2560962116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c01e070 con 0x564be6bd5040 2024-09-13T18:49:45.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.507+0000 7f9a33400700 1 -- 172.21.15.81:0/2560962116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c001410 con 0x564be6bd5040 2024-09-13T18:49:45.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.507+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564be6ad5f40 con 0x564be6bd5040 2024-09-13T18:49:45.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.507+0000 7f9a33400700 1 -- 172.21.15.81:0/2560962116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c017850 con 0x564be6bd5040 2024-09-13T18:49:45.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.507+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564be6ad59a0 con 0x564be6bd5040 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a33400700 1 -- 172.21.15.81:0/2560962116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a2c0179b0 con 0x564be6bd5040 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a33400700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9a1c065090 0x7f9a1c067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a33400700 1 -- 172.21.15.81:0/2560962116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a2c0845a0 con 0x564be6bd5040 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a39e00700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9a1c065090 0x7f9a1c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564be6be64e0 0x564be6d12290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 5.5 5:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x564be6d127d0 con 0x564be6be64e0 2024-09-13T18:49:45.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a3b200700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564be6be64e0 0x564be6d12290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a39e00700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9a1c065090 0x7f9a1c067550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a28003bd0 tx=0x7f9a28003070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.511+0000 7f9a3b200700 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564be6be64e0 0x564be6d12290 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3b200700 1 -- 172.21.15.81:0/2560962116 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f9a3400f900 con 0x564be6be64e0 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564be6be64e0 msgr2=0x564be6d12290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564be6be64e0 0x564be6d12290 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9a1c065090 msgr2=0x7f9a1c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9a1c065090 0x7f9a1c067550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a28003bd0 tx=0x7f9a28003070 comp rx=0 tx=0).stop 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 msgr2=0x564be6d11090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 --2- 172.21.15.81:0/2560962116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564be6bd5040 0x564be6d11090 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00b9d0 tx=0x7f9a2c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3b200700 1 -- 172.21.15.81:0/2560962116 reap_dead start 2024-09-13T18:49:45.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 shutdown_connections 2024-09-13T18:49:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 >> 172.21.15.81:0/2560962116 conn(0x564be6ba7d90 msgr2=0x564be6bd23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 shutdown_connections 2024-09-13T18:49:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.515+0000 7f9a3d6b2140 1 -- 172.21.15.81:0/2560962116 wait complete. 2024-09-13T18:49:45.529 INFO:teuthology.orchestra.run.smithi081.stdout:tag123 2024-09-13T18:49:45.529 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000005.00000000 scrub_tag 2024-09-13T18:49:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 Processor -- start 2024-09-13T18:49:45.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 -- start start 2024-09-13T18:49:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f2613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2230a0 0x555c9f2f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 0x555c9f2f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9f1b42f0 con 0x555c9f2621a0 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9f1708e0 con 0x555c9f222cc0 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.587+0000 7efda43fd140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9f170580 con 0x555c9f2230a0 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 0x555c9f2f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 0x555c9f2f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39022/0 (socket says 172.21.15.81:39022) 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 -- 172.21.15.81:0/848740524 learned_addr learned my addr 172.21.15.81:0/848740524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda1600700 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f2613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda0c00700 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2230a0 0x555c9f2f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 -- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2230a0 msgr2=0x555c9f2f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2230a0 0x555c9f2f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 -- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 msgr2=0x555c9f2613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f2613b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 -- 172.21.15.81:0/848740524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90005de0 con 0x555c9f2621a0 2024-09-13T18:49:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda0c00700 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2230a0 0x555c9f2f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:45.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda2000700 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 0x555c9f2f3ff0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c4f0 tx=0x7efd9c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39646b11f9d1e75f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efd9b400700 1 -- 172.21.15.81:0/848740524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c010590 con 0x555c9f2621a0 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efd9b400700 1 -- 172.21.15.81:0/848740524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c0106f0 con 0x555c9f2621a0 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efd9b400700 1 -- 172.21.15.81:0/848740524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c010a60 con 0x555c9f2621a0 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 -- 172.21.15.81:0/848740524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 msgr2=0x555c9f2f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 0x555c9f2f3ff0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c4f0 tx=0x7efd9c00c800 comp rx=0 tx=0).stop 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 -- 172.21.15.81:0/848740524 shutdown_connections 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2621a0 0x555c9f2f3ff0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2230a0 0x555c9f2f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 --2- 172.21.15.81:0/848740524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f2613b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 -- 172.21.15.81:0/848740524 >> 172.21.15.81:0/848740524 conn(0x555c9f24d0e0 msgr2=0x555c9f2f71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 -- 172.21.15.81:0/848740524 shutdown_connections 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.591+0000 7efda43fd140 1 -- 172.21.15.81:0/848740524 wait complete. 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 Processor -- start 2024-09-13T18:49:45.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 -- start start 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f267090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2230a0 0x555c9f2f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2621a0 0x555c9f38d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9f1468d0 con 0x555c9f2230a0 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9f265bd0 con 0x555c9f222cc0 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9f2697f0 con 0x555c9f2621a0 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2230a0 0x555c9f2f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2230a0 0x555c9f2f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39030/0 (socket says 172.21.15.81:39030) 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 -- 172.21.15.81:0/2784327299 learned_addr learned my addr 172.21.15.81:0/2784327299 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda2000700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2621a0 0x555c9f38d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda1600700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f267090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 -- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2621a0 msgr2=0x555c9f38d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555c9f2621a0 0x555c9f38d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 -- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 msgr2=0x555c9f267090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f267090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 -- 172.21.15.81:0/2784327299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c00d040 con 0x555c9f2230a0 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda1600700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555c9f222cc0 0x555c9f267090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:45.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda0c00700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2230a0 0x555c9f2f25b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd90015040 tx=0x7efd90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efd9a000700 1 -- 172.21.15.81:0/2784327299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90008670 con 0x555c9f2230a0 2024-09-13T18:49:45.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efd9a000700 1 -- 172.21.15.81:0/2784327299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9001d630 con 0x555c9f2230a0 2024-09-13T18:49:45.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efd9a000700 1 -- 172.21.15.81:0/2784327299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9001d9e0 con 0x555c9f2230a0 2024-09-13T18:49:45.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.595+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c9f15eb00 con 0x555c9f2230a0 2024-09-13T18:49:45.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.599+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c9f151f40 con 0x555c9f2230a0 2024-09-13T18:49:45.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.599+0000 7efd9a000700 1 -- 172.21.15.81:0/2784327299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efd90005b30 con 0x555c9f2230a0 2024-09-13T18:49:45.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efd9a000700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd84065090 0x7efd84067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efd9a000700 1 -- 172.21.15.81:0/2784327299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd900840e0 con 0x555c9f2230a0 2024-09-13T18:49:45.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda1600700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd84065090 0x7efd84067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x555c9f38de90 0x555c9f2f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- osd_op(unknown.0.0:1 5.9 5:9258b67d:::10000000005.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x555c9f2692b0 con 0x555c9f38de90 2024-09-13T18:49:45.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda1600700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd84065090 0x7efd84067550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd94000c00 tx=0x7efd94003050 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda2000700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x555c9f38de90 0x555c9f2f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda2000700 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x555c9f38de90 0x555c9f2f8860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda2000700 1 -- 172.21.15.81:0/2784327299 <== osd.7 v2:172.21.15.178:6816/2829585854 1 ==== osd_op_reply(1 10000000005.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7efd9c010960 con 0x555c9f38de90 2024-09-13T18:49:45.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x555c9f38de90 msgr2=0x555c9f2f8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x555c9f38de90 0x555c9f2f8860 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd84065090 msgr2=0x7efd84067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd84065090 0x7efd84067550 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efd94000c00 tx=0x7efd94003050 comp rx=0 tx=0).stop 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2230a0 msgr2=0x555c9f2f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 --2- 172.21.15.81:0/2784327299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c9f2230a0 0x555c9f2f25b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7efd90015040 tx=0x7efd90002fb0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda2000700 1 -- 172.21.15.81:0/2784327299 reap_dead start 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 shutdown_connections 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 >> 172.21.15.81:0/2784327299 conn(0x555c9f24d0e0 msgr2=0x555c9f24e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 shutdown_connections 2024-09-13T18:49:45.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.603+0000 7efda43fd140 1 -- 172.21.15.81:0/2784327299 wait complete. 2024-09-13T18:49:45.621 INFO:teuthology.orchestra.run.smithi081.stdout:tag123 2024-09-13T18:49:45.621 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000006.00000000 scrub_tag 2024-09-13T18:49:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.679+0000 7fe3b6d9c140 1 Processor -- start 2024-09-13T18:49:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.679+0000 7fe3b6d9c140 1 -- start start 2024-09-13T18:49:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eae2540 0x55a83ebbd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eb9ef70 0x55a83eb9d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 0x55a83eb2eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83ea762f0 con 0x55a83eba0560 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83ea328e0 con 0x55a83eb9ef70 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a83ea32580 con 0x55a83eae2540 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 0x55a83eb2eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 0x55a83eb2eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39046/0 (socket says 172.21.15.81:39046) 2024-09-13T18:49:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 -- 172.21.15.81:0/1459476661 learned_addr learned my addr 172.21.15.81:0/1459476661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4000700 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eae2540 0x55a83ebbd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b3600700 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eb9ef70 0x55a83eb9d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 -- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eae2540 msgr2=0x55a83ebbd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eae2540 0x55a83ebbd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 -- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eb9ef70 msgr2=0x55a83eb9d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eb9ef70 0x55a83eb9d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 -- 172.21.15.81:0/1459476661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0005d20 con 0x55a83eba0560 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b4a00700 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 0x55a83eb2eaa0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac002880 tx=0x7fe3ac002b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170840a2e1767165 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b2200700 1 -- 172.21.15.81:0/1459476661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac012680 con 0x55a83eba0560 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b2200700 1 -- 172.21.15.81:0/1459476661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ac0127e0 con 0x55a83eba0560 2024-09-13T18:49:45.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b2200700 1 -- 172.21.15.81:0/1459476661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac012b90 con 0x55a83eba0560 2024-09-13T18:49:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/1459476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 msgr2=0x55a83eb2eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 0x55a83eb2eaa0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac002880 tx=0x7fe3ac002b90 comp rx=0 tx=0).stop 2024-09-13T18:49:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/1459476661 shutdown_connections 2024-09-13T18:49:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eba0560 0x55a83eb2eaa0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eb9ef70 0x55a83eb9d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/1459476661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eae2540 0x55a83ebbd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/1459476661 >> 172.21.15.81:0/1459476661 conn(0x55a83eae3cb0 msgr2=0x55a83eb16220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/1459476661 shutdown_connections 2024-09-13T18:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.683+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/1459476661 wait complete. 2024-09-13T18:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 Processor -- start 2024-09-13T18:49:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 -- start start 2024-09-13T18:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eae2540 0x55a83eb2c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eb9ef70 0x55a83ebb99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eba0560 0x55a83ebb9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83ea088d0 con 0x55a83eb9ef70 2024-09-13T18:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83eb2ce90 con 0x55a83eae2540 2024-09-13T18:49:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b6d9c140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a83eb2ba30 con 0x55a83eba0560 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eb9ef70 0x55a83ebb99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eb9ef70 0x55a83ebb99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39058/0 (socket says 172.21.15.81:39058) 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 -- 172.21.15.81:0/2394407898 learned_addr learned my addr 172.21.15.81:0/2394407898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b4000700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eae2540 0x55a83eb2c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b4a00700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eba0560 0x55a83ebb9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 -- 172.21.15.81:0/2394407898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eba0560 msgr2=0x55a83ebb9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a83eba0560 0x55a83ebb9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 -- 172.21.15.81:0/2394407898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eae2540 msgr2=0x55a83eb2c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a83eae2540 0x55a83eb2c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 -- 172.21.15.81:0/2394407898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ac002530 con 0x55a83eb9ef70 2024-09-13T18:49:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.687+0000 7fe3b3600700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eb9ef70 0x55a83ebb99a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55a83eb171d0 tx=0x7fe3a0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.691+0000 7fe3b0e00700 1 -- 172.21.15.81:0/2394407898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0012620 con 0x55a83eb9ef70 2024-09-13T18:49:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.691+0000 7fe3b0e00700 1 -- 172.21.15.81:0/2394407898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00127a0 con 0x55a83eb9ef70 2024-09-13T18:49:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.691+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a83ea20b00 con 0x55a83eb9ef70 2024-09-13T18:49:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.691+0000 7fe3b0e00700 1 -- 172.21.15.81:0/2394407898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0012b50 con 0x55a83eb9ef70 2024-09-13T18:49:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.691+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a83ea13f40 con 0x55a83eb9ef70 2024-09-13T18:49:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.691+0000 7fe3b0e00700 1 -- 172.21.15.81:0/2394407898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3a0012cb0 con 0x55a83eb9ef70 2024-09-13T18:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b0e00700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe394065090 0x7fe394067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b0e00700 1 -- 172.21.15.81:0/2394407898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3a0084980 con 0x55a83eb9ef70 2024-09-13T18:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b4000700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe394065090 0x7fe394067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55a83ebb81a0 0x55a83ec4f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 5.5 5:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55a83ebb85b0 con 0x55a83ebb81a0 2024-09-13T18:49:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b4a00700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55a83ebb81a0 0x55a83ec4f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b4000700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe394065090 0x7fe394067550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4001ed0 tx=0x7fe3a4000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b4a00700 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55a83ebb81a0 0x55a83ec4f2c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b4a00700 1 -- 172.21.15.81:0/2394407898 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7fe3ac018020 con 0x55a83ebb81a0 2024-09-13T18:49:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55a83ebb81a0 msgr2=0x55a83ec4f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55a83ebb81a0 0x55a83ec4f2c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe394065090 msgr2=0x7fe394067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe394065090 0x7fe394067550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4001ed0 tx=0x7fe3a4000bc0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eb9ef70 msgr2=0x55a83ebb99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 --2- 172.21.15.81:0/2394407898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a83eb9ef70 0x55a83ebb99a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x55a83eb171d0 tx=0x7fe3a0002fb0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b4a00700 1 -- 172.21.15.81:0/2394407898 reap_dead start 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 shutdown_connections 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 >> 172.21.15.81:0/2394407898 conn(0x55a83eae3cb0 msgr2=0x55a83eb9fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 shutdown_connections 2024-09-13T18:49:45.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.695+0000 7fe3b6d9c140 1 -- 172.21.15.81:0/2394407898 wait complete. 2024-09-13T18:49:45.711 INFO:teuthology.orchestra.run.smithi081.stdout:tag123 2024-09-13T18:49:45.711 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000007.00000000 scrub_tag 2024-09-13T18:49:45.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 Processor -- start 2024-09-13T18:49:45.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 -- start start 2024-09-13T18:49:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff91c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff8894f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff889a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff7f22f0 con 0x55d8ff8a87c0 2024-09-13T18:49:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff7ae8e0 con 0x55d8ff8aa6f0 2024-09-13T18:49:45.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9625e06140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff7ae580 con 0x55d8ff91a7a0 2024-09-13T18:49:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9622600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff8894f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff91c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9622600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff8894f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:57070/0 (socket says 172.21.15.81:57070) 2024-09-13T18:49:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9622600700 1 -- 172.21.15.81:0/3894675281 learned_addr learned my addr 172.21.15.81:0/3894675281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff889a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 -- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 msgr2=0x55d8ff889a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff889a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 -- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 msgr2=0x55d8ff8894f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff8894f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 -- 172.21.15.81:0/3894675281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c00a1c0 con 0x55d8ff8a87c0 2024-09-13T18:49:45.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9622600700 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff8894f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.767+0000 7f9623000700 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff91c680 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9614001c80 tx=0x7f961400b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7dc90ea83edb3aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9621200700 1 -- 172.21.15.81:0/3894675281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614014070 con 0x55d8ff8a87c0 2024-09-13T18:49:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9621200700 1 -- 172.21.15.81:0/3894675281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9614008030 con 0x55d8ff8a87c0 2024-09-13T18:49:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9621200700 1 -- 172.21.15.81:0/3894675281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961400bc60 con 0x55d8ff8a87c0 2024-09-13T18:49:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- 172.21.15.81:0/3894675281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 msgr2=0x55d8ff91c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff91c680 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9614001c80 tx=0x7f961400b4c0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- 172.21.15.81:0/3894675281 shutdown_connections 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff889a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff8894f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- 172.21.15.81:0/3894675281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff91c680 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- 172.21.15.81:0/3894675281 >> 172.21.15.81:0/3894675281 conn(0x55d8ff861d90 msgr2=0x55d8ff88cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- 172.21.15.81:0/3894675281 shutdown_connections 2024-09-13T18:49:45.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- 172.21.15.81:0/3894675281 wait complete. 2024-09-13T18:49:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 Processor -- start 2024-09-13T18:49:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- start start 2024-09-13T18:49:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff8899c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff918f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff88bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff7848d0 con 0x55d8ff8a87c0 2024-09-13T18:49:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff8a70f0 con 0x55d8ff8aa6f0 2024-09-13T18:49:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.771+0000 7f9625e06140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8ff8a7390 con 0x55d8ff91a7a0 2024-09-13T18:49:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff8899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff8899c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39098/0 (socket says 172.21.15.81:39098) 2024-09-13T18:49:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 -- 172.21.15.81:0/2914565101 learned_addr learned my addr 172.21.15.81:0/2914565101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9622600700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff918f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623a00700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff88bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 -- 172.21.15.81:0/2914565101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 msgr2=0x55d8ff88bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d8ff91a7a0 0x55d8ff88bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 -- 172.21.15.81:0/2914565101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 msgr2=0x55d8ff918f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d8ff8aa6f0 0x55d8ff918f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 -- 172.21.15.81:0/2914565101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610009510 con 0x55d8ff8a87c0 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9623000700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff8899c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f961400b810 tx=0x7f9614000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f961b400700 1 -- 172.21.15.81:0/2914565101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9614014040 con 0x55d8ff8a87c0 2024-09-13T18:49:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f961b400700 1 -- 172.21.15.81:0/2914565101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400fcd0 con 0x55d8ff8a87c0 2024-09-13T18:49:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961400a040 con 0x55d8ff8a87c0 2024-09-13T18:49:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f961b400700 1 -- 172.21.15.81:0/2914565101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961401b670 con 0x55d8ff8a87c0 2024-09-13T18:49:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.775+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8ff79cb00 con 0x55d8ff8a87c0 2024-09-13T18:49:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f961b400700 1 -- 172.21.15.81:0/2914565101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f961401b7d0 con 0x55d8ff8a87c0 2024-09-13T18:49:45.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f961b400700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9604065060 0x7f9604067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f961b400700 1 -- 172.21.15.81:0/2914565101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f96140842d0 con 0x55d8ff8a87c0 2024-09-13T18:49:45.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f9622600700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9604065060 0x7f9604067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f9625e06140 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55d8ff9194b0 0x55d8ff8a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:45.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- osd_op(unknown.0.0:1 5.1d 5:bbf5850a:::10000000007.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d8ff8a1c40 con 0x55d8ff9194b0 2024-09-13T18:49:45.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.779+0000 7f9623a00700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55d8ff9194b0 0x55d8ff8a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9622600700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9604065060 0x7f9604067520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f96100094e0 tx=0x7f961000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9623a00700 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55d8ff9194b0 0x55d8ff8a1700 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9623a00700 1 -- 172.21.15.81:0/2914565101 <== osd.1 v2:172.21.15.81:6824/2924937371 1 ==== osd_op_reply(1 10000000007.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+10 (crc 0 0 0) 0x7f961c017040 con 0x55d8ff9194b0 2024-09-13T18:49:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55d8ff9194b0 msgr2=0x55d8ff8a1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55d8ff9194b0 0x55d8ff8a1700 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9604065060 msgr2=0x7f9604067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9604065060 0x7f9604067520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f96100094e0 tx=0x7f961000c040 comp rx=0 tx=0).stop 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 msgr2=0x55d8ff8899c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 --2- 172.21.15.81:0/2914565101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8ff8a87c0 0x55d8ff8899c0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f961400b810 tx=0x7f9614000bc0 comp rx=0 tx=0).stop 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9623a00700 1 -- 172.21.15.81:0/2914565101 reap_dead start 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 shutdown_connections 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 >> 172.21.15.81:0/2914565101 conn(0x55d8ff861d90 msgr2=0x55d8ff88e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:45.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 shutdown_connections 2024-09-13T18:49:45.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:45.783+0000 7f9625e06140 1 -- 172.21.15.81:0/2914565101 wait complete. 2024-09-13T18:49:45.800 INFO:teuthology.orchestra.run.smithi081.stdout:tag123 2024-09-13T18:49:45.800 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:49:45.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:49:45.836 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:49:45.885 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:49:45.885 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:49:45.885 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:45.904 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:49:45.904 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:45.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:49:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.171+0000 7f7bbe600700 1 Processor -- start 2024-09-13T18:49:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.171+0000 7f7bbe600700 1 -- start start 2024-09-13T18:49:46.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbe600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bb80cb020 0x7f7bb80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbe600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bb815c2a0 0x7f7bb815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbe600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb80b2ad0 con 0x7f7bb806aaa0 2024-09-13T18:49:46.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbe600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb815b960 con 0x7f7bb80cb020 2024-09-13T18:49:46.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbe600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb815bc40 con 0x7f7bb815c2a0 2024-09-13T18:49:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbd200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bb80cb020 0x7f7bb80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbdc00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7bb806aaa0 0x7f7bb80b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51076/0 (socket says 172.21.15.81:51076) 2024-09-13T18:49:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbdc00700 1 -- 172.21.15.81:0/4154512020 learned_addr learned my addr 172.21.15.81:0/4154512020 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:46.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bb7e00700 1 --2- 172.21.15.81:0/4154512020 >> v2:172.21.15.178:3300/0 conn(0x7f7bb815c2a0 0x7f7bb815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbd200700 1 -- 172.21.15.81:0/4154512020 >> v2:172.21.15.178:3300/0 conn(0x7f7bb815c2a0 msgr2=0x7f7bb815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbd200700 1 --2- 172.21.15.81:0/4154512020 >> v2:172.21.15.178:3300/0 conn(0x7f7bb815c2a0 0x7f7bb815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbd200700 1 -- 172.21.15.81:0/4154512020 >> v1:172.21.15.81:6789/0 conn(0x7f7bb806aaa0 legacy=0x7f7bb80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbd200700 1 -- 172.21.15.81:0/4154512020 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb815bf20 con 0x7f7bb80cb020 2024-09-13T18:49:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bb7e00700 1 --2- 172.21.15.81:0/4154512020 >> v2:172.21.15.178:3300/0 conn(0x7f7bb815c2a0 0x7f7bb815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bbd200700 1 --2- 172.21.15.81:0/4154512020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb80cc6f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7bb815e630 tx=0x7f7bac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14eb21fa5e5de99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.175+0000 7f7bb7400700 1 -- 172.21.15.81:0/4154512020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac011830 con 0x7f7bb80cb020 2024-09-13T18:49:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bb7400700 1 -- 172.21.15.81:0/4154512020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac011990 con 0x7f7bb80cb020 2024-09-13T18:49:46.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bb7400700 1 -- 172.21.15.81:0/4154512020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac011d40 con 0x7f7bb80cb020 2024-09-13T18:49:46.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 -- 172.21.15.81:0/4154512020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 msgr2=0x7f7bb80cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 --2- 172.21.15.81:0/4154512020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb80cc6f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f7bb815e630 tx=0x7f7bac009b30 comp rx=0 tx=0).stop 2024-09-13T18:49:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 -- 172.21.15.81:0/4154512020 shutdown_connections 2024-09-13T18:49:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 --2- 172.21.15.81:0/4154512020 >> v2:172.21.15.178:3300/0 conn(0x7f7bb815c2a0 0x7f7bb815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 --2- 172.21.15.81:0/4154512020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb80cc6f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 -- 172.21.15.81:0/4154512020 >> 172.21.15.81:0/4154512020 conn(0x7f7bb80b0c40 msgr2=0x7f7bb806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 -- 172.21.15.81:0/4154512020 shutdown_connections 2024-09-13T18:49:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.179+0000 7f7bbe600700 1 -- 172.21.15.81:0/4154512020 wait complete. 2024-09-13T18:49:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 Processor -- start 2024-09-13T18:49:46.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 -- start start 2024-09-13T18:49:46.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806aaa0 0x7f7bb8157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb8155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815c2a0 0x7f7bb8153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8155860 con 0x7f7bb80cb020 2024-09-13T18:49:46.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8152750 con 0x7f7bb815c2a0 2024-09-13T18:49:46.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbe600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8153290 con 0x7f7bb806aaa0 2024-09-13T18:49:46.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb8155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39120/0 (socket says 172.21.15.81:39120) 2024-09-13T18:49:46.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 -- 172.21.15.81:0/742069788 learned_addr learned my addr 172.21.15.81:0/742069788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:46.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbd200700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806aaa0 0x7f7bb8157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bbdc00700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815c2a0 0x7f7bb8153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 -- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806aaa0 msgr2=0x7f7bb8157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806aaa0 0x7f7bb8157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 -- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815c2a0 msgr2=0x7f7bb8153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815c2a0 0x7f7bb8153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.183+0000 7f7bb7e00700 1 -- 172.21.15.81:0/742069788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0094b0 con 0x7f7bb80cb020 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bb7e00700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb8155050 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400e810 tx=0x7f7ba400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4004230 con 0x7f7bb80cb020 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4004390 con 0x7f7bb80cb020 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb8155590 con 0x7f7bb80cb020 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba40036c0 con 0x7f7bb80cb020 2024-09-13T18:49:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb8152a10 con 0x7f7bb80cb020 2024-09-13T18:49:46.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.187+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb8153400 con 0x7f7bb80cb020 2024-09-13T18:49:46.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.191+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ba4003840 con 0x7f7bb80cb020 2024-09-13T18:49:46.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.191+0000 7f7bb4c00700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.191+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ba4083bc0 con 0x7f7bb80cb020 2024-09-13T18:49:46.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.191+0000 7f7bbd200700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.191+0000 7f7bbd200700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0090b0 tx=0x7f7bac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:46.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.199+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ba4050dc0 con 0x7f7bb80cb020 2024-09-13T18:49:46.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.391+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bb80cc6f0 con 0x7f7bb80cb020 2024-09-13T18:49:46.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.391+0000 7f7bb4c00700 1 -- 172.21.15.81:0/742069788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16823 (secure 0 0 0) 0x7f7ba4020090 con 0x7f7bb80cb020 2024-09-13T18:49:46.401 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:46.401 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:58.351327+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 msgr2=0x7f7b98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0090b0 tx=0x7f7bac008030 comp rx=0 tx=0).stop 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 msgr2=0x7f7bb8155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb8155050 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400e810 tx=0x7f7ba400eb20 comp rx=0 tx=0).stop 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 shutdown_connections 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815c2a0 0x7f7bb8153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb80cb020 0x7f7bb8155050 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 --2- 172.21.15.81:0/742069788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806aaa0 0x7f7bb8157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 >> 172.21.15.81:0/742069788 conn(0x7f7bb80b0c40 msgr2=0x7f7bb81597a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 shutdown_connections 2024-09-13T18:49:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.395+0000 7f7bbe600700 1 -- 172.21.15.81:0/742069788 wait complete. 2024-09-13T18:49:46.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:48:40.047375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:48:41.257293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:49:46.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:49:46.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.603+0000 7f19fce00700 1 Processor -- start 2024-09-13T18:49:46.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.603+0000 7f19fce00700 1 -- start start 2024-09-13T18:49:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19f8160d30 0x7f19f806cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f806d150 0x7f19f806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f8161110 0x7f19f806b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f80b0020 con 0x7f19f8161110 2024-09-13T18:49:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f80d1770 con 0x7f19f8160d30 2024-09-13T18:49:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f80d03f0 con 0x7f19f806d150 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f8161110 0x7f19f806b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f8161110 0x7f19f806b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49210/0 (socket says 172.21.15.81:49210) 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 -- 172.21.15.81:0/1402337807 learned_addr learned my addr 172.21.15.81:0/1402337807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7400700 1 --2- 172.21.15.81:0/1402337807 >> v2:172.21.15.178:3300/0 conn(0x7f19f8160d30 0x7f19f806cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f6a00700 1 --2- 172.21.15.81:0/1402337807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f806d150 0x7f19f806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 -- 172.21.15.81:0/1402337807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f806d150 msgr2=0x7f19f806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 --2- 172.21.15.81:0/1402337807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f806d150 0x7f19f806ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 -- 172.21.15.81:0/1402337807 >> v2:172.21.15.178:3300/0 conn(0x7f19f8160d30 msgr2=0x7f19f806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 --2- 172.21.15.81:0/1402337807 >> v2:172.21.15.178:3300/0 conn(0x7f19f8160d30 0x7f19f806cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 -- 172.21.15.81:0/1402337807 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80d06d0 con 0x7f19f8161110 2024-09-13T18:49:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f7e00700 1 --2- 172.21.15.81:0/1402337807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8161110 0x7f19f806b170 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f19f8073c60 tx=0x7f19f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45011a3382bb3ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f6000700 1 -- 172.21.15.81:0/1402337807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f000e070 con 0x7f19f8161110 2024-09-13T18:49:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f6000700 1 -- 172.21.15.81:0/1402337807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f000b9c0 con 0x7f19f8161110 2024-09-13T18:49:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19f6000700 1 -- 172.21.15.81:0/1402337807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f000bd70 con 0x7f19f8161110 2024-09-13T18:49:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 -- 172.21.15.81:0/1402337807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8161110 msgr2=0x7f19f806b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.607+0000 7f19fce00700 1 --2- 172.21.15.81:0/1402337807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8161110 0x7f19f806b170 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f19f8073c60 tx=0x7f19f000b330 comp rx=0 tx=0).stop 2024-09-13T18:49:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 -- 172.21.15.81:0/1402337807 shutdown_connections 2024-09-13T18:49:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 --2- 172.21.15.81:0/1402337807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8161110 0x7f19f806b170 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 --2- 172.21.15.81:0/1402337807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f806d150 0x7f19f806ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 --2- 172.21.15.81:0/1402337807 >> v2:172.21.15.178:3300/0 conn(0x7f19f8160d30 0x7f19f806cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 -- 172.21.15.81:0/1402337807 >> 172.21.15.81:0/1402337807 conn(0x7f19f8071d20 msgr2=0x7f19f8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 -- 172.21.15.81:0/1402337807 shutdown_connections 2024-09-13T18:49:46.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.611+0000 7f19fce00700 1 -- 172.21.15.81:0/1402337807 wait complete. 2024-09-13T18:49:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 Processor -- start 2024-09-13T18:49:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 -- start start 2024-09-13T18:49:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f806d150 0x7f19f81fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 0x7f19f8163720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8161110 0x7f19f8163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81f7620 con 0x7f19f8160d30 2024-09-13T18:49:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81f6cf0 con 0x7f19f806d150 2024-09-13T18:49:46.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19fce00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f81f6fd0 con 0x7f19f8161110 2024-09-13T18:49:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 0x7f19f8163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 0x7f19f8163720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49222/0 (socket says 172.21.15.81:49222) 2024-09-13T18:49:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 -- 172.21.15.81:0/1993848601 learned_addr learned my addr 172.21.15.81:0/1993848601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f806d150 0x7f19f81fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f7e00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8161110 0x7f19f8163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 -- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8161110 msgr2=0x7f19f8163c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8161110 0x7f19f8163c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 -- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f806d150 msgr2=0x7f19f81fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f806d150 0x7f19f81fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 -- 172.21.15.81:0/1993848601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009b30 con 0x7f19f8160d30 2024-09-13T18:49:46.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.615+0000 7f19f6a00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 0x7f19f8163720 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e7e0 tx=0x7f19e400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.619+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4004230 con 0x7f19f8160d30 2024-09-13T18:49:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.619+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4004390 con 0x7f19f8160d30 2024-09-13T18:49:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.619+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e40036c0 con 0x7f19f8160d30 2024-09-13T18:49:46.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.619+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f81f72b0 con 0x7f19f8160d30 2024-09-13T18:49:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.619+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f81fabb0 con 0x7f19f8160d30 2024-09-13T18:49:46.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.619+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f806cc10 con 0x7f19f8160d30 2024-09-13T18:49:46.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.623+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19e4003840 con 0x7f19f8160d30 2024-09-13T18:49:46.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.623+0000 7f19ef400700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19d8066760 0x7f19d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.623+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f19e4083ca0 con 0x7f19f8160d30 2024-09-13T18:49:46.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.623+0000 7f19f7400700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19d8066760 0x7f19d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:46.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.623+0000 7f19f7400700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19d8066760 0x7f19d8068c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009980 tx=0x7f19e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:46.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.627+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19e4050e20 con 0x7f19f8160d30 2024-09-13T18:49:46.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.807+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19f80b5760 con 0x7f19f8160d30 2024-09-13T18:49:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19ef400700 1 -- 172.21.15.81:0/1993848601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19e4054440 con 0x7f19f8160d30 2024-09-13T18:49:46.819 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:49:46.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19d8066760 msgr2=0x7f19d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19d8066760 0x7f19d8068c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009980 tx=0x7f19e8008040 comp rx=0 tx=0).stop 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 msgr2=0x7f19f8163720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 0x7f19f8163720 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e7e0 tx=0x7f19e400eaf0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 shutdown_connections 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19d8066760 0x7f19d8068c20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f8161110 0x7f19f8163c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f8160d30 0x7f19f8163720 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 --2- 172.21.15.81:0/1993848601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f806d150 0x7f19f81fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 >> 172.21.15.81:0/1993848601 conn(0x7f19f8071d20 msgr2=0x7f19f80b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 shutdown_connections 2024-09-13T18:49:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.811+0000 7f19fce00700 1 -- 172.21.15.81:0/1993848601 wait complete. 2024-09-13T18:49:46.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:49:47.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.999+0000 7f27eb200700 1 Processor -- start 2024-09-13T18:49:47.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:46.999+0000 7f27eb200700 1 -- start start 2024-09-13T18:49:47.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27eb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec15e9f0 0x7f27ec0b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27eb200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27ec066090 0x7f27ec066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27eb200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec161940 con 0x7f27ec161410 2024-09-13T18:49:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27eb200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec1624c0 con 0x7f27ec066090 2024-09-13T18:49:47.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27eb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0b5120 con 0x7f27ec15e9f0 2024-09-13T18:49:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27e9400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f27ec161410 0x7f27ec0b2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:41668/0 (socket says 172.21.15.81:41668) 2024-09-13T18:49:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27e9400700 1 -- 172.21.15.81:0/4039065476 learned_addr learned my addr 172.21.15.81:0/4039065476 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27ea800700 1 --2- 172.21.15.81:0/4039065476 >> v2:172.21.15.81:3300/0 conn(0x7f27ec066090 0x7f27ec066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27e9e00700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec15e9f0 0x7f27ec0b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27e8a00700 1 -- 172.21.15.81:0/4039065476 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204287031 0 0) 0x7f27ec161940 con 0x7f27ec161410 2024-09-13T18:49:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27e8a00700 1 -- 172.21.15.81:0/4039065476 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d00035d0 con 0x7f27ec161410 2024-09-13T18:49:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27ea800700 1 -- 172.21.15.81:0/4039065476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec15e9f0 msgr2=0x7f27ec0b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27ea800700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec15e9f0 0x7f27ec0b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27ea800700 1 -- 172.21.15.81:0/4039065476 >> v1:172.21.15.178:6789/0 conn(0x7f27ec161410 legacy=0x7f27ec0b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27ea800700 1 -- 172.21.15.81:0/4039065476 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec161c20 con 0x7f27ec066090 2024-09-13T18:49:47.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.003+0000 7f27e9e00700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec15e9f0 0x7f27ec0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:47.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27ea800700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec066090 0x7f27ec066520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009d90 tx=0x7f27e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e50f1fb2f41b77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27e8a00700 1 -- 172.21.15.81:0/4039065476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400e070 con 0x7f27ec066090 2024-09-13T18:49:47.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27e8a00700 1 -- 172.21.15.81:0/4039065476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400bb20 con 0x7f27ec066090 2024-09-13T18:49:47.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27e8a00700 1 -- 172.21.15.81:0/4039065476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4012430 con 0x7f27ec066090 2024-09-13T18:49:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 -- 172.21.15.81:0/4039065476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec066090 msgr2=0x7f27ec066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec066090 0x7f27ec066520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009d90 tx=0x7f27e400b330 comp rx=0 tx=0).stop 2024-09-13T18:49:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 -- 172.21.15.81:0/4039065476 shutdown_connections 2024-09-13T18:49:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec066090 0x7f27ec066520 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 --2- 172.21.15.81:0/4039065476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec15e9f0 0x7f27ec0b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 -- 172.21.15.81:0/4039065476 >> 172.21.15.81:0/4039065476 conn(0x7f27ec070d10 msgr2=0x7f27ec0710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 -- 172.21.15.81:0/4039065476 shutdown_connections 2024-09-13T18:49:47.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.007+0000 7f27eb200700 1 -- 172.21.15.81:0/4039065476 wait complete. 2024-09-13T18:49:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 Processor -- start 2024-09-13T18:49:47.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 -- start start 2024-09-13T18:49:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec066090 0x7f27ec158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27ec15e9f0 0x7f27ec1f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 0x7f27ec1fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0ccc90 con 0x7f27ec161410 2024-09-13T18:49:47.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec15c3c0 con 0x7f27ec15e9f0 2024-09-13T18:49:47.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27eb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec15c6a0 con 0x7f27ec066090 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 0x7f27ec1fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 0x7f27ec1fa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49250/0 (socket says 172.21.15.81:49250) 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 -- 172.21.15.81:0/2872031665 learned_addr learned my addr 172.21.15.81:0/2872031665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27e9400700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27ec15e9f0 0x7f27ec1f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27e9e00700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec066090 0x7f27ec158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 -- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec066090 msgr2=0x7f27ec158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec066090 0x7f27ec158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 -- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27ec15e9f0 msgr2=0x7f27ec1f9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27ec15e9f0 0x7f27ec1f9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 -- 172.21.15.81:0/2872031665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0094b0 con 0x7f27ec161410 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27e9e00700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec066090 0x7f27ec158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.011+0000 7f27ea800700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 0x7f27ec1fa4d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f27e4014040 tx=0x7f27e4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4012430 con 0x7f27ec161410 2024-09-13T18:49:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4020070 con 0x7f27ec161410 2024-09-13T18:49:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4004280 con 0x7f27ec161410 2024-09-13T18:49:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4009a70 con 0x7f27ec161410 2024-09-13T18:49:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec0cd150 con 0x7f27ec161410 2024-09-13T18:49:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec15c8c0 con 0x7f27ec161410 2024-09-13T18:49:47.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.015+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27e40043e0 con 0x7f27ec161410 2024-09-13T18:49:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.019+0000 7f27e2000700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f27cc066730 0x7f27cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.019+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27e4022070 con 0x7f27ec161410 2024-09-13T18:49:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.019+0000 7f27e9e00700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f27cc066730 0x7f27cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.019+0000 7f27e9e00700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f27cc066730 0x7f27cc068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d00 tx=0x7f27dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.023+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27e4053180 con 0x7f27ec161410 2024-09-13T18:49:47.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.207+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27ec161150 con 0x7f27ec161410 2024-09-13T18:49:47.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.207+0000 7f27e2000700 1 -- 172.21.15.81:0/2872031665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27e402c020 con 0x7f27ec161410 2024-09-13T18:49:47.216 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f27cc066730 msgr2=0x7f27cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f27cc066730 0x7f27cc068bf0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d00 tx=0x7f27dc008040 comp rx=0 tx=0).stop 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 msgr2=0x7f27ec1fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 0x7f27ec1fa4d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f27e4014040 tx=0x7f27e4004af0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 shutdown_connections 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f27cc066730 0x7f27cc068bf0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27ec161410 0x7f27ec1fa4d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27ec15e9f0 0x7f27ec1f9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 --2- 172.21.15.81:0/2872031665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27ec066090 0x7f27ec158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 >> 172.21.15.81:0/2872031665 conn(0x7f27ec070d10 msgr2=0x7f27ec066470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 shutdown_connections 2024-09-13T18:49:47.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.211+0000 7f27eb200700 1 -- 172.21.15.81:0/2872031665 wait complete. 2024-09-13T18:49:47.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:49:47.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 Processor -- start 2024-09-13T18:49:47.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 -- start start 2024-09-13T18:49:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f40f806c5a0 0x7f40f815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 0x7f40f80cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80b4680 con 0x7f40f806c980 2024-09-13T18:49:47.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f80b5dd0 con 0x7f40f806c5a0 2024-09-13T18:49:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80b4960 con 0x7f40f80cf830 2024-09-13T18:49:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 0x7f40f80cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 0x7f40f80cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:53374/0 (socket says 172.21.15.81:53374) 2024-09-13T18:49:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 -- 172.21.15.81:0/3609300988 learned_addr learned my addr 172.21.15.81:0/3609300988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:47.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f6a00700 1 --2- 172.21.15.81:0/3609300988 >> v2:172.21.15.178:3300/0 conn(0x7f40f806c5a0 0x7f40f815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 -- 172.21.15.81:0/3609300988 >> v2:172.21.15.178:3300/0 conn(0x7f40f806c5a0 msgr2=0x7f40f815aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 --2- 172.21.15.81:0/3609300988 >> v2:172.21.15.178:3300/0 conn(0x7f40f806c5a0 0x7f40f815aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 -- 172.21.15.81:0/3609300988 >> v1:172.21.15.178:6789/0 conn(0x7f40f806c980 legacy=0x7f40f80b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.407+0000 7f40f7400700 1 -- 172.21.15.81:0/3609300988 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80cf030 con 0x7f40f80cf830 2024-09-13T18:49:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7400700 1 --2- 172.21.15.81:0/3609300988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 0x7f40f80cfc40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009e50 tx=0x7f40f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52aa207973cceb03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f5600700 1 -- 172.21.15.81:0/3609300988 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000e070 con 0x7f40f80cf830 2024-09-13T18:49:47.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f5600700 1 -- 172.21.15.81:0/3609300988 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f000b910 con 0x7f40f80cf830 2024-09-13T18:49:47.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f5600700 1 -- 172.21.15.81:0/3609300988 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000bcc0 con 0x7f40f80cf830 2024-09-13T18:49:47.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 -- 172.21.15.81:0/3609300988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 msgr2=0x7f40f80cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 --2- 172.21.15.81:0/3609300988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 0x7f40f80cfc40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009e50 tx=0x7f40f000b330 comp rx=0 tx=0).stop 2024-09-13T18:49:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 -- 172.21.15.81:0/3609300988 shutdown_connections 2024-09-13T18:49:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 --2- 172.21.15.81:0/3609300988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f80cf830 0x7f40f80cfc40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 --2- 172.21.15.81:0/3609300988 >> v2:172.21.15.178:3300/0 conn(0x7f40f806c5a0 0x7f40f815aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 -- 172.21.15.81:0/3609300988 >> 172.21.15.81:0/3609300988 conn(0x7f40f8071d20 msgr2=0x7f40f8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 -- 172.21.15.81:0/3609300988 shutdown_connections 2024-09-13T18:49:47.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 -- 172.21.15.81:0/3609300988 wait complete. 2024-09-13T18:49:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 Processor -- start 2024-09-13T18:49:47.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.411+0000 7f40f7e00700 1 -- start start 2024-09-13T18:49:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 0x7f40f815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f806c980 0x7f40f8139770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f80cf830 0x7f40f814aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f8139cb0 con 0x7f40f806c5a0 2024-09-13T18:49:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f814afd0 con 0x7f40f80cf830 2024-09-13T18:49:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f815c660 con 0x7f40f806c980 2024-09-13T18:49:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 0x7f40f815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 0x7f40f815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49256/0 (socket says 172.21.15.81:49256) 2024-09-13T18:49:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 -- 172.21.15.81:0/913498982 learned_addr learned my addr 172.21.15.81:0/913498982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7400700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f80cf830 0x7f40f814aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6000700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f806c980 0x7f40f8139770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 -- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f806c980 msgr2=0x7f40f8139770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f806c980 0x7f40f8139770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 -- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f80cf830 msgr2=0x7f40f814aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f80cf830 0x7f40f814aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 -- 172.21.15.81:0/913498982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f0009b30 con 0x7f40f806c5a0 2024-09-13T18:49:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6000700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f806c980 0x7f40f8139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f6a00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 0x7f40f815c080 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f40e800e9d0 tx=0x7f40e800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8009720 con 0x7f40f806c5a0 2024-09-13T18:49:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f815c940 con 0x7f40f806c5a0 2024-09-13T18:49:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e800c850 con 0x7f40f806c5a0 2024-09-13T18:49:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800cbc0 con 0x7f40f806c5a0 2024-09-13T18:49:47.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.415+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f815cf00 con 0x7f40f806c5a0 2024-09-13T18:49:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.419+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f80cec70 con 0x7f40f806c5a0 2024-09-13T18:49:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.419+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40e800cd20 con 0x7f40f806c5a0 2024-09-13T18:49:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.423+0000 7f40eea00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d8066730 0x7f40d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.423+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f40e8084500 con 0x7f40f806c5a0 2024-09-13T18:49:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.423+0000 7f40f6000700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d8066730 0x7f40d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.423+0000 7f40f6000700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d8066730 0x7f40d8068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f40f814c940 tx=0x7f40e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.427+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40e80515f0 con 0x7f40f806c5a0 2024-09-13T18:49:47.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f40f815a0e0 con 0x7f40f806c5a0 2024-09-13T18:49:47.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40eea00700 1 -- 172.21.15.81:0/913498982 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f40e8054c10 con 0x7f40f806c5a0 2024-09-13T18:49:47.615 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d8066730 msgr2=0x7f40d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d8066730 0x7f40d8068bf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f40f814c940 tx=0x7f40e4009040 comp rx=0 tx=0).stop 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 msgr2=0x7f40f815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 0x7f40f815c080 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f40e800e9d0 tx=0x7f40e800ece0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 shutdown_connections 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d8066730 0x7f40d8068bf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f80cf830 0x7f40f814aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f806c980 0x7f40f8139770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 --2- 172.21.15.81:0/913498982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f806c5a0 0x7f40f815c080 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.607+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 >> 172.21.15.81:0/913498982 conn(0x7f40f8071d20 msgr2=0x7f40f80b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:47.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.611+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 shutdown_connections 2024-09-13T18:49:47.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.611+0000 7f40f7e00700 1 -- 172.21.15.81:0/913498982 wait complete. 2024-09-13T18:49:47.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:49:47.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.803+0000 7f8293e00700 1 Processor -- start 2024-09-13T18:49:47.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.803+0000 7f8293e00700 1 -- start start 2024-09-13T18:49:47.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8293e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f82940b2d80 0x7f829406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8293e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940b3560 con 0x7f829406aaa0 2024-09-13T18:49:47.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8293e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940b3280 con 0x7f82941610b0 2024-09-13T18:49:47.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8293e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8294070b30 con 0x7f82940b2d80 2024-09-13T18:49:47.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8292000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f829406aaa0 0x7f82940b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56118/0 (socket says 172.21.15.81:56118) 2024-09-13T18:49:47.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8292000700 1 -- 172.21.15.81:0/167464363 learned_addr learned my addr 172.21.15.81:0/167464363 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:47.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8293400700 1 --2- 172.21.15.81:0/167464363 >> v2:172.21.15.178:3300/0 conn(0x7f82940b2d80 0x7f829406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161788538 0 0) 0x7f82940b3560 con 0x7f829406aaa0 2024-09-13T18:49:47.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82780035d0 con 0x7f829406aaa0 2024-09-13T18:49:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384371702 0 0) 0x7f82940b3280 con 0x7f82941610b0 2024-09-13T18:49:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82940b3560 con 0x7f82941610b0 2024-09-13T18:49:47.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016841641 0 0) 0x7f82780035d0 con 0x7f829406aaa0 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 >> v2:172.21.15.178:3300/0 conn(0x7f82940b2d80 msgr2=0x7f829406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 --2- 172.21.15.81:0/167464363 >> v2:172.21.15.178:3300/0 conn(0x7f82940b2d80 0x7f829406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 >> v1:172.21.15.178:6789/0 conn(0x7f82941610b0 legacy=0x7f82940719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294070ee0 con 0x7f829406aaa0 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f8280001670 con 0x7f829406aaa0 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 >> v1:172.21.15.81:6789/0 conn(0x7f829406aaa0 legacy=0x7f82940b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8278003c20 0x7f8278004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8278004870 0x7f8278004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.807+0000 7f8291600700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f827800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8294070b30 con 0x7f8278005280 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827800c1d0 con 0x7f8278004870 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827800c390 con 0x7f8278003c20 2024-09-13T18:49:47.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f827800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8292a00700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8278003c20 0x7f8278004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8292000700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8278004870 0x7f8278004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 -- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8278003c20 msgr2=0x7f8278004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8278003c20 0x7f8278004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 -- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8278004870 msgr2=0x7f8278004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8278004870 0x7f8278004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 -- 172.21.15.81:0/167464363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82780035d0 con 0x7f8278005280 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 -- 172.21.15.81:0/167464363 reap_dead start 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293400700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f827800ba30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f82940b31b0 tx=0x7f82780058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9580f84a3695d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c003c40 con 0x7f8278005280 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00f040 con 0x7f8278005280 2024-09-13T18:49:47.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8291600700 1 -- 172.21.15.81:0/167464363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00e9d0 con 0x7f8278005280 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 -- 172.21.15.81:0/167464363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 msgr2=0x7f827800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f827800ba30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f82940b31b0 tx=0x7f82780058a0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 -- 172.21.15.81:0/167464363 shutdown_connections 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 --2- 172.21.15.81:0/167464363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f827800ba30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 -- 172.21.15.81:0/167464363 >> 172.21.15.81:0/167464363 conn(0x7f82940b0c40 msgr2=0x7f829406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 -- 172.21.15.81:0/167464363 shutdown_connections 2024-09-13T18:49:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.811+0000 7f8293e00700 1 -- 172.21.15.81:0/167464363 wait complete. 2024-09-13T18:49:47.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.815+0000 7f8293e00700 1 Processor -- start 2024-09-13T18:49:47.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.815+0000 7f8293e00700 1 -- start start 2024-09-13T18:49:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f8294155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82941568c0 0x7f82941f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8294163fd0 0x7f82940ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941647e0 con 0x7f8278005280 2024-09-13T18:49:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941550a0 con 0x7f8294163fd0 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8294155380 con 0x7f82941568c0 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f8294155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f8294155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49278/0 (socket says 172.21.15.81:49278) 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 -- 172.21.15.81:0/2968523540 learned_addr learned my addr 172.21.15.81:0/2968523540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293400700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8294163fd0 0x7f82940ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292000700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82941568c0 0x7f82941f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 -- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82941568c0 msgr2=0x7f82941f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82941568c0 0x7f82941f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 -- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8294163fd0 msgr2=0x7f82940ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8294163fd0 0x7f82940ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 -- 172.21.15.81:0/2968523540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294155660 con 0x7f8278005280 2024-09-13T18:49:47.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292000700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82941568c0 0x7f82941f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8292a00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f8294155e60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f828400f750 tx=0x7f828400fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284005320 con 0x7f8278005280 2024-09-13T18:49:47.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82840054a0 con 0x7f8278005280 2024-09-13T18:49:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284006ac0 con 0x7f8278005280 2024-09-13T18:49:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8294155940 con 0x7f8278005280 2024-09-13T18:49:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940cd220 con 0x7f8278005280 2024-09-13T18:49:47.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.819+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f829406af10 con 0x7f8278005280 2024-09-13T18:49:47.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.823+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8284006c20 con 0x7f8278005280 2024-09-13T18:49:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.823+0000 7f828aa00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8274066730 0x7f8274068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.823+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8284083840 con 0x7f8278005280 2024-09-13T18:49:47.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.823+0000 7f8292000700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8274066730 0x7f8274068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:47.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.823+0000 7f8292000700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8274066730 0x7f8274068bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8280001200 tx=0x7f8280009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:47.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:47.827+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f82840509d0 con 0x7f8278005280 2024-09-13T18:49:48.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82940ae360 con 0x7f8278005280 2024-09-13T18:49:48.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f828aa00700 1 -- 172.21.15.81:0/2968523540 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8284053ff0 con 0x7f8278005280 2024-09-13T18:49:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8274066730 msgr2=0x7f8274068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8274066730 0x7f8274068bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8280001200 tx=0x7f8280009040 comp rx=0 tx=0).stop 2024-09-13T18:49:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 msgr2=0x7f8294155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f8294155e60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f828400f750 tx=0x7f828400fb10 comp rx=0 tx=0).stop 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 shutdown_connections 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8274066730 0x7f8274068bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8294163fd0 0x7f82940ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82941568c0 0x7f82941f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 --2- 172.21.15.81:0/2968523540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005280 0x7f8294155e60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 >> 172.21.15.81:0/2968523540 conn(0x7f82940b0c40 msgr2=0x7f82940aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 shutdown_connections 2024-09-13T18:49:48.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.019+0000 7f8293e00700 1 -- 172.21.15.81:0/2968523540 wait complete. 2024-09-13T18:49:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:49:48.055 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:49:48.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:49:48.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:49:48.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:49:48.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:49:48.101 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:49:48.165 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:49:48.165 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:48.182 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:49:48.183 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:49:48.183 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:48.225 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:49:48.225 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:49:48.225 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:48.240 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:49:48.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.427+0000 7f38ae800700 1 Processor -- start 2024-09-13T18:49:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.427+0000 7f38ae800700 1 -- start start 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38ae800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38a806c460 0x7f38a806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38ae800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38a806a5d0 0x7f38a806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38ae800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a80cdd90 con 0x7f38a815b700 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38ae800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a806ce10 con 0x7f38a806a5d0 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38ae800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a806af50 con 0x7f38a806c460 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f38a815b700 0x7f38a815bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56132/0 (socket says 172.21.15.81:56132) 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7400700 1 -- 172.21.15.81:0/1122773552 learned_addr learned my addr 172.21.15.81:0/1122773552 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:48.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7e00700 1 --2- 172.21.15.81:0/1122773552 >> v2:172.21.15.81:3300/0 conn(0x7f38a806a5d0 0x7f38a806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a6a00700 1 --2- 172.21.15.81:0/1122773552 >> v2:172.21.15.178:3300/0 conn(0x7f38a806c460 0x7f38a806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a6000700 1 -- 172.21.15.81:0/1122773552 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494188838 0 0) 0x7f38a80cdd90 con 0x7f38a815b700 2024-09-13T18:49:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a6000700 1 -- 172.21.15.81:0/1122773552 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f388c0035d0 con 0x7f38a815b700 2024-09-13T18:49:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7e00700 1 -- 172.21.15.81:0/1122773552 >> v2:172.21.15.178:3300/0 conn(0x7f38a806c460 msgr2=0x7f38a806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7e00700 1 --2- 172.21.15.81:0/1122773552 >> v2:172.21.15.178:3300/0 conn(0x7f38a806c460 0x7f38a806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7e00700 1 -- 172.21.15.81:0/1122773552 >> v1:172.21.15.81:6789/0 conn(0x7f38a815b700 legacy=0x7f38a815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.431+0000 7f38a7e00700 1 -- 172.21.15.81:0/1122773552 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a806d7e0 con 0x7f38a806a5d0 2024-09-13T18:49:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38a7e00700 1 --2- 172.21.15.81:0/1122773552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a806a5d0 0x7f38a806aa10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f38a806dcd0 tx=0x7f38a0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d3bb485c0aa6f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38a6000700 1 -- 172.21.15.81:0/1122773552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0011830 con 0x7f38a806a5d0 2024-09-13T18:49:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38a6000700 1 -- 172.21.15.81:0/1122773552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0011990 con 0x7f38a806a5d0 2024-09-13T18:49:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38a6000700 1 -- 172.21.15.81:0/1122773552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0011d00 con 0x7f38a806a5d0 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 -- 172.21.15.81:0/1122773552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a806a5d0 msgr2=0x7f38a806aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 --2- 172.21.15.81:0/1122773552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a806a5d0 0x7f38a806aa10 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f38a806dcd0 tx=0x7f38a0009b30 comp rx=0 tx=0).stop 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 -- 172.21.15.81:0/1122773552 shutdown_connections 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 --2- 172.21.15.81:0/1122773552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a806a5d0 0x7f38a806aa10 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 --2- 172.21.15.81:0/1122773552 >> v2:172.21.15.178:3300/0 conn(0x7f38a806c460 0x7f38a806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 -- 172.21.15.81:0/1122773552 >> 172.21.15.81:0/1122773552 conn(0x7f38a80b08d0 msgr2=0x7f38a80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 -- 172.21.15.81:0/1122773552 shutdown_connections 2024-09-13T18:49:48.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.435+0000 7f38ae800700 1 -- 172.21.15.81:0/1122773552 wait complete. 2024-09-13T18:49:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 Processor -- start 2024-09-13T18:49:48.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 -- start start 2024-09-13T18:49:48.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38a806a5d0 0x7f38a8142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38a806c460 0x7f38a81452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 0x7f38a80ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8156940 con 0x7f38a815b700 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8156ee0 con 0x7f38a806a5d0 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8142fe0 con 0x7f38a806c460 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 0x7f38a80ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 0x7f38a80ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49296/0 (socket says 172.21.15.81:49296) 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 -- 172.21.15.81:0/4294561970 learned_addr learned my addr 172.21.15.81:0/4294561970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7400700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38a806a5d0 0x7f38a8142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a6a00700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38a806c460 0x7f38a81452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 -- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38a806c460 msgr2=0x7f38a81452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38a806c460 0x7f38a81452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 -- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38a806a5d0 msgr2=0x7f38a8142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38a806a5d0 0x7f38a8142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 -- 172.21.15.81:0/4294561970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00094b0 con 0x7f38a815b700 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7400700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38a806a5d0 0x7f38a8142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38a7e00700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 0x7f38a80ad920 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009fd0 tx=0x7f38a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00045d0 con 0x7f38a815b700 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a001f070 con 0x7f38a815b700 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a8146270 con 0x7f38a815b700 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.439+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00038c0 con 0x7f38a815b700 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.443+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8145f90 con 0x7f38a815b700 2024-09-13T18:49:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.443+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a806aa10 con 0x7f38a815b700 2024-09-13T18:49:48.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.443+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38a0003a20 con 0x7f38a815b700 2024-09-13T18:49:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.447+0000 7f389f400700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3888066730 0x7f3888068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.447+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f38a0021070 con 0x7f38a815b700 2024-09-13T18:49:48.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.447+0000 7f38a7400700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3888066730 0x7f3888068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.447+0000 7f38a7400700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3888066730 0x7f3888068bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3898005cb0 tx=0x7f3898009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:48.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.451+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38a0052c70 con 0x7f38a815b700 2024-09-13T18:49:48.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.679+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38a8157020 con 0x7f38a815b700 2024-09-13T18:49:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f389f400700 1 -- 172.21.15.81:0/4294561970 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f38a0015090 con 0x7f38a815b700 2024-09-13T18:49:48.691 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:48.691 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:49:14.436973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5388,"mds_1":5314,"mds_2":5006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5006":{"gid":5006,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:49:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3888066730 msgr2=0x7f3888068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3888066730 0x7f3888068bf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3898005cb0 tx=0x7f3898009040 comp rx=0 tx=0).stop 2024-09-13T18:49:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 msgr2=0x7f38a80ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 0x7f38a80ad920 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009fd0 tx=0x7f38a0004770 comp rx=0 tx=0).stop 2024-09-13T18:49:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 shutdown_connections 2024-09-13T18:49:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3888066730 0x7f3888068bf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a815b700 0x7f38a80ad920 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38a806c460 0x7f38a81452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 --2- 172.21.15.81:0/4294561970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38a806a5d0 0x7f38a8142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 >> 172.21.15.81:0/4294561970 conn(0x7f38a80b08d0 msgr2=0x7f38a80ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:48.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 shutdown_connections 2024-09-13T18:49:48.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.683+0000 7f38ae800700 1 -- 172.21.15.81:0/4294561970 wait complete. 2024-09-13T18:49:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-13T18:49:48.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:49:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.871+0000 7f677b000700 1 Processor -- start 2024-09-13T18:49:48.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.871+0000 7f677b000700 1 -- start start 2024-09-13T18:49:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f677b000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f677415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f677b000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f677406c460 0x7f677406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f677b000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f677406a5d0 0x7f677406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f677b000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677406afa0 con 0x7f677406a5d0 2024-09-13T18:49:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f677b000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67740cdd90 con 0x7f677406c460 2024-09-13T18:49:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f677b000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677406ce10 con 0x7f677415b700 2024-09-13T18:49:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f677406a5d0 0x7f677406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f676b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f677406c460 0x7f677406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f677406a5d0 0x7f677406aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49302/0 (socket says 172.21.15.81:49302) 2024-09-13T18:49:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 -- 172.21.15.81:0/9661900 learned_addr learned my addr 172.21.15.81:0/9661900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6773e00700 1 --2- 172.21.15.81:0/9661900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f677415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 -- 172.21.15.81:0/9661900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 msgr2=0x7f677415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 --2- 172.21.15.81:0/9661900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f677415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 -- 172.21.15.81:0/9661900 >> v2:172.21.15.178:3300/0 conn(0x7f677406c460 msgr2=0x7f677406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 --2- 172.21.15.81:0/9661900 >> v2:172.21.15.178:3300/0 conn(0x7f677406c460 0x7f677406d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 -- 172.21.15.81:0/9661900 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677415c020 con 0x7f677406a5d0 2024-09-13T18:49:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f676b400700 1 --2- 172.21.15.81:0/9661900 >> v2:172.21.15.178:3300/0 conn(0x7f677406c460 0x7f677406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.875+0000 7f6779000700 1 --2- 172.21.15.81:0/9661900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406a5d0 0x7f677406aa60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f67740cc590 tx=0x7f676c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f76e8e8f18ef047 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f6773400700 1 -- 172.21.15.81:0/9661900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00e070 con 0x7f677406a5d0 2024-09-13T18:49:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f6773400700 1 -- 172.21.15.81:0/9661900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c00b910 con 0x7f677406a5d0 2024-09-13T18:49:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f6773400700 1 -- 172.21.15.81:0/9661900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c00bcc0 con 0x7f677406a5d0 2024-09-13T18:49:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 -- 172.21.15.81:0/9661900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406a5d0 msgr2=0x7f677406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 --2- 172.21.15.81:0/9661900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406a5d0 0x7f677406aa60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f67740cc590 tx=0x7f676c00b330 comp rx=0 tx=0).stop 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 -- 172.21.15.81:0/9661900 shutdown_connections 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 --2- 172.21.15.81:0/9661900 >> v2:172.21.15.178:3300/0 conn(0x7f677406c460 0x7f677406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 --2- 172.21.15.81:0/9661900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406a5d0 0x7f677406aa60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 --2- 172.21.15.81:0/9661900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f677415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 -- 172.21.15.81:0/9661900 >> 172.21.15.81:0/9661900 conn(0x7f67740b08d0 msgr2=0x7f67740b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 -- 172.21.15.81:0/9661900 shutdown_connections 2024-09-13T18:49:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.879+0000 7f677b000700 1 -- 172.21.15.81:0/9661900 wait complete. 2024-09-13T18:49:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 Processor -- start 2024-09-13T18:49:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 -- start start 2024-09-13T18:49:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677406a5d0 0x7f677415aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 0x7f6774151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f6774159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774151af0 con 0x7f677406c460 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677415af50 con 0x7f677406a5d0 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f677b000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67741568f0 con 0x7f677415b700 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f676b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 0x7f6774151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f676b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 0x7f6774151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49314/0 (socket says 172.21.15.81:49314) 2024-09-13T18:49:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f676b400700 1 -- 172.21.15.81:0/610936736 learned_addr learned my addr 172.21.15.81:0/610936736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.883+0000 7f6773e00700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677406a5d0 0x7f677415aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f6779000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f6774159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f676b400700 1 -- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 msgr2=0x7f6774159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f676b400700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f6774159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f676b400700 1 -- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677406a5d0 msgr2=0x7f677415aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f676b400700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677406a5d0 0x7f677415aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f676b400700 1 -- 172.21.15.81:0/610936736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c0094b0 con 0x7f677406c460 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f676b400700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 0x7f6774151000 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f675c00ebe0 tx=0x7f675c009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c009790 con 0x7f677406c460 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c00c8b0 con 0x7f677406c460 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c009b30 con 0x7f677406c460 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c00cc40 con 0x7f677406c460 2024-09-13T18:49:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6774155fc0 con 0x7f677406c460 2024-09-13T18:49:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.887+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677406caa0 con 0x7f677406c460 2024-09-13T18:49:48.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.891+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f675c013470 con 0x7f677406c460 2024-09-13T18:49:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.891+0000 7f6770c00700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6750066730 0x7f6750068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.891+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f675c084090 con 0x7f677406c460 2024-09-13T18:49:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.891+0000 7f6773e00700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6750066730 0x7f6750068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.891+0000 7f6773e00700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6750066730 0x7f6750068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f67741522f0 tx=0x7f6764008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:48.895+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f675c0512a0 con 0x7f677406c460 2024-09-13T18:49:49.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.087+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6774156a30 con 0x7f677406c460 2024-09-13T18:49:49.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.091+0000 7f6770c00700 1 -- 172.21.15.81:0/610936736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16823 (secure 0 0 0) 0x7f675c0548c0 con 0x7f677406c460 2024-09-13T18:49:49.101 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:49.102 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:58.351327+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:49:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6750066730 msgr2=0x7f6750068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6750066730 0x7f6750068bf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f67741522f0 tx=0x7f6764008040 comp rx=0 tx=0).stop 2024-09-13T18:49:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 msgr2=0x7f6774151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 0x7f6774151000 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f675c00ebe0 tx=0x7f675c009e50 comp rx=0 tx=0).stop 2024-09-13T18:49:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 shutdown_connections 2024-09-13T18:49:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6750066730 0x7f6750068bf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f677415b700 0x7f6774159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f677406c460 0x7f6774151000 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 --2- 172.21.15.81:0/610936736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f677406a5d0 0x7f677415aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 >> 172.21.15.81:0/610936736 conn(0x7f67740b08d0 msgr2=0x7f67740ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 shutdown_connections 2024-09-13T18:49:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.095+0000 7f677b000700 1 -- 172.21.15.81:0/610936736 wait complete. 2024-09-13T18:49:49.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:48:40.047375+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:48:41.257293+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:49:49.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:49:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553e800700 1 Processor -- start 2024-09-13T18:49:49.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553e800700 1 -- start start 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55380b4f80 0x7f55380b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553e800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380ce530 con 0x7f5538160fc0 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553e800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380cf3e0 con 0x7f55380d0480 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553e800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55380d0060 con 0x7f55380b4f80 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f55380b4f80 0x7f55380b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5538160fc0 0x7f55380cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56134/0 (socket says 172.21.15.81:56134) 2024-09-13T18:49:49.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553d400700 1 -- 172.21.15.81:0/3732801720 learned_addr learned my addr 172.21.15.81:0/3732801720 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:49.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.291+0000 7f553ca00700 1 -- 172.21.15.81:0/3732801720 >> v1:172.21.15.178:6789/0 conn(0x7f55380d0480 legacy=0x7f553816ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:49.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553ca00700 1 -- 172.21.15.81:0/3732801720 >> v1:172.21.15.81:6789/0 conn(0x7f5538160fc0 legacy=0x7f55380cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553ca00700 1 -- 172.21.15.81:0/3732801720 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380cf6c0 con 0x7f55380b4f80 2024-09-13T18:49:49.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553ca00700 1 --2- 172.21.15.81:0/3732801720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55380b4f80 0x7f55380b2700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5528009850 tx=0x7f5528009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56603cb136e1bf02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:49.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f5537e00700 1 -- 172.21.15.81:0/3732801720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528004230 con 0x7f55380b4f80 2024-09-13T18:49:49.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f5537e00700 1 -- 172.21.15.81:0/3732801720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5528004390 con 0x7f55380b4f80 2024-09-13T18:49:49.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f5537e00700 1 -- 172.21.15.81:0/3732801720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55280036c0 con 0x7f55380b4f80 2024-09-13T18:49:49.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 -- 172.21.15.81:0/3732801720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55380b4f80 msgr2=0x7f55380b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 --2- 172.21.15.81:0/3732801720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55380b4f80 0x7f55380b2700 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5528009850 tx=0x7f5528009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:49.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 -- 172.21.15.81:0/3732801720 shutdown_connections 2024-09-13T18:49:49.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 --2- 172.21.15.81:0/3732801720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55380b4f80 0x7f55380b2700 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 -- 172.21.15.81:0/3732801720 >> 172.21.15.81:0/3732801720 conn(0x7f5538071d90 msgr2=0x7f5538072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:49.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 -- 172.21.15.81:0/3732801720 shutdown_connections 2024-09-13T18:49:49.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.295+0000 7f553e800700 1 -- 172.21.15.81:0/3732801720 wait complete. 2024-09-13T18:49:49.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.299+0000 7f553e800700 1 Processor -- start 2024-09-13T18:49:49.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.299+0000 7f553e800700 1 -- start start 2024-09-13T18:49:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55380b4f80 0x7f55381fad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55380d0480 0x7f55381471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 0x7f553806cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55381499f0 con 0x7f5538160fc0 2024-09-13T18:49:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553815dcf0 con 0x7f55380d0480 2024-09-13T18:49:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55381fb260 con 0x7f55380b4f80 2024-09-13T18:49:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 0x7f553806cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 0x7f553806cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49336/0 (socket says 172.21.15.81:49336) 2024-09-13T18:49:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 -- 172.21.15.81:0/2665218447 learned_addr learned my addr 172.21.15.81:0/2665218447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553ca00700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55380d0480 0x7f55381471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553d400700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55380b4f80 0x7f55381fad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 -- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55380b4f80 msgr2=0x7f55381fad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55380b4f80 0x7f55381fad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 -- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55380d0480 msgr2=0x7f55381471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55380d0480 0x7f55381471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 -- 172.21.15.81:0/2665218447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55280094b0 con 0x7f5538160fc0 2024-09-13T18:49:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553ca00700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55380d0480 0x7f55381471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553de00700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 0x7f553806cbc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f553000cb60 tx=0x7f553000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000a940 con 0x7f5538160fc0 2024-09-13T18:49:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553000aaa0 con 0x7f5538160fc0 2024-09-13T18:49:49.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5538161520 con 0x7f5538160fc0 2024-09-13T18:49:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000ae50 con 0x7f5538160fc0 2024-09-13T18:49:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.303+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5538149bf0 con 0x7f5538160fc0 2024-09-13T18:49:49.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.307+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55380cde20 con 0x7f5538160fc0 2024-09-13T18:49:49.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.307+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5530012420 con 0x7f5538160fc0 2024-09-13T18:49:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.307+0000 7f5535600700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f551c066730 0x7f551c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.307+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5530084930 con 0x7f5538160fc0 2024-09-13T18:49:49.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.307+0000 7f553d400700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f551c066730 0x7f551c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.307+0000 7f553d400700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f551c066730 0x7f551c068bf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f552c000f60 tx=0x7f552c007f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:49.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.311+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5530051a20 con 0x7f5538160fc0 2024-09-13T18:49:49.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.499+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f553815deb0 con 0x7f5538160fc0 2024-09-13T18:49:49.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.499+0000 7f5535600700 1 -- 172.21.15.81:0/2665218447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55300160a0 con 0x7f5538160fc0 2024-09-13T18:49:49.508 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f551c066730 msgr2=0x7f551c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f551c066730 0x7f551c068bf0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f552c000f60 tx=0x7f552c007f30 comp rx=0 tx=0).stop 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 msgr2=0x7f553806cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 0x7f553806cbc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f553000cb60 tx=0x7f553000ce70 comp rx=0 tx=0).stop 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 shutdown_connections 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f551c066730 0x7f551c068bf0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5538160fc0 0x7f553806cbc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55380d0480 0x7f55381471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 --2- 172.21.15.81:0/2665218447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55380b4f80 0x7f55381fad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 >> 172.21.15.81:0/2665218447 conn(0x7f5538071d90 msgr2=0x7f55380b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 shutdown_connections 2024-09-13T18:49:49.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.503+0000 7f553e800700 1 -- 172.21.15.81:0/2665218447 wait complete. 2024-09-13T18:49:49.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:49:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.715+0000 7f609b200700 1 Processor -- start 2024-09-13T18:49:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.715+0000 7f609b200700 1 -- start start 2024-09-13T18:49:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6094160d30 0x7f609406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f609406d150 0x7f609406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609b200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60940b0020 con 0x7f6094161110 2024-09-13T18:49:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60940d1770 con 0x7f609406d150 2024-09-13T18:49:49.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60940d03f0 con 0x7f6094160d30 2024-09-13T18:49:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6094160d30 0x7f609406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609a800700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f6094161110 0x7f6094164a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:41706/0 (socket says 172.21.15.81:41706) 2024-09-13T18:49:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f609a800700 1 -- 172.21.15.81:0/763410349 learned_addr learned my addr 172.21.15.81:0/763410349 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099400700 1 --2- 172.21.15.81:0/763410349 >> v2:172.21.15.81:3300/0 conn(0x7f609406d150 0x7f609406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099e00700 1 -- 172.21.15.81:0/763410349 >> v2:172.21.15.81:3300/0 conn(0x7f609406d150 msgr2=0x7f609406ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099e00700 1 --2- 172.21.15.81:0/763410349 >> v2:172.21.15.81:3300/0 conn(0x7f609406d150 0x7f609406ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6098a00700 1 -- 172.21.15.81:0/763410349 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068075892 0 0) 0x7f60940b0020 con 0x7f6094161110 2024-09-13T18:49:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099e00700 1 -- 172.21.15.81:0/763410349 >> v1:172.21.15.178:6789/0 conn(0x7f6094161110 legacy=0x7f6094164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099e00700 1 -- 172.21.15.81:0/763410349 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940d06d0 con 0x7f6094160d30 2024-09-13T18:49:49.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.719+0000 7f6099e00700 1 --2- 172.21.15.81:0/763410349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f609406cc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6094073c60 tx=0x7f6088009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbcddca6e16eaf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f6098a00700 1 -- 172.21.15.81:0/763410349 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088011830 con 0x7f6094160d30 2024-09-13T18:49:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f6098a00700 1 -- 172.21.15.81:0/763410349 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6088011990 con 0x7f6094160d30 2024-09-13T18:49:49.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f6098a00700 1 -- 172.21.15.81:0/763410349 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088011d20 con 0x7f6094160d30 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 -- 172.21.15.81:0/763410349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 msgr2=0x7f609406cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 --2- 172.21.15.81:0/763410349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f609406cc10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6094073c60 tx=0x7f6088009b30 comp rx=0 tx=0).stop 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 -- 172.21.15.81:0/763410349 shutdown_connections 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 --2- 172.21.15.81:0/763410349 >> v2:172.21.15.81:3300/0 conn(0x7f609406d150 0x7f609406ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 --2- 172.21.15.81:0/763410349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f609406cc10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 -- 172.21.15.81:0/763410349 >> 172.21.15.81:0/763410349 conn(0x7f6094071d20 msgr2=0x7f6094072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 -- 172.21.15.81:0/763410349 shutdown_connections 2024-09-13T18:49:49.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 -- 172.21.15.81:0/763410349 wait complete. 2024-09-13T18:49:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 Processor -- start 2024-09-13T18:49:49.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.723+0000 7f609b200700 1 -- start start 2024-09-13T18:49:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f609406d150 0x7f6094155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f6094159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 0x7f6094163490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60941eb0c0 con 0x7f6094161110 2024-09-13T18:49:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6094156000 con 0x7f6094160d30 2024-09-13T18:49:49.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60941ecde0 con 0x7f609406d150 2024-09-13T18:49:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 0x7f6094163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 0x7f6094163490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49350/0 (socket says 172.21.15.81:49350) 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 -- 172.21.15.81:0/358875751 learned_addr learned my addr 172.21.15.81:0/358875751 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f6099e00700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f609406d150 0x7f6094155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f6099400700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f6094159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 -- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f609406d150 msgr2=0x7f6094155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f609406d150 0x7f6094155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 -- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 msgr2=0x7f6094159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f6094159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 -- 172.21.15.81:0/358875751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880094b0 con 0x7f6094161110 2024-09-13T18:49:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609a800700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 0x7f6094163490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f609000cc10 tx=0x7f609000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609000aaa0 con 0x7f6094161110 2024-09-13T18:49:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609000ac20 con 0x7f6094161110 2024-09-13T18:49:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60941ed0c0 con 0x7f6094161110 2024-09-13T18:49:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60900070d0 con 0x7f6094161110 2024-09-13T18:49:49.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.727+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60941eb610 con 0x7f6094161110 2024-09-13T18:49:49.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.731+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609406c510 con 0x7f6094161110 2024-09-13T18:49:49.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.731+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6090007230 con 0x7f6094161110 2024-09-13T18:49:49.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.731+0000 7f608e000700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6078066730 0x7f6078068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.731+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6090083f70 con 0x7f6094161110 2024-09-13T18:49:49.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.735+0000 7f6099e00700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6078066730 0x7f6078068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.735+0000 7f6099e00700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6078066730 0x7f6078068bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6088009fd0 tx=0x7f6088008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:49.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.739+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6090051170 con 0x7f6094161110 2024-09-13T18:49:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.915+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60941eb800 con 0x7f6094161110 2024-09-13T18:49:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.915+0000 7f608e000700 1 -- 172.21.15.81:0/358875751 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6090018020 con 0x7f6094161110 2024-09-13T18:49:49.926 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6078066730 msgr2=0x7f6078068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6078066730 0x7f6078068bf0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6088009fd0 tx=0x7f6088008030 comp rx=0 tx=0).stop 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 msgr2=0x7f6094163490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 0x7f6094163490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f609000cc10 tx=0x7f609000cf20 comp rx=0 tx=0).stop 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 shutdown_connections 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6078066730 0x7f6078068bf0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6094161110 0x7f6094163490 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6094160d30 0x7f6094159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 --2- 172.21.15.81:0/358875751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f609406d150 0x7f6094155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 >> 172.21.15.81:0/358875751 conn(0x7f6094071d20 msgr2=0x7f60940b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 shutdown_connections 2024-09-13T18:49:49.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:49.923+0000 7f609b200700 1 -- 172.21.15.81:0/358875751 wait complete. 2024-09-13T18:49:49.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:49:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.115+0000 7f3393200700 1 Processor -- start 2024-09-13T18:49:50.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.115+0000 7f3393200700 1 -- start start 2024-09-13T18:49:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3393200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f339406c960 0x7f339406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3393200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339406d2f0 con 0x7f33940cd730 2024-09-13T18:49:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3393200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940cd2a0 con 0x7f3394159920 2024-09-13T18:49:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3393200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33940ccc90 con 0x7f339406c960 2024-09-13T18:49:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3391400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f339406c960 0x7f339406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3392800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33940cd730 0x7f33940cdb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56136/0 (socket says 172.21.15.81:56136) 2024-09-13T18:49:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3392800700 1 -- 172.21.15.81:0/342711953 learned_addr learned my addr 172.21.15.81:0/342711953 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:50.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3391e00700 1 --1- 172.21.15.81:0/342711953 >> v1:172.21.15.178:6789/0 conn(0x7f3394159920 0x7f33940b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:41714/0 (socket says 172.21.15.81:41714) 2024-09-13T18:49:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3391400700 1 -- 172.21.15.81:0/342711953 >> v1:172.21.15.178:6789/0 conn(0x7f3394159920 legacy=0x7f33940b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3391400700 1 -- 172.21.15.81:0/342711953 >> v1:172.21.15.81:6789/0 conn(0x7f33940cd730 legacy=0x7f33940cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3390a00700 1 -- 172.21.15.81:0/342711953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287767067 0 0) 0x7f338c001490 con 0x7f33940cd730 2024-09-13T18:49:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3391400700 1 -- 172.21.15.81:0/342711953 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33940b3580 con 0x7f339406c960 2024-09-13T18:49:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.119+0000 7f3391400700 1 --2- 172.21.15.81:0/342711953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f339406cdb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3380009850 tx=0x7f3380009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57187502b0f3bbce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3390a00700 1 -- 172.21.15.81:0/342711953 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380011830 con 0x7f339406c960 2024-09-13T18:49:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3390a00700 1 -- 172.21.15.81:0/342711953 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3380011990 con 0x7f339406c960 2024-09-13T18:49:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3390a00700 1 -- 172.21.15.81:0/342711953 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380011d20 con 0x7f339406c960 2024-09-13T18:49:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 -- 172.21.15.81:0/342711953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 msgr2=0x7f339406cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 --2- 172.21.15.81:0/342711953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f339406cdb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3380009850 tx=0x7f3380009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:50.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 -- 172.21.15.81:0/342711953 shutdown_connections 2024-09-13T18:49:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 --2- 172.21.15.81:0/342711953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f339406cdb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 -- 172.21.15.81:0/342711953 >> 172.21.15.81:0/342711953 conn(0x7f339406a390 msgr2=0x7f339406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 -- 172.21.15.81:0/342711953 shutdown_connections 2024-09-13T18:49:50.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 -- 172.21.15.81:0/342711953 wait complete. 2024-09-13T18:49:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.123+0000 7f3393200700 1 Processor -- start 2024-09-13T18:49:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 -- start start 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f3394151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33940cd730 0x7f3394154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 0x7f3394154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339414f9c0 con 0x7f33941f15a0 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394150220 con 0x7f339406c960 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3394152a60 con 0x7f33940cd730 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 0x7f3394154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 0x7f3394154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49360/0 (socket says 172.21.15.81:49360) 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 -- 172.21.15.81:0/2481295903 learned_addr learned my addr 172.21.15.81:0/2481295903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3391e00700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f3394151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3391400700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33940cd730 0x7f3394154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 -- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33940cd730 msgr2=0x7f3394154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33940cd730 0x7f3394154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 -- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 msgr2=0x7f3394151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f3394151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 -- 172.21.15.81:0/2481295903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800094b0 con 0x7f33941f15a0 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3391400700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33940cd730 0x7f3394154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3392800700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 0x7f3394154c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f338c00cca0 tx=0x7f338c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c00abc0 con 0x7f33941f15a0 2024-09-13T18:49:50.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c00ad20 con 0x7f33941f15a0 2024-09-13T18:49:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c007310 con 0x7f33941f15a0 2024-09-13T18:49:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339414fbd0 con 0x7f33941f15a0 2024-09-13T18:49:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.127+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33941ef2d0 con 0x7f33941f15a0 2024-09-13T18:49:50.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.131+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394152d40 con 0x7f33941f15a0 2024-09-13T18:49:50.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.131+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f338c007470 con 0x7f33941f15a0 2024-09-13T18:49:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.135+0000 7f338a000700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3374066730 0x7f3374068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.135+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f338c083cd0 con 0x7f33941f15a0 2024-09-13T18:49:50.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.135+0000 7f3391e00700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3374066730 0x7f3374068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.135+0000 7f3391e00700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3374066730 0x7f3374068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3384000f60 tx=0x7f3384001220 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.143+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f338c050e40 con 0x7f33941f15a0 2024-09-13T18:49:50.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.327+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f339406d2f0 con 0x7f33941f15a0 2024-09-13T18:49:50.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.327+0000 7f338a000700 1 -- 172.21.15.81:0/2481295903 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f339406d2f0 con 0x7f33941f15a0 2024-09-13T18:49:50.336 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:49:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3374066730 msgr2=0x7f3374068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3374066730 0x7f3374068bf0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3384000f60 tx=0x7f3384001220 comp rx=0 tx=0).stop 2024-09-13T18:49:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 msgr2=0x7f3394154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 0x7f3394154c80 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f338c00cca0 tx=0x7f338c00a060 comp rx=0 tx=0).stop 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 shutdown_connections 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3374066730 0x7f3374068bf0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33941f15a0 0x7f3394154c80 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33940cd730 0x7f3394154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 --2- 172.21.15.81:0/2481295903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f339406c960 0x7f3394151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 >> 172.21.15.81:0/2481295903 conn(0x7f339406a390 msgr2=0x7f339406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 shutdown_connections 2024-09-13T18:49:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.331+0000 7f3393200700 1 -- 172.21.15.81:0/2481295903 wait complete. 2024-09-13T18:49:50.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:50.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.519+0000 7f0e2d000700 1 Processor -- start 2024-09-13T18:49:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.519+0000 7f0e2d000700 1 -- start start 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e2d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e280cb020 0x7f0e280cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e2d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2806aaa0 0x7f0e2806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e2d000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2806b430 con 0x7f0e2815c2a0 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e2d000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e280b2ad0 con 0x7f0e280cb020 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e2d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2815b960 con 0x7f0e2806aaa0 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e280cb020 0x7f0e280cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e280cb020 0x7f0e280cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49366/0 (socket says 172.21.15.81:49366) 2024-09-13T18:49:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 -- 172.21.15.81:0/3657060627 learned_addr learned my addr 172.21.15.81:0/3657060627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27e00700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2806aaa0 0x7f0e2806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 -- 172.21.15.81:0/3657060627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2806aaa0 msgr2=0x7f0e2806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2806aaa0 0x7f0e2806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 -- 172.21.15.81:0/3657060627 >> v1:172.21.15.81:6789/0 conn(0x7f0e2815c2a0 legacy=0x7f0e2815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e26a00700 1 -- 172.21.15.81:0/3657060627 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262171708 0 0) 0x7f0e10001110 con 0x7f0e2815c2a0 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 -- 172.21.15.81:0/3657060627 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2815bc40 con 0x7f0e280cb020 2024-09-13T18:49:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27e00700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2806aaa0 0x7f0e2806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e27400700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e280cb020 0x7f0e280cc6f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009e50 tx=0x7f0e1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd1c53b0290e44d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.523+0000 7f0e26a00700 1 -- 172.21.15.81:0/3657060627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800e070 con 0x7f0e280cb020 2024-09-13T18:49:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e26a00700 1 -- 172.21.15.81:0/3657060627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1800b9c0 con 0x7f0e280cb020 2024-09-13T18:49:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e26a00700 1 -- 172.21.15.81:0/3657060627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800bd70 con 0x7f0e280cb020 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 -- 172.21.15.81:0/3657060627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e280cb020 msgr2=0x7f0e280cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e280cb020 0x7f0e280cc6f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009e50 tx=0x7f0e1800b330 comp rx=0 tx=0).stop 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 -- 172.21.15.81:0/3657060627 shutdown_connections 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2806aaa0 0x7f0e2806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 --2- 172.21.15.81:0/3657060627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e280cb020 0x7f0e280cc6f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 -- 172.21.15.81:0/3657060627 >> 172.21.15.81:0/3657060627 conn(0x7f0e280b0c40 msgr2=0x7f0e2806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 -- 172.21.15.81:0/3657060627 shutdown_connections 2024-09-13T18:49:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 -- 172.21.15.81:0/3657060627 wait complete. 2024-09-13T18:49:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 Processor -- start 2024-09-13T18:49:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.527+0000 7f0e2d000700 1 -- start start 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 0x7f0e2813b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e280cb020 0x7f0e2814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2815c2a0 0x7f0e2813afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2814d910 con 0x7f0e2806aaa0 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2813be70 con 0x7f0e280cb020 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2814db60 con 0x7f0e2815c2a0 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 0x7f0e2813b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 0x7f0e2813b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49370/0 (socket says 172.21.15.81:49370) 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 -- 172.21.15.81:0/2853327050 learned_addr learned my addr 172.21.15.81:0/2853327050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 -- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2815c2a0 msgr2=0x7f0e2813afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2815c2a0 0x7f0e2813afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e1ea00700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e280cb020 0x7f0e2814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 -- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e280cb020 msgr2=0x7f0e2814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e280cb020 0x7f0e2814f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 -- 172.21.15.81:0/2853327050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18009b30 con 0x7f0e2806aaa0 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e1ea00700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e280cb020 0x7f0e2814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:50.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e27400700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 0x7f0e2813b930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800b370 tx=0x7f0e18004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180099b0 con 0x7f0e2806aaa0 2024-09-13T18:49:50.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180092e0 con 0x7f0e2806aaa0 2024-09-13T18:49:50.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2814de40 con 0x7f0e2806aaa0 2024-09-13T18:49:50.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1801c640 con 0x7f0e2806aaa0 2024-09-13T18:49:50.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2814e400 con 0x7f0e2806aaa0 2024-09-13T18:49:50.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.531+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2814e620 con 0x7f0e2806aaa0 2024-09-13T18:49:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.535+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e1801c7a0 con 0x7f0e2806aaa0 2024-09-13T18:49:50.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.535+0000 7f0e1fe00700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e04066730 0x7f0e04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.535+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e18086050 con 0x7f0e2806aaa0 2024-09-13T18:49:50.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.535+0000 7f0e1ea00700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e04066730 0x7f0e04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.539+0000 7f0e1ea00700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e04066730 0x7f0e04068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0e2815b050 tx=0x7f0e10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.543+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e180532f0 con 0x7f0e2806aaa0 2024-09-13T18:49:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.787+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e2806aef0 con 0x7f0e2806aaa0 2024-09-13T18:49:50.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.787+0000 7f0e1fe00700 1 -- 172.21.15.81:0/2853327050 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f0e18056910 con 0x7f0e2806aaa0 2024-09-13T18:49:50.796 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:50.796 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:49:14.436973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5388,"mds_1":5314,"mds_2":5006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5006":{"gid":5006,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e04066730 msgr2=0x7f0e04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e04066730 0x7f0e04068bf0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0e2815b050 tx=0x7f0e10009040 comp rx=0 tx=0).stop 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 msgr2=0x7f0e2813b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 0x7f0e2813b930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800b370 tx=0x7f0e18004af0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 shutdown_connections 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e04066730 0x7f0e04068bf0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e2815c2a0 0x7f0e2813afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e280cb020 0x7f0e2814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 --2- 172.21.15.81:0/2853327050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e2806aaa0 0x7f0e2813b930 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 >> 172.21.15.81:0/2853327050 conn(0x7f0e280b0c40 msgr2=0x7f0e2806cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 shutdown_connections 2024-09-13T18:49:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.791+0000 7f0e2d000700 1 -- 172.21.15.81:0/2853327050 wait complete. 2024-09-13T18:49:50.800 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-13T18:49:50.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:49:50.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.979+0000 7f4ff6e00700 1 Processor -- start 2024-09-13T18:49:50.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6e00700 1 -- start start 2024-09-13T18:49:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 0x7f4ff006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff00b2ad0 con 0x7f4ff015c2a0 2024-09-13T18:49:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff006b450 con 0x7f4ff006aaa0 2024-09-13T18:49:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff015b960 con 0x7f4ff00cb020 2024-09-13T18:49:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 0x7f4ff006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 0x7f4ff006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:47804/0 (socket says 172.21.15.81:47804) 2024-09-13T18:49:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff6400700 1 -- 172.21.15.81:0/2757525365 learned_addr learned my addr 172.21.15.81:0/2757525365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff5a00700 1 --2- 172.21.15.81:0/2757525365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff5a00700 1 -- 172.21.15.81:0/2757525365 >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 msgr2=0x7f4ff006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff5a00700 1 --2- 172.21.15.81:0/2757525365 >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 0x7f4ff006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.983+0000 7f4ff5a00700 1 -- 172.21.15.81:0/2757525365 >> v1:172.21.15.178:6789/0 conn(0x7f4ff015c2a0 legacy=0x7f4ff015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff5a00700 1 -- 172.21.15.81:0/2757525365 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff015bc40 con 0x7f4ff00cb020 2024-09-13T18:49:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6400700 1 --2- 172.21.15.81:0/2757525365 >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 0x7f4ff006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:49:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff5a00700 1 --2- 172.21.15.81:0/2757525365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff00cc6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009850 tx=0x7f4fe4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c29c116a1ecd07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4fefe00700 1 -- 172.21.15.81:0/2757525365 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4011830 con 0x7f4ff00cb020 2024-09-13T18:49:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4fefe00700 1 -- 172.21.15.81:0/2757525365 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe4011990 con 0x7f4ff00cb020 2024-09-13T18:49:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4fefe00700 1 -- 172.21.15.81:0/2757525365 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4011d40 con 0x7f4ff00cb020 2024-09-13T18:49:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 -- 172.21.15.81:0/2757525365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 msgr2=0x7f4ff00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/2757525365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff00cc6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009850 tx=0x7f4fe4009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 -- 172.21.15.81:0/2757525365 shutdown_connections 2024-09-13T18:49:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/2757525365 >> v2:172.21.15.178:3300/0 conn(0x7f4ff006aaa0 0x7f4ff006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/2757525365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff00cc6f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 -- 172.21.15.81:0/2757525365 >> 172.21.15.81:0/2757525365 conn(0x7f4ff00b0c40 msgr2=0x7f4ff006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 -- 172.21.15.81:0/2757525365 shutdown_connections 2024-09-13T18:49:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.987+0000 7f4ff6e00700 1 -- 172.21.15.81:0/2757525365 wait complete. 2024-09-13T18:49:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 Processor -- start 2024-09-13T18:49:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 -- start start 2024-09-13T18:49:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff006aaa0 0x7f4ff013fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff0141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 0x7f4ff013e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff013d0f0 con 0x7f4ff015c2a0 2024-09-13T18:49:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff013d3d0 con 0x7f4ff006aaa0 2024-09-13T18:49:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff013d6b0 con 0x7f4ff00cb020 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 0x7f4ff013e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff5a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff006aaa0 0x7f4ff013fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff0141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 0x7f4ff013e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49372/0 (socket says 172.21.15.81:49372) 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff5a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff006aaa0 0x7f4ff013fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:47810/0 (socket says 172.21.15.81:47810) 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 -- 172.21.15.81:0/3420005900 learned_addr learned my addr 172.21.15.81:0/3420005900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 -- 172.21.15.81:0/3420005900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 msgr2=0x7f4ff0141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff0141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 -- 172.21.15.81:0/3420005900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff006aaa0 msgr2=0x7f4ff013fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff006aaa0 0x7f4ff013fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.991+0000 7f4ff6400700 1 -- 172.21.15.81:0/3420005900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe8009b30 con 0x7f4ff015c2a0 2024-09-13T18:49:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4ff6400700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 0x7f4ff013e190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800efc0 tx=0x7f4fe800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8018070 con 0x7f4ff015c2a0 2024-09-13T18:49:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe800f040 con 0x7f4ff015c2a0 2024-09-13T18:49:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8003c40 con 0x7f4ff015c2a0 2024-09-13T18:49:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe40094b0 con 0x7f4ff015c2a0 2024-09-13T18:49:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff013dc70 con 0x7f4ff015c2a0 2024-09-13T18:49:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.995+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff006af10 con 0x7f4ff015c2a0 2024-09-13T18:49:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.999+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4fe800c880 con 0x7f4ff015c2a0 2024-09-13T18:49:51.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.999+0000 7f4fed600700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.999+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4fe8084360 con 0x7f4ff015c2a0 2024-09-13T18:49:51.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.999+0000 7f4ff5a00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:50.999+0000 7f4ff5a00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40090b0 tx=0x7f4fe4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.007+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4fe8051600 con 0x7f4ff015c2a0 2024-09-13T18:49:51.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.199+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ff0140090 con 0x7f4ff015c2a0 2024-09-13T18:49:51.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.199+0000 7f4fed600700 1 -- 172.21.15.81:0/3420005900 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16823 (secure 0 0 0) 0x7f4fe8054c20 con 0x7f4ff015c2a0 2024-09-13T18:49:51.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:51.210 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:58.351327+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 msgr2=0x7f4fd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40090b0 tx=0x7f4fe4008030 comp rx=0 tx=0).stop 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 msgr2=0x7f4ff013e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 0x7f4ff013e190 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800efc0 tx=0x7f4fe800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 shutdown_connections 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4fd0066760 0x7f4fd0068c20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ff015c2a0 0x7f4ff013e190 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ff00cb020 0x7f4ff0141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 --2- 172.21.15.81:0/3420005900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ff006aaa0 0x7f4ff013fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 >> 172.21.15.81:0/3420005900 conn(0x7f4ff00b0c40 msgr2=0x7f4ff015db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 shutdown_connections 2024-09-13T18:49:51.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.203+0000 7f4ff6e00700 1 -- 172.21.15.81:0/3420005900 wait complete. 2024-09-13T18:49:51.236 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:49:51.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.395+0000 7f856e400700 1 Processor -- start 2024-09-13T18:49:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.395+0000 7f856e400700 1 -- start start 2024-09-13T18:49:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f856e400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f856815b700 0x7f856815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f856e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806a5d0 0x7f856806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f856e400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85680cdd90 con 0x7f856806c460 2024-09-13T18:49:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f856e400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856806afa0 con 0x7f856815b700 2024-09-13T18:49:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f856e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856806ce10 con 0x7f856806a5d0 2024-09-13T18:49:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8566a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f856806c460 0x7f856806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56154/0 (socket says 172.21.15.81:56154) 2024-09-13T18:49:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8566a00700 1 -- 172.21.15.81:0/425609738 learned_addr learned my addr 172.21.15.81:0/425609738 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8567400700 1 --2- 172.21.15.81:0/425609738 >> v2:172.21.15.178:3300/0 conn(0x7f856815b700 0x7f856815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8567e00700 1 --2- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806a5d0 0x7f856806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8566000700 1 -- 172.21.15.81:0/425609738 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422765712 0 0) 0x7f85680cdd90 con 0x7f856806c460 2024-09-13T18:49:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8566000700 1 -- 172.21.15.81:0/425609738 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f854c0035d0 con 0x7f856806c460 2024-09-13T18:49:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8567400700 1 -- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806a5d0 msgr2=0x7f856806aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8567400700 1 --2- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806a5d0 0x7f856806aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8567400700 1 -- 172.21.15.81:0/425609738 >> v1:172.21.15.81:6789/0 conn(0x7f856806c460 legacy=0x7f856806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.399+0000 7f8567400700 1 -- 172.21.15.81:0/425609738 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856815c020 con 0x7f856815b700 2024-09-13T18:49:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f8567400700 1 --2- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856815bae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8558009850 tx=0x7f8558009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e6ad3a09561d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f8566000700 1 -- 172.21.15.81:0/425609738 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558011830 con 0x7f856815b700 2024-09-13T18:49:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f8566000700 1 -- 172.21.15.81:0/425609738 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558011990 con 0x7f856815b700 2024-09-13T18:49:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f8566000700 1 -- 172.21.15.81:0/425609738 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558011d40 con 0x7f856815b700 2024-09-13T18:49:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 -- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 msgr2=0x7f856815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 --2- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856815bae0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8558009850 tx=0x7f8558009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 -- 172.21.15.81:0/425609738 shutdown_connections 2024-09-13T18:49:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 --2- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806a5d0 0x7f856806aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 --2- 172.21.15.81:0/425609738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856815bae0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 -- 172.21.15.81:0/425609738 >> 172.21.15.81:0/425609738 conn(0x7f85680b08d0 msgr2=0x7f85680b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 -- 172.21.15.81:0/425609738 shutdown_connections 2024-09-13T18:49:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.403+0000 7f856e400700 1 -- 172.21.15.81:0/425609738 wait complete. 2024-09-13T18:49:51.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 Processor -- start 2024-09-13T18:49:51.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 -- start start 2024-09-13T18:49:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 0x7f856814ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806c460 0x7f8568158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856814e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8568152b00 con 0x7f856806a5d0 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856814f240 con 0x7f856815b700 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8568152d50 con 0x7f856806c460 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 0x7f856814ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 0x7f856814ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49376/0 (socket says 172.21.15.81:49376) 2024-09-13T18:49:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 -- 172.21.15.81:0/3505464621 learned_addr learned my addr 172.21.15.81:0/3505464621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567e00700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856814e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8566a00700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806c460 0x7f8568158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 -- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806c460 msgr2=0x7f8568158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806c460 0x7f8568158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 -- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 msgr2=0x7f856814e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856814e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 -- 172.21.15.81:0/3505464621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580094b0 con 0x7f856806a5d0 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8566a00700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806c460 0x7f8568158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567e00700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f8567400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 0x7f856814ead0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8558014040 tx=0x7f8558004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580036c0 con 0x7f856806a5d0 2024-09-13T18:49:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855801e070 con 0x7f856806a5d0 2024-09-13T18:49:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8568153030 con 0x7f856806a5d0 2024-09-13T18:49:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8558003a80 con 0x7f856806a5d0 2024-09-13T18:49:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.407+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85681f64f0 con 0x7f856806a5d0 2024-09-13T18:49:51.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.411+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85681f6710 con 0x7f856806a5d0 2024-09-13T18:49:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.411+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8558003be0 con 0x7f856806a5d0 2024-09-13T18:49:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.415+0000 7f855f400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8548066760 0x7f8548068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.415+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8558020070 con 0x7f856806a5d0 2024-09-13T18:49:51.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.415+0000 7f8566a00700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8548066760 0x7f8548068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.415+0000 7f8566a00700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8548066760 0x7f8548068c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f856806dd80 tx=0x7f8554009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.419+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8558052910 con 0x7f856806a5d0 2024-09-13T18:49:51.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.651+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f856806aa60 con 0x7f856806a5d0 2024-09-13T18:49:51.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.651+0000 7f855f400700 1 -- 172.21.15.81:0/3505464621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f8558083e60 con 0x7f856806a5d0 2024-09-13T18:49:51.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:51.661 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:49:14.436973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5388,"mds_1":5314,"mds_2":5006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5006":{"gid":5006,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:49:51.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8548066760 msgr2=0x7f8548068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8548066760 0x7f8548068c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f856806dd80 tx=0x7f8554009040 comp rx=0 tx=0).stop 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 msgr2=0x7f856814ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 0x7f856814ead0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8558014040 tx=0x7f8558004770 comp rx=0 tx=0).stop 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 shutdown_connections 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8548066760 0x7f8548068c20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f856815b700 0x7f856814e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f856806c460 0x7f8568158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 --2- 172.21.15.81:0/3505464621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f856806a5d0 0x7f856814ead0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 >> 172.21.15.81:0/3505464621 conn(0x7f85680b08d0 msgr2=0x7f856806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 shutdown_connections 2024-09-13T18:49:51.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.655+0000 7f856e400700 1 -- 172.21.15.81:0/3505464621 wait complete. 2024-09-13T18:49:51.667 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-13T18:49:51.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 Processor -- start 2024-09-13T18:49:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 -- start start 2024-09-13T18:49:51.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c0cb020 0x7f021c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f021c15c2a0 0x7f021c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f021c06aaa0 0x7f021c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c06b450 con 0x7f021c06aaa0 2024-09-13T18:49:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0b2ad0 con 0x7f021c15c2a0 2024-09-13T18:49:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.843+0000 7f0223000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c15b960 con 0x7f021c0cb020 2024-09-13T18:49:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f021c06aaa0 0x7f021c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f021c06aaa0 0x7f021c06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49382/0 (socket says 172.21.15.81:49382) 2024-09-13T18:49:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 -- 172.21.15.81:0/3864024896 learned_addr learned my addr 172.21.15.81:0/3864024896 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0221200700 1 --2- 172.21.15.81:0/3864024896 >> v2:172.21.15.178:3300/0 conn(0x7f021c15c2a0 0x7f021c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0221c00700 1 --2- 172.21.15.81:0/3864024896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c0cb020 0x7f021c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 -- 172.21.15.81:0/3864024896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c0cb020 msgr2=0x7f021c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 --2- 172.21.15.81:0/3864024896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c0cb020 0x7f021c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 -- 172.21.15.81:0/3864024896 >> v2:172.21.15.178:3300/0 conn(0x7f021c15c2a0 msgr2=0x7f021c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 --2- 172.21.15.81:0/3864024896 >> v2:172.21.15.178:3300/0 conn(0x7f021c15c2a0 0x7f021c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 -- 172.21.15.81:0/3864024896 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c15bc40 con 0x7f021c06aaa0 2024-09-13T18:49:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0222600700 1 --2- 172.21.15.81:0/3864024896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c06af10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f021c072180 tx=0x7f0214009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a33b3cd07f649f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f021be00700 1 -- 172.21.15.81:0/3864024896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214011830 con 0x7f021c06aaa0 2024-09-13T18:49:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f021be00700 1 -- 172.21.15.81:0/3864024896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214011990 con 0x7f021c06aaa0 2024-09-13T18:49:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f021be00700 1 -- 172.21.15.81:0/3864024896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214011d20 con 0x7f021c06aaa0 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 -- 172.21.15.81:0/3864024896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 msgr2=0x7f021c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 --2- 172.21.15.81:0/3864024896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c06af10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f021c072180 tx=0x7f0214009bf0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 -- 172.21.15.81:0/3864024896 shutdown_connections 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 --2- 172.21.15.81:0/3864024896 >> v2:172.21.15.178:3300/0 conn(0x7f021c15c2a0 0x7f021c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 --2- 172.21.15.81:0/3864024896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c06af10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 --2- 172.21.15.81:0/3864024896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c0cb020 0x7f021c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 -- 172.21.15.81:0/3864024896 >> 172.21.15.81:0/3864024896 conn(0x7f021c0b0c40 msgr2=0x7f021c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:51.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 -- 172.21.15.81:0/3864024896 shutdown_connections 2024-09-13T18:49:51.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.847+0000 7f0223000700 1 -- 172.21.15.81:0/3864024896 wait complete. 2024-09-13T18:49:51.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 Processor -- start 2024-09-13T18:49:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 -- start start 2024-09-13T18:49:51.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c0cb020 0x7f021c1f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c15c2a0 0x7f021c0c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c9a70 con 0x7f021c06aaa0 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c8df0 con 0x7f021c0cb020 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0223000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0c90d0 con 0x7f021c15c2a0 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0221c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0221c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c0c3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49392/0 (socket says 172.21.15.81:49392) 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0221c00700 1 -- 172.21.15.81:0/3150073291 learned_addr learned my addr 172.21.15.81:0/3150073291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:51.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.851+0000 7f0221200700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c0cb020 0x7f021c1f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0222600700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c15c2a0 0x7f021c0c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0221c00700 1 -- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c15c2a0 msgr2=0x7f021c0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0221c00700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c15c2a0 0x7f021c0c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0221c00700 1 -- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c0cb020 msgr2=0x7f021c1f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0221c00700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c0cb020 0x7f021c1f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0221c00700 1 -- 172.21.15.81:0/3150073291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214009570 con 0x7f021c06aaa0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0221c00700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c0c3ec0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0210007e60 tx=0x7f021000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000ed30 con 0x7f021c06aaa0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000ee90 con 0x7f021c06aaa0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210014660 con 0x7f021c06aaa0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0c93b0 con 0x7f021c06aaa0 2024-09-13T18:49:51.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c1f4800 con 0x7f021c06aaa0 2024-09-13T18:49:51.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.855+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c15c6c0 con 0x7f021c06aaa0 2024-09-13T18:49:51.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.859+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02100147c0 con 0x7f021c06aaa0 2024-09-13T18:49:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.859+0000 7f0219600700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01fc066730 0x7f01fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.859+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02100849b0 con 0x7f021c06aaa0 2024-09-13T18:49:51.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.859+0000 7f0221200700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01fc066730 0x7f01fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:51.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.859+0000 7f0221200700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01fc066730 0x7f01fc068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f021c144670 tx=0x7f0208009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:51.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:51.867+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0210051b20 con 0x7f021c06aaa0 2024-09-13T18:49:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.099+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f021c0c9ce0 con 0x7f021c06aaa0 2024-09-13T18:49:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.099+0000 7f0219600700 1 -- 172.21.15.81:0/3150073291 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f0210055140 con 0x7f021c06aaa0 2024-09-13T18:49:52.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:52.109 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:48:42.242082+0000","modified":"2024-09-13T18:49:14.436973+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5388,"mds_1":5314,"mds_2":5006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5006":{"gid":5006,"name":"d","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/628924969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":628924969},{"type":"v1","addr":"172.21.15.178:6835","nonce":628924969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5314":{"gid":5314,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6837/3633246084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3633246084},{"type":"v1","addr":"172.21.15.81:6837","nonce":3633246084}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5388":{"gid":5388,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.81:6836/2473824789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2473824789},{"type":"v1","addr":"172.21.15.81:6836","nonce":2473824789}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:49:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01fc066730 msgr2=0x7f01fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01fc066730 0x7f01fc068bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f021c144670 tx=0x7f0208009240 comp rx=0 tx=0).stop 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 msgr2=0x7f021c0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c0c3ec0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0210007e60 tx=0x7f021000e3c0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 shutdown_connections 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01fc066730 0x7f01fc068bf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f021c15c2a0 0x7f021c0c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f021c0cb020 0x7f021c1f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 --2- 172.21.15.81:0/3150073291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f021c06aaa0 0x7f021c0c3ec0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 >> 172.21.15.81:0/3150073291 conn(0x7f021c0b0c40 msgr2=0x7f021c15dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 shutdown_connections 2024-09-13T18:49:52.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.103+0000 7f0223000700 1 -- 172.21.15.81:0/3150073291 wait complete. 2024-09-13T18:49:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-13T18:49:52.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:49:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.287+0000 7fa93da00700 1 Processor -- start 2024-09-13T18:49:52.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.287+0000 7fa93da00700 1 -- start start 2024-09-13T18:49:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93da00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9380667a0 0x7fa938161220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93da00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa93806b870 0x7fa93806a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93da00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9380ac890 con 0x7fa93815cc50 2024-09-13T18:49:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93da00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa938161800 con 0x7fa93806b870 2024-09-13T18:49:52.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93da00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93806bd20 con 0x7fa9380667a0 2024-09-13T18:49:52.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa93806b870 0x7fa93806a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa937e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa93815cc50 0x7fa938066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56160/0 (socket says 172.21.15.81:56160) 2024-09-13T18:49:52.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa937e00700 1 -- 172.21.15.81:0/2871660974 learned_addr learned my addr 172.21.15.81:0/2871660974 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:52.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa92f400700 1 --2- 172.21.15.81:0/2871660974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9380667a0 0x7fa938161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93d000700 1 -- 172.21.15.81:0/2871660974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9380667a0 msgr2=0x7fa938161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93d000700 1 --2- 172.21.15.81:0/2871660974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9380667a0 0x7fa938161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93d000700 1 -- 172.21.15.81:0/2871660974 >> v1:172.21.15.81:6789/0 conn(0x7fa93815cc50 legacy=0x7fa938066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93d000700 1 -- 172.21.15.81:0/2871660974 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9380af2a0 con 0x7fa93806b870 2024-09-13T18:49:52.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa937400700 1 -- 172.21.15.81:0/2871660974 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150593421 0 0) 0x7fa9380ac890 con 0x7fa93815cc50 2024-09-13T18:49:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.291+0000 7fa93d000700 1 --2- 172.21.15.81:0/2871660974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93806b870 0x7fa93806a390 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa930009850 tx=0x7fa930009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bbac5a657488d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa937400700 1 -- 172.21.15.81:0/2871660974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011830 con 0x7fa93806b870 2024-09-13T18:49:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa937400700 1 -- 172.21.15.81:0/2871660974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930011990 con 0x7fa93806b870 2024-09-13T18:49:52.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa937400700 1 -- 172.21.15.81:0/2871660974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011d40 con 0x7fa93806b870 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 -- 172.21.15.81:0/2871660974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93806b870 msgr2=0x7fa93806a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 --2- 172.21.15.81:0/2871660974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93806b870 0x7fa93806a390 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa930009850 tx=0x7fa930009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 -- 172.21.15.81:0/2871660974 shutdown_connections 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 --2- 172.21.15.81:0/2871660974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93806b870 0x7fa93806a390 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 --2- 172.21.15.81:0/2871660974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9380667a0 0x7fa938161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 -- 172.21.15.81:0/2871660974 >> 172.21.15.81:0/2871660974 conn(0x7fa93806ca10 msgr2=0x7fa93806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 -- 172.21.15.81:0/2871660974 shutdown_connections 2024-09-13T18:49:52.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.295+0000 7fa93da00700 1 -- 172.21.15.81:0/2871660974 wait complete. 2024-09-13T18:49:52.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 Processor -- start 2024-09-13T18:49:52.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 -- start start 2024-09-13T18:49:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9380667a0 0x7fa938150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93806b870 0x7fa9381556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 0x7fa9381e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938155bf0 con 0x7fa93815cc50 2024-09-13T18:49:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9381e6b90 con 0x7fa9380667a0 2024-09-13T18:49:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93da00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9381e6dc0 con 0x7fa93806b870 2024-09-13T18:49:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 0x7fa9381e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 0x7fa9381e6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49412/0 (socket says 172.21.15.81:49412) 2024-09-13T18:49:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa93d000700 1 -- 172.21.15.81:0/2635729029 learned_addr learned my addr 172.21.15.81:0/2635729029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa937e00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9380667a0 0x7fa938150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.299+0000 7fa92f400700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93806b870 0x7fa9381556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93d000700 1 -- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93806b870 msgr2=0x7fa9381556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93d000700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93806b870 0x7fa9381556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93d000700 1 -- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9380667a0 msgr2=0x7fa938150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93d000700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9380667a0 0x7fa938150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93d000700 1 -- 172.21.15.81:0/2635729029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9300094b0 con 0x7fa93815cc50 2024-09-13T18:49:52.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa937e00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9380667a0 0x7fa938150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93d000700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 0x7fa9381e6650 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa9380cf900 tx=0x7fa930004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9300045d0 con 0x7fa93815cc50 2024-09-13T18:49:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93001f070 con 0x7fa93815cc50 2024-09-13T18:49:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9381e70a0 con 0x7fa93815cc50 2024-09-13T18:49:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930003900 con 0x7fa93815cc50 2024-09-13T18:49:52.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9381e7660 con 0x7fa93815cc50 2024-09-13T18:49:52.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.303+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93815d030 con 0x7fa93815cc50 2024-09-13T18:49:52.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.307+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa930003a60 con 0x7fa93815cc50 2024-09-13T18:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.307+0000 7fa934c00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa914066730 0x7fa914068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.307+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa930021070 con 0x7fa93815cc50 2024-09-13T18:49:52.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.311+0000 7fa937e00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa914066730 0x7fa914068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.311+0000 7fa937e00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa914066730 0x7fa914068bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa928000f60 tx=0x7fa928007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.315+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa930052d10 con 0x7fa93815cc50 2024-09-13T18:49:52.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.499+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa938160610 con 0x7fa93815cc50 2024-09-13T18:49:52.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.503+0000 7fa934c00700 1 -- 172.21.15.81:0/2635729029 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16823 (secure 0 0 0) 0x7fa930015020 con 0x7fa93815cc50 2024-09-13T18:49:52.513 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:52.513 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":41,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:48:58.351327+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:48:40.047375+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-13T18:48:41.257293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa914066730 msgr2=0x7fa914068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa914066730 0x7fa914068bf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa928000f60 tx=0x7fa928007d50 comp rx=0 tx=0).stop 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 msgr2=0x7fa9381e6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 0x7fa9381e6650 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa9380cf900 tx=0x7fa930004770 comp rx=0 tx=0).stop 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 shutdown_connections 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa914066730 0x7fa914068bf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa93815cc50 0x7fa9381e6650 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa93806b870 0x7fa9381556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 --2- 172.21.15.81:0/2635729029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9380667a0 0x7fa938150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 >> 172.21.15.81:0/2635729029 conn(0x7fa93806ca10 msgr2=0x7fa93806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:52.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 shutdown_connections 2024-09-13T18:49:52.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.507+0000 7fa93da00700 1 -- 172.21.15.81:0/2635729029 wait complete. 2024-09-13T18:49:52.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:49:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.699+0000 7fb299800700 1 Processor -- start 2024-09-13T18:49:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.699+0000 7fb299800700 1 -- start start 2024-09-13T18:49:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb299800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb29415e070 0x7fb2940cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb299800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2940cd970 con 0x7fb2940d10f0 2024-09-13T18:49:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb299800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29415e450 con 0x7fb2940b2c50 2024-09-13T18:49:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb299800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2940d0050 con 0x7fb29415e070 2024-09-13T18:49:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb29415e070 0x7fb2940cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2940d10f0 0x7fb2940b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56172/0 (socket says 172.21.15.81:56172) 2024-09-13T18:49:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293400700 1 -- 172.21.15.81:0/3582137523 learned_addr learned my addr 172.21.15.81:0/3582137523 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293e00700 1 -- 172.21.15.81:0/3582137523 >> v1:172.21.15.178:6789/0 conn(0x7fb2940b2c50 legacy=0x7fb2940b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293e00700 1 -- 172.21.15.81:0/3582137523 >> v1:172.21.15.81:6789/0 conn(0x7fb2940d10f0 legacy=0x7fb2940b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293e00700 1 -- 172.21.15.81:0/3582137523 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940d0330 con 0x7fb29415e070 2024-09-13T18:49:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb293e00700 1 --2- 172.21.15.81:0/3582137523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29415e070 0x7fb2940cd430 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb284009850 tx=0x7fb284009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e9f0e6a3e64ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb292a00700 1 -- 172.21.15.81:0/3582137523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284011830 con 0x7fb29415e070 2024-09-13T18:49:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb292a00700 1 -- 172.21.15.81:0/3582137523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284011990 con 0x7fb29415e070 2024-09-13T18:49:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb292a00700 1 -- 172.21.15.81:0/3582137523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284011d20 con 0x7fb29415e070 2024-09-13T18:49:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb299800700 1 -- 172.21.15.81:0/3582137523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29415e070 msgr2=0x7fb2940cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.703+0000 7fb299800700 1 --2- 172.21.15.81:0/3582137523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29415e070 0x7fb2940cd430 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb284009850 tx=0x7fb284009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 -- 172.21.15.81:0/3582137523 shutdown_connections 2024-09-13T18:49:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 --2- 172.21.15.81:0/3582137523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29415e070 0x7fb2940cd430 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 -- 172.21.15.81:0/3582137523 >> 172.21.15.81:0/3582137523 conn(0x7fb294071f00 msgr2=0x7fb2940722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 -- 172.21.15.81:0/3582137523 shutdown_connections 2024-09-13T18:49:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 -- 172.21.15.81:0/3582137523 wait complete. 2024-09-13T18:49:52.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 Processor -- start 2024-09-13T18:49:52.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.707+0000 7fb299800700 1 -- start start 2024-09-13T18:49:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 0x7fb294155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940d10f0 0x7fb2940b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29415e070 0x7fb2940b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2941564e0 con 0x7fb2940b2c50 2024-09-13T18:49:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29406a390 con 0x7fb29415e070 2024-09-13T18:49:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2940ad750 con 0x7fb2940d10f0 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 0x7fb294155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 0x7fb294155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49430/0 (socket says 172.21.15.81:49430) 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 -- 172.21.15.81:0/2557463963 learned_addr learned my addr 172.21.15.81:0/2557463963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293400700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940d10f0 0x7fb2940b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb298e00700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29415e070 0x7fb2940b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 -- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940d10f0 msgr2=0x7fb2940b6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940d10f0 0x7fb2940b6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 -- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29415e070 msgr2=0x7fb2940b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29415e070 0x7fb2940b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 -- 172.21.15.81:0/2557463963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840094b0 con 0x7fb2940b2c50 2024-09-13T18:49:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb298e00700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29415e070 0x7fb2940b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb293e00700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 0x7fb294155fa0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb2940cc540 tx=0x7fb284004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2840038c0 con 0x7fb2940b2c50 2024-09-13T18:49:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb284003a20 con 0x7fb2940b2c50 2024-09-13T18:49:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284003dd0 con 0x7fb2940b2c50 2024-09-13T18:49:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2940b6860 con 0x7fb2940b2c50 2024-09-13T18:49:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.711+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2940aec70 con 0x7fb2940b2c50 2024-09-13T18:49:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.715+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29406a500 con 0x7fb2940b2c50 2024-09-13T18:49:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.715+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb28401a430 con 0x7fb2940b2c50 2024-09-13T18:49:52.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.715+0000 7fb28be00700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb274066730 0x7fb274068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.715+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb284021030 con 0x7fb2940b2c50 2024-09-13T18:49:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.719+0000 7fb293400700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb274066730 0x7fb274068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.719+0000 7fb293400700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb274066730 0x7fb274068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb29406c570 tx=0x7fb280009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.723+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb284052e60 con 0x7fb2940b2c50 2024-09-13T18:49:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.939+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb2940afdc0 con 0x7fb2940b2c50 2024-09-13T18:49:52.949 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:49:52.939+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:49:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.955+0000 7fb28be00700 1 -- 172.21.15.81:0/2557463963 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb28402b090 con 0x7fb2940b2c50 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb274066730 msgr2=0x7fb274068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb274066730 0x7fb274068bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb29406c570 tx=0x7fb280009040 comp rx=0 tx=0).stop 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 msgr2=0x7fb294155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 0x7fb294155fa0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fb2940cc540 tx=0x7fb284004770 comp rx=0 tx=0).stop 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 shutdown_connections 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb274066730 0x7fb274068bf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb29415e070 0x7fb2940b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2940d10f0 0x7fb2940b6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 --2- 172.21.15.81:0/2557463963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2940b2c50 0x7fb294155fa0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 >> 172.21.15.81:0/2557463963 conn(0x7fb294071f00 msgr2=0x7fb2940ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 shutdown_connections 2024-09-13T18:49:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:52.959+0000 7fb299800700 1 -- 172.21.15.81:0/2557463963 wait complete. 2024-09-13T18:49:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:49:52.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:49:53.032 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:49:53.033 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:49:53.040 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:49:53.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.151+0000 7f8eb7e00700 1 Processor -- start 2024-09-13T18:49:53.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.151+0000 7f8eb7e00700 1 -- start start 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 0x7f8eb806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb80b1980 con 0x7f8eb806cea0 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb80b2500 con 0x7f8eb8143b70 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb806d2f0 con 0x7f8eb806d620 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8eb806cea0 0x7f8eb80b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56200/0 (socket says 172.21.15.81:56200) 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 -- 172.21.15.81:0/1940516015 learned_addr learned my addr 172.21.15.81:0/1940516015 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:53.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb6000700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 0x7f8eb806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396807214 0 0) 0x7f8eb80b1980 con 0x7f8eb806cea0 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e9c0035d0 con 0x7f8eb806cea0 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103803976 0 0) 0x7f8e9c0035d0 con 0x7f8eb806cea0 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 msgr2=0x7f8eb806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 0x7f8eb806c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 >> v1:172.21.15.178:6789/0 conn(0x7f8eb8143b70 legacy=0x7f8eb80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80b1bd0 con 0x7f8eb806cea0 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f8eb00019f0 con 0x7f8eb806cea0 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 >> v1:172.21.15.81:6789/0 conn(0x7f8eb806cea0 legacy=0x7f8eb80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c003a50 0x7f8e9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 0x7f8e9c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8e9c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb806d2f0 con 0x7f8e9c004db0 2024-09-13T18:49:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c00ba60 con 0x7f8e9c003a50 2024-09-13T18:49:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c00bc20 con 0x7f8eb806d620 2024-09-13T18:49:53.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8e9c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb6a00700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c003a50 0x7f8e9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 -- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 msgr2=0x7f8e9c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb806d620 0x7f8e9c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 -- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c003a50 msgr2=0x7f8e9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c003a50 0x7f8e9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 -- 172.21.15.81:0/1940516015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0035d0 con 0x7f8e9c004db0 2024-09-13T18:49:53.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.155+0000 7f8eb7400700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8e9c005230 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000a7d0 tx=0x7f8e9c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732456a960db87d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb00072d0 con 0x7f8e9c004db0 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb000ae90 con 0x7f8e9c004db0 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb5600700 1 -- 172.21.15.81:0/1940516015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0007670 con 0x7f8e9c004db0 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 -- 172.21.15.81:0/1940516015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 msgr2=0x7f8e9c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/1940516015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8e9c005230 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000a7d0 tx=0x7f8e9c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7400700 1 -- 172.21.15.81:0/1940516015 reap_dead start 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 -- 172.21.15.81:0/1940516015 shutdown_connections 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 -- 172.21.15.81:0/1940516015 >> 172.21.15.81:0/1940516015 conn(0x7f8eb806a390 msgr2=0x7f8eb806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 -- 172.21.15.81:0/1940516015 shutdown_connections 2024-09-13T18:49:53.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 -- 172.21.15.81:0/1940516015 wait complete. 2024-09-13T18:49:53.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 Processor -- start 2024-09-13T18:49:53.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.159+0000 7f8eb7e00700 1 -- start start 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8eb813f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8eb813f120 0x7f8eb813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb8142340 0x7f8eb81427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb813e980 con 0x7f8e9c004db0 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8142d00 con 0x7f8eb813f120 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb8157340 con 0x7f8eb8142340 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8eb813f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8eb813f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49466/0 (socket says 172.21.15.81:49466) 2024-09-13T18:49:53.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 -- 172.21.15.81:0/440373744 learned_addr learned my addr 172.21.15.81:0/440373744 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6000700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8eb813f120 0x7f8eb813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7400700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb8142340 0x7f8eb81427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 -- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb8142340 msgr2=0x7f8eb81427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb8142340 0x7f8eb81427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 -- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8eb813f120 msgr2=0x7f8eb813e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8eb813f120 0x7f8eb813e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 -- 172.21.15.81:0/440373744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8156eb0 con 0x7f8e9c004db0 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7400700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb8142340 0x7f8eb81427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb6a00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8eb813f590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800e830 tx=0x7f8ea800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:53.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea80052e0 con 0x7f8e9c004db0 2024-09-13T18:49:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea8005440 con 0x7f8e9c004db0 2024-09-13T18:49:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb815a430 con 0x7f8e9c004db0 2024-09-13T18:49:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea80038e0 con 0x7f8e9c004db0 2024-09-13T18:49:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.163+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb8156860 con 0x7f8e9c004db0 2024-09-13T18:49:53.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.167+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb81566c0 con 0x7f8e9c004db0 2024-09-13T18:49:53.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.167+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ea8003a40 con 0x7f8e9c004db0 2024-09-13T18:49:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.167+0000 7f8eaea00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e98066730 0x7f8e98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.171+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f8ea8083c60 con 0x7f8e9c004db0 2024-09-13T18:49:53.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.171+0000 7f8eb6000700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e98066730 0x7f8e98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:53.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.171+0000 7f8eb6000700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e98066730 0x7f8e98068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8142ff0 tx=0x7f8ea40093b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:53.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.175+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8eb81566c0 con 0x7f8e9c004db0 2024-09-13T18:49:53.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.387+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8eb81566c0 con 0x7f8e9c004db0 2024-09-13T18:49:53.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.967+0000 7f8eaea00700 1 -- 172.21.15.81:0/440373744 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8eb81566c0 con 0x7f8e9c004db0 2024-09-13T18:49:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.971+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e98066730 msgr2=0x7f8e98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.971+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e98066730 0x7f8e98068bf0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8142ff0 tx=0x7f8ea40093b0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.971+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 msgr2=0x7f8eb813f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.971+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8eb813f590 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800e830 tx=0x7f8ea800eb40 comp rx=0 tx=0).stop 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 shutdown_connections 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e98066730 0x7f8e98068bf0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8eb8142340 0x7f8eb81427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8eb813f120 0x7f8eb813e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 --2- 172.21.15.81:0/440373744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e9c004db0 0x7f8eb813f590 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 >> 172.21.15.81:0/440373744 conn(0x7f8eb806a390 msgr2=0x7f8eb80b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 shutdown_connections 2024-09-13T18:49:53.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:53.975+0000 7f8eb7e00700 1 -- 172.21.15.81:0/440373744 wait complete. 2024-09-13T18:49:54.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:49:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.219+0000 7fb635400700 1 Processor -- start 2024-09-13T18:49:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.219+0000 7fb635400700 1 -- start start 2024-09-13T18:49:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb635400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6300b4670 0x7fb6300b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb635400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6300b4ab0 con 0x7fb6300b5430 2024-09-13T18:49:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb635400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb630066be0 con 0x7fb63015a6e0 2024-09-13T18:49:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb635400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63015aac0 con 0x7fb6300b4670 2024-09-13T18:49:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62fe00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb63015a6e0 0x7fb630066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:41772/0 (socket says 172.21.15.81:41772) 2024-09-13T18:49:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62fe00700 1 -- 172.21.15.81:0/2877200709 learned_addr learned my addr 172.21.15.81:0/2877200709 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb634a00700 1 --1- 172.21.15.81:0/2877200709 >> v1:172.21.15.81:6789/0 conn(0x7fb6300b5430 0x7fb630070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56212/0 (socket says 172.21.15.81:56212) 2024-09-13T18:49:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62f400700 1 --2- 172.21.15.81:0/2877200709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6300b4670 0x7fb6300b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442401199 0 0) 0x7fb630066be0 con 0x7fb63015a6e0 2024-09-13T18:49:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6140035d0 con 0x7fb63015a6e0 2024-09-13T18:49:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354656768 0 0) 0x7fb6300b4ab0 con 0x7fb6300b5430 2024-09-13T18:49:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb630066be0 con 0x7fb6300b5430 2024-09-13T18:49:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62f400700 1 -- 172.21.15.81:0/2877200709 >> v1:172.21.15.178:6789/0 conn(0x7fb63015a6e0 legacy=0x7fb630066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62f400700 1 -- 172.21.15.81:0/2877200709 >> v1:172.21.15.81:6789/0 conn(0x7fb6300b5430 legacy=0x7fb630070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.223+0000 7fb62f400700 1 -- 172.21.15.81:0/2877200709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300b38b0 con 0x7fb6300b4670 2024-09-13T18:49:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb62f400700 1 --2- 172.21.15.81:0/2877200709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6300b4670 0x7fb6300b4ef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009880 tx=0x7fb61c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6132c4b89358f2c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c011830 con 0x7fb6300b4670 2024-09-13T18:49:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c011990 con 0x7fb6300b4670 2024-09-13T18:49:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb62ea00700 1 -- 172.21.15.81:0/2877200709 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c011d20 con 0x7fb6300b4670 2024-09-13T18:49:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 -- 172.21.15.81:0/2877200709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6300b4670 msgr2=0x7fb6300b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 --2- 172.21.15.81:0/2877200709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6300b4670 0x7fb6300b4ef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009880 tx=0x7fb61c009b90 comp rx=0 tx=0).stop 2024-09-13T18:49:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 -- 172.21.15.81:0/2877200709 shutdown_connections 2024-09-13T18:49:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 --2- 172.21.15.81:0/2877200709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6300b4670 0x7fb6300b4ef0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 -- 172.21.15.81:0/2877200709 >> 172.21.15.81:0/2877200709 conn(0x7fb63006d4b0 msgr2=0x7fb63006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 -- 172.21.15.81:0/2877200709 shutdown_connections 2024-09-13T18:49:54.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.227+0000 7fb635400700 1 -- 172.21.15.81:0/2877200709 wait complete. 2024-09-13T18:49:54.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 Processor -- start 2024-09-13T18:49:54.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 -- start start 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 0x7fb630154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6300b5430 0x7fb63015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63015a6e0 0x7fb63015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63015e4f0 con 0x7fb6300b4670 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301e71c0 con 0x7fb6300b5430 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb635400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6301e65b0 con 0x7fb63015a6e0 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 0x7fb630154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 0x7fb630154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49468/0 (socket says 172.21.15.81:49468) 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 -- 172.21.15.81:0/3696467359 learned_addr learned my addr 172.21.15.81:0/3696467359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:54.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62f400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6300b5430 0x7fb63015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb634a00700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63015a6e0 0x7fb63015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 -- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63015a6e0 msgr2=0x7fb63015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63015a6e0 0x7fb63015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 -- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6300b5430 msgr2=0x7fb63015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6300b5430 0x7fb63015b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 -- 172.21.15.81:0/3696467359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c0094b0 con 0x7fb6300b4670 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.231+0000 7fb62fe00700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 0x7fb630154920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb62000c4d0 tx=0x7fb62000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620005d90 con 0x7fb6300b4670 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6200070d0 con 0x7fb6300b4670 2024-09-13T18:49:54.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620007480 con 0x7fb6300b4670 2024-09-13T18:49:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6301e6890 con 0x7fb6300b4670 2024-09-13T18:49:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6301e6e50 con 0x7fb6300b4670 2024-09-13T18:49:54.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63015df40 con 0x7fb6300b4670 2024-09-13T18:49:54.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.235+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb6200075e0 con 0x7fb6300b4670 2024-09-13T18:49:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.239+0000 7fb627e00700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb610066730 0x7fb610068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.239+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fb620083890 con 0x7fb6300b4670 2024-09-13T18:49:54.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.239+0000 7fb62f400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb610066730 0x7fb610068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:54.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.239+0000 7fb62f400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb610066730 0x7fb610068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009880 tx=0x7fb61c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:54.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.243+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb620050900 con 0x7fb6300b4670 2024-09-13T18:49:54.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.427+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb63015ad30 con 0x7fb6300b4670 2024-09-13T18:49:54.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.979+0000 7fb627e00700 1 -- 172.21.15.81:0/3696467359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb620053f20 con 0x7fb6300b4670 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb610066730 msgr2=0x7fb610068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb610066730 0x7fb610068bf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009880 tx=0x7fb61c01c040 comp rx=0 tx=0).stop 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 msgr2=0x7fb630154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 0x7fb630154920 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb62000c4d0 tx=0x7fb62000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 shutdown_connections 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb610066730 0x7fb610068bf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63015a6e0 0x7fb63015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6300b5430 0x7fb63015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 --2- 172.21.15.81:0/3696467359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6300b4670 0x7fb630154920 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 >> 172.21.15.81:0/3696467359 conn(0x7fb63006d4b0 msgr2=0x7fb63006b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 shutdown_connections 2024-09-13T18:49:54.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:54.987+0000 7fb635400700 1 -- 172.21.15.81:0/3696467359 wait complete. 2024-09-13T18:49:54.997 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:49:55.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:49:55.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.183+0000 7f4c75800700 1 Processor -- start 2024-09-13T18:49:55.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.183+0000 7f4c75800700 1 -- start start 2024-09-13T18:49:55.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.183+0000 7f4c75800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c70160fc0 0x7f4c7006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:55.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.183+0000 7f4c75800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c700b3990 0x7f4c700ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:55.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c75800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7006d000 con 0x7f4c700cf0b0 2024-09-13T18:49:55.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c75800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c700cf4c0 con 0x7f4c70160fc0 2024-09-13T18:49:55.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c75800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7006c3f0 con 0x7f4c700b3990 2024-09-13T18:49:55.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c70160fc0 0x7f4c7006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:55.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4c70160fc0 0x7f4c7006be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49478/0 (socket says 172.21.15.81:49478) 2024-09-13T18:49:55.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 -- 172.21.15.81:0/1012313341 learned_addr learned my addr 172.21.15.81:0/1012313341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:55.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6e000700 1 --2- 172.21.15.81:0/1012313341 >> v2:172.21.15.178:3300/0 conn(0x7f4c700b3990 0x7f4c700ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:55.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 -- 172.21.15.81:0/1012313341 >> v2:172.21.15.178:3300/0 conn(0x7f4c700b3990 msgr2=0x7f4c700ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:55.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 --2- 172.21.15.81:0/1012313341 >> v2:172.21.15.178:3300/0 conn(0x7f4c700b3990 0x7f4c700ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:55.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 -- 172.21.15.81:0/1012313341 >> v1:172.21.15.178:6789/0 conn(0x7f4c700cf0b0 legacy=0x7f4c7006fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:55.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 -- 172.21.15.81:0/1012313341 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7006c6d0 con 0x7f4c70160fc0 2024-09-13T18:49:55.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6ea00700 1 --2- 172.21.15.81:0/1012313341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c70160fc0 0x7f4c7006be10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4c700cb240 tx=0x7f4c60009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf6e8d7b8894995 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:55.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6d600700 1 -- 172.21.15.81:0/1012313341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60011830 con 0x7f4c70160fc0 2024-09-13T18:49:55.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6d600700 1 -- 172.21.15.81:0/1012313341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c60011990 con 0x7f4c70160fc0 2024-09-13T18:49:55.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c6d600700 1 -- 172.21.15.81:0/1012313341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60011d20 con 0x7f4c70160fc0 2024-09-13T18:49:55.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c75800700 1 -- 172.21.15.81:0/1012313341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c70160fc0 msgr2=0x7f4c7006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:55.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.187+0000 7f4c75800700 1 --2- 172.21.15.81:0/1012313341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c70160fc0 0x7f4c7006be10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4c700cb240 tx=0x7f4c60009bf0 comp rx=0 tx=0).stop 2024-09-13T18:49:55.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 -- 172.21.15.81:0/1012313341 shutdown_connections 2024-09-13T18:49:55.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 --2- 172.21.15.81:0/1012313341 >> v2:172.21.15.178:3300/0 conn(0x7f4c700b3990 0x7f4c700ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:55.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 --2- 172.21.15.81:0/1012313341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c70160fc0 0x7f4c7006be10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:55.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 -- 172.21.15.81:0/1012313341 >> 172.21.15.81:0/1012313341 conn(0x7f4c7006a570 msgr2=0x7f4c7006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:55.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 -- 172.21.15.81:0/1012313341 shutdown_connections 2024-09-13T18:49:55.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 -- 172.21.15.81:0/1012313341 wait complete. 2024-09-13T18:49:55.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 Processor -- start 2024-09-13T18:49:55.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.191+0000 7f4c75800700 1 -- start start 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c700b3990 0x7f4c70158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 0x7f4c700cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c70160fc0 0x7f4c7015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7015a640 con 0x7f4c700cf0b0 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7015a8e0 con 0x7f4c700b3990 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7015abc0 con 0x7f4c70160fc0 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 0x7f4c700cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 0x7f4c700cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49494/0 (socket says 172.21.15.81:49494) 2024-09-13T18:49:55.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 -- 172.21.15.81:0/929925324 learned_addr learned my addr 172.21.15.81:0/929925324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:55.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6ea00700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c700b3990 0x7f4c70158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:55.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6f400700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c70160fc0 0x7f4c7015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 -- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c70160fc0 msgr2=0x7f4c7015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c70160fc0 0x7f4c7015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 -- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c700b3990 msgr2=0x7f4c70158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c700b3990 0x7f4c70158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 -- 172.21.15.81:0/929925324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c60009570 con 0x7f4c700cf0b0 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6ea00700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c700b3990 0x7f4c70158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:55.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c6e000700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 0x7f4c700cdb80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00e840 tx=0x7f4c5c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c0095a0 con 0x7f4c700cf0b0 2024-09-13T18:49:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5c00c690 con 0x7f4c700cf0b0 2024-09-13T18:49:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7015aea0 con 0x7f4c700cf0b0 2024-09-13T18:49:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5c00ca00 con 0x7f4c700cf0b0 2024-09-13T18:49:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.195+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c700ce3b0 con 0x7f4c700cf0b0 2024-09-13T18:49:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.199+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c700ceb70 con 0x7f4c700cf0b0 2024-09-13T18:49:55.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.199+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c5c00cb60 con 0x7f4c700cf0b0 2024-09-13T18:49:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.203+0000 7f4c66a00700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4c50066730 0x7f4c50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.203+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f4c5c084290 con 0x7f4c700cf0b0 2024-09-13T18:49:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.203+0000 7f4c6ea00700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4c50066730 0x7f4c50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.203+0000 7f4c6ea00700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4c50066730 0x7f4c50068bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c60000c00 tx=0x7f4c60008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:55.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.207+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c5c0514b0 con 0x7f4c700cf0b0 2024-09-13T18:49:55.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.387+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4c700737f0 con 0x7f4c700cf0b0 2024-09-13T18:49:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.987+0000 7f4c66a00700 1 -- 172.21.15.81:0/929925324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4c5c054ad0 con 0x7f4c700cf0b0 2024-09-13T18:49:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.991+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4c50066730 msgr2=0x7f4c50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.991+0000 7f4c75800700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4c50066730 0x7f4c50068bf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4c60000c00 tx=0x7f4c60008030 comp rx=0 tx=0).stop 2024-09-13T18:49:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.991+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 msgr2=0x7f4c700cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.991+0000 7f4c75800700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 0x7f4c700cdb80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4c5c00e840 tx=0x7f4c5c00ec00 comp rx=0 tx=0).stop 2024-09-13T18:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 shutdown_connections 2024-09-13T18:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4c50066730 0x7f4c50068bf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c70160fc0 0x7f4c7015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c700cf0b0 0x7f4c700cdb80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 --2- 172.21.15.81:0/929925324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c700b3990 0x7f4c70158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 >> 172.21.15.81:0/929925324 conn(0x7f4c7006a570 msgr2=0x7f4c700b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 shutdown_connections 2024-09-13T18:49:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:55.995+0000 7f4c75800700 1 -- 172.21.15.81:0/929925324 wait complete. 2024-09-13T18:49:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:49:56.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:49:56.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.183+0000 7f493fe00700 1 Processor -- start 2024-09-13T18:49:56.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.183+0000 7f493fe00700 1 -- start start 2024-09-13T18:49:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f493806ed70 0x7f493806f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f493815ac10 0x7f49380cf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49380cf6d0 0x7f4938066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493806b610 con 0x7f493806ed70 2024-09-13T18:49:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493806aa40 con 0x7f493815ac10 2024-09-13T18:49:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493806f690 con 0x7f49380cf6d0 2024-09-13T18:49:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f493806ed70 0x7f493806f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f493806ed70 0x7f493806f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49504/0 (socket says 172.21.15.81:49504) 2024-09-13T18:49:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493d400700 1 -- 172.21.15.81:0/2567536432 learned_addr learned my addr 172.21.15.81:0/2567536432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493ca00700 1 --2- 172.21.15.81:0/2567536432 >> v2:172.21.15.178:3300/0 conn(0x7f493815ac10 0x7f49380cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.187+0000 7f493de00700 1 --2- 172.21.15.81:0/2567536432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49380cf6d0 0x7f4938066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493d400700 1 -- 172.21.15.81:0/2567536432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49380cf6d0 msgr2=0x7f4938066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493d400700 1 --2- 172.21.15.81:0/2567536432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49380cf6d0 0x7f4938066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493d400700 1 -- 172.21.15.81:0/2567536432 >> v2:172.21.15.178:3300/0 conn(0x7f493815ac10 msgr2=0x7f49380cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493d400700 1 --2- 172.21.15.81:0/2567536432 >> v2:172.21.15.178:3300/0 conn(0x7f493815ac10 0x7f49380cf190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493d400700 1 -- 172.21.15.81:0/2567536432 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493806ace0 con 0x7f493806ed70 2024-09-13T18:49:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493d400700 1 --2- 172.21.15.81:0/2567536432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493806f150 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f49380b5280 tx=0x7f492c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a962d9ee90238 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f4937e00700 1 -- 172.21.15.81:0/2567536432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011830 con 0x7f493806ed70 2024-09-13T18:49:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f4937e00700 1 -- 172.21.15.81:0/2567536432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c011990 con 0x7f493806ed70 2024-09-13T18:49:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f4937e00700 1 -- 172.21.15.81:0/2567536432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c011d20 con 0x7f493806ed70 2024-09-13T18:49:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 -- 172.21.15.81:0/2567536432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 msgr2=0x7f493806f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 --2- 172.21.15.81:0/2567536432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493806f150 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f49380b5280 tx=0x7f492c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 -- 172.21.15.81:0/2567536432 shutdown_connections 2024-09-13T18:49:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 --2- 172.21.15.81:0/2567536432 >> v2:172.21.15.178:3300/0 conn(0x7f493815ac10 0x7f49380cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 --2- 172.21.15.81:0/2567536432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49380cf6d0 0x7f4938066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 --2- 172.21.15.81:0/2567536432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493806f150 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 -- 172.21.15.81:0/2567536432 >> 172.21.15.81:0/2567536432 conn(0x7f493806d530 msgr2=0x7f493806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 -- 172.21.15.81:0/2567536432 shutdown_connections 2024-09-13T18:49:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.191+0000 7f493fe00700 1 -- 172.21.15.81:0/2567536432 wait complete. 2024-09-13T18:49:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 Processor -- start 2024-09-13T18:49:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 -- start start 2024-09-13T18:49:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49380cf6d0 0x7f49380a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493815ac10 0x7f49380b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380aa8f0 con 0x7f493806ed70 2024-09-13T18:49:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380aa460 con 0x7f49380cf6d0 2024-09-13T18:49:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49380a9850 con 0x7f493815ac10 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49518/0 (socket says 172.21.15.81:49518) 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 -- 172.21.15.81:0/843516117 learned_addr learned my addr 172.21.15.81:0/843516117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493de00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493815ac10 0x7f49380b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493ca00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49380cf6d0 0x7f49380a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 -- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493815ac10 msgr2=0x7f49380b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493815ac10 0x7f49380b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 -- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49380cf6d0 msgr2=0x7f49380a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49380cf6d0 0x7f49380a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 -- 172.21.15.81:0/843516117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009570 con 0x7f493806ed70 2024-09-13T18:49:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493d400700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493814f5f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f492c000c00 tx=0x7f492c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c004590 con 0x7f493806ed70 2024-09-13T18:49:56.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c01e070 con 0x7f493806ed70 2024-09-13T18:49:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49380a9b30 con 0x7f493806ed70 2024-09-13T18:49:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c003900 con 0x7f493806ed70 2024-09-13T18:49:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.195+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49380aa0f0 con 0x7f493806ed70 2024-09-13T18:49:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.199+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49380ce4d0 con 0x7f493806ed70 2024-09-13T18:49:56.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.199+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f492c003a60 con 0x7f493806ed70 2024-09-13T18:49:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.203+0000 7f4935600700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4918066730 0x7f4918068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.203+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f492c084e80 con 0x7f493806ed70 2024-09-13T18:49:56.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.203+0000 7f493ca00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4918066730 0x7f4918068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.203+0000 7f493ca00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4918066730 0x7f4918068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49380af6b0 tx=0x7f4924008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:56.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.207+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f492c0522f0 con 0x7f493806ed70 2024-09-13T18:49:56.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.387+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f493806f150 con 0x7f493806ed70 2024-09-13T18:49:56.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.395+0000 7f4935600700 1 -- 172.21.15.81:0/843516117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f492c055910 con 0x7f493806ed70 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4918066730 msgr2=0x7f4918068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4918066730 0x7f4918068bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f49380af6b0 tx=0x7f4924008040 comp rx=0 tx=0).stop 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 msgr2=0x7f493814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493814f5f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f492c000c00 tx=0x7f492c004770 comp rx=0 tx=0).stop 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 shutdown_connections 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4918066730 0x7f4918068bf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f493815ac10 0x7f49380b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49380cf6d0 0x7f49380a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 --2- 172.21.15.81:0/843516117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f493806ed70 0x7f493814f5f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 >> 172.21.15.81:0/843516117 conn(0x7f493806d530 msgr2=0x7f4938070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:56.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 shutdown_connections 2024-09-13T18:49:56.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.399+0000 7f493fe00700 1 -- 172.21.15.81:0/843516117 wait complete. 2024-09-13T18:49:56.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2024-09-13T18:49:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.603+0000 7fe640c00700 1 Processor -- start 2024-09-13T18:49:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.603+0000 7fe640c00700 1 -- start start 2024-09-13T18:49:56.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe640c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe63c15cd90 0x7fe63c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe640c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 0x7fe63c0cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe640c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63c0d1390 con 0x7fe63c0cde10 2024-09-13T18:49:56.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe640c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0b2530 con 0x7fe63c15cd90 2024-09-13T18:49:56.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe640c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0d05f0 con 0x7fe63c15d170 2024-09-13T18:49:56.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe63c0cde10 0x7fe63c0ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43550/0 (socket says 172.21.15.81:43550) 2024-09-13T18:49:56.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63be00700 1 -- 172.21.15.81:0/1377166413 learned_addr learned my addr 172.21.15.81:0/1377166413 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:56.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63b400700 1 --2- 172.21.15.81:0/1377166413 >> v2:172.21.15.178:3300/0 conn(0x7fe63c15cd90 0x7fe63c0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe632a00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 0x7fe63c0cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166201400 0 0) 0x7fe63c0d1390 con 0x7fe63c0cde10 2024-09-13T18:49:56.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6200035d0 con 0x7fe63c0cde10 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1324501777 0 0) 0x7fe6200035d0 con 0x7fe63c0cde10 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 msgr2=0x7fe63c0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 0x7fe63c0cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 >> v2:172.21.15.178:3300/0 conn(0x7fe63c15cd90 msgr2=0x7fe63c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 --2- 172.21.15.81:0/1377166413 >> v2:172.21.15.178:3300/0 conn(0x7fe63c15cd90 0x7fe63c0b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0d1670 con 0x7fe63c0cde10 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fe6340019f0 con 0x7fe63c0cde10 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 >> v1:172.21.15.81:6789/0 conn(0x7fe63c0cde10 legacy=0x7fe63c0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 0x7fe620003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620004010 0x7fe620004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe620004db0 0x7fe620005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0b2530 con 0x7fe620004010 2024-09-13T18:49:56.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000ba30 con 0x7fe620004db0 2024-09-13T18:49:56.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000bba0 con 0x7fe63c15d170 2024-09-13T18:49:56.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe632a00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620004010 0x7fe620004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63b400700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 0x7fe620003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.607+0000 7fe63be00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe620004db0 0x7fe620005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe632a00700 1 -- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 msgr2=0x7fe620003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe632a00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe63c15d170 0x7fe620003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe632a00700 1 -- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe620004db0 msgr2=0x7fe620005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe632a00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe620004db0 0x7fe620005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe632a00700 1 -- 172.21.15.81:0/1377166413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6200035d0 con 0x7fe620004010 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe63be00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe620004db0 0x7fe620005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe632a00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620004010 0x7fe620004870 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe624009b40 tx=0x7fe6200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a7ebe7de424c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62400e6c0 con 0x7fe620004010 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62400e820 con 0x7fe620004010 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe63aa00700 1 -- 172.21.15.81:0/1377166413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62400eb90 con 0x7fe620004010 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe640c00700 1 -- 172.21.15.81:0/1377166413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620004010 msgr2=0x7fe620004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe640c00700 1 --2- 172.21.15.81:0/1377166413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe620004010 0x7fe620004870 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe624009b40 tx=0x7fe6200058a0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe63be00700 1 -- 172.21.15.81:0/1377166413 reap_dead start 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe640c00700 1 -- 172.21.15.81:0/1377166413 shutdown_connections 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe640c00700 1 -- 172.21.15.81:0/1377166413 >> 172.21.15.81:0/1377166413 conn(0x7fe63c0d2c10 msgr2=0x7fe63c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe640c00700 1 -- 172.21.15.81:0/1377166413 shutdown_connections 2024-09-13T18:49:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.611+0000 7fe640c00700 1 -- 172.21.15.81:0/1377166413 wait complete. 2024-09-13T18:49:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.615+0000 7fe640c00700 1 Processor -- start 2024-09-13T18:49:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.615+0000 7fe640c00700 1 -- start start 2024-09-13T18:49:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.615+0000 7fe640c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe620004010 0x7fe63c0b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.615+0000 7fe640c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe63c155d10 0x7fe63c0b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.615+0000 7fe640c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 0x7fe63c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe640c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0b5080 con 0x7fe63c0b8900 2024-09-13T18:49:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe640c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0b46b0 con 0x7fe63c155d10 2024-09-13T18:49:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe640c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0b3aa0 con 0x7fe620004010 2024-09-13T18:49:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 0x7fe63c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 0x7fe63c0b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56246/0 (socket says 172.21.15.81:56246) 2024-09-13T18:49:56.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 -- 172.21.15.81:0/1406580264 learned_addr learned my addr 172.21.15.81:0/1406580264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe632a00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe63c155d10 0x7fe63c0b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63b400700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe620004010 0x7fe63c0b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 -- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe620004010 msgr2=0x7fe63c0b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe620004010 0x7fe63c0b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 -- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe63c155d10 msgr2=0x7fe63c0b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe63c155d10 0x7fe63c0b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 -- 172.21.15.81:0/1406580264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c0b3d80 con 0x7fe63c0b8900 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe632a00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe63c155d10 0x7fe63c0b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:56.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe63be00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 0x7fe63c0b5a40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0cd820 tx=0x7fe634007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400e900 con 0x7fe63c0b8900 2024-09-13T18:49:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63400ea60 con 0x7fe63c0b8900 2024-09-13T18:49:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c0b4060 con 0x7fe63c0b8900 2024-09-13T18:49:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400edf0 con 0x7fe63c0b8900 2024-09-13T18:49:56.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c0b36c0 con 0x7fe63c0b8900 2024-09-13T18:49:56.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.619+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c0b4840 con 0x7fe63c0b8900 2024-09-13T18:49:56.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.623+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe63401d460 con 0x7fe63c0b8900 2024-09-13T18:49:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.623+0000 7fe633e00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe618066730 0x7fe618068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:56.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.623+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe634084320 con 0x7fe63c0b8900 2024-09-13T18:49:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.623+0000 7fe63b400700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe618066730 0x7fe618068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:56.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.623+0000 7fe63b400700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe618066730 0x7fe618068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009c30 tx=0x7fe62c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.631+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe6340517a0 con 0x7fe63c0b8900 2024-09-13T18:49:56.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.875+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) v1 -- 0x7fe63c0b1f50 con 0x7fe63c0b8900 2024-09-13T18:49:56.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe633e00700 1 -- 172.21.15.81:0/1406580264 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v158) v1 ==== 136+0+0 (secure 0 0 0) 0x7fe634054dc0 con 0x7fe63c0b8900 2024-09-13T18:49:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe618066730 msgr2=0x7fe618068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe618066730 0x7fe618068bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009c30 tx=0x7fe62c008040 comp rx=0 tx=0).stop 2024-09-13T18:49:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 msgr2=0x7fe63c0b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:56.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 0x7fe63c0b5a40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe63c0cd820 tx=0x7fe634007cb0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 shutdown_connections 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe618066730 0x7fe618068bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe63c0b8900 0x7fe63c0b5a40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe63c155d10 0x7fe63c0b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 --2- 172.21.15.81:0/1406580264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe620004010 0x7fe63c0b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 >> 172.21.15.81:0/1406580264 conn(0x7fe63c0d2c10 msgr2=0x7fe63c0ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 shutdown_connections 2024-09-13T18:49:56.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:56.987+0000 7fe640c00700 1 -- 172.21.15.81:0/1406580264 wait complete. 2024-09-13T18:49:57.018 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-13T18:49:57.018 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-13T18:49:57.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:49:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.175+0000 7fdfe3e00700 1 Processor -- start 2024-09-13T18:49:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.175+0000 7fdfe3e00700 1 -- start start 2024-09-13T18:49:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfdc0ce4c0 0x7fdfdc06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0ad480 con 0x7fdfdc06ab10 2024-09-13T18:49:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc157790 con 0x7fdfdc1573b0 2024-09-13T18:49:57.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc06afa0 con 0x7fdfdc0ce4c0 2024-09-13T18:49:57.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe0a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfdc0ce4c0 0x7fdfdc06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe1e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdfdc06ab10 0x7fdfdc06ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43552/0 (socket says 172.21.15.81:43552) 2024-09-13T18:49:57.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe1e00700 1 -- 172.21.15.81:0/2232000888 learned_addr learned my addr 172.21.15.81:0/2232000888 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:57.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe0a00700 1 -- 172.21.15.81:0/2232000888 >> v1:172.21.15.178:6789/0 conn(0x7fdfdc1573b0 legacy=0x7fdfdc0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe0a00700 1 -- 172.21.15.81:0/2232000888 >> v1:172.21.15.81:6789/0 conn(0x7fdfdc06ab10 legacy=0x7fdfdc06ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe0a00700 1 -- 172.21.15.81:0/2232000888 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0ad6d0 con 0x7fdfdc0ce4c0 2024-09-13T18:49:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.179+0000 7fdfe0a00700 1 --2- 172.21.15.81:0/2232000888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc0ce4c0 0x7fdfdc06a5d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009850 tx=0x7fdfc8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8dce3c85884ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfdbe00700 1 -- 172.21.15.81:0/2232000888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011830 con 0x7fdfdc0ce4c0 2024-09-13T18:49:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfdbe00700 1 -- 172.21.15.81:0/2232000888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8011990 con 0x7fdfdc0ce4c0 2024-09-13T18:49:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfdbe00700 1 -- 172.21.15.81:0/2232000888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011d20 con 0x7fdfdc0ce4c0 2024-09-13T18:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 -- 172.21.15.81:0/2232000888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc0ce4c0 msgr2=0x7fdfdc06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/2232000888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc0ce4c0 0x7fdfdc06a5d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009850 tx=0x7fdfc8009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 -- 172.21.15.81:0/2232000888 shutdown_connections 2024-09-13T18:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/2232000888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc0ce4c0 0x7fdfdc06a5d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 -- 172.21.15.81:0/2232000888 >> 172.21.15.81:0/2232000888 conn(0x7fdfdc0b08d0 msgr2=0x7fdfdc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 -- 172.21.15.81:0/2232000888 shutdown_connections 2024-09-13T18:49:57.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 -- 172.21.15.81:0/2232000888 wait complete. 2024-09-13T18:49:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 Processor -- start 2024-09-13T18:49:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.183+0000 7fdfe3e00700 1 -- start start 2024-09-13T18:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 0x7fdfdc1f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0ce4c0 0x7fdfdc14d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc1573b0 0x7fdfdc15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc158ac0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc1f34c0 con 0x7fdfdc1573b0 2024-09-13T18:49:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc14db90 con 0x7fdfdc0ce4c0 2024-09-13T18:49:57.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 0x7fdfdc1f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 0x7fdfdc1f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56276/0 (socket says 172.21.15.81:56276) 2024-09-13T18:49:57.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 -- 172.21.15.81:0/1898557087 learned_addr learned my addr 172.21.15.81:0/1898557087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:57.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc1573b0 0x7fdfdc15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe0a00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0ce4c0 0x7fdfdc14d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 -- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0ce4c0 msgr2=0x7fdfdc14d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0ce4c0 0x7fdfdc14d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 -- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc1573b0 msgr2=0x7fdfdc15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc1573b0 0x7fdfdc15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 -- 172.21.15.81:0/1898557087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80094b0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe1400700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 0x7fdfdc1f2f80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000c500 tx=0x7fdfd000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00052d0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0005430 con 0x7fdfdc06ab10 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc157e40 con 0x7fdfdc06ab10 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00055a0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.187+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc158400 con 0x7fdfdc06ab10 2024-09-13T18:49:57.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.191+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc0cc8e0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.191+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfd00038e0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.191+0000 7fdfd9600700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfbc066730 0x7fdfbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.191+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fdfd00834a0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.191+0000 7fdfe0a00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfbc066730 0x7fdfbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.195+0000 7fdfe0a00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfbc066730 0x7fdfbc068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009fd0 tx=0x7fdfc8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:57.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.199+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfd00508a0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.387+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfdc06a5d0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.387+0000 7fdfd9600700 1 -- 172.21.15.81:0/1898557087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13451 (secure 0 0 0) 0x7fdfd00704a0 con 0x7fdfdc06ab10 2024-09-13T18:49:57.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:49:57.398 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:49:55.973394+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6837/3633246084":"2024-09-14T18:49:52.943237+0000","172.21.15.178:6835/628924969":"2024-09-14T18:49:52.943212+0000","172.21.15.178:6834/628924969":"2024-09-14T18:49:52.943212+0000","172.21.15.81:6836/2473824789":"2024-09-14T18:49:52.943250+0000","172.21.15.81:6835/3633246084":"2024-09-14T18:49:52.943237+0000","172.21.15.81:6834/2473824789":"2024-09-14T18:49:52.943250+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:49:57.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfbc066730 msgr2=0x7fdfbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfbc066730 0x7fdfbc068bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009fd0 tx=0x7fdfc8008030 comp rx=0 tx=0).stop 2024-09-13T18:49:57.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 msgr2=0x7fdfdc1f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 0x7fdfdc1f2f80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000c500 tx=0x7fdfd000c810 comp rx=0 tx=0).stop 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 shutdown_connections 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfbc066730 0x7fdfbc068bf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdfdc1573b0 0x7fdfdc15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdfdc0ce4c0 0x7fdfdc14d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 --2- 172.21.15.81:0/1898557087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfdc06ab10 0x7fdfdc1f2f80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 >> 172.21.15.81:0/1898557087 conn(0x7fdfdc0b08d0 msgr2=0x7fdfdc160820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 shutdown_connections 2024-09-13T18:49:57.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.391+0000 7fdfe3e00700 1 -- 172.21.15.81:0/1898557087 wait complete. 2024-09-13T18:49:57.425 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:49:57.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:49:57.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 Processor -- start 2024-09-13T18:49:57.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 -- start start 2024-09-13T18:49:57.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feb4c144330 0x7feb4c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb4c06d760 0x7feb4c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c06bcf0 con 0x7feb4c144710 2024-09-13T18:49:57.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c0cce10 con 0x7feb4c06d760 2024-09-13T18:49:57.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.591+0000 7feb51c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c06cb50 con 0x7feb4c144330 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb4c06d760 0x7feb4c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb4c144710 0x7feb4c15e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43568/0 (socket says 172.21.15.81:43568) 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4b400700 1 -- 172.21.15.81:0/3567101688 learned_addr learned my addr 172.21.15.81:0/3567101688 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4aa00700 1 --2- 172.21.15.81:0/3567101688 >> v2:172.21.15.178:3300/0 conn(0x7feb4c144330 0x7feb4c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4a000700 1 -- 172.21.15.81:0/3567101688 >> v2:172.21.15.178:3300/0 conn(0x7feb4c144330 msgr2=0x7feb4c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4a000700 1 --2- 172.21.15.81:0/3567101688 >> v2:172.21.15.178:3300/0 conn(0x7feb4c144330 0x7feb4c0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4a000700 1 -- 172.21.15.81:0/3567101688 >> v1:172.21.15.81:6789/0 conn(0x7feb4c144710 legacy=0x7feb4c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4a000700 1 -- 172.21.15.81:0/3567101688 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0cf4b0 con 0x7feb4c06d760 2024-09-13T18:49:57.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb49600700 1 -- 172.21.15.81:0/3567101688 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944614287 0 0) 0x7feb4c06bcf0 con 0x7feb4c144710 2024-09-13T18:49:57.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb4a000700 1 --2- 172.21.15.81:0/3567101688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c0b35a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0b1740 tx=0x7feb38009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f060c9bf035d758 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:57.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb49600700 1 -- 172.21.15.81:0/3567101688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38011830 con 0x7feb4c06d760 2024-09-13T18:49:57.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb49600700 1 -- 172.21.15.81:0/3567101688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38011990 con 0x7feb4c06d760 2024-09-13T18:49:57.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb49600700 1 -- 172.21.15.81:0/3567101688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38011d20 con 0x7feb4c06d760 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 -- 172.21.15.81:0/3567101688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 msgr2=0x7feb4c0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 --2- 172.21.15.81:0/3567101688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c0b35a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0b1740 tx=0x7feb38009b30 comp rx=0 tx=0).stop 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 -- 172.21.15.81:0/3567101688 shutdown_connections 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 --2- 172.21.15.81:0/3567101688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c0b35a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 --2- 172.21.15.81:0/3567101688 >> v2:172.21.15.178:3300/0 conn(0x7feb4c144330 0x7feb4c0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 -- 172.21.15.81:0/3567101688 >> 172.21.15.81:0/3567101688 conn(0x7feb4c06a570 msgr2=0x7feb4c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 -- 172.21.15.81:0/3567101688 shutdown_connections 2024-09-13T18:49:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.595+0000 7feb51c00700 1 -- 172.21.15.81:0/3567101688 wait complete. 2024-09-13T18:49:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.599+0000 7feb51c00700 1 Processor -- start 2024-09-13T18:49:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.599+0000 7feb51c00700 1 -- start start 2024-09-13T18:49:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4c144330 0x7feb4c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4c0b1270 0x7feb4c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0b0de0 con 0x7feb4c06d760 2024-09-13T18:49:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0b01d0 con 0x7feb4c144330 2024-09-13T18:49:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0b04b0 con 0x7feb4c0b1270 2024-09-13T18:49:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56306/0 (socket says 172.21.15.81:56306) 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 -- 172.21.15.81:0/4288247660 learned_addr learned my addr 172.21.15.81:0/4288247660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4a000700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4c144330 0x7feb4c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4b400700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4c0b1270 0x7feb4c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 -- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4c0b1270 msgr2=0x7feb4c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4c0b1270 0x7feb4c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 -- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4c144330 msgr2=0x7feb4c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4c144330 0x7feb4c15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 -- 172.21.15.81:0/4288247660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380094b0 con 0x7feb4c06d760 2024-09-13T18:49:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4b400700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4c0b1270 0x7feb4c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb4aa00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c159ac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00e9d0 tx=0x7feb3c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c009720 con 0x7feb4c06d760 2024-09-13T18:49:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c00c850 con 0x7feb4c06d760 2024-09-13T18:49:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c00cbc0 con 0x7feb4c06d760 2024-09-13T18:49:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c0b0790 con 0x7feb4c06d760 2024-09-13T18:49:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.603+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c138f40 con 0x7feb4c06d760 2024-09-13T18:49:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.607+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c0b2c00 con 0x7feb4c06d760 2024-09-13T18:49:57.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.607+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb3c00cd20 con 0x7feb4c06d760 2024-09-13T18:49:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.611+0000 7feb42a00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb2c066760 0x7feb2c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.611+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7feb3c084160 con 0x7feb4c06d760 2024-09-13T18:49:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.611+0000 7feb4a000700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb2c066760 0x7feb2c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.611+0000 7feb4a000700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb2c066760 0x7feb2c068c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0ae610 tx=0x7feb38008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.615+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb3c051560 con 0x7feb4c06d760 2024-09-13T18:49:57.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.791+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb4c136f30 con 0x7feb4c06d760 2024-09-13T18:49:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.791+0000 7feb42a00700 1 -- 172.21.15.81:0/4288247660 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb3c054b80 con 0x7feb4c06d760 2024-09-13T18:49:57.800 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:49:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb2c066760 msgr2=0x7feb2c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb2c066760 0x7feb2c068c20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feb4c0ae610 tx=0x7feb38008030 comp rx=0 tx=0).stop 2024-09-13T18:49:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 msgr2=0x7feb4c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c159ac0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feb3c00e9d0 tx=0x7feb3c00ece0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 shutdown_connections 2024-09-13T18:49:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feb2c066760 0x7feb2c068c20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4c0b1270 0x7feb4c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4c144330 0x7feb4c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 --2- 172.21.15.81:0/4288247660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb4c06d760 0x7feb4c159ac0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 >> 172.21.15.81:0/4288247660 conn(0x7feb4c06a570 msgr2=0x7feb4c15e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 shutdown_connections 2024-09-13T18:49:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.795+0000 7feb51c00700 1 -- 172.21.15.81:0/4288247660 wait complete. 2024-09-13T18:49:57.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2024-09-13T18:49:57.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.979+0000 7f1084c00700 1 Processor -- start 2024-09-13T18:49:57.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f1084c00700 1 -- start start 2024-09-13T18:49:57.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f1084c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f108006aaa0 0x7f108006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f1084c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800ccb40 con 0x7f10800cc6f0 2024-09-13T18:49:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f1084c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108006b430 con 0x7f10800cb020 2024-09-13T18:49:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f1084c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800b2ad0 con 0x7f108006aaa0 2024-09-13T18:49:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107ea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10800cc6f0 0x7f108015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43574/0 (socket says 172.21.15.81:43574) 2024-09-13T18:49:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107ea00700 1 -- 172.21.15.81:0/3246927670 learned_addr learned my addr 172.21.15.81:0/3246927670 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107fe00700 1 --2- 172.21.15.81:0/3246927670 >> v2:172.21.15.178:3300/0 conn(0x7f108006aaa0 0x7f108006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107fe00700 1 -- 172.21.15.81:0/3246927670 >> v1:172.21.15.178:6789/0 conn(0x7f10800cb020 legacy=0x7f108015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107fe00700 1 -- 172.21.15.81:0/3246927670 >> v1:172.21.15.81:6789/0 conn(0x7f10800cc6f0 legacy=0x7f108015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107fe00700 1 -- 172.21.15.81:0/3246927670 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108015b960 con 0x7f108006aaa0 2024-09-13T18:49:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.983+0000 7f107fe00700 1 --2- 172.21.15.81:0/3246927670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108006aaa0 0x7f108006aef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1078009d90 tx=0x7f107800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2ec0df9038dffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:58.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.991+0000 7f107e000700 1 -- 172.21.15.81:0/3246927670 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107800e070 con 0x7f108006aaa0 2024-09-13T18:49:58.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.991+0000 7f107e000700 1 -- 172.21.15.81:0/3246927670 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800bbd0 con 0x7f108006aaa0 2024-09-13T18:49:58.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.991+0000 7f107e000700 1 -- 172.21.15.81:0/3246927670 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078012430 con 0x7f108006aaa0 2024-09-13T18:49:58.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- 172.21.15.81:0/3246927670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108006aaa0 msgr2=0x7f108006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:58.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 --2- 172.21.15.81:0/3246927670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108006aaa0 0x7f108006aef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1078009d90 tx=0x7f107800b330 comp rx=0 tx=0).stop 2024-09-13T18:49:58.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- 172.21.15.81:0/3246927670 shutdown_connections 2024-09-13T18:49:58.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 --2- 172.21.15.81:0/3246927670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108006aaa0 0x7f108006aef0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:58.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- 172.21.15.81:0/3246927670 >> 172.21.15.81:0/3246927670 conn(0x7f10800b0c40 msgr2=0x7f108006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:58.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- 172.21.15.81:0/3246927670 shutdown_connections 2024-09-13T18:49:58.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- 172.21.15.81:0/3246927670 wait complete. 2024-09-13T18:49:58.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 Processor -- start 2024-09-13T18:49:58.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- start start 2024-09-13T18:49:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 0x7f108014c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10800cb020 0x7f108014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10800cc6f0 0x7f108014e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108014db50 con 0x7f108006aaa0 2024-09-13T18:49:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108014cfd0 con 0x7f10800cc6f0 2024-09-13T18:49:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.995+0000 7f1084c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108014d2b0 con 0x7f10800cb020 2024-09-13T18:49:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 0x7f108014c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 0x7f108014c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56314/0 (socket says 172.21.15.81:56314) 2024-09-13T18:49:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 -- 172.21.15.81:0/3604047301 learned_addr learned my addr 172.21.15.81:0/3604047301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107fe00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10800cc6f0 0x7f108014e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107ea00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10800cb020 0x7f108014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 -- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10800cb020 msgr2=0x7f108014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10800cb020 0x7f108014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 -- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10800cc6f0 msgr2=0x7f108014e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10800cc6f0 0x7f108014e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 -- 172.21.15.81:0/3604047301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078009a70 con 0x7f108006aaa0 2024-09-13T18:49:58.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f107f400700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 0x7f108014c460 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f107000c500 tx=0x7f107000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700052d0 con 0x7f108006aaa0 2024-09-13T18:49:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070005430 con 0x7f108006aaa0 2024-09-13T18:49:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108014d590 con 0x7f108006aaa0 2024-09-13T18:49:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700055a0 con 0x7f108006aaa0 2024-09-13T18:49:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1080149530 con 0x7f108006aaa0 2024-09-13T18:49:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:57.999+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1080155830 con 0x7f108006aaa0 2024-09-13T18:49:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.003+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10700038e0 con 0x7f108006aaa0 2024-09-13T18:49:58.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.003+0000 7f1077400700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1060066730 0x7f1060068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:58.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.003+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f10700831d0 con 0x7f108006aaa0 2024-09-13T18:49:58.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.003+0000 7f107ea00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1060066730 0x7f1060068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.003+0000 7f107ea00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1060066730 0x7f1060068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f10800ce380 tx=0x7f106c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.011+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10700506e0 con 0x7f108006aaa0 2024-09-13T18:49:58.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.259+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) v1 -- 0x7f108006b430 con 0x7f108006aaa0 2024-09-13T18:49:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:58.999+0000 7f1077400700 1 -- 172.21.15.81:0/3604047301 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v160) v1 ==== 146+0+0 (secure 0 0 0) 0x7f108006b430 con 0x7f108006aaa0 2024-09-13T18:49:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1060066730 msgr2=0x7f1060068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1060066730 0x7f1060068bf0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f10800ce380 tx=0x7f106c009040 comp rx=0 tx=0).stop 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 msgr2=0x7f108014c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 0x7f108014c460 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f107000c500 tx=0x7f107000c810 comp rx=0 tx=0).stop 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 shutdown_connections 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1060066730 0x7f1060068bf0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10800cc6f0 0x7f108014e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10800cb020 0x7f108014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 --2- 172.21.15.81:0/3604047301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f108006aaa0 0x7f108014c460 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 >> 172.21.15.81:0/3604047301 conn(0x7f10800b0c40 msgr2=0x7f108006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 shutdown_connections 2024-09-13T18:49:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.007+0000 7f1084c00700 1 -- 172.21.15.81:0/3604047301 wait complete. 2024-09-13T18:49:59.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:49:59.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.207+0000 7fd159a00700 1 Processor -- start 2024-09-13T18:49:59.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.207+0000 7fd159a00700 1 -- start start 2024-09-13T18:49:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd159a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd15406d760 0x7fd1540b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd159a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144710 0x7fd1540b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd159a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15406bcf0 con 0x7fd154144330 2024-09-13T18:49:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd159a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1540cce10 con 0x7fd15406d760 2024-09-13T18:49:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd159a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15406cb50 con 0x7fd154144710 2024-09-13T18:49:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd154144330 0x7fd1540cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43578/0 (socket says 172.21.15.81:43578) 2024-09-13T18:49:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152a00700 1 -- 172.21.15.81:0/2130165587 learned_addr learned my addr 172.21.15.81:0/2130165587 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152000700 1 --2- 172.21.15.81:0/2130165587 >> v2:172.21.15.178:3300/0 conn(0x7fd15406d760 0x7fd1540b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd153400700 1 --2- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144710 0x7fd1540b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd151600700 1 -- 172.21.15.81:0/2130165587 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141979989 0 0) 0x7fd15406bcf0 con 0x7fd154144330 2024-09-13T18:49:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd151600700 1 -- 172.21.15.81:0/2130165587 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1380035d0 con 0x7fd154144330 2024-09-13T18:49:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152000700 1 -- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144710 msgr2=0x7fd1540b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:49:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152000700 1 --2- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144710 0x7fd1540b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152000700 1 -- 172.21.15.81:0/2130165587 >> v1:172.21.15.81:6789/0 conn(0x7fd154144330 legacy=0x7fd1540cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152000700 1 -- 172.21.15.81:0/2130165587 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15406bf40 con 0x7fd15406d760 2024-09-13T18:49:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd152000700 1 --2- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15406d760 0x7fd1540b35a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd140009850 tx=0x7fd140009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f8c8520c6bf2306 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd151600700 1 -- 172.21.15.81:0/2130165587 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140011830 con 0x7fd15406d760 2024-09-13T18:49:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd151600700 1 -- 172.21.15.81:0/2130165587 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140011990 con 0x7fd15406d760 2024-09-13T18:49:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.211+0000 7fd151600700 1 -- 172.21.15.81:0/2130165587 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd140011d40 con 0x7fd15406d760 2024-09-13T18:49:59.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 -- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15406d760 msgr2=0x7fd1540b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 --2- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15406d760 0x7fd1540b35a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd140009850 tx=0x7fd140009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:59.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 -- 172.21.15.81:0/2130165587 shutdown_connections 2024-09-13T18:49:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 --2- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144710 0x7fd1540b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 --2- 172.21.15.81:0/2130165587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15406d760 0x7fd1540b35a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 -- 172.21.15.81:0/2130165587 >> 172.21.15.81:0/2130165587 conn(0x7fd15406a570 msgr2=0x7fd15406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 -- 172.21.15.81:0/2130165587 shutdown_connections 2024-09-13T18:49:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.215+0000 7fd159a00700 1 -- 172.21.15.81:0/2130165587 wait complete. 2024-09-13T18:49:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 Processor -- start 2024-09-13T18:49:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 -- start start 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 0x7fd1540cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144330 0x7fd154143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1541efb20 0x7fd1541541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd154140b00 con 0x7fd15406d760 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1541436c0 con 0x7fd1541efb20 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd154143940 con 0x7fd154144330 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 0x7fd1540cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 0x7fd1540cd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56326/0 (socket says 172.21.15.81:56326) 2024-09-13T18:49:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 -- 172.21.15.81:0/2968356135 learned_addr learned my addr 172.21.15.81:0/2968356135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152000700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144330 0x7fd154143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd153400700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1541efb20 0x7fd1541541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 -- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144330 msgr2=0x7fd154143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144330 0x7fd154143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 -- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1541efb20 msgr2=0x7fd1541541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1541efb20 0x7fd1541541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 -- 172.21.15.81:0/2968356135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400094b0 con 0x7fd15406d760 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd152a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 0x7fd1540cd910 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c730 tx=0x7fd14400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144005d90 con 0x7fd15406d760 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1440070d0 con 0x7fd15406d760 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144007480 con 0x7fd15406d760 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd154140210 con 0x7fd15406d760 2024-09-13T18:49:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.219+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd154140790 con 0x7fd15406d760 2024-09-13T18:49:59.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.223+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1540cef70 con 0x7fd15406d760 2024-09-13T18:49:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.223+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1440075e0 con 0x7fd15406d760 2024-09-13T18:49:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.227+0000 7fd14aa00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd134066730 0x7fd134068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.227+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fd144083580 con 0x7fd15406d760 2024-09-13T18:49:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.227+0000 7fd152000700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd134066730 0x7fd134068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.227+0000 7fd152000700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd134066730 0x7fd134068bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd1540ae610 tx=0x7fd140008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.231+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1440509f0 con 0x7fd15406d760 2024-09-13T18:49:59.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.411+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd1540b3ce0 con 0x7fd15406d760 2024-09-13T18:49:59.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.423+0000 7fd14aa00700 1 -- 172.21.15.81:0/2968356135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd144054010 con 0x7fd15406d760 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd134066730 msgr2=0x7fd134068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd134066730 0x7fd134068bf0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd1540ae610 tx=0x7fd140008030 comp rx=0 tx=0).stop 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 msgr2=0x7fd1540cd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 0x7fd1540cd910 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd14400c730 tx=0x7fd14400ca40 comp rx=0 tx=0).stop 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 shutdown_connections 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd134066730 0x7fd134068bf0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1541efb20 0x7fd1541541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd154144330 0x7fd154143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 --2- 172.21.15.81:0/2968356135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd15406d760 0x7fd1540cd910 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 >> 172.21.15.81:0/2968356135 conn(0x7fd15406a570 msgr2=0x7fd15415c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 shutdown_connections 2024-09-13T18:49:59.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.427+0000 7fd159a00700 1 -- 172.21.15.81:0/2968356135 wait complete. 2024-09-13T18:49:59.457 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:49:59.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:49:59.497 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:49:59.538 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:49:59.538 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:49:59.538 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:59.555 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:49:59.556 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:49:59.556 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:59.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:49:59.602 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:49:59.602 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:59.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:49:59.618 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:49:59.618 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:49:59.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:49:59.663 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:49:59.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:49:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.835+0000 7f19c6e00700 1 Processor -- start 2024-09-13T18:49:59.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.835+0000 7f19c6e00700 1 -- start start 2024-09-13T18:49:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c6e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19c00cb020 0x7f19c00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c6e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c00b2ad0 con 0x7f19c015c2a0 2024-09-13T18:49:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c6e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c015b960 con 0x7f19c006aaa0 2024-09-13T18:49:59.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c6e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c015bc40 con 0x7f19c00cb020 2024-09-13T18:49:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c5000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19c015c2a0 0x7f19c015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43580/0 (socket says 172.21.15.81:43580) 2024-09-13T18:49:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c5000700 1 -- 172.21.15.81:0/658190241 learned_addr learned my addr 172.21.15.81:0/658190241 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:49:59.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c5a00700 1 --2- 172.21.15.81:0/658190241 >> v2:172.21.15.178:3300/0 conn(0x7f19c00cb020 0x7f19c00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859958701 0 0) 0x7f19c00b2ad0 con 0x7f19c015c2a0 2024-09-13T18:49:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a80035d0 con 0x7f19c015c2a0 2024-09-13T18:49:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000887859 0 0) 0x7f19c015b960 con 0x7f19c006aaa0 2024-09-13T18:49:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c00b2ad0 con 0x7f19c006aaa0 2024-09-13T18:49:59.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4185809885 0 0) 0x7f19a80035d0 con 0x7f19c015c2a0 2024-09-13T18:49:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c5a00700 1 -- 172.21.15.81:0/658190241 >> v1:172.21.15.178:6789/0 conn(0x7f19c006aaa0 legacy=0x7f19c00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c5a00700 1 -- 172.21.15.81:0/658190241 >> v1:172.21.15.81:6789/0 conn(0x7f19c015c2a0 legacy=0x7f19c015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.839+0000 7f19c5a00700 1 -- 172.21.15.81:0/658190241 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c015bf20 con 0x7f19c00cb020 2024-09-13T18:49:59.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c5a00700 1 --2- 172.21.15.81:0/658190241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c00cb020 0x7f19c00cc6f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009850 tx=0x7f19b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec56760a8f748ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac001670 con 0x7f19c00cb020 2024-09-13T18:49:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4004030 con 0x7f19c00cb020 2024-09-13T18:49:59.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19bfe00700 1 -- 172.21.15.81:0/658190241 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b40043c0 con 0x7f19c00cb020 2024-09-13T18:49:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 -- 172.21.15.81:0/658190241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c00cb020 msgr2=0x7f19c00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 --2- 172.21.15.81:0/658190241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c00cb020 0x7f19c00cc6f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19b4009850 tx=0x7f19b4009b60 comp rx=0 tx=0).stop 2024-09-13T18:49:59.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 -- 172.21.15.81:0/658190241 shutdown_connections 2024-09-13T18:49:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 --2- 172.21.15.81:0/658190241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c00cb020 0x7f19c00cc6f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 -- 172.21.15.81:0/658190241 >> 172.21.15.81:0/658190241 conn(0x7f19c00b0c40 msgr2=0x7f19c006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:49:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 -- 172.21.15.81:0/658190241 shutdown_connections 2024-09-13T18:49:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.843+0000 7f19c6e00700 1 -- 172.21.15.81:0/658190241 wait complete. 2024-09-13T18:49:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 Processor -- start 2024-09-13T18:49:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 -- start start 2024-09-13T18:49:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 0x7f19c01f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19c00cb020 0x7f19c015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c015c2a0 0x7f19c0071290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0070c30 con 0x7f19c006aaa0 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c01f3e80 con 0x7f19c015c2a0 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c00700b0 con 0x7f19c00cb020 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 0x7f19c01f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 0x7f19c01f3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56340/0 (socket says 172.21.15.81:56340) 2024-09-13T18:49:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 -- 172.21.15.81:0/1839218046 learned_addr learned my addr 172.21.15.81:0/1839218046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:49:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6400700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c015c2a0 0x7f19c0071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5000700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19c00cb020 0x7f19c015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 -- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19c00cb020 msgr2=0x7f19c015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19c00cb020 0x7f19c015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 -- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c015c2a0 msgr2=0x7f19c0071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c015c2a0 0x7f19c0071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 -- 172.21.15.81:0/1839218046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b40094b0 con 0x7f19c006aaa0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c6400700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c015c2a0 0x7f19c0071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.847+0000 7f19c5a00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 0x7f19c01f3940 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f19c00b1690 tx=0x7f19b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4003e70 con 0x7f19c006aaa0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b401f070 con 0x7f19c006aaa0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c0070390 con 0x7f19c006aaa0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4011890 con 0x7f19c006aaa0 2024-09-13T18:49:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0070950 con 0x7f19c006aaa0 2024-09-13T18:49:59.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c015c6b0 con 0x7f19c006aaa0 2024-09-13T18:49:59.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.851+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19b40119f0 con 0x7f19c006aaa0 2024-09-13T18:49:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.855+0000 7f19bd600700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19a0066730 0x7f19a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:49:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.855+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f19b4021070 con 0x7f19c006aaa0 2024-09-13T18:49:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.855+0000 7f19c5000700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19a0066730 0x7f19a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:49:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.855+0000 7f19c5000700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19a0066730 0x7f19a0068bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f19c00cb650 tx=0x7f19ac007aa0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:49:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:49:59.863+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f19b4052df0 con 0x7f19c006aaa0 2024-09-13T18:50:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.083+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19c00b3ce0 con 0x7f19c006aaa0 2024-09-13T18:50:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.083+0000 7f19bd600700 1 -- 172.21.15.81:0/1839218046 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f19b402bde0 con 0x7f19c006aaa0 2024-09-13T18:50:00.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:00.094 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5003,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3314071113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3314071113},{"type":"v1","addr":"172.21.15.178:6833","nonce":3314071113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5818,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3010292150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3010292150},{"type":"v1","addr":"172.21.15.81:6835","nonce":3010292150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5824,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2374421918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2374421918},{"type":"v1","addr":"172.21.15.178:6835","nonce":2374421918}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5970,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3341513429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3341513429},{"type":"v1","addr":"172.21.15.81:6837","nonce":3341513429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2024-09-13T18:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19a0066730 msgr2=0x7f19a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19a0066730 0x7f19a0068bf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f19c00cb650 tx=0x7f19ac007aa0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 msgr2=0x7f19c01f3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 0x7f19c01f3940 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f19c00b1690 tx=0x7f19b4004770 comp rx=0 tx=0).stop 2024-09-13T18:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 shutdown_connections 2024-09-13T18:50:00.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f19a0066730 0x7f19a0068bf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19c015c2a0 0x7f19c0071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19c00cb020 0x7f19c015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 --2- 172.21.15.81:0/1839218046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c006aaa0 0x7f19c01f3940 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 >> 172.21.15.81:0/1839218046 conn(0x7f19c00b0c40 msgr2=0x7f19c015d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 shutdown_connections 2024-09-13T18:50:00.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.087+0000 7f19c6e00700 1 -- 172.21.15.81:0/1839218046 wait complete. 2024-09-13T18:50:00.099 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 27 2024-09-13T18:50:00.119 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:50:00.120 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:50:00.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:50:00.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:50:00.120 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:50:00.120 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:50:00.120 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:50:00.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:50:00.121 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:50:00.121 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:50:00.121 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:50:00.121 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:50:00.121 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:50:00.121 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:50:00.122 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:50:00.122 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:50:00.145 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:50:00.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:50:00.146 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:50:00.147 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:50:00.149 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:50:00.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:50:00.149 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:50:00.149 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:50:00.193 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:50:00.193 DEBUG:teuthology.parallel:result is None 2024-09-13T18:50:00.194 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:50:00.194 DEBUG:teuthology.parallel:result is None 2024-09-13T18:50:00.196 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:50:00.197 DEBUG:teuthology.parallel:result is None 2024-09-13T18:50:00.197 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:50:00.197 DEBUG:teuthology.parallel:result is None 2024-09-13T18:50:00.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:50:00.296 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:50:00.297 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:50:00.316 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:50:00.326 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:50:00.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.363+0000 7f7626c00700 1 Processor -- start 2024-09-13T18:50:00.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.363+0000 7f7626c00700 1 -- start start 2024-09-13T18:50:00.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7626c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76200ceab0 0x7f762006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:00.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7626c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7626c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762015e3e0 con 0x7f76200cdad0 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7626c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762006d010 con 0x7f76200ceab0 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7626c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762015d7d0 con 0x7f76200ccf60 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7624e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f76200ceab0 0x7f762006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7625800700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f76200cdad0 0x7f76200ce3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:37832/0 (socket says 172.21.15.81:37832) 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7625800700 1 -- 172.21.15.81:0/483134178 learned_addr learned my addr 172.21.15.81:0/483134178 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:00.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7626200700 1 --2- 172.21.15.81:0/483134178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:00.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7624e00700 1 -- 172.21.15.81:0/483134178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 msgr2=0x7f762006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:00.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7624e00700 1 --2- 172.21.15.81:0/483134178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762006cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7624e00700 1 -- 172.21.15.81:0/483134178 >> v1:172.21.15.178:6789/0 conn(0x7f76200cdad0 legacy=0x7f76200ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:00.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.367+0000 7f7624e00700 1 -- 172.21.15.81:0/483134178 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762015dab0 con 0x7f76200ceab0 2024-09-13T18:50:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7624e00700 1 --2- 172.21.15.81:0/483134178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762006c590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f760c009850 tx=0x7f760c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7f6e32903cc55d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f761fe00700 1 -- 172.21.15.81:0/483134178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c011830 con 0x7f76200ceab0 2024-09-13T18:50:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f761fe00700 1 -- 172.21.15.81:0/483134178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c011990 con 0x7f76200ceab0 2024-09-13T18:50:00.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f761fe00700 1 -- 172.21.15.81:0/483134178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c011d40 con 0x7f76200ceab0 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 -- 172.21.15.81:0/483134178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 msgr2=0x7f762006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 --2- 172.21.15.81:0/483134178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762006c590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f760c009850 tx=0x7f760c009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 -- 172.21.15.81:0/483134178 shutdown_connections 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 --2- 172.21.15.81:0/483134178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762006cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 --2- 172.21.15.81:0/483134178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762006c590 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 -- 172.21.15.81:0/483134178 >> 172.21.15.81:0/483134178 conn(0x7f762006a390 msgr2=0x7f762006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 -- 172.21.15.81:0/483134178 shutdown_connections 2024-09-13T18:50:00.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.371+0000 7f7626c00700 1 -- 172.21.15.81:0/483134178 wait complete. 2024-09-13T18:50:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 Processor -- start 2024-09-13T18:50:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 -- start start 2024-09-13T18:50:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762014bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76200cdad0 0x7f762014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:00.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7620149600 con 0x7f76200ceab0 2024-09-13T18:50:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76201498e0 con 0x7f76200cdad0 2024-09-13T18:50:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7620149bc0 con 0x7f76200ccf60 2024-09-13T18:50:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762014d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56386/0 (socket says 172.21.15.81:56386) 2024-09-13T18:50:00.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7626200700 1 -- 172.21.15.81:0/3024201038 learned_addr learned my addr 172.21.15.81:0/3024201038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:00.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7624e00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76200cdad0 0x7f762014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:00.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.375+0000 7f7625800700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762014bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626200700 1 -- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 msgr2=0x7f762014bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626200700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762014bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626200700 1 -- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76200cdad0 msgr2=0x7f762014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626200700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76200cdad0 0x7f762014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626200700 1 -- 172.21.15.81:0/3024201038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0094b0 con 0x7f76200ceab0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7624e00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76200cdad0 0x7f762014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626200700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762014d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f761800efc0 tx=0x7f761800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618009ea0 con 0x7f76200ceab0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761800f040 con 0x7f76200ceab0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7620149ea0 con 0x7f76200ceab0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618014480 con 0x7f76200ceab0 2024-09-13T18:50:00.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762014bff0 con 0x7f76200ceab0 2024-09-13T18:50:00.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.379+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7620072a10 con 0x7f76200ceab0 2024-09-13T18:50:00.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.383+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76180145e0 con 0x7f76200ceab0 2024-09-13T18:50:00.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.383+0000 7f761d600700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7600066730 0x7f7600068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.387+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7618084940 con 0x7f76200ceab0 2024-09-13T18:50:00.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.387+0000 7f7625800700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7600066730 0x7f7600068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:00.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.387+0000 7f7625800700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7600066730 0x7f7600068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7614005930 tx=0x7f7614009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:00.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.387+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7618051d20 con 0x7f76200ceab0 2024-09-13T18:50:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:00.575+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f762014a3c0 con 0x7f76200ceab0 2024-09-13T18:50:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.351+0000 7f761d600700 1 -- 172.21.15.81:0/3024201038 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7618018020 con 0x7f76200ceab0 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7600066730 msgr2=0x7f7600068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7600066730 0x7f7600068bf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7614005930 tx=0x7f7614009040 comp rx=0 tx=0).stop 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 msgr2=0x7f762014d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762014d990 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f761800efc0 tx=0x7f761800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 shutdown_connections 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7600066730 0x7f7600068bf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76200ceab0 0x7f762014d990 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76200cdad0 0x7f762014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 --2- 172.21.15.81:0/3024201038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76200ccf60 0x7f762014bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 >> 172.21.15.81:0/3024201038 conn(0x7f762006a390 msgr2=0x7f762015cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 shutdown_connections 2024-09-13T18:50:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.355+0000 7f7626c00700 1 -- 172.21.15.81:0/3024201038 wait complete. 2024-09-13T18:50:01.366 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-13T18:50:01.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:50:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.547+0000 7f1012c00700 1 Processor -- start 2024-09-13T18:50:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.547+0000 7f1012c00700 1 -- start start 2024-09-13T18:50:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1012c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f100c13ebc0 0x7f100c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1012c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f100c06ab10 0x7f100c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1012c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c0703d0 0x7f100c15d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1012c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c13fcc0 con 0x7f100c13ebc0 2024-09-13T18:50:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1012c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f100c06af50 con 0x7f100c06ab10 2024-09-13T18:50:01.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1012c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c13f0f0 con 0x7f100c0703d0 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f100c13ebc0 0x7f100c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f100c13ebc0 0x7f100c06a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56396/0 (socket says 172.21.15.81:56396) 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 -- 172.21.15.81:0/4058749536 learned_addr learned my addr 172.21.15.81:0/4058749536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100b400700 1 --2- 172.21.15.81:0/4058749536 >> v2:172.21.15.178:3300/0 conn(0x7f100c06ab10 0x7f100c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f1010c00700 1 --2- 172.21.15.81:0/4058749536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c0703d0 0x7f100c15d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 -- 172.21.15.81:0/4058749536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c0703d0 msgr2=0x7f100c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 --2- 172.21.15.81:0/4058749536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c0703d0 0x7f100c15d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 -- 172.21.15.81:0/4058749536 >> v2:172.21.15.178:3300/0 conn(0x7f100c06ab10 msgr2=0x7f100c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 --2- 172.21.15.81:0/4058749536 >> v2:172.21.15.178:3300/0 conn(0x7f100c06ab10 0x7f100c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 -- 172.21.15.81:0/4058749536 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c13f390 con 0x7f100c13ebc0 2024-09-13T18:50:01.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100be00700 1 --2- 172.21.15.81:0/4058749536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c13ebc0 0x7f100c06a5d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f100c06dd00 tx=0x7f0ffc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d65034a501691f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100aa00700 1 -- 172.21.15.81:0/4058749536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00e070 con 0x7f100c13ebc0 2024-09-13T18:50:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.551+0000 7f100aa00700 1 -- 172.21.15.81:0/4058749536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00b9c0 con 0x7f100c13ebc0 2024-09-13T18:50:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f100aa00700 1 -- 172.21.15.81:0/4058749536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00bd70 con 0x7f100c13ebc0 2024-09-13T18:50:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 -- 172.21.15.81:0/4058749536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c13ebc0 msgr2=0x7f100c06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 --2- 172.21.15.81:0/4058749536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c13ebc0 0x7f100c06a5d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f100c06dd00 tx=0x7f0ffc00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 -- 172.21.15.81:0/4058749536 shutdown_connections 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 --2- 172.21.15.81:0/4058749536 >> v2:172.21.15.178:3300/0 conn(0x7f100c06ab10 0x7f100c06fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 --2- 172.21.15.81:0/4058749536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c0703d0 0x7f100c15d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 --2- 172.21.15.81:0/4058749536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c13ebc0 0x7f100c06a5d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 -- 172.21.15.81:0/4058749536 >> 172.21.15.81:0/4058749536 conn(0x7f100c0b08d0 msgr2=0x7f100c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 -- 172.21.15.81:0/4058749536 shutdown_connections 2024-09-13T18:50:01.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.555+0000 7f1012c00700 1 -- 172.21.15.81:0/4058749536 wait complete. 2024-09-13T18:50:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 Processor -- start 2024-09-13T18:50:01.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 -- start start 2024-09-13T18:50:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 0x7f100c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f100c0703d0 0x7f100c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c13ebc0 0x7f100c0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c152af0 con 0x7f100c06ab10 2024-09-13T18:50:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c150110 con 0x7f100c0703d0 2024-09-13T18:50:01.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c1528f0 con 0x7f100c13ebc0 2024-09-13T18:50:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 0x7f100c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 0x7f100c14fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56404/0 (socket says 172.21.15.81:56404) 2024-09-13T18:50:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 -- 172.21.15.81:0/1650419489 learned_addr learned my addr 172.21.15.81:0/1650419489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100b400700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f100c0703d0 0x7f100c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1010c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c13ebc0 0x7f100c0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 -- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c13ebc0 msgr2=0x7f100c0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c13ebc0 0x7f100c0b2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 -- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f100c0703d0 msgr2=0x7f100c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f100c0703d0 0x7f100c15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 -- 172.21.15.81:0/1650419489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc009b30 con 0x7f100c06ab10 2024-09-13T18:50:01.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f100be00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 0x7f100c14fbd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00b370 tx=0x7f0ffc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc004250 con 0x7f100c06ab10 2024-09-13T18:50:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc0043b0 con 0x7f100c06ab10 2024-09-13T18:50:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100c1f3020 con 0x7f100c06ab10 2024-09-13T18:50:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.559+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc004760 con 0x7f100c06ab10 2024-09-13T18:50:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.563+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100c15cb70 con 0x7f100c06ab10 2024-09-13T18:50:01.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.563+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100c157c70 con 0x7f100c06ab10 2024-09-13T18:50:01.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.563+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ffc01c440 con 0x7f100c06ab10 2024-09-13T18:50:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.567+0000 7f1003e00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0fec066730 0x7f0fec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:01.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.567+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0ffc0854f0 con 0x7f100c06ab10 2024-09-13T18:50:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.567+0000 7f100b400700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0fec066730 0x7f0fec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:01.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.567+0000 7f100b400700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0fec066730 0x7f0fec068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f100c0721d0 tx=0x7f0ff8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:01.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.575+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0ffc052a60 con 0x7f100c06ab10 2024-09-13T18:50:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.815+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f100c070860 con 0x7f100c06ab10 2024-09-13T18:50:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.815+0000 7f1003e00700 1 -- 172.21.15.81:0/1650419489 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0ffc056080 con 0x7f100c06ab10 2024-09-13T18:50:01.825 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:01.825 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:01.825 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-13T18:50:01.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.825 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw==", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw==", 2024-09-13T18:50:01.826 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q==", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:50:01.827 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g==", 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g==", 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw==", 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA==", 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg==", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw==", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.831 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw==", 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A==", 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q==", 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.833 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ==", 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg==", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg==", 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.835 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng==", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:50:01.836 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB2iORm9hwhIRAASJc+x3PH9tdxfNlBIxr8ZA==", 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA==", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g==", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:50:01.838 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:50:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:50:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:01.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T18:50:01.839 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0fec066730 msgr2=0x7f0fec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0fec066730 0x7f0fec068bf0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f100c0721d0 tx=0x7f0ff8008040 comp rx=0 tx=0).stop 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 msgr2=0x7f100c14fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 0x7f100c14fbd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00b370 tx=0x7f0ffc004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 shutdown_connections 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0fec066730 0x7f0fec068bf0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f100c13ebc0 0x7f100c0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f100c0703d0 0x7f100c15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 --2- 172.21.15.81:0/1650419489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f100c06ab10 0x7f100c14fbd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 >> 172.21.15.81:0/1650419489 conn(0x7f100c0b08d0 msgr2=0x7f100c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 shutdown_connections 2024-09-13T18:50:01.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:01.819+0000 7f1012c00700 1 -- 172.21.15.81:0/1650419489 wait complete. 2024-09-13T18:50:01.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:02.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26baa00700 1 Processor -- start 2024-09-13T18:50:02.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26baa00700 1 -- start start 2024-09-13T18:50:02.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26baa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b406aaa0 0x7f26b406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26baa00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b40ccb40 con 0x7f26b40cb020 2024-09-13T18:50:02.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26baa00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b406b430 con 0x7f26b40cc6f0 2024-09-13T18:50:02.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26baa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b40b2ad0 con 0x7f26b406aaa0 2024-09-13T18:50:02.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26b9600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f26b40cb020 0x7f26b415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43612/0 (socket says 172.21.15.81:43612) 2024-09-13T18:50:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26b9600700 1 -- 172.21.15.81:0/3809554168 learned_addr learned my addr 172.21.15.81:0/3809554168 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26ba000700 1 --2- 172.21.15.81:0/3809554168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b406aaa0 0x7f26b406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26b3e00700 1 -- 172.21.15.81:0/3809554168 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979207678 0 0) 0x7f26b40ccb40 con 0x7f26b40cb020 2024-09-13T18:50:02.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26b3e00700 1 -- 172.21.15.81:0/3809554168 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f269c0035d0 con 0x7f26b40cb020 2024-09-13T18:50:02.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26ba000700 1 -- 172.21.15.81:0/3809554168 >> v1:172.21.15.178:6789/0 conn(0x7f26b40cc6f0 legacy=0x7f26b415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26b3e00700 1 -- 172.21.15.81:0/3809554168 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610243725 0 0) 0x7f26a0001110 con 0x7f26b40cc6f0 2024-09-13T18:50:02.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26ba000700 1 -- 172.21.15.81:0/3809554168 >> v1:172.21.15.81:6789/0 conn(0x7f26b40cb020 legacy=0x7f26b415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.007+0000 7f26ba000700 1 -- 172.21.15.81:0/3809554168 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b415b960 con 0x7f26b406aaa0 2024-09-13T18:50:02.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26ba000700 1 --2- 172.21.15.81:0/3809554168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b406aaa0 0x7f26b406aef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009dc0 tx=0x7f26ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e01b3ea0b916ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26b3e00700 1 -- 172.21.15.81:0/3809554168 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00e070 con 0x7f26b406aaa0 2024-09-13T18:50:02.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26b3e00700 1 -- 172.21.15.81:0/3809554168 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac00bb20 con 0x7f26b406aaa0 2024-09-13T18:50:02.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26b3e00700 1 -- 172.21.15.81:0/3809554168 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00bed0 con 0x7f26b406aaa0 2024-09-13T18:50:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 -- 172.21.15.81:0/3809554168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b406aaa0 msgr2=0x7f26b406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 --2- 172.21.15.81:0/3809554168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b406aaa0 0x7f26b406aef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009dc0 tx=0x7f26ac00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 -- 172.21.15.81:0/3809554168 shutdown_connections 2024-09-13T18:50:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 --2- 172.21.15.81:0/3809554168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b406aaa0 0x7f26b406aef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 -- 172.21.15.81:0/3809554168 >> 172.21.15.81:0/3809554168 conn(0x7f26b40b0c40 msgr2=0x7f26b406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 -- 172.21.15.81:0/3809554168 shutdown_connections 2024-09-13T18:50:02.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.011+0000 7f26baa00700 1 -- 172.21.15.81:0/3809554168 wait complete. 2024-09-13T18:50:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.015+0000 7f26baa00700 1 Processor -- start 2024-09-13T18:50:02.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.015+0000 7f26baa00700 1 -- start start 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 0x7f26b41545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b40cb020 0x7f26b41415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b40cc6f0 0x7f26b406cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4154ae0 con 0x7f26b406aaa0 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b413cfb0 con 0x7f26b40cc6f0 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b413d290 con 0x7f26b40cb020 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 0x7f26b41545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 0x7f26b41545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56406/0 (socket says 172.21.15.81:56406) 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 -- 172.21.15.81:0/1859433564 learned_addr learned my addr 172.21.15.81:0/1859433564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b8c00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b40cb020 0x7f26b41415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26ba000700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b40cc6f0 0x7f26b406cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 -- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b40cb020 msgr2=0x7f26b41415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b40cb020 0x7f26b41415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 -- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b40cc6f0 msgr2=0x7f26b406cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b40cc6f0 0x7f26b406cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 -- 172.21.15.81:0/1859433564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac009a70 con 0x7f26b406aaa0 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b9600700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 0x7f26b41545a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f26a800c4f0 tx=0x7f26a800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8005d90 con 0x7f26b406aaa0 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a80070d0 con 0x7f26b406aaa0 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b413d570 con 0x7f26b406aaa0 2024-09-13T18:50:02.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a8007440 con 0x7f26b406aaa0 2024-09-13T18:50:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b413db30 con 0x7f26b406aaa0 2024-09-13T18:50:02.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.019+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b41f04b0 con 0x7f26b406aaa0 2024-09-13T18:50:02.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.023+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26a80075a0 con 0x7f26b406aaa0 2024-09-13T18:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.023+0000 7f26b1600700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2694066760 0x7f2694068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.023+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f26a80833e0 con 0x7f26b406aaa0 2024-09-13T18:50:02.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.023+0000 7f26b8c00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2694066760 0x7f2694068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.027+0000 7f26b8c00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2694066760 0x7f2694068c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f26b413dfc0 tx=0x7f26a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.031+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26b41f04b0 con 0x7f26b406aaa0 2024-09-13T18:50:02.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.235+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26b41f04b0 con 0x7f26b406aaa0 2024-09-13T18:50:02.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.235+0000 7f26b1600700 1 -- 172.21.15.81:0/1859433564 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f26b41f04b0 con 0x7f26b406aaa0 2024-09-13T18:50:02.246 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:02.246 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":49,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:01.341420+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2694066760 msgr2=0x7f2694068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2694066760 0x7f2694068c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f26b413dfc0 tx=0x7f26a0009040 comp rx=0 tx=0).stop 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 msgr2=0x7f26b41545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 0x7f26b41545a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f26a800c4f0 tx=0x7f26a800c800 comp rx=0 tx=0).stop 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 shutdown_connections 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2694066760 0x7f2694068c20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26b40cc6f0 0x7f26b406cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26b40cb020 0x7f26b41415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 --2- 172.21.15.81:0/1859433564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b406aaa0 0x7f26b41545a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 >> 172.21.15.81:0/1859433564 conn(0x7f26b40b0c40 msgr2=0x7f26b40b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 shutdown_connections 2024-09-13T18:50:02.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.239+0000 7f26baa00700 1 -- 172.21.15.81:0/1859433564 wait complete. 2024-09-13T18:50:02.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:50:02.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:50:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.443+0000 7f7ed8a00700 1 Processor -- start 2024-09-13T18:50:02.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.443+0000 7f7ed8a00700 1 -- start start 2024-09-13T18:50:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.443+0000 7f7ed8a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ed415a770 0x7f7ed4071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.443+0000 7f7ed8a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7ed406f480 0x7f7ed4161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed4161740 con 0x7f7ed40b39b0 2024-09-13T18:50:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed41607b0 con 0x7f7ed406f480 2024-09-13T18:50:02.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed40b4120 con 0x7f7ed415a770 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ecbe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ed40b39b0 0x7f7ed406ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43620/0 (socket says 172.21.15.81:43620) 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ecbe00700 1 -- 172.21.15.81:0/4099798829 learned_addr learned my addr 172.21.15.81:0/4099798829 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed2800700 1 --2- 172.21.15.81:0/4099798829 >> v2:172.21.15.81:3300/0 conn(0x7f7ed406f480 0x7f7ed4161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed1e00700 1 --2- 172.21.15.81:0/4099798829 >> v2:172.21.15.178:3300/0 conn(0x7f7ed415a770 0x7f7ed4071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed1400700 1 -- 172.21.15.81:0/4099798829 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184461872 0 0) 0x7f7ebc001110 con 0x7f7ed40b39b0 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed1400700 1 -- 172.21.15.81:0/4099798829 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb80035d0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed2800700 1 -- 172.21.15.81:0/4099798829 >> v2:172.21.15.178:3300/0 conn(0x7f7ed415a770 msgr2=0x7f7ed4071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed2800700 1 --2- 172.21.15.81:0/4099798829 >> v2:172.21.15.178:3300/0 conn(0x7f7ed415a770 0x7f7ed4071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed2800700 1 -- 172.21.15.81:0/4099798829 >> v1:172.21.15.81:6789/0 conn(0x7f7ed40b39b0 legacy=0x7f7ed406ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed2800700 1 -- 172.21.15.81:0/4099798829 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed40b4400 con 0x7f7ed406f480 2024-09-13T18:50:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed2800700 1 --2- 172.21.15.81:0/4099798829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed406f480 0x7f7ed4161200 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40b2740 tx=0x7f7ecc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ff6418340bd4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed1400700 1 -- 172.21.15.81:0/4099798829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc00e070 con 0x7f7ed406f480 2024-09-13T18:50:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed1400700 1 -- 172.21.15.81:0/4099798829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc00bb20 con 0x7f7ed406f480 2024-09-13T18:50:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed1400700 1 -- 172.21.15.81:0/4099798829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc012430 con 0x7f7ed406f480 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- 172.21.15.81:0/4099798829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed406f480 msgr2=0x7f7ed4161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/4099798829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed406f480 0x7f7ed4161200 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7ed40b2740 tx=0x7f7ecc00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- 172.21.15.81:0/4099798829 shutdown_connections 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/4099798829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed406f480 0x7f7ed4161200 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/4099798829 >> v2:172.21.15.178:3300/0 conn(0x7f7ed415a770 0x7f7ed4071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- 172.21.15.81:0/4099798829 >> 172.21.15.81:0/4099798829 conn(0x7f7ed40b1e10 msgr2=0x7f7ed406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- 172.21.15.81:0/4099798829 shutdown_connections 2024-09-13T18:50:02.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.447+0000 7f7ed8a00700 1 -- 172.21.15.81:0/4099798829 wait complete. 2024-09-13T18:50:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.451+0000 7f7ed8a00700 1 Processor -- start 2024-09-13T18:50:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.451+0000 7f7ed8a00700 1 -- start start 2024-09-13T18:50:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ed406f480 0x7f7ed41525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 0x7f7ed40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ed415a770 0x7f7ed40cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40ce250 con 0x7f7ed40b39b0 2024-09-13T18:50:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40ce530 con 0x7f7ed415a770 2024-09-13T18:50:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40ce810 con 0x7f7ed406f480 2024-09-13T18:50:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 0x7f7ed40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 0x7f7ed40cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56420/0 (socket says 172.21.15.81:56420) 2024-09-13T18:50:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 -- 172.21.15.81:0/2311814159 learned_addr learned my addr 172.21.15.81:0/2311814159 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed1e00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ed406f480 0x7f7ed41525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed2800700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ed415a770 0x7f7ed40cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 -- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ed406f480 msgr2=0x7f7ed41525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ed406f480 0x7f7ed41525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 -- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ed415a770 msgr2=0x7f7ed40cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ed415a770 0x7f7ed40cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 -- 172.21.15.81:0/2311814159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc009a70 con 0x7f7ed40b39b0 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed1e00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ed406f480 0x7f7ed41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ecbe00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 0x7f7ed40cd6e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc001270 tx=0x7f7ebc00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc005d90 con 0x7f7ed40b39b0 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0070d0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc007480 con 0x7f7ed40b39b0 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed40ceaf0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed40cf2f0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.455+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4161200 con 0x7f7ed40b39b0 2024-09-13T18:50:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.459+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ebc0075e0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.459+0000 7f7eca000700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7eb0066730 0x7f7eb0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.459+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7ebc0833f0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.459+0000 7f7ed1e00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7eb0066730 0x7f7eb0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.459+0000 7f7ed1e00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7eb0066730 0x7f7eb0068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009ba0 tx=0x7f7ec4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.467+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ebc0508e0 con 0x7f7ed40b39b0 2024-09-13T18:50:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.655+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ed4161740 con 0x7f7ed40b39b0 2024-09-13T18:50:02.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.655+0000 7f7eca000700 1 -- 172.21.15.81:0/2311814159 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ed4161740 con 0x7f7ed40b39b0 2024-09-13T18:50:02.666 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7eb0066730 msgr2=0x7f7eb0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7eb0066730 0x7f7eb0068bf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4009ba0 tx=0x7f7ec4008040 comp rx=0 tx=0).stop 2024-09-13T18:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 msgr2=0x7f7ed40cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 0x7f7ed40cd6e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc001270 tx=0x7f7ebc00ca90 comp rx=0 tx=0).stop 2024-09-13T18:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 shutdown_connections 2024-09-13T18:50:02.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7eb0066730 0x7f7eb0068bf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ed415a770 0x7f7ed40cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed40b39b0 0x7f7ed40cd6e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 --2- 172.21.15.81:0/2311814159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ed406f480 0x7f7ed41525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 >> 172.21.15.81:0/2311814159 conn(0x7f7ed40b1e10 msgr2=0x7f7ed415e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.659+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 shutdown_connections 2024-09-13T18:50:02.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.663+0000 7f7ed8a00700 1 -- 172.21.15.81:0/2311814159 wait complete. 2024-09-13T18:50:02.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:50:02.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.859+0000 7f3b0a400700 1 Processor -- start 2024-09-13T18:50:02.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.859+0000 7f3b0a400700 1 -- start start 2024-09-13T18:50:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b0a400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b0406c880 0x7f3b040b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b0a400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0406cc60 0x7f3b0415d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b0a400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040b2fa0 con 0x7f3b0415d980 2024-09-13T18:50:02.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b0a400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040b50e0 con 0x7f3b0406c880 2024-09-13T18:50:02.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b0a400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040b3280 con 0x7f3b0406cc60 2024-09-13T18:50:02.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b0406c880 0x7f3b040b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3b0415d980 0x7f3b040ce120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43628/0 (socket says 172.21.15.81:43628) 2024-09-13T18:50:02.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09a00700 1 -- 172.21.15.81:0/1264100508 learned_addr learned my addr 172.21.15.81:0/1264100508 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:02.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3afbe00700 1 --2- 172.21.15.81:0/1264100508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0406cc60 0x7f3b0415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09000700 1 -- 172.21.15.81:0/1264100508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0406cc60 msgr2=0x7f3b0415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09000700 1 --2- 172.21.15.81:0/1264100508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0406cc60 0x7f3b0415d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09000700 1 -- 172.21.15.81:0/1264100508 >> v1:172.21.15.81:6789/0 conn(0x7f3b0415d980 legacy=0x7f3b040ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09000700 1 -- 172.21.15.81:0/1264100508 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040b3560 con 0x7f3b0406c880 2024-09-13T18:50:02.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b03e00700 1 -- 172.21.15.81:0/1264100508 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2200790876 0 0) 0x7f3b040b2fa0 con 0x7f3b0415d980 2024-09-13T18:50:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b09000700 1 --2- 172.21.15.81:0/1264100508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406c880 0x7f3b040b4ba0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3af400baf0 tx=0x7f3af400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb12383b06191b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b03e00700 1 -- 172.21.15.81:0/1264100508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af400dc70 con 0x7f3b0406c880 2024-09-13T18:50:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.863+0000 7f3b03e00700 1 -- 172.21.15.81:0/1264100508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af400ddd0 con 0x7f3b0406c880 2024-09-13T18:50:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b03e00700 1 -- 172.21.15.81:0/1264100508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4010690 con 0x7f3b0406c880 2024-09-13T18:50:02.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 -- 172.21.15.81:0/1264100508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406c880 msgr2=0x7f3b040b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 --2- 172.21.15.81:0/1264100508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406c880 0x7f3b040b4ba0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3af400baf0 tx=0x7f3af400be00 comp rx=0 tx=0).stop 2024-09-13T18:50:02.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 -- 172.21.15.81:0/1264100508 shutdown_connections 2024-09-13T18:50:02.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 --2- 172.21.15.81:0/1264100508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0406cc60 0x7f3b0415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 --2- 172.21.15.81:0/1264100508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406c880 0x7f3b040b4ba0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 -- 172.21.15.81:0/1264100508 >> 172.21.15.81:0/1264100508 conn(0x7f3b0406e660 msgr2=0x7f3b0406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:02.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 -- 172.21.15.81:0/1264100508 shutdown_connections 2024-09-13T18:50:02.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.867+0000 7f3b0a400700 1 -- 172.21.15.81:0/1264100508 wait complete. 2024-09-13T18:50:02.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 Processor -- start 2024-09-13T18:50:02.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 -- start start 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b0406c880 0x7f3b041f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 0x7f3b040ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0415d980 0x7f3b040c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b041f26c0 con 0x7f3b0406cc60 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040ae890 con 0x7f3b0406c880 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b0a400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04145990 con 0x7f3b0415d980 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 0x7f3b040ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 0x7f3b040ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56438/0 (socket says 172.21.15.81:56438) 2024-09-13T18:50:02.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 -- 172.21.15.81:0/216065306 learned_addr learned my addr 172.21.15.81:0/216065306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:02.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b09000700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b0406c880 0x7f3b041f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b09a00700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0415d980 0x7f3b040c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 -- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0415d980 msgr2=0x7f3b040c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0415d980 0x7f3b040c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 -- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b0406c880 msgr2=0x7f3b041f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b0406c880 0x7f3b041f3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 -- 172.21.15.81:0/216065306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af400b750 con 0x7f3b0406cc60 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b09000700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b0406c880 0x7f3b041f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b09a00700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0415d980 0x7f3b040c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3afbe00700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 0x7f3b040ae350 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9d0 tx=0x7f3aec00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec009720 con 0x7f3b0406cc60 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec00c850 con 0x7f3b0406cc60 2024-09-13T18:50:02.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.871+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00cbc0 con 0x7f3b0406cc60 2024-09-13T18:50:02.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.875+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b041f2980 con 0x7f3b0406cc60 2024-09-13T18:50:02.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.875+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b041f2f40 con 0x7f3b0406cc60 2024-09-13T18:50:02.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.875+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b040b2bc0 con 0x7f3b0406cc60 2024-09-13T18:50:02.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.875+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3aec00cd20 con 0x7f3b0406cc60 2024-09-13T18:50:02.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.875+0000 7f3b01600700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ae0066730 0x7f3ae0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:02.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.879+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3aec084080 con 0x7f3b0406cc60 2024-09-13T18:50:02.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.879+0000 7f3b09000700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ae0066730 0x7f3ae0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:02.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.879+0000 7f3b09000700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ae0066730 0x7f3ae0068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3af4000c00 tx=0x7f3af4013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:02.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:02.883+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3aec0b5db0 con 0x7f3b0406cc60 2024-09-13T18:50:03.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.075+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3b040b47d0 con 0x7f3b0406cc60 2024-09-13T18:50:03.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.079+0000 7f3b01600700 1 -- 172.21.15.81:0/216065306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3aec055080 con 0x7f3b0406cc60 2024-09-13T18:50:03.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:03.089 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:50:03.089 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:50:03.089 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:50:03.089 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:50:03.089 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:03.089 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ae0066730 msgr2=0x7f3ae0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ae0066730 0x7f3ae0068bf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3af4000c00 tx=0x7f3af4013000 comp rx=0 tx=0).stop 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 msgr2=0x7f3b040ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 0x7f3b040ae350 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3aec00e9d0 tx=0x7f3aec00ed90 comp rx=0 tx=0).stop 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 shutdown_connections 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ae0066730 0x7f3ae0068bf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b0415d980 0x7f3b040c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0406cc60 0x7f3b040ae350 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 --2- 172.21.15.81:0/216065306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b0406c880 0x7f3b041f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 >> 172.21.15.81:0/216065306 conn(0x7f3b0406e660 msgr2=0x7f3b040cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 shutdown_connections 2024-09-13T18:50:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.083+0000 7f3b0a400700 1 -- 172.21.15.81:0/216065306 wait complete. 2024-09-13T18:50:03.113 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:50:03.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:50:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.279+0000 7f6920a00700 1 Processor -- start 2024-09-13T18:50:03.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6920a00700 1 -- start start 2024-09-13T18:50:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6920a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f691c15cb40 0x7f691c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:03.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6920a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0cfcf0 0x7f691c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6920a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691c0af700 con 0x7f691c0b25b0 2024-09-13T18:50:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6920a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f691c0b2f60 con 0x7f691c15cb40 2024-09-13T18:50:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6920a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c0ce850 con 0x7f691c0cfcf0 2024-09-13T18:50:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6919e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f691c0b25b0 0x7f691c0d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43630/0 (socket says 172.21.15.81:43630) 2024-09-13T18:50:03.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.283+0000 7f6919e00700 1 -- 172.21.15.81:0/2595429584 learned_addr learned my addr 172.21.15.81:0/2595429584 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691a800700 1 --2- 172.21.15.81:0/2595429584 >> v2:172.21.15.178:3300/0 conn(0x7f691c15cb40 0x7f691c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691b200700 1 --2- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0cfcf0 0x7f691c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6919400700 1 -- 172.21.15.81:0/2595429584 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110442865 0 0) 0x7f691c0af700 con 0x7f691c0b25b0 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6919400700 1 -- 172.21.15.81:0/2595429584 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69000035d0 con 0x7f691c0b25b0 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691a800700 1 -- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0cfcf0 msgr2=0x7f691c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691a800700 1 --2- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0cfcf0 0x7f691c0b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691a800700 1 -- 172.21.15.81:0/2595429584 >> v1:172.21.15.81:6789/0 conn(0x7f691c0b25b0 legacy=0x7f691c0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691a800700 1 -- 172.21.15.81:0/2595429584 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c15cf20 con 0x7f691c15cb40 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f691a800700 1 --2- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c15cb40 0x7f691c0b3920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f690c009850 tx=0x7f690c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf531d4f763252c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:03.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6919400700 1 -- 172.21.15.81:0/2595429584 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c011830 con 0x7f691c15cb40 2024-09-13T18:50:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6919400700 1 -- 172.21.15.81:0/2595429584 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690c011990 con 0x7f691c15cb40 2024-09-13T18:50:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6919400700 1 -- 172.21.15.81:0/2595429584 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690c011d40 con 0x7f691c15cb40 2024-09-13T18:50:03.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 -- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c15cb40 msgr2=0x7f691c0b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 --2- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c15cb40 0x7f691c0b3920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f690c009850 tx=0x7f690c009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 -- 172.21.15.81:0/2595429584 shutdown_connections 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 --2- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0cfcf0 0x7f691c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 --2- 172.21.15.81:0/2595429584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c15cb40 0x7f691c0b3920 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 -- 172.21.15.81:0/2595429584 >> 172.21.15.81:0/2595429584 conn(0x7f691c066270 msgr2=0x7f691c071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 -- 172.21.15.81:0/2595429584 shutdown_connections 2024-09-13T18:50:03.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.287+0000 7f6920a00700 1 -- 172.21.15.81:0/2595429584 wait complete. 2024-09-13T18:50:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 Processor -- start 2024-09-13T18:50:03.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 -- start start 2024-09-13T18:50:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0b25b0 0x7f691c0ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c0cfcf0 0x7f691c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 0x7f691c150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c06b510 con 0x7f691c15cb40 2024-09-13T18:50:03.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691c06b7b0 con 0x7f691c0cfcf0 2024-09-13T18:50:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f691c06ba90 con 0x7f691c0b25b0 2024-09-13T18:50:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 0x7f691c150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 0x7f691c150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56440/0 (socket says 172.21.15.81:56440) 2024-09-13T18:50:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 -- 172.21.15.81:0/2950614705 learned_addr learned my addr 172.21.15.81:0/2950614705 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:03.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6919e00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c0cfcf0 0x7f691c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:03.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691a800700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0b25b0 0x7f691c0ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:03.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 -- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0b25b0 msgr2=0x7f691c0ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:03.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0b25b0 0x7f691c0ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 -- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c0cfcf0 msgr2=0x7f691c06c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:03.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c0cfcf0 0x7f691c06c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:03.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 -- 172.21.15.81:0/2950614705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c0094b0 con 0x7f691c15cb40 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691a800700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0b25b0 0x7f691c0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f691b200700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 0x7f691c150b30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f691400efc0 tx=0x7f691400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400cd40 con 0x7f691c15cb40 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691400f040 con 0x7f691c15cb40 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69140146c0 con 0x7f691c15cb40 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691c06bd70 con 0x7f691c15cb40 2024-09-13T18:50:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.291+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691c0ca9b0 con 0x7f691c15cb40 2024-09-13T18:50:03.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.295+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c0d04d0 con 0x7f691c15cb40 2024-09-13T18:50:03.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.295+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6914014820 con 0x7f691c15cb40 2024-09-13T18:50:03.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.295+0000 7f6912a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f68fc066730 0x7f68fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:03.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.295+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6914084920 con 0x7f691c15cb40 2024-09-13T18:50:03.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.299+0000 7f691a800700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f68fc066730 0x7f68fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.299+0000 7f691a800700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f68fc066730 0x7f68fc068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f690c000c00 tx=0x7f690c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:03.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.303+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6914051e00 con 0x7f691c15cb40 2024-09-13T18:50:03.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:03.483+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f691c0b0d50 con 0x7f691c15cb40 2024-09-13T18:50:04.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.091+0000 7f6912a00700 1 -- 172.21.15.81:0/2950614705 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6914018020 con 0x7f691c15cb40 2024-09-13T18:50:04.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f68fc066730 msgr2=0x7f68fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:04.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f68fc066730 0x7f68fc068bf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f690c000c00 tx=0x7f690c008030 comp rx=0 tx=0).stop 2024-09-13T18:50:04.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 msgr2=0x7f691c150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:04.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 0x7f691c150b30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f691400efc0 tx=0x7f691400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 shutdown_connections 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f68fc066730 0x7f68fc068bf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f691c15cb40 0x7f691c150b30 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f691c0cfcf0 0x7f691c06c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 --2- 172.21.15.81:0/2950614705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f691c0b25b0 0x7f691c0ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 >> 172.21.15.81:0/2950614705 conn(0x7f691c066270 msgr2=0x7f691c0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:04.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 shutdown_connections 2024-09-13T18:50:04.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.099+0000 7f6920a00700 1 -- 172.21.15.81:0/2950614705 wait complete. 2024-09-13T18:50:04.109 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:50:04.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:50:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.299+0000 7fb3d3e00700 1 Processor -- start 2024-09-13T18:50:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.299+0000 7fb3d3e00700 1 -- start start 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3d40cd380 0x7fb3d406c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3d40b41c0 0x7fb3d40b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d406cec0 con 0x7fb3d406c5a0 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40b5780 con 0x7fb3d40b41c0 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d40b5a60 con 0x7fb3d40cd380 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3d40b41c0 0x7fb3d40b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb3d40b41c0 0x7fb3d40b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56442/0 (socket says 172.21.15.81:56442) 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 -- 172.21.15.81:0/279347364 learned_addr learned my addr 172.21.15.81:0/279347364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d2000700 1 --2- 172.21.15.81:0/279347364 >> v2:172.21.15.178:3300/0 conn(0x7fb3d40cd380 0x7fb3d406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:04.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 -- 172.21.15.81:0/279347364 >> v2:172.21.15.178:3300/0 conn(0x7fb3d40cd380 msgr2=0x7fb3d406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:04.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 --2- 172.21.15.81:0/279347364 >> v2:172.21.15.178:3300/0 conn(0x7fb3d40cd380 0x7fb3d406c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 -- 172.21.15.81:0/279347364 >> v1:172.21.15.178:6789/0 conn(0x7fb3d406c5a0 legacy=0x7fb3d415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:04.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 -- 172.21.15.81:0/279347364 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40b39c0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d3400700 1 --2- 172.21.15.81:0/279347364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b4630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4072a90 tx=0x7fb3cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6483d36a838a5a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.303+0000 7fb3d1600700 1 -- 172.21.15.81:0/279347364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00e070 con 0x7fb3d40b41c0 2024-09-13T18:50:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d1600700 1 -- 172.21.15.81:0/279347364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc003a40 con 0x7fb3d40b41c0 2024-09-13T18:50:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d1600700 1 -- 172.21.15.81:0/279347364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc003df0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 -- 172.21.15.81:0/279347364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 msgr2=0x7fb3d40b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/279347364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b4630 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4072a90 tx=0x7fb3cc00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 -- 172.21.15.81:0/279347364 shutdown_connections 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/279347364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b4630 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/279347364 >> v2:172.21.15.178:3300/0 conn(0x7fb3d40cd380 0x7fb3d406c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 -- 172.21.15.81:0/279347364 >> 172.21.15.81:0/279347364 conn(0x7fb3d4066270 msgr2=0x7fb3d4071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 -- 172.21.15.81:0/279347364 shutdown_connections 2024-09-13T18:50:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.307+0000 7fb3d3e00700 1 -- 172.21.15.81:0/279347364 wait complete. 2024-09-13T18:50:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 Processor -- start 2024-09-13T18:50:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 -- start start 2024-09-13T18:50:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3d406c5a0 0x7fb3d40b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3d40cd380 0x7fb3d4149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40c5890 con 0x7fb3d40b41c0 2024-09-13T18:50:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40b2d30 con 0x7fb3d40cd380 2024-09-13T18:50:04.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.311+0000 7fb3d3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d414a500 con 0x7fb3d406c5a0 2024-09-13T18:50:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56444/0 (socket says 172.21.15.81:56444) 2024-09-13T18:50:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 -- 172.21.15.81:0/3008793640 learned_addr learned my addr 172.21.15.81:0/3008793640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2a00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3d406c5a0 0x7fb3d40b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d3400700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3d40cd380 0x7fb3d4149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:04.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 -- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3d406c5a0 msgr2=0x7fb3d40b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3d406c5a0 0x7fb3d40b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 -- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3d40cd380 msgr2=0x7fb3d4149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3d40cd380 0x7fb3d4149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:04.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 -- 172.21.15.81:0/3008793640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009b30 con 0x7fb3d40b41c0 2024-09-13T18:50:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d2000700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b27f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000e870 tx=0x7fb3c000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00095c0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0013680 con 0x7fb3d40b41c0 2024-09-13T18:50:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d40b2fd0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0013a10 con 0x7fb3d40b41c0 2024-09-13T18:50:04.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.315+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d40c5ae0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.319+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d406c980 con 0x7fb3d40b41c0 2024-09-13T18:50:04.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.319+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3c0013b90 con 0x7fb3d40b41c0 2024-09-13T18:50:04.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.319+0000 7fb3caa00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb3b4066730 0x7fb3b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.323+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fb3c0083fc0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.323+0000 7fb3d2a00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb3b4066730 0x7fb3b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:04.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.323+0000 7fb3d2a00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb3b4066730 0x7fb3b4068bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4005150 tx=0x7fb3c4007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:04.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.327+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3c00b5db0 con 0x7fb3d40b41c0 2024-09-13T18:50:04.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:04.507+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb3d4073660 con 0x7fb3d40b41c0 2024-09-13T18:50:05.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.111+0000 7fb3caa00700 1 -- 172.21.15.81:0/3008793640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3c00513d0 con 0x7fb3d40b41c0 2024-09-13T18:50:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb3b4066730 msgr2=0x7fb3b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb3b4066730 0x7fb3b4068bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4005150 tx=0x7fb3c4007ee0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 msgr2=0x7fb3d40b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b27f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb3c000e870 tx=0x7fb3c000eb80 comp rx=0 tx=0).stop 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 shutdown_connections 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb3b4066730 0x7fb3b4068bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3d40cd380 0x7fb3d4149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40b41c0 0x7fb3d40b27f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 --2- 172.21.15.81:0/3008793640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3d406c5a0 0x7fb3d40b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.123+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 >> 172.21.15.81:0/3008793640 conn(0x7fb3d4066270 msgr2=0x7fb3d406a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.127+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 shutdown_connections 2024-09-13T18:50:05.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.127+0000 7fb3d3e00700 1 -- 172.21.15.81:0/3008793640 wait complete. 2024-09-13T18:50:05.140 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:50:05.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:50:05.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.319+0000 7f61e2000700 1 Processor -- start 2024-09-13T18:50:05.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.319+0000 7f61e2000700 1 -- start start 2024-09-13T18:50:05.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61e2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61dc160fc0 0x7f61dc06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61e2000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc06d000 con 0x7f61dc0cf280 2024-09-13T18:50:05.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61e2000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc06c3f0 con 0x7f61dc0b3990 2024-09-13T18:50:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61e2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc06c6d0 con 0x7f61dc160fc0 2024-09-13T18:50:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61dbe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61dc0cf280 0x7f61dc1618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43634/0 (socket says 172.21.15.81:43634) 2024-09-13T18:50:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61dbe00700 1 -- 172.21.15.81:0/1235568153 learned_addr learned my addr 172.21.15.81:0/1235568153 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:05.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61db400700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61dc160fc0 0x7f61dc06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610867734 0 0) 0x7f61dc06d000 con 0x7f61dc0cf280 2024-09-13T18:50:05.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61c00035d0 con 0x7f61dc0cf280 2024-09-13T18:50:05.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472444796 0 0) 0x7f61c00035d0 con 0x7f61dc0cf280 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61dc160fc0 msgr2=0x7f61dc06be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61dc160fc0 0x7f61dc06be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 >> v1:172.21.15.178:6789/0 conn(0x7f61dc0b3990 legacy=0x7f61dc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc06c9b0 con 0x7f61dc0cf280 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f61d40019f0 con 0x7f61dc0cf280 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 >> v1:172.21.15.81:6789/0 conn(0x7f61dc0cf280 legacy=0x7f61dc1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c0003a50 0x7f61c0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0004400 0x7f61c00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c00050d0 0x7f61c000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc06c6d0 con 0x7f61c0004400 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000bfa0 con 0x7f61c0003a50 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c000c160 con 0x7f61c00050d0 2024-09-13T18:50:05.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61db400700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61dc160fc0 0x7f61dc06be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61daa00700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0004400 0x7f61c00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.323+0000 7f61dbe00700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c00050d0 0x7f61c000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61db400700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c0003a50 0x7f61c0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61daa00700 1 -- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c00050d0 msgr2=0x7f61c000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61daa00700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c00050d0 0x7f61c000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61daa00700 1 -- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c0003a50 msgr2=0x7f61c0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61daa00700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61c0003a50 0x7f61c0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61daa00700 1 -- 172.21.15.81:0/1235568153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00035d0 con 0x7f61c0004400 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61daa00700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0004400 0x7f61c00048d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0cb240 tx=0x7f61c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52143fca16b4798 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4001390 con 0x7f61c0004400 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c400c660 con 0x7f61c0004400 2024-09-13T18:50:05.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61da000700 1 -- 172.21.15.81:0/1235568153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c400ca10 con 0x7f61c0004400 2024-09-13T18:50:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61e2000700 1 -- 172.21.15.81:0/1235568153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0004400 msgr2=0x7f61c00048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61e2000700 1 --2- 172.21.15.81:0/1235568153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c0004400 0x7f61c00048d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0cb240 tx=0x7f61c00058a0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61dbe00700 1 -- 172.21.15.81:0/1235568153 reap_dead start 2024-09-13T18:50:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61e2000700 1 -- 172.21.15.81:0/1235568153 shutdown_connections 2024-09-13T18:50:05.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61e2000700 1 -- 172.21.15.81:0/1235568153 >> 172.21.15.81:0/1235568153 conn(0x7f61dc06a570 msgr2=0x7f61dc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61e2000700 1 -- 172.21.15.81:0/1235568153 shutdown_connections 2024-09-13T18:50:05.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.327+0000 7f61e2000700 1 -- 172.21.15.81:0/1235568153 wait complete. 2024-09-13T18:50:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.331+0000 7f61e2000700 1 Processor -- start 2024-09-13T18:50:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.331+0000 7f61e2000700 1 -- start start 2024-09-13T18:50:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c0004400 0x7f61dc0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61dc149e70 0x7f61dc0cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 0x7f61dc0cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0a8f40 con 0x7f61dc1eb670 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc14a3e0 con 0x7f61dc149e70 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc14af60 con 0x7f61c0004400 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 0x7f61dc0cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 0x7f61dc0cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56476/0 (socket says 172.21.15.81:56476) 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 -- 172.21.15.81:0/3882339437 learned_addr learned my addr 172.21.15.81:0/3882339437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61daa00700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61dc149e70 0x7f61dc0cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61db400700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c0004400 0x7f61dc0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 -- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c0004400 msgr2=0x7f61dc0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c0004400 0x7f61dc0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 -- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61dc149e70 msgr2=0x7f61dc0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61dc149e70 0x7f61dc0cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 -- 172.21.15.81:0/3882339437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc0b3f50 con 0x7f61dc1eb670 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61db400700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c0004400 0x7f61dc0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:05.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61dbe00700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 0x7f61dc0cd980 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f61d4002230 tx=0x7f61d400adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4007650 con 0x7f61dc1eb670 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d40077b0 con 0x7f61dc1eb670 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc14a630 con 0x7f61dc1eb670 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4007b60 con 0x7f61dc1eb670 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc14abf0 con 0x7f61dc1eb670 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.335+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc15ea10 con 0x7f61dc1eb670 2024-09-13T18:50:05.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.339+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f61d401d460 con 0x7f61dc1eb670 2024-09-13T18:50:05.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.339+0000 7f61d3400700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f61b8066760 0x7f61b8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.339+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f61d40852e0 con 0x7f61dc1eb670 2024-09-13T18:50:05.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.339+0000 7f61db400700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f61b8066760 0x7f61b8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.343+0000 7f61db400700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f61b8066760 0x7f61b8068c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0ce0e0 tx=0x7f61cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:05.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.347+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f61d4052550 con 0x7f61dc1eb670 2024-09-13T18:50:05.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.567+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f61dc0674c0 con 0x7f61dc1eb670 2024-09-13T18:50:05.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.583+0000 7f61d3400700 1 -- 172.21.15.81:0/3882339437 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f61d4055b70 con 0x7f61dc1eb670 2024-09-13T18:50:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.587+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f61b8066760 msgr2=0x7f61b8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.587+0000 7f61e2000700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f61b8066760 0x7f61b8068c20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0ce0e0 tx=0x7f61cc008040 comp rx=0 tx=0).stop 2024-09-13T18:50:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.587+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 msgr2=0x7f61dc0cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.587+0000 7f61e2000700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 0x7f61dc0cd980 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f61d4002230 tx=0x7f61d400adb0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 shutdown_connections 2024-09-13T18:50:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f61b8066760 0x7f61b8068c20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61dc1eb670 0x7f61dc0cd980 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61dc149e70 0x7f61dc0cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 --2- 172.21.15.81:0/3882339437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61c0004400 0x7f61dc0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 >> 172.21.15.81:0/3882339437 conn(0x7f61dc06a570 msgr2=0x7f61dc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:05.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 shutdown_connections 2024-09-13T18:50:05.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.591+0000 7f61e2000700 1 -- 172.21.15.81:0/3882339437 wait complete. 2024-09-13T18:50:05.610 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 7 and data pool 8 2024-09-13T18:50:05.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:05.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.791+0000 7f6595a00700 1 Processor -- start 2024-09-13T18:50:05.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.791+0000 7f6595a00700 1 -- start start 2024-09-13T18:50:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6595a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 0x7f659006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6595a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900b1e80 con 0x7f6590071d20 2024-09-13T18:50:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6595a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900ce140 con 0x7f659006a5d0 2024-09-13T18:50:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6587e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6590071d20 0x7f65900cd610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43644/0 (socket says 172.21.15.81:43644) 2024-09-13T18:50:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6587e00700 1 -- 172.21.15.81:0/2417299771 learned_addr learned my addr 172.21.15.81:0/2417299771 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6595a00700 1 -- 172.21.15.81:0/2417299771 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900cde60 con 0x7f65900b19f0 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658f400700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 0x7f659006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1715615055 0 0) 0x7f65900b1e80 con 0x7f6590071d20 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65740035d0 con 0x7f6590071d20 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889466254 0 0) 0x7f65740035d0 con 0x7f6590071d20 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 msgr2=0x7f659006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 0x7f659006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 >> v1:172.21.15.178:6789/0 conn(0x7f659006a5d0 legacy=0x7f659006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659006c3b0 con 0x7f6590071d20 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f6578001670 con 0x7f6590071d20 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 >> v1:172.21.15.81:6789/0 conn(0x7f6590071d20 legacy=0x7f65900cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6574003a50 0x7f6574003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574004400 0x7f65740048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 0x7f6574005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900cde60 con 0x7f6574003a50 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657400ba30 con 0x7f6574004400 2024-09-13T18:50:05.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657400bbf0 con 0x7f65900b19f0 2024-09-13T18:50:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658ea00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6574003a50 0x7f6574003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f658f400700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 0x7f6574005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.795+0000 7f6587e00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574004400 0x7f65740048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658ea00700 1 -- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 msgr2=0x7f6574005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658ea00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65900b19f0 0x7f6574005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658ea00700 1 -- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574004400 msgr2=0x7f65740048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658ea00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574004400 0x7f65740048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658ea00700 1 -- 172.21.15.81:0/2417299771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740035d0 con 0x7f6574003a50 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6587e00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574004400 0x7f65740048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658ea00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6574003a50 0x7f6574003e30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f65800019a0 tx=0x7f65740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ec02403162c0fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580016070 con 0x7f6574003a50 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580006880 con 0x7f6574003a50 2024-09-13T18:50:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658e000700 1 -- 172.21.15.81:0/2417299771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580001440 con 0x7f6574003a50 2024-09-13T18:50:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6595a00700 1 -- 172.21.15.81:0/2417299771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6574003a50 msgr2=0x7f6574003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6595a00700 1 --2- 172.21.15.81:0/2417299771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6574003a50 0x7f6574003e30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f65800019a0 tx=0x7f65740058a0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f658f400700 1 -- 172.21.15.81:0/2417299771 reap_dead start 2024-09-13T18:50:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6595a00700 1 -- 172.21.15.81:0/2417299771 shutdown_connections 2024-09-13T18:50:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6595a00700 1 -- 172.21.15.81:0/2417299771 >> 172.21.15.81:0/2417299771 conn(0x7f65900b08d0 msgr2=0x7f65900b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6595a00700 1 -- 172.21.15.81:0/2417299771 shutdown_connections 2024-09-13T18:50:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.799+0000 7f6595a00700 1 -- 172.21.15.81:0/2417299771 wait complete. 2024-09-13T18:50:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 Processor -- start 2024-09-13T18:50:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 -- start start 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574003a50 0x7f65901498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 0x7f6590160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65901f9fa0 0x7f65901fa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901fa990 con 0x7f6590147460 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590147c30 con 0x7f6574003a50 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6595a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65901457f0 con 0x7f65901f9fa0 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6587e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 0x7f6590160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6587e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 0x7f6590160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56500/0 (socket says 172.21.15.81:56500) 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f6587e00700 1 -- 172.21.15.81:0/3575703980 learned_addr learned my addr 172.21.15.81:0/3575703980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.803+0000 7f658ea00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574003a50 0x7f65901498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f658f400700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65901f9fa0 0x7f65901fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6587e00700 1 -- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65901f9fa0 msgr2=0x7f65901fa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6587e00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65901f9fa0 0x7f65901fa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6587e00700 1 -- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574003a50 msgr2=0x7f65901498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6587e00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574003a50 0x7f65901498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6587e00700 1 -- 172.21.15.81:0/3575703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590147950 con 0x7f6590147460 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f658ea00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574003a50 0x7f65901498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6587e00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 0x7f6590160b00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6578001200 tx=0x7f657800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578005e20 con 0x7f6590147460 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657800c780 con 0x7f6590147460 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65901451a0 con 0x7f6590147460 2024-09-13T18:50:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657800caf0 con 0x7f6590147460 2024-09-13T18:50:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6590161040 con 0x7f6590147460 2024-09-13T18:50:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.807+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659006a9b0 con 0x7f6590147460 2024-09-13T18:50:05.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.811+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f657800cc50 con 0x7f6590147460 2024-09-13T18:50:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.811+0000 7f6586a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f656c066760 0x7f656c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.811+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6578083c80 con 0x7f6590147460 2024-09-13T18:50:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.811+0000 7f658ea00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f656c066760 0x7f656c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.811+0000 7f658ea00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f656c066760 0x7f656c068c20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6580000fd0 tx=0x7f6580009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:05.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:05.819+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6578050f40 con 0x7f6590147460 2024-09-13T18:50:06.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.011+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65900b2180 con 0x7f6590147460 2024-09-13T18:50:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6586a00700 1 -- 172.21.15.81:0/3575703980 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f6578054560 con 0x7f6590147460 2024-09-13T18:50:06.022 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:06.023 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:05.573717+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f656c066760 msgr2=0x7f656c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f656c066760 0x7f656c068c20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6580000fd0 tx=0x7f6580009030 comp rx=0 tx=0).stop 2024-09-13T18:50:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 msgr2=0x7f6590160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 0x7f6590160b00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6578001200 tx=0x7f657800ee80 comp rx=0 tx=0).stop 2024-09-13T18:50:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 shutdown_connections 2024-09-13T18:50:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f656c066760 0x7f656c068c20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65901f9fa0 0x7f65901fa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6590147460 0x7f6590160b00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 --2- 172.21.15.81:0/3575703980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6574003a50 0x7f65901498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 >> 172.21.15.81:0/3575703980 conn(0x7f65900b08d0 msgr2=0x7f65900ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 shutdown_connections 2024-09-13T18:50:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.015+0000 7f6595a00700 1 -- 172.21.15.81:0/3575703980 wait complete. 2024-09-13T18:50:06.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:06.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa877200700 1 Processor -- start 2024-09-13T18:50:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa877200700 1 -- start start 2024-09-13T18:50:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa877200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa87806aaa0 0x7fa87806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa877200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780ccb40 con 0x7fa8780cb020 2024-09-13T18:50:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa877200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87806b430 con 0x7fa8780cc6f0 2024-09-13T18:50:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa877200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780b2ad0 con 0x7fa87806aaa0 2024-09-13T18:50:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa875e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa8780cb020 0x7fa87815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43648/0 (socket says 172.21.15.81:43648) 2024-09-13T18:50:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa875e00700 1 -- 172.21.15.81:0/2003888367 learned_addr learned my addr 172.21.15.81:0/2003888367 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa876800700 1 --2- 172.21.15.81:0/2003888367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa87806aaa0 0x7fa87806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383917168 0 0) 0x7fa8780ccb40 con 0x7fa8780cb020 2024-09-13T18:50:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85c0035d0 con 0x7fa8780cb020 2024-09-13T18:50:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223518093 0 0) 0x7fa864001110 con 0x7fa8780cc6f0 2024-09-13T18:50:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8780ccb40 con 0x7fa8780cc6f0 2024-09-13T18:50:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.211+0000 7fa876800700 1 -- 172.21.15.81:0/2003888367 >> v1:172.21.15.178:6789/0 conn(0x7fa8780cc6f0 legacy=0x7fa87815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa876800700 1 -- 172.21.15.81:0/2003888367 >> v1:172.21.15.81:6789/0 conn(0x7fa8780cb020 legacy=0x7fa87815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238546053 0 0) 0x7fa85c0035d0 con 0x7fa8780cb020 2024-09-13T18:50:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa876800700 1 -- 172.21.15.81:0/2003888367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87815b960 con 0x7fa87806aaa0 2024-09-13T18:50:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa876800700 1 --2- 172.21.15.81:0/2003888367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa87806aaa0 0x7fa87806aef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa870009dc0 tx=0x7fa87000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f6cca2bc104d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000e070 con 0x7fa87806aaa0 2024-09-13T18:50:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87000bb20 con 0x7fa87806aaa0 2024-09-13T18:50:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa874a00700 1 -- 172.21.15.81:0/2003888367 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000bed0 con 0x7fa87806aaa0 2024-09-13T18:50:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 -- 172.21.15.81:0/2003888367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa87806aaa0 msgr2=0x7fa87806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 --2- 172.21.15.81:0/2003888367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa87806aaa0 0x7fa87806aef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa870009dc0 tx=0x7fa87000b330 comp rx=0 tx=0).stop 2024-09-13T18:50:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 -- 172.21.15.81:0/2003888367 shutdown_connections 2024-09-13T18:50:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 --2- 172.21.15.81:0/2003888367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa87806aaa0 0x7fa87806aef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 -- 172.21.15.81:0/2003888367 >> 172.21.15.81:0/2003888367 conn(0x7fa8780b0c40 msgr2=0x7fa87806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 -- 172.21.15.81:0/2003888367 shutdown_connections 2024-09-13T18:50:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.215+0000 7fa877200700 1 -- 172.21.15.81:0/2003888367 wait complete. 2024-09-13T18:50:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 Processor -- start 2024-09-13T18:50:06.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 -- start start 2024-09-13T18:50:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87806aaa0 0x7fa878155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 0x7fa87813d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8780cc6f0 0x7fa878136130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8781567c0 con 0x7fa8780cb020 2024-09-13T18:50:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8781564e0 con 0x7fa87806aaa0 2024-09-13T18:50:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa877200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87813dbf0 con 0x7fa8780cc6f0 2024-09-13T18:50:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa875400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 0x7fa87813d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa875400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 0x7fa87813d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56502/0 (socket says 172.21.15.81:56502) 2024-09-13T18:50:06.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa875400700 1 -- 172.21.15.81:0/4081672215 learned_addr learned my addr 172.21.15.81:0/4081672215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa876800700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8780cc6f0 0x7fa878136130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.219+0000 7fa875e00700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87806aaa0 0x7fa878155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa875400700 1 -- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8780cc6f0 msgr2=0x7fa878136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa875400700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8780cc6f0 0x7fa878136130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa875400700 1 -- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87806aaa0 msgr2=0x7fa878155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa875400700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87806aaa0 0x7fa878155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa875400700 1 -- 172.21.15.81:0/4081672215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009a70 con 0x7fa8780cb020 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa876800700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8780cc6f0 0x7fa878136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa875400700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 0x7fa87813d3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa86400c4d0 tx=0x7fa86400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8640052d0 con 0x7fa8780cb020 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864005450 con 0x7fa8780cb020 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87813ded0 con 0x7fa8780cb020 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8640038e0 con 0x7fa8780cb020 2024-09-13T18:50:06.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa878136670 con 0x7fa8780cb020 2024-09-13T18:50:06.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.223+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87813da50 con 0x7fa8780cb020 2024-09-13T18:50:06.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.227+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa864003a40 con 0x7fa8780cb020 2024-09-13T18:50:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.227+0000 7fa86e000700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa858066780 0x7fa858068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.227+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa8640836f0 con 0x7fa8780cb020 2024-09-13T18:50:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.227+0000 7fa875e00700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa858066780 0x7fa858068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.227+0000 7fa875e00700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa858066780 0x7fa858068c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa8680013c0 tx=0x7fa868009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:06.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.235+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa87813da50 con 0x7fa8780cb020 2024-09-13T18:50:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.419+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87806b430 con 0x7fa8780cb020 2024-09-13T18:50:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.423+0000 7fa86e000700 1 -- 172.21.15.81:0/4081672215 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16787 (secure 0 0 0) 0x7fa87806b430 con 0x7fa8780cb020 2024-09-13T18:50:06.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:06.434 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:05.573717+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa858066780 msgr2=0x7fa858068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa858066780 0x7fa858068c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa8680013c0 tx=0x7fa868009040 comp rx=0 tx=0).stop 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 msgr2=0x7fa87813d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 0x7fa87813d3c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa86400c4d0 tx=0x7fa86400c890 comp rx=0 tx=0).stop 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 shutdown_connections 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa858066780 0x7fa858068c40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8780cc6f0 0x7fa878136130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8780cb020 0x7fa87813d3c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 --2- 172.21.15.81:0/4081672215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa87806aaa0 0x7fa878155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 >> 172.21.15.81:0/4081672215 conn(0x7fa8780b0c40 msgr2=0x7fa878158de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 shutdown_connections 2024-09-13T18:50:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.427+0000 7fa877200700 1 -- 172.21.15.81:0/4081672215 wait complete. 2024-09-13T18:50:06.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:50:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.619+0000 7f70b6a00700 1 Processor -- start 2024-09-13T18:50:06.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.619+0000 7f70b6a00700 1 -- start start 2024-09-13T18:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b6a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70b0158660 0x7f70b0071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b6a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b015e980 con 0x7f70b0158280 2024-09-13T18:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b6a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b015ec60 con 0x7f70b015e420 2024-09-13T18:50:06.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b6a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b015ef40 con 0x7f70b0158660 2024-09-13T18:50:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b4c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f70b0158660 0x7f70b0071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b5600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70b0158280 0x7f70b006cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60348/0 (socket says 172.21.15.81:60348) 2024-09-13T18:50:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b5600700 1 -- 172.21.15.81:0/1509494110 learned_addr learned my addr 172.21.15.81:0/1509494110 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70afe00700 1 -- 172.21.15.81:0/1509494110 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437572240 0 0) 0x7f70b015e980 con 0x7f70b0158280 2024-09-13T18:50:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b4c00700 1 -- 172.21.15.81:0/1509494110 >> v1:172.21.15.178:6789/0 conn(0x7f70b015e420 legacy=0x7f70b00cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b4c00700 1 -- 172.21.15.81:0/1509494110 >> v1:172.21.15.81:6789/0 conn(0x7f70b0158280 legacy=0x7f70b006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.623+0000 7f70b4c00700 1 -- 172.21.15.81:0/1509494110 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b015f220 con 0x7f70b0158660 2024-09-13T18:50:06.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b4c00700 1 --2- 172.21.15.81:0/1509494110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b0158660 0x7f70b0071a00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f709c009850 tx=0x7f709c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f106d3b02a67e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70afe00700 1 -- 172.21.15.81:0/1509494110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c011830 con 0x7f70b0158660 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70afe00700 1 -- 172.21.15.81:0/1509494110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c011990 con 0x7f70b0158660 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70afe00700 1 -- 172.21.15.81:0/1509494110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c011d20 con 0x7f70b0158660 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 -- 172.21.15.81:0/1509494110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b0158660 msgr2=0x7f70b0071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 --2- 172.21.15.81:0/1509494110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b0158660 0x7f70b0071a00 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f709c009850 tx=0x7f709c009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 -- 172.21.15.81:0/1509494110 shutdown_connections 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 --2- 172.21.15.81:0/1509494110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b0158660 0x7f70b0071a00 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 -- 172.21.15.81:0/1509494110 >> 172.21.15.81:0/1509494110 conn(0x7f70b006a780 msgr2=0x7f70b006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 -- 172.21.15.81:0/1509494110 shutdown_connections 2024-09-13T18:50:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.627+0000 7f70b6a00700 1 -- 172.21.15.81:0/1509494110 wait complete. 2024-09-13T18:50:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 Processor -- start 2024-09-13T18:50:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 -- start start 2024-09-13T18:50:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b0158280 0x7f70b01f19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 0x7f70b01f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70b01f5b20 0x7f70b00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01f5fb0 con 0x7f70b015e420 2024-09-13T18:50:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00ce910 con 0x7f70b0158280 2024-09-13T18:50:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01f1f30 con 0x7f70b01f5b20 2024-09-13T18:50:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 0x7f70b01f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 0x7f70b01f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53088/0 (socket says 172.21.15.81:53088) 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 -- 172.21.15.81:0/2156020101 learned_addr learned my addr 172.21.15.81:0/2156020101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b5600700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b0158280 0x7f70b01f19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b6000700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70b01f5b20 0x7f70b00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 -- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70b01f5b20 msgr2=0x7f70b00cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70b01f5b20 0x7f70b00cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 -- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b0158280 msgr2=0x7f70b01f19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b0158280 0x7f70b01f19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.631+0000 7f70b4c00700 1 -- 172.21.15.81:0/2156020101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0094b0 con 0x7f70b015e420 2024-09-13T18:50:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70b4c00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 0x7f70b01f55e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f709c009fd0 tx=0x7f709c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00bab0 con 0x7f70b015e420 2024-09-13T18:50:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c01f070 con 0x7f70b015e420 2024-09-13T18:50:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b0148760 con 0x7f70b015e420 2024-09-13T18:50:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709c00be10 con 0x7f70b015e420 2024-09-13T18:50:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b00ce630 con 0x7f70b015e420 2024-09-13T18:50:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.635+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b0071a00 con 0x7f70b015e420 2024-09-13T18:50:06.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.639+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f709c01a430 con 0x7f70b015e420 2024-09-13T18:50:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.639+0000 7f70ad600700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7090066730 0x7f7090068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.639+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f709c021070 con 0x7f70b015e420 2024-09-13T18:50:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.639+0000 7f70b5600700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7090066730 0x7f7090068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.639+0000 7f70b5600700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7090066730 0x7f7090068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f70a4007b30 tx=0x7f70a4007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:06.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.647+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f709c052c70 con 0x7f70b015e420 2024-09-13T18:50:06.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:06.863+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f70b006b3a0 con 0x7f70b015e420 2024-09-13T18:50:07.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.602+0000 7f70ad600700 1 -- 172.21.15.81:0/2156020101 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f709c015020 con 0x7f70b015e420 2024-09-13T18:50:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7090066730 msgr2=0x7f7090068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:07.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7090066730 0x7f7090068bf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f70a4007b30 tx=0x7f70a4007a80 comp rx=0 tx=0).stop 2024-09-13T18:50:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 msgr2=0x7f70b01f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 0x7f70b01f55e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f709c009fd0 tx=0x7f709c004770 comp rx=0 tx=0).stop 2024-09-13T18:50:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 shutdown_connections 2024-09-13T18:50:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7090066730 0x7f7090068bf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70b01f5b20 0x7f70b00cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70b015e420 0x7f70b01f55e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.606+0000 7f70b6a00700 1 --2- 172.21.15.81:0/2156020101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70b0158280 0x7f70b01f19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.610+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 >> 172.21.15.81:0/2156020101 conn(0x7f70b006a780 msgr2=0x7f70b015b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:07.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.610+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 shutdown_connections 2024-09-13T18:50:07.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.610+0000 7f70b6a00700 1 -- 172.21.15.81:0/2156020101 wait complete. 2024-09-13T18:50:07.641 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:50:07.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:50:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.814+0000 7f5eed400700 1 Processor -- start 2024-09-13T18:50:07.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.814+0000 7f5eed400700 1 -- start start 2024-09-13T18:50:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eed400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ee81601b0 0x7f5ee80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eed400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee8160840 0x7f5ee8160c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eed400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee80ce1f0 con 0x7f5ee81611c0 2024-09-13T18:50:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eed400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee80d0710 con 0x7f5ee81601b0 2024-09-13T18:50:07.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eed400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee8161630 con 0x7f5ee8160840 2024-09-13T18:50:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5ee7e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ee81601b0 0x7f5ee80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5ee7400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee8160840 0x7f5ee8160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eeca00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f5ee81611c0 0x7f5ee80b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:53736/0 (socket says 172.21.15.81:53736) 2024-09-13T18:50:07.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.818+0000 7f5eeca00700 1 -- 172.21.15.81:0/868548369 learned_addr learned my addr 172.21.15.81:0/868548369 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee7e00700 1 -- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee8160840 msgr2=0x7f5ee8160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee8160840 0x7f5ee8160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee7e00700 1 -- 172.21.15.81:0/868548369 >> v1:172.21.15.178:6789/0 conn(0x7f5ee81611c0 legacy=0x7f5ee80b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee7e00700 1 -- 172.21.15.81:0/868548369 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8160590 con 0x7f5ee81601b0 2024-09-13T18:50:07.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b36d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009850 tx=0x7f5ed8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=659d0bc4bc6d282 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee6a00700 1 -- 172.21.15.81:0/868548369 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8011830 con 0x7f5ee81601b0 2024-09-13T18:50:07.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee6a00700 1 -- 172.21.15.81:0/868548369 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8011990 con 0x7f5ee81601b0 2024-09-13T18:50:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5ee6a00700 1 -- 172.21.15.81:0/868548369 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8011d40 con 0x7f5ee81601b0 2024-09-13T18:50:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 -- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee81601b0 msgr2=0x7f5ee80b36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:07.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 --2- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b36d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009850 tx=0x7f5ed8009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 -- 172.21.15.81:0/868548369 shutdown_connections 2024-09-13T18:50:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 --2- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee8160840 0x7f5ee8160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 --2- 172.21.15.81:0/868548369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b36d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 -- 172.21.15.81:0/868548369 >> 172.21.15.81:0/868548369 conn(0x7f5ee80d2b40 msgr2=0x7f5ee80d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 -- 172.21.15.81:0/868548369 shutdown_connections 2024-09-13T18:50:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.822+0000 7f5eed400700 1 -- 172.21.15.81:0/868548369 wait complete. 2024-09-13T18:50:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 Processor -- start 2024-09-13T18:50:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 -- start start 2024-09-13T18:50:07.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee8160840 0x7f5ee80b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee81611c0 0x7f5ee80b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b62e0 con 0x7f5ee81601b0 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b65c0 con 0x7f5ee8160840 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eed400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80b68a0 con 0x7f5ee81611c0 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53094/0 (socket says 172.21.15.81:53094) 2024-09-13T18:50:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1682130354 learned_addr learned my addr 172.21.15.81:0/1682130354 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee8160840 0x7f5ee80b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5eeca00700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee81611c0 0x7f5ee80b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee81611c0 msgr2=0x7f5ee80b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee81611c0 0x7f5ee80b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee8160840 msgr2=0x7f5ee80b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee8160840 0x7f5ee80b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 -- 172.21.15.81:0/1682130354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80094b0 con 0x7f5ee81601b0 2024-09-13T18:50:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.826+0000 7f5ee7e00700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b7380 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8014040 tx=0x7f5ed8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.830+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80036c0 con 0x7f5ee81601b0 2024-09-13T18:50:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.830+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed801e070 con 0x7f5ee81601b0 2024-09-13T18:50:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.830+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8003a80 con 0x7f5ee81601b0 2024-09-13T18:50:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.830+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80b6b80 con 0x7f5ee81601b0 2024-09-13T18:50:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.830+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80b8190 con 0x7f5ee81601b0 2024-09-13T18:50:07.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.830+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee80b70a0 con 0x7f5ee81601b0 2024-09-13T18:50:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.834+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ed8003be0 con 0x7f5ee81601b0 2024-09-13T18:50:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.834+0000 7f5edfe00700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec8066730 0x7f5ec8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.834+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5ed8020070 con 0x7f5ee81601b0 2024-09-13T18:50:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.834+0000 7f5ee7400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec8066730 0x7f5ec8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.834+0000 7f5ee7400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec8066730 0x7f5ec8068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81f6c90 tx=0x7f5ed4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:07.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:07.842+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ed80528c0 con 0x7f5ee81601b0 2024-09-13T18:50:08.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.058+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5ee80d3840 con 0x7f5ee81601b0 2024-09-13T18:50:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.610+0000 7f5edfe00700 1 -- 172.21.15.81:0/1682130354 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ed8055ee0 con 0x7f5ee81601b0 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec8066730 msgr2=0x7f5ec8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec8066730 0x7f5ec8068bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ee81f6c90 tx=0x7f5ed4009240 comp rx=0 tx=0).stop 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 msgr2=0x7f5ee80b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b7380 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8014040 tx=0x7f5ed8004770 comp rx=0 tx=0).stop 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 shutdown_connections 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ec8066730 0x7f5ec8068bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ee81611c0 0x7f5ee80b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ee8160840 0x7f5ee80b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 --2- 172.21.15.81:0/1682130354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ee81601b0 0x7f5ee80b7380 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 >> 172.21.15.81:0/1682130354 conn(0x7f5ee80d2b40 msgr2=0x7f5ee806d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 shutdown_connections 2024-09-13T18:50:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.614+0000 7f5eed400700 1 -- 172.21.15.81:0/1682130354 wait complete. 2024-09-13T18:50:08.647 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:50:08.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:08.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.802+0000 7f7c27200700 1 Processor -- start 2024-09-13T18:50:08.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.802+0000 7f7c27200700 1 -- start start 2024-09-13T18:50:08.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c2806aaa0 0x7f7c2815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:08.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2815e9f0 0x7f7c2815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:08.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2815e560 con 0x7f7c280b3980 2024-09-13T18:50:08.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280adf90 con 0x7f7c2806aaa0 2024-09-13T18:50:08.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815d920 con 0x7f7c2815e9f0 2024-09-13T18:50:08.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c2806aaa0 0x7f7c2815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7c2806aaa0 0x7f7c2815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53100/0 (socket says 172.21.15.81:53100) 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 -- 172.21.15.81:0/2480880592 learned_addr learned my addr 172.21.15.81:0/2480880592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c26800700 1 --2- 172.21.15.81:0/2480880592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2815e9f0 0x7f7c2815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 -- 172.21.15.81:0/2480880592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2815e9f0 msgr2=0x7f7c2815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 --2- 172.21.15.81:0/2480880592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2815e9f0 0x7f7c2815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 -- 172.21.15.81:0/2480880592 >> v1:172.21.15.178:6789/0 conn(0x7f7c280b3980 legacy=0x7f7c2806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:08.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 -- 172.21.15.81:0/2480880592 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2815dc00 con 0x7f7c2806aaa0 2024-09-13T18:50:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25e00700 1 --2- 172.21.15.81:0/2480880592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2806aaa0 0x7f7c2815d310 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009910 tx=0x7f7c18009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0490fc1d8329cb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25400700 1 -- 172.21.15.81:0/2480880592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18011830 con 0x7f7c2806aaa0 2024-09-13T18:50:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25400700 1 -- 172.21.15.81:0/2480880592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c18011990 con 0x7f7c2806aaa0 2024-09-13T18:50:08.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c25400700 1 -- 172.21.15.81:0/2480880592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c18011d40 con 0x7f7c2806aaa0 2024-09-13T18:50:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 -- 172.21.15.81:0/2480880592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2806aaa0 msgr2=0x7f7c2815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:08.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.806+0000 7f7c27200700 1 --2- 172.21.15.81:0/2480880592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2806aaa0 0x7f7c2815d310 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009910 tx=0x7f7c18009c20 comp rx=0 tx=0).stop 2024-09-13T18:50:08.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 -- 172.21.15.81:0/2480880592 shutdown_connections 2024-09-13T18:50:08.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 --2- 172.21.15.81:0/2480880592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2815e9f0 0x7f7c2815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 --2- 172.21.15.81:0/2480880592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2806aaa0 0x7f7c2815d310 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 -- 172.21.15.81:0/2480880592 >> 172.21.15.81:0/2480880592 conn(0x7f7c280b0c40 msgr2=0x7f7c2806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:08.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 -- 172.21.15.81:0/2480880592 shutdown_connections 2024-09-13T18:50:08.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 -- 172.21.15.81:0/2480880592 wait complete. 2024-09-13T18:50:08.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 Processor -- start 2024-09-13T18:50:08.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.810+0000 7f7c27200700 1 -- start start 2024-09-13T18:50:08.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2806aaa0 0x7f7c281faa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:08.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c280b3980 0x7f7c28141560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:08.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 0x7f7c28141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:08.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28139f70 con 0x7f7c2815e9f0 2024-09-13T18:50:08.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281faf90 con 0x7f7c2806aaa0 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281392f0 con 0x7f7c280b3980 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 0x7f7c28141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 0x7f7c28141aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53112/0 (socket says 172.21.15.81:53112) 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 -- 172.21.15.81:0/2756880347 learned_addr learned my addr 172.21.15.81:0/2756880347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c25e00700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2806aaa0 0x7f7c281faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c1fe00700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c280b3980 0x7f7c28141560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 -- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c280b3980 msgr2=0x7f7c28141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c280b3980 0x7f7c28141560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 -- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2806aaa0 msgr2=0x7f7c281faa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2806aaa0 0x7f7c281faa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 -- 172.21.15.81:0/2756880347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c18009570 con 0x7f7c2815e9f0 2024-09-13T18:50:08.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c25e00700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2806aaa0 0x7f7c281faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:08.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c26800700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 0x7f7c28141aa0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000efc0 tx=0x7f7c2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:08.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20009ba0 con 0x7f7c2815e9f0 2024-09-13T18:50:08.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000f040 con 0x7f7c2815e9f0 2024-09-13T18:50:08.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c20014480 con 0x7f7c2815e9f0 2024-09-13T18:50:08.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c281395d0 con 0x7f7c2815e9f0 2024-09-13T18:50:08.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.814+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c28139b90 con 0x7f7c2815e9f0 2024-09-13T18:50:08.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.818+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2815d310 con 0x7f7c2815e9f0 2024-09-13T18:50:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.818+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c200145e0 con 0x7f7c2815e9f0 2024-09-13T18:50:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.818+0000 7f7c1e000700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7c04066730 0x7f7c04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.818+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7c20084b70 con 0x7f7c2815e9f0 2024-09-13T18:50:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.818+0000 7f7c25e00700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7c04066730 0x7f7c04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.822+0000 7f7c25e00700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7c04066730 0x7f7c04068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c18000c00 tx=0x7f7c18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:08.826+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c20051db0 con 0x7f7c2815e9f0 2024-09-13T18:50:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.062+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c280718c0 con 0x7f7c2815e9f0 2024-09-13T18:50:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.062+0000 7f7c1e000700 1 -- 172.21.15.81:0/2756880347 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f7c20018090 con 0x7f7c2815e9f0 2024-09-13T18:50:09.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:09.073 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6048,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:08.605860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6051},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7c04066730 msgr2=0x7f7c04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7c04066730 0x7f7c04068bf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7c18000c00 tx=0x7f7c18008030 comp rx=0 tx=0).stop 2024-09-13T18:50:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 msgr2=0x7f7c28141aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 0x7f7c28141aa0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7c2000efc0 tx=0x7f7c2000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 shutdown_connections 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7c04066730 0x7f7c04068bf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c2815e9f0 0x7f7c28141aa0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c280b3980 0x7f7c28141560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 --2- 172.21.15.81:0/2756880347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2806aaa0 0x7f7c281faa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 >> 172.21.15.81:0/2756880347 conn(0x7f7c280b0c40 msgr2=0x7f7c2806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 shutdown_connections 2024-09-13T18:50:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.066+0000 7f7c27200700 1 -- 172.21.15.81:0/2756880347 wait complete. 2024-09-13T18:50:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2024-09-13T18:50:09.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:09.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.258+0000 7f5afe200700 1 Processor -- start 2024-09-13T18:50:09.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.258+0000 7f5afe200700 1 -- start start 2024-09-13T18:50:09.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5afe200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5af813ebc0 0x7f5af806a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5afe200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af813fcc0 con 0x7f5af806ab10 2024-09-13T18:50:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5afe200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af806af50 con 0x7f5af80705a0 2024-09-13T18:50:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5afe200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af8070a30 con 0x7f5af813ebc0 2024-09-13T18:50:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5af813ebc0 0x7f5af806a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5aeea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5af806ab10 0x7f5af806fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60364/0 (socket says 172.21.15.81:60364) 2024-09-13T18:50:09.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5aeea00700 1 -- 172.21.15.81:0/300083378 learned_addr learned my addr 172.21.15.81:0/300083378 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af6a00700 1 -- 172.21.15.81:0/300083378 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411988066 0 0) 0x7f5af813fcc0 con 0x7f5af806ab10 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af6a00700 1 -- 172.21.15.81:0/300083378 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad80057e0 con 0x7f5af806ab10 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af7400700 1 -- 172.21.15.81:0/300083378 >> v1:172.21.15.178:6789/0 conn(0x7f5af80705a0 legacy=0x7f5af806bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af6a00700 1 -- 172.21.15.81:0/300083378 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176688867 0 0) 0x7f5af806af50 con 0x7f5af80705a0 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af7400700 1 -- 172.21.15.81:0/300083378 >> v1:172.21.15.81:6789/0 conn(0x7f5af806ab10 legacy=0x7f5af806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af7400700 1 -- 172.21.15.81:0/300083378 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af813f0f0 con 0x7f5af813ebc0 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af7400700 1 --2- 172.21.15.81:0/300083378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af813ebc0 0x7f5af806a5d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009850 tx=0x7f5ae8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6808622e5ce2c0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af6a00700 1 -- 172.21.15.81:0/300083378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8011830 con 0x7f5af813ebc0 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af6a00700 1 -- 172.21.15.81:0/300083378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8011990 con 0x7f5af813ebc0 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.262+0000 7f5af6a00700 1 -- 172.21.15.81:0/300083378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8011d00 con 0x7f5af813ebc0 2024-09-13T18:50:09.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 -- 172.21.15.81:0/300083378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af813ebc0 msgr2=0x7f5af806a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 --2- 172.21.15.81:0/300083378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af813ebc0 0x7f5af806a5d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009850 tx=0x7f5ae8009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 -- 172.21.15.81:0/300083378 shutdown_connections 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 --2- 172.21.15.81:0/300083378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af813ebc0 0x7f5af806a5d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 -- 172.21.15.81:0/300083378 >> 172.21.15.81:0/300083378 conn(0x7f5af80b08d0 msgr2=0x7f5af80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 -- 172.21.15.81:0/300083378 shutdown_connections 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.266+0000 7f5afe200700 1 -- 172.21.15.81:0/300083378 wait complete. 2024-09-13T18:50:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 Processor -- start 2024-09-13T18:50:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 -- start start 2024-09-13T18:50:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af806ab10 0x7f5af813b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 0x7f5af8153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af813ebc0 0x7f5af813a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af813beb0 con 0x7f5af80705a0 2024-09-13T18:50:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8153590 con 0x7f5af813ebc0 2024-09-13T18:50:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8153830 con 0x7f5af806ab10 2024-09-13T18:50:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 0x7f5af8153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 0x7f5af8153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53138/0 (socket says 172.21.15.81:53138) 2024-09-13T18:50:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 -- 172.21.15.81:0/3786998563 learned_addr learned my addr 172.21.15.81:0/3786998563 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5af7400700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af806ab10 0x7f5af813b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5af7e00700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af813ebc0 0x7f5af813a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 -- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af806ab10 msgr2=0x7f5af813b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af806ab10 0x7f5af813b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 -- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af813ebc0 msgr2=0x7f5af813a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af813ebc0 0x7f5af813a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 -- 172.21.15.81:0/3786998563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80094b0 con 0x7f5af80705a0 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aeea00700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 0x7f5af8153050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c4d0 tx=0x7f5ae000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:09.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00011d0 con 0x7f5af80705a0 2024-09-13T18:50:09.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0005d90 con 0x7f5af80705a0 2024-09-13T18:50:09.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af813abb0 con 0x7f5af80705a0 2024-09-13T18:50:09.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.270+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00072d0 con 0x7f5af80705a0 2024-09-13T18:50:09.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.274+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af813b170 con 0x7f5af80705a0 2024-09-13T18:50:09.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.274+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af806a5d0 con 0x7f5af80705a0 2024-09-13T18:50:09.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.274+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ae0007430 con 0x7f5af80705a0 2024-09-13T18:50:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.278+0000 7f5aefe00700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ad4066730 0x7f5ad4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.278+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5ae00836e0 con 0x7f5af80705a0 2024-09-13T18:50:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.278+0000 7f5af7400700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ad4066730 0x7f5ad4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.278+0000 7f5af7400700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ad4066730 0x7f5ad4068bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80090b0 tx=0x7f5ae8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.282+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ae0050920 con 0x7f5af80705a0 2024-09-13T18:50:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.478+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af806d530 con 0x7f5af80705a0 2024-09-13T18:50:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.482+0000 7f5aefe00700 1 -- 172.21.15.81:0/3786998563 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f5ae0053f40 con 0x7f5af80705a0 2024-09-13T18:50:09.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:09.492 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":53,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:06.579021+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ad4066730 msgr2=0x7f5ad4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ad4066730 0x7f5ad4068bf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80090b0 tx=0x7f5ae8008030 comp rx=0 tx=0).stop 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 msgr2=0x7f5af8153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 0x7f5af8153050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c4d0 tx=0x7f5ae000c890 comp rx=0 tx=0).stop 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 shutdown_connections 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5ad4066730 0x7f5ad4068bf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af813ebc0 0x7f5af813a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af80705a0 0x7f5af8153050 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 --2- 172.21.15.81:0/3786998563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af806ab10 0x7f5af813b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 >> 172.21.15.81:0/3786998563 conn(0x7f5af80b08d0 msgr2=0x7f5af806bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 shutdown_connections 2024-09-13T18:50:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.486+0000 7f5afe200700 1 -- 172.21.15.81:0/3786998563 wait complete. 2024-09-13T18:50:09.519 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:50:09.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:50:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.682+0000 7f00f5a00700 1 Processor -- start 2024-09-13T18:50:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.682+0000 7f00f5a00700 1 -- start start 2024-09-13T18:50:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00f5a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00f5a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00f006aaa0 0x7f00f006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00f5a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f00b2ad0 con 0x7f00f015c2a0 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00f5a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f006b450 con 0x7f00f006aaa0 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00f5a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f015b960 con 0x7f00f00cb020 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00efe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00f5000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00f006aaa0 0x7f00f006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00efe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f00cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:56780/0 (socket says 172.21.15.81:56780) 2024-09-13T18:50:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.686+0000 7f00efe00700 1 -- 172.21.15.81:0/2027089368 learned_addr learned my addr 172.21.15.81:0/2027089368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00efe00700 1 -- 172.21.15.81:0/2027089368 >> v2:172.21.15.178:3300/0 conn(0x7f00f006aaa0 msgr2=0x7f00f006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00efe00700 1 --2- 172.21.15.81:0/2027089368 >> v2:172.21.15.178:3300/0 conn(0x7f00f006aaa0 0x7f00f006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00efe00700 1 -- 172.21.15.81:0/2027089368 >> v1:172.21.15.178:6789/0 conn(0x7f00f015c2a0 legacy=0x7f00f015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00efe00700 1 -- 172.21.15.81:0/2027089368 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f015bc40 con 0x7f00f00cb020 2024-09-13T18:50:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00efe00700 1 --2- 172.21.15.81:0/2027089368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f00cc6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009910 tx=0x7f00e0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a8027e03d9eda3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00eea00700 1 -- 172.21.15.81:0/2027089368 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0011830 con 0x7f00f00cb020 2024-09-13T18:50:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00eea00700 1 -- 172.21.15.81:0/2027089368 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0011990 con 0x7f00f00cb020 2024-09-13T18:50:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00eea00700 1 -- 172.21.15.81:0/2027089368 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0011d40 con 0x7f00f00cb020 2024-09-13T18:50:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 -- 172.21.15.81:0/2027089368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 msgr2=0x7f00f00cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 --2- 172.21.15.81:0/2027089368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f00cc6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009910 tx=0x7f00e0009c20 comp rx=0 tx=0).stop 2024-09-13T18:50:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 -- 172.21.15.81:0/2027089368 shutdown_connections 2024-09-13T18:50:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 --2- 172.21.15.81:0/2027089368 >> v2:172.21.15.178:3300/0 conn(0x7f00f006aaa0 0x7f00f006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 --2- 172.21.15.81:0/2027089368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f00cc6f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 -- 172.21.15.81:0/2027089368 >> 172.21.15.81:0/2027089368 conn(0x7f00f00b0c40 msgr2=0x7f00f006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 -- 172.21.15.81:0/2027089368 shutdown_connections 2024-09-13T18:50:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.690+0000 7f00f5a00700 1 -- 172.21.15.81:0/2027089368 wait complete. 2024-09-13T18:50:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.694+0000 7f00f5a00700 1 Processor -- start 2024-09-13T18:50:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.694+0000 7f00f5a00700 1 -- start start 2024-09-13T18:50:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 0x7f00f0142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f015c2a0 0x7f00f0141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0157aa0 con 0x7f00f006aaa0 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0141cb0 con 0x7f00f015c2a0 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0142a40 con 0x7f00f00cb020 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 0x7f00f0142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 0x7f00f0142240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53150/0 (socket says 172.21.15.81:53150) 2024-09-13T18:50:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 -- 172.21.15.81:0/1581684036 learned_addr learned my addr 172.21.15.81:0/1581684036 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00ef400700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5000700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f015c2a0 0x7f00f0141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 -- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 msgr2=0x7f00f0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 -- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f015c2a0 msgr2=0x7f00f0141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f015c2a0 0x7f00f0141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 -- 172.21.15.81:0/1581684036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e0009570 con 0x7f00f006aaa0 2024-09-13T18:50:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00efe00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 0x7f00f0142240 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0004510 con 0x7f00f006aaa0 2024-09-13T18:50:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f0142d20 con 0x7f00f006aaa0 2024-09-13T18:50:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e00036c0 con 0x7f00f006aaa0 2024-09-13T18:50:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0003a70 con 0x7f00f006aaa0 2024-09-13T18:50:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.698+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f01432e0 con 0x7f00f006aaa0 2024-09-13T18:50:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.702+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f006af10 con 0x7f00f006aaa0 2024-09-13T18:50:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.702+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f00e0003bd0 con 0x7f00f006aaa0 2024-09-13T18:50:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.706+0000 7f00e7e00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d0066760 0x7f00d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.706+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f00e0021030 con 0x7f00f006aaa0 2024-09-13T18:50:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.706+0000 7f00ef400700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d0066760 0x7f00d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.706+0000 7f00ef400700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d0066760 0x7f00d0068c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00f0134940 tx=0x7f00dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.710+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f00e0052a80 con 0x7f00f006aaa0 2024-09-13T18:50:09.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.898+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00f00cb400 con 0x7f00d0066760 2024-09-13T18:50:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.906+0000 7f00e7e00700 1 -- 172.21.15.81:0/1581684036 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286773 (secure 0 0 0) 0x7f00dc001540 con 0x7f00d0066760 2024-09-13T18:50:09.923 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d0066760 msgr2=0x7f00d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d0066760 0x7f00d0068c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00f0134940 tx=0x7f00dc009040 comp rx=0 tx=0).stop 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 msgr2=0x7f00f0142240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 0x7f00f0142240 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0004770 comp rx=0 tx=0).stop 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 shutdown_connections 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00d0066760 0x7f00d0068c20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00f015c2a0 0x7f00f0141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00f00cb020 0x7f00f0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 --2- 172.21.15.81:0/1581684036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00f006aaa0 0x7f00f0142240 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 >> 172.21.15.81:0/1581684036 conn(0x7f00f00b0c40 msgr2=0x7f00f00b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 shutdown_connections 2024-09-13T18:50:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:09.914+0000 7f00f5a00700 1 -- 172.21.15.81:0/1581684036 wait complete. 2024-09-13T18:50:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:50:09.948 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-13T18:50:09.026917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238716,"kb_used_data":6116,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736004,"statfs":{"total":773094113280,"available":772849668096,"internally_reserved":0,"allocated":6262784,"data_stored":3410512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":238014011},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933528"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588231+0000","last_change":"2024-09-13T18:50:05.594747+0000","last_active":"2024-09-13T18:50:06.588231+0000","last_peered":"2024-09-13T18:50:06.588231+0000","last_clean":"2024-09-13T18:50:06.588231+0000","last_became_active":"2024-09-13T18:50:05.593543+0000","last_became_peered":"2024-09-13T18:50:05.593543+0000","last_unstale":"2024-09-13T18:50:06.588231+0000","last_undegraded":"2024-09-13T18:50:06.588231+0000","last_fullsized":"2024-09-13T18:50:06.588231+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:56.861367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776657+0000","last_change":"2024-09-13T18:50:05.618843+0000","last_active":"2024-09-13T18:50:06.776657+0000","last_peered":"2024-09-13T18:50:06.776657+0000","last_clean":"2024-09-13T18:50:06.776657+0000","last_became_active":"2024-09-13T18:50:05.618478+0000","last_became_peered":"2024-09-13T18:50:05.618478+0000","last_unstale":"2024-09-13T18:50:06.776657+0000","last_undegraded":"2024-09-13T18:50:06.776657+0000","last_fullsized":"2024-09-13T18:50:06.776657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:50.641649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588700+0000","last_change":"2024-09-13T18:50:05.611596+0000","last_active":"2024-09-13T18:50:06.588700+0000","last_peered":"2024-09-13T18:50:06.588700+0000","last_clean":"2024-09-13T18:50:06.588700+0000","last_became_active":"2024-09-13T18:50:05.609456+0000","last_became_peered":"2024-09-13T18:50:05.609456+0000","last_unstale":"2024-09-13T18:50:06.588700+0000","last_undegraded":"2024-09-13T18:50:06.588700+0000","last_fullsized":"2024-09-13T18:50:06.588700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:15.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776554+0000","last_change":"2024-09-13T18:50:05.623671+0000","last_active":"2024-09-13T18:50:06.776554+0000","last_peered":"2024-09-13T18:50:06.776554+0000","last_clean":"2024-09-13T18:50:06.776554+0000","last_became_active":"2024-09-13T18:50:05.623488+0000","last_became_peered":"2024-09-13T18:50:05.623488+0000","last_unstale":"2024-09-13T18:50:06.776554+0000","last_undegraded":"2024-09-13T18:50:06.776554+0000","last_fullsized":"2024-09-13T18:50:06.776554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:54.523708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.232000+0000","last_change":"2024-09-13T18:50:05.611927+0000","last_active":"2024-09-13T18:50:07.232000+0000","last_peered":"2024-09-13T18:50:07.232000+0000","last_clean":"2024-09-13T18:50:07.232000+0000","last_became_active":"2024-09-13T18:50:05.611657+0000","last_became_peered":"2024-09-13T18:50:05.611657+0000","last_unstale":"2024-09-13T18:50:07.232000+0000","last_undegraded":"2024-09-13T18:50:07.232000+0000","last_fullsized":"2024-09-13T18:50:07.232000+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:56.861367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.586976+0000","last_change":"2024-09-13T18:50:05.611640+0000","last_active":"2024-09-13T18:50:06.586976+0000","last_peered":"2024-09-13T18:50:06.586976+0000","last_clean":"2024-09-13T18:50:06.586976+0000","last_became_active":"2024-09-13T18:50:05.611257+0000","last_became_peered":"2024-09-13T18:50:05.611257+0000","last_unstale":"2024-09-13T18:50:06.586976+0000","last_undegraded":"2024-09-13T18:50:06.586976+0000","last_fullsized":"2024-09-13T18:50:06.586976+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:34.315902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587568+0000","last_change":"2024-09-13T18:50:05.601792+0000","last_active":"2024-09-13T18:50:06.587568+0000","last_peered":"2024-09-13T18:50:06.587568+0000","last_clean":"2024-09-13T18:50:06.587568+0000","last_became_active":"2024-09-13T18:50:05.601521+0000","last_became_peered":"2024-09-13T18:50:05.601521+0000","last_unstale":"2024-09-13T18:50:06.587568+0000","last_undegraded":"2024-09-13T18:50:06.587568+0000","last_fullsized":"2024-09-13T18:50:06.587568+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:25.541318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228032+0000","last_change":"2024-09-13T18:50:05.624095+0000","last_active":"2024-09-13T18:50:07.228032+0000","last_peered":"2024-09-13T18:50:07.228032+0000","last_clean":"2024-09-13T18:50:07.228032+0000","last_became_active":"2024-09-13T18:50:05.619545+0000","last_became_peered":"2024-09-13T18:50:05.619545+0000","last_unstale":"2024-09-13T18:50:07.228032+0000","last_undegraded":"2024-09-13T18:50:07.228032+0000","last_fullsized":"2024-09-13T18:50:07.228032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:35.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229695+0000","last_change":"2024-09-13T18:50:05.622685+0000","last_active":"2024-09-13T18:50:07.229695+0000","last_peered":"2024-09-13T18:50:07.229695+0000","last_clean":"2024-09-13T18:50:07.229695+0000","last_became_active":"2024-09-13T18:50:05.622523+0000","last_became_peered":"2024-09-13T18:50:05.622523+0000","last_unstale":"2024-09-13T18:50:07.229695+0000","last_undegraded":"2024-09-13T18:50:07.229695+0000","last_fullsized":"2024-09-13T18:50:07.229695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:52.918579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587601+0000","last_change":"2024-09-13T18:50:05.603430+0000","last_active":"2024-09-13T18:50:06.587601+0000","last_peered":"2024-09-13T18:50:06.587601+0000","last_clean":"2024-09-13T18:50:06.587601+0000","last_became_active":"2024-09-13T18:50:05.603167+0000","last_became_peered":"2024-09-13T18:50:05.603167+0000","last_unstale":"2024-09-13T18:50:06.587601+0000","last_undegraded":"2024-09-13T18:50:06.587601+0000","last_fullsized":"2024-09-13T18:50:06.587601+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228427+0000","last_change":"2024-09-13T18:50:05.612164+0000","last_active":"2024-09-13T18:50:07.228427+0000","last_peered":"2024-09-13T18:50:07.228427+0000","last_clean":"2024-09-13T18:50:07.228427+0000","last_became_active":"2024-09-13T18:50:05.611939+0000","last_became_peered":"2024-09-13T18:50:05.611939+0000","last_unstale":"2024-09-13T18:50:07.228427+0000","last_undegraded":"2024-09-13T18:50:07.228427+0000","last_fullsized":"2024-09-13T18:50:07.228427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:24.438216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229211+0000","last_change":"2024-09-13T18:50:05.610394+0000","last_active":"2024-09-13T18:50:07.229211+0000","last_peered":"2024-09-13T18:50:07.229211+0000","last_clean":"2024-09-13T18:50:07.229211+0000","last_became_active":"2024-09-13T18:50:05.610049+0000","last_became_peered":"2024-09-13T18:50:05.610049+0000","last_unstale":"2024-09-13T18:50:07.229211+0000","last_undegraded":"2024-09-13T18:50:07.229211+0000","last_fullsized":"2024-09-13T18:50:07.229211+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:02.856552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587111+0000","last_change":"2024-09-13T18:50:05.600110+0000","last_active":"2024-09-13T18:50:06.587111+0000","last_peered":"2024-09-13T18:50:06.587111+0000","last_clean":"2024-09-13T18:50:06.587111+0000","last_became_active":"2024-09-13T18:50:05.599848+0000","last_became_peered":"2024-09-13T18:50:05.599848+0000","last_unstale":"2024-09-13T18:50:06.587111+0000","last_undegraded":"2024-09-13T18:50:06.587111+0000","last_fullsized":"2024-09-13T18:50:06.587111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.829552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588419+0000","last_change":"2024-09-13T18:50:05.612408+0000","last_active":"2024-09-13T18:50:06.588419+0000","last_peered":"2024-09-13T18:50:06.588419+0000","last_clean":"2024-09-13T18:50:06.588419+0000","last_became_active":"2024-09-13T18:50:05.612189+0000","last_became_peered":"2024-09-13T18:50:05.612189+0000","last_unstale":"2024-09-13T18:50:06.588419+0000","last_undegraded":"2024-09-13T18:50:06.588419+0000","last_fullsized":"2024-09-13T18:50:06.588419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:23.808542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776218+0000","last_change":"2024-09-13T18:50:05.618012+0000","last_active":"2024-09-13T18:50:06.776218+0000","last_peered":"2024-09-13T18:50:06.776218+0000","last_clean":"2024-09-13T18:50:06.776218+0000","last_became_active":"2024-09-13T18:50:05.617755+0000","last_became_peered":"2024-09-13T18:50:05.617755+0000","last_unstale":"2024-09-13T18:50:06.776218+0000","last_undegraded":"2024-09-13T18:50:06.776218+0000","last_fullsized":"2024-09-13T18:50:06.776218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:09.884703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.586805+0000","last_change":"2024-09-13T18:50:05.597629+0000","last_active":"2024-09-13T18:50:06.586805+0000","last_peered":"2024-09-13T18:50:06.586805+0000","last_clean":"2024-09-13T18:50:06.586805+0000","last_became_active":"2024-09-13T18:50:05.597348+0000","last_became_peered":"2024-09-13T18:50:05.597348+0000","last_unstale":"2024-09-13T18:50:06.586805+0000","last_undegraded":"2024-09-13T18:50:06.586805+0000","last_fullsized":"2024-09-13T18:50:06.586805+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:41.701588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.589059+0000","last_change":"2024-09-13T18:50:05.600783+0000","last_active":"2024-09-13T18:50:06.589059+0000","last_peered":"2024-09-13T18:50:06.589059+0000","last_clean":"2024-09-13T18:50:06.589059+0000","last_became_active":"2024-09-13T18:50:05.600563+0000","last_became_peered":"2024-09-13T18:50:05.600563+0000","last_unstale":"2024-09-13T18:50:06.589059+0000","last_undegraded":"2024-09-13T18:50:06.589059+0000","last_fullsized":"2024-09-13T18:50:06.589059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:31.399914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776732+0000","last_change":"2024-09-13T18:50:05.622274+0000","last_active":"2024-09-13T18:50:06.776732+0000","last_peered":"2024-09-13T18:50:06.776732+0000","last_clean":"2024-09-13T18:50:06.776732+0000","last_became_active":"2024-09-13T18:50:05.621821+0000","last_became_peered":"2024-09-13T18:50:05.621821+0000","last_unstale":"2024-09-13T18:50:06.776732+0000","last_undegraded":"2024-09-13T18:50:06.776732+0000","last_fullsized":"2024-09-13T18:50:06.776732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:24.135921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588721+0000","last_change":"2024-09-13T18:50:05.602114+0000","last_active":"2024-09-13T18:50:06.588721+0000","last_peered":"2024-09-13T18:50:06.588721+0000","last_clean":"2024-09-13T18:50:06.588721+0000","last_became_active":"2024-09-13T18:50:05.601660+0000","last_became_peered":"2024-09-13T18:50:05.601660+0000","last_unstale":"2024-09-13T18:50:06.588721+0000","last_undegraded":"2024-09-13T18:50:06.588721+0000","last_fullsized":"2024-09-13T18:50:06.588721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:22.012470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230921+0000","last_change":"2024-09-13T18:50:05.606223+0000","last_active":"2024-09-13T18:50:07.230921+0000","last_peered":"2024-09-13T18:50:07.230921+0000","last_clean":"2024-09-13T18:50:07.230921+0000","last_became_active":"2024-09-13T18:50:05.605933+0000","last_became_peered":"2024-09-13T18:50:05.605933+0000","last_unstale":"2024-09-13T18:50:07.230921+0000","last_undegraded":"2024-09-13T18:50:07.230921+0000","last_fullsized":"2024-09-13T18:50:07.230921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:34.489512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230755+0000","last_change":"2024-09-13T18:50:05.612328+0000","last_active":"2024-09-13T18:50:07.230755+0000","last_peered":"2024-09-13T18:50:07.230755+0000","last_clean":"2024-09-13T18:50:07.230755+0000","last_became_active":"2024-09-13T18:50:05.612066+0000","last_became_peered":"2024-09-13T18:50:05.612066+0000","last_unstale":"2024-09-13T18:50:07.230755+0000","last_undegraded":"2024-09-13T18:50:07.230755+0000","last_fullsized":"2024-09-13T18:50:07.230755+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:34.315902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227649+0000","last_change":"2024-09-13T18:50:05.619936+0000","last_active":"2024-09-13T18:50:07.227649+0000","last_peered":"2024-09-13T18:50:07.227649+0000","last_clean":"2024-09-13T18:50:07.227649+0000","last_became_active":"2024-09-13T18:50:05.619685+0000","last_became_peered":"2024-09-13T18:50:05.619685+0000","last_unstale":"2024-09-13T18:50:07.227649+0000","last_undegraded":"2024-09-13T18:50:07.227649+0000","last_fullsized":"2024-09-13T18:50:07.227649+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:10.904516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227675+0000","last_change":"2024-09-13T18:50:05.614385+0000","last_active":"2024-09-13T18:50:07.227675+0000","last_peered":"2024-09-13T18:50:07.227675+0000","last_clean":"2024-09-13T18:50:07.227675+0000","last_became_active":"2024-09-13T18:50:05.614098+0000","last_became_peered":"2024-09-13T18:50:05.614098+0000","last_unstale":"2024-09-13T18:50:07.227675+0000","last_undegraded":"2024-09-13T18:50:07.227675+0000","last_fullsized":"2024-09-13T18:50:07.227675+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:47.490054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587109+0000","last_change":"2024-09-13T18:50:05.610962+0000","last_active":"2024-09-13T18:50:06.587109+0000","last_peered":"2024-09-13T18:50:06.587109+0000","last_clean":"2024-09-13T18:50:06.587109+0000","last_became_active":"2024-09-13T18:50:05.608138+0000","last_became_peered":"2024-09-13T18:50:05.608138+0000","last_unstale":"2024-09-13T18:50:06.587109+0000","last_undegraded":"2024-09-13T18:50:06.587109+0000","last_fullsized":"2024-09-13T18:50:06.587109+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:46.268093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.589084+0000","last_change":"2024-09-13T18:50:05.613115+0000","last_active":"2024-09-13T18:50:06.589084+0000","last_peered":"2024-09-13T18:50:06.589084+0000","last_clean":"2024-09-13T18:50:06.589084+0000","last_became_active":"2024-09-13T18:50:05.612853+0000","last_became_peered":"2024-09-13T18:50:05.612853+0000","last_unstale":"2024-09-13T18:50:06.589084+0000","last_undegraded":"2024-09-13T18:50:06.589084+0000","last_fullsized":"2024-09-13T18:50:06.589084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:29.785337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229326+0000","last_change":"2024-09-13T18:50:05.613977+0000","last_active":"2024-09-13T18:50:07.229326+0000","last_peered":"2024-09-13T18:50:07.229326+0000","last_clean":"2024-09-13T18:50:07.229326+0000","last_became_active":"2024-09-13T18:50:05.613272+0000","last_became_peered":"2024-09-13T18:50:05.613272+0000","last_unstale":"2024-09-13T18:50:07.229326+0000","last_undegraded":"2024-09-13T18:50:07.229326+0000","last_fullsized":"2024-09-13T18:50:07.229326+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:29.553567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587614+0000","last_change":"2024-09-13T18:50:05.597555+0000","last_active":"2024-09-13T18:50:06.587614+0000","last_peered":"2024-09-13T18:50:06.587614+0000","last_clean":"2024-09-13T18:50:06.587614+0000","last_became_active":"2024-09-13T18:50:05.597282+0000","last_became_peered":"2024-09-13T18:50:05.597282+0000","last_unstale":"2024-09-13T18:50:06.587614+0000","last_undegraded":"2024-09-13T18:50:06.587614+0000","last_fullsized":"2024-09-13T18:50:06.587614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.066197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231332+0000","last_change":"2024-09-13T18:50:05.607434+0000","last_active":"2024-09-13T18:50:07.231332+0000","last_peered":"2024-09-13T18:50:07.231332+0000","last_clean":"2024-09-13T18:50:07.231332+0000","last_became_active":"2024-09-13T18:50:05.607148+0000","last_became_peered":"2024-09-13T18:50:05.607148+0000","last_unstale":"2024-09-13T18:50:07.231332+0000","last_undegraded":"2024-09-13T18:50:07.231332+0000","last_fullsized":"2024-09-13T18:50:07.231332+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.829552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587860+0000","last_change":"2024-09-13T18:50:05.596943+0000","last_active":"2024-09-13T18:50:06.587860+0000","last_peered":"2024-09-13T18:50:06.587860+0000","last_clean":"2024-09-13T18:50:06.587860+0000","last_became_active":"2024-09-13T18:50:05.596651+0000","last_became_peered":"2024-09-13T18:50:05.596651+0000","last_unstale":"2024-09-13T18:50:06.587860+0000","last_undegraded":"2024-09-13T18:50:06.587860+0000","last_fullsized":"2024-09-13T18:50:06.587860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:46.580779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776445+0000","last_change":"2024-09-13T18:50:05.617870+0000","last_active":"2024-09-13T18:50:06.776445+0000","last_peered":"2024-09-13T18:50:06.776445+0000","last_clean":"2024-09-13T18:50:06.776445+0000","last_became_active":"2024-09-13T18:50:05.617556+0000","last_became_peered":"2024-09-13T18:50:05.617556+0000","last_unstale":"2024-09-13T18:50:06.776445+0000","last_undegraded":"2024-09-13T18:50:06.776445+0000","last_fullsized":"2024-09-13T18:50:06.776445+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:30.300154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587902+0000","last_change":"2024-09-13T18:50:05.610099+0000","last_active":"2024-09-13T18:50:06.587902+0000","last_peered":"2024-09-13T18:50:06.587902+0000","last_clean":"2024-09-13T18:50:06.587902+0000","last_became_active":"2024-09-13T18:50:05.609833+0000","last_became_peered":"2024-09-13T18:50:05.609833+0000","last_unstale":"2024-09-13T18:50:06.587902+0000","last_undegraded":"2024-09-13T18:50:06.587902+0000","last_fullsized":"2024-09-13T18:50:06.587902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:51.371581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591161+0000","last_change":"2024-09-13T18:50:05.628139+0000","last_active":"2024-09-13T18:50:06.591161+0000","last_peered":"2024-09-13T18:50:06.591161+0000","last_clean":"2024-09-13T18:50:06.591161+0000","last_became_active":"2024-09-13T18:50:05.627802+0000","last_became_peered":"2024-09-13T18:50:05.627802+0000","last_unstale":"2024-09-13T18:50:06.591161+0000","last_undegraded":"2024-09-13T18:50:06.591161+0000","last_fullsized":"2024-09-13T18:50:06.591161+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:50.641649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.775996+0000","last_change":"2024-09-13T18:50:05.617171+0000","last_active":"2024-09-13T18:50:06.775996+0000","last_peered":"2024-09-13T18:50:06.775996+0000","last_clean":"2024-09-13T18:50:06.775996+0000","last_became_active":"2024-09-13T18:50:05.616721+0000","last_became_peered":"2024-09-13T18:50:05.616721+0000","last_unstale":"2024-09-13T18:50:06.775996+0000","last_undegraded":"2024-09-13T18:50:06.775996+0000","last_fullsized":"2024-09-13T18:50:06.775996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:14.481326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231589+0000","last_change":"2024-09-13T18:50:05.132381+0000","last_active":"2024-09-13T18:50:07.231589+0000","last_peered":"2024-09-13T18:50:07.231589+0000","last_clean":"2024-09-13T18:50:07.231589+0000","last_became_active":"2024-09-13T18:50:05.132056+0000","last_became_peered":"2024-09-13T18:50:05.132056+0000","last_unstale":"2024-09-13T18:50:07.231589+0000","last_undegraded":"2024-09-13T18:50:07.231589+0000","last_fullsized":"2024-09-13T18:50:07.231589+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.871142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591477+0000","last_change":"2024-09-13T18:50:05.613901+0000","last_active":"2024-09-13T18:50:06.591477+0000","last_peered":"2024-09-13T18:50:06.591477+0000","last_clean":"2024-09-13T18:50:06.591477+0000","last_became_active":"2024-09-13T18:50:05.613561+0000","last_became_peered":"2024-09-13T18:50:05.613561+0000","last_unstale":"2024-09-13T18:50:06.591477+0000","last_undegraded":"2024-09-13T18:50:06.591477+0000","last_fullsized":"2024-09-13T18:50:06.591477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587906+0000","last_change":"2024-09-13T18:50:05.136268+0000","last_active":"2024-09-13T18:50:06.587906+0000","last_peered":"2024-09-13T18:50:06.587906+0000","last_clean":"2024-09-13T18:50:06.587906+0000","last_became_active":"2024-09-13T18:50:05.135943+0000","last_became_peered":"2024-09-13T18:50:05.135943+0000","last_unstale":"2024-09-13T18:50:06.587906+0000","last_undegraded":"2024-09-13T18:50:06.587906+0000","last_fullsized":"2024-09-13T18:50:06.587906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:28.917656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230860+0000","last_change":"2024-09-13T18:50:05.619777+0000","last_active":"2024-09-13T18:50:07.230860+0000","last_peered":"2024-09-13T18:50:07.230860+0000","last_clean":"2024-09-13T18:50:07.230860+0000","last_became_active":"2024-09-13T18:50:05.619520+0000","last_became_peered":"2024-09-13T18:50:05.619520+0000","last_unstale":"2024-09-13T18:50:07.230860+0000","last_undegraded":"2024-09-13T18:50:07.230860+0000","last_fullsized":"2024-09-13T18:50:07.230860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.066197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587513+0000","last_change":"2024-09-13T18:50:05.133330+0000","last_active":"2024-09-13T18:50:06.587513+0000","last_peered":"2024-09-13T18:50:06.587513+0000","last_clean":"2024-09-13T18:50:06.587513+0000","last_became_active":"2024-09-13T18:50:05.133045+0000","last_became_peered":"2024-09-13T18:50:05.133045+0000","last_unstale":"2024-09-13T18:50:06.587513+0000","last_undegraded":"2024-09-13T18:50:06.587513+0000","last_fullsized":"2024-09-13T18:50:06.587513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:46.241085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228909+0000","last_change":"2024-09-13T18:50:05.613419+0000","last_active":"2024-09-13T18:50:07.228909+0000","last_peered":"2024-09-13T18:50:07.228909+0000","last_clean":"2024-09-13T18:50:07.228909+0000","last_became_active":"2024-09-13T18:50:05.613126+0000","last_became_peered":"2024-09-13T18:50:05.613126+0000","last_unstale":"2024-09-13T18:50:07.228909+0000","last_undegraded":"2024-09-13T18:50:07.228909+0000","last_fullsized":"2024-09-13T18:50:07.228909+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:53.581272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591738+0000","last_change":"2024-09-13T18:50:05.130403+0000","last_active":"2024-09-13T18:50:06.591738+0000","last_peered":"2024-09-13T18:50:06.591738+0000","last_clean":"2024-09-13T18:50:06.591738+0000","last_became_active":"2024-09-13T18:50:05.130147+0000","last_became_peered":"2024-09-13T18:50:05.130147+0000","last_unstale":"2024-09-13T18:50:06.591738+0000","last_undegraded":"2024-09-13T18:50:06.591738+0000","last_fullsized":"2024-09-13T18:50:06.591738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:42.287350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.232221+0000","last_change":"2024-09-13T18:50:05.617910+0000","last_active":"2024-09-13T18:50:07.232221+0000","last_peered":"2024-09-13T18:50:07.232221+0000","last_clean":"2024-09-13T18:50:07.232221+0000","last_became_active":"2024-09-13T18:50:05.617612+0000","last_became_peered":"2024-09-13T18:50:05.617612+0000","last_unstale":"2024-09-13T18:50:07.232221+0000","last_undegraded":"2024-09-13T18:50:07.232221+0000","last_fullsized":"2024-09-13T18:50:07.232221+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587959+0000","last_change":"2024-09-13T18:50:05.131909+0000","last_active":"2024-09-13T18:50:06.587959+0000","last_peered":"2024-09-13T18:50:06.587959+0000","last_clean":"2024-09-13T18:50:06.587959+0000","last_became_active":"2024-09-13T18:50:05.131673+0000","last_became_peered":"2024-09-13T18:50:05.131673+0000","last_unstale":"2024-09-13T18:50:06.587959+0000","last_undegraded":"2024-09-13T18:50:06.587959+0000","last_fullsized":"2024-09-13T18:50:06.587959+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:23.122360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776462+0000","last_change":"2024-09-13T18:50:05.618663+0000","last_active":"2024-09-13T18:50:06.776462+0000","last_peered":"2024-09-13T18:50:06.776462+0000","last_clean":"2024-09-13T18:50:06.776462+0000","last_became_active":"2024-09-13T18:50:05.618303+0000","last_became_peered":"2024-09-13T18:50:05.618303+0000","last_unstale":"2024-09-13T18:50:06.776462+0000","last_undegraded":"2024-09-13T18:50:06.776462+0000","last_fullsized":"2024-09-13T18:50:06.776462+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:39.263659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231878+0000","last_change":"2024-09-13T18:50:05.131793+0000","last_active":"2024-09-13T18:50:07.231878+0000","last_peered":"2024-09-13T18:50:07.231878+0000","last_clean":"2024-09-13T18:50:07.231878+0000","last_became_active":"2024-09-13T18:50:05.131495+0000","last_became_peered":"2024-09-13T18:50:05.131495+0000","last_unstale":"2024-09-13T18:50:07.231878+0000","last_undegraded":"2024-09-13T18:50:07.231878+0000","last_fullsized":"2024-09-13T18:50:07.231878+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:16.448168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229614+0000","last_change":"2024-09-13T18:50:05.613460+0000","last_active":"2024-09-13T18:50:07.229614+0000","last_peered":"2024-09-13T18:50:07.229614+0000","last_clean":"2024-09-13T18:50:07.229614+0000","last_became_active":"2024-09-13T18:50:05.612945+0000","last_became_peered":"2024-09-13T18:50:05.612945+0000","last_unstale":"2024-09-13T18:50:07.229614+0000","last_undegraded":"2024-09-13T18:50:07.229614+0000","last_fullsized":"2024-09-13T18:50:07.229614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:46.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230845+0000","last_change":"2024-09-13T18:50:05.136351+0000","last_active":"2024-09-13T18:50:07.230845+0000","last_peered":"2024-09-13T18:50:07.230845+0000","last_clean":"2024-09-13T18:50:07.230845+0000","last_became_active":"2024-09-13T18:50:05.136086+0000","last_became_peered":"2024-09-13T18:50:05.136086+0000","last_unstale":"2024-09-13T18:50:07.230845+0000","last_undegraded":"2024-09-13T18:50:07.230845+0000","last_fullsized":"2024-09-13T18:50:07.230845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:38.250098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776833+0000","last_change":"2024-09-13T18:50:05.625952+0000","last_active":"2024-09-13T18:50:06.776833+0000","last_peered":"2024-09-13T18:50:06.776833+0000","last_clean":"2024-09-13T18:50:06.776833+0000","last_became_active":"2024-09-13T18:50:05.625751+0000","last_became_peered":"2024-09-13T18:50:05.625751+0000","last_unstale":"2024-09-13T18:50:06.776833+0000","last_undegraded":"2024-09-13T18:50:06.776833+0000","last_fullsized":"2024-09-13T18:50:06.776833+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:13.868022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587163+0000","last_change":"2024-09-13T18:50:05.133335+0000","last_active":"2024-09-13T18:50:06.587163+0000","last_peered":"2024-09-13T18:50:06.587163+0000","last_clean":"2024-09-13T18:50:06.587163+0000","last_became_active":"2024-09-13T18:50:05.133098+0000","last_became_peered":"2024-09-13T18:50:05.133098+0000","last_unstale":"2024-09-13T18:50:06.587163+0000","last_undegraded":"2024-09-13T18:50:06.587163+0000","last_fullsized":"2024-09-13T18:50:06.587163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.871142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231422+0000","last_change":"2024-09-13T18:50:05.627816+0000","last_active":"2024-09-13T18:50:07.231422+0000","last_peered":"2024-09-13T18:50:07.231422+0000","last_clean":"2024-09-13T18:50:07.231422+0000","last_became_active":"2024-09-13T18:50:05.627464+0000","last_became_peered":"2024-09-13T18:50:05.627464+0000","last_unstale":"2024-09-13T18:50:07.231422+0000","last_undegraded":"2024-09-13T18:50:07.231422+0000","last_fullsized":"2024-09-13T18:50:07.231422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:07.371205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776717+0000","last_change":"2024-09-13T18:50:05.137868+0000","last_active":"2024-09-13T18:50:06.776717+0000","last_peered":"2024-09-13T18:50:06.776717+0000","last_clean":"2024-09-13T18:50:06.776717+0000","last_became_active":"2024-09-13T18:50:05.137624+0000","last_became_peered":"2024-09-13T18:50:05.137624+0000","last_unstale":"2024-09-13T18:50:06.776717+0000","last_undegraded":"2024-09-13T18:50:06.776717+0000","last_fullsized":"2024-09-13T18:50:06.776717+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:55.394236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591028+0000","last_change":"2024-09-13T18:50:05.598892+0000","last_active":"2024-09-13T18:50:06.591028+0000","last_peered":"2024-09-13T18:50:06.591028+0000","last_clean":"2024-09-13T18:50:06.591028+0000","last_became_active":"2024-09-13T18:50:05.598601+0000","last_became_peered":"2024-09-13T18:50:05.598601+0000","last_unstale":"2024-09-13T18:50:06.591028+0000","last_undegraded":"2024-09-13T18:50:06.591028+0000","last_fullsized":"2024-09-13T18:50:06.591028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:24.135921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.232327+0000","last_change":"2024-09-13T18:50:05.137663+0000","last_active":"2024-09-13T18:50:07.232327+0000","last_peered":"2024-09-13T18:50:07.232327+0000","last_clean":"2024-09-13T18:50:07.232327+0000","last_became_active":"2024-09-13T18:50:05.136081+0000","last_became_peered":"2024-09-13T18:50:05.136081+0000","last_unstale":"2024-09-13T18:50:07.232327+0000","last_undegraded":"2024-09-13T18:50:07.232327+0000","last_fullsized":"2024-09-13T18:50:07.232327+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:53.510147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588619+0000","last_change":"2024-09-13T18:50:05.606852+0000","last_active":"2024-09-13T18:50:06.588619+0000","last_peered":"2024-09-13T18:50:06.588619+0000","last_clean":"2024-09-13T18:50:06.588619+0000","last_became_active":"2024-09-13T18:50:05.606575+0000","last_became_peered":"2024-09-13T18:50:05.606575+0000","last_unstale":"2024-09-13T18:50:06.588619+0000","last_undegraded":"2024-09-13T18:50:06.588619+0000","last_fullsized":"2024-09-13T18:50:06.588619+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:46.975236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776722+0000","last_change":"2024-09-13T18:50:05.139595+0000","last_active":"2024-09-13T18:50:06.776722+0000","last_peered":"2024-09-13T18:50:06.776722+0000","last_clean":"2024-09-13T18:50:06.776722+0000","last_became_active":"2024-09-13T18:50:05.139337+0000","last_became_peered":"2024-09-13T18:50:05.139337+0000","last_unstale":"2024-09-13T18:50:06.776722+0000","last_undegraded":"2024-09-13T18:50:06.776722+0000","last_fullsized":"2024-09-13T18:50:06.776722+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:42.476519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231979+0000","last_change":"2024-09-13T18:50:05.614641+0000","last_active":"2024-09-13T18:50:07.231979+0000","last_peered":"2024-09-13T18:50:07.231979+0000","last_clean":"2024-09-13T18:50:07.231979+0000","last_became_active":"2024-09-13T18:50:05.614400+0000","last_became_peered":"2024-09-13T18:50:05.614400+0000","last_unstale":"2024-09-13T18:50:07.231979+0000","last_undegraded":"2024-09-13T18:50:07.231979+0000","last_fullsized":"2024-09-13T18:50:07.231979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:09.293934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229475+0000","last_change":"2024-09-13T18:50:05.128709+0000","last_active":"2024-09-13T18:50:07.229475+0000","last_peered":"2024-09-13T18:50:07.229475+0000","last_clean":"2024-09-13T18:50:07.229475+0000","last_became_active":"2024-09-13T18:50:05.128331+0000","last_became_peered":"2024-09-13T18:50:05.128331+0000","last_unstale":"2024-09-13T18:50:07.229475+0000","last_undegraded":"2024-09-13T18:50:07.229475+0000","last_fullsized":"2024-09-13T18:50:07.229475+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:52.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591335+0000","last_change":"2024-09-13T18:50:05.614204+0000","last_active":"2024-09-13T18:50:06.591335+0000","last_peered":"2024-09-13T18:50:06.591335+0000","last_clean":"2024-09-13T18:50:06.591335+0000","last_became_active":"2024-09-13T18:50:05.613868+0000","last_became_peered":"2024-09-13T18:50:05.613868+0000","last_unstale":"2024-09-13T18:50:06.591335+0000","last_undegraded":"2024-09-13T18:50:06.591335+0000","last_fullsized":"2024-09-13T18:50:06.591335+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:56.861367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588040+0000","last_change":"2024-09-13T18:50:05.132904+0000","last_active":"2024-09-13T18:50:06.588040+0000","last_peered":"2024-09-13T18:50:06.588040+0000","last_clean":"2024-09-13T18:50:06.588040+0000","last_became_active":"2024-09-13T18:50:05.132576+0000","last_became_peered":"2024-09-13T18:50:05.132576+0000","last_unstale":"2024-09-13T18:50:06.588040+0000","last_undegraded":"2024-09-13T18:50:06.588040+0000","last_fullsized":"2024-09-13T18:50:06.588040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:29.286594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588977+0000","last_change":"2024-09-13T18:50:05.606989+0000","last_active":"2024-09-13T18:50:06.588977+0000","last_peered":"2024-09-13T18:50:06.588977+0000","last_clean":"2024-09-13T18:50:06.588977+0000","last_became_active":"2024-09-13T18:50:05.606598+0000","last_became_peered":"2024-09-13T18:50:05.606598+0000","last_unstale":"2024-09-13T18:50:06.588977+0000","last_undegraded":"2024-09-13T18:50:06.588977+0000","last_fullsized":"2024-09-13T18:50:06.588977+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:54.991570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230993+0000","last_change":"2024-09-13T18:50:05.131829+0000","last_active":"2024-09-13T18:50:07.230993+0000","last_peered":"2024-09-13T18:50:07.230993+0000","last_clean":"2024-09-13T18:50:07.230993+0000","last_became_active":"2024-09-13T18:50:05.131534+0000","last_became_peered":"2024-09-13T18:50:05.131534+0000","last_unstale":"2024-09-13T18:50:07.230993+0000","last_undegraded":"2024-09-13T18:50:07.230993+0000","last_fullsized":"2024-09-13T18:50:07.230993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:53.510147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229439+0000","last_change":"2024-09-13T18:50:05.621719+0000","last_active":"2024-09-13T18:50:07.229439+0000","last_peered":"2024-09-13T18:50:07.229439+0000","last_clean":"2024-09-13T18:50:07.229439+0000","last_became_active":"2024-09-13T18:50:05.620575+0000","last_became_peered":"2024-09-13T18:50:05.620575+0000","last_unstale":"2024-09-13T18:50:07.229439+0000","last_undegraded":"2024-09-13T18:50:07.229439+0000","last_fullsized":"2024-09-13T18:50:07.229439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:22.140559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776447+0000","last_change":"2024-09-13T18:50:05.136596+0000","last_active":"2024-09-13T18:50:06.776447+0000","last_peered":"2024-09-13T18:50:06.776447+0000","last_clean":"2024-09-13T18:50:06.776447+0000","last_became_active":"2024-09-13T18:50:05.136058+0000","last_became_peered":"2024-09-13T18:50:05.136058+0000","last_unstale":"2024-09-13T18:50:06.776447+0000","last_undegraded":"2024-09-13T18:50:06.776447+0000","last_fullsized":"2024-09-13T18:50:06.776447+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:37.636372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588939+0000","last_change":"2024-09-13T18:50:05.595888+0000","last_active":"2024-09-13T18:50:06.588939+0000","last_peered":"2024-09-13T18:50:06.588939+0000","last_clean":"2024-09-13T18:50:06.588939+0000","last_became_active":"2024-09-13T18:50:05.595649+0000","last_became_peered":"2024-09-13T18:50:05.595649+0000","last_unstale":"2024-09-13T18:50:06.588939+0000","last_undegraded":"2024-09-13T18:50:06.588939+0000","last_fullsized":"2024-09-13T18:50:06.588939+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:14.033589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228226+0000","last_change":"2024-09-13T18:50:05.128315+0000","last_active":"2024-09-13T18:50:07.228226+0000","last_peered":"2024-09-13T18:50:07.228226+0000","last_clean":"2024-09-13T18:50:07.228226+0000","last_became_active":"2024-09-13T18:50:05.128041+0000","last_became_peered":"2024-09-13T18:50:05.128041+0000","last_unstale":"2024-09-13T18:50:07.228226+0000","last_undegraded":"2024-09-13T18:50:07.228226+0000","last_fullsized":"2024-09-13T18:50:07.228226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:33.199411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228111+0000","last_change":"2024-09-13T18:50:05.606051+0000","last_active":"2024-09-13T18:50:07.228111+0000","last_peered":"2024-09-13T18:50:07.228111+0000","last_clean":"2024-09-13T18:50:07.228111+0000","last_became_active":"2024-09-13T18:50:05.605744+0000","last_became_peered":"2024-09-13T18:50:05.605744+0000","last_unstale":"2024-09-13T18:50:07.228111+0000","last_undegraded":"2024-09-13T18:50:07.228111+0000","last_fullsized":"2024-09-13T18:50:07.228111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:11.089086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.589125+0000","last_change":"2024-09-13T18:50:05.131074+0000","last_active":"2024-09-13T18:50:06.589125+0000","last_peered":"2024-09-13T18:50:06.589125+0000","last_clean":"2024-09-13T18:50:06.589125+0000","last_became_active":"2024-09-13T18:50:05.130802+0000","last_became_peered":"2024-09-13T18:50:05.130802+0000","last_unstale":"2024-09-13T18:50:06.589125+0000","last_undegraded":"2024-09-13T18:50:06.589125+0000","last_fullsized":"2024-09-13T18:50:06.589125+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:12.854462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587183+0000","last_change":"2024-09-13T18:50:05.594588+0000","last_active":"2024-09-13T18:50:06.587183+0000","last_peered":"2024-09-13T18:50:06.587183+0000","last_clean":"2024-09-13T18:50:06.587183+0000","last_became_active":"2024-09-13T18:50:05.594333+0000","last_became_peered":"2024-09-13T18:50:05.594333+0000","last_unstale":"2024-09-13T18:50:06.587183+0000","last_undegraded":"2024-09-13T18:50:06.587183+0000","last_fullsized":"2024-09-13T18:50:06.587183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:34.489512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228705+0000","last_change":"2024-09-13T18:50:05.127446+0000","last_active":"2024-09-13T18:50:07.228705+0000","last_peered":"2024-09-13T18:50:07.228705+0000","last_clean":"2024-09-13T18:50:07.228705+0000","last_became_active":"2024-09-13T18:50:05.127181+0000","last_became_peered":"2024-09-13T18:50:05.127181+0000","last_unstale":"2024-09-13T18:50:07.228705+0000","last_undegraded":"2024-09-13T18:50:07.228705+0000","last_fullsized":"2024-09-13T18:50:07.228705+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:23.983012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231285+0000","last_change":"2024-09-13T18:50:05.611166+0000","last_active":"2024-09-13T18:50:07.231285+0000","last_peered":"2024-09-13T18:50:07.231285+0000","last_clean":"2024-09-13T18:50:07.231285+0000","last_became_active":"2024-09-13T18:50:05.610898+0000","last_became_peered":"2024-09-13T18:50:05.610898+0000","last_unstale":"2024-09-13T18:50:07.231285+0000","last_undegraded":"2024-09-13T18:50:07.231285+0000","last_fullsized":"2024-09-13T18:50:07.231285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:41.701588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231485+0000","last_change":"2024-09-13T18:50:05.139639+0000","last_active":"2024-09-13T18:50:07.231485+0000","last_peered":"2024-09-13T18:50:07.231485+0000","last_clean":"2024-09-13T18:50:07.231485+0000","last_became_active":"2024-09-13T18:50:05.139358+0000","last_became_peered":"2024-09-13T18:50:05.139358+0000","last_unstale":"2024-09-13T18:50:07.231485+0000","last_undegraded":"2024-09-13T18:50:07.231485+0000","last_fullsized":"2024-09-13T18:50:07.231485+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:29.286594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587330+0000","last_change":"2024-09-13T18:50:05.594410+0000","last_active":"2024-09-13T18:50:06.587330+0000","last_peered":"2024-09-13T18:50:06.587330+0000","last_clean":"2024-09-13T18:50:06.587330+0000","last_became_active":"2024-09-13T18:50:05.593977+0000","last_became_peered":"2024-09-13T18:50:05.593977+0000","last_unstale":"2024-09-13T18:50:06.587330+0000","last_undegraded":"2024-09-13T18:50:06.587330+0000","last_fullsized":"2024-09-13T18:50:06.587330+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:07.371205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231160+0000","last_change":"2024-09-13T18:50:05.128930+0000","last_active":"2024-09-13T18:50:07.231160+0000","last_peered":"2024-09-13T18:50:07.231160+0000","last_clean":"2024-09-13T18:50:07.231160+0000","last_became_active":"2024-09-13T18:50:05.128461+0000","last_became_peered":"2024-09-13T18:50:05.128461+0000","last_unstale":"2024-09-13T18:50:07.231160+0000","last_undegraded":"2024-09-13T18:50:07.231160+0000","last_fullsized":"2024-09-13T18:50:07.231160+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:12.854462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591798+0000","last_change":"2024-09-13T18:50:05.599476+0000","last_active":"2024-09-13T18:50:06.591798+0000","last_peered":"2024-09-13T18:50:06.591798+0000","last_clean":"2024-09-13T18:50:06.591798+0000","last_became_active":"2024-09-13T18:50:05.598394+0000","last_became_peered":"2024-09-13T18:50:05.598394+0000","last_unstale":"2024-09-13T18:50:06.591798+0000","last_undegraded":"2024-09-13T18:50:06.591798+0000","last_fullsized":"2024-09-13T18:50:06.591798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:07.371205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587551+0000","last_change":"2024-09-13T18:50:05.127200+0000","last_active":"2024-09-13T18:50:06.587551+0000","last_peered":"2024-09-13T18:50:06.587551+0000","last_clean":"2024-09-13T18:50:06.587551+0000","last_became_active":"2024-09-13T18:50:05.126870+0000","last_became_peered":"2024-09-13T18:50:05.126870+0000","last_unstale":"2024-09-13T18:50:06.587551+0000","last_undegraded":"2024-09-13T18:50:06.587551+0000","last_fullsized":"2024-09-13T18:50:06.587551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:42.287350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231163+0000","last_change":"2024-09-13T18:50:05.605547+0000","last_active":"2024-09-13T18:50:07.231163+0000","last_peered":"2024-09-13T18:50:07.231163+0000","last_clean":"2024-09-13T18:50:07.231163+0000","last_became_active":"2024-09-13T18:50:05.605254+0000","last_became_peered":"2024-09-13T18:50:05.605254+0000","last_unstale":"2024-09-13T18:50:07.231163+0000","last_undegraded":"2024-09-13T18:50:07.231163+0000","last_fullsized":"2024-09-13T18:50:07.231163+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:47.770636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227884+0000","last_change":"2024-09-13T18:50:05.134437+0000","last_active":"2024-09-13T18:50:07.227884+0000","last_peered":"2024-09-13T18:50:07.227884+0000","last_clean":"2024-09-13T18:50:07.227884+0000","last_became_active":"2024-09-13T18:50:05.134088+0000","last_became_peered":"2024-09-13T18:50:05.134088+0000","last_unstale":"2024-09-13T18:50:07.227884+0000","last_undegraded":"2024-09-13T18:50:07.227884+0000","last_fullsized":"2024-09-13T18:50:07.227884+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:08.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588968+0000","last_change":"2024-09-13T18:50:05.605726+0000","last_active":"2024-09-13T18:50:06.588968+0000","last_peered":"2024-09-13T18:50:06.588968+0000","last_clean":"2024-09-13T18:50:06.588968+0000","last_became_active":"2024-09-13T18:50:05.605474+0000","last_became_peered":"2024-09-13T18:50:05.605474+0000","last_unstale":"2024-09-13T18:50:06.588968+0000","last_undegraded":"2024-09-13T18:50:06.588968+0000","last_fullsized":"2024-09-13T18:50:06.588968+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:34.212972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587846+0000","last_change":"2024-09-13T18:50:05.129460+0000","last_active":"2024-09-13T18:50:06.587846+0000","last_peered":"2024-09-13T18:50:06.587846+0000","last_clean":"2024-09-13T18:50:06.587846+0000","last_became_active":"2024-09-13T18:50:05.129017+0000","last_became_peered":"2024-09-13T18:50:05.129017+0000","last_unstale":"2024-09-13T18:50:06.587846+0000","last_undegraded":"2024-09-13T18:50:06.587846+0000","last_fullsized":"2024-09-13T18:50:06.587846+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:16.448168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588365+0000","last_change":"2024-09-13T18:50:05.608893+0000","last_active":"2024-09-13T18:50:06.588365+0000","last_peered":"2024-09-13T18:50:06.588365+0000","last_clean":"2024-09-13T18:50:06.588365+0000","last_became_active":"2024-09-13T18:50:05.608653+0000","last_became_peered":"2024-09-13T18:50:05.608653+0000","last_unstale":"2024-09-13T18:50:06.588365+0000","last_undegraded":"2024-09-13T18:50:06.588365+0000","last_fullsized":"2024-09-13T18:50:06.588365+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:12.712081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227481+0000","last_change":"2024-09-13T18:50:05.128993+0000","last_active":"2024-09-13T18:50:07.227481+0000","last_peered":"2024-09-13T18:50:07.227481+0000","last_clean":"2024-09-13T18:50:07.227481+0000","last_became_active":"2024-09-13T18:50:05.128690+0000","last_became_peered":"2024-09-13T18:50:05.128690+0000","last_unstale":"2024-09-13T18:50:07.227481+0000","last_undegraded":"2024-09-13T18:50:07.227481+0000","last_fullsized":"2024-09-13T18:50:07.227481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.861379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591159+0000","last_change":"2024-09-13T18:50:05.614004+0000","last_active":"2024-09-13T18:50:06.591159+0000","last_peered":"2024-09-13T18:50:06.591159+0000","last_clean":"2024-09-13T18:50:06.591159+0000","last_became_active":"2024-09-13T18:50:05.613417+0000","last_became_peered":"2024-09-13T18:50:05.613417+0000","last_unstale":"2024-09-13T18:50:06.591159+0000","last_undegraded":"2024-09-13T18:50:06.591159+0000","last_fullsized":"2024-09-13T18:50:06.591159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:14.481326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231592+0000","last_change":"2024-09-13T18:50:05.133624+0000","last_active":"2024-09-13T18:50:07.231592+0000","last_peered":"2024-09-13T18:50:07.231592+0000","last_clean":"2024-09-13T18:50:07.231592+0000","last_became_active":"2024-09-13T18:50:05.133398+0000","last_became_peered":"2024-09-13T18:50:05.133398+0000","last_unstale":"2024-09-13T18:50:07.231592+0000","last_undegraded":"2024-09-13T18:50:07.231592+0000","last_fullsized":"2024-09-13T18:50:07.231592+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:46.890441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587008+0000","last_change":"2024-09-13T18:50:05.601820+0000","last_active":"2024-09-13T18:50:06.587008+0000","last_peered":"2024-09-13T18:50:06.587008+0000","last_clean":"2024-09-13T18:50:06.587008+0000","last_became_active":"2024-09-13T18:50:05.601570+0000","last_became_peered":"2024-09-13T18:50:05.601570+0000","last_unstale":"2024-09-13T18:50:06.587008+0000","last_undegraded":"2024-09-13T18:50:06.587008+0000","last_fullsized":"2024-09-13T18:50:06.587008+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:47.770636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776794+0000","last_change":"2024-09-13T18:50:05.135430+0000","last_active":"2024-09-13T18:50:06.776794+0000","last_peered":"2024-09-13T18:50:06.776794+0000","last_clean":"2024-09-13T18:50:06.776794+0000","last_became_active":"2024-09-13T18:50:05.135175+0000","last_became_peered":"2024-09-13T18:50:05.135175+0000","last_unstale":"2024-09-13T18:50:06.776794+0000","last_undegraded":"2024-09-13T18:50:06.776794+0000","last_fullsized":"2024-09-13T18:50:06.776794+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:27.455197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228974+0000","last_change":"2024-09-13T18:50:05.608878+0000","last_active":"2024-09-13T18:50:07.228974+0000","last_peered":"2024-09-13T18:50:07.228974+0000","last_clean":"2024-09-13T18:50:07.228974+0000","last_became_active":"2024-09-13T18:50:05.608649+0000","last_became_peered":"2024-09-13T18:50:05.608649+0000","last_unstale":"2024-09-13T18:50:07.228974+0000","last_undegraded":"2024-09-13T18:50:07.228974+0000","last_fullsized":"2024-09-13T18:50:07.228974+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:16.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588939+0000","last_change":"2024-09-13T18:50:05.127034+0000","last_active":"2024-09-13T18:50:06.588939+0000","last_peered":"2024-09-13T18:50:06.588939+0000","last_clean":"2024-09-13T18:50:06.588939+0000","last_became_active":"2024-09-13T18:50:05.126785+0000","last_became_peered":"2024-09-13T18:50:05.126785+0000","last_unstale":"2024-09-13T18:50:06.588939+0000","last_undegraded":"2024-09-13T18:50:06.588939+0000","last_fullsized":"2024-09-13T18:50:06.588939+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:13.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588199+0000","last_change":"2024-09-13T18:50:05.616925+0000","last_active":"2024-09-13T18:50:06.588199+0000","last_peered":"2024-09-13T18:50:06.588199+0000","last_clean":"2024-09-13T18:50:06.588199+0000","last_became_active":"2024-09-13T18:50:05.616632+0000","last_became_peered":"2024-09-13T18:50:05.616632+0000","last_unstale":"2024-09-13T18:50:06.588199+0000","last_undegraded":"2024-09-13T18:50:06.588199+0000","last_fullsized":"2024-09-13T18:50:06.588199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:13.238349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229073+0000","last_change":"2024-09-13T18:50:05.128856+0000","last_active":"2024-09-13T18:50:07.229073+0000","last_peered":"2024-09-13T18:50:07.229073+0000","last_clean":"2024-09-13T18:50:07.229073+0000","last_became_active":"2024-09-13T18:50:05.128586+0000","last_became_peered":"2024-09-13T18:50:05.128586+0000","last_unstale":"2024-09-13T18:50:07.229073+0000","last_undegraded":"2024-09-13T18:50:07.229073+0000","last_fullsized":"2024-09-13T18:50:07.229073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:40.634257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591649+0000","last_change":"2024-09-13T18:50:05.616167+0000","last_active":"2024-09-13T18:50:06.591649+0000","last_peered":"2024-09-13T18:50:06.591649+0000","last_clean":"2024-09-13T18:50:06.591649+0000","last_became_active":"2024-09-13T18:50:05.615729+0000","last_became_peered":"2024-09-13T18:50:05.615729+0000","last_unstale":"2024-09-13T18:50:06.591649+0000","last_undegraded":"2024-09-13T18:50:06.591649+0000","last_fullsized":"2024-09-13T18:50:06.591649+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:09.293934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228850+0000","last_change":"2024-09-13T18:50:05.129422+0000","last_active":"2024-09-13T18:50:07.228850+0000","last_peered":"2024-09-13T18:50:07.228850+0000","last_clean":"2024-09-13T18:50:07.228850+0000","last_became_active":"2024-09-13T18:50:05.129168+0000","last_became_peered":"2024-09-13T18:50:05.129168+0000","last_unstale":"2024-09-13T18:50:07.228850+0000","last_undegraded":"2024-09-13T18:50:07.228850+0000","last_fullsized":"2024-09-13T18:50:07.228850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:45.254532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588783+0000","last_change":"2024-09-13T18:50:05.610034+0000","last_active":"2024-09-13T18:50:06.588783+0000","last_peered":"2024-09-13T18:50:06.588783+0000","last_clean":"2024-09-13T18:50:06.588783+0000","last_became_active":"2024-09-13T18:50:05.609772+0000","last_became_peered":"2024-09-13T18:50:05.609772+0000","last_unstale":"2024-09-13T18:50:06.588783+0000","last_undegraded":"2024-09-13T18:50:06.588783+0000","last_fullsized":"2024-09-13T18:50:06.588783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:41.647818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231399+0000","last_change":"2024-09-13T18:50:05.133548+0000","last_active":"2024-09-13T18:50:07.231399+0000","last_peered":"2024-09-13T18:50:07.231399+0000","last_clean":"2024-09-13T18:50:07.231399+0000","last_became_active":"2024-09-13T18:50:05.133292+0000","last_became_peered":"2024-09-13T18:50:05.133292+0000","last_unstale":"2024-09-13T18:50:07.231399+0000","last_undegraded":"2024-09-13T18:50:07.231399+0000","last_fullsized":"2024-09-13T18:50:07.231399+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:46.890441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229818+0000","last_change":"2024-09-13T18:50:05.613867+0000","last_active":"2024-09-13T18:50:07.229818+0000","last_peered":"2024-09-13T18:50:07.229818+0000","last_clean":"2024-09-13T18:50:07.229818+0000","last_became_active":"2024-09-13T18:50:05.613641+0000","last_became_peered":"2024-09-13T18:50:05.613641+0000","last_unstale":"2024-09-13T18:50:07.229818+0000","last_undegraded":"2024-09-13T18:50:07.229818+0000","last_fullsized":"2024-09-13T18:50:07.229818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:17.592182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591405+0000","last_change":"2024-09-13T18:50:05.133333+0000","last_active":"2024-09-13T18:50:06.591405+0000","last_peered":"2024-09-13T18:50:06.591405+0000","last_clean":"2024-09-13T18:50:06.591405+0000","last_became_active":"2024-09-13T18:50:05.133060+0000","last_became_peered":"2024-09-13T18:50:05.133060+0000","last_unstale":"2024-09-13T18:50:06.591405+0000","last_undegraded":"2024-09-13T18:50:06.591405+0000","last_fullsized":"2024-09-13T18:50:06.591405+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:59.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230641+0000","last_change":"2024-09-13T18:50:05.604277+0000","last_active":"2024-09-13T18:50:07.230641+0000","last_peered":"2024-09-13T18:50:07.230641+0000","last_clean":"2024-09-13T18:50:07.230641+0000","last_became_active":"2024-09-13T18:50:05.604011+0000","last_became_peered":"2024-09-13T18:50:05.604011+0000","last_unstale":"2024-09-13T18:50:07.230641+0000","last_undegraded":"2024-09-13T18:50:07.230641+0000","last_fullsized":"2024-09-13T18:50:07.230641+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588880+0000","last_change":"2024-09-13T18:50:05.132665+0000","last_active":"2024-09-13T18:50:06.588880+0000","last_peered":"2024-09-13T18:50:06.588880+0000","last_clean":"2024-09-13T18:50:06.588880+0000","last_became_active":"2024-09-13T18:50:05.132375+0000","last_became_peered":"2024-09-13T18:50:05.132375+0000","last_unstale":"2024-09-13T18:50:06.588880+0000","last_undegraded":"2024-09-13T18:50:06.588880+0000","last_fullsized":"2024-09-13T18:50:06.588880+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:38.250098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T18:50:05.606760+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:50:05.606760+0000","last_peered":"2024-09-13T18:50:05.606760+0000","last_clean":"2024-09-13T18:50:05.606760+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:50:05.606760+0000","last_undegraded":"2024-09-13T18:50:05.606760+0000","last_fullsized":"2024-09-13T18:50:05.606760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":871106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76600000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4099999999999999,"5min":1.468,"15min":1.468},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.129,"15min":1.143},"min":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3759999999999999,"5min":1.585,"15min":1.585},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.1299999999999999,"15min":1.141},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4790000000000001,"5min":1.619,"15min":1.619},"last":1.133},{"interface":"front","average":{"1min":1.123,"5min":1.2230000000000001,"15min":1.24},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4330000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.93600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.333,"15min":1.3560000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.482,"5min":1.829,"15min":1.829},"last":0.997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.202,"15min":1.21},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5309999999999999,"5min":1.625,"15min":1.625},"last":1.071}]},{"osd":3,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.647,"5min":1.696,"15min":1.696},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.4390000000000001,"15min":1.464},"min":{"1min":0.995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5549999999999999,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.04}]},{"osd":4,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1080000000000001,"15min":1.1140000000000001},"min":{"1min":0.79200000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.175,"15min":1.175},"min":{"1min":0.66700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4239999999999999,"5min":1.532,"15min":1.532},"last":1.514}]},{"osd":5,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.3300000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5800000000000001,"5min":1.714,"15min":1.714},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3939999999999999,"15min":1.4059999999999999},"min":{"1min":0.94699999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.486,"5min":1.76,"15min":1.76},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.96499999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":626688,"data_stored":274646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1439999999999999,"15min":1.1539999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.8169999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.1639999999999999,"15min":1.1819999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5029999999999999,"5min":1.55,"15min":1.55},"last":1.349}]},{"osd":1,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1200000000000001,"15min":1.117},"min":{"1min":0.70599999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.266},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4470000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.456,"15min":1.494},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.675,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.044},{"interface":"front","average":{"1min":1.212,"5min":1.496,"15min":1.544},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.5720000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.387}]},{"osd":3,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.5229999999999999,"15min":1.5589999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7230000000000001,"5min":4.883,"15min":4.883},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.538,"15min":1.581},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9810000000000001,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.323,"15min":1.3400000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.353,"15min":1.3620000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.796,"5min":2.077,"15min":2.077},"last":1.496}]},{"osd":5,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.7290000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.5,"15min":1.504},"min":{"1min":1.1240000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.47}]},{"osd":7,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.482,"15min":1.492},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.548,"15min":1.5680000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1709999999999998,"5min":2.367,"15min":2.367},"last":1.091}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":630784,"data_stored":280614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.202,"15min":1.226},"min":{"1min":0.70799999999999996,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4470000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.77100000000000002,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3500000000000001,"5min":2.278,"15min":2.278},"last":1.425}]},{"osd":1,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2729999999999999,"15min":1.292},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5289999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.351},{"interface":"front","average":{"1min":1.121,"5min":1.1930000000000001,"15min":1.2050000000000001},"min":{"1min":0.85999999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5589999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.321}]},{"osd":2,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2949999999999999,"15min":1.3089999999999999},"min":{"1min":0.84699999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7470000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.27,"15min":1.284},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.46,"5min":2.157,"15min":2.157},"last":1.214}]},{"osd":3,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.383,"15min":1.4019999999999999},"min":{"1min":1.024,"5min":0.749,"15min":0.749},"max":{"1min":1.601,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.444,"15min":1.47},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7030000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.4419999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.2410000000000001,"15min":1.2470000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5760000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.276,"15min":1.2889999999999999},"min":{"1min":0.89100000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5189999999999999,"5min":1.974,"15min":1.974},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.292,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.645,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.153},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3680000000000001,"15min":1.377},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.54,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4279999999999999,"15min":1.4419999999999999},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5489999999999999,"5min":2.169,"15min":2.169},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.5089999999999999,"15min":1.5349999999999999},"min":{"1min":0.95899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.804,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.395}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":634880,"data_stored":281196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.119,"15min":1.1319999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.131,"15min":1.1379999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.542,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3680000000000001,"15min":1.375},"min":{"1min":0.88900000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.6319999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3340000000000001,"15min":1.3440000000000001},"min":{"1min":0.86399999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.617,"5min":2.423,"15min":2.423},"last":1.806}]},{"osd":2,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.92800000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.99,"15min":1.99},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3839999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.694,"5min":2.335,"15min":2.335},"last":1.637}]},{"osd":3,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3080000000000001,"15min":1.3340000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.397,"5min":2.621,"15min":2.621},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.2649999999999999,"15min":1.284},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.506,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.323,"15min":1.341},"min":{"1min":0.85599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.718},{"interface":"front","average":{"1min":1.258,"5min":1.327,"15min":1.339},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7569999999999999,"5min":2.266,"15min":2.266},"last":1.089}]},{"osd":6,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3660000000000001,"15min":1.3859999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.319,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.371},{"interface":"front","average":{"1min":1.379,"5min":1.47,"15min":1.4850000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.7969999999999999,"5min":2.5,"15min":2.5},"last":1.544}]},{"osd":7,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.476,"15min":1.488},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.7150000000000001,"5min":2.395,"15min":2.395},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.4850000000000001,"15min":1.4970000000000001},"min":{"1min":1.1100000000000001,"5min":1.079,"15min":1.079},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.1459999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":634880,"data_stored":275580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.88200000000000001,"15min":0.90500000000000003},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.331,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.86799999999999999,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.095,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.071,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.464,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.98199999999999998,"15min":0.995},"min":{"1min":0.69199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.502,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.569,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.21,"15min":1.248},"min":{"1min":0.78700000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.431,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4490000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.2390000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2869999999999999,"15min":1.3280000000000001},"min":{"1min":0.83899999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.613,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.353,"15min":1.389},"min":{"1min":0.88400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.548,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1559999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.417,"15min":1.4490000000000001},"min":{"1min":0.95699999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":2.714,"15min":2.714},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.8520000000000001,"5min":2.52,"15min":2.52},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.4630000000000001,"15min":1.542},"min":{"1min":0.97799999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5620000000000001,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.401,"15min":1.4530000000000001},"min":{"1min":0.98399999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.5489999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3540000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":275558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.97499999999999998,"15min":1.0229999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98699999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.073,"15min":1.109},"min":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.337,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":1.1359999999999999,"15min":1.1970000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1060000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.232,"15min":1.266},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.589,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.3149999999999999,"15min":1.3600000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.651,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.2230000000000001,"15min":1.274},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4490000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.123}]},{"osd":4,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.681,"15min":1.7569999999999999},"min":{"1min":0.96299999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.5049999999999999,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.036},{"interface":"front","average":{"1min":1.21,"5min":1.4590000000000001,"15min":1.5009999999999999},"min":{"1min":1.0009999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.556,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.524,"15min":1.5649999999999999},"min":{"1min":1.089,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.54,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.502,"15min":1.548},"min":{"1min":1.0109999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.7370000000000001,"5min":4.335,"15min":4.335},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.5569999999999999,"15min":1.605},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.4470000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.7889999999999999,"15min":1.877},"min":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.6319999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.232}]},{"osd":7,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.5760000000000001,"15min":1.6180000000000001},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.6890000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.6279999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.01}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":280774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89100000000000001,"15min":0.90900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.0680000000000001,"15min":1.1100000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.286,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.196,"15min":1.2250000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.615,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.0740000000000001,"15min":1.095},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.411,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.3129999999999999,"15min":1.363},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.516,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.417,"5min":10.368,"15min":10.368},"last":1.1539999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3919999999999999,"15min":1.4159999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.673,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.365,"15min":1.391},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.611,"5min":2.911,"15min":2.911},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.758,"15min":1.859},"min":{"1min":0.77300000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5880000000000001,"5min":10.214,"15min":10.214},"last":1.258},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.488,"15min":1.5249999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.3919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.595,"15min":1.651},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5569999999999999,"5min":6.032,"15min":6.032},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.8089999999999999,"15min":1.903},"min":{"1min":0.84399999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.526,"5min":10.112,"15min":10.112},"last":1.302}]},{"osd":7,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.8660000000000001,"15min":1.962},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6080000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.585,"15min":1.623},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":1.7689999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.335}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1232896,"data_stored":871038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.95299999999999996,"15min":1.0369999999999999},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0329999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.95399999999999996,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.119,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.1020000000000001,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.294,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.995},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.167,"15min":1.2549999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3080000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":1.2649999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.171,"15min":1.2330000000000001},"min":{"1min":0.65200000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4490000000000001,"5min":4.093,"15min":4.093},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.379,"15min":1.4710000000000001},"min":{"1min":0.75700000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5800000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3959999999999999,"15min":1.4850000000000001},"min":{"1min":1.0089999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.556,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.492},"min":{"1min":1.004,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.597,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.597}]},{"osd":5,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.5680000000000001,"15min":1.6739999999999999},"min":{"1min":0.97699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.8029999999999999,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.4830000000000001,"15min":1.5880000000000001},"min":{"1min":1.121,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.4690000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.173}]},{"osd":6,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4990000000000001,"15min":1.6000000000000001},"min":{"1min":1.0229999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.714,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.714},{"interface":"front","average":{"1min":1.319,"5min":1.631,"15min":1.7649999999999999},"min":{"1min":1.091,"5min":1.042,"15min":1.042},"max":{"1min":1.51,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.552,"15min":1.6419999999999999},"min":{"1min":1.0189999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7529999999999999,"5min":3.056,"15min":3.056},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.5509999999999999,"15min":1.6719999999999999},"min":{"1min":1.038,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.6579999999999999,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:50:09.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:50:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.158+0000 7f3deee00700 1 Processor -- start 2024-09-13T18:50:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.158+0000 7f3deee00700 1 -- start start 2024-09-13T18:50:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3deee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3de80cb700 0x7f3de806aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3deee00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3de806afe0 0x7f3de81636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3deee00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de80707d0 con 0x7f3de8159bd0 2024-09-13T18:50:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3deee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de806b470 con 0x7f3de80cb700 2024-09-13T18:50:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3deee00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de80720a0 con 0x7f3de806afe0 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3de80cb700 0x7f3de806aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3de80cb700 0x7f3de806aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53164/0 (socket says 172.21.15.81:53164) 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 -- 172.21.15.81:0/1107992284 learned_addr learned my addr 172.21.15.81:0/1107992284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3dee400700 1 --2- 172.21.15.81:0/1107992284 >> v2:172.21.15.178:3300/0 conn(0x7f3de806afe0 0x7f3de81636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 -- 172.21.15.81:0/1107992284 >> v2:172.21.15.178:3300/0 conn(0x7f3de806afe0 msgr2=0x7f3de81636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 --2- 172.21.15.81:0/1107992284 >> v2:172.21.15.178:3300/0 conn(0x7f3de806afe0 0x7f3de81636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 -- 172.21.15.81:0/1107992284 >> v1:172.21.15.81:6789/0 conn(0x7f3de8159bd0 legacy=0x7f3de8071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 -- 172.21.15.81:0/1107992284 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de806fee0 con 0x7f3de80cb700 2024-09-13T18:50:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3dee400700 1 --2- 172.21.15.81:0/1107992284 >> v2:172.21.15.178:3300/0 conn(0x7f3de806afe0 0x7f3de81636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3ded000700 1 --2- 172.21.15.81:0/1107992284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de80cb700 0x7f3de806aaa0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3de80cb260 tx=0x7f3dd4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b87e3b5decf48af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.162+0000 7f3de7e00700 1 -- 172.21.15.81:0/1107992284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd400ba20 con 0x7f3de80cb700 2024-09-13T18:50:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3de7e00700 1 -- 172.21.15.81:0/1107992284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd400bb80 con 0x7f3de80cb700 2024-09-13T18:50:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3de7e00700 1 -- 172.21.15.81:0/1107992284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4009e60 con 0x7f3de80cb700 2024-09-13T18:50:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 -- 172.21.15.81:0/1107992284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de80cb700 msgr2=0x7f3de806aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 --2- 172.21.15.81:0/1107992284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de80cb700 0x7f3de806aaa0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3de80cb260 tx=0x7f3dd4009c20 comp rx=0 tx=0).stop 2024-09-13T18:50:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 -- 172.21.15.81:0/1107992284 shutdown_connections 2024-09-13T18:50:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 --2- 172.21.15.81:0/1107992284 >> v2:172.21.15.178:3300/0 conn(0x7f3de806afe0 0x7f3de81636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 --2- 172.21.15.81:0/1107992284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de80cb700 0x7f3de806aaa0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 -- 172.21.15.81:0/1107992284 >> 172.21.15.81:0/1107992284 conn(0x7f3de80b0c40 msgr2=0x7f3de806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 -- 172.21.15.81:0/1107992284 shutdown_connections 2024-09-13T18:50:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 -- 172.21.15.81:0/1107992284 wait complete. 2024-09-13T18:50:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 Processor -- start 2024-09-13T18:50:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.166+0000 7f3deee00700 1 -- start start 2024-09-13T18:50:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 0x7f3de81e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80cb700 0x7f3de8158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8159bd0 0x7f3de815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81e4360 con 0x7f3de806afe0 2024-09-13T18:50:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de81e7000 con 0x7f3de8159bd0 2024-09-13T18:50:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de815bc50 con 0x7f3de80cb700 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 0x7f3de81e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 0x7f3de81e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53178/0 (socket says 172.21.15.81:53178) 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 -- 172.21.15.81:0/2545578883 learned_addr learned my addr 172.21.15.81:0/2545578883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3ded000700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80cb700 0x7f3de8158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3dee400700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8159bd0 0x7f3de815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 -- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80cb700 msgr2=0x7f3de8158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80cb700 0x7f3de8158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 -- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8159bd0 msgr2=0x7f3de815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8159bd0 0x7f3de815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 -- 172.21.15.81:0/2545578883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4009570 con 0x7f3de806afe0 2024-09-13T18:50:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deda00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 0x7f3de81e3e20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00cbc0 tx=0x7f3ddc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc003c20 con 0x7f3de806afe0 2024-09-13T18:50:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc003d80 con 0x7f3de806afe0 2024-09-13T18:50:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de815bf30 con 0x7f3de806afe0 2024-09-13T18:50:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc00aaa0 con 0x7f3de806afe0 2024-09-13T18:50:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.170+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de81e3620 con 0x7f3de806afe0 2024-09-13T18:50:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.174+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de806aaa0 con 0x7f3de806afe0 2024-09-13T18:50:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.174+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ddc00ac00 con 0x7f3de806afe0 2024-09-13T18:50:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.178+0000 7f3de5600700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dc8066730 0x7f3dc8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.178+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ddc084270 con 0x7f3de806afe0 2024-09-13T18:50:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.178+0000 7f3ded000700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dc8066730 0x7f3dc8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.178+0000 7f3ded000700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dc8066730 0x7f3dc8068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4000c00 tx=0x7f3dd4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.182+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ddc051400 con 0x7f3de806afe0 2024-09-13T18:50:10.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.370+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3de8070460 con 0x7f3dc8066730 2024-09-13T18:50:10.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.386+0000 7f3de5600700 1 -- 172.21.15.81:0/2545578883 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286773 (secure 0 0 0) 0x7f3dd400b8a0 con 0x7f3dc8066730 2024-09-13T18:50:10.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dc8066730 msgr2=0x7f3dc8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dc8066730 0x7f3dc8068bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4000c00 tx=0x7f3dd4008030 comp rx=0 tx=0).stop 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 msgr2=0x7f3de81e3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 0x7f3de81e3e20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc00cbc0 tx=0x7f3ddc00ced0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 shutdown_connections 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3dc8066730 0x7f3dc8068bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3de8159bd0 0x7f3de815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3de80cb700 0x7f3de8158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 --2- 172.21.15.81:0/2545578883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3de806afe0 0x7f3de81e3e20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 >> 172.21.15.81:0/2545578883 conn(0x7f3de80b0c40 msgr2=0x7f3de8155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 shutdown_connections 2024-09-13T18:50:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.394+0000 7f3deee00700 1 -- 172.21.15.81:0/2545578883 wait complete. 2024-09-13T18:50:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:50:10.429 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-13T18:50:09.026917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238716,"kb_used_data":6116,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736004,"statfs":{"total":773094113280,"available":772849668096,"internally_reserved":0,"allocated":6262784,"data_stored":3410512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":238014011},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.933528"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588231+0000","last_change":"2024-09-13T18:50:05.594747+0000","last_active":"2024-09-13T18:50:06.588231+0000","last_peered":"2024-09-13T18:50:06.588231+0000","last_clean":"2024-09-13T18:50:06.588231+0000","last_became_active":"2024-09-13T18:50:05.593543+0000","last_became_peered":"2024-09-13T18:50:05.593543+0000","last_unstale":"2024-09-13T18:50:06.588231+0000","last_undegraded":"2024-09-13T18:50:06.588231+0000","last_fullsized":"2024-09-13T18:50:06.588231+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:56.861367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776657+0000","last_change":"2024-09-13T18:50:05.618843+0000","last_active":"2024-09-13T18:50:06.776657+0000","last_peered":"2024-09-13T18:50:06.776657+0000","last_clean":"2024-09-13T18:50:06.776657+0000","last_became_active":"2024-09-13T18:50:05.618478+0000","last_became_peered":"2024-09-13T18:50:05.618478+0000","last_unstale":"2024-09-13T18:50:06.776657+0000","last_undegraded":"2024-09-13T18:50:06.776657+0000","last_fullsized":"2024-09-13T18:50:06.776657+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:50.641649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588700+0000","last_change":"2024-09-13T18:50:05.611596+0000","last_active":"2024-09-13T18:50:06.588700+0000","last_peered":"2024-09-13T18:50:06.588700+0000","last_clean":"2024-09-13T18:50:06.588700+0000","last_became_active":"2024-09-13T18:50:05.609456+0000","last_became_peered":"2024-09-13T18:50:05.609456+0000","last_unstale":"2024-09-13T18:50:06.588700+0000","last_undegraded":"2024-09-13T18:50:06.588700+0000","last_fullsized":"2024-09-13T18:50:06.588700+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:15.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776554+0000","last_change":"2024-09-13T18:50:05.623671+0000","last_active":"2024-09-13T18:50:06.776554+0000","last_peered":"2024-09-13T18:50:06.776554+0000","last_clean":"2024-09-13T18:50:06.776554+0000","last_became_active":"2024-09-13T18:50:05.623488+0000","last_became_peered":"2024-09-13T18:50:05.623488+0000","last_unstale":"2024-09-13T18:50:06.776554+0000","last_undegraded":"2024-09-13T18:50:06.776554+0000","last_fullsized":"2024-09-13T18:50:06.776554+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:54.523708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.232000+0000","last_change":"2024-09-13T18:50:05.611927+0000","last_active":"2024-09-13T18:50:07.232000+0000","last_peered":"2024-09-13T18:50:07.232000+0000","last_clean":"2024-09-13T18:50:07.232000+0000","last_became_active":"2024-09-13T18:50:05.611657+0000","last_became_peered":"2024-09-13T18:50:05.611657+0000","last_unstale":"2024-09-13T18:50:07.232000+0000","last_undegraded":"2024-09-13T18:50:07.232000+0000","last_fullsized":"2024-09-13T18:50:07.232000+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:56.861367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.586976+0000","last_change":"2024-09-13T18:50:05.611640+0000","last_active":"2024-09-13T18:50:06.586976+0000","last_peered":"2024-09-13T18:50:06.586976+0000","last_clean":"2024-09-13T18:50:06.586976+0000","last_became_active":"2024-09-13T18:50:05.611257+0000","last_became_peered":"2024-09-13T18:50:05.611257+0000","last_unstale":"2024-09-13T18:50:06.586976+0000","last_undegraded":"2024-09-13T18:50:06.586976+0000","last_fullsized":"2024-09-13T18:50:06.586976+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:34.315902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587568+0000","last_change":"2024-09-13T18:50:05.601792+0000","last_active":"2024-09-13T18:50:06.587568+0000","last_peered":"2024-09-13T18:50:06.587568+0000","last_clean":"2024-09-13T18:50:06.587568+0000","last_became_active":"2024-09-13T18:50:05.601521+0000","last_became_peered":"2024-09-13T18:50:05.601521+0000","last_unstale":"2024-09-13T18:50:06.587568+0000","last_undegraded":"2024-09-13T18:50:06.587568+0000","last_fullsized":"2024-09-13T18:50:06.587568+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:25.541318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228032+0000","last_change":"2024-09-13T18:50:05.624095+0000","last_active":"2024-09-13T18:50:07.228032+0000","last_peered":"2024-09-13T18:50:07.228032+0000","last_clean":"2024-09-13T18:50:07.228032+0000","last_became_active":"2024-09-13T18:50:05.619545+0000","last_became_peered":"2024-09-13T18:50:05.619545+0000","last_unstale":"2024-09-13T18:50:07.228032+0000","last_undegraded":"2024-09-13T18:50:07.228032+0000","last_fullsized":"2024-09-13T18:50:07.228032+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:35.599927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229695+0000","last_change":"2024-09-13T18:50:05.622685+0000","last_active":"2024-09-13T18:50:07.229695+0000","last_peered":"2024-09-13T18:50:07.229695+0000","last_clean":"2024-09-13T18:50:07.229695+0000","last_became_active":"2024-09-13T18:50:05.622523+0000","last_became_peered":"2024-09-13T18:50:05.622523+0000","last_unstale":"2024-09-13T18:50:07.229695+0000","last_undegraded":"2024-09-13T18:50:07.229695+0000","last_fullsized":"2024-09-13T18:50:07.229695+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:52.918579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587601+0000","last_change":"2024-09-13T18:50:05.603430+0000","last_active":"2024-09-13T18:50:06.587601+0000","last_peered":"2024-09-13T18:50:06.587601+0000","last_clean":"2024-09-13T18:50:06.587601+0000","last_became_active":"2024-09-13T18:50:05.603167+0000","last_became_peered":"2024-09-13T18:50:05.603167+0000","last_unstale":"2024-09-13T18:50:06.587601+0000","last_undegraded":"2024-09-13T18:50:06.587601+0000","last_fullsized":"2024-09-13T18:50:06.587601+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228427+0000","last_change":"2024-09-13T18:50:05.612164+0000","last_active":"2024-09-13T18:50:07.228427+0000","last_peered":"2024-09-13T18:50:07.228427+0000","last_clean":"2024-09-13T18:50:07.228427+0000","last_became_active":"2024-09-13T18:50:05.611939+0000","last_became_peered":"2024-09-13T18:50:05.611939+0000","last_unstale":"2024-09-13T18:50:07.228427+0000","last_undegraded":"2024-09-13T18:50:07.228427+0000","last_fullsized":"2024-09-13T18:50:07.228427+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:24.438216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229211+0000","last_change":"2024-09-13T18:50:05.610394+0000","last_active":"2024-09-13T18:50:07.229211+0000","last_peered":"2024-09-13T18:50:07.229211+0000","last_clean":"2024-09-13T18:50:07.229211+0000","last_became_active":"2024-09-13T18:50:05.610049+0000","last_became_peered":"2024-09-13T18:50:05.610049+0000","last_unstale":"2024-09-13T18:50:07.229211+0000","last_undegraded":"2024-09-13T18:50:07.229211+0000","last_fullsized":"2024-09-13T18:50:07.229211+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:50:02.856552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587111+0000","last_change":"2024-09-13T18:50:05.600110+0000","last_active":"2024-09-13T18:50:06.587111+0000","last_peered":"2024-09-13T18:50:06.587111+0000","last_clean":"2024-09-13T18:50:06.587111+0000","last_became_active":"2024-09-13T18:50:05.599848+0000","last_became_peered":"2024-09-13T18:50:05.599848+0000","last_unstale":"2024-09-13T18:50:06.587111+0000","last_undegraded":"2024-09-13T18:50:06.587111+0000","last_fullsized":"2024-09-13T18:50:06.587111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.829552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588419+0000","last_change":"2024-09-13T18:50:05.612408+0000","last_active":"2024-09-13T18:50:06.588419+0000","last_peered":"2024-09-13T18:50:06.588419+0000","last_clean":"2024-09-13T18:50:06.588419+0000","last_became_active":"2024-09-13T18:50:05.612189+0000","last_became_peered":"2024-09-13T18:50:05.612189+0000","last_unstale":"2024-09-13T18:50:06.588419+0000","last_undegraded":"2024-09-13T18:50:06.588419+0000","last_fullsized":"2024-09-13T18:50:06.588419+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:23.808542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776218+0000","last_change":"2024-09-13T18:50:05.618012+0000","last_active":"2024-09-13T18:50:06.776218+0000","last_peered":"2024-09-13T18:50:06.776218+0000","last_clean":"2024-09-13T18:50:06.776218+0000","last_became_active":"2024-09-13T18:50:05.617755+0000","last_became_peered":"2024-09-13T18:50:05.617755+0000","last_unstale":"2024-09-13T18:50:06.776218+0000","last_undegraded":"2024-09-13T18:50:06.776218+0000","last_fullsized":"2024-09-13T18:50:06.776218+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:09.884703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.586805+0000","last_change":"2024-09-13T18:50:05.597629+0000","last_active":"2024-09-13T18:50:06.586805+0000","last_peered":"2024-09-13T18:50:06.586805+0000","last_clean":"2024-09-13T18:50:06.586805+0000","last_became_active":"2024-09-13T18:50:05.597348+0000","last_became_peered":"2024-09-13T18:50:05.597348+0000","last_unstale":"2024-09-13T18:50:06.586805+0000","last_undegraded":"2024-09-13T18:50:06.586805+0000","last_fullsized":"2024-09-13T18:50:06.586805+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:41.701588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.589059+0000","last_change":"2024-09-13T18:50:05.600783+0000","last_active":"2024-09-13T18:50:06.589059+0000","last_peered":"2024-09-13T18:50:06.589059+0000","last_clean":"2024-09-13T18:50:06.589059+0000","last_became_active":"2024-09-13T18:50:05.600563+0000","last_became_peered":"2024-09-13T18:50:05.600563+0000","last_unstale":"2024-09-13T18:50:06.589059+0000","last_undegraded":"2024-09-13T18:50:06.589059+0000","last_fullsized":"2024-09-13T18:50:06.589059+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:31.399914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776732+0000","last_change":"2024-09-13T18:50:05.622274+0000","last_active":"2024-09-13T18:50:06.776732+0000","last_peered":"2024-09-13T18:50:06.776732+0000","last_clean":"2024-09-13T18:50:06.776732+0000","last_became_active":"2024-09-13T18:50:05.621821+0000","last_became_peered":"2024-09-13T18:50:05.621821+0000","last_unstale":"2024-09-13T18:50:06.776732+0000","last_undegraded":"2024-09-13T18:50:06.776732+0000","last_fullsized":"2024-09-13T18:50:06.776732+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:24.135921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588721+0000","last_change":"2024-09-13T18:50:05.602114+0000","last_active":"2024-09-13T18:50:06.588721+0000","last_peered":"2024-09-13T18:50:06.588721+0000","last_clean":"2024-09-13T18:50:06.588721+0000","last_became_active":"2024-09-13T18:50:05.601660+0000","last_became_peered":"2024-09-13T18:50:05.601660+0000","last_unstale":"2024-09-13T18:50:06.588721+0000","last_undegraded":"2024-09-13T18:50:06.588721+0000","last_fullsized":"2024-09-13T18:50:06.588721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:07:22.012470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230921+0000","last_change":"2024-09-13T18:50:05.606223+0000","last_active":"2024-09-13T18:50:07.230921+0000","last_peered":"2024-09-13T18:50:07.230921+0000","last_clean":"2024-09-13T18:50:07.230921+0000","last_became_active":"2024-09-13T18:50:05.605933+0000","last_became_peered":"2024-09-13T18:50:05.605933+0000","last_unstale":"2024-09-13T18:50:07.230921+0000","last_undegraded":"2024-09-13T18:50:07.230921+0000","last_fullsized":"2024-09-13T18:50:07.230921+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:34.489512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230755+0000","last_change":"2024-09-13T18:50:05.612328+0000","last_active":"2024-09-13T18:50:07.230755+0000","last_peered":"2024-09-13T18:50:07.230755+0000","last_clean":"2024-09-13T18:50:07.230755+0000","last_became_active":"2024-09-13T18:50:05.612066+0000","last_became_peered":"2024-09-13T18:50:05.612066+0000","last_unstale":"2024-09-13T18:50:07.230755+0000","last_undegraded":"2024-09-13T18:50:07.230755+0000","last_fullsized":"2024-09-13T18:50:07.230755+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:34.315902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227649+0000","last_change":"2024-09-13T18:50:05.619936+0000","last_active":"2024-09-13T18:50:07.227649+0000","last_peered":"2024-09-13T18:50:07.227649+0000","last_clean":"2024-09-13T18:50:07.227649+0000","last_became_active":"2024-09-13T18:50:05.619685+0000","last_became_peered":"2024-09-13T18:50:05.619685+0000","last_unstale":"2024-09-13T18:50:07.227649+0000","last_undegraded":"2024-09-13T18:50:07.227649+0000","last_fullsized":"2024-09-13T18:50:07.227649+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:10.904516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227675+0000","last_change":"2024-09-13T18:50:05.614385+0000","last_active":"2024-09-13T18:50:07.227675+0000","last_peered":"2024-09-13T18:50:07.227675+0000","last_clean":"2024-09-13T18:50:07.227675+0000","last_became_active":"2024-09-13T18:50:05.614098+0000","last_became_peered":"2024-09-13T18:50:05.614098+0000","last_unstale":"2024-09-13T18:50:07.227675+0000","last_undegraded":"2024-09-13T18:50:07.227675+0000","last_fullsized":"2024-09-13T18:50:07.227675+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:47.490054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587109+0000","last_change":"2024-09-13T18:50:05.610962+0000","last_active":"2024-09-13T18:50:06.587109+0000","last_peered":"2024-09-13T18:50:06.587109+0000","last_clean":"2024-09-13T18:50:06.587109+0000","last_became_active":"2024-09-13T18:50:05.608138+0000","last_became_peered":"2024-09-13T18:50:05.608138+0000","last_unstale":"2024-09-13T18:50:06.587109+0000","last_undegraded":"2024-09-13T18:50:06.587109+0000","last_fullsized":"2024-09-13T18:50:06.587109+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:46.268093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.589084+0000","last_change":"2024-09-13T18:50:05.613115+0000","last_active":"2024-09-13T18:50:06.589084+0000","last_peered":"2024-09-13T18:50:06.589084+0000","last_clean":"2024-09-13T18:50:06.589084+0000","last_became_active":"2024-09-13T18:50:05.612853+0000","last_became_peered":"2024-09-13T18:50:05.612853+0000","last_unstale":"2024-09-13T18:50:06.589084+0000","last_undegraded":"2024-09-13T18:50:06.589084+0000","last_fullsized":"2024-09-13T18:50:06.589084+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:29.785337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229326+0000","last_change":"2024-09-13T18:50:05.613977+0000","last_active":"2024-09-13T18:50:07.229326+0000","last_peered":"2024-09-13T18:50:07.229326+0000","last_clean":"2024-09-13T18:50:07.229326+0000","last_became_active":"2024-09-13T18:50:05.613272+0000","last_became_peered":"2024-09-13T18:50:05.613272+0000","last_unstale":"2024-09-13T18:50:07.229326+0000","last_undegraded":"2024-09-13T18:50:07.229326+0000","last_fullsized":"2024-09-13T18:50:07.229326+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:29.553567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587614+0000","last_change":"2024-09-13T18:50:05.597555+0000","last_active":"2024-09-13T18:50:06.587614+0000","last_peered":"2024-09-13T18:50:06.587614+0000","last_clean":"2024-09-13T18:50:06.587614+0000","last_became_active":"2024-09-13T18:50:05.597282+0000","last_became_peered":"2024-09-13T18:50:05.597282+0000","last_unstale":"2024-09-13T18:50:06.587614+0000","last_undegraded":"2024-09-13T18:50:06.587614+0000","last_fullsized":"2024-09-13T18:50:06.587614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.066197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231332+0000","last_change":"2024-09-13T18:50:05.607434+0000","last_active":"2024-09-13T18:50:07.231332+0000","last_peered":"2024-09-13T18:50:07.231332+0000","last_clean":"2024-09-13T18:50:07.231332+0000","last_became_active":"2024-09-13T18:50:05.607148+0000","last_became_peered":"2024-09-13T18:50:05.607148+0000","last_unstale":"2024-09-13T18:50:07.231332+0000","last_undegraded":"2024-09-13T18:50:07.231332+0000","last_fullsized":"2024-09-13T18:50:07.231332+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:19.829552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587860+0000","last_change":"2024-09-13T18:50:05.596943+0000","last_active":"2024-09-13T18:50:06.587860+0000","last_peered":"2024-09-13T18:50:06.587860+0000","last_clean":"2024-09-13T18:50:06.587860+0000","last_became_active":"2024-09-13T18:50:05.596651+0000","last_became_peered":"2024-09-13T18:50:05.596651+0000","last_unstale":"2024-09-13T18:50:06.587860+0000","last_undegraded":"2024-09-13T18:50:06.587860+0000","last_fullsized":"2024-09-13T18:50:06.587860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:46.580779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776445+0000","last_change":"2024-09-13T18:50:05.617870+0000","last_active":"2024-09-13T18:50:06.776445+0000","last_peered":"2024-09-13T18:50:06.776445+0000","last_clean":"2024-09-13T18:50:06.776445+0000","last_became_active":"2024-09-13T18:50:05.617556+0000","last_became_peered":"2024-09-13T18:50:05.617556+0000","last_unstale":"2024-09-13T18:50:06.776445+0000","last_undegraded":"2024-09-13T18:50:06.776445+0000","last_fullsized":"2024-09-13T18:50:06.776445+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:30.300154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587902+0000","last_change":"2024-09-13T18:50:05.610099+0000","last_active":"2024-09-13T18:50:06.587902+0000","last_peered":"2024-09-13T18:50:06.587902+0000","last_clean":"2024-09-13T18:50:06.587902+0000","last_became_active":"2024-09-13T18:50:05.609833+0000","last_became_peered":"2024-09-13T18:50:05.609833+0000","last_unstale":"2024-09-13T18:50:06.587902+0000","last_undegraded":"2024-09-13T18:50:06.587902+0000","last_fullsized":"2024-09-13T18:50:06.587902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:51.371581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591161+0000","last_change":"2024-09-13T18:50:05.628139+0000","last_active":"2024-09-13T18:50:06.591161+0000","last_peered":"2024-09-13T18:50:06.591161+0000","last_clean":"2024-09-13T18:50:06.591161+0000","last_became_active":"2024-09-13T18:50:05.627802+0000","last_became_peered":"2024-09-13T18:50:05.627802+0000","last_unstale":"2024-09-13T18:50:06.591161+0000","last_undegraded":"2024-09-13T18:50:06.591161+0000","last_fullsized":"2024-09-13T18:50:06.591161+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:50.641649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.775996+0000","last_change":"2024-09-13T18:50:05.617171+0000","last_active":"2024-09-13T18:50:06.775996+0000","last_peered":"2024-09-13T18:50:06.775996+0000","last_clean":"2024-09-13T18:50:06.775996+0000","last_became_active":"2024-09-13T18:50:05.616721+0000","last_became_peered":"2024-09-13T18:50:05.616721+0000","last_unstale":"2024-09-13T18:50:06.775996+0000","last_undegraded":"2024-09-13T18:50:06.775996+0000","last_fullsized":"2024-09-13T18:50:06.775996+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:14.481326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231589+0000","last_change":"2024-09-13T18:50:05.132381+0000","last_active":"2024-09-13T18:50:07.231589+0000","last_peered":"2024-09-13T18:50:07.231589+0000","last_clean":"2024-09-13T18:50:07.231589+0000","last_became_active":"2024-09-13T18:50:05.132056+0000","last_became_peered":"2024-09-13T18:50:05.132056+0000","last_unstale":"2024-09-13T18:50:07.231589+0000","last_undegraded":"2024-09-13T18:50:07.231589+0000","last_fullsized":"2024-09-13T18:50:07.231589+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.871142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591477+0000","last_change":"2024-09-13T18:50:05.613901+0000","last_active":"2024-09-13T18:50:06.591477+0000","last_peered":"2024-09-13T18:50:06.591477+0000","last_clean":"2024-09-13T18:50:06.591477+0000","last_became_active":"2024-09-13T18:50:05.613561+0000","last_became_peered":"2024-09-13T18:50:05.613561+0000","last_unstale":"2024-09-13T18:50:06.591477+0000","last_undegraded":"2024-09-13T18:50:06.591477+0000","last_fullsized":"2024-09-13T18:50:06.591477+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587906+0000","last_change":"2024-09-13T18:50:05.136268+0000","last_active":"2024-09-13T18:50:06.587906+0000","last_peered":"2024-09-13T18:50:06.587906+0000","last_clean":"2024-09-13T18:50:06.587906+0000","last_became_active":"2024-09-13T18:50:05.135943+0000","last_became_peered":"2024-09-13T18:50:05.135943+0000","last_unstale":"2024-09-13T18:50:06.587906+0000","last_undegraded":"2024-09-13T18:50:06.587906+0000","last_fullsized":"2024-09-13T18:50:06.587906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:01:28.917656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230860+0000","last_change":"2024-09-13T18:50:05.619777+0000","last_active":"2024-09-13T18:50:07.230860+0000","last_peered":"2024-09-13T18:50:07.230860+0000","last_clean":"2024-09-13T18:50:07.230860+0000","last_became_active":"2024-09-13T18:50:05.619520+0000","last_became_peered":"2024-09-13T18:50:05.619520+0000","last_unstale":"2024-09-13T18:50:07.230860+0000","last_undegraded":"2024-09-13T18:50:07.230860+0000","last_fullsized":"2024-09-13T18:50:07.230860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.066197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587513+0000","last_change":"2024-09-13T18:50:05.133330+0000","last_active":"2024-09-13T18:50:06.587513+0000","last_peered":"2024-09-13T18:50:06.587513+0000","last_clean":"2024-09-13T18:50:06.587513+0000","last_became_active":"2024-09-13T18:50:05.133045+0000","last_became_peered":"2024-09-13T18:50:05.133045+0000","last_unstale":"2024-09-13T18:50:06.587513+0000","last_undegraded":"2024-09-13T18:50:06.587513+0000","last_fullsized":"2024-09-13T18:50:06.587513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:46.241085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228909+0000","last_change":"2024-09-13T18:50:05.613419+0000","last_active":"2024-09-13T18:50:07.228909+0000","last_peered":"2024-09-13T18:50:07.228909+0000","last_clean":"2024-09-13T18:50:07.228909+0000","last_became_active":"2024-09-13T18:50:05.613126+0000","last_became_peered":"2024-09-13T18:50:05.613126+0000","last_unstale":"2024-09-13T18:50:07.228909+0000","last_undegraded":"2024-09-13T18:50:07.228909+0000","last_fullsized":"2024-09-13T18:50:07.228909+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:53.581272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591738+0000","last_change":"2024-09-13T18:50:05.130403+0000","last_active":"2024-09-13T18:50:06.591738+0000","last_peered":"2024-09-13T18:50:06.591738+0000","last_clean":"2024-09-13T18:50:06.591738+0000","last_became_active":"2024-09-13T18:50:05.130147+0000","last_became_peered":"2024-09-13T18:50:05.130147+0000","last_unstale":"2024-09-13T18:50:06.591738+0000","last_undegraded":"2024-09-13T18:50:06.591738+0000","last_fullsized":"2024-09-13T18:50:06.591738+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:42.287350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.232221+0000","last_change":"2024-09-13T18:50:05.617910+0000","last_active":"2024-09-13T18:50:07.232221+0000","last_peered":"2024-09-13T18:50:07.232221+0000","last_clean":"2024-09-13T18:50:07.232221+0000","last_became_active":"2024-09-13T18:50:05.617612+0000","last_became_peered":"2024-09-13T18:50:05.617612+0000","last_unstale":"2024-09-13T18:50:07.232221+0000","last_undegraded":"2024-09-13T18:50:07.232221+0000","last_fullsized":"2024-09-13T18:50:07.232221+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587959+0000","last_change":"2024-09-13T18:50:05.131909+0000","last_active":"2024-09-13T18:50:06.587959+0000","last_peered":"2024-09-13T18:50:06.587959+0000","last_clean":"2024-09-13T18:50:06.587959+0000","last_became_active":"2024-09-13T18:50:05.131673+0000","last_became_peered":"2024-09-13T18:50:05.131673+0000","last_unstale":"2024-09-13T18:50:06.587959+0000","last_undegraded":"2024-09-13T18:50:06.587959+0000","last_fullsized":"2024-09-13T18:50:06.587959+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:23.122360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776462+0000","last_change":"2024-09-13T18:50:05.618663+0000","last_active":"2024-09-13T18:50:06.776462+0000","last_peered":"2024-09-13T18:50:06.776462+0000","last_clean":"2024-09-13T18:50:06.776462+0000","last_became_active":"2024-09-13T18:50:05.618303+0000","last_became_peered":"2024-09-13T18:50:05.618303+0000","last_unstale":"2024-09-13T18:50:06.776462+0000","last_undegraded":"2024-09-13T18:50:06.776462+0000","last_fullsized":"2024-09-13T18:50:06.776462+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:39.263659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231878+0000","last_change":"2024-09-13T18:50:05.131793+0000","last_active":"2024-09-13T18:50:07.231878+0000","last_peered":"2024-09-13T18:50:07.231878+0000","last_clean":"2024-09-13T18:50:07.231878+0000","last_became_active":"2024-09-13T18:50:05.131495+0000","last_became_peered":"2024-09-13T18:50:05.131495+0000","last_unstale":"2024-09-13T18:50:07.231878+0000","last_undegraded":"2024-09-13T18:50:07.231878+0000","last_fullsized":"2024-09-13T18:50:07.231878+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:16.448168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229614+0000","last_change":"2024-09-13T18:50:05.613460+0000","last_active":"2024-09-13T18:50:07.229614+0000","last_peered":"2024-09-13T18:50:07.229614+0000","last_clean":"2024-09-13T18:50:07.229614+0000","last_became_active":"2024-09-13T18:50:05.612945+0000","last_became_peered":"2024-09-13T18:50:05.612945+0000","last_unstale":"2024-09-13T18:50:07.229614+0000","last_undegraded":"2024-09-13T18:50:07.229614+0000","last_fullsized":"2024-09-13T18:50:07.229614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:46.987813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230845+0000","last_change":"2024-09-13T18:50:05.136351+0000","last_active":"2024-09-13T18:50:07.230845+0000","last_peered":"2024-09-13T18:50:07.230845+0000","last_clean":"2024-09-13T18:50:07.230845+0000","last_became_active":"2024-09-13T18:50:05.136086+0000","last_became_peered":"2024-09-13T18:50:05.136086+0000","last_unstale":"2024-09-13T18:50:07.230845+0000","last_undegraded":"2024-09-13T18:50:07.230845+0000","last_fullsized":"2024-09-13T18:50:07.230845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:38.250098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776833+0000","last_change":"2024-09-13T18:50:05.625952+0000","last_active":"2024-09-13T18:50:06.776833+0000","last_peered":"2024-09-13T18:50:06.776833+0000","last_clean":"2024-09-13T18:50:06.776833+0000","last_became_active":"2024-09-13T18:50:05.625751+0000","last_became_peered":"2024-09-13T18:50:05.625751+0000","last_unstale":"2024-09-13T18:50:06.776833+0000","last_undegraded":"2024-09-13T18:50:06.776833+0000","last_fullsized":"2024-09-13T18:50:06.776833+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:13.868022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587163+0000","last_change":"2024-09-13T18:50:05.133335+0000","last_active":"2024-09-13T18:50:06.587163+0000","last_peered":"2024-09-13T18:50:06.587163+0000","last_clean":"2024-09-13T18:50:06.587163+0000","last_became_active":"2024-09-13T18:50:05.133098+0000","last_became_peered":"2024-09-13T18:50:05.133098+0000","last_unstale":"2024-09-13T18:50:06.587163+0000","last_undegraded":"2024-09-13T18:50:06.587163+0000","last_fullsized":"2024-09-13T18:50:06.587163+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:08.871142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231422+0000","last_change":"2024-09-13T18:50:05.627816+0000","last_active":"2024-09-13T18:50:07.231422+0000","last_peered":"2024-09-13T18:50:07.231422+0000","last_clean":"2024-09-13T18:50:07.231422+0000","last_became_active":"2024-09-13T18:50:05.627464+0000","last_became_peered":"2024-09-13T18:50:05.627464+0000","last_unstale":"2024-09-13T18:50:07.231422+0000","last_undegraded":"2024-09-13T18:50:07.231422+0000","last_fullsized":"2024-09-13T18:50:07.231422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:07.371205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776717+0000","last_change":"2024-09-13T18:50:05.137868+0000","last_active":"2024-09-13T18:50:06.776717+0000","last_peered":"2024-09-13T18:50:06.776717+0000","last_clean":"2024-09-13T18:50:06.776717+0000","last_became_active":"2024-09-13T18:50:05.137624+0000","last_became_peered":"2024-09-13T18:50:05.137624+0000","last_unstale":"2024-09-13T18:50:06.776717+0000","last_undegraded":"2024-09-13T18:50:06.776717+0000","last_fullsized":"2024-09-13T18:50:06.776717+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:55.394236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591028+0000","last_change":"2024-09-13T18:50:05.598892+0000","last_active":"2024-09-13T18:50:06.591028+0000","last_peered":"2024-09-13T18:50:06.591028+0000","last_clean":"2024-09-13T18:50:06.591028+0000","last_became_active":"2024-09-13T18:50:05.598601+0000","last_became_peered":"2024-09-13T18:50:05.598601+0000","last_unstale":"2024-09-13T18:50:06.591028+0000","last_undegraded":"2024-09-13T18:50:06.591028+0000","last_fullsized":"2024-09-13T18:50:06.591028+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:22:24.135921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.232327+0000","last_change":"2024-09-13T18:50:05.137663+0000","last_active":"2024-09-13T18:50:07.232327+0000","last_peered":"2024-09-13T18:50:07.232327+0000","last_clean":"2024-09-13T18:50:07.232327+0000","last_became_active":"2024-09-13T18:50:05.136081+0000","last_became_peered":"2024-09-13T18:50:05.136081+0000","last_unstale":"2024-09-13T18:50:07.232327+0000","last_undegraded":"2024-09-13T18:50:07.232327+0000","last_fullsized":"2024-09-13T18:50:07.232327+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:53.510147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588619+0000","last_change":"2024-09-13T18:50:05.606852+0000","last_active":"2024-09-13T18:50:06.588619+0000","last_peered":"2024-09-13T18:50:06.588619+0000","last_clean":"2024-09-13T18:50:06.588619+0000","last_became_active":"2024-09-13T18:50:05.606575+0000","last_became_peered":"2024-09-13T18:50:05.606575+0000","last_unstale":"2024-09-13T18:50:06.588619+0000","last_undegraded":"2024-09-13T18:50:06.588619+0000","last_fullsized":"2024-09-13T18:50:06.588619+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:46.975236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776722+0000","last_change":"2024-09-13T18:50:05.139595+0000","last_active":"2024-09-13T18:50:06.776722+0000","last_peered":"2024-09-13T18:50:06.776722+0000","last_clean":"2024-09-13T18:50:06.776722+0000","last_became_active":"2024-09-13T18:50:05.139337+0000","last_became_peered":"2024-09-13T18:50:05.139337+0000","last_unstale":"2024-09-13T18:50:06.776722+0000","last_undegraded":"2024-09-13T18:50:06.776722+0000","last_fullsized":"2024-09-13T18:50:06.776722+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:42.476519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231979+0000","last_change":"2024-09-13T18:50:05.614641+0000","last_active":"2024-09-13T18:50:07.231979+0000","last_peered":"2024-09-13T18:50:07.231979+0000","last_clean":"2024-09-13T18:50:07.231979+0000","last_became_active":"2024-09-13T18:50:05.614400+0000","last_became_peered":"2024-09-13T18:50:05.614400+0000","last_unstale":"2024-09-13T18:50:07.231979+0000","last_undegraded":"2024-09-13T18:50:07.231979+0000","last_fullsized":"2024-09-13T18:50:07.231979+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:09.293934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229475+0000","last_change":"2024-09-13T18:50:05.128709+0000","last_active":"2024-09-13T18:50:07.229475+0000","last_peered":"2024-09-13T18:50:07.229475+0000","last_clean":"2024-09-13T18:50:07.229475+0000","last_became_active":"2024-09-13T18:50:05.128331+0000","last_became_peered":"2024-09-13T18:50:05.128331+0000","last_unstale":"2024-09-13T18:50:07.229475+0000","last_undegraded":"2024-09-13T18:50:07.229475+0000","last_fullsized":"2024-09-13T18:50:07.229475+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:52.761461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591335+0000","last_change":"2024-09-13T18:50:05.614204+0000","last_active":"2024-09-13T18:50:06.591335+0000","last_peered":"2024-09-13T18:50:06.591335+0000","last_clean":"2024-09-13T18:50:06.591335+0000","last_became_active":"2024-09-13T18:50:05.613868+0000","last_became_peered":"2024-09-13T18:50:05.613868+0000","last_unstale":"2024-09-13T18:50:06.591335+0000","last_undegraded":"2024-09-13T18:50:06.591335+0000","last_fullsized":"2024-09-13T18:50:06.591335+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:56.861367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588040+0000","last_change":"2024-09-13T18:50:05.132904+0000","last_active":"2024-09-13T18:50:06.588040+0000","last_peered":"2024-09-13T18:50:06.588040+0000","last_clean":"2024-09-13T18:50:06.588040+0000","last_became_active":"2024-09-13T18:50:05.132576+0000","last_became_peered":"2024-09-13T18:50:05.132576+0000","last_unstale":"2024-09-13T18:50:06.588040+0000","last_undegraded":"2024-09-13T18:50:06.588040+0000","last_fullsized":"2024-09-13T18:50:06.588040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:29.286594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588977+0000","last_change":"2024-09-13T18:50:05.606989+0000","last_active":"2024-09-13T18:50:06.588977+0000","last_peered":"2024-09-13T18:50:06.588977+0000","last_clean":"2024-09-13T18:50:06.588977+0000","last_became_active":"2024-09-13T18:50:05.606598+0000","last_became_peered":"2024-09-13T18:50:05.606598+0000","last_unstale":"2024-09-13T18:50:06.588977+0000","last_undegraded":"2024-09-13T18:50:06.588977+0000","last_fullsized":"2024-09-13T18:50:06.588977+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:54.991570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230993+0000","last_change":"2024-09-13T18:50:05.131829+0000","last_active":"2024-09-13T18:50:07.230993+0000","last_peered":"2024-09-13T18:50:07.230993+0000","last_clean":"2024-09-13T18:50:07.230993+0000","last_became_active":"2024-09-13T18:50:05.131534+0000","last_became_peered":"2024-09-13T18:50:05.131534+0000","last_unstale":"2024-09-13T18:50:07.230993+0000","last_undegraded":"2024-09-13T18:50:07.230993+0000","last_fullsized":"2024-09-13T18:50:07.230993+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:53.510147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229439+0000","last_change":"2024-09-13T18:50:05.621719+0000","last_active":"2024-09-13T18:50:07.229439+0000","last_peered":"2024-09-13T18:50:07.229439+0000","last_clean":"2024-09-13T18:50:07.229439+0000","last_became_active":"2024-09-13T18:50:05.620575+0000","last_became_peered":"2024-09-13T18:50:05.620575+0000","last_unstale":"2024-09-13T18:50:07.229439+0000","last_undegraded":"2024-09-13T18:50:07.229439+0000","last_fullsized":"2024-09-13T18:50:07.229439+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:22.140559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776447+0000","last_change":"2024-09-13T18:50:05.136596+0000","last_active":"2024-09-13T18:50:06.776447+0000","last_peered":"2024-09-13T18:50:06.776447+0000","last_clean":"2024-09-13T18:50:06.776447+0000","last_became_active":"2024-09-13T18:50:05.136058+0000","last_became_peered":"2024-09-13T18:50:05.136058+0000","last_unstale":"2024-09-13T18:50:06.776447+0000","last_undegraded":"2024-09-13T18:50:06.776447+0000","last_fullsized":"2024-09-13T18:50:06.776447+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:37.636372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588939+0000","last_change":"2024-09-13T18:50:05.595888+0000","last_active":"2024-09-13T18:50:06.588939+0000","last_peered":"2024-09-13T18:50:06.588939+0000","last_clean":"2024-09-13T18:50:06.588939+0000","last_became_active":"2024-09-13T18:50:05.595649+0000","last_became_peered":"2024-09-13T18:50:05.595649+0000","last_unstale":"2024-09-13T18:50:06.588939+0000","last_undegraded":"2024-09-13T18:50:06.588939+0000","last_fullsized":"2024-09-13T18:50:06.588939+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:14.033589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228226+0000","last_change":"2024-09-13T18:50:05.128315+0000","last_active":"2024-09-13T18:50:07.228226+0000","last_peered":"2024-09-13T18:50:07.228226+0000","last_clean":"2024-09-13T18:50:07.228226+0000","last_became_active":"2024-09-13T18:50:05.128041+0000","last_became_peered":"2024-09-13T18:50:05.128041+0000","last_unstale":"2024-09-13T18:50:07.228226+0000","last_undegraded":"2024-09-13T18:50:07.228226+0000","last_fullsized":"2024-09-13T18:50:07.228226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:33.199411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228111+0000","last_change":"2024-09-13T18:50:05.606051+0000","last_active":"2024-09-13T18:50:07.228111+0000","last_peered":"2024-09-13T18:50:07.228111+0000","last_clean":"2024-09-13T18:50:07.228111+0000","last_became_active":"2024-09-13T18:50:05.605744+0000","last_became_peered":"2024-09-13T18:50:05.605744+0000","last_unstale":"2024-09-13T18:50:07.228111+0000","last_undegraded":"2024-09-13T18:50:07.228111+0000","last_fullsized":"2024-09-13T18:50:07.228111+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:11.089086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.589125+0000","last_change":"2024-09-13T18:50:05.131074+0000","last_active":"2024-09-13T18:50:06.589125+0000","last_peered":"2024-09-13T18:50:06.589125+0000","last_clean":"2024-09-13T18:50:06.589125+0000","last_became_active":"2024-09-13T18:50:05.130802+0000","last_became_peered":"2024-09-13T18:50:05.130802+0000","last_unstale":"2024-09-13T18:50:06.589125+0000","last_undegraded":"2024-09-13T18:50:06.589125+0000","last_fullsized":"2024-09-13T18:50:06.589125+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:12.854462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587183+0000","last_change":"2024-09-13T18:50:05.594588+0000","last_active":"2024-09-13T18:50:06.587183+0000","last_peered":"2024-09-13T18:50:06.587183+0000","last_clean":"2024-09-13T18:50:06.587183+0000","last_became_active":"2024-09-13T18:50:05.594333+0000","last_became_peered":"2024-09-13T18:50:05.594333+0000","last_unstale":"2024-09-13T18:50:06.587183+0000","last_undegraded":"2024-09-13T18:50:06.587183+0000","last_fullsized":"2024-09-13T18:50:06.587183+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:34.489512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228705+0000","last_change":"2024-09-13T18:50:05.127446+0000","last_active":"2024-09-13T18:50:07.228705+0000","last_peered":"2024-09-13T18:50:07.228705+0000","last_clean":"2024-09-13T18:50:07.228705+0000","last_became_active":"2024-09-13T18:50:05.127181+0000","last_became_peered":"2024-09-13T18:50:05.127181+0000","last_unstale":"2024-09-13T18:50:07.228705+0000","last_undegraded":"2024-09-13T18:50:07.228705+0000","last_fullsized":"2024-09-13T18:50:07.228705+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:50:23.983012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231285+0000","last_change":"2024-09-13T18:50:05.611166+0000","last_active":"2024-09-13T18:50:07.231285+0000","last_peered":"2024-09-13T18:50:07.231285+0000","last_clean":"2024-09-13T18:50:07.231285+0000","last_became_active":"2024-09-13T18:50:05.610898+0000","last_became_peered":"2024-09-13T18:50:05.610898+0000","last_unstale":"2024-09-13T18:50:07.231285+0000","last_undegraded":"2024-09-13T18:50:07.231285+0000","last_fullsized":"2024-09-13T18:50:07.231285+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:38:41.701588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231485+0000","last_change":"2024-09-13T18:50:05.139639+0000","last_active":"2024-09-13T18:50:07.231485+0000","last_peered":"2024-09-13T18:50:07.231485+0000","last_clean":"2024-09-13T18:50:07.231485+0000","last_became_active":"2024-09-13T18:50:05.139358+0000","last_became_peered":"2024-09-13T18:50:05.139358+0000","last_unstale":"2024-09-13T18:50:07.231485+0000","last_undegraded":"2024-09-13T18:50:07.231485+0000","last_fullsized":"2024-09-13T18:50:07.231485+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:19:29.286594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587330+0000","last_change":"2024-09-13T18:50:05.594410+0000","last_active":"2024-09-13T18:50:06.587330+0000","last_peered":"2024-09-13T18:50:06.587330+0000","last_clean":"2024-09-13T18:50:06.587330+0000","last_became_active":"2024-09-13T18:50:05.593977+0000","last_became_peered":"2024-09-13T18:50:05.593977+0000","last_unstale":"2024-09-13T18:50:06.587330+0000","last_undegraded":"2024-09-13T18:50:06.587330+0000","last_fullsized":"2024-09-13T18:50:06.587330+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:07.371205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231160+0000","last_change":"2024-09-13T18:50:05.128930+0000","last_active":"2024-09-13T18:50:07.231160+0000","last_peered":"2024-09-13T18:50:07.231160+0000","last_clean":"2024-09-13T18:50:07.231160+0000","last_became_active":"2024-09-13T18:50:05.128461+0000","last_became_peered":"2024-09-13T18:50:05.128461+0000","last_unstale":"2024-09-13T18:50:07.231160+0000","last_undegraded":"2024-09-13T18:50:07.231160+0000","last_fullsized":"2024-09-13T18:50:07.231160+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:12.854462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591798+0000","last_change":"2024-09-13T18:50:05.599476+0000","last_active":"2024-09-13T18:50:06.591798+0000","last_peered":"2024-09-13T18:50:06.591798+0000","last_clean":"2024-09-13T18:50:06.591798+0000","last_became_active":"2024-09-13T18:50:05.598394+0000","last_became_peered":"2024-09-13T18:50:05.598394+0000","last_unstale":"2024-09-13T18:50:06.591798+0000","last_undegraded":"2024-09-13T18:50:06.591798+0000","last_fullsized":"2024-09-13T18:50:06.591798+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:07.371205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587551+0000","last_change":"2024-09-13T18:50:05.127200+0000","last_active":"2024-09-13T18:50:06.587551+0000","last_peered":"2024-09-13T18:50:06.587551+0000","last_clean":"2024-09-13T18:50:06.587551+0000","last_became_active":"2024-09-13T18:50:05.126870+0000","last_became_peered":"2024-09-13T18:50:05.126870+0000","last_unstale":"2024-09-13T18:50:06.587551+0000","last_undegraded":"2024-09-13T18:50:06.587551+0000","last_fullsized":"2024-09-13T18:50:06.587551+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:42.287350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231163+0000","last_change":"2024-09-13T18:50:05.605547+0000","last_active":"2024-09-13T18:50:07.231163+0000","last_peered":"2024-09-13T18:50:07.231163+0000","last_clean":"2024-09-13T18:50:07.231163+0000","last_became_active":"2024-09-13T18:50:05.605254+0000","last_became_peered":"2024-09-13T18:50:05.605254+0000","last_unstale":"2024-09-13T18:50:07.231163+0000","last_undegraded":"2024-09-13T18:50:07.231163+0000","last_fullsized":"2024-09-13T18:50:07.231163+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:47.770636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227884+0000","last_change":"2024-09-13T18:50:05.134437+0000","last_active":"2024-09-13T18:50:07.227884+0000","last_peered":"2024-09-13T18:50:07.227884+0000","last_clean":"2024-09-13T18:50:07.227884+0000","last_became_active":"2024-09-13T18:50:05.134088+0000","last_became_peered":"2024-09-13T18:50:05.134088+0000","last_unstale":"2024-09-13T18:50:07.227884+0000","last_undegraded":"2024-09-13T18:50:07.227884+0000","last_fullsized":"2024-09-13T18:50:07.227884+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:08.362116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588968+0000","last_change":"2024-09-13T18:50:05.605726+0000","last_active":"2024-09-13T18:50:06.588968+0000","last_peered":"2024-09-13T18:50:06.588968+0000","last_clean":"2024-09-13T18:50:06.588968+0000","last_became_active":"2024-09-13T18:50:05.605474+0000","last_became_peered":"2024-09-13T18:50:05.605474+0000","last_unstale":"2024-09-13T18:50:06.588968+0000","last_undegraded":"2024-09-13T18:50:06.588968+0000","last_fullsized":"2024-09-13T18:50:06.588968+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:34.212972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587846+0000","last_change":"2024-09-13T18:50:05.129460+0000","last_active":"2024-09-13T18:50:06.587846+0000","last_peered":"2024-09-13T18:50:06.587846+0000","last_clean":"2024-09-13T18:50:06.587846+0000","last_became_active":"2024-09-13T18:50:05.129017+0000","last_became_peered":"2024-09-13T18:50:05.129017+0000","last_unstale":"2024-09-13T18:50:06.587846+0000","last_undegraded":"2024-09-13T18:50:06.587846+0000","last_fullsized":"2024-09-13T18:50:06.587846+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:16.448168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588365+0000","last_change":"2024-09-13T18:50:05.608893+0000","last_active":"2024-09-13T18:50:06.588365+0000","last_peered":"2024-09-13T18:50:06.588365+0000","last_clean":"2024-09-13T18:50:06.588365+0000","last_became_active":"2024-09-13T18:50:05.608653+0000","last_became_peered":"2024-09-13T18:50:05.608653+0000","last_unstale":"2024-09-13T18:50:06.588365+0000","last_undegraded":"2024-09-13T18:50:06.588365+0000","last_fullsized":"2024-09-13T18:50:06.588365+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:12.712081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.227481+0000","last_change":"2024-09-13T18:50:05.128993+0000","last_active":"2024-09-13T18:50:07.227481+0000","last_peered":"2024-09-13T18:50:07.227481+0000","last_clean":"2024-09-13T18:50:07.227481+0000","last_became_active":"2024-09-13T18:50:05.128690+0000","last_became_peered":"2024-09-13T18:50:05.128690+0000","last_unstale":"2024-09-13T18:50:07.227481+0000","last_undegraded":"2024-09-13T18:50:07.227481+0000","last_fullsized":"2024-09-13T18:50:07.227481+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:50.861379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591159+0000","last_change":"2024-09-13T18:50:05.614004+0000","last_active":"2024-09-13T18:50:06.591159+0000","last_peered":"2024-09-13T18:50:06.591159+0000","last_clean":"2024-09-13T18:50:06.591159+0000","last_became_active":"2024-09-13T18:50:05.613417+0000","last_became_peered":"2024-09-13T18:50:05.613417+0000","last_unstale":"2024-09-13T18:50:06.591159+0000","last_undegraded":"2024-09-13T18:50:06.591159+0000","last_fullsized":"2024-09-13T18:50:06.591159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:14.481326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231592+0000","last_change":"2024-09-13T18:50:05.133624+0000","last_active":"2024-09-13T18:50:07.231592+0000","last_peered":"2024-09-13T18:50:07.231592+0000","last_clean":"2024-09-13T18:50:07.231592+0000","last_became_active":"2024-09-13T18:50:05.133398+0000","last_became_peered":"2024-09-13T18:50:05.133398+0000","last_unstale":"2024-09-13T18:50:07.231592+0000","last_undegraded":"2024-09-13T18:50:07.231592+0000","last_fullsized":"2024-09-13T18:50:07.231592+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:46.890441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.587008+0000","last_change":"2024-09-13T18:50:05.601820+0000","last_active":"2024-09-13T18:50:06.587008+0000","last_peered":"2024-09-13T18:50:06.587008+0000","last_clean":"2024-09-13T18:50:06.587008+0000","last_became_active":"2024-09-13T18:50:05.601570+0000","last_became_peered":"2024-09-13T18:50:05.601570+0000","last_unstale":"2024-09-13T18:50:06.587008+0000","last_undegraded":"2024-09-13T18:50:06.587008+0000","last_fullsized":"2024-09-13T18:50:06.587008+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:47.770636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.776794+0000","last_change":"2024-09-13T18:50:05.135430+0000","last_active":"2024-09-13T18:50:06.776794+0000","last_peered":"2024-09-13T18:50:06.776794+0000","last_clean":"2024-09-13T18:50:06.776794+0000","last_became_active":"2024-09-13T18:50:05.135175+0000","last_became_peered":"2024-09-13T18:50:05.135175+0000","last_unstale":"2024-09-13T18:50:06.776794+0000","last_undegraded":"2024-09-13T18:50:06.776794+0000","last_fullsized":"2024-09-13T18:50:06.776794+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:27.455197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228974+0000","last_change":"2024-09-13T18:50:05.608878+0000","last_active":"2024-09-13T18:50:07.228974+0000","last_peered":"2024-09-13T18:50:07.228974+0000","last_clean":"2024-09-13T18:50:07.228974+0000","last_became_active":"2024-09-13T18:50:05.608649+0000","last_became_peered":"2024-09-13T18:50:05.608649+0000","last_unstale":"2024-09-13T18:50:07.228974+0000","last_undegraded":"2024-09-13T18:50:07.228974+0000","last_fullsized":"2024-09-13T18:50:07.228974+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:16.310893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588939+0000","last_change":"2024-09-13T18:50:05.127034+0000","last_active":"2024-09-13T18:50:06.588939+0000","last_peered":"2024-09-13T18:50:06.588939+0000","last_clean":"2024-09-13T18:50:06.588939+0000","last_became_active":"2024-09-13T18:50:05.126785+0000","last_became_peered":"2024-09-13T18:50:05.126785+0000","last_unstale":"2024-09-13T18:50:06.588939+0000","last_undegraded":"2024-09-13T18:50:06.588939+0000","last_fullsized":"2024-09-13T18:50:06.588939+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:13.467765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588199+0000","last_change":"2024-09-13T18:50:05.616925+0000","last_active":"2024-09-13T18:50:06.588199+0000","last_peered":"2024-09-13T18:50:06.588199+0000","last_clean":"2024-09-13T18:50:06.588199+0000","last_became_active":"2024-09-13T18:50:05.616632+0000","last_became_peered":"2024-09-13T18:50:05.616632+0000","last_unstale":"2024-09-13T18:50:06.588199+0000","last_undegraded":"2024-09-13T18:50:06.588199+0000","last_fullsized":"2024-09-13T18:50:06.588199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:13.238349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229073+0000","last_change":"2024-09-13T18:50:05.128856+0000","last_active":"2024-09-13T18:50:07.229073+0000","last_peered":"2024-09-13T18:50:07.229073+0000","last_clean":"2024-09-13T18:50:07.229073+0000","last_became_active":"2024-09-13T18:50:05.128586+0000","last_became_peered":"2024-09-13T18:50:05.128586+0000","last_unstale":"2024-09-13T18:50:07.229073+0000","last_undegraded":"2024-09-13T18:50:07.229073+0000","last_fullsized":"2024-09-13T18:50:07.229073+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:40.634257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591649+0000","last_change":"2024-09-13T18:50:05.616167+0000","last_active":"2024-09-13T18:50:06.591649+0000","last_peered":"2024-09-13T18:50:06.591649+0000","last_clean":"2024-09-13T18:50:06.591649+0000","last_became_active":"2024-09-13T18:50:05.615729+0000","last_became_peered":"2024-09-13T18:50:05.615729+0000","last_unstale":"2024-09-13T18:50:06.591649+0000","last_undegraded":"2024-09-13T18:50:06.591649+0000","last_fullsized":"2024-09-13T18:50:06.591649+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:34:09.293934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.228850+0000","last_change":"2024-09-13T18:50:05.129422+0000","last_active":"2024-09-13T18:50:07.228850+0000","last_peered":"2024-09-13T18:50:07.228850+0000","last_clean":"2024-09-13T18:50:07.228850+0000","last_became_active":"2024-09-13T18:50:05.129168+0000","last_became_peered":"2024-09-13T18:50:05.129168+0000","last_unstale":"2024-09-13T18:50:07.228850+0000","last_undegraded":"2024-09-13T18:50:07.228850+0000","last_fullsized":"2024-09-13T18:50:07.228850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:45.254532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588783+0000","last_change":"2024-09-13T18:50:05.610034+0000","last_active":"2024-09-13T18:50:06.588783+0000","last_peered":"2024-09-13T18:50:06.588783+0000","last_clean":"2024-09-13T18:50:06.588783+0000","last_became_active":"2024-09-13T18:50:05.609772+0000","last_became_peered":"2024-09-13T18:50:05.609772+0000","last_unstale":"2024-09-13T18:50:06.588783+0000","last_undegraded":"2024-09-13T18:50:06.588783+0000","last_fullsized":"2024-09-13T18:50:06.588783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:41.647818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.231399+0000","last_change":"2024-09-13T18:50:05.133548+0000","last_active":"2024-09-13T18:50:07.231399+0000","last_peered":"2024-09-13T18:50:07.231399+0000","last_clean":"2024-09-13T18:50:07.231399+0000","last_became_active":"2024-09-13T18:50:05.133292+0000","last_became_peered":"2024-09-13T18:50:05.133292+0000","last_unstale":"2024-09-13T18:50:07.231399+0000","last_undegraded":"2024-09-13T18:50:07.231399+0000","last_fullsized":"2024-09-13T18:50:07.231399+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:46.890441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.229818+0000","last_change":"2024-09-13T18:50:05.613867+0000","last_active":"2024-09-13T18:50:07.229818+0000","last_peered":"2024-09-13T18:50:07.229818+0000","last_clean":"2024-09-13T18:50:07.229818+0000","last_became_active":"2024-09-13T18:50:05.613641+0000","last_became_peered":"2024-09-13T18:50:05.613641+0000","last_unstale":"2024-09-13T18:50:07.229818+0000","last_undegraded":"2024-09-13T18:50:07.229818+0000","last_fullsized":"2024-09-13T18:50:07.229818+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:17.592182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.591405+0000","last_change":"2024-09-13T18:50:05.133333+0000","last_active":"2024-09-13T18:50:06.591405+0000","last_peered":"2024-09-13T18:50:06.591405+0000","last_clean":"2024-09-13T18:50:06.591405+0000","last_became_active":"2024-09-13T18:50:05.133060+0000","last_became_peered":"2024-09-13T18:50:05.133060+0000","last_unstale":"2024-09-13T18:50:06.591405+0000","last_undegraded":"2024-09-13T18:50:06.591405+0000","last_fullsized":"2024-09-13T18:50:06.591405+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:59.460046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:07.230641+0000","last_change":"2024-09-13T18:50:05.604277+0000","last_active":"2024-09-13T18:50:07.230641+0000","last_peered":"2024-09-13T18:50:07.230641+0000","last_clean":"2024-09-13T18:50:07.230641+0000","last_became_active":"2024-09-13T18:50:05.604011+0000","last_became_peered":"2024-09-13T18:50:05.604011+0000","last_unstale":"2024-09-13T18:50:07.230641+0000","last_undegraded":"2024-09-13T18:50:07.230641+0000","last_fullsized":"2024-09-13T18:50:07.230641+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:05.093901+0000","last_clean_scrub_stamp":"2024-09-13T18:50:05.093901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:40.398511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-09-13T18:50:06.588880+0000","last_change":"2024-09-13T18:50:05.132665+0000","last_active":"2024-09-13T18:50:06.588880+0000","last_peered":"2024-09-13T18:50:06.588880+0000","last_clean":"2024-09-13T18:50:06.588880+0000","last_became_active":"2024-09-13T18:50:05.132375+0000","last_became_peered":"2024-09-13T18:50:05.132375+0000","last_unstale":"2024-09-13T18:50:06.588880+0000","last_undegraded":"2024-09-13T18:50:06.588880+0000","last_fullsized":"2024-09-13T18:50:06.588880+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:50:04.080341+0000","last_clean_scrub_stamp":"2024-09-13T18:50:04.080341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:38.250098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-13T18:50:05.606760+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:50:05.606760+0000","last_peered":"2024-09-13T18:50:05.606760+0000","last_clean":"2024-09-13T18:50:05.606760+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:50:05.606760+0000","last_undegraded":"2024-09-13T18:50:05.606760+0000","last_fullsized":"2024-09-13T18:50:05.606760+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1232896,"data_stored":871106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.081,"15min":1.0940000000000001},"min":{"1min":0.76600000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.4099999999999999,"5min":1.468,"15min":1.468},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.129,"15min":1.143},"min":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3759999999999999,"5min":1.585,"15min":1.585},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.1299999999999999,"15min":1.141},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4790000000000001,"5min":1.619,"15min":1.619},"last":1.133},{"interface":"front","average":{"1min":1.123,"5min":1.2230000000000001,"15min":1.24},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.4330000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.93600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.333,"15min":1.3560000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.482,"5min":1.829,"15min":1.829},"last":0.997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.202,"15min":1.21},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.5309999999999999,"5min":1.625,"15min":1.625},"last":1.071}]},{"osd":3,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.82499999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.647,"5min":1.696,"15min":1.696},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.4390000000000001,"15min":1.464},"min":{"1min":0.995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5549999999999999,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.04}]},{"osd":4,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1080000000000001,"15min":1.1140000000000001},"min":{"1min":0.79200000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.175,"15min":1.175},"min":{"1min":0.66700000000000004,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4239999999999999,"5min":1.532,"15min":1.532},"last":1.514}]},{"osd":5,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.3300000000000001,"15min":1.343},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":1.6299999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2250000000000001,"15min":1.2290000000000001},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5800000000000001,"5min":1.714,"15min":1.714},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:09 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3939999999999999,"15min":1.4059999999999999},"min":{"1min":0.94699999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.486,"5min":1.76,"15min":1.76},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.4099999999999999,"15min":1.4259999999999999},"min":{"1min":0.96499999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.3580000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":626688,"data_stored":274646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1439999999999999,"15min":1.1539999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.8169999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.1639999999999999,"15min":1.1819999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5029999999999999,"5min":1.55,"15min":1.55},"last":1.349}]},{"osd":1,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1200000000000001,"15min":1.117},"min":{"1min":0.70599999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.266},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1919999999999999,"15min":1.204},"min":{"1min":0.79200000000000004,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.4470000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.456,"15min":1.494},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.675,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.044},{"interface":"front","average":{"1min":1.212,"5min":1.496,"15min":1.544},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.5720000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.387}]},{"osd":3,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.5229999999999999,"15min":1.5589999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.7230000000000001,"5min":4.883,"15min":4.883},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.282,"5min":1.538,"15min":1.581},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9810000000000001,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.94099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.323,"15min":1.3400000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.353,"15min":1.3620000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.796,"5min":2.077,"15min":2.077},"last":1.496}]},{"osd":5,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.4359999999999999,"15min":1.45},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.7290000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.48,"5min":1.5,"15min":1.504},"min":{"1min":1.1240000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.47}]},{"osd":7,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.482,"15min":1.492},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.548,"15min":1.5680000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1709999999999998,"5min":2.367,"15min":2.367},"last":1.091}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31740,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340100,"statfs":{"total":96636764160,"available":96604262400,"internally_reserved":0,"allocated":630784,"data_stored":280614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.202,"15min":1.226},"min":{"1min":0.70799999999999996,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4470000000000001,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.157,"15min":1.1659999999999999},"min":{"1min":0.77100000000000002,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.3500000000000001,"5min":2.278,"15min":2.278},"last":1.425}]},{"osd":1,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2729999999999999,"15min":1.292},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.5289999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.351},{"interface":"front","average":{"1min":1.121,"5min":1.1930000000000001,"15min":1.2050000000000001},"min":{"1min":0.85999999999999999,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.5589999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.321}]},{"osd":2,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2949999999999999,"15min":1.3089999999999999},"min":{"1min":0.84699999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7470000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.27,"15min":1.284},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.46,"5min":2.157,"15min":2.157},"last":1.214}]},{"osd":3,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.383,"15min":1.4019999999999999},"min":{"1min":1.024,"5min":0.749,"15min":0.749},"max":{"1min":1.601,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.444,"15min":1.47},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7030000000000001,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.4419999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.2410000000000001,"15min":1.2470000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.5760000000000001,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.276,"15min":1.2889999999999999},"min":{"1min":0.89100000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5189999999999999,"5min":1.974,"15min":1.974},"last":1.2809999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.292,"15min":1.3109999999999999},"min":{"1min":0.80200000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.645,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.153},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3680000000000001,"15min":1.377},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.54,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.3660000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:49:11 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4279999999999999,"15min":1.4419999999999999},"min":{"1min":0.87,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.5489999999999999,"5min":2.169,"15min":2.169},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.5089999999999999,"15min":1.5349999999999999},"min":{"1min":0.95899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.804,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.395}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":634880,"data_stored":281196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.119,"15min":1.1319999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.131,"15min":1.1379999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.542,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.78000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3680000000000001,"15min":1.375},"min":{"1min":0.88900000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.6319999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.3340000000000001,"15min":1.3440000000000001},"min":{"1min":0.86399999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.617,"5min":2.423,"15min":2.423},"last":1.806}]},{"osd":2,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.288,"15min":1.3029999999999999},"min":{"1min":0.92800000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.4950000000000001,"5min":1.99,"15min":1.99},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.3839999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.694,"5min":2.335,"15min":2.335},"last":1.637}]},{"osd":3,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3080000000000001,"15min":1.3340000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.397,"5min":2.621,"15min":2.621},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.151,"5min":1.2649999999999999,"15min":1.284},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":1.506,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.323,"15min":1.341},"min":{"1min":0.85599999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.718},{"interface":"front","average":{"1min":1.258,"5min":1.327,"15min":1.339},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.7569999999999999,"5min":2.266,"15min":2.266},"last":1.089}]},{"osd":6,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3660000000000001,"15min":1.3859999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.319,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.371},{"interface":"front","average":{"1min":1.379,"5min":1.47,"15min":1.4850000000000001},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.7969999999999999,"5min":2.5,"15min":2.5},"last":1.544}]},{"osd":7,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4039999999999999,"5min":1.476,"15min":1.488},"min":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"max":{"1min":1.7150000000000001,"5min":2.395,"15min":2.395},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.4850000000000001,"15min":1.4970000000000001},"min":{"1min":1.1100000000000001,"5min":1.079,"15min":1.079},"max":{"1min":2.415,"5min":2.415,"15min":2.415},"last":1.1459999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":634880,"data_stored":275580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.88200000000000001,"15min":0.90500000000000003},"min":{"1min":0.52400000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.331,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.86799999999999999,"15min":0.89000000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.095,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.86099999999999999,"15min":0.875},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":1.071,"15min":1.129},"min":{"1min":0.66400000000000003,"5min":0.505,"15min":0.505},"max":{"1min":1.464,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.76500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.98199999999999998,"15min":0.995},"min":{"1min":0.69199999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.502,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.569,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3340000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.21,"15min":1.248},"min":{"1min":0.78700000000000003,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.431,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.2190000000000001,"15min":1.2490000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4490000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.2390000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2869999999999999,"15min":1.3280000000000001},"min":{"1min":0.83899999999999997,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.613,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.353,"15min":1.389},"min":{"1min":0.88400000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.548,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1559999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.417,"15min":1.4490000000000001},"min":{"1min":0.95699999999999996,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.573,"5min":2.714,"15min":2.714},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.3959999999999999,"15min":1.444},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.8520000000000001,"5min":2.52,"15min":2.52},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.4630000000000001,"15min":1.542},"min":{"1min":0.97799999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5620000000000001,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.401,"15min":1.4530000000000001},"min":{"1min":0.98399999999999999,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.5489999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3540000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":630784,"data_stored":275558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.97499999999999998,"15min":1.0229999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98699999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.073,"15min":1.109},"min":{"1min":0.58899999999999997,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.337,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.69499999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":1.1359999999999999,"15min":1.1970000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.1060000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.232,"15min":1.266},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.589,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.3149999999999999,"15min":1.3600000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.651,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.2230000000000001,"15min":1.274},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.4490000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.123}]},{"osd":4,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.681,"15min":1.7569999999999999},"min":{"1min":0.96299999999999997,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.5049999999999999,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.036},{"interface":"front","average":{"1min":1.21,"5min":1.4590000000000001,"15min":1.5009999999999999},"min":{"1min":1.0009999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":1.556,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.1459999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.524,"15min":1.5649999999999999},"min":{"1min":1.089,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.54,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.502,"15min":1.548},"min":{"1min":1.0109999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.7370000000000001,"5min":4.335,"15min":4.335},"last":1.1919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.5569999999999999,"15min":1.605},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.4470000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.7889999999999999,"15min":1.877},"min":{"1min":0.96299999999999997,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.6319999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.232}]},{"osd":7,"last update":"Fri Sep 13 18:49:06 2024","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.5760000000000001,"15min":1.6180000000000001},"min":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"max":{"1min":1.6890000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.6279999999999999,"15min":1.6799999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.01}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":280774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.89100000000000001,"15min":0.90900000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.0680000000000001,"15min":1.1100000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.286,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.78800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.196,"15min":1.2250000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.615,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.0740000000000001,"15min":1.095},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.411,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.3129999999999999,"15min":1.363},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.516,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.96099999999999997,"5min":1.4279999999999999,"15min":1.506},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.417,"5min":10.368,"15min":10.368},"last":1.1539999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.3919999999999999,"15min":1.4159999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.673,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.365,"15min":1.391},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.611,"5min":2.911,"15min":2.911},"last":1.1240000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.758,"15min":1.859},"min":{"1min":0.77300000000000002,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5880000000000001,"5min":10.214,"15min":10.214},"last":1.258},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.488,"15min":1.5249999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.671,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.3919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.595,"15min":1.651},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5569999999999999,"5min":6.032,"15min":6.032},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.8089999999999999,"15min":1.903},"min":{"1min":0.84399999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.526,"5min":10.112,"15min":10.112},"last":1.302}]},{"osd":7,"last update":"Fri Sep 13 18:49:07 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.8660000000000001,"15min":1.962},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.6080000000000001,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.585,"15min":1.623},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":1.7689999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.335}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":1232896,"data_stored":871038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.95299999999999996,"15min":1.0369999999999999},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0329999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.95399999999999996,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.119,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.93200000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.1020000000000001,"15min":1.1899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.294,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.995},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.167,"15min":1.2549999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.3080000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":1.2649999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.171,"15min":1.2330000000000001},"min":{"1min":0.65200000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4490000000000001,"5min":4.093,"15min":4.093},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.379,"15min":1.4710000000000001},"min":{"1min":0.75700000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.5800000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.3300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3959999999999999,"15min":1.4850000000000001},"min":{"1min":1.0089999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.556,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.415,"15min":1.492},"min":{"1min":1.004,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.597,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.597}]},{"osd":5,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.5680000000000001,"15min":1.6739999999999999},"min":{"1min":0.97699999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":1.8029999999999999,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.8029999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.4830000000000001,"15min":1.5880000000000001},"min":{"1min":1.121,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.4690000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.173}]},{"osd":6,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.4990000000000001,"15min":1.6000000000000001},"min":{"1min":1.0229999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.714,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.714},{"interface":"front","average":{"1min":1.319,"5min":1.631,"15min":1.7649999999999999},"min":{"1min":1.091,"5min":1.042,"15min":1.042},"max":{"1min":1.51,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.4319999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:50:07 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.552,"15min":1.6419999999999999},"min":{"1min":1.0189999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.7529999999999999,"5min":3.056,"15min":3.056},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.5509999999999999,"15min":1.6719999999999999},"min":{"1min":1.038,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.6579999999999999,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.385}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:50:10.434 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:50:10.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:50:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.642+0000 7fb890c00700 1 Processor -- start 2024-09-13T18:50:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.642+0000 7fb890c00700 1 -- start start 2024-09-13T18:50:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.642+0000 7fb890c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb88c15cc50 0x7fb88c0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.642+0000 7fb890c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 0x7fb88c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb890c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88c15d030 con 0x7fb88c0cf9e0 2024-09-13T18:50:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb890c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb88c0cfe90 con 0x7fb88c15cc50 2024-09-13T18:50:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb890c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0d2540 con 0x7fb88c0d13b0 2024-09-13T18:50:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb88c15cc50 0x7fb88c0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 0x7fb88c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 0x7fb88c0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:56818/0 (socket says 172.21.15.81:56818) 2024-09-13T18:50:10.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88aa00700 1 -- 172.21.15.81:0/842607687 learned_addr learned my addr 172.21.15.81:0/842607687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:10.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88b400700 1 -- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 msgr2=0x7fb88c0cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:10.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88b400700 1 --2- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 0x7fb88c0cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88b400700 1 -- 172.21.15.81:0/842607687 >> v1:172.21.15.178:6789/0 conn(0x7fb88c0cf9e0 legacy=0x7fb88c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88b400700 1 -- 172.21.15.81:0/842607687 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c0d1930 con 0x7fb88c15cc50 2024-09-13T18:50:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88aa00700 1 --2- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 0x7fb88c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88a000700 1 -- 172.21.15.81:0/842607687 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414329221 0 0) 0x7fb88c15d030 con 0x7fb88c0cf9e0 2024-09-13T18:50:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88b400700 1 --2- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c15cc50 0x7fb88c0d0e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009850 tx=0x7fb87c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7efdcda9959d3ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:10.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88a000700 1 -- 172.21.15.81:0/842607687 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c011830 con 0x7fb88c15cc50 2024-09-13T18:50:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88a000700 1 -- 172.21.15.81:0/842607687 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c011990 con 0x7fb88c15cc50 2024-09-13T18:50:10.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb88a000700 1 -- 172.21.15.81:0/842607687 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c011d40 con 0x7fb88c15cc50 2024-09-13T18:50:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.646+0000 7fb890c00700 1 -- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c15cc50 msgr2=0x7fb88c0d0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 --2- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c15cc50 0x7fb88c0d0e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009850 tx=0x7fb87c009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:10.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 -- 172.21.15.81:0/842607687 shutdown_connections 2024-09-13T18:50:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 --2- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c0d13b0 0x7fb88c0cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 --2- 172.21.15.81:0/842607687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c15cc50 0x7fb88c0d0e70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 -- 172.21.15.81:0/842607687 >> 172.21.15.81:0/842607687 conn(0x7fb88c06b870 msgr2=0x7fb88c06bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 -- 172.21.15.81:0/842607687 shutdown_connections 2024-09-13T18:50:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.650+0000 7fb890c00700 1 -- 172.21.15.81:0/842607687 wait complete. 2024-09-13T18:50:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 Processor -- start 2024-09-13T18:50:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 -- start start 2024-09-13T18:50:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c0cf9e0 0x7fb88c158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 0x7fb88c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c15cc50 0x7fb88c15ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cce20 con 0x7fb88c0d13b0 2024-09-13T18:50:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cd100 con 0x7fb88c0cf9e0 2024-09-13T18:50:10.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb890c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88c0cd3e0 con 0x7fb88c15cc50 2024-09-13T18:50:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb88aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 0x7fb88c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb88aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 0x7fb88c0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53186/0 (socket says 172.21.15.81:53186) 2024-09-13T18:50:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb88aa00700 1 -- 172.21.15.81:0/3349458813 learned_addr learned my addr 172.21.15.81:0/3349458813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb88b400700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c0cf9e0 0x7fb88c158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.654+0000 7fb88be00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c15cc50 0x7fb88c15ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb88aa00700 1 -- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c15cc50 msgr2=0x7fb88c15ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb88aa00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c15cc50 0x7fb88c15ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb88aa00700 1 -- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c0cf9e0 msgr2=0x7fb88c158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb88aa00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c0cf9e0 0x7fb88c158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb88aa00700 1 -- 172.21.15.81:0/3349458813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878009570 con 0x7fb88c0d13b0 2024-09-13T18:50:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb88aa00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 0x7fb88c0cc360 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb87800ebe0 tx=0x7fb87800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:10.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800c850 con 0x7fb88c0d13b0 2024-09-13T18:50:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800c9b0 con 0x7fb88c0d13b0 2024-09-13T18:50:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c0094b0 con 0x7fb88c0d13b0 2024-09-13T18:50:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800cd60 con 0x7fb88c0d13b0 2024-09-13T18:50:10.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb88c1f2cb0 con 0x7fb88c0d13b0 2024-09-13T18:50:10.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.658+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88c067780 con 0x7fb88c0d13b0 2024-09-13T18:50:10.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.662+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb878013470 con 0x7fb88c0d13b0 2024-09-13T18:50:10.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.662+0000 7fb883400700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb86c066730 0x7fb86c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.662+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8780842f0 con 0x7fb88c0d13b0 2024-09-13T18:50:10.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.662+0000 7fb88b400700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb86c066730 0x7fb86c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:10.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.662+0000 7fb88b400700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb86c066730 0x7fb86c068bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb87c000c00 tx=0x7fb87c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:10.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.670+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb878051510 con 0x7fb88c0d13b0 2024-09-13T18:50:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.918+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb88c066e30 con 0x7fb88c0d13b0 2024-09-13T18:50:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.926+0000 7fb883400700 1 -- 172.21.15.81:0/3349458813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb878054b30 con 0x7fb88c0d13b0 2024-09-13T18:50:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb86c066730 msgr2=0x7fb86c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb86c066730 0x7fb86c068bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb87c000c00 tx=0x7fb87c01c040 comp rx=0 tx=0).stop 2024-09-13T18:50:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 msgr2=0x7fb88c0cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 0x7fb88c0cc360 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb87800ebe0 tx=0x7fb87800eef0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 shutdown_connections 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb86c066730 0x7fb86c068bf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb88c15cc50 0x7fb88c15ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb88c0d13b0 0x7fb88c0cc360 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 --2- 172.21.15.81:0/3349458813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb88c0cf9e0 0x7fb88c158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.930+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 >> 172.21.15.81:0/3349458813 conn(0x7fb88c06b870 msgr2=0x7fb88c0b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.934+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 shutdown_connections 2024-09-13T18:50:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:10.934+0000 7fb890c00700 1 -- 172.21.15.81:0/3349458813 wait complete. 2024-09-13T18:50:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-13T18:50:10.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:11.033 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:50:11.022+0000 7f13f2400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:50:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.118+0000 7f20d9200700 1 Processor -- start 2024-09-13T18:50:11.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20d9200700 1 -- start start 2024-09-13T18:50:11.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20d9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:11.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20d9200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f20d406a5d0 0x7f20d406aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:11.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20d9200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d40cdd90 con 0x7f20d406c460 2024-09-13T18:50:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20d9200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d406afc0 con 0x7f20d406a5d0 2024-09-13T18:50:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20d9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d406ce10 con 0x7f20d415b700 2024-09-13T18:50:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20c9400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f20d406c460 0x7f20d406d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60376/0 (socket says 172.21.15.81:60376) 2024-09-13T18:50:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.122+0000 7f20c9400700 1 -- 172.21.15.81:0/3727307324 learned_addr learned my addr 172.21.15.81:0/3727307324 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1e00700 1 --2- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:11.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d2800700 1 --2- 172.21.15.81:0/3727307324 >> v2:172.21.15.178:3300/0 conn(0x7f20d406a5d0 0x7f20d406aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1400700 1 -- 172.21.15.81:0/3727307324 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697754479 0 0) 0x7f20d40cdd90 con 0x7f20d406c460 2024-09-13T18:50:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1400700 1 -- 172.21.15.81:0/3727307324 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b80035d0 con 0x7f20d406c460 2024-09-13T18:50:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d2800700 1 -- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 msgr2=0x7f20d415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:11.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d2800700 1 --2- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d2800700 1 -- 172.21.15.81:0/3727307324 >> v1:172.21.15.81:6789/0 conn(0x7f20d406c460 legacy=0x7f20d406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:11.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1400700 1 -- 172.21.15.81:0/3727307324 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2718315826 0 0) 0x7f20b80035d0 con 0x7f20d406c460 2024-09-13T18:50:11.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d2800700 1 -- 172.21.15.81:0/3727307324 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d415c020 con 0x7f20d406a5d0 2024-09-13T18:50:11.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d2800700 1 --2- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406a5d0 0x7f20d406aa80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009d90 tx=0x7f20cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e3cfd41135e530 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:11.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1400700 1 -- 172.21.15.81:0/3727307324 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00e070 con 0x7f20d406a5d0 2024-09-13T18:50:11.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1400700 1 -- 172.21.15.81:0/3727307324 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc003a40 con 0x7f20d406a5d0 2024-09-13T18:50:11.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d1400700 1 -- 172.21.15.81:0/3727307324 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc001670 con 0x7f20d406a5d0 2024-09-13T18:50:11.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 -- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406a5d0 msgr2=0x7f20d406aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:11.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 --2- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406a5d0 0x7f20d406aa80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f20cc009d90 tx=0x7f20cc00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 -- 172.21.15.81:0/3727307324 shutdown_connections 2024-09-13T18:50:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 --2- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406a5d0 0x7f20d406aa80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 --2- 172.21.15.81:0/3727307324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 -- 172.21.15.81:0/3727307324 >> 172.21.15.81:0/3727307324 conn(0x7f20d40b08d0 msgr2=0x7f20d40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 -- 172.21.15.81:0/3727307324 shutdown_connections 2024-09-13T18:50:11.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.126+0000 7f20d9200700 1 -- 172.21.15.81:0/3727307324 wait complete. 2024-09-13T18:50:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 Processor -- start 2024-09-13T18:50:11.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 -- start start 2024-09-13T18:50:11.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 0x7f20d4151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406c460 0x7f20d4154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d4154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41e4f60 con 0x7f20d406a5d0 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41e5240 con 0x7f20d406c460 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41e5520 con 0x7f20d415b700 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 0x7f20d4151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 0x7f20d4151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53188/0 (socket says 172.21.15.81:53188) 2024-09-13T18:50:11.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 -- 172.21.15.81:0/1570856895 learned_addr learned my addr 172.21.15.81:0/1570856895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20c9400700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406c460 0x7f20d4154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d2800700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d4154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 -- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 msgr2=0x7f20d4154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d4154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 -- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406c460 msgr2=0x7f20d4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406c460 0x7f20d4154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 -- 172.21.15.81:0/1570856895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc009a70 con 0x7f20d406a5d0 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d2800700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d4154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20c9400700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406c460 0x7f20d4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20d1e00700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 0x7f20d4151450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e840 tx=0x7f20c400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.130+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40095a0 con 0x7f20d406a5d0 2024-09-13T18:50:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.134+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c400c690 con 0x7f20d406a5d0 2024-09-13T18:50:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.134+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c400ca00 con 0x7f20d406a5d0 2024-09-13T18:50:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.134+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d41e5800 con 0x7f20d406a5d0 2024-09-13T18:50:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.134+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d41e5dc0 con 0x7f20d406a5d0 2024-09-13T18:50:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.134+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d406aa80 con 0x7f20d406a5d0 2024-09-13T18:50:11.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.134+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f20c400cb60 con 0x7f20d406a5d0 2024-09-13T18:50:11.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.138+0000 7f20caa00700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f20b0066760 0x7f20b0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.138+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f20c40842b0 con 0x7f20d406a5d0 2024-09-13T18:50:11.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.138+0000 7f20c9400700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f20b0066760 0x7f20b0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:11.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.138+0000 7f20c9400700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f20b0066760 0x7f20b0068c20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f20bc001860 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:11.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.142+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20c4051450 con 0x7f20d406a5d0 2024-09-13T18:50:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.378+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20d406c240 con 0x7f20d406a5d0 2024-09-13T18:50:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.382+0000 7f20caa00700 1 -- 172.21.15.81:0/1570856895 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4734 (secure 0 0 0) 0x7f20c4054a70 con 0x7f20d406a5d0 2024-09-13T18:50:11.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:11.392 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6048,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:08.605860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6051},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.382+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f20b0066760 msgr2=0x7f20b0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:11.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.382+0000 7f20d9200700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f20b0066760 0x7f20b0068c20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f20bc001860 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.382+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 msgr2=0x7f20d4151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.382+0000 7f20d9200700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 0x7f20d4151450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e840 tx=0x7f20c400ec00 comp rx=0 tx=0).stop 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 shutdown_connections 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f20b0066760 0x7f20b0068c20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20d415b700 0x7f20d4154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20d406c460 0x7f20d4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 --2- 172.21.15.81:0/1570856895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20d406a5d0 0x7f20d4151450 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 >> 172.21.15.81:0/1570856895 conn(0x7f20d40b08d0 msgr2=0x7f20d40ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 shutdown_connections 2024-09-13T18:50:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.386+0000 7f20d9200700 1 -- 172.21.15.81:0/1570856895 wait complete. 2024-09-13T18:50:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 33 2024-09-13T18:50:11.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:50:05.574515+0000', 'modified': '2024-09-13T18:50:08.605860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6051}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6051': {'gid': 6051, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/396996950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 396996950}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 396996950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:50:11.821 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:50:11.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:50:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.998+0000 7efc99800700 1 Processor -- start 2024-09-13T18:50:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:11.998+0000 7efc99800700 1 -- start start 2024-09-13T18:50:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc99800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9406ed70 0x7efc9406f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc99800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc9415de00 0x7efc94159f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc99800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc940cc6c0 0x7efc940b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc99800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9406f690 con 0x7efc940cc6c0 2024-09-13T18:50:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc99800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9415a830 con 0x7efc9415de00 2024-09-13T18:50:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc99800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9415ab10 con 0x7efc9406ed70 2024-09-13T18:50:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc93400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efc940cc6c0 0x7efc940b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc9415de00 0x7efc94159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc92a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9406ed70 0x7efc9406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc9415de00 0x7efc94159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:53484/0 (socket says 172.21.15.81:53484) 2024-09-13T18:50:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 -- 172.21.15.81:0/1139020278 learned_addr learned my addr 172.21.15.81:0/1139020278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 -- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9406ed70 msgr2=0x7efc9406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 --2- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9406ed70 0x7efc9406f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 -- 172.21.15.81:0/1139020278 >> v2:172.21.15.81:3300/0 conn(0x7efc940cc6c0 msgr2=0x7efc940b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 --2- 172.21.15.81:0/1139020278 >> v2:172.21.15.81:3300/0 conn(0x7efc940cc6c0 0x7efc940b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 -- 172.21.15.81:0/1139020278 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9415d600 con 0x7efc9415de00 2024-09-13T18:50:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc93400700 1 --2- 172.21.15.81:0/1139020278 >> v2:172.21.15.81:3300/0 conn(0x7efc940cc6c0 0x7efc940b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:12.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc8a000700 1 --2- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94159f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efc94067c50 tx=0x7efc7c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40f398726d6db02c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.002+0000 7efc92000700 1 -- 172.21.15.81:0/1139020278 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011830 con 0x7efc9415de00 2024-09-13T18:50:12.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc92000700 1 -- 172.21.15.81:0/1139020278 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c011990 con 0x7efc9415de00 2024-09-13T18:50:12.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc92000700 1 -- 172.21.15.81:0/1139020278 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c011d20 con 0x7efc9415de00 2024-09-13T18:50:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 -- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 msgr2=0x7efc94159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 --2- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94159f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7efc94067c50 tx=0x7efc7c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 -- 172.21.15.81:0/1139020278 shutdown_connections 2024-09-13T18:50:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 --2- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94159f70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 --2- 172.21.15.81:0/1139020278 >> v2:172.21.15.81:3300/0 conn(0x7efc940cc6c0 0x7efc940b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 --2- 172.21.15.81:0/1139020278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9406ed70 0x7efc9406f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 -- 172.21.15.81:0/1139020278 >> 172.21.15.81:0/1139020278 conn(0x7efc9406d880 msgr2=0x7efc9406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 -- 172.21.15.81:0/1139020278 shutdown_connections 2024-09-13T18:50:12.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.006+0000 7efc99800700 1 -- 172.21.15.81:0/1139020278 wait complete. 2024-09-13T18:50:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 Processor -- start 2024-09-13T18:50:12.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 -- start start 2024-09-13T18:50:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 0x7efc94149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9415cc00 0x7efc941432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94143130 con 0x7efc940cc6c0 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc94149aa0 con 0x7efc9415de00 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc99800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc94148e90 con 0x7efc9415cc00 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc92a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 0x7efc94149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc92a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 0x7efc94149f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53200/0 (socket says 172.21.15.81:53200) 2024-09-13T18:50:12.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc92a00700 1 -- 172.21.15.81:0/2935265931 learned_addr learned my addr 172.21.15.81:0/2935265931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc8a000700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.010+0000 7efc93400700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9415cc00 0x7efc941432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc92a00700 1 -- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9415cc00 msgr2=0x7efc941432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc92a00700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9415cc00 0x7efc941432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc92a00700 1 -- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 msgr2=0x7efc94158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc92a00700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc92a00700 1 -- 172.21.15.81:0/2935265931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c009a70 con 0x7efc940cc6c0 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc93400700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9415cc00 0x7efc941432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:12.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc92a00700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 0x7efc94149f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efc8400e940 tx=0x7efc8400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc8b400700 1 -- 172.21.15.81:0/2935265931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400ee90 con 0x7efc940cc6c0 2024-09-13T18:50:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc8b400700 1 -- 172.21.15.81:0/2935265931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8400c850 con 0x7efc940cc6c0 2024-09-13T18:50:12.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc8b400700 1 -- 172.21.15.81:0/2935265931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8400cbe0 con 0x7efc940cc6c0 2024-09-13T18:50:12.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c009570 con 0x7efc940cc6c0 2024-09-13T18:50:12.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.014+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc94149450 con 0x7efc940cc6c0 2024-09-13T18:50:12.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.018+0000 7efc8b400700 1 -- 172.21.15.81:0/2935265931 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc8400cd40 con 0x7efc940cc6c0 2024-09-13T18:50:12.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.018+0000 7efc8b400700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efc70066760 0x7efc70068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.018+0000 7efc8b400700 1 -- 172.21.15.81:0/2935265931 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efc84084350 con 0x7efc940cc6c0 2024-09-13T18:50:12.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.018+0000 7efc8a000700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efc70066760 0x7efc70068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.018+0000 7efc8a000700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efc70066760 0x7efc70068c20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efc94067c50 tx=0x7efc7c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 Processor -- start 2024-09-13T18:50:12.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 -- start start 2024-09-13T18:50:12.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911cda0 0x2911d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290e5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x290e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29044d80 con 0x290fbd00 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29042510 con 0x2911d6c0 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2903de00 con 0x2911cda0 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc92a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911cda0 0x2911d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53214/0 (socket says 172.21.15.81:53214) 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 -- 172.21.15.81:0/3736186461 learned_addr learned my addr 172.21.15.81:0/3736186461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc93400700 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x290e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 -- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911cda0 msgr2=0x2911d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911cda0 0x2911d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 -- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 msgr2=0x290e5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x290e5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 -- 172.21.15.81:0/3736186461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28eb0960 con 0x290fbd00 2024-09-13T18:50:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.022+0000 7efc8a000700 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290e5890 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efc7c014040 tx=0x7efc7c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da081c822cf2755c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc83400700 1 -- 172.21.15.81:0/3736186461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02b070 con 0x290fbd00 2024-09-13T18:50:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc83400700 1 -- 172.21.15.81:0/3736186461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c026800 con 0x290fbd00 2024-09-13T18:50:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc83400700 1 -- 172.21.15.81:0/3736186461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c01f070 con 0x290fbd00 2024-09-13T18:50:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3736186461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 msgr2=0x290e5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290e5890 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7efc7c014040 tx=0x7efc7c010000 comp rx=0 tx=0).stop 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3736186461 shutdown_connections 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x290e5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290e5890 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3736186461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911cda0 0x2911d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3736186461 >> 172.21.15.81:0/3736186461 conn(0x28e654d0 msgr2=0x290fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3736186461 shutdown_connections 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3736186461 wait complete. 2024-09-13T18:50:12.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 -- start start 2024-09-13T18:50:12.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.026+0000 7efc9cb1e740 1 Processor -- start 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x290d5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911d6c0 0x290d5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ffb730 con 0x290fbd00 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x290015b0 con 0x2911cda0 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28ee9aa0 con 0x2911d6c0 2024-09-13T18:50:12.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 10 client.0 _ll_register_callbacks cb 0x29037610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:12.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53228/0 (socket says 172.21.15.81:53228) 2024-09-13T18:50:12.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 -- 172.21.15.81:0/3387359273 learned_addr learned my addr 172.21.15.81:0/3387359273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc8a000700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x290d5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc93400700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911d6c0 0x290d5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 -- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911d6c0 msgr2=0x290d5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911d6c0 0x290d5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 -- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 msgr2=0x290d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x290d5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 -- 172.21.15.81:0/3387359273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9415d600 con 0x290fbd00 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc92a00700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290fcc10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efc84054ea0 tx=0x7efc840559c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6cf97f1930fa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc7be00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:12.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc7be00700 1 -- 172.21.15.81:0/3387359273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84055400 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc7be00700 1 -- 172.21.15.81:0/3387359273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efc84055560 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28e721e0 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc7be00700 1 -- 172.21.15.81:0/3387359273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc84082260 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 10 client.6186 fetch_fsmap learned FSMap version 33 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x29004220 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc7be00700 1 -- 172.21.15.81:0/3387359273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc84070030 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc7be00700 1 -- 172.21.15.81:0/3387359273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efc84054690 con 0x290fbd00 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 10 client.6186 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 10 client.6186 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 20 client.6186 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x290fd1b0 0x290d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 4 client.6186 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.030+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28ebc460 con 0x290fd1b0 2024-09-13T18:50:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc8a000700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x290fd1b0 0x290d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc8a000700 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x290fd1b0 0x290d30c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1da6ac46dc568197 server_cookie=a60f9b307cef650c in_seq=0 out_seq=0 2024-09-13T18:50:12.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc7be00700 10 client.6186 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc7be00700 1 -- 172.21.15.81:0/3387359273 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x28ebc460 con 0x290fd1b0 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc7be00700 10 client.6186 handle_command_reply: tid=0 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 client.6186 shutdown 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 msgr2=0x290fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290fcc10 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efc84054ea0 tx=0x7efc840559c0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 shutdown_connections 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x290fd1b0 0x290d30c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2911d6c0 0x290d5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x290d5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc7be00700 0 client.6186 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/3387359273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x290fbd00 0x290fcc10 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 >> 172.21.15.81:0/3387359273 conn(0x28e654d0 msgr2=0x290f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 shutdown_connections 2024-09-13T18:50:12.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 1 -- 172.21.15.81:0/3387359273 wait complete. 2024-09-13T18:50:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.034+0000 7efc9cb1e740 20 client.6186 trim_cache size 0 max 16384 2024-09-13T18:50:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.054+0000 7efc9cb1e740 1 Processor -- start 2024-09-13T18:50:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.054+0000 7efc9cb1e740 1 -- start start 2024-09-13T18:50:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.054+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x29136270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.054+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x291367b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 0x291314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2906cec0 con 0x2911d6c0 2024-09-13T18:50:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28fe6020 con 0x2911cda0 2024-09-13T18:50:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28fffe90 con 0x290fbd00 2024-09-13T18:50:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 0x291314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 0x291314f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53244/0 (socket says 172.21.15.81:53244) 2024-09-13T18:50:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 -- 172.21.15.81:0/1810494574 learned_addr learned my addr 172.21.15.81:0/1810494574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc92a00700 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x29136270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc8a000700 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x291367b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 -- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 msgr2=0x29136270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x29136270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 -- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 msgr2=0x291367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x291367b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 -- 172.21.15.81:0/1810494574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28fea450 con 0x2911d6c0 2024-09-13T18:50:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc93400700 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 0x291314f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007830 tx=0x7efc8c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30dbbab09042968 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc83e00700 1 -- 172.21.15.81:0/1810494574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00e040 con 0x2911d6c0 2024-09-13T18:50:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc83e00700 1 -- 172.21.15.81:0/1810494574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00f040 con 0x2911d6c0 2024-09-13T18:50:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc83e00700 1 -- 172.21.15.81:0/1810494574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c020860 con 0x2911d6c0 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- 172.21.15.81:0/1810494574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 msgr2=0x291314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 0x291314f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7efc8c007830 tx=0x7efc8c009750 comp rx=0 tx=0).stop 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- 172.21.15.81:0/1810494574 shutdown_connections 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911d6c0 0x291314f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911cda0 0x291367b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/1810494574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x29136270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- 172.21.15.81:0/1810494574 >> 172.21.15.81:0/1810494574 conn(0x28e654d0 msgr2=0x290f7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- 172.21.15.81:0/1810494574 shutdown_connections 2024-09-13T18:50:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.058+0000 7efc9cb1e740 1 -- 172.21.15.81:0/1810494574 wait complete. 2024-09-13T18:50:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.062+0000 7efc9cb1e740 1 -- start start 2024-09-13T18:50:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.062+0000 7efc9cb1e740 1 Processor -- start 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.062+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x2917e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 0x2917ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x291362d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2913cfe0 con 0x2911cda0 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2913ba30 con 0x2911d6c0 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x291358e0 con 0x290fbd00 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 10 client.0 _ll_register_callbacks cb 0x29094710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 0x2917ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc92a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x2917e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc93400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x291362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 0x2917ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53256/0 (socket says 172.21.15.81:53256) 2024-09-13T18:50:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 -- 172.21.15.81:0/2880108254 learned_addr learned my addr 172.21.15.81:0/2880108254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 -- 172.21.15.81:0/2880108254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 msgr2=0x2917e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x2917e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 -- 172.21.15.81:0/2880108254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 msgr2=0x291362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x291362d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 -- 172.21.15.81:0/2880108254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8c0074e0 con 0x2911cda0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc8a000700 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 0x2917ee40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009c30 tx=0x7efc7c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e05424bbea0c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc7be00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc7be00700 1 -- 172.21.15.81:0/2880108254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02b040 con 0x2911cda0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc7be00700 1 -- 172.21.15.81:0/2880108254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efc7c026d30 con 0x2911cda0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc7c026800 con 0x2911cda0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc7be00700 1 -- 172.21.15.81:0/2880108254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc7c03b440 con 0x2911cda0 2024-09-13T18:50:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 10 client.6192 fetch_fsmap learned FSMap version 33 2024-09-13T18:50:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x28fde720 con 0x2911cda0 2024-09-13T18:50:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc7be00700 1 -- 172.21.15.81:0/2880108254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c026800 con 0x2911cda0 2024-09-13T18:50:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc7be00700 1 -- 172.21.15.81:0/2880108254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7efc7c03b5a0 con 0x2911cda0 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 10 client.6192 fetch_fsmap finished waiting for FSMap version 33 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 10 client.6192 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 20 client.6192 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x29133ea0 0x29134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 4 client.6192 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.066+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x28ee11e0 con 0x29133ea0 2024-09-13T18:50:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc92a00700 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x29133ea0 0x29134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc7be00700 10 client.6192 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc92a00700 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x29133ea0 0x29134280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeedfd2259579ab1 server_cookie=fb64a2a22a53fe7a in_seq=0 out_seq=0 2024-09-13T18:50:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc7be00700 1 -- 172.21.15.81:0/2880108254 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x28ee11e0 con 0x29133ea0 2024-09-13T18:50:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc7be00700 10 client.6192 handle_command_reply: tid=0 2024-09-13T18:50:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 client.6192 shutdown 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 msgr2=0x2917ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 0x2917ee40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009c30 tx=0x7efc7c00e000 comp rx=0 tx=0).stop 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 shutdown_connections 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x29133ea0 0x29134280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2911d6c0 0x291362d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc7be00700 0 client.6192 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2911cda0 0x2917ee40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 --2- 172.21.15.81:0/2880108254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x290fbd00 0x2917e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 >> 172.21.15.81:0/2880108254 conn(0x28e654d0 msgr2=0x290f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 shutdown_connections 2024-09-13T18:50:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 1 -- 172.21.15.81:0/2880108254 wait complete. 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc9cb1e740 20 client.6192 trim_cache size 0 max 16384 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6051, 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:50:12.082 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:50:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.4938806060000003, 2024-09-13T18:50:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 33, 2024-09-13T18:50:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 53, 2024-09-13T18:50:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 53, 2024-09-13T18:50:12.083 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.776381253 2024-09-13T18:50:12.083 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efc70066760 msgr2=0x7efc70068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efc70066760 0x7efc70068c20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efc94067c50 tx=0x7efc7c008030 comp rx=0 tx=0).stop 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 msgr2=0x7efc94149f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 0x7efc94149f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7efc8400e940 tx=0x7efc8400ec50 comp rx=0 tx=0).stop 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 shutdown_connections 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efc70066760 0x7efc70068c20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc9415cc00 0x7efc941432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc9415de00 0x7efc94158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 --2- 172.21.15.81:0/2935265931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc940cc6c0 0x7efc94149f30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 >> 172.21.15.81:0/2935265931 conn(0x7efc9406ed70 msgr2=0x7efc9406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 shutdown_connections 2024-09-13T18:50:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.070+0000 7efc99800700 1 -- 172.21.15.81:0/2935265931 wait complete. 2024-09-13T18:50:12.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:50:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 Processor -- start 2024-09-13T18:50:12.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 -- start start 2024-09-13T18:50:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f312c06d180 0x7f312c0cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312c0b0190 con 0x7f312c15cb30 2024-09-13T18:50:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312c0d0770 con 0x7f312c06d180 2024-09-13T18:50:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.274+0000 7f3131a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c06a530 con 0x7f312c15cf10 2024-09-13T18:50:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f312c06d180 0x7f312c0cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312be00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f312c15cb30 0x7f312c06ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:53772/0 (socket says 172.21.15.81:53772) 2024-09-13T18:50:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f312c06d180 0x7f312c0cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:53528/0 (socket says 172.21.15.81:53528) 2024-09-13T18:50:12.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312be00700 1 -- 172.21.15.81:0/4146504971 learned_addr learned my addr 172.21.15.81:0/4146504971 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 -- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 msgr2=0x7f312c0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 --2- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 -- 172.21.15.81:0/4146504971 >> v1:172.21.15.178:6789/0 conn(0x7f312c15cb30 legacy=0x7f312c06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 -- 172.21.15.81:0/4146504971 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312c06a810 con 0x7f312c06d180 2024-09-13T18:50:12.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131000700 1 --2- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312b400700 1 --2- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0cfcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3118009850 tx=0x7f3118009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45915f9d7ff4cbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312aa00700 1 -- 172.21.15.81:0/4146504971 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118004230 con 0x7f312c06d180 2024-09-13T18:50:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312aa00700 1 -- 172.21.15.81:0/4146504971 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3118004390 con 0x7f312c06d180 2024-09-13T18:50:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f312aa00700 1 -- 172.21.15.81:0/4146504971 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31180036c0 con 0x7f312c06d180 2024-09-13T18:50:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131a00700 1 -- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 msgr2=0x7f312c0cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131a00700 1 --2- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0cfcf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3118009850 tx=0x7f3118009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131a00700 1 -- 172.21.15.81:0/4146504971 shutdown_connections 2024-09-13T18:50:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131a00700 1 --2- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131a00700 1 --2- 172.21.15.81:0/4146504971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0cfcf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.278+0000 7f3131a00700 1 -- 172.21.15.81:0/4146504971 >> 172.21.15.81:0/4146504971 conn(0x7f312c071f00 msgr2=0x7f312c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.282+0000 7f3131a00700 1 -- 172.21.15.81:0/4146504971 shutdown_connections 2024-09-13T18:50:12.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.282+0000 7f3131a00700 1 -- 172.21.15.81:0/4146504971 wait complete. 2024-09-13T18:50:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.282+0000 7f3131a00700 1 Processor -- start 2024-09-13T18:50:12.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.282+0000 7f3131a00700 1 -- start start 2024-09-13T18:50:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 0x7f312c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0b20f0 con 0x7f312c15cb30 2024-09-13T18:50:12.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0b0da0 con 0x7f312c06d180 2024-09-13T18:50:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312c0b1050 con 0x7f312c15cf10 2024-09-13T18:50:12.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 0x7f312c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 0x7f312c0b0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53266/0 (socket says 172.21.15.81:53266) 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 -- 172.21.15.81:0/610107342 learned_addr learned my addr 172.21.15.81:0/610107342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312be00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131000700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 -- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 msgr2=0x7f312c0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 -- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 msgr2=0x7f312c0b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0b29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 -- 172.21.15.81:0/610107342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009a70 con 0x7f312c15cb30 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131000700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312be00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:12.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f312b400700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 0x7f312c0b0320 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3118009ba0 tx=0x7f3118004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118011830 con 0x7f312c15cb30 2024-09-13T18:50:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311801f070 con 0x7f312c15cb30 2024-09-13T18:50:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31180094b0 con 0x7f312c15cb30 2024-09-13T18:50:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118011bf0 con 0x7f312c15cb30 2024-09-13T18:50:12.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.286+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c0b18f0 con 0x7f312c15cb30 2024-09-13T18:50:12.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.290+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c06ca70 con 0x7f312c15cb30 2024-09-13T18:50:12.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.290+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3118011d50 con 0x7f312c15cb30 2024-09-13T18:50:12.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.294+0000 7f3123e00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f310c066730 0x7f310c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.294+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3118021070 con 0x7f312c15cb30 2024-09-13T18:50:12.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.294+0000 7f312be00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f310c066730 0x7f310c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:12.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.294+0000 7f312be00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f310c066730 0x7f310c068bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f311c000f60 tx=0x7f311c007e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:12.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.298+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3118053030 con 0x7f312c15cb30 2024-09-13T18:50:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.530+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f312c06ca70 con 0x7f312c15cb30 2024-09-13T18:50:12.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.530+0000 7f3123e00700 1 -- 172.21.15.81:0/610107342 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3118056650 con 0x7f312c15cb30 2024-09-13T18:50:12.541 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:50:12.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f310c066730 msgr2=0x7f310c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f310c066730 0x7f310c068bf0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f311c000f60 tx=0x7f311c007e50 comp rx=0 tx=0).stop 2024-09-13T18:50:12.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 msgr2=0x7f312c0b0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:12.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 0x7f312c0b0320 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3118009ba0 tx=0x7f3118004770 comp rx=0 tx=0).stop 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 shutdown_connections 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f310c066730 0x7f310c068bf0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312c15cf10 0x7f312c0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f312c15cb30 0x7f312c0b0320 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 --2- 172.21.15.81:0/610107342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f312c06d180 0x7f312c0b29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 >> 172.21.15.81:0/610107342 conn(0x7f312c071f00 msgr2=0x7f312c15f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 shutdown_connections 2024-09-13T18:50:12.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:12.534+0000 7f3131a00700 1 -- 172.21.15.81:0/610107342 wait complete. 2024-09-13T18:50:12.569 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:50:12.569 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:50:12.570 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:50:12.570 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:50:12.570 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:50:12.570 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:50:12.570 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:50:12.570 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:50:12.571 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:50:12.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:12.571 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:50:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:50:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:50:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:50:12.586 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:50:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42280sec preferred_lft 42280sec 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:50:12.588 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::3069:26ff:fefd:eadb/64 scope link 2024-09-13T18:50:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:50:12.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:12.590 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:50:12.666 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:50:12.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:12.669 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:50:12.730 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:50:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:50:12.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:12.732 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:50:12.732 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:50:12.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:50:12.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:50:12.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:50:12.732 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:50:12.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:12.870 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:50:12.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:12.884 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:50:12.884 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:50:12.885 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:50:12.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:12.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:50:12.934 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:12.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:50:12.962 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:50:13.057 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:50:13.058 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:50:13.058 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:50:13.114 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:50:13.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:13.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:50:13.237 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:50:13.237 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:50:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:50:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:50:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:50:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:50:13.263 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:50:13.269 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:50:13.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:13.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:50:13.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:13.300 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:50:13.382 INFO:teuthology.orchestra.run.smithi081.stdout:client6046 2024-09-13T18:50:13.383 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:50:13.383 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:50:13.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:50:13.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 Processor -- start 2024-09-13T18:50:13.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 -- start start 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73480b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7348144710 0x7f73480b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734806bcf0 con 0x7f7348144330 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73480cce10 con 0x7f7348144710 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f734ca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734806cb50 con 0x7f734806d760 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f7346800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7348144710 0x7f73480b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f7346800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7348144710 0x7f73480b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53280/0 (socket says 172.21.15.81:53280) 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f7346800700 1 -- 172.21.15.81:0/1265662609 learned_addr learned my addr 172.21.15.81:0/1265662609 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.658+0000 7f7345e00700 1 --1- 172.21.15.81:0/1265662609 >> v1:172.21.15.81:6789/0 conn(0x7f7348144330 0x7f73480cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60382/0 (socket says 172.21.15.81:60382) 2024-09-13T18:50:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7345400700 1 --2- 172.21.15.81:0/1265662609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73480b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7346800700 1 -- 172.21.15.81:0/1265662609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 msgr2=0x7f73480b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7346800700 1 --2- 172.21.15.81:0/1265662609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73480b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7346800700 1 -- 172.21.15.81:0/1265662609 >> v1:172.21.15.81:6789/0 conn(0x7f7348144330 legacy=0x7f73480cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7346800700 1 -- 172.21.15.81:0/1265662609 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734806bf40 con 0x7f7348144710 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7344a00700 1 -- 172.21.15.81:0/1265662609 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758031636 0 0) 0x7f734806bcf0 con 0x7f7348144330 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7346800700 1 --2- 172.21.15.81:0/1265662609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7348144710 0x7f73480b3ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7340009e50 tx=0x7f734000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e59ed01ea5b7db server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7344a00700 1 -- 172.21.15.81:0/1265662609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734000e070 con 0x7f7348144710 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7344a00700 1 -- 172.21.15.81:0/1265662609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734000b9c0 con 0x7f7348144710 2024-09-13T18:50:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f7344a00700 1 -- 172.21.15.81:0/1265662609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734000bd70 con 0x7f7348144710 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 -- 172.21.15.81:0/1265662609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7348144710 msgr2=0x7f73480b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 --2- 172.21.15.81:0/1265662609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7348144710 0x7f73480b3ae0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7340009e50 tx=0x7f734000b330 comp rx=0 tx=0).stop 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 -- 172.21.15.81:0/1265662609 shutdown_connections 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 --2- 172.21.15.81:0/1265662609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7348144710 0x7f73480b3ae0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 --2- 172.21.15.81:0/1265662609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73480b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 -- 172.21.15.81:0/1265662609 >> 172.21.15.81:0/1265662609 conn(0x7f734806a570 msgr2=0x7f734806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:13.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 -- 172.21.15.81:0/1265662609 shutdown_connections 2024-09-13T18:50:13.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.662+0000 7f734ca00700 1 -- 172.21.15.81:0/1265662609 wait complete. 2024-09-13T18:50:13.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 Processor -- start 2024-09-13T18:50:13.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 -- start start 2024-09-13T18:50:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73481f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7348144330 0x7f734813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 0x7f734813d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480b0260 con 0x7f73481376e0 2024-09-13T18:50:13.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73480b10c0 con 0x7f7348144330 2024-09-13T18:50:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f734ca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480b1550 con 0x7f734806d760 2024-09-13T18:50:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 0x7f734813d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 0x7f734813d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53282/0 (socket says 172.21.15.81:53282) 2024-09-13T18:50:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 -- 172.21.15.81:0/1900902821 learned_addr learned my addr 172.21.15.81:0/1900902821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7345e00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73481f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:13.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7345400700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7348144330 0x7f734813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:13.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 -- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 msgr2=0x7f73481f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73481f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 -- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7348144330 msgr2=0x7f734813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7348144330 0x7f734813cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.666+0000 7f7346800700 1 -- 172.21.15.81:0/1900902821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340009b30 con 0x7f73481376e0 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f7346800700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 0x7f734813d530 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7340004270 tx=0x7f7340004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400099b0 con 0x7f73481376e0 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73400092e0 con 0x7f73481376e0 2024-09-13T18:50:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734001c660 con 0x7f73481376e0 2024-09-13T18:50:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73480cd880 con 0x7f73481376e0 2024-09-13T18:50:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73480b0790 con 0x7f73481376e0 2024-09-13T18:50:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73480b1b40 con 0x7f73481376e0 2024-09-13T18:50:13.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.670+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f734001c7c0 con 0x7f73481376e0 2024-09-13T18:50:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.674+0000 7f733e000700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7328066760 0x7f7328068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.674+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7340085b10 con 0x7f73481376e0 2024-09-13T18:50:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.674+0000 7f7345e00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7328066760 0x7f7328068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:13.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.674+0000 7f7345e00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7328066760 0x7f7328068c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7338000f60 tx=0x7f7338007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:13.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.678+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f73480b1b40 con 0x7f73481376e0 2024-09-13T18:50:13.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:13.898+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f73480b1b40 con 0x7f73481376e0 2024-09-13T18:50:14.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.630+0000 7f733e000700 1 -- 172.21.15.81:0/1900902821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v34) v1 ==== 105+0+0 (secure 0 0 0) 0x7f73480b1b40 con 0x7f73481376e0 2024-09-13T18:50:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.634+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7328066760 msgr2=0x7f7328068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.634+0000 7f734ca00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7328066760 0x7f7328068c20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7338000f60 tx=0x7f7338007c00 comp rx=0 tx=0).stop 2024-09-13T18:50:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.634+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 msgr2=0x7f734813d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.634+0000 7f734ca00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 0x7f734813d530 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7340004270 tx=0x7f7340004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 shutdown_connections 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7328066760 0x7f7328068c20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73481376e0 0x7f734813d530 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7348144330 0x7f734813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 --2- 172.21.15.81:0/1900902821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f734806d760 0x7f73481f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 >> 172.21.15.81:0/1900902821 conn(0x7f734806a570 msgr2=0x7f73480ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 shutdown_connections 2024-09-13T18:50:14.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.638+0000 7f734ca00700 1 -- 172.21.15.81:0/1900902821 wait complete. 2024-09-13T18:50:14.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.830+0000 7fce99000700 1 Processor -- start 2024-09-13T18:50:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce99000700 1 -- start start 2024-09-13T18:50:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce99000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fce94159bd0 0x7fce940cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce99000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce940707d0 con 0x7fce9406b1b0 2024-09-13T18:50:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce99000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9406fee0 con 0x7fce94071870 2024-09-13T18:50:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce99000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce940720a0 con 0x7fce94159bd0 2024-09-13T18:50:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce93e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce9406b1b0 0x7fce941636b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60390/0 (socket says 172.21.15.81:60390) 2024-09-13T18:50:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce93e00700 1 -- 172.21.15.81:0/2130073306 learned_addr learned my addr 172.21.15.81:0/2130073306 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.834+0000 7fce93400700 1 --2- 172.21.15.81:0/2130073306 >> v2:172.21.15.178:3300/0 conn(0x7fce94159bd0 0x7fce940cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce92a00700 1 -- 172.21.15.81:0/2130073306 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395542759 0 0) 0x7fce940707d0 con 0x7fce9406b1b0 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce92a00700 1 -- 172.21.15.81:0/2130073306 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce780035d0 con 0x7fce9406b1b0 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce93400700 1 -- 172.21.15.81:0/2130073306 >> v1:172.21.15.178:6789/0 conn(0x7fce94071870 legacy=0x7fce9406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce92a00700 1 -- 172.21.15.81:0/2130073306 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517314918 0 0) 0x7fce9406fee0 con 0x7fce94071870 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce93400700 1 -- 172.21.15.81:0/2130073306 >> v1:172.21.15.81:6789/0 conn(0x7fce9406b1b0 legacy=0x7fce941636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce93400700 1 -- 172.21.15.81:0/2130073306 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce940b2ef0 con 0x7fce94159bd0 2024-09-13T18:50:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce93400700 1 --2- 172.21.15.81:0/2130073306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94159bd0 0x7fce940cb700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fce84009dc0 tx=0x7fce8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6fd4f8f84f236df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce92a00700 1 -- 172.21.15.81:0/2130073306 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400e070 con 0x7fce94159bd0 2024-09-13T18:50:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce92a00700 1 -- 172.21.15.81:0/2130073306 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8400bae0 con 0x7fce94159bd0 2024-09-13T18:50:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce92a00700 1 -- 172.21.15.81:0/2130073306 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400be50 con 0x7fce94159bd0 2024-09-13T18:50:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 -- 172.21.15.81:0/2130073306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94159bd0 msgr2=0x7fce940cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 --2- 172.21.15.81:0/2130073306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94159bd0 0x7fce940cb700 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fce84009dc0 tx=0x7fce8400b330 comp rx=0 tx=0).stop 2024-09-13T18:50:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 -- 172.21.15.81:0/2130073306 shutdown_connections 2024-09-13T18:50:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 --2- 172.21.15.81:0/2130073306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94159bd0 0x7fce940cb700 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 -- 172.21.15.81:0/2130073306 >> 172.21.15.81:0/2130073306 conn(0x7fce940b0c40 msgr2=0x7fce9406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 -- 172.21.15.81:0/2130073306 shutdown_connections 2024-09-13T18:50:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.838+0000 7fce99000700 1 -- 172.21.15.81:0/2130073306 wait complete. 2024-09-13T18:50:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 Processor -- start 2024-09-13T18:50:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 -- start start 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9406b1b0 0x7fce940ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94071870 0x7fce941f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 0x7fce941521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce940ae350 con 0x7fce94159bd0 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce940ad870 con 0x7fce94071870 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce99000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce940af040 con 0x7fce9406b1b0 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce93e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 0x7fce941521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce93e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 0x7fce941521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53288/0 (socket says 172.21.15.81:53288) 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce93e00700 1 -- 172.21.15.81:0/1925049386 learned_addr learned my addr 172.21.15.81:0/1925049386 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.842+0000 7fce8aa00700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94071870 0x7fce941f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93400700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9406b1b0 0x7fce940ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93e00700 1 -- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9406b1b0 msgr2=0x7fce940ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93e00700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9406b1b0 0x7fce940ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93e00700 1 -- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94071870 msgr2=0x7fce941f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93e00700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94071870 0x7fce941f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93e00700 1 -- 172.21.15.81:0/1925049386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce84009a70 con 0x7fce94159bd0 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce8aa00700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94071870 0x7fce941f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce93e00700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 0x7fce941521a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c4c0 tx=0x7fce8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c005d90 con 0x7fce94159bd0 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce940adab0 con 0x7fce94159bd0 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c0070d0 con 0x7fce94159bd0 2024-09-13T18:50:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c007480 con 0x7fce94159bd0 2024-09-13T18:50:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce940ae070 con 0x7fce94159bd0 2024-09-13T18:50:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.846+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce940aee10 con 0x7fce94159bd0 2024-09-13T18:50:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.850+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fce8c0075e0 con 0x7fce94159bd0 2024-09-13T18:50:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.850+0000 7fce8be00700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce70066730 0x7fce70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.850+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fce8c0834f0 con 0x7fce94159bd0 2024-09-13T18:50:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.850+0000 7fce93400700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce70066730 0x7fce70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.854+0000 7fce93400700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce70066730 0x7fce70068bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fce84000f80 tx=0x7fce84011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:14.858+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fce940aee10 con 0x7fce94159bd0 2024-09-13T18:50:15.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.082+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce940aee10 con 0x7fce94159bd0 2024-09-13T18:50:15.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.082+0000 7fce8be00700 1 -- 172.21.15.81:0/1925049386 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4750 (secure 0 0 0) 0x7fce940aee10 con 0x7fce94159bd0 2024-09-13T18:50:15.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:15.093 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5911,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:14.636467+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6051,"mds_1":6048},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:creating","state_seq":1,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce70066730 msgr2=0x7fce70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce70066730 0x7fce70068bf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fce84000f80 tx=0x7fce84011000 comp rx=0 tx=0).stop 2024-09-13T18:50:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 msgr2=0x7fce941521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:15.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 0x7fce941521a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c4c0 tx=0x7fce8c00c880 comp rx=0 tx=0).stop 2024-09-13T18:50:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 shutdown_connections 2024-09-13T18:50:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce70066730 0x7fce70068bf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce94159bd0 0x7fce941521a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce94071870 0x7fce941f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 --2- 172.21.15.81:0/1925049386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9406b1b0 0x7fce940ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 >> 172.21.15.81:0/1925049386 conn(0x7fce940b0c40 msgr2=0x7fce94157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 shutdown_connections 2024-09-13T18:50:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:15.086+0000 7fce99000700 1 -- 172.21.15.81:0/1925049386 wait complete. 2024-09-13T18:50:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 35 2024-09-13T18:50:15.522 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:50:05.574515+0000', 'modified': '2024-09-13T18:50:14.636467+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6051, 'mds_1': 6048}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6048': {'gid': 6048, 'name': 'c', 'rank': 1, 'incarnation': 35, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.81:6836/729196456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 729196456}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 729196456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6051': {'gid': 6051, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/396996950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 396996950}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 396996950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:50:15.522 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6048:up:creating 2024-09-13T18:50:16.034 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:50:16.022+0000 7f13f2400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T18:50:16.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:16.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.698+0000 7fadb7e00700 1 Processor -- start 2024-09-13T18:50:16.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.698+0000 7fadb7e00700 1 -- start start 2024-09-13T18:50:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fadb806aaa0 0x7fadb806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb7e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb80ccb40 con 0x7fadb80cc6f0 2024-09-13T18:50:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb7e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb806b430 con 0x7fadb80cb020 2024-09-13T18:50:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb7e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb80b2ad0 con 0x7fadb806aaa0 2024-09-13T18:50:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb6000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fadb80cc6f0 0x7fadb815b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52000/0 (socket says 172.21.15.81:52000) 2024-09-13T18:50:16.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb6000700 1 -- 172.21.15.81:0/1331017259 learned_addr learned my addr 172.21.15.81:0/1331017259 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.702+0000 7fadb7400700 1 --2- 172.21.15.81:0/1331017259 >> v2:172.21.15.81:3300/0 conn(0x7fadb806aaa0 0x7fadb806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7400700 1 -- 172.21.15.81:0/1331017259 >> v1:172.21.15.178:6789/0 conn(0x7fadb80cb020 legacy=0x7fadb815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7400700 1 -- 172.21.15.81:0/1331017259 >> v1:172.21.15.81:6789/0 conn(0x7fadb80cc6f0 legacy=0x7fadb815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7400700 1 -- 172.21.15.81:0/1331017259 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb815b960 con 0x7fadb806aaa0 2024-09-13T18:50:16.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb5600700 1 -- 172.21.15.81:0/1331017259 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736814409 0 0) 0x7fadb80ccb40 con 0x7fadb80cc6f0 2024-09-13T18:50:16.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7400700 1 --2- 172.21.15.81:0/1331017259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb806aaa0 0x7fadb806aef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009d90 tx=0x7fadb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9796451db6d4113 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:16.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb5600700 1 -- 172.21.15.81:0/1331017259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000e070 con 0x7fadb806aaa0 2024-09-13T18:50:16.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb5600700 1 -- 172.21.15.81:0/1331017259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb000bbd0 con 0x7fadb806aaa0 2024-09-13T18:50:16.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb5600700 1 -- 172.21.15.81:0/1331017259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0012430 con 0x7fadb806aaa0 2024-09-13T18:50:16.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 -- 172.21.15.81:0/1331017259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb806aaa0 msgr2=0x7fadb806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1331017259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb806aaa0 0x7fadb806aef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009d90 tx=0x7fadb000b330 comp rx=0 tx=0).stop 2024-09-13T18:50:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 -- 172.21.15.81:0/1331017259 shutdown_connections 2024-09-13T18:50:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1331017259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb806aaa0 0x7fadb806aef0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 -- 172.21.15.81:0/1331017259 >> 172.21.15.81:0/1331017259 conn(0x7fadb80b0c40 msgr2=0x7fadb806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 -- 172.21.15.81:0/1331017259 shutdown_connections 2024-09-13T18:50:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.706+0000 7fadb7e00700 1 -- 172.21.15.81:0/1331017259 wait complete. 2024-09-13T18:50:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 Processor -- start 2024-09-13T18:50:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 -- start start 2024-09-13T18:50:16.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadb806aaa0 0x7fadb813f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:16.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadb80cb020 0x7fadb806c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:16.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 0x7fadb806c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb813fb50 con 0x7fadb80cc6f0 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb813fd40 con 0x7fadb806aaa0 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb8140020 con 0x7fadb80cb020 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 0x7fadb806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 0x7fadb806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45366/0 (socket says 172.21.15.81:45366) 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 -- 172.21.15.81:0/1303568760 learned_addr learned my addr 172.21.15.81:0/1303568760 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb6a00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadb806aaa0 0x7fadb813f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb6000700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadb80cb020 0x7fadb806c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 -- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadb80cb020 msgr2=0x7fadb806c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadb80cb020 0x7fadb806c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 -- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadb806aaa0 msgr2=0x7fadb813f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadb806aaa0 0x7fadb813f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 -- 172.21.15.81:0/1303568760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009a70 con 0x7fadb80cc6f0 2024-09-13T18:50:16.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb6000700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadb80cb020 0x7fadb806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:16.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb6a00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadb806aaa0 0x7fadb813f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:16.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.710+0000 7fadb7400700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 0x7fadb806c650 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fadb0014040 tx=0x7fadb0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:16.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0012430 con 0x7fadb80cc6f0 2024-09-13T18:50:16.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb0020070 con 0x7fadb80cc6f0 2024-09-13T18:50:16.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb8140300 con 0x7fadb80cc6f0 2024-09-13T18:50:16.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0004280 con 0x7fadb80cc6f0 2024-09-13T18:50:16.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb81f4730 con 0x7fadb80cc6f0 2024-09-13T18:50:16.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb8140820 con 0x7fadb80cc6f0 2024-09-13T18:50:16.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.714+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadb00043e0 con 0x7fadb80cc6f0 2024-09-13T18:50:16.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.718+0000 7fadaf400700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad98066760 0x7fad98068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:16.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.718+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fadb0022070 con 0x7fadb80cc6f0 2024-09-13T18:50:16.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.718+0000 7fadb6a00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad98066760 0x7fad98068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:16.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.718+0000 7fadb6a00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad98066760 0x7fad98068c20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fada8000f60 tx=0x7fada8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:16.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.726+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fadb8140820 con 0x7fadb80cc6f0 2024-09-13T18:50:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.938+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadb8140820 con 0x7fadb80cc6f0 2024-09-13T18:50:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.942+0000 7fadaf400700 1 -- 172.21.15.81:0/1303568760 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4762 (secure 0 0 0) 0x7fadb8140820 con 0x7fadb80cc6f0 2024-09-13T18:50:16.952 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:16.952 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:16.663943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad98066760 msgr2=0x7fad98068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad98066760 0x7fad98068c20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fada8000f60 tx=0x7fada8009040 comp rx=0 tx=0).stop 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 msgr2=0x7fadb806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 0x7fadb806c650 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fadb0014040 tx=0x7fadb0004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 shutdown_connections 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad98066760 0x7fad98068c20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadb80cc6f0 0x7fadb806c650 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadb80cb020 0x7fadb806c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 --2- 172.21.15.81:0/1303568760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadb806aaa0 0x7fadb813f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 >> 172.21.15.81:0/1303568760 conn(0x7fadb80b0c40 msgr2=0x7fadb806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 shutdown_connections 2024-09-13T18:50:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:16.946+0000 7fadb7e00700 1 -- 172.21.15.81:0/1303568760 wait complete. 2024-09-13T18:50:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 38 2024-09-13T18:50:17.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:50:05.574515+0000', 'modified': '2024-09-13T18:50:16.663943+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6051, 'mds_1': 6048, 'mds_2': 5911}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5911': {'gid': 5911, 'name': 'd', 'rank': 2, 'incarnation': 37, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.178:6835/1611484847', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 1611484847}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 1611484847}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6048': {'gid': 6048, 'name': 'c', 'rank': 1, 'incarnation': 35, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.81:6836/729196456', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 729196456}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 729196456}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6051': {'gid': 6051, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/396996950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 396996950}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 396996950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:50:17.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:50:17.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:50:17.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.542+0000 7f9fd2000700 1 Processor -- start 2024-09-13T18:50:17.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.542+0000 7f9fd2000700 1 -- start start 2024-09-13T18:50:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc161150 0x7f9fcc0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc0cc740 0x7f9fcc06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0cb1a0 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fcc06ad80 con 0x7f9fcc161150 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0cb440 con 0x7f9fcc0cc740 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd0c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fcc161150 0x7f9fcc0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd1600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9fcc06a8d0 0x7f9fcc0ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52004/0 (socket says 172.21.15.81:52004) 2024-09-13T18:50:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd1600700 1 -- 172.21.15.81:0/4173918415 learned_addr learned my addr 172.21.15.81:0/4173918415 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/4173918415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc0cc740 0x7f9fcc06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd0c00700 1 -- 172.21.15.81:0/4173918415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc0cc740 msgr2=0x7f9fcc06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/4173918415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc0cc740 0x7f9fcc06a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd0c00700 1 -- 172.21.15.81:0/4173918415 >> v1:172.21.15.81:6789/0 conn(0x7f9fcc06a8d0 legacy=0x7f9fcc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd0c00700 1 -- 172.21.15.81:0/4173918415 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0cb720 con 0x7f9fcc161150 2024-09-13T18:50:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/4173918415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc161150 0x7f9fcc0cc200 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009850 tx=0x7f9fc0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e913eaf4911a6e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fcb400700 1 -- 172.21.15.81:0/4173918415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011830 con 0x7f9fcc161150 2024-09-13T18:50:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fcb400700 1 -- 172.21.15.81:0/4173918415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc0011990 con 0x7f9fcc161150 2024-09-13T18:50:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fcb400700 1 -- 172.21.15.81:0/4173918415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0011d40 con 0x7f9fcc161150 2024-09-13T18:50:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- 172.21.15.81:0/4173918415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc161150 msgr2=0x7f9fcc0cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 --2- 172.21.15.81:0/4173918415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc161150 0x7f9fcc0cc200 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009850 tx=0x7f9fc0009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- 172.21.15.81:0/4173918415 shutdown_connections 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 --2- 172.21.15.81:0/4173918415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc0cc740 0x7f9fcc06a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 --2- 172.21.15.81:0/4173918415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc161150 0x7f9fcc0cc200 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- 172.21.15.81:0/4173918415 >> 172.21.15.81:0/4173918415 conn(0x7f9fcc071f00 msgr2=0x7f9fcc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- 172.21.15.81:0/4173918415 shutdown_connections 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.546+0000 7f9fd2000700 1 -- 172.21.15.81:0/4173918415 wait complete. 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 Processor -- start 2024-09-13T18:50:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 -- start start 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 0x7f9fcc15f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fcc0cc740 0x7f9fcc0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc161150 0x7f9fcc15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0c4c90 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0ca4e0 con 0x7f9fcc0cc740 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0ca200 con 0x7f9fcc161150 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 0x7f9fcc15f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 0x7f9fcc15f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45378/0 (socket says 172.21.15.81:45378) 2024-09-13T18:50:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd0c00700 1 -- 172.21.15.81:0/3872165098 learned_addr learned my addr 172.21.15.81:0/3872165098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fcc0cc740 0x7f9fcc0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.550+0000 7f9fd1600700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc161150 0x7f9fcc15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd0c00700 1 -- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc161150 msgr2=0x7f9fcc15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc161150 0x7f9fcc15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd0c00700 1 -- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fcc0cc740 msgr2=0x7f9fcc0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fcc0cc740 0x7f9fcc0c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd0c00700 1 -- 172.21.15.81:0/3872165098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc00094b0 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fcc0cc740 0x7f9fcc0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 0x7f9fcc15f320 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000c00 tx=0x7f9fc0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fc8c00700 1 -- 172.21.15.81:0/3872165098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00044b0 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fc8c00700 1 -- 172.21.15.81:0/3872165098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc001f070 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fc8c00700 1 -- 172.21.15.81:0/3872165098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003900 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc0c45d0 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.554+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc15f860 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.558+0000 7f9fc8c00700 1 -- 172.21.15.81:0/3872165098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9fc0021030 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.558+0000 7f9fc8c00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9fac066730 0x7f9fac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.558+0000 7f9fc8c00700 1 -- 172.21.15.81:0/3872165098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fc0085600 con 0x7f9fcc06a8d0 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.558+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9fac066730 0x7f9fac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.558+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9fac066730 0x7f9fac068bf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc15ec40 tx=0x7f9fb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 Processor -- start 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 -- start start 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536eda0 0x536f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5337890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5337dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5296d80 con 0x534dd00 2024-09-13T18:50:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5294510 con 0x536f6c0 2024-09-13T18:50:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x528fe00 con 0x536eda0 2024-09-13T18:50:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5337890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5337890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45394/0 (socket says 172.21.15.81:45394) 2024-09-13T18:50:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1230079406 learned_addr learned my addr 172.21.15.81:0/1230079406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd1600700 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5337dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536eda0 0x536f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536eda0 msgr2=0x536f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536eda0 0x536f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 msgr2=0x5337dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5337dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 -- 172.21.15.81:0/1230079406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5102960 con 0x534dd00 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5337890 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8004430 tx=0x7f9fb8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8d75c144267dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fbd200700 1 -- 172.21.15.81:0/1230079406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8004460 con 0x534dd00 2024-09-13T18:50:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fbd200700 1 -- 172.21.15.81:0/1230079406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80045c0 con 0x534dd00 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.562+0000 7f9fbd200700 1 -- 172.21.15.81:0/1230079406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80038c0 con 0x534dd00 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 -- 172.21.15.81:0/1230079406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 msgr2=0x5337890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5337890 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8004430 tx=0x7f9fb8014000 comp rx=0 tx=0).stop 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 -- 172.21.15.81:0/1230079406 shutdown_connections 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5337dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5337890 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1230079406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536eda0 0x536f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 -- 172.21.15.81:0/1230079406 >> 172.21.15.81:0/1230079406 conn(0x50b74d0 msgr2=0x5350c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 -- 172.21.15.81:0/1230079406 shutdown_connections 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 -- 172.21.15.81:0/1230079406 wait complete. 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 -- start start 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.566+0000 7f9fd6992740 1 Processor -- start 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x534dd00 0x53272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x5328470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x536faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x524d730 con 0x536eda0 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x52535b0 con 0x534dd00 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x513baa0 con 0x536f6c0 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 10 client.0 _ll_register_callbacks cb 0x5289610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x5328470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd0c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x534dd00 0x53272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x5328470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45400/0 (socket says 172.21.15.81:45400) 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 -- 172.21.15.81:0/2829590129 learned_addr learned my addr 172.21.15.81:0/2829590129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd1600700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x536faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 -- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 msgr2=0x536faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x536faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 -- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x534dd00 msgr2=0x53272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x534dd00 0x53272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 -- 172.21.15.81:0/2829590129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8004110 con 0x536eda0 2024-09-13T18:50:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x534dd00 0x53272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd1600700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x536faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x5328470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8025040 tx=0x7f9fb8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91888142ebcf08b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fb1600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fb1600700 1 -- 172.21.15.81:0/2829590129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8003e80 con 0x536eda0 2024-09-13T18:50:17.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fb1600700 1 -- 172.21.15.81:0/2829590129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fb801e040 con 0x536eda0 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x50c41e0 con 0x536eda0 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fb1600700 1 -- 172.21.15.81:0/2829590129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb8015480 con 0x536eda0 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 10 client.6234 fetch_fsmap learned FSMap version 38 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5256220 con 0x536eda0 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fb1600700 1 -- 172.21.15.81:0/2829590129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x50c41e0 con 0x536eda0 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fb1600700 1 -- 172.21.15.81:0/2829590129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9fb8015870 con 0x536eda0 2024-09-13T18:50:17.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 10 client.6234 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:50:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 10 client.6234 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:50:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 20 client.6234 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x53254f0 0x53258d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 4 client.6234 mds_command: new command op to 5911 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.570+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 --> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x510e460 con 0x53254f0 2024-09-13T18:50:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x53254f0 0x53258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x53254f0 0x53258d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=432a0874ec7b5aaa server_cookie=e54c61dfde2d6671 in_seq=0 out_seq=0 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fb1600700 10 client.6234 ms_handle_connect on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fb1600700 1 -- 172.21.15.81:0/2829590129 <== mds.2 v2:172.21.15.178:6834/1611484847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x510e460 con 0x53254f0 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fb1600700 10 client.6234 handle_command_reply: tid=0 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 client.6234 shutdown 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 msgr2=0x5328470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x5328470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8025040 tx=0x7f9fb8004770 comp rx=0 tx=0).stop 2024-09-13T18:50:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 shutdown_connections 2024-09-13T18:50:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x53254f0 0x53258d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x536faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x5328470 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fd6992740 1 --2- 172.21.15.81:0/2829590129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x534dd00 0x53272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.578+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 >> 172.21.15.81:0/2829590129 conn(0x50b74d0 msgr2=0x534a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.574+0000 7f9fb1600700 0 client.6234 ms_handle_reset on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.578+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 shutdown_connections 2024-09-13T18:50:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.578+0000 7f9fd6992740 1 -- 172.21.15.81:0/2829590129 wait complete. 2024-09-13T18:50:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.578+0000 7f9fd6992740 20 client.6234 trim_cache size 0 max 16384 2024-09-13T18:50:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.606+0000 7f9fd6992740 1 Processor -- start 2024-09-13T18:50:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.606+0000 7f9fd6992740 1 -- start start 2024-09-13T18:50:17.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5324920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536eda0 0x534ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x534d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x52beec0 con 0x534dd00 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x528e480 con 0x536eda0 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5238020 con 0x536f6c0 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5324920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5324920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45408/0 (socket says 172.21.15.81:45408) 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 -- 172.21.15.81:0/1699243876 learned_addr learned my addr 172.21.15.81:0/1699243876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd1600700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x534d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536eda0 0x534ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 -- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 msgr2=0x534d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x534d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 -- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536eda0 msgr2=0x534ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536eda0 0x534ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 -- 172.21.15.81:0/1699243876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x523c450 con 0x534dd00 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd1600700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x534d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536eda0 0x534ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5324920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0056520 tx=0x7f9fc001d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb87502d73274333 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fbdc00700 1 -- 172.21.15.81:0/1699243876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc005e8d0 con 0x534dd00 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fbdc00700 1 -- 172.21.15.81:0/1699243876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc005a0c0 con 0x534dd00 2024-09-13T18:50:17.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fbdc00700 1 -- 172.21.15.81:0/1699243876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0054930 con 0x534dd00 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- 172.21.15.81:0/1699243876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 msgr2=0x5324920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5324920 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0056520 tx=0x7f9fc001d040 comp rx=0 tx=0).stop 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- 172.21.15.81:0/1699243876 shutdown_connections 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x536f6c0 0x534d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536eda0 0x534ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 --2- 172.21.15.81:0/1699243876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x534dd00 0x5324920 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- 172.21.15.81:0/1699243876 >> 172.21.15.81:0/1699243876 conn(0x50b74d0 msgr2=0x534c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- 172.21.15.81:0/1699243876 shutdown_connections 2024-09-13T18:50:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- 172.21.15.81:0/1699243876 wait complete. 2024-09-13T18:50:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.610+0000 7f9fd6992740 1 -- start start 2024-09-13T18:50:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 Processor -- start 2024-09-13T18:50:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x534dd00 0x5386a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x53853d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5382d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5387240 con 0x536eda0 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5387690 con 0x536f6c0 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x53250c0 con 0x534dd00 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 10 client.0 _ll_register_callbacks cb 0x52e6710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x53853d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x53853d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45418/0 (socket says 172.21.15.81:45418) 2024-09-13T18:50:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 -- 172.21.15.81:0/4035734151 learned_addr learned my addr 172.21.15.81:0/4035734151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd1600700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5382d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x534dd00 0x5386a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 -- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x534dd00 msgr2=0x5386a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x534dd00 0x5386a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 -- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 msgr2=0x5382d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5382d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 -- 172.21.15.81:0/4035734151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc15f860 con 0x536eda0 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fcbe00700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x53853d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8011ae0 tx=0x7f9fb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17adc02b41902904 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fb1600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fb1600700 1 -- 172.21.15.81:0/4035734151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8011ea0 con 0x536eda0 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fb80045c0 con 0x536eda0 2024-09-13T18:50:17.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fb1600700 1 -- 172.21.15.81:0/4035734151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9fb8015480 con 0x536eda0 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fb1600700 1 -- 172.21.15.81:0/4035734151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fb8005c50 con 0x536eda0 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 10 client.6240 fetch_fsmap learned FSMap version 38 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.614+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5230720 con 0x536eda0 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fb1600700 1 -- 172.21.15.81:0/4035734151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb80045c0 con 0x536eda0 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fb1600700 1 -- 172.21.15.81:0/4035734151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9fb8006040 con 0x536eda0 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 10 client.6240 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:50:17.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 10 client.6240 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 20 client.6240 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x5383540 0x5383920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 4 client.6240 mds_command: new command op to 5911 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 --> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] -- command(tid 0: {"prefix": "status"}) v1 -- 0x51331e0 con 0x5383540 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x5383540 0x5383920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fb1600700 10 client.6240 ms_handle_connect on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:17.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd0c00700 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x5383540 0x5383920 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0a950c57549d01d server_cookie=f77a295a0c7cd200 in_seq=0 out_seq=0 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fb1600700 1 -- 172.21.15.81:0/4035734151 <== mds.2 v2:172.21.15.178:6834/1611484847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x51331e0 con 0x5383540 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fb1600700 10 client.6240 handle_command_reply: tid=0 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 client.6240 shutdown 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 msgr2=0x53853d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x53853d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8011ae0 tx=0x7f9fb8017000 comp rx=0 tx=0).stop 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 shutdown_connections 2024-09-13T18:50:17.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x5383540 0x5383920 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x536f6c0 0x5382d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x536eda0 0x53853d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 --2- 172.21.15.81:0/4035734151 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x534dd00 0x5386a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fb1600700 0 client.6240 ms_handle_reset on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 >> 172.21.15.81:0/4035734151 conn(0x50b74d0 msgr2=0x534cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 shutdown_connections 2024-09-13T18:50:17.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 1 -- 172.21.15.81:0/4035734151 wait complete. 2024-09-13T18:50:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.618+0000 7f9fd6992740 20 client.6240 trim_cache size 0 max 16384 2024-09-13T18:50:17.655 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:17.655 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:50:17.655 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5911, 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 1.9577749799999999, 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 38, 2024-09-13T18:50:17.656 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 53, 2024-09-13T18:50:17.657 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 53, 2024-09-13T18:50:17.657 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.297922775 2024-09-13T18:50:17.657 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9fac066730 msgr2=0x7f9fac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9fac066730 0x7f9fac068bf0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc15ec40 tx=0x7f9fb8008040 comp rx=0 tx=0).stop 2024-09-13T18:50:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 msgr2=0x7f9fcc15f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 0x7f9fcc15f320 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0000c00 tx=0x7f9fc0004770 comp rx=0 tx=0).stop 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 shutdown_connections 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9fac066730 0x7f9fac068bf0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fcc161150 0x7f9fcc15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fcc0cc740 0x7f9fcc0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 --2- 172.21.15.81:0/3872165098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fcc06a8d0 0x7f9fcc15f320 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 >> 172.21.15.81:0/3872165098 conn(0x7f9fcc071f00 msgr2=0x7f9fcc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 shutdown_connections 2024-09-13T18:50:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.622+0000 7f9fd2000700 1 -- 172.21.15.81:0/3872165098 wait complete. 2024-09-13T18:50:17.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:50:17.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 Processor -- start 2024-09-13T18:50:17.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 -- start start 2024-09-13T18:50:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9610159bd0 0x7f96100cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f961006b1b0 0x7f96101636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100707d0 con 0x7f9610071870 2024-09-13T18:50:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96100720a0 con 0x7f9610159bd0 2024-09-13T18:50:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9615600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961006fee0 con 0x7f961006b1b0 2024-09-13T18:50:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f960f400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9610071870 0x7f961006aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52006/0 (socket says 172.21.15.81:52006) 2024-09-13T18:50:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f960f400700 1 -- 172.21.15.81:0/2663790601 learned_addr learned my addr 172.21.15.81:0/2663790601 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f960fe00700 1 --2- 172.21.15.81:0/2663790601 >> v2:172.21.15.81:3300/0 conn(0x7f9610159bd0 0x7f96100cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.834+0000 7f9614c00700 1 --2- 172.21.15.81:0/2663790601 >> v2:172.21.15.178:3300/0 conn(0x7f961006b1b0 0x7f96101636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960ea00700 1 -- 172.21.15.81:0/2663790601 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782110967 0 0) 0x7f96100707d0 con 0x7f9610071870 2024-09-13T18:50:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960ea00700 1 -- 172.21.15.81:0/2663790601 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f40035d0 con 0x7f9610071870 2024-09-13T18:50:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960fe00700 1 -- 172.21.15.81:0/2663790601 >> v2:172.21.15.178:3300/0 conn(0x7f961006b1b0 msgr2=0x7f96101636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960fe00700 1 --2- 172.21.15.81:0/2663790601 >> v2:172.21.15.178:3300/0 conn(0x7f961006b1b0 0x7f96101636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960fe00700 1 -- 172.21.15.81:0/2663790601 >> v1:172.21.15.81:6789/0 conn(0x7f9610071870 legacy=0x7f961006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960fe00700 1 -- 172.21.15.81:0/2663790601 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100b2ef0 con 0x7f9610159bd0 2024-09-13T18:50:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960fe00700 1 --2- 172.21.15.81:0/2663790601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610159bd0 0x7f96100cb700 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9600009850 tx=0x7f9600009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63c8475a5493295 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960ea00700 1 -- 172.21.15.81:0/2663790601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011830 con 0x7f9610159bd0 2024-09-13T18:50:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960ea00700 1 -- 172.21.15.81:0/2663790601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600011990 con 0x7f9610159bd0 2024-09-13T18:50:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f960ea00700 1 -- 172.21.15.81:0/2663790601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600011d20 con 0x7f9610159bd0 2024-09-13T18:50:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 -- 172.21.15.81:0/2663790601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610159bd0 msgr2=0x7f96100cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 --2- 172.21.15.81:0/2663790601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610159bd0 0x7f96100cb700 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9600009850 tx=0x7f9600009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 -- 172.21.15.81:0/2663790601 shutdown_connections 2024-09-13T18:50:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 --2- 172.21.15.81:0/2663790601 >> v2:172.21.15.178:3300/0 conn(0x7f961006b1b0 0x7f96101636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 --2- 172.21.15.81:0/2663790601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610159bd0 0x7f96100cb700 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 -- 172.21.15.81:0/2663790601 >> 172.21.15.81:0/2663790601 conn(0x7f96100b0c40 msgr2=0x7f961006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 -- 172.21.15.81:0/2663790601 shutdown_connections 2024-09-13T18:50:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.838+0000 7f9615600700 1 -- 172.21.15.81:0/2663790601 wait complete. 2024-09-13T18:50:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.842+0000 7f9615600700 1 Processor -- start 2024-09-13T18:50:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.842+0000 7f9615600700 1 -- start start 2024-09-13T18:50:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961006b1b0 0x7f961015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 0x7f96101480b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9610159bd0 0x7f96100ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100ad980 con 0x7f9610071870 2024-09-13T18:50:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96100adfc0 con 0x7f961006b1b0 2024-09-13T18:50:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100ad3c0 con 0x7f9610159bd0 2024-09-13T18:50:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 0x7f96101480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 0x7f96101480b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45436/0 (socket says 172.21.15.81:45436) 2024-09-13T18:50:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 -- 172.21.15.81:0/132908277 learned_addr learned my addr 172.21.15.81:0/132908277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960fe00700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961006b1b0 0x7f961015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9614c00700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9610159bd0 0x7f96100ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 -- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9610159bd0 msgr2=0x7f96100ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9610159bd0 0x7f96100ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 -- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961006b1b0 msgr2=0x7f961015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961006b1b0 0x7f961015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 -- 172.21.15.81:0/132908277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000094b0 con 0x7f9610071870 2024-09-13T18:50:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f960f400700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 0x7f96101480b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c700 tx=0x7f95fc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9607e00700 1 -- 172.21.15.81:0/132908277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc005d90 con 0x7f9610071870 2024-09-13T18:50:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9607e00700 1 -- 172.21.15.81:0/132908277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc0070d0 con 0x7f9610071870 2024-09-13T18:50:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9607e00700 1 -- 172.21.15.81:0/132908277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc007480 con 0x7f9610071870 2024-09-13T18:50:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96100ad6a0 con 0x7f9610071870 2024-09-13T18:50:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.846+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961014f330 con 0x7f9610071870 2024-09-13T18:50:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.850+0000 7f9607e00700 1 -- 172.21.15.81:0/132908277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95fc0075e0 con 0x7f9610071870 2024-09-13T18:50:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.850+0000 7f9607e00700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95f0066730 0x7f95f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.850+0000 7f9607e00700 1 -- 172.21.15.81:0/132908277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95fc083760 con 0x7f9610071870 2024-09-13T18:50:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.850+0000 7f960fe00700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95f0066730 0x7f95f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.850+0000 7f960fe00700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95f0066730 0x7f95f0068bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9600000c00 tx=0x7f9600008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 Processor -- start 2024-09-13T18:50:17.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 -- start start 2024-09-13T18:50:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b78180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b56d00 0x1b40890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b786c0 0x1b40dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a9fd80 con 0x1b77da0 2024-09-13T18:50:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a9d510 con 0x1b786c0 2024-09-13T18:50:17.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a98e00 con 0x1b56d00 2024-09-13T18:50:17.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b78180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b78180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45442/0 (socket says 172.21.15.81:45442) 2024-09-13T18:50:17.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 -- 172.21.15.81:0/593101270 learned_addr learned my addr 172.21.15.81:0/593101270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9614c00700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b786c0 0x1b40dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960f400700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b56d00 0x1b40890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 -- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b56d00 msgr2=0x1b40890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b56d00 0x1b40890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 -- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b786c0 msgr2=0x1b40dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b786c0 0x1b40dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960fe00700 1 -- 172.21.15.81:0/593101270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x190b960 con 0x1b77da0 2024-09-13T18:50:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f960f400700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b56d00 0x1b40890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:17.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.854+0000 7f9614c00700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b786c0 0x1b40dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f960fe00700 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b78180 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9600014040 tx=0x7f9600010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b228169a08c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f95fbe00700 1 -- 172.21.15.81:0/593101270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960002b070 con 0x1b77da0 2024-09-13T18:50:17.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f95fbe00700 1 -- 172.21.15.81:0/593101270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96000036c0 con 0x1b77da0 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f95fbe00700 1 -- 172.21.15.81:0/593101270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960001f070 con 0x1b77da0 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 -- 172.21.15.81:0/593101270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 msgr2=0x1b78180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b78180 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9600014040 tx=0x7f9600010000 comp rx=0 tx=0).stop 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 -- 172.21.15.81:0/593101270 shutdown_connections 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b786c0 0x1b40dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b56d00 0x1b40890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 --2- 172.21.15.81:0/593101270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b78180 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 -- 172.21.15.81:0/593101270 >> 172.21.15.81:0/593101270 conn(0x18c04d0 msgr2=0x1b59c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 -- 172.21.15.81:0/593101270 shutdown_connections 2024-09-13T18:50:17.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 -- 172.21.15.81:0/593101270 wait complete. 2024-09-13T18:50:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.858+0000 7f9619eff740 1 -- start start 2024-09-13T18:50:17.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 Processor -- start 2024-09-13T18:50:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b77570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b7e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b786c0 0x1b31470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a56730 con 0x1b77da0 2024-09-13T18:50:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a5c5b0 con 0x1b56d00 2024-09-13T18:50:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1944aa0 con 0x1b786c0 2024-09-13T18:50:17.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9619eff740 10 client.0 _ll_register_callbacks cb 0x1a92610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b7e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b7e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45446/0 (socket says 172.21.15.81:45446) 2024-09-13T18:50:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 -- 172.21.15.81:0/4082312408 learned_addr learned my addr 172.21.15.81:0/4082312408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9614c00700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b786c0 0x1b31470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960fe00700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b77570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 -- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b786c0 msgr2=0x1b31470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b786c0 0x1b31470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 -- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 msgr2=0x1b77570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b77570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 -- 172.21.15.81:0/4082312408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100b2ef0 con 0x1b77da0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f9614c00700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b786c0 0x1b31470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f960f400700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b7e3b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f95fc007fd0 tx=0x7f95fc054af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92d02830f4e8e00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f95f8c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.862+0000 7f95f8c00700 1 -- 172.21.15.81:0/4082312408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0583e0 con 0x1b77da0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 1 -- 172.21.15.81:0/4082312408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95fc05c9a0 con 0x1b77da0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18cd1e0 con 0x1b77da0 2024-09-13T18:50:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 1 -- 172.21.15.81:0/4082312408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95fc05c510 con 0x1b77da0 2024-09-13T18:50:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 10 client.6255 fetch_fsmap learned FSMap version 38 2024-09-13T18:50:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1a5f220 con 0x1b77da0 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 1 -- 172.21.15.81:0/4082312408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18cd1e0 con 0x1b77da0 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 1 -- 172.21.15.81:0/4082312408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f95fc05a370 con 0x1b77da0 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 10 client.6255 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 10 client.6255 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 20 client.6255 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1b781e0 0x1b30260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 4 client.6255 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1917460 con 0x1b781e0 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f960fe00700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1b781e0 0x1b30260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 10 client.6255 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f960fe00700 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1b781e0 0x1b30260 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78d9c3585dea854a server_cookie=2683b4b00788f5ae in_seq=0 out_seq=0 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 1 -- 172.21.15.81:0/4082312408 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1917460 con 0x1b781e0 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f95f8c00700 10 client.6255 handle_command_reply: tid=0 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.866+0000 7f9619eff740 1 client.6255 shutdown 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 msgr2=0x1b7e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b7e3b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f95fc007fd0 tx=0x7f95fc054af0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 shutdown_connections 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b786c0 0x1b31470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1b781e0 0x1b30260 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b77da0 0x1b7e3b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f95f8c00700 0 client.6255 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 --2- 172.21.15.81:0/4082312408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b77570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 >> 172.21.15.81:0/4082312408 conn(0x18c04d0 msgr2=0x1b53710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 shutdown_connections 2024-09-13T18:50:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 1 -- 172.21.15.81:0/4082312408 wait complete. 2024-09-13T18:50:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.870+0000 7f9619eff740 20 client.6255 trim_cache size 0 max 16384 2024-09-13T18:50:17.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 Processor -- start 2024-09-13T18:50:17.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 -- start start 2024-09-13T18:50:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b72a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1b718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b71e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b32c80 con 0x1b786c0 2024-09-13T18:50:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b915c0 con 0x1b56d00 2024-09-13T18:50:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ac7ec0 con 0x1b77da0 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9614c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b71e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9614c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b71e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45452/0 (socket says 172.21.15.81:45452) 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f9614c00700 1 -- 172.21.15.81:0/2717164906 learned_addr learned my addr 172.21.15.81:0/2717164906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960fe00700 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b72a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960f400700 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1b718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960fe00700 1 -- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 msgr2=0x1b718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960fe00700 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1b718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960fe00700 1 -- 172.21.15.81:0/2717164906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 msgr2=0x1b71e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960fe00700 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b71e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.890+0000 7f960fe00700 1 -- 172.21.15.81:0/2717164906 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a45450 con 0x1b56d00 2024-09-13T18:50:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f960fe00700 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b72a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x1a629e0 tx=0x7f9600032040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd14389380cea446 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9605200700 1 -- 172.21.15.81:0/2717164906 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960002b040 con 0x1b56d00 2024-09-13T18:50:17.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9605200700 1 -- 172.21.15.81:0/2717164906 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600003c70 con 0x1b56d00 2024-09-13T18:50:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9605200700 1 -- 172.21.15.81:0/2717164906 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960003d480 con 0x1b56d00 2024-09-13T18:50:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 -- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 msgr2=0x1b72a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b72a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x1a629e0 tx=0x7f9600032040 comp rx=0 tx=0).stop 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 -- 172.21.15.81:0/2717164906 shutdown_connections 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b71e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1b718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 --2- 172.21.15.81:0/2717164906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b72a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 -- 172.21.15.81:0/2717164906 >> 172.21.15.81:0/2717164906 conn(0x18c04d0 msgr2=0x1b76e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 -- 172.21.15.81:0/2717164906 shutdown_connections 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 -- 172.21.15.81:0/2717164906 wait complete. 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 -- start start 2024-09-13T18:50:17.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.894+0000 7f9619eff740 1 Processor -- start 2024-09-13T18:50:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b7d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1bc31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b30940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b32b40 con 0x1b786c0 2024-09-13T18:50:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a5b0e0 con 0x1b56d00 2024-09-13T18:50:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b74410 con 0x1b77da0 2024-09-13T18:50:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 10 client.0 _ll_register_callbacks cb 0x1aef710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b30940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b30940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45460/0 (socket says 172.21.15.81:45460) 2024-09-13T18:50:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 -- 172.21.15.81:0/2122468067 learned_addr learned my addr 172.21.15.81:0/2122468067 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f960fe00700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b7d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f960f400700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1bc31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 -- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 msgr2=0x1bc31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1bc31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 -- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 msgr2=0x1b7d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b7d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 -- 172.21.15.81:0/2122468067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x190b960 con 0x1b786c0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9614c00700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b30940 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9608018f50 tx=0x7f9608018f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4939cee5c27129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f95f8c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f95f8c00700 1 -- 172.21.15.81:0/2122468067 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e040 con 0x1b786c0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f95f8c00700 1 -- 172.21.15.81:0/2122468067 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9608018320 con 0x1b786c0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96000036c0 con 0x1b786c0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f95f8c00700 1 -- 172.21.15.81:0/2122468067 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9608016be0 con 0x1b786c0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 10 client.6261 fetch_fsmap learned FSMap version 38 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1a39720 con 0x1b786c0 2024-09-13T18:50:17.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f95f8c00700 1 -- 172.21.15.81:0/2122468067 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96000036c0 con 0x1b786c0 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f95f8c00700 1 -- 172.21.15.81:0/2122468067 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9608016d40 con 0x1b786c0 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 10 client.6261 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 10 client.6261 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 20 client.6261 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1bc45f0 0x1bc49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 4 client.6261 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:50:17.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "status"}) v1 -- 0x193c1e0 con 0x1bc45f0 2024-09-13T18:50:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.898+0000 7f960fe00700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1bc45f0 0x1bc49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f95f8c00700 10 client.6261 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f960fe00700 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1bc45f0 0x1bc49d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4eee4c0cc204db2 server_cookie=e372367bb0e8ada3 in_seq=0 out_seq=0 2024-09-13T18:50:17.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f95f8c00700 1 -- 172.21.15.81:0/2122468067 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x193c1e0 con 0x1bc45f0 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f95f8c00700 10 client.6261 handle_command_reply: tid=0 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 client.6261 shutdown 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 msgr2=0x1b30940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b30940 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9608018f50 tx=0x7f9608018f80 comp rx=0 tx=0).stop 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 shutdown_connections 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x1bc45f0 0x1bc49d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1b786c0 0x1b30940 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f95f8c00700 0 client.6261 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1b77da0 0x1bc31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 --2- 172.21.15.81:0/2122468067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1b56d00 0x1b7d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 >> 172.21.15.81:0/2122468067 conn(0x18c04d0 msgr2=0x1b30230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 shutdown_connections 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 1 -- 172.21.15.81:0/2122468067 wait complete. 2024-09-13T18:50:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9619eff740 20 client.6261 trim_cache size 0 max 16384 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6048, 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 3.2641413840000002, 2024-09-13T18:50:17.914 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 38, 2024-09-13T18:50:17.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 53, 2024-09-13T18:50:17.915 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 53, 2024-09-13T18:50:17.915 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.611006971999998 2024-09-13T18:50:17.915 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95f0066730 msgr2=0x7f95f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95f0066730 0x7f95f0068bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9600000c00 tx=0x7f9600008030 comp rx=0 tx=0).stop 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 msgr2=0x7f96101480b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 0x7f96101480b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c700 tx=0x7f95fc00ca10 comp rx=0 tx=0).stop 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 shutdown_connections 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95f0066730 0x7f95f0068bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9610159bd0 0x7f96100ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9610071870 0x7f96101480b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 --2- 172.21.15.81:0/132908277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f961006b1b0 0x7f961015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 >> 172.21.15.81:0/132908277 conn(0x7f96100b0c40 msgr2=0x7f96101584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 shutdown_connections 2024-09-13T18:50:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:17.902+0000 7f9615600700 1 -- 172.21.15.81:0/132908277 wait complete. 2024-09-13T18:50:17.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:50:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.094+0000 7fd023200700 1 Processor -- start 2024-09-13T18:50:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.094+0000 7fd023200700 1 -- start start 2024-09-13T18:50:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd023200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0240cb020 0x7fd0240cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd023200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd02406aaa0 0x7fd02406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd023200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0240b2ad0 con 0x7fd02415c2a0 2024-09-13T18:50:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd023200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02406b450 con 0x7fd02406aaa0 2024-09-13T18:50:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd023200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02415b960 con 0x7fd0240cb020 2024-09-13T18:50:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd02406aaa0 0x7fd02406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd02406aaa0 0x7fd02406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45466/0 (socket says 172.21.15.81:45466) 2024-09-13T18:50:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 -- 172.21.15.81:0/2537464506 learned_addr learned my addr 172.21.15.81:0/2537464506 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd021e00700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0240cb020 0x7fd0240cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 -- 172.21.15.81:0/2537464506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0240cb020 msgr2=0x7fd0240cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0240cb020 0x7fd0240cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 -- 172.21.15.81:0/2537464506 >> v1:172.21.15.178:6789/0 conn(0x7fd02415c2a0 legacy=0x7fd02415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 -- 172.21.15.81:0/2537464506 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02415bc40 con 0x7fd02406aaa0 2024-09-13T18:50:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd021e00700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0240cb020 0x7fd0240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd022800700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02406aaa0 0x7fd02406af10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009910 tx=0x7fd01c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04a3c6bb263dfb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd021400700 1 -- 172.21.15.81:0/2537464506 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c00ba60 con 0x7fd02406aaa0 2024-09-13T18:50:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd021400700 1 -- 172.21.15.81:0/2537464506 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c00bbc0 con 0x7fd02406aaa0 2024-09-13T18:50:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.098+0000 7fd021400700 1 -- 172.21.15.81:0/2537464506 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c009e60 con 0x7fd02406aaa0 2024-09-13T18:50:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 -- 172.21.15.81:0/2537464506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02406aaa0 msgr2=0x7fd02406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02406aaa0 0x7fd02406af10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd01c009910 tx=0x7fd01c009c20 comp rx=0 tx=0).stop 2024-09-13T18:50:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 -- 172.21.15.81:0/2537464506 shutdown_connections 2024-09-13T18:50:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02406aaa0 0x7fd02406af10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 --2- 172.21.15.81:0/2537464506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0240cb020 0x7fd0240cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 -- 172.21.15.81:0/2537464506 >> 172.21.15.81:0/2537464506 conn(0x7fd0240b0c40 msgr2=0x7fd02406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 -- 172.21.15.81:0/2537464506 shutdown_connections 2024-09-13T18:50:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 -- 172.21.15.81:0/2537464506 wait complete. 2024-09-13T18:50:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 Processor -- start 2024-09-13T18:50:18.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.102+0000 7fd023200700 1 -- start start 2024-09-13T18:50:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd02406aaa0 0x7fd02413e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0240cb020 0x7fd024140820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 0x7fd0241598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0241e3e20 con 0x7fd02415c2a0 2024-09-13T18:50:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0241e4100 con 0x7fd0240cb020 2024-09-13T18:50:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0241e43e0 con 0x7fd02406aaa0 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 0x7fd0241598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 0x7fd0241598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45482/0 (socket says 172.21.15.81:45482) 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 -- 172.21.15.81:0/2225042849 learned_addr learned my addr 172.21.15.81:0/2225042849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd019400700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0240cb020 0x7fd024140820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd021e00700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd02406aaa0 0x7fd02413e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 -- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd02406aaa0 msgr2=0x7fd02413e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd02406aaa0 0x7fd02413e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 -- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0240cb020 msgr2=0x7fd024140820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0240cb020 0x7fd024140820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 -- 172.21.15.81:0/2225042849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c009570 con 0x7fd02415c2a0 2024-09-13T18:50:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd019400700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0240cb020 0x7fd024140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd021e00700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd02406aaa0 0x7fd02413e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd022800700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 0x7fd0241598c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00c010 tx=0x7fd01c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd01aa00700 1 -- 172.21.15.81:0/2225042849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c004520 con 0x7fd02415c2a0 2024-09-13T18:50:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd01aa00700 1 -- 172.21.15.81:0/2225042849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c0036c0 con 0x7fd02415c2a0 2024-09-13T18:50:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd01aa00700 1 -- 172.21.15.81:0/2225042849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c003a70 con 0x7fd02415c2a0 2024-09-13T18:50:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.106+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0241e46c0 con 0x7fd02415c2a0 2024-09-13T18:50:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.110+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02413e7d0 con 0x7fd02415c2a0 2024-09-13T18:50:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.114+0000 7fd01aa00700 1 -- 172.21.15.81:0/2225042849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd01c021070 con 0x7fd02415c2a0 2024-09-13T18:50:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.114+0000 7fd01aa00700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd000066730 0x7fd000068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.114+0000 7fd01aa00700 1 -- 172.21.15.81:0/2225042849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd01c085950 con 0x7fd02415c2a0 2024-09-13T18:50:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.114+0000 7fd021e00700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd000066730 0x7fd000068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.114+0000 7fd021e00700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd000066730 0x7fd000068bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd01400e550 tx=0x7fd014007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.114+0000 7fd02c081740 1 Processor -- start 2024-09-13T18:50:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 -- start start 2024-09-13T18:50:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28d25610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28ced890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28ceddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28c4cd80 con 0x28d25230 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28c4a510 con 0x28d25b50 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28c45e00 con 0x28d03e90 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28d25610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28d25610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45486/0 (socket says 172.21.15.81:45486) 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 -- 172.21.15.81:0/525715192 learned_addr learned my addr 172.21.15.81:0/525715192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd019400700 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28ced890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd022800700 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28ceddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 -- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 msgr2=0x28ced890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28ced890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 -- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 msgr2=0x28ceddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28ceddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 -- 172.21.15.81:0/525715192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28ab8960 con 0x28d25230 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd021e00700 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28d25610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c8e0 tx=0x7fd014011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bab8371e3fcb0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd012600700 1 -- 172.21.15.81:0/525715192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014019710 con 0x28d25230 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd012600700 1 -- 172.21.15.81:0/525715192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014019870 con 0x28d25230 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.118+0000 7fd012600700 1 -- 172.21.15.81:0/525715192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014019be0 con 0x28d25230 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 -- 172.21.15.81:0/525715192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 msgr2=0x28d25610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28d25610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c8e0 tx=0x7fd014011000 comp rx=0 tx=0).stop 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 -- 172.21.15.81:0/525715192 shutdown_connections 2024-09-13T18:50:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28ceddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28ced890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 --2- 172.21.15.81:0/525715192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28d25610 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 -- 172.21.15.81:0/525715192 >> 172.21.15.81:0/525715192 conn(0x28a6d4d0 msgr2=0x28d06e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 -- 172.21.15.81:0/525715192 shutdown_connections 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 -- 172.21.15.81:0/525715192 wait complete. 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 -- start start 2024-09-13T18:50:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.122+0000 7fd02c081740 1 Processor -- start 2024-09-13T18:50:18.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 0x28ceff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25230 0x28cdddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28d1d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28c03730 con 0x28d03e90 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28c095b0 con 0x28d25b50 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28af1aa0 con 0x28d25230 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 10 client.0 _ll_register_callbacks cb 0x28c3f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 0x28ceff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 0x28ceff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45498/0 (socket says 172.21.15.81:45498) 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 -- 172.21.15.81:0/2648998079 learned_addr learned my addr 172.21.15.81:0/2648998079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd019400700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25230 0x28cdddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd022800700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28d1d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 -- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25230 msgr2=0x28cdddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25230 0x28cdddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 -- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 msgr2=0x28d1d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28d1d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 -- 172.21.15.81:0/2648998079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd01400c590 con 0x28d03e90 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd021e00700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 0x28ceff50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd014024040 tx=0x7fd014004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b21a95e9168bb7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd006a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd006a00700 1 -- 172.21.15.81:0/2648998079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014017670 con 0x28d03e90 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd006a00700 1 -- 172.21.15.81:0/2648998079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd0140177d0 con 0x28d03e90 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x28a7a1e0 con 0x28d03e90 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd006a00700 1 -- 172.21.15.81:0/2648998079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd014017990 con 0x28d03e90 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 10 client.6273 fetch_fsmap learned FSMap version 38 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.126+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x28c0c220 con 0x28d03e90 2024-09-13T18:50:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd006a00700 1 -- 172.21.15.81:0/2648998079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x28a7a1e0 con 0x28d03e90 2024-09-13T18:50:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd006a00700 1 -- 172.21.15.81:0/2648998079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fd014017af0 con 0x28d03e90 2024-09-13T18:50:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 10 client.6273 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:50:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 10 client.6273 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:50:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 20 client.6273 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28cdac20 0x28cdb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 4 client.6273 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28ac4460 con 0x28cdac20 2024-09-13T18:50:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd019400700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28cdac20 0x28cdb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd006a00700 10 client.6273 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd019400700 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28cdac20 0x28cdb000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc23a744a0e9771f server_cookie=801d9d38b005aaca in_seq=0 out_seq=0 2024-09-13T18:50:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd006a00700 1 -- 172.21.15.81:0/2648998079 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x28ac4460 con 0x28cdac20 2024-09-13T18:50:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd006a00700 10 client.6273 handle_command_reply: tid=0 2024-09-13T18:50:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 client.6273 shutdown 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 msgr2=0x28ceff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 0x28ceff50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd014024040 tx=0x7fd014004b60 comp rx=0 tx=0).stop 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 shutdown_connections 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28cdac20 0x28cdb000 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25b50 0x28d1d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25230 0x28cdddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd006a00700 0 client.6273 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 --2- 172.21.15.81:0/2648998079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d03e90 0x28ceff50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 >> 172.21.15.81:0/2648998079 conn(0x28a6d4d0 msgr2=0x28d1e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 shutdown_connections 2024-09-13T18:50:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.130+0000 7fd02c081740 1 -- 172.21.15.81:0/2648998079 wait complete. 2024-09-13T18:50:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.134+0000 7fd02c081740 20 client.6273 trim_cache size 0 max 16384 2024-09-13T18:50:18.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 Processor -- start 2024-09-13T18:50:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- start start 2024-09-13T18:50:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d03e90 0x28d1d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28cd9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25b50 0x28cd9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28be4470 con 0x28d25230 2024-09-13T18:50:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28c74ec0 con 0x28d03e90 2024-09-13T18:50:18.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28c0f550 con 0x28d25b50 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28cd9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28cd9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45500/0 (socket says 172.21.15.81:45500) 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 -- 172.21.15.81:0/1524720093 learned_addr learned my addr 172.21.15.81:0/1524720093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd022800700 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25b50 0x28cd9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd021e00700 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d03e90 0x28d1d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 -- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25b50 msgr2=0x28cd9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25b50 0x28cd9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 -- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d03e90 msgr2=0x28d1d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d03e90 0x28d1d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 -- 172.21.15.81:0/1524720093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28bf2450 con 0x28d25230 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd021e00700 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d03e90 0x28d1d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:18.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd019400700 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28cd9700 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd00c005380 tx=0x7fd00c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6936badb6b720a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd013000700 1 -- 172.21.15.81:0/1524720093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c003d60 con 0x28d25230 2024-09-13T18:50:18.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd013000700 1 -- 172.21.15.81:0/1524720093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00c01a4b0 con 0x28d25230 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd013000700 1 -- 172.21.15.81:0/1524720093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c01a860 con 0x28d25230 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- 172.21.15.81:0/1524720093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 msgr2=0x28cd9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28cd9700 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd00c005380 tx=0x7fd00c003c40 comp rx=0 tx=0).stop 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- 172.21.15.81:0/1524720093 shutdown_connections 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d25b50 0x28cd9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25230 0x28cd9700 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 --2- 172.21.15.81:0/1524720093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d03e90 0x28d1d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.154+0000 7fd02c081740 1 -- 172.21.15.81:0/1524720093 >> 172.21.15.81:0/1524720093 conn(0x28a6d4d0 msgr2=0x28d24290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.158+0000 7fd02c081740 1 -- 172.21.15.81:0/1524720093 shutdown_connections 2024-09-13T18:50:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.158+0000 7fd02c081740 1 -- 172.21.15.81:0/1524720093 wait complete. 2024-09-13T18:50:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.158+0000 7fd02c081740 1 -- start start 2024-09-13T18:50:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.158+0000 7fd02c081740 1 Processor -- start 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28d29a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25230 0x28d28130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25b50 0x28cdcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d1de90 con 0x28d25b50 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cde690 con 0x28d25230 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d1dbf0 con 0x28d03e90 2024-09-13T18:50:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 10 client.0 _ll_register_callbacks cb 0x28bf7ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd021e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28d29a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25b50 0x28cdcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd021e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28d29a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:51990/0 (socket says 172.21.15.81:51990) 2024-09-13T18:50:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd021e00700 1 -- 172.21.15.81:0/2803833762 learned_addr learned my addr 172.21.15.81:0/2803833762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd019400700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25230 0x28d28130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 -- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 msgr2=0x28d29a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28d29a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 -- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25230 msgr2=0x28d28130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25230 0x28d28130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 -- 172.21.15.81:0/2803833762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd00c00f040 con 0x28d25b50 2024-09-13T18:50:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd021e00700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28d29a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd022800700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25b50 0x28cdcfe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd01c083e20 tx=0x7fd01c056fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be70f22ed8b000b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd006a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd006a00700 1 -- 172.21.15.81:0/2803833762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c081070 con 0x28d25b50 2024-09-13T18:50:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd006a00700 1 -- 172.21.15.81:0/2803833762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd01c0568d0 con 0x28d25b50 2024-09-13T18:50:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd014019870 con 0x28d25b50 2024-09-13T18:50:18.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd006a00700 1 -- 172.21.15.81:0/2803833762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd01c05a700 con 0x28d25b50 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 10 client.6279 fetch_fsmap learned FSMap version 38 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x28be6720 con 0x28d25b50 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd006a00700 1 -- 172.21.15.81:0/2803833762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014019870 con 0x28d25b50 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd006a00700 1 -- 172.21.15.81:0/2803833762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 38) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fd01c056b30 con 0x28d25b50 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 10 client.6279 fetch_fsmap finished waiting for FSMap version 38 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 10 client.6279 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 20 client.6279 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28d2a210 0x28d2a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 4 client.6279 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.162+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x28ae91e0 con 0x28d2a210 2024-09-13T18:50:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd021e00700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28d2a210 0x28d2a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd021e00700 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28d2a210 0x28d2a5f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f454b558794c81d7 server_cookie=4570a51f370fe5c9 in_seq=0 out_seq=0 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd006a00700 10 client.6279 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd006a00700 1 -- 172.21.15.81:0/2803833762 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x28ae91e0 con 0x28d2a210 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd006a00700 10 client.6279 handle_command_reply: tid=0 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 client.6279 shutdown 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25b50 msgr2=0x28cdcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25b50 0x28cdcfe0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fd01c083e20 tx=0x7fd01c056fd0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 shutdown_connections 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x28d2a210 0x28d2a5f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x28d25b50 0x28cdcfe0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d25230 0x28d28130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 --2- 172.21.15.81:0/2803833762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d03e90 0x28d29a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd006a00700 0 client.6279 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 >> 172.21.15.81:0/2803833762 conn(0x28a6d4d0 msgr2=0x28cd9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 shutdown_connections 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 1 -- 172.21.15.81:0/2803833762 wait complete. 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd02c081740 20 client.6279 trim_cache size 0 max 16384 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6051, 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:50:18.178 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 12.589725325, 2024-09-13T18:50:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 38, 2024-09-13T18:50:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 53, 2024-09-13T18:50:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 53, 2024-09-13T18:50:18.179 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.872226821000002 2024-09-13T18:50:18.179 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd000066730 msgr2=0x7fd000068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd000066730 0x7fd000068bf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd01400e550 tx=0x7fd014007ab0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 msgr2=0x7fd0241598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 0x7fd0241598c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00c010 tx=0x7fd01c004770 comp rx=0 tx=0).stop 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 shutdown_connections 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd000066730 0x7fd000068bf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd02415c2a0 0x7fd0241598c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0240cb020 0x7fd024140820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 --2- 172.21.15.81:0/2225042849 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd02406aaa0 0x7fd02413e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 >> 172.21.15.81:0/2225042849 conn(0x7fd0240b0c40 msgr2=0x7fd02415da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 shutdown_connections 2024-09-13T18:50:18.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.166+0000 7fd023200700 1 -- 172.21.15.81:0/2225042849 wait complete. 2024-09-13T18:50:18.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:18.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.358+0000 7f5b2be00700 1 Processor -- start 2024-09-13T18:50:18.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.358+0000 7f5b2be00700 1 -- start start 2024-09-13T18:50:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2be00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b2c0cb020 0x7f5b2c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c0b2ad0 con 0x7f5b2c15c2a0 2024-09-13T18:50:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2c15b960 con 0x7f5b2c06aaa0 2024-09-13T18:50:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2be00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2c15bc40 con 0x7f5b2c0cb020 2024-09-13T18:50:18.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2a000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5b2c15c2a0 0x7f5b2c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52014/0 (socket says 172.21.15.81:52014) 2024-09-13T18:50:18.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2a000700 1 -- 172.21.15.81:0/3073149313 learned_addr learned my addr 172.21.15.81:0/3073149313 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182591571 0 0) 0x7f5b2c0b2ad0 con 0x7f5b2c15c2a0 2024-09-13T18:50:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/3073149313 >> v2:172.21.15.178:3300/0 conn(0x7f5b2c0cb020 0x7f5b2c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b100035d0 con 0x7f5b2c15c2a0 2024-09-13T18:50:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3571645104 0 0) 0x7f5b100035d0 con 0x7f5b2c15c2a0 2024-09-13T18:50:18.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 >> v2:172.21.15.178:3300/0 conn(0x7f5b2c0cb020 msgr2=0x7f5b2c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 --2- 172.21.15.81:0/3073149313 >> v2:172.21.15.178:3300/0 conn(0x7f5b2c0cb020 0x7f5b2c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 >> v1:172.21.15.178:6789/0 conn(0x7f5b2c06aaa0 legacy=0x7f5b2c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c15bf20 con 0x7f5b2c15c2a0 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f5b18001670 con 0x7f5b2c15c2a0 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 >> v1:172.21.15.81:6789/0 conn(0x7f5b2c15c2a0 legacy=0x7f5b2c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b10004870 0x7f5b10004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b10005280 0x7f5b1000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c15bc40 con 0x7f5b10003a90 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1000c1b0 con 0x7f5b10004870 2024-09-13T18:50:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1000c370 con 0x7f5b10005280 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.362+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2a000700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b10004870 0x7f5b10004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2b400700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b10005280 0x7f5b1000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b10005280 msgr2=0x7f5b1000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b10005280 0x7f5b1000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b10004870 msgr2=0x7f5b10004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b10004870 0x7f5b10004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3073149313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100035d0 con 0x7f5b10003a90 2024-09-13T18:50:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2a000700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b10004870 0x7f5b10004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2b400700 1 -- 172.21.15.81:0/3073149313 reap_dead start 2024-09-13T18:50:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b10003e70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009880 tx=0x7f5b100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faeab60022feb129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00c070 con 0x7f5b10003a90 2024-09-13T18:50:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c013610 con 0x7f5b10003a90 2024-09-13T18:50:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b29600700 1 -- 172.21.15.81:0/3073149313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c0139c0 con 0x7f5b10003a90 2024-09-13T18:50:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 -- 172.21.15.81:0/3073149313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 msgr2=0x7f5b10003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b10003e70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c009880 tx=0x7f5b100058a0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 -- 172.21.15.81:0/3073149313 shutdown_connections 2024-09-13T18:50:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 --2- 172.21.15.81:0/3073149313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b10003e70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 -- 172.21.15.81:0/3073149313 >> 172.21.15.81:0/3073149313 conn(0x7f5b2c0b0c40 msgr2=0x7f5b2c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 -- 172.21.15.81:0/3073149313 shutdown_connections 2024-09-13T18:50:18.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.366+0000 7f5b2be00700 1 -- 172.21.15.81:0/3073149313 wait complete. 2024-09-13T18:50:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 Processor -- start 2024-09-13T18:50:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 -- start start 2024-09-13T18:50:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b2c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b2c157370 0x7f5b2c06cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b2c13f190 0x7f5b2c13f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c13fb50 con 0x7f5b10003a90 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c38f0 con 0x7f5b2c13f190 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2c0c3bd0 con 0x7f5b2c157370 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b2c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b2c0c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45524/0 (socket says 172.21.15.81:45524) 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 -- 172.21.15.81:0/1054739753 learned_addr learned my addr 172.21.15.81:0/1054739753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2a000700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b2c157370 0x7f5b2c06cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2b400700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b2c13f190 0x7f5b2c13f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 -- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b2c157370 msgr2=0x7f5b2c06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b2c157370 0x7f5b2c06cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 -- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b2c13f190 msgr2=0x7f5b2c13f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b2c13f190 0x7f5b2c13f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.370+0000 7f5b2aa00700 1 -- 172.21.15.81:0/1054739753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0c3eb0 con 0x7f5b10003a90 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b2aa00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b2c0c61a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c000c00 tx=0x7f5b1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c013410 con 0x7f5b10003a90 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c01c630 con 0x7f5b10003a90 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c01c9e0 con 0x7f5b10003a90 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2c0c4190 con 0x7f5b10003a90 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2c0c4750 con 0x7f5b10003a90 2024-09-13T18:50:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.374+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2c0c4940 con 0x7f5b10003a90 2024-09-13T18:50:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.378+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b1c01cb40 con 0x7f5b10003a90 2024-09-13T18:50:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.378+0000 7f5b22a00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b0c066780 0x7f5b0c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.378+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b1c084e50 con 0x7f5b10003a90 2024-09-13T18:50:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.378+0000 7f5b2a000700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b0c066780 0x7f5b0c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.378+0000 7f5b2a000700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b0c066780 0x7f5b0c068c40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ca620 tx=0x7f5b18008f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.382+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b1c0521f0 con 0x7f5b10003a90 2024-09-13T18:50:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.610+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b2c0cca80 con 0x7f5b10003a90 2024-09-13T18:50:18.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.614+0000 7f5b22a00700 1 -- 172.21.15.81:0/1054739753 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4762 (secure 0 0 0) 0x7f5b1c055810 con 0x7f5b10003a90 2024-09-13T18:50:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:18.623 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:16.663943+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.614+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b0c066780 msgr2=0x7f5b0c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.614+0000 7f5b2be00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b0c066780 0x7f5b0c068c40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0ca620 tx=0x7f5b18008f50 comp rx=0 tx=0).stop 2024-09-13T18:50:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.614+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 msgr2=0x7f5b2c0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.614+0000 7f5b2be00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b2c0c61a0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c000c00 tx=0x7f5b1c004770 comp rx=0 tx=0).stop 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 shutdown_connections 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b0c066780 0x7f5b0c068c40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b2c13f190 0x7f5b2c13f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b2c157370 0x7f5b2c06cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 --2- 172.21.15.81:0/1054739753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b10003a90 0x7f5b2c0c61a0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 >> 172.21.15.81:0/1054739753 conn(0x7f5b2c0b0c40 msgr2=0x7f5b2c0cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 shutdown_connections 2024-09-13T18:50:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:18.618+0000 7f5b2be00700 1 -- 172.21.15.81:0/1054739753 wait complete. 2024-09-13T18:50:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 38 2024-09-13T18:50:18.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:18.646 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:50:18.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:18.678 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:50:18.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:18.753 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-13T18:50:18.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:18.817 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-13T18:50:18.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:18.882 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-13T18:50:18.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:50:19.163 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:50:19.164 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:50:19.164 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:50:21.035 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:50:21.026+0000 7f13f2400700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:50:21.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:50:21.342 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:50:21.342 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:50:21.342 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:50:23.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:50:23.530 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:50:23.530 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:50:23.531 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:50:25.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:50:25.724 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-13T18:50:25.725 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:50:25.725 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:50:27.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:50:27.908 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-13T18:50:27.909 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:50:27.909 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:50:27.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:50:28.086 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:50:28.087 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:50:28.087 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:50:30.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:50:30.279 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:50:30.280 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:50:30.280 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:50:32.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:50:32.468 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:50:32.469 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:50:32.469 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:50:32.469 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:50:32.661 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:50:32.662 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:50:32.662 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:50:32.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-09-13T18:50:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.838+0000 7f5b4f200700 1 Processor -- start 2024-09-13T18:50:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.838+0000 7f5b4f200700 1 -- start start 2024-09-13T18:50:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b480b20a0 0x7f5b48164400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4f200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4815a020 con 0x7f5b48159660 2024-09-13T18:50:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4f200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4815a300 con 0x7f5b48159a40 2024-09-13T18:50:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815a5e0 con 0x7f5b480b20a0 2024-09-13T18:50:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4de00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5b48159660 0x7f5b480b3c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35302/0 (socket says 172.21.15.81:35302) 2024-09-13T18:50:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4de00700 1 -- 172.21.15.81:0/2551505257 learned_addr learned my addr 172.21.15.81:0/2551505257 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4e800700 1 --2- 172.21.15.81:0/2551505257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b480b20a0 0x7f5b48164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806695760 0 0) 0x7f5b4815a020 con 0x7f5b48159660 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b300035d0 con 0x7f5b48159660 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189828000 0 0) 0x7f5b4815a300 con 0x7f5b48159a40 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b4815a020 con 0x7f5b48159a40 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4e800700 1 -- 172.21.15.81:0/2551505257 >> v1:172.21.15.178:6789/0 conn(0x7f5b48159a40 legacy=0x7f5b480b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4e800700 1 -- 172.21.15.81:0/2551505257 >> v1:172.21.15.81:6789/0 conn(0x7f5b48159660 legacy=0x7f5b480b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.842+0000 7f5b4e800700 1 -- 172.21.15.81:0/2551505257 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4815a8c0 con 0x7f5b480b20a0 2024-09-13T18:50:32.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4e800700 1 --2- 172.21.15.81:0/2551505257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b480b20a0 0x7f5b48164400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009dc0 tx=0x7f5b4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681b4e5a90fea8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4400e070 con 0x7f5b480b20a0 2024-09-13T18:50:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4400bb20 con 0x7f5b480b20a0 2024-09-13T18:50:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4ca00700 1 -- 172.21.15.81:0/2551505257 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44012430 con 0x7f5b480b20a0 2024-09-13T18:50:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 -- 172.21.15.81:0/2551505257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b480b20a0 msgr2=0x7f5b48164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 --2- 172.21.15.81:0/2551505257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b480b20a0 0x7f5b48164400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009dc0 tx=0x7f5b4400b330 comp rx=0 tx=0).stop 2024-09-13T18:50:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 -- 172.21.15.81:0/2551505257 shutdown_connections 2024-09-13T18:50:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 --2- 172.21.15.81:0/2551505257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b480b20a0 0x7f5b48164400 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 -- 172.21.15.81:0/2551505257 >> 172.21.15.81:0/2551505257 conn(0x7f5b4806cb90 msgr2=0x7f5b4806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 -- 172.21.15.81:0/2551505257 shutdown_connections 2024-09-13T18:50:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.846+0000 7f5b4f200700 1 -- 172.21.15.81:0/2551505257 wait complete. 2024-09-13T18:50:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 Processor -- start 2024-09-13T18:50:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 -- start start 2024-09-13T18:50:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 0x7f5b480afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b48159660 0x7f5b48071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b48159a40 0x7f5b4814e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815aeb0 con 0x7f5b480b20a0 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815b100 con 0x7f5b48159660 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815b3e0 con 0x7f5b48159a40 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 0x7f5b480afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 0x7f5b480afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56230/0 (socket says 172.21.15.81:56230) 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 -- 172.21.15.81:0/3191477495 learned_addr learned my addr 172.21.15.81:0/3191477495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4d400700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b48159660 0x7f5b48071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4e800700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b48159a40 0x7f5b4814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 -- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b48159a40 msgr2=0x7f5b4814e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b48159a40 0x7f5b4814e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 -- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b48159660 msgr2=0x7f5b48071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b48159660 0x7f5b48071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.850+0000 7f5b4de00700 1 -- 172.21.15.81:0/3191477495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44009a70 con 0x7f5b480b20a0 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.854+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 0x7f5b480afe50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c700 tx=0x7f5b3c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.854+0000 7f5b42000700 1 -- 172.21.15.81:0/3191477495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c005d90 con 0x7f5b480b20a0 2024-09-13T18:50:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.854+0000 7f5b42000700 1 -- 172.21.15.81:0/3191477495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c0070d0 con 0x7f5b480b20a0 2024-09-13T18:50:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.854+0000 7f5b42000700 1 -- 172.21.15.81:0/3191477495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c007480 con 0x7f5b480b20a0 2024-09-13T18:50:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.854+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4815b6c0 con 0x7f5b480b20a0 2024-09-13T18:50:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.854+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4815bc80 con 0x7f5b480b20a0 2024-09-13T18:50:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b42000700 1 -- 172.21.15.81:0/3191477495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b3c0075e0 con 0x7f5b480b20a0 2024-09-13T18:50:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b42000700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b2c066730 0x7f5b2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b42000700 1 -- 172.21.15.81:0/3191477495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b3c083860 con 0x7f5b480b20a0 2024-09-13T18:50:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b4d400700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b2c066730 0x7f5b2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 Processor -- start 2024-09-13T18:50:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 -- start start 2024-09-13T18:50:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b4d400700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b2c066730 0x7f5b2c068bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5b48071ea0 tx=0x7f5b38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb7cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb7f4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb816550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb75d010 con 0xb815d90 2024-09-13T18:50:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb6eaf40 con 0xb7cb310 2024-09-13T18:50:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.858+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb73de30 con 0xb816170 2024-09-13T18:50:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb7cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb7cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56236/0 (socket says 172.21.15.81:56236) 2024-09-13T18:50:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 -- 172.21.15.81:0/123802733 learned_addr learned my addr 172.21.15.81:0/123802733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4d400700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb7f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4e800700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb816550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 -- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 msgr2=0xb816550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb816550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 -- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 msgr2=0xb7f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb7f4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 -- 172.21.15.81:0/123802733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb5a9a40 con 0xb815d90 2024-09-13T18:50:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4d400700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb7f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4e800700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb816550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b4de00700 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb7cc810 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c054650 tx=0x7f5b3c0545c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f4d52a8dddc7b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b36600700 1 -- 172.21.15.81:0/123802733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0546c0 con 0xb815d90 2024-09-13T18:50:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b36600700 1 -- 172.21.15.81:0/123802733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c0584f0 con 0xb815d90 2024-09-13T18:50:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b36600700 1 -- 172.21.15.81:0/123802733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c05cab0 con 0xb815d90 2024-09-13T18:50:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 -- 172.21.15.81:0/123802733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 msgr2=0xb7cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb7cc810 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c054650 tx=0x7f5b3c0545c0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 -- 172.21.15.81:0/123802733 shutdown_connections 2024-09-13T18:50:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb816550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb7f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 --2- 172.21.15.81:0/123802733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb7cc810 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 -- 172.21.15.81:0/123802733 >> 172.21.15.81:0/123802733 conn(0xb55e5b0 msgr2=0xb7cfb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 -- 172.21.15.81:0/123802733 shutdown_connections 2024-09-13T18:50:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 -- 172.21.15.81:0/123802733 wait complete. 2024-09-13T18:50:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 -- start start 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.862+0000 7f5b53afc740 1 Processor -- start 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb7f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb81f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb81fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb739150 con 0xb7cb310 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb736eb0 con 0xb815d90 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb6f48e0 con 0xb816170 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 10 client.0 _ll_register_callbacks cb 0xb6d3670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb7f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb7f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56240/0 (socket says 172.21.15.81:56240) 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 -- 172.21.15.81:0/861221374 learned_addr learned my addr 172.21.15.81:0/861221374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4d400700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb81f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4e800700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb81fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 -- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 msgr2=0xb81fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb81fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 -- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 msgr2=0xb81f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb81f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 -- 172.21.15.81:0/861221374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4815bc80 con 0xb7cb310 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4e800700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb81fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b4de00700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb7f2e50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c050bc0 tx=0x7f5b3c001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3456e87f9a192c57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b2aa00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b2aa00700 1 -- 172.21.15.81:0/861221374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c053db0 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b2aa00700 1 -- 172.21.15.81:0/861221374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b3c05cab0 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb56b2c0 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b2aa00700 1 -- 172.21.15.81:0/861221374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b3c05c620 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 10 client.6297 fetch_fsmap learned FSMap version 40 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0xb6fd290 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b2aa00700 1 -- 172.21.15.81:0/861221374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb56b2c0 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b2aa00700 1 -- 172.21.15.81:0/861221374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f5b3c07bb40 con 0xb7cb310 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 10 client.6297 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 10 client.6297 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 20 client.6297 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb7efab0 0xb828c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 4 client.6297 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.866+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb5b5540 con 0xb7efab0 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b4d400700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb7efab0 0xb828c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b4d400700 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb7efab0 0xb828c10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cff6c04f61da16 server_cookie=2a7d45a1e2d8b5b6 in_seq=0 out_seq=0 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b2aa00700 10 client.6297 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b2aa00700 1 -- 172.21.15.81:0/861221374 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xb5b5540 con 0xb7efab0 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b2aa00700 10 client.6297 handle_command_reply: tid=0 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 client.6297 shutdown 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 msgr2=0xb7f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb7f2e50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c050bc0 tx=0x7f5b3c001150 comp rx=0 tx=0).stop 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 shutdown_connections 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb7efab0 0xb828c10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb816170 0xb81fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb81f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 --2- 172.21.15.81:0/861221374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb7f2e50 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b2aa00700 0 client.6297 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 >> 172.21.15.81:0/861221374 conn(0xb55e5b0 msgr2=0xb7f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 shutdown_connections 2024-09-13T18:50:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 1 -- 172.21.15.81:0/861221374 wait complete. 2024-09-13T18:50:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.870+0000 7f5b53afc740 20 client.6297 trim_cache size 0 max 16384 2024-09-13T18:50:32.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.886+0000 7f5b53afc740 1 Processor -- start 2024-09-13T18:50:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.886+0000 7f5b53afc740 1 -- start start 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.886+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb82d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb82d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb817700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb5e2b80 con 0xb7cb310 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb7346c0 con 0xb815d90 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb6c0a50 con 0xb55e5b0 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb82d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb82d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56248/0 (socket says 172.21.15.81:56248) 2024-09-13T18:50:32.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 -- 172.21.15.81:0/1059314950 learned_addr learned my addr 172.21.15.81:0/1059314950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:32.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4de00700 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb82d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4e800700 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb817700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 -- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 msgr2=0xb82d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb82d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 -- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 msgr2=0xb817700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb817700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 -- 172.21.15.81:0/1059314950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb6e34c0 con 0xb7cb310 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4de00700 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb82d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b4d400700 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb82d560 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5b380011e0 tx=0x7f5b38012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b9bbe8b2d998d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b37000700 1 -- 172.21.15.81:0/1059314950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800fc40 con 0xb7cb310 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b37000700 1 -- 172.21.15.81:0/1059314950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b38026e90 con 0xb7cb310 2024-09-13T18:50:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b37000700 1 -- 172.21.15.81:0/1059314950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3800fdc0 con 0xb7cb310 2024-09-13T18:50:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- 172.21.15.81:0/1059314950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 msgr2=0xb82d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb82d560 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5b380011e0 tx=0x7f5b38012000 comp rx=0 tx=0).stop 2024-09-13T18:50:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- 172.21.15.81:0/1059314950 shutdown_connections 2024-09-13T18:50:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb815d90 0xb817700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb7cb310 0xb82d560 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 --2- 172.21.15.81:0/1059314950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb82d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- 172.21.15.81:0/1059314950 >> 172.21.15.81:0/1059314950 conn(0xb8155d0 msgr2=0xb82c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- 172.21.15.81:0/1059314950 shutdown_connections 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.890+0000 7f5b53afc740 1 -- 172.21.15.81:0/1059314950 wait complete. 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 -- start start 2024-09-13T18:50:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 Processor -- start 2024-09-13T18:50:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb81a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb876450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb876990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xb707c00 con 0xb815d90 2024-09-13T18:50:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb834ef0 con 0xb7cb310 2024-09-13T18:50:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xb877130 con 0xb55e5b0 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 10 client.0 _ll_register_callbacks cb 0xb735610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb876990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb876990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56258/0 (socket says 172.21.15.81:56258) 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 -- 172.21.15.81:0/3793928615 learned_addr learned my addr 172.21.15.81:0/3793928615 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4d400700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb876450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 -- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 msgr2=0xb81a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb81a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb81a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 -- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 msgr2=0xb876450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb876450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 -- 172.21.15.81:0/3793928615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b38019040 con 0xb815d90 2024-09-13T18:50:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4d400700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb876450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb81a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b4e800700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb876990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5b44013000 tx=0x7f5b44004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f09f702324926b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b2aa00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3793928615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44012430 con 0xb815d90 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b3c0584f0 con 0xb815d90 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3793928615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b44020040 con 0xb815d90 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3793928615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b440098f0 con 0xb815d90 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 10 client.6303 fetch_fsmap learned FSMap version 40 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.894+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0xb6d7790 con 0xb815d90 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3793928615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c0584f0 con 0xb815d90 2024-09-13T18:50:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3793928615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f5b4402d060 con 0xb815d90 2024-09-13T18:50:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b53afc740 10 client.6303 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:50:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b53afc740 10 client.6303 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b53afc740 20 client.6303 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:32.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b53afc740 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb816170 0xb832690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:32.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b53afc740 4 client.6303 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:50:32.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0xb5da2c0 con 0xb816170 2024-09-13T18:50:32.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb816170 0xb832690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:32.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b4de00700 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb816170 0xb832690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d4934364ce357b9 server_cookie=769977dbd0b3fb7e in_seq=0 out_seq=0 2024-09-13T18:50:32.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.898+0000 7f5b2aa00700 10 client.6303 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:32.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b2aa00700 1 -- 172.21.15.81:0/3793928615 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0xb5da2c0 con 0xb816170 2024-09-13T18:50:32.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b2aa00700 10 client.6303 handle_command_reply: tid=0 2024-09-13T18:50:32.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 client.6303 shutdown 2024-09-13T18:50:32.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 msgr2=0xb876990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb876990 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5b44013000 tx=0x7f5b44004b60 comp rx=0 tx=0).stop 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 shutdown_connections 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0xb816170 0xb832690 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xb815d90 0xb876990 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xb7cb310 0xb876450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 --2- 172.21.15.81:0/3793928615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xb55e5b0 0xb81a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b2aa00700 0 client.6303 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 >> 172.21.15.81:0/3793928615 conn(0xb8155d0 msgr2=0xb7ec620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 shutdown_connections 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 1 -- 172.21.15.81:0/3793928615 wait complete. 2024-09-13T18:50:32.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b53afc740 20 client.6303 trim_cache size 0 max 16384 2024-09-13T18:50:32.929 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:50:32.929 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:50:32.929 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b2c066730 msgr2=0x7f5b2c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b2c066730 0x7f5b2c068bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5b48071ea0 tx=0x7f5b38009040 comp rx=0 tx=0).stop 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 msgr2=0x7f5b480afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 0x7f5b480afe50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00c700 tx=0x7f5b3c00ca10 comp rx=0 tx=0).stop 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 shutdown_connections 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b2c066730 0x7f5b2c068bf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b48159a40 0x7f5b4814e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b48159660 0x7f5b48071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 --2- 172.21.15.81:0/3191477495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b480b20a0 0x7f5b480afe50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:32.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 >> 172.21.15.81:0/3191477495 conn(0x7f5b4806cb90 msgr2=0x7f5b48068160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:32.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 shutdown_connections 2024-09-13T18:50:32.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:32.918+0000 7f5b4f200700 1 -- 172.21.15.81:0/3191477495 wait complete. 2024-09-13T18:50:32.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 flush journal 2024-09-13T18:50:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.114+0000 7f4d15400700 1 Processor -- start 2024-09-13T18:50:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.114+0000 7f4d15400700 1 -- start start 2024-09-13T18:50:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d15400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d10143b70 0x7f4d100cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d15400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100b1980 con 0x7f4d1006d070 2024-09-13T18:50:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d15400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100b2500 con 0x7f4d1006d620 2024-09-13T18:50:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d15400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d100b1bd0 con 0x7f4d10143b70 2024-09-13T18:50:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d0fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d10143b70 0x7f4d100cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d14a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4d1006d070 0x7f4d100b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35312/0 (socket says 172.21.15.81:35312) 2024-09-13T18:50:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d14a00700 1 -- 172.21.15.81:0/3289767550 learned_addr learned my addr 172.21.15.81:0/3289767550 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d0fe00700 1 -- 172.21.15.81:0/3289767550 >> v1:172.21.15.178:6789/0 conn(0x7f4d1006d620 legacy=0x7f4d1006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d0fe00700 1 -- 172.21.15.81:0/3289767550 >> v1:172.21.15.81:6789/0 conn(0x7f4d1006d070 legacy=0x7f4d100b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d0fe00700 1 -- 172.21.15.81:0/3289767550 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100b1eb0 con 0x7f4d10143b70 2024-09-13T18:50:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.118+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/3289767550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d10143b70 0x7f4d100cde20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009850 tx=0x7f4d00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cb1276652b7f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d0ea00700 1 -- 172.21.15.81:0/3289767550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00011830 con 0x7f4d10143b70 2024-09-13T18:50:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d0ea00700 1 -- 172.21.15.81:0/3289767550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00011990 con 0x7f4d10143b70 2024-09-13T18:50:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d0ea00700 1 -- 172.21.15.81:0/3289767550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00011d20 con 0x7f4d10143b70 2024-09-13T18:50:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 -- 172.21.15.81:0/3289767550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d10143b70 msgr2=0x7f4d100cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 --2- 172.21.15.81:0/3289767550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d10143b70 0x7f4d100cde20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009850 tx=0x7f4d00009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 -- 172.21.15.81:0/3289767550 shutdown_connections 2024-09-13T18:50:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 --2- 172.21.15.81:0/3289767550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d10143b70 0x7f4d100cde20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 -- 172.21.15.81:0/3289767550 >> 172.21.15.81:0/3289767550 conn(0x7f4d1006a390 msgr2=0x7f4d1006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 -- 172.21.15.81:0/3289767550 shutdown_connections 2024-09-13T18:50:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.122+0000 7f4d15400700 1 -- 172.21.15.81:0/3289767550 wait complete. 2024-09-13T18:50:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 Processor -- start 2024-09-13T18:50:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 -- start start 2024-09-13T18:50:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 0x7f4d1013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1006d620 0x7f4d10154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d10143b70 0x7f4d10154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d10071500 con 0x7f4d1006d070 2024-09-13T18:50:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1015afa0 con 0x7f4d1006d620 2024-09-13T18:50:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d15400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1015b280 con 0x7f4d10143b70 2024-09-13T18:50:33.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d0fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 0x7f4d1013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d0fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 0x7f4d1013f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56266/0 (socket says 172.21.15.81:56266) 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d0fe00700 1 -- 172.21.15.81:0/494855935 learned_addr learned my addr 172.21.15.81:0/494855935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d14a00700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d10143b70 0x7f4d10154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d0f400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1006d620 0x7f4d10154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d0fe00700 1 -- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d10143b70 msgr2=0x7f4d10154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.126+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d10143b70 0x7f4d10154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d0fe00700 1 -- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1006d620 msgr2=0x7f4d10154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1006d620 0x7f4d10154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d0fe00700 1 -- 172.21.15.81:0/494855935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000094b0 con 0x7f4d1006d070 2024-09-13T18:50:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d14a00700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d10143b70 0x7f4d10154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 0x7f4d1013f230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009fd0 tx=0x7f4d00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d07e00700 1 -- 172.21.15.81:0/494855935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000038c0 con 0x7f4d1006d070 2024-09-13T18:50:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d07e00700 1 -- 172.21.15.81:0/494855935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0001e070 con 0x7f4d1006d070 2024-09-13T18:50:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1015b560 con 0x7f4d1006d070 2024-09-13T18:50:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d07e00700 1 -- 172.21.15.81:0/494855935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00003c80 con 0x7f4d1006d070 2024-09-13T18:50:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.130+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1013f770 con 0x7f4d1006d070 2024-09-13T18:50:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.134+0000 7f4d07e00700 1 -- 172.21.15.81:0/494855935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d0001a420 con 0x7f4d1006d070 2024-09-13T18:50:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.134+0000 7f4d07e00700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4cf0066730 0x7f4cf0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.134+0000 7f4d07e00700 1 -- 172.21.15.81:0/494855935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d00020070 con 0x7f4d1006d070 2024-09-13T18:50:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.134+0000 7f4d0f400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4cf0066730 0x7f4cf0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.134+0000 7f4d0f400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4cf0066730 0x7f4cf0068bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4d10071e80 tx=0x7f4cfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 Processor -- start 2024-09-13T18:50:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 -- start start 2024-09-13T18:50:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe1a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe42520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe64550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbdab010 con 0xbe63d90 2024-09-13T18:50:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbd38f40 con 0xbe19310 2024-09-13T18:50:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbd8be30 con 0xbe64170 2024-09-13T18:50:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe1a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe1a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56272/0 (socket says 172.21.15.81:56272) 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1533080383 learned_addr learned my addr 172.21.15.81:0/1533080383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d14a00700 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe64550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0f400700 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe42520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 msgr2=0xbe64550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe64550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 msgr2=0xbe42520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe42520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1533080383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xbbf7a40 con 0xbe63d90 2024-09-13T18:50:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe1a810 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4d00056600 tx=0x7f4d00009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95a453fa58a3dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4cfbe00700 1 -- 172.21.15.81:0/1533080383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00056900 con 0xbe63d90 2024-09-13T18:50:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4cfbe00700 1 -- 172.21.15.81:0/1533080383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0005a730 con 0xbe63d90 2024-09-13T18:50:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.138+0000 7f4cfbe00700 1 -- 172.21.15.81:0/1533080383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0005ecf0 con 0xbe63d90 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1533080383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 msgr2=0xbe1a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe1a810 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4d00056600 tx=0x7f4d00009240 comp rx=0 tx=0).stop 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1533080383 shutdown_connections 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe64550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe42520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1533080383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe1a810 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1533080383 >> 172.21.15.81:0/1533080383 conn(0xbbac5b0 msgr2=0xbe1db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1533080383 shutdown_connections 2024-09-13T18:50:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1533080383 wait complete. 2024-09-13T18:50:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- start start 2024-09-13T18:50:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 Processor -- start 2024-09-13T18:50:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe62300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe65f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe40900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbd87150 con 0xbe63d90 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbd84eb0 con 0xbe19310 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbd428e0 con 0xbe64170 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d19ebc740 10 client.0 _ll_register_callbacks cb 0xbd21670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d0f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe65f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d0f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe65f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56278/0 (socket says 172.21.15.81:56278) 2024-09-13T18:50:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d0f400700 1 -- 172.21.15.81:0/2033993526 learned_addr learned my addr 172.21.15.81:0/2033993526 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.142+0000 7f4d14a00700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe40900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe62300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0f400700 1 -- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 msgr2=0xbe40900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0f400700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe40900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0f400700 1 -- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 msgr2=0xbe62300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0f400700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe62300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0f400700 1 -- 172.21.15.81:0/2033993526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1013f770 con 0xbe63d90 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe62300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0f400700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe65f70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc003980 tx=0x7f4cfc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2586521a95013e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 1 -- 172.21.15.81:0/2033993526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc005540 con 0xbe63d90 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 1 -- 172.21.15.81:0/2033993526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4cfc015110 con 0xbe63d90 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xbbb92c0 con 0xbe63d90 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 1 -- 172.21.15.81:0/2033993526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4cfc0152d0 con 0xbe63d90 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 10 client.6318 fetch_fsmap learned FSMap version 40 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0xbd4b290 con 0xbe63d90 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 1 -- 172.21.15.81:0/2033993526 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xbbb92c0 con 0xbe63d90 2024-09-13T18:50:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 1 -- 172.21.15.81:0/2033993526 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f4cfc0158d0 con 0xbe63d90 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 10 client.6318 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 10 client.6318 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 20 client.6318 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe664b0 0xbe64550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 4 client.6318 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xbc03540 con 0xbe664b0 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe664b0 0xbe64550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe664b0 0xbe64550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=474547e80dd3d0c4 server_cookie=a10955afd38e459a in_seq=0 out_seq=0 2024-09-13T18:50:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.146+0000 7f4cf8c00700 10 client.6318 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4cf8c00700 1 -- 172.21.15.81:0/2033993526 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xbc03540 con 0xbe664b0 2024-09-13T18:50:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4cf8c00700 10 client.6318 handle_command_reply: tid=0 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 client.6318 shutdown 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 msgr2=0xbe65f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe65f70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc003980 tx=0x7f4cfc000ed0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 shutdown_connections 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe64170 0xbe40900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe664b0 0xbe64550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe65f70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/2033993526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe62300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 >> 172.21.15.81:0/2033993526 conn(0xbbac5b0 msgr2=0xbe424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4cf8c00700 0 client.6318 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 shutdown_connections 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 1 -- 172.21.15.81:0/2033993526 wait complete. 2024-09-13T18:50:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.150+0000 7f4d19ebc740 20 client.6318 trim_cache size 0 max 16384 2024-09-13T18:50:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 Processor -- start 2024-09-13T18:50:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 -- start start 2024-09-13T18:50:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbbac5b0 0xbe3e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe3f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe3f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbc30b80 con 0xbe63d90 2024-09-13T18:50:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbd2a230 con 0xbe19310 2024-09-13T18:50:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.166+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbd89f30 con 0xbbac5b0 2024-09-13T18:50:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe3f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56292/0 (socket says 172.21.15.81:56292) 2024-09-13T18:50:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 -- 172.21.15.81:0/572528681 learned_addr learned my addr 172.21.15.81:0/572528681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbbac5b0 0xbe3e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d0f400700 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe3f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 -- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbbac5b0 msgr2=0xbe3e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbbac5b0 0xbe3e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 -- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 msgr2=0xbe3f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe3f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 -- 172.21.15.81:0/572528681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xbe19c60 con 0xbe63d90 2024-09-13T18:50:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d14a00700 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe3f700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4d08002140 tx=0x7f4d08002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9295a058f089764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d05200700 1 -- 172.21.15.81:0/572528681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080075e0 con 0xbe63d90 2024-09-13T18:50:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d05200700 1 -- 172.21.15.81:0/572528681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d08007740 con 0xbe63d90 2024-09-13T18:50:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d05200700 1 -- 172.21.15.81:0/572528681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08007ab0 con 0xbe63d90 2024-09-13T18:50:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d19ebc740 1 -- 172.21.15.81:0/572528681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 msgr2=0xbe3f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.170+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe3f700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4d08002140 tx=0x7f4d08002170 comp rx=0 tx=0).stop 2024-09-13T18:50:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- 172.21.15.81:0/572528681 shutdown_connections 2024-09-13T18:50:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbe63d90 0xbe3f700 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe19310 0xbe3f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/572528681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbbac5b0 0xbe3e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- 172.21.15.81:0/572528681 >> 172.21.15.81:0/572528681 conn(0xbe1df10 msgr2=0xbe3dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- 172.21.15.81:0/572528681 shutdown_connections 2024-09-13T18:50:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- 172.21.15.81:0/572528681 wait complete. 2024-09-13T18:50:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- start start 2024-09-13T18:50:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 Processor -- start 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 0xbec4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe19310 0xbec5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe63d90 0xbec5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe836f0 con 0xbbac5b0 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe7b3e0 con 0xbe63d90 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbe400c0 con 0xbe19310 2024-09-13T18:50:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d19ebc740 10 client.0 _ll_register_callbacks cb 0xbd83610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 0xbec4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 0xbec4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56300/0 (socket says 172.21.15.81:56300) 2024-09-13T18:50:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1968918619 learned_addr learned my addr 172.21.15.81:0/1968918619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d14a00700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe63d90 0xbec5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0f400700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe19310 0xbec5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe19310 msgr2=0xbec5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe19310 0xbec5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe63d90 msgr2=0xbec5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe63d90 0xbec5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d0fe00700 1 -- 172.21.15.81:0/1968918619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0800f040 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.174+0000 7f4d14a00700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe63d90 0xbec5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d0fe00700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 0xbec4e40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4d00052db0 tx=0x7f4d00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eddbc6583811936 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 1 -- 172.21.15.81:0/1968918619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0005ed70 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 1 -- 172.21.15.81:0/1968918619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d00056900 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d0005a730 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 1 -- 172.21.15.81:0/1968918619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d00054a40 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 10 client.6324 fetch_fsmap learned FSMap version 40 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0xbd314c0 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 1 -- 172.21.15.81:0/1968918619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0005a730 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 1 -- 172.21.15.81:0/1968918619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f4d00055df0 con 0xbbac5b0 2024-09-13T18:50:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 10 client.6324 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 10 client.6324 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 20 client.6324 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe64170 0xbec61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 4 client.6324 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0xbc282c0 con 0xbe64170 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d0f400700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe64170 0xbec61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4d0f400700 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe64170 0xbec61c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c194af018a8bb1fd server_cookie=d37cd43682b0a4ad in_seq=0 out_seq=0 2024-09-13T18:50:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.178+0000 7f4cf8c00700 10 client.6324 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4cf8c00700 1 -- 172.21.15.81:0/1968918619 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0xbc282c0 con 0xbe64170 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4cf8c00700 10 client.6324 handle_command_reply: tid=0 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 client.6324 shutdown 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 msgr2=0xbec4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 0xbec4e40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4d00052db0 tx=0x7f4d00009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 shutdown_connections 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbe63d90 0xbec5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbe19310 0xbec5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0xbe64170 0xbec61c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 --2- 172.21.15.81:0/1968918619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbbac5b0 0xbec4e40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4cf8c00700 0 client.6324 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 >> 172.21.15.81:0/1968918619 conn(0xbe1df10 msgr2=0xbe3efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 shutdown_connections 2024-09-13T18:50:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 1 -- 172.21.15.81:0/1968918619 wait complete. 2024-09-13T18:50:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d19ebc740 20 client.6324 trim_cache size 0 max 16384 2024-09-13T18:50:33.204 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:50:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:50:33.205 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4cf0066730 msgr2=0x7f4cf0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4cf0066730 0x7f4cf0068bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4d10071e80 tx=0x7f4cfc009040 comp rx=0 tx=0).stop 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 msgr2=0x7f4d1013f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 0x7f4d1013f230 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009fd0 tx=0x7f4d00004770 comp rx=0 tx=0).stop 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 shutdown_connections 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4cf0066730 0x7f4cf0068bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d10143b70 0x7f4d10154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d1006d620 0x7f4d10154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 --2- 172.21.15.81:0/494855935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d1006d070 0x7f4d1013f230 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 >> 172.21.15.81:0/494855935 conn(0x7f4d1006a390 msgr2=0x7f4d100ae5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 shutdown_connections 2024-09-13T18:50:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.194+0000 7f4d15400700 1 -- 172.21.15.81:0/494855935 wait complete. 2024-09-13T18:50:33.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 flush journal 2024-09-13T18:50:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.398+0000 7fb90a000700 1 Processor -- start 2024-09-13T18:50:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.398+0000 7fb90a000700 1 -- start start 2024-09-13T18:50:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb90a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90406d760 0x7fb9040b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb90a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb904144710 0x7fb9040b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb90a000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90406bcf0 con 0x7fb904144330 2024-09-13T18:50:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb90a000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9040cce10 con 0x7fb904144710 2024-09-13T18:50:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb90a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90406cb50 con 0x7fb90406d760 2024-09-13T18:50:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb904144710 0x7fb9040b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb904144710 0x7fb9040b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56310/0 (socket says 172.21.15.81:56310) 2024-09-13T18:50:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb902a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90406d760 0x7fb9040b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 -- 172.21.15.81:0/3967895281 learned_addr learned my addr 172.21.15.81:0/3967895281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 -- 172.21.15.81:0/3967895281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90406d760 msgr2=0x7fb9040b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 --2- 172.21.15.81:0/3967895281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90406d760 0x7fb9040b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 -- 172.21.15.81:0/3967895281 >> v1:172.21.15.178:6789/0 conn(0x7fb904144330 legacy=0x7fb9040cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 -- 172.21.15.81:0/3967895281 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90406bf40 con 0x7fb904144710 2024-09-13T18:50:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb902a00700 1 --2- 172.21.15.81:0/3967895281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90406d760 0x7fb9040b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.402+0000 7fb903e00700 1 --2- 172.21.15.81:0/3967895281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb904144710 0x7fb9040b3ae0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009e50 tx=0x7fb8fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4150edc14b3c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb902000700 1 -- 172.21.15.81:0/3967895281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00e070 con 0x7fb904144710 2024-09-13T18:50:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb902000700 1 -- 172.21.15.81:0/3967895281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00b910 con 0x7fb904144710 2024-09-13T18:50:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb902000700 1 -- 172.21.15.81:0/3967895281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00bcc0 con 0x7fb904144710 2024-09-13T18:50:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 -- 172.21.15.81:0/3967895281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb904144710 msgr2=0x7fb9040b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 --2- 172.21.15.81:0/3967895281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb904144710 0x7fb9040b3ae0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009e50 tx=0x7fb8fc00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 -- 172.21.15.81:0/3967895281 shutdown_connections 2024-09-13T18:50:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 --2- 172.21.15.81:0/3967895281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb904144710 0x7fb9040b3ae0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 --2- 172.21.15.81:0/3967895281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90406d760 0x7fb9040b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 -- 172.21.15.81:0/3967895281 >> 172.21.15.81:0/3967895281 conn(0x7fb90406a570 msgr2=0x7fb90406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 -- 172.21.15.81:0/3967895281 shutdown_connections 2024-09-13T18:50:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.406+0000 7fb90a000700 1 -- 172.21.15.81:0/3967895281 wait complete. 2024-09-13T18:50:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 Processor -- start 2024-09-13T18:50:33.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 -- start start 2024-09-13T18:50:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 0x7fb9041f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb904144330 0x7fb9041f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90415d070 0x7fb90415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90415db90 con 0x7fb90406d760 2024-09-13T18:50:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9041f5b30 con 0x7fb904144330 2024-09-13T18:50:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb90a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb904152db0 con 0x7fb90415d070 2024-09-13T18:50:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 0x7fb9041f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 0x7fb9041f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56316/0 (socket says 172.21.15.81:56316) 2024-09-13T18:50:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb902a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb904144330 0x7fb9041f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 -- 172.21.15.81:0/4084679409 learned_addr learned my addr 172.21.15.81:0/4084679409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903e00700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90415d070 0x7fb90415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 -- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90415d070 msgr2=0x7fb90415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90415d070 0x7fb90415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 -- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb904144330 msgr2=0x7fb9041f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb904144330 0x7fb9041f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.410+0000 7fb903400700 1 -- 172.21.15.81:0/4084679409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f00094b0 con 0x7fb90406d760 2024-09-13T18:50:33.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.414+0000 7fb903400700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 0x7fb9041f55f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c500 tx=0x7fb8f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.414+0000 7fb8fb400700 1 -- 172.21.15.81:0/4084679409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40052d0 con 0x7fb90406d760 2024-09-13T18:50:33.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.414+0000 7fb8fb400700 1 -- 172.21.15.81:0/4084679409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4005430 con 0x7fb90406d760 2024-09-13T18:50:33.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.414+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc009b30 con 0x7fb90406d760 2024-09-13T18:50:33.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.414+0000 7fb8fb400700 1 -- 172.21.15.81:0/4084679409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40055a0 con 0x7fb90406d760 2024-09-13T18:50:33.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.414+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb904153370 con 0x7fb90406d760 2024-09-13T18:50:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb8fb400700 1 -- 172.21.15.81:0/4084679409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8f40038e0 con 0x7fb90406d760 2024-09-13T18:50:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 Processor -- start 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb8fb400700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8e4066730 0x7fb8e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 -- start start 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb8fb400700 1 -- 172.21.15.81:0/4084679409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8f4083650 con 0x7fb90406d760 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb903e00700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8e4066730 0x7fb8e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c5e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5985d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c52c010 con 0x1c5c2d00 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c4b9f40 con 0x1c5e4950 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c50ce30 con 0x1c5e5270 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb903e00700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8e4066730 0x7fb8e4068bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b370 tx=0x7fb8fc009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb902a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c5e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb902a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c5e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56318/0 (socket says 172.21.15.81:56318) 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb902a00700 1 -- 172.21.15.81:0/1776834520 learned_addr learned my addr 172.21.15.81:0/1776834520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.418+0000 7fb903e00700 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb903400700 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb902a00700 1 -- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 msgr2=0x1c5985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb902a00700 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb902a00700 1 -- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 msgr2=0x1c5c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb902a00700 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb902a00700 1 -- 172.21.15.81:0/1776834520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c378a40 con 0x1c5c2d00 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb903400700 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb902a00700 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c5e4d30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009e90 tx=0x7fb8f00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34fb4252e3925ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb8ef400700 1 -- 172.21.15.81:0/1776834520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0011cb0 con 0x1c5c2d00 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb8ef400700 1 -- 172.21.15.81:0/1776834520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0011e10 con 0x1c5c2d00 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb8ef400700 1 -- 172.21.15.81:0/1776834520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0014680 con 0x1c5c2d00 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 -- 172.21.15.81:0/1776834520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 msgr2=0x1c5e4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c5e4d30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009e90 tx=0x7fb8f00115a0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 -- 172.21.15.81:0/1776834520 shutdown_connections 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c5e4d30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/1776834520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 -- 172.21.15.81:0/1776834520 >> 172.21.15.81:0/1776834520 conn(0x1c32d5b0 msgr2=0x1c59e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 -- 172.21.15.81:0/1776834520 shutdown_connections 2024-09-13T18:50:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 -- 172.21.15.81:0/1776834520 wait complete. 2024-09-13T18:50:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 -- start start 2024-09-13T18:50:33.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.422+0000 7fb90d3b7740 1 Processor -- start 2024-09-13T18:50:33.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5ac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c508150 con 0x1c5e5270 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c505eb0 con 0x1c5e4950 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c4c38e0 con 0x1c5c2d00 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 10 client.0 _ll_register_callbacks cb 0x1c4a2670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56320/0 (socket says 172.21.15.81:56320) 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 -- 172.21.15.81:0/941081630 learned_addr learned my addr 172.21.15.81:0/941081630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903400700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 -- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 msgr2=0x1c5ae0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5ae0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 -- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 msgr2=0x1c5abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb902a00700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 -- 172.21.15.81:0/941081630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f0009ac0 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903400700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb903e00700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5ac390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b680 tx=0x7fb8fc004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd2323ffa7ca80f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb8e3e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb8e3e00700 1 -- 172.21.15.81:0/941081630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc01d830 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb8e3e00700 1 -- 172.21.15.81:0/941081630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8fc023070 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c33a2c0 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb8e3e00700 1 -- 172.21.15.81:0/941081630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8fc01d990 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 10 client.6336 fetch_fsmap learned FSMap version 40 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x1c4cc290 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb8e3e00700 1 -- 172.21.15.81:0/941081630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c33a2c0 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb8e3e00700 1 -- 172.21.15.81:0/941081630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fb8fc01daf0 con 0x1c5e5270 2024-09-13T18:50:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 10 client.6336 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 10 client.6336 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 20 client.6336 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5e0780 0x1c5af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 4 client.6336 mds_command: new command op to 5911 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.426+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 --> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c384540 con 0x1c5e0780 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb903400700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5e0780 0x1c5af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb8e3e00700 10 client.6336 ms_handle_connect on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:33.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb903400700 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5e0780 0x1c5af2e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=34265a41b34695df server_cookie=841348db8bddb4f8 in_seq=0 out_seq=0 2024-09-13T18:50:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb8e3e00700 1 -- 172.21.15.81:0/941081630 <== mds.2 v2:172.21.15.178:6834/1611484847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1c384540 con 0x1c5e0780 2024-09-13T18:50:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb8e3e00700 10 client.6336 handle_command_reply: tid=0 2024-09-13T18:50:33.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 client.6336 shutdown 2024-09-13T18:50:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 msgr2=0x1c5ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5ac390 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b680 tx=0x7fb8fc004b60 comp rx=0 tx=0).stop 2024-09-13T18:50:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 shutdown_connections 2024-09-13T18:50:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5e0780 0x1c5af2e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5ac390 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/941081630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5ae0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb8e3e00700 0 client.6336 ms_handle_reset on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 >> 172.21.15.81:0/941081630 conn(0x1c32d5b0 msgr2=0x1c599dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 shutdown_connections 2024-09-13T18:50:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 1 -- 172.21.15.81:0/941081630 wait complete. 2024-09-13T18:50:33.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.430+0000 7fb90d3b7740 20 client.6336 trim_cache size 0 max 16384 2024-09-13T18:50:33.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 Processor -- start 2024-09-13T18:50:33.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 -- start start 2024-09-13T18:50:33.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5fe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c59e1c0 con 0x1c5e5270 2024-09-13T18:50:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c3b1b80 con 0x1c5e4950 2024-09-13T18:50:33.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c4d6c00 con 0x1c5c2d00 2024-09-13T18:50:33.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5df3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56336/0 (socket says 172.21.15.81:56336) 2024-09-13T18:50:33.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 -- 172.21.15.81:0/3060395832 learned_addr learned my addr 172.21.15.81:0/3060395832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903400700 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5fe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb902a00700 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 -- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 msgr2=0x1c5fe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5fe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 -- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 msgr2=0x1c5deeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5deeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb903e00700 1 -- 172.21.15.81:0/3060395832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c5c2b70 con 0x1c5e5270 2024-09-13T18:50:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.450+0000 7fb902a00700 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb903e00700 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5df3f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00d010 tx=0x7fb8fc02b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a144ed1d634513fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb8efe00700 1 -- 172.21.15.81:0/3060395832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc004780 con 0x1c5e5270 2024-09-13T18:50:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb8efe00700 1 -- 172.21.15.81:0/3060395832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc021070 con 0x1c5e5270 2024-09-13T18:50:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb8efe00700 1 -- 172.21.15.81:0/3060395832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc01d850 con 0x1c5e5270 2024-09-13T18:50:33.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 -- 172.21.15.81:0/3060395832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 msgr2=0x1c5df3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5df3f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00d010 tx=0x7fb8fc02b070 comp rx=0 tx=0).stop 2024-09-13T18:50:33.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 -- 172.21.15.81:0/3060395832 shutdown_connections 2024-09-13T18:50:33.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5e5270 0x1c5df3f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5deeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/3060395832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5c2d00 0x1c5fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 -- 172.21.15.81:0/3060395832 >> 172.21.15.81:0/3060395832 conn(0x1c32d5b0 msgr2=0x1c5b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 -- 172.21.15.81:0/3060395832 shutdown_connections 2024-09-13T18:50:33.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 -- 172.21.15.81:0/3060395832 wait complete. 2024-09-13T18:50:33.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.454+0000 7fb90d3b7740 1 -- start start 2024-09-13T18:50:33.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 Processor -- start 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c6490d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5fb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5df180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c4a4620 con 0x1c5c2d00 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c5036c0 con 0x1c5e4950 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c5fcf70 con 0x1c5e5270 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb90d3b7740 10 client.0 _ll_register_callbacks cb 0x1c4d58f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c6490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c6490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56352/0 (socket says 172.21.15.81:56352) 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 -- 172.21.15.81:0/271964983 learned_addr learned my addr 172.21.15.81:0/271964983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903e00700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb902a00700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 -- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 msgr2=0x1c5df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5df180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 -- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 msgr2=0x1c5fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5fb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 -- 172.21.15.81:0/271964983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1c4cc290 con 0x1c5c2d00 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903e00700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb903400700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c6490d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4054230 tx=0x7fb8f4081900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51f4311ba5f14b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.458+0000 7fb8e3e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb8e3e00700 1 -- 172.21.15.81:0/271964983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f405c920 con 0x1c5c2d00 2024-09-13T18:50:33.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb8e3e00700 1 -- 172.21.15.81:0/271964983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8f40528d0 con 0x1c5c2d00 2024-09-13T18:50:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8f0011e10 con 0x1c5c2d00 2024-09-13T18:50:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb8e3e00700 1 -- 172.21.15.81:0/271964983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8f4053a20 con 0x1c5c2d00 2024-09-13T18:50:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 10 client.6342 fetch_fsmap learned FSMap version 40 2024-09-13T18:50:33.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x1c4b24c0 con 0x1c5c2d00 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb8e3e00700 1 -- 172.21.15.81:0/271964983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4076070 con 0x1c5c2d00 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb8e3e00700 1 -- 172.21.15.81:0/271964983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 40) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fb8f405c490 con 0x1c5c2d00 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 10 client.6342 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 10 client.6342 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 20 client.6342 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5fbeb0 0x1c5df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 4 client.6342 mds_command: new command op to 5911 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 --> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x1c3a92c0 con 0x1c5fbeb0 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb902a00700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5fbeb0 0x1c5df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:33.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb902a00700 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5fbeb0 0x1c5df6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba021b74d8ab179 server_cookie=84839596a3979479 in_seq=0 out_seq=0 2024-09-13T18:50:33.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.462+0000 7fb8e3e00700 10 client.6342 ms_handle_connect on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb8e3e00700 1 -- 172.21.15.81:0/271964983 <== mds.2 v2:172.21.15.178:6834/1611484847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x1c3a92c0 con 0x1c5fbeb0 2024-09-13T18:50:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb8e3e00700 10 client.6342 handle_command_reply: tid=0 2024-09-13T18:50:33.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 client.6342 shutdown 2024-09-13T18:50:33.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 msgr2=0x1c6490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c6490d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4054230 tx=0x7fb8f4081900 comp rx=0 tx=0).stop 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 shutdown_connections 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x1c5fbeb0 0x1c5df6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5e5270 0x1c5df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb8e3e00700 0 client.6342 ms_handle_reset on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5e4950 0x1c5fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 --2- 172.21.15.81:0/271964983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c5c2d00 0x1c6490d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 >> 172.21.15.81:0/271964983 conn(0x1c32d5b0 msgr2=0x1c5c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 shutdown_connections 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 1 -- 172.21.15.81:0/271964983 wait complete. 2024-09-13T18:50:33.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90d3b7740 20 client.6342 trim_cache size 0 max 16384 2024-09-13T18:50:33.490 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:33.490 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:50:33.490 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:50:33.490 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:33.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8e4066730 msgr2=0x7fb8e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8e4066730 0x7fb8e4068bf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b370 tx=0x7fb8fc009000 comp rx=0 tx=0).stop 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 msgr2=0x7fb9041f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 0x7fb9041f55f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c500 tx=0x7fb8f400c810 comp rx=0 tx=0).stop 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 shutdown_connections 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8e4066730 0x7fb8e4068bf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb90415d070 0x7fb90415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb904144330 0x7fb9041f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 --2- 172.21.15.81:0/4084679409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90406d760 0x7fb9041f55f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 >> 172.21.15.81:0/4084679409 conn(0x7fb90406a570 msgr2=0x7fb904142f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 shutdown_connections 2024-09-13T18:50:33.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:33.478+0000 7fb90a000700 1 -- 172.21.15.81:0/4084679409 wait complete. 2024-09-13T18:50:33.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:50:33.513 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-13T18:50:33.546 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/ 2024-09-13T18:50:33.546 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4 2024-09-13T18:50:33.547 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5 2024-09-13T18:50:33.547 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6 2024-09-13T18:50:33.547 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-13T18:50:33.547 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-13T18:50:33.549 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:50:33.549 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:50:33.549 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:50:33.549 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:50:33.549 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-13T18:50:33.550 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:50:33.689 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2024-09-13T18:50:33.881 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:50:33.881 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:50:33.881 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:50:33.881 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:50:33.881 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-13T18:50:33.881 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:50:34.017 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627779 2024-09-13T18:50:34.205 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:50:34.206 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:50:34.206 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:50:34.206 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:50:34.206 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-13T18:50:34.206 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:50:34.358 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627780 2024-09-13T18:50:34.546 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:50:34.546 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:50:34.546 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:50:34.546 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:50:34.546 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-13T18:50:34.546 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:50:34.686 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627781 2024-09-13T18:50:34.877 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:50:34.877 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:50:34.877 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:50:34.877 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:50:34.877 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-13T18:50:34.877 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:50:35.014 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627782 2024-09-13T18:50:35.203 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:50:35.203 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:50:35.203 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:50:35.203 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:50:35.203 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-13T18:50:35.203 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:50:35.345 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627783 2024-09-13T18:50:35.536 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-13T18:50:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 Processor -- start 2024-09-13T18:50:35.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 -- start start 2024-09-13T18:50:35.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 0x55ba4ac1ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab8cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4aa50a00 con 0x55ba4aabacc0 2024-09-13T18:50:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4aa4c2f0 con 0x55ba4ab8fd90 2024-09-13T18:50:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.642+0000 7f4fa53d1140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba4aa088e0 con 0x55ba4ac1c260 2024-09-13T18:50:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 0x55ba4ac1ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 0x55ba4ac1ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56362/0 (socket says 172.21.15.81:56362) 2024-09-13T18:50:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 -- 172.21.15.81:0/1440215524 learned_addr learned my addr 172.21.15.81:0/1440215524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa3000700 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab8cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa1c00700 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 -- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 msgr2=0x55ba4ab8cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab8cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 -- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4ab8fd90 msgr2=0x55ba4ac1bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 -- 172.21.15.81:0/1440215524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c005d20 con 0x55ba4aabacc0 2024-09-13T18:50:35.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa2600700 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 0x55ba4ac1ac70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001760 tx=0x7f4f94001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951552ea019a1a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4f9be00700 1 -- 172.21.15.81:0/1440215524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94002690 con 0x55ba4aabacc0 2024-09-13T18:50:35.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4f9be00700 1 -- 172.21.15.81:0/1440215524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94002810 con 0x55ba4aabacc0 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4f9be00700 1 -- 172.21.15.81:0/1440215524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94002bc0 con 0x55ba4aabacc0 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1440215524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 msgr2=0x55ba4ac1ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 0x55ba4ac1ac70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001760 tx=0x7f4f94001a70 comp rx=0 tx=0).stop 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1440215524 shutdown_connections 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab8cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1440215524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4aabacc0 0x55ba4ac1ac70 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1440215524 >> 172.21.15.81:0/1440215524 conn(0x55ba4aae50e0 msgr2=0x55ba4aaffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1440215524 shutdown_connections 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1440215524 wait complete. 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 Processor -- start 2024-09-13T18:50:35.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.646+0000 7f4fa53d1140 1 -- start start 2024-09-13T18:50:35.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4aabacc0 0x55ba4ac18b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab7c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4aa08580 con 0x55ba4ab8fd90 2024-09-13T18:50:35.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba4a9de8d0 con 0x55ba4aabacc0 2024-09-13T18:50:35.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba4ac1ed10 con 0x55ba4ac1c260 2024-09-13T18:50:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56372/0 (socket says 172.21.15.81:56372) 2024-09-13T18:50:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 -- 172.21.15.81:0/1140524204 learned_addr learned my addr 172.21.15.81:0/1140524204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa2600700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4aabacc0 0x55ba4ac18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa3000700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab7c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 -- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 msgr2=0x55ba4ab7c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ba4ac1c260 0x55ba4ab7c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 -- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4aabacc0 msgr2=0x55ba4ac18b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ba4aabacc0 0x55ba4ac18b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 -- 172.21.15.81:0/1140524204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94006d10 con 0x55ba4ab8fd90 2024-09-13T18:50:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa1c00700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1b8d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4f90001e00 tx=0x7f4f9000c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4f9aa00700 1 -- 172.21.15.81:0/1140524204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000f650 con 0x55ba4ab8fd90 2024-09-13T18:50:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4f9aa00700 1 -- 172.21.15.81:0/1140524204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9000f7b0 con 0x55ba4ab8fd90 2024-09-13T18:50:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ba4a9e9f40 con 0x55ba4ab8fd90 2024-09-13T18:50:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4f9aa00700 1 -- 172.21.15.81:0/1140524204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000fb40 con 0x55ba4ab8fd90 2024-09-13T18:50:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.650+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba4a9e99a0 con 0x55ba4ab8fd90 2024-09-13T18:50:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.654+0000 7f4f9aa00700 1 -- 172.21.15.81:0/1140524204 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f90015020 con 0x55ba4ab8fd90 2024-09-13T18:50:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.654+0000 7f4f9aa00700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.654+0000 7f4f9aa00700 1 -- 172.21.15.81:0/1140524204 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4f90083570 con 0x55ba4ab8fd90 2024-09-13T18:50:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.658+0000 7f4fa2600700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.658+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55ba4ac1be10 0x55ba4ab01fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.658+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- osd_op(unknown.0.0:1 7.12 7:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55ba4aaff170 con 0x55ba4ac1be10 2024-09-13T18:50:35.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.658+0000 7f4fa3000700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55ba4ac1be10 0x55ba4ab01fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.658+0000 7f4fa2600700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001700 tx=0x7f4f94013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.658+0000 7f4fa3000700 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55ba4ac1be10 0x55ba4ab01fe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa3000700 1 -- 172.21.15.81:0/1140524204 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v53'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4f9c00a0c0 con 0x55ba4ac1be10 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55ba4ac1be10 msgr2=0x55ba4ab01fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55ba4ac1be10 0x55ba4ab01fe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 msgr2=0x7f4f84067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4f94001700 tx=0x7f4f94013040 comp rx=0 tx=0).stop 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4ab8fd90 msgr2=0x55ba4ac1b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 --2- 172.21.15.81:0/1140524204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ba4ab8fd90 0x55ba4ac1b8d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4f90001e00 tx=0x7f4f9000c640 comp rx=0 tx=0).stop 2024-09-13T18:50:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa3000700 1 -- 172.21.15.81:0/1140524204 reap_dead start 2024-09-13T18:50:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 shutdown_connections 2024-09-13T18:50:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 >> 172.21.15.81:0/1140524204 conn(0x55ba4aae50e0 msgr2=0x55ba4aaffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 shutdown_connections 2024-09-13T18:50:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.662+0000 7f4fa53d1140 1 -- 172.21.15.81:0/1140524204 wait complete. 2024-09-13T18:50:35.679 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-13T18:50:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.730+0000 7f6b49527140 1 Processor -- start 2024-09-13T18:50:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 -- start start 2024-09-13T18:50:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c340f6eda0 0x55c340f3cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3410120b0 0x55c340f6a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 0x55c340ff66d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c340ece2f0 con 0x55c341012490 2024-09-13T18:50:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c340e8a8e0 con 0x55c340f6eda0 2024-09-13T18:50:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b49527140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c340e8a580 con 0x55c3410120b0 2024-09-13T18:50:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 0x55c340ff66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 0x55c340ff66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56388/0 (socket says 172.21.15.81:56388) 2024-09-13T18:50:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 -- 172.21.15.81:0/3429773221 learned_addr learned my addr 172.21.15.81:0/3429773221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b46800700 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c340f6eda0 0x55c340f3cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b45e00700 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3410120b0 0x55c340f6a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 -- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3410120b0 msgr2=0x55c340f6a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3410120b0 0x55c340f6a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 -- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c340f6eda0 msgr2=0x55c340f3cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c340f6eda0 0x55c340f3cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 -- 172.21.15.81:0/3429773221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4000a1c0 con 0x55c341012490 2024-09-13T18:50:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b47200700 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 0x55c340ff66d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x55c340f85910 tx=0x7f6b4000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4affc20d8e3c53ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b44a00700 1 -- 172.21.15.81:0/3429773221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000e510 con 0x55c341012490 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b44a00700 1 -- 172.21.15.81:0/3429773221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4000e690 con 0x55c341012490 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.734+0000 7f6b44a00700 1 -- 172.21.15.81:0/3429773221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4000ec20 con 0x55c341012490 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- 172.21.15.81:0/3429773221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 msgr2=0x55c340ff66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 0x55c340ff66d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x55c340f85910 tx=0x7f6b4000e000 comp rx=0 tx=0).stop 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- 172.21.15.81:0/3429773221 shutdown_connections 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c341012490 0x55c340ff66d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3410120b0 0x55c340f6a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- 172.21.15.81:0/3429773221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c340f6eda0 0x55c340f3cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- 172.21.15.81:0/3429773221 >> 172.21.15.81:0/3429773221 conn(0x55c340f3b8c0 msgr2=0x55c340f3c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- 172.21.15.81:0/3429773221 shutdown_connections 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- 172.21.15.81:0/3429773221 wait complete. 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 Processor -- start 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- start start 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c340f6eda0 0x55c340ff91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3410120b0 0x55c340f84a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c341012490 0x55c34100e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c340e608d0 con 0x55c3410120b0 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c340f83900 con 0x55c341012490 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b49527140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c340f83b30 con 0x55c340f6eda0 2024-09-13T18:50:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.738+0000 7f6b45e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3410120b0 0x55c340f84a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3410120b0 0x55c340f84a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56394/0 (socket says 172.21.15.81:56394) 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 -- 172.21.15.81:0/3098359209 learned_addr learned my addr 172.21.15.81:0/3098359209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b47200700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c341012490 0x55c34100e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b46800700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c340f6eda0 0x55c340ff91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 -- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c340f6eda0 msgr2=0x55c340ff91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c340f6eda0 0x55c340ff91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 -- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c341012490 msgr2=0x55c34100e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c341012490 0x55c34100e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 -- 172.21.15.81:0/3098359209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c340e92ca0 con 0x55c3410120b0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b45e00700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3410120b0 0x55c340f84a50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009f20 tx=0x7f6b340086e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b3f400700 1 -- 172.21.15.81:0/3098359209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3400f050 con 0x55c3410120b0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b3f400700 1 -- 172.21.15.81:0/3098359209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34010040 con 0x55c3410120b0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b3f400700 1 -- 172.21.15.81:0/3098359209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340158a0 con 0x55c3410120b0 2024-09-13T18:50:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c340e78b00 con 0x55c3410120b0 2024-09-13T18:50:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.742+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c340e6bf40 con 0x55c3410120b0 2024-09-13T18:50:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b3f400700 1 -- 172.21.15.81:0/3098359209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b34005020 con 0x55c3410120b0 2024-09-13T18:50:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b3f400700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6b28065130 0x7f6b280675f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b3f400700 1 -- 172.21.15.81:0/3098359209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6b34082db0 con 0x55c3410120b0 2024-09-13T18:50:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b46800700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6b28065130 0x7f6b280675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b49527140 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55c340f62150 0x55c340f81910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- osd_op(unknown.0.0:1 7.12 7:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55c34100ed70 con 0x55c340f62150 2024-09-13T18:50:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b47200700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55c340f62150 0x55c340f81910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.746+0000 7f6b46800700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6b28065130 0x7f6b280675f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6b38011560 tx=0x7f6b38001790 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b47200700 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55c340f62150 0x55c340f81910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b47200700 1 -- 172.21.15.81:0/3098359209 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v53'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6b40017040 con 0x55c340f62150 2024-09-13T18:50:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55c340f62150 msgr2=0x55c340f81910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b49527140 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55c340f62150 0x55c340f81910 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6b28065130 msgr2=0x7f6b280675f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b49527140 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6b28065130 0x7f6b280675f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6b38011560 tx=0x7f6b38001790 comp rx=0 tx=0).stop 2024-09-13T18:50:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3410120b0 msgr2=0x55c340f84a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b49527140 1 --2- 172.21.15.81:0/3098359209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c3410120b0 0x55c340f84a50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009f20 tx=0x7f6b340086e0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.750+0000 7f6b47200700 1 -- 172.21.15.81:0/3098359209 reap_dead start 2024-09-13T18:50:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.754+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 shutdown_connections 2024-09-13T18:50:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.754+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 >> 172.21.15.81:0/3098359209 conn(0x55c340f3b8c0 msgr2=0x55c340f68140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.754+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 shutdown_connections 2024-09-13T18:50:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.754+0000 7f6b49527140 1 -- 172.21.15.81:0/3098359209 wait complete. 2024-09-13T18:50:35.771 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-13T18:50:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 Processor -- start 2024-09-13T18:50:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 -- start start 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e907090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e997d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e998690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e7c6a00 con 0x55f54e909830 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e7c22f0 con 0x7fb5800023f0 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59d3d9140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f54e77e8e0 con 0x55f54e9982b0 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb599c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e997d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb599c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e997d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56416/0 (socket says 172.21.15.81:56416) 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb599c00700 1 -- 172.21.15.81:0/234458779 learned_addr learned my addr 172.21.15.81:0/234458779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.838+0000 7fb59a600700 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e907090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59b000700 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e998690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb599c00700 1 -- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 msgr2=0x55f54e998690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb599c00700 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e998690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb599c00700 1 -- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 msgr2=0x55f54e907090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb599c00700 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e907090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb599c00700 1 -- 172.21.15.81:0/234458779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f54e75ff40 con 0x55f54e909830 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59a600700 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e907090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb599c00700 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e997d70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d2c0 tx=0x7fb58800d5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbeec75e830ed15f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb593e00700 1 -- 172.21.15.81:0/234458779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588016070 con 0x55f54e909830 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb593e00700 1 -- 172.21.15.81:0/234458779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588008040 con 0x55f54e909830 2024-09-13T18:50:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb593e00700 1 -- 172.21.15.81:0/234458779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800dd00 con 0x55f54e909830 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 -- 172.21.15.81:0/234458779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 msgr2=0x55f54e997d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e997d70 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d2c0 tx=0x7fb58800d5d0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 -- 172.21.15.81:0/234458779 shutdown_connections 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e998690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e997d70 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/234458779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e907090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 -- 172.21.15.81:0/234458779 >> 172.21.15.81:0/234458779 conn(0x55f54e82fcb0 msgr2=0x55f54e8e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 -- 172.21.15.81:0/234458779 shutdown_connections 2024-09-13T18:50:35.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 -- 172.21.15.81:0/234458779 wait complete. 2024-09-13T18:50:35.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.842+0000 7fb59d3d9140 1 Processor -- start 2024-09-13T18:50:35.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 -- start start 2024-09-13T18:50:35.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e903b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e99fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e9a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e77e580 con 0x55f54e909830 2024-09-13T18:50:35.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f54e7548d0 con 0x7fb5800023f0 2024-09-13T18:50:35.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59d3d9140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f54e9007f0 con 0x55f54e9982b0 2024-09-13T18:50:35.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e903b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e903b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56424/0 (socket says 172.21.15.81:56424) 2024-09-13T18:50:35.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 -- 172.21.15.81:0/2533934453 learned_addr learned my addr 172.21.15.81:0/2533934453 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb599c00700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e99fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59b000700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e9a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 -- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 msgr2=0x55f54e99fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f54e9982b0 0x55f54e99fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 -- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 msgr2=0x55f54e9a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5800023f0 0x55f54e9a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 -- 172.21.15.81:0/2533934453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58800a040 con 0x55f54e909830 2024-09-13T18:50:35.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.846+0000 7fb59a600700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e903b60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb58c005ba0 tx=0x7fb58c0033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.850+0000 7fb592a00700 1 -- 172.21.15.81:0/2533934453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c020040 con 0x55f54e909830 2024-09-13T18:50:35.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.850+0000 7fb592a00700 1 -- 172.21.15.81:0/2533934453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c01b830 con 0x55f54e909830 2024-09-13T18:50:35.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.850+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f54e75f9a0 con 0x55f54e909830 2024-09-13T18:50:35.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.850+0000 7fb592a00700 1 -- 172.21.15.81:0/2533934453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c012450 con 0x55f54e909830 2024-09-13T18:50:35.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.850+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f54e8fda20 con 0x55f54e909830 2024-09-13T18:50:35.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.850+0000 7fb592a00700 1 -- 172.21.15.81:0/2533934453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb58c01bba0 con 0x55f54e909830 2024-09-13T18:50:35.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb592a00700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb57c065090 0x7fb57c067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb592a00700 1 -- 172.21.15.81:0/2533934453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb58c0840c0 con 0x55f54e909830 2024-09-13T18:50:35.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb599c00700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb57c065090 0x7fb57c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x55f54e9040a0 0x55f54e901470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- osd_op(unknown.0.0:1 7.5 7:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55f54e8ff6b0 con 0x55f54e9040a0 2024-09-13T18:50:35.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb59b000700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x55f54e9040a0 0x55f54e901470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb599c00700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb57c065090 0x7fb57c067550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d610 tx=0x7fb588002000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.854+0000 7fb59b000700 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x55f54e9040a0 0x55f54e901470 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59b000700 1 -- 172.21.15.81:0/2533934453 <== osd.7 v2:172.21.15.178:6816/2829585854 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v53'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb59400f450 con 0x55f54e9040a0 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x55f54e9040a0 msgr2=0x55f54e901470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x55f54e9040a0 0x55f54e901470 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb57c065090 msgr2=0x7fb57c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb57c065090 0x7fb57c067550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d610 tx=0x7fb588002000 comp rx=0 tx=0).stop 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 msgr2=0x55f54e903b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 --2- 172.21.15.81:0/2533934453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f54e909830 0x55f54e903b60 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb58c005ba0 tx=0x7fb58c0033a0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59b000700 1 -- 172.21.15.81:0/2533934453 reap_dead start 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 shutdown_connections 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 >> 172.21.15.81:0/2533934453 conn(0x55f54e82fcb0 msgr2=0x55f54e8e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 shutdown_connections 2024-09-13T18:50:35.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.858+0000 7fb59d3d9140 1 -- 172.21.15.81:0/2533934453 wait complete. 2024-09-13T18:50:35.878 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-13T18:50:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 Processor -- start 2024-09-13T18:50:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 -- start start 2024-09-13T18:50:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 0x5593370140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370cdf70 0x559337045850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cee50 0x559337040d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559336f618e0 con 0x559337011540 2024-09-13T18:50:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559336f61580 con 0x5593370cee50 2024-09-13T18:50:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bd7f2140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x559336f378d0 con 0x5593370cdf70 2024-09-13T18:50:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 0x5593370140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 0x5593370140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56436/0 (socket says 172.21.15.81:56436) 2024-09-13T18:50:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 -- 172.21.15.81:0/3781107475 learned_addr learned my addr 172.21.15.81:0/3781107475 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27bb400700 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cee50 0x559337040d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27ba000700 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370cdf70 0x559337045850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 -- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370cdf70 msgr2=0x559337045850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370cdf70 0x559337045850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 -- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cee50 msgr2=0x559337040d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cee50 0x559337040d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 -- 172.21.15.81:0/3781107475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac005de0 con 0x559337011540 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27ba000700 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370cdf70 0x559337045850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.938+0000 7f27baa00700 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 0x5593370140c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f27ac005fd0 tx=0x7f27ac005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbca91de91366758 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27b8c00700 1 -- 172.21.15.81:0/3781107475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac00f040 con 0x559337011540 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27b8c00700 1 -- 172.21.15.81:0/3781107475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac008b10 con 0x559337011540 2024-09-13T18:50:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27b8c00700 1 -- 172.21.15.81:0/3781107475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac008e80 con 0x559337011540 2024-09-13T18:50:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- 172.21.15.81:0/3781107475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 msgr2=0x5593370140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 0x5593370140c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f27ac005fd0 tx=0x7f27ac005ac0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- 172.21.15.81:0/3781107475 shutdown_connections 2024-09-13T18:50:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cee50 0x559337040d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370cdf70 0x559337045850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/3781107475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559337011540 0x5593370140c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- 172.21.15.81:0/3781107475 >> 172.21.15.81:0/3781107475 conn(0x559337012cb0 msgr2=0x5593370e9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- 172.21.15.81:0/3781107475 shutdown_connections 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- 172.21.15.81:0/3781107475 wait complete. 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 Processor -- start 2024-09-13T18:50:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- start start 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cdf70 0x559337017cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593370cee50 0x5593370e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370e4f90 0x559337040cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559337179c70 con 0x5593370cee50 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593371791f0 con 0x5593370cdf70 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27bd7f2140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x559337179490 con 0x5593370e4f90 2024-09-13T18:50:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27ba000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593370cee50 0x5593370e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27ba000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593370cee50 0x5593370e4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56446/0 (socket says 172.21.15.81:56446) 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.942+0000 7f27ba000700 1 -- 172.21.15.81:0/1314660052 learned_addr learned my addr 172.21.15.81:0/1314660052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27bb400700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370e4f90 0x559337040cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27baa00700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cdf70 0x559337017cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27ba000700 1 -- 172.21.15.81:0/1314660052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370e4f90 msgr2=0x559337040cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27ba000700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5593370e4f90 0x559337040cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27ba000700 1 -- 172.21.15.81:0/1314660052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cdf70 msgr2=0x559337017cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27ba000700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5593370cdf70 0x559337017cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27ba000700 1 -- 172.21.15.81:0/1314660052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac00a5a0 con 0x5593370cee50 2024-09-13T18:50:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27ba000700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593370cee50 0x5593370e4a50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009f30 tx=0x7f27a80086e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27b3400700 1 -- 172.21.15.81:0/1314660052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8018070 con 0x5593370cee50 2024-09-13T18:50:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27b3400700 1 -- 172.21.15.81:0/1314660052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27a8010040 con 0x5593370cee50 2024-09-13T18:50:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27b3400700 1 -- 172.21.15.81:0/1314660052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a80145f0 con 0x5593370cee50 2024-09-13T18:50:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b400a100 con 0x5593370cee50 2024-09-13T18:50:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.946+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559336f69ca0 con 0x5593370cee50 2024-09-13T18:50:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27b3400700 1 -- 172.21.15.81:0/1314660052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27a8005020 con 0x5593370cee50 2024-09-13T18:50:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27b3400700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f279c065090 0x7f279c067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27b3400700 1 -- 172.21.15.81:0/1314660052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f27a80826f0 con 0x5593370cee50 2024-09-13T18:50:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27baa00700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f279c065090 0x7f279c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x559337178ce0 0x559337014910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 7.9 7:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x559337014e50 con 0x559337178ce0 2024-09-13T18:50:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27bb400700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x559337178ce0 0x559337014910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.950+0000 7f27baa00700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f279c065090 0x7f279c067550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5593370eca70 tx=0x7f27ac012000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bb400700 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x559337178ce0 0x559337014910 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bb400700 1 -- 172.21.15.81:0/1314660052 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v53'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f27b400f690 con 0x559337178ce0 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x559337178ce0 msgr2=0x559337014910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x559337178ce0 0x559337014910 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f279c065090 msgr2=0x7f279c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f279c065090 0x7f279c067550 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x5593370eca70 tx=0x7f27ac012000 comp rx=0 tx=0).stop 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593370cee50 msgr2=0x5593370e4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 --2- 172.21.15.81:0/1314660052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5593370cee50 0x5593370e4a50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009f30 tx=0x7f27a80086e0 comp rx=0 tx=0).stop 2024-09-13T18:50:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bb400700 1 -- 172.21.15.81:0/1314660052 reap_dead start 2024-09-13T18:50:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 shutdown_connections 2024-09-13T18:50:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 >> 172.21.15.81:0/1314660052 conn(0x559337012cb0 msgr2=0x559337044e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 shutdown_connections 2024-09-13T18:50:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:35.954+0000 7f27bd7f2140 1 -- 172.21.15.81:0/1314660052 wait complete. 2024-09-13T18:50:35.973 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-13T18:50:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 Processor -- start 2024-09-13T18:50:36.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 -- start start 2024-09-13T18:50:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a670e350 0x5560a673a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a674b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 0x5560a673b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a665b8e0 con 0x5560a67c93b0 2024-09-13T18:50:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a665b580 con 0x5560a670e350 2024-09-13T18:50:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1237a7b140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560a66318d0 con 0x5560a670e730 2024-09-13T18:50:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 0x5560a673b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 0x5560a673b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56462/0 (socket says 172.21.15.81:56462) 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 -- 172.21.15.81:0/3167424104 learned_addr learned my addr 172.21.15.81:0/3167424104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1234200700 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a674b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1234c00700 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a670e350 0x5560a673a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 -- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 msgr2=0x5560a674b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a674b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 -- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a670e350 msgr2=0x5560a673a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a670e350 0x5560a673a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 -- 172.21.15.81:0/3167424104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c00a1c0 con 0x5560a67c93b0 2024-09-13T18:50:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.030+0000 7f1235600700 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 0x5560a673b5c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f122c005fd0 tx=0x7f122c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60c5dd7739c3550 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1232e00700 1 -- 172.21.15.81:0/3167424104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00e710 con 0x5560a67c93b0 2024-09-13T18:50:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1232e00700 1 -- 172.21.15.81:0/3167424104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00e9e0 con 0x5560a67c93b0 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1232e00700 1 -- 172.21.15.81:0/3167424104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00ed90 con 0x5560a67c93b0 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 -- 172.21.15.81:0/3167424104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 msgr2=0x5560a673b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 0x5560a673b5c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f122c005fd0 tx=0x7f122c00e000 comp rx=0 tx=0).stop 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 -- 172.21.15.81:0/3167424104 shutdown_connections 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a67c93b0 0x5560a673b5c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a674b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 --2- 172.21.15.81:0/3167424104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a670e350 0x5560a673a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 -- 172.21.15.81:0/3167424104 >> 172.21.15.81:0/3167424104 conn(0x5560a67380e0 msgr2=0x5560a670b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 -- 172.21.15.81:0/3167424104 shutdown_connections 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 -- 172.21.15.81:0/3167424104 wait complete. 2024-09-13T18:50:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 Processor -- start 2024-09-13T18:50:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.034+0000 7f1237a7b140 1 -- start start 2024-09-13T18:50:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a670e350 0x5560a67c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a67c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a67c93b0 0x5560a685b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a6733580 con 0x5560a670e350 2024-09-13T18:50:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a6733820 con 0x5560a67c93b0 2024-09-13T18:50:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560a6733ac0 con 0x5560a670e730 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a670e350 0x5560a67c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a670e350 0x5560a67c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56474/0 (socket says 172.21.15.81:56474) 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 -- 172.21.15.81:0/4018853977 learned_addr learned my addr 172.21.15.81:0/4018853977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234200700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a67c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1235600700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a67c93b0 0x5560a685b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 -- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 msgr2=0x5560a67c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5560a670e730 0x5560a67c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 -- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a67c93b0 msgr2=0x5560a685b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5560a67c93b0 0x5560a685b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 -- 172.21.15.81:0/4018853977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560a663cbb0 con 0x5560a670e350 2024-09-13T18:50:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1234c00700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a670e350 0x5560a67c3200 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f12240086c0 tx=0x7f12240089d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1231a00700 1 -- 172.21.15.81:0/4018853977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224011040 con 0x5560a670e350 2024-09-13T18:50:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1231a00700 1 -- 172.21.15.81:0/4018853977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224006790 con 0x5560a670e350 2024-09-13T18:50:36.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1231a00700 1 -- 172.21.15.81:0/4018853977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224006b20 con 0x5560a670e350 2024-09-13T18:50:36.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560a6663ca0 con 0x5560a670e350 2024-09-13T18:50:36.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.038+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560a6649b00 con 0x5560a670e350 2024-09-13T18:50:36.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.042+0000 7f1231a00700 1 -- 172.21.15.81:0/4018853977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1224006c80 con 0x5560a670e350 2024-09-13T18:50:36.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.042+0000 7f1231a00700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1214065090 0x7f1214067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.042+0000 7f1231a00700 1 -- 172.21.15.81:0/4018853977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1224083350 con 0x5560a670e350 2024-09-13T18:50:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.042+0000 7f1234200700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1214065090 0x7f1214067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.046+0000 7f1237a7b140 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x5560a67349b0 0x5560a6734dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.046+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- osd_op(unknown.0.0:1 7.5 7:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x5560a6735300 con 0x5560a67349b0 2024-09-13T18:50:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.046+0000 7f1234200700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1214065090 0x7f1214067550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1220005630 tx=0x7f122000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.046+0000 7f1235600700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x5560a67349b0 0x5560a6734dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.046+0000 7f1235600700 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x5560a67349b0 0x5560a6734dc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1235600700 1 -- 172.21.15.81:0/4018853977 <== osd.7 v2:172.21.15.178:6816/2829585854 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v53'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f122c00eb50 con 0x5560a67349b0 2024-09-13T18:50:36.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x5560a67349b0 msgr2=0x5560a6734dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x5560a67349b0 0x5560a6734dc0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1214065090 msgr2=0x7f1214067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1214065090 0x7f1214067550 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1220005630 tx=0x7f122000c040 comp rx=0 tx=0).stop 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a670e350 msgr2=0x5560a67c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 --2- 172.21.15.81:0/4018853977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560a670e350 0x5560a67c3200 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f12240086c0 tx=0x7f12240089d0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1235600700 1 -- 172.21.15.81:0/4018853977 reap_dead start 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 shutdown_connections 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 >> 172.21.15.81:0/4018853977 conn(0x5560a67380e0 msgr2=0x5560a670b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 shutdown_connections 2024-09-13T18:50:36.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.050+0000 7f1237a7b140 1 -- 172.21.15.81:0/4018853977 wait complete. 2024-09-13T18:50:36.068 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-13T18:50:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 Processor -- start 2024-09-13T18:50:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 -- start start 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700ebf42f0 con 0x55700ed1cf70 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700ebb08e0 con 0x55700ed1de50 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8ba229b140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55700ebb0580 con 0x55700ec60540 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56488/0 (socket says 172.21.15.81:56488) 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 -- 172.21.15.81:0/4286682131 learned_addr learned my addr 172.21.15.81:0/4286682131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9fe00700 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9f400700 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 -- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 msgr2=0x55700ed37f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed37f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 -- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 msgr2=0x55700ecac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9ea00700 1 -- 172.21.15.81:0/4286682131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b90005d20 con 0x55700ed1cf70 2024-09-13T18:50:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.126+0000 7f8b9f400700 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8b9ea00700 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecac030 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b2f0 tx=0x7f8b8c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5982415388f548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8b9d600700 1 -- 172.21.15.81:0/4286682131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c014070 con 0x55700ed1cf70 2024-09-13T18:50:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8b9d600700 1 -- 172.21.15.81:0/4286682131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c00f3f0 con 0x55700ed1cf70 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8b9d600700 1 -- 172.21.15.81:0/4286682131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00f780 con 0x55700ed1cf70 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 -- 172.21.15.81:0/4286682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 msgr2=0x55700ecac030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecac030 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b2f0 tx=0x7f8b8c00b600 comp rx=0 tx=0).stop 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 -- 172.21.15.81:0/4286682131 shutdown_connections 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecac030 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 --2- 172.21.15.81:0/4286682131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 -- 172.21.15.81:0/4286682131 >> 172.21.15.81:0/4286682131 conn(0x55700ec61cb0 msgr2=0x55700ecad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 -- 172.21.15.81:0/4286682131 shutdown_connections 2024-09-13T18:50:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 -- 172.21.15.81:0/4286682131 wait complete. 2024-09-13T18:50:36.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 Processor -- start 2024-09-13T18:50:36.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.130+0000 7f8ba229b140 1 -- start start 2024-09-13T18:50:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecacb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700eb868d0 con 0x55700ed1cf70 2024-09-13T18:50:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700eca90f0 con 0x55700ed1de50 2024-09-13T18:50:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55700eca9390 con 0x55700ec60540 2024-09-13T18:50:36.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecacb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecacb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56498/0 (socket says 172.21.15.81:56498) 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 -- 172.21.15.81:0/3548204512 learned_addr learned my addr 172.21.15.81:0/3548204512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9f400700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9fe00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 -- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 msgr2=0x55700ed370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 -- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 msgr2=0x55700ecad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55700ed1de50 0x55700ecad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 -- 172.21.15.81:0/3548204512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c001b40 con 0x55700ed1cf70 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9f400700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55700ec60540 0x55700ed370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:36.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b9ea00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecacb40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b640 tx=0x7f8b8c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b97e00700 1 -- 172.21.15.81:0/3548204512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c014070 con 0x55700ed1cf70 2024-09-13T18:50:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b97e00700 1 -- 172.21.15.81:0/3548204512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8c01b640 con 0x55700ed1cf70 2024-09-13T18:50:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8b97e00700 1 -- 172.21.15.81:0/3548204512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00bee0 con 0x55700ed1cf70 2024-09-13T18:50:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55700eb9eb00 con 0x55700ed1cf70 2024-09-13T18:50:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.134+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55700eb91f40 con 0x55700ed1cf70 2024-09-13T18:50:36.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.138+0000 7f8b97e00700 1 -- 172.21.15.81:0/3548204512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b8c00d040 con 0x55700ed1cf70 2024-09-13T18:50:36.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.138+0000 7f8b97e00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b80065060 0x7f8b80067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.138+0000 7f8b97e00700 1 -- 172.21.15.81:0/3548204512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8b8c00a040 con 0x55700ed1cf70 2024-09-13T18:50:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.142+0000 7f8b9f400700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b80065060 0x7f8b80067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.142+0000 7f8ba229b140 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55700edcd4f0 0x55700edcd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.142+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- osd_op(unknown.0.0:1 7.1d 7:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v8 -- 0x55700edcde40 con 0x55700edcd4f0 2024-09-13T18:50:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.142+0000 7f8b9fe00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55700edcd4f0 0x55700edcd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.142+0000 7f8b9f400700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b80065060 0x7f8b80067520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8b90015040 tx=0x7f8b9000f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.142+0000 7f8b9fe00700 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55700edcd4f0 0x55700edcd900 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8b9fe00700 1 -- 172.21.15.81:0/3548204512 <== osd.1 v2:172.21.15.81:6824/2924937371 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v53'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8b98002960 con 0x55700edcd4f0 2024-09-13T18:50:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55700edcd4f0 msgr2=0x55700edcd900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x55700edcd4f0 0x55700edcd900 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b80065060 msgr2=0x7f8b80067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b80065060 0x7f8b80067520 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8b90015040 tx=0x7f8b9000f000 comp rx=0 tx=0).stop 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 msgr2=0x55700ecacb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 --2- 172.21.15.81:0/3548204512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55700ed1cf70 0x55700ecacb40 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00b640 tx=0x7f8b8c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8b9fe00700 1 -- 172.21.15.81:0/3548204512 reap_dead start 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 shutdown_connections 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 >> 172.21.15.81:0/3548204512 conn(0x55700ec61cb0 msgr2=0x55700ec93e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 shutdown_connections 2024-09-13T18:50:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.146+0000 7f8ba229b140 1 -- 172.21.15.81:0/3548204512 wait complete. 2024-09-13T18:50:36.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /d1/d2/d3 recursive,force 2024-09-13T18:50:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.338+0000 7fb4b1a00700 1 Processor -- start 2024-09-13T18:50:36.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.338+0000 7fb4b1a00700 1 -- start start 2024-09-13T18:50:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4b1a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac144330 0x7fb4ac0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4b1a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4ac06d760 0x7fb4ac0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4b1a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4ac144710 0x7fb4ac0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4b1a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac0cce10 con 0x7fb4ac144710 2024-09-13T18:50:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4b1a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4ac06bcf0 con 0x7fb4ac06d760 2024-09-13T18:50:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4b1a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac06cb50 con 0x7fb4ac144330 2024-09-13T18:50:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4ac144710 0x7fb4ac0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4ac144710 0x7fb4ac0b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56506/0 (socket says 172.21.15.81:56506) 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 -- 172.21.15.81:0/27172094 learned_addr learned my addr 172.21.15.81:0/27172094 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/27172094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac144330 0x7fb4ac0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4aa000700 1 --2- 172.21.15.81:0/27172094 >> v2:172.21.15.178:3300/0 conn(0x7fb4ac06d760 0x7fb4ac0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 -- 172.21.15.81:0/27172094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac144330 msgr2=0x7fb4ac0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 --2- 172.21.15.81:0/27172094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac144330 0x7fb4ac0cef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 -- 172.21.15.81:0/27172094 >> v2:172.21.15.178:3300/0 conn(0x7fb4ac06d760 msgr2=0x7fb4ac0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 --2- 172.21.15.81:0/27172094 >> v2:172.21.15.178:3300/0 conn(0x7fb4ac06d760 0x7fb4ac0b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 -- 172.21.15.81:0/27172094 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ac0cf4b0 con 0x7fb4ac144710 2024-09-13T18:50:36.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.342+0000 7fb4ab400700 1 --2- 172.21.15.81:0/27172094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144710 0x7fb4ac0b3ae0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0cf6e0 tx=0x7fb4a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f180505cf83a9bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4a9600700 1 -- 172.21.15.81:0/27172094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400e070 con 0x7fb4ac144710 2024-09-13T18:50:36.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4a9600700 1 -- 172.21.15.81:0/27172094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a400b910 con 0x7fb4ac144710 2024-09-13T18:50:36.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4a9600700 1 -- 172.21.15.81:0/27172094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a400bcc0 con 0x7fb4ac144710 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 -- 172.21.15.81:0/27172094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144710 msgr2=0x7fb4ac0b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/27172094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144710 0x7fb4ac0b3ae0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac0cf6e0 tx=0x7fb4a400b330 comp rx=0 tx=0).stop 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 -- 172.21.15.81:0/27172094 shutdown_connections 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/27172094 >> v2:172.21.15.178:3300/0 conn(0x7fb4ac06d760 0x7fb4ac0b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/27172094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144710 0x7fb4ac0b3ae0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/27172094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac144330 0x7fb4ac0cef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 -- 172.21.15.81:0/27172094 >> 172.21.15.81:0/27172094 conn(0x7fb4ac06a570 msgr2=0x7fb4ac06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 -- 172.21.15.81:0/27172094 shutdown_connections 2024-09-13T18:50:36.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.346+0000 7fb4b1a00700 1 -- 172.21.15.81:0/27172094 wait complete. 2024-09-13T18:50:36.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 Processor -- start 2024-09-13T18:50:36.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 -- start start 2024-09-13T18:50:36.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac06d760 0x7fb4ac13a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 0x7fb4ac15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4ac15b5c0 0x7fb4ac159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac070ef0 con 0x7fb4ac144330 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac152010 con 0x7fb4ac15b5c0 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4b1a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac13a860 con 0x7fb4ac06d760 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 0x7fb4ac15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 0x7fb4ac15b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56510/0 (socket says 172.21.15.81:56510) 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4aa000700 1 -- 172.21.15.81:0/2187672828 learned_addr learned my addr 172.21.15.81:0/2187672828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac06d760 0x7fb4ac13a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.350+0000 7fb4ab400700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4ac15b5c0 0x7fb4ac159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4aa000700 1 -- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac06d760 msgr2=0x7fb4ac13a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4aa000700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac06d760 0x7fb4ac13a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4aa000700 1 -- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4ac15b5c0 msgr2=0x7fb4ac159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4aa000700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4ac15b5c0 0x7fb4ac159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4aa000700 1 -- 172.21.15.81:0/2187672828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a4009b30 con 0x7fb4ac144330 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4aa000700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 0x7fb4ac15b080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb49800e9d0 tx=0x7fb49800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4a2a00700 1 -- 172.21.15.81:0/2187672828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498009720 con 0x7fb4ac144330 2024-09-13T18:50:36.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4a2a00700 1 -- 172.21.15.81:0/2187672828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49800ee70 con 0x7fb4ac144330 2024-09-13T18:50:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac070270 con 0x7fb4ac144330 2024-09-13T18:50:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4a2a00700 1 -- 172.21.15.81:0/2187672828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49800ca50 con 0x7fb4ac144330 2024-09-13T18:50:36.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.354+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac070830 con 0x7fb4ac144330 2024-09-13T18:50:36.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4a2a00700 1 -- 172.21.15.81:0/2187672828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb49800cbb0 con 0x7fb4ac144330 2024-09-13T18:50:36.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 Processor -- start 2024-09-13T18:50:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 -- start start 2024-09-13T18:50:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4a2a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb48c066760 0x7fb48c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4a2a00700 1 -- 172.21.15.81:0/2187672828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb498084390 con 0x7fb4ac144330 2024-09-13T18:50:36.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4ab400700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb48c066760 0x7fb48c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x1442f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14431ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x14434800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14356530 con 0x143ea5c0 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14353cc0 con 0x143ea1e0 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.358+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1434f5b0 con 0x14432410 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14431ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14431ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56522/0 (socket says 172.21.15.81:56522) 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 -- 172.21.15.81:0/2347731520 learned_addr learned my addr 172.21.15.81:0/2347731520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4ab400700 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x14434800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x1442f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4ab400700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb48c066760 0x7fb48c068c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400b370 tx=0x7fb4a4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 -- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 msgr2=0x14434800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x14434800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 -- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 msgr2=0x1442f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x1442f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 -- 172.21.15.81:0/2347731520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14241f10 con 0x143ea5c0 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x1442f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4aa000700 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14431ed0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb4980516e0 tx=0x7fb4980558e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c66946333983b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb497400700 1 -- 172.21.15.81:0/2347731520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498059010 con 0x143ea5c0 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb497400700 1 -- 172.21.15.81:0/2347731520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49805d5d0 con 0x143ea5c0 2024-09-13T18:50:36.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb497400700 1 -- 172.21.15.81:0/2347731520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4980840b0 con 0x143ea5c0 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 -- 172.21.15.81:0/2347731520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 msgr2=0x14431ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14431ed0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb4980516e0 tx=0x7fb4980558e0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 -- 172.21.15.81:0/2347731520 shutdown_connections 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x14434800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14431ed0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/2347731520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x1442f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 -- 172.21.15.81:0/2347731520 >> 172.21.15.81:0/2347731520 conn(0x141767b0 msgr2=0x14410ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 -- 172.21.15.81:0/2347731520 shutdown_connections 2024-09-13T18:50:36.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 -- 172.21.15.81:0/2347731520 wait complete. 2024-09-13T18:50:36.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 -- start start 2024-09-13T18:50:36.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.362+0000 7fb4b4d19740 1 Processor -- start 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 0x14438780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea5c0 0x1440d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x143e5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14312950 con 0x143ea1e0 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x143125f0 con 0x143ea5c0 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x142e4e40 con 0x14432410 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 10 client.0 _ll_register_callbacks cb 0x14348c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 0x14438780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 0x14438780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56532/0 (socket says 172.21.15.81:56532) 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 -- 172.21.15.81:0/709140181 learned_addr learned my addr 172.21.15.81:0/709140181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4ab400700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x143e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aa000700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea5c0 0x1440d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 -- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 msgr2=0x143e5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x143e5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 -- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea5c0 msgr2=0x1440d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea5c0 0x1440d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 -- 172.21.15.81:0/709140181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac070830 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 0x14438780 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009df0 tx=0x7fb49c0135c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2864cd70c244a0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb48be00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb48be00700 1 -- 172.21.15.81:0/709140181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c004030 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb48be00700 1 -- 172.21.15.81:0/709140181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb49c004190 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x141834c0 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb48be00700 1 -- 172.21.15.81:0/709140181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb49c004350 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 10 client.6411 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x14315630 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb48be00700 1 -- 172.21.15.81:0/709140181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x141834c0 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.366+0000 7fb48be00700 1 -- 172.21.15.81:0/709140181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb49c0036c0 con 0x143ea1e0 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 10 client.6411 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:36.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 10 client.6411 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 20 client.6411 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x143e5aa0 0x143e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 4 client.6411 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x141cd740 con 0x143e5aa0 2024-09-13T18:50:36.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4aa000700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x143e5aa0 0x143e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4aa000700 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x143e5aa0 0x143e81a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b2c770dbbc80894 server_cookie=5e4ae30f93d839f2 in_seq=0 out_seq=0 2024-09-13T18:50:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb48be00700 10 client.6411 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb48be00700 1 -- 172.21.15.81:0/709140181 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x141cd740 con 0x143e5aa0 2024-09-13T18:50:36.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb48be00700 10 client.6411 handle_command_reply: tid=0 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 client.6411 shutdown 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 msgr2=0x14438780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 0x14438780 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009df0 tx=0x7fb49c0135c0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 shutdown_connections 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x143e5aa0 0x143e81a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14432410 0x143e5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb48be00700 0 client.6411 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea5c0 0x1440d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/709140181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea1e0 0x14438780 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 >> 172.21.15.81:0/709140181 conn(0x141767b0 msgr2=0x14430910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 shutdown_connections 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 1 -- 172.21.15.81:0/709140181 wait complete. 2024-09-13T18:50:36.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.370+0000 7fb4b4d19740 20 client.6411 trim_cache size 0 max 16384 2024-09-13T18:50:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.390+0000 7fb4b4d19740 1 Processor -- start 2024-09-13T18:50:36.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.390+0000 7fb4b4d19740 1 -- start start 2024-09-13T18:50:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 0x14431a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x14430910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea5c0 0x14430e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x142ed5d0 con 0x141767b0 2024-09-13T18:50:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x143a6f60 con 0x143ea1e0 2024-09-13T18:50:36.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1431d520 con 0x143ea5c0 2024-09-13T18:50:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 0x14431a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 0x14431a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56538/0 (socket says 172.21.15.81:56538) 2024-09-13T18:50:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 -- 172.21.15.81:0/3605911128 learned_addr learned my addr 172.21.15.81:0/3605911128 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aa000700 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x14430910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4ab400700 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea5c0 0x14430e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 -- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea5c0 msgr2=0x14430e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea5c0 0x14430e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 -- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 msgr2=0x14430910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x14430910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 -- 172.21.15.81:0/3605911128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x142fb860 con 0x141767b0 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 0x14431a50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009890 tx=0x7fb49c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e230559d1dcbd088 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb497e00700 1 -- 172.21.15.81:0/3605911128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0095d0 con 0x141767b0 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb497e00700 1 -- 172.21.15.81:0/3605911128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c00c070 con 0x141767b0 2024-09-13T18:50:36.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb497e00700 1 -- 172.21.15.81:0/3605911128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c013910 con 0x141767b0 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- 172.21.15.81:0/3605911128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 msgr2=0x14431a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 0x14431a50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009890 tx=0x7fb49c017000 comp rx=0 tx=0).stop 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- 172.21.15.81:0/3605911128 shutdown_connections 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea5c0 0x14430e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x143ea1e0 0x14430910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/3605911128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x141767b0 0x14431a50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- 172.21.15.81:0/3605911128 >> 172.21.15.81:0/3605911128 conn(0x144378e0 msgr2=0x14435020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- 172.21.15.81:0/3605911128 shutdown_connections 2024-09-13T18:50:36.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.394+0000 7fb4b4d19740 1 -- 172.21.15.81:0/3605911128 wait complete. 2024-09-13T18:50:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 -- start start 2024-09-13T18:50:36.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 Processor -- start 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea1e0 0x14414f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14414390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14432410 0x144148d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1444edc0 con 0x143ea5c0 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x144353d0 con 0x14432410 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x144154b0 con 0x143ea1e0 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4b4d19740 10 client.0 _ll_register_callbacks cb 0x1434e180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14414390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4aa000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14414390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56546/0 (socket says 172.21.15.81:56546) 2024-09-13T18:50:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.398+0000 7fb4aa000700 1 -- 172.21.15.81:0/789065297 learned_addr learned my addr 172.21.15.81:0/789065297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4ab400700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14432410 0x144148d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea1e0 0x14414f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aa000700 1 -- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea1e0 msgr2=0x14414f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aa000700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea1e0 0x14414f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aa000700 1 -- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14432410 msgr2=0x144148d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aa000700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14432410 0x144148d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aa000700 1 -- 172.21.15.81:0/789065297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x14315630 con 0x143ea5c0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aa000700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14414390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb49800e9a0 tx=0x7fb498084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d92227b13e3eca8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 1 -- 172.21.15.81:0/789065297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498082040 con 0x143ea5c0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb49805d5d0 con 0x143ea5c0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 1 -- 172.21.15.81:0/789065297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb498081070 con 0x143ea5c0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 1 -- 172.21.15.81:0/789065297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4980533e0 con 0x143ea5c0 2024-09-13T18:50:36.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 10 client.6417 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x141c1c40 con 0x143ea5c0 2024-09-13T18:50:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 1 -- 172.21.15.81:0/789065297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49805d5d0 con 0x143ea5c0 2024-09-13T18:50:36.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 1 -- 172.21.15.81:0/789065297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb49805b0c0 con 0x143ea5c0 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 10 client.6417 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 10 client.6417 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 20 client.6417 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x144908a0 0x14490cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 4 client.6417 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x141f4620 con 0x144908a0 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x144908a0 0x14490cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb48be00700 10 client.6417 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.402+0000 7fb4aaa00700 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x144908a0 0x14490cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b05eae466e8f35fb server_cookie=1b07959eb1c1fa57 in_seq=0 out_seq=0 2024-09-13T18:50:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb48be00700 1 -- 172.21.15.81:0/789065297 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x141f4620 con 0x144908a0 2024-09-13T18:50:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb48be00700 10 client.6417 handle_command_reply: tid=0 2024-09-13T18:50:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 client.6417 shutdown 2024-09-13T18:50:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 msgr2=0x14414390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14414390 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb49800e9a0 tx=0x7fb498084040 comp rx=0 tx=0).stop 2024-09-13T18:50:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 shutdown_connections 2024-09-13T18:50:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x144908a0 0x14490cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14432410 0x144148d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x143ea5c0 0x14414390 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 --2- 172.21.15.81:0/789065297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x143ea1e0 0x14414f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 >> 172.21.15.81:0/789065297 conn(0x144378e0 msgr2=0x14434800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb48be00700 0 client.6417 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.416 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:50:36.406+0000 7f13ede00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1) n(v3 rc2024-09-13T18:50:18.930734+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6046 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x563c40f61b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.930734+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:50:18.930734+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:50:36.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 shutdown_connections 2024-09-13T18:50:36.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 1 -- 172.21.15.81:0/789065297 wait complete. 2024-09-13T18:50:36.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b4d19740 20 client.6417 trim_cache size 0 max 16384 2024-09-13T18:50:36.417 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:36.417 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-13T18:50:36.418 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "81a4e7f2-e8fe-4e90-86b1-32406d364c12", 2024-09-13T18:50:36.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-13T18:50:36.418 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:36.418 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:50:36.406+0000 7f9c62800700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1) n(v2 rc2024-09-13T18:50:18.930734+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6046 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55a94a29b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.930734+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:50:18.930734+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb48c066760 msgr2=0x7fb48c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb48c066760 0x7fb48c068c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400b370 tx=0x7fb4a4009000 comp rx=0 tx=0).stop 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 msgr2=0x7fb4ac15b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 0x7fb4ac15b080 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb49800e9d0 tx=0x7fb49800ece0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 shutdown_connections 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb48c066760 0x7fb48c068c20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4ac15b5c0 0x7fb4ac159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4ac144330 0x7fb4ac15b080 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 --2- 172.21.15.81:0/2187672828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4ac06d760 0x7fb4ac13a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 >> 172.21.15.81:0/2187672828 conn(0x7fb4ac06a570 msgr2=0x7fb4ac13ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 shutdown_connections 2024-09-13T18:50:36.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.406+0000 7fb4b1a00700 1 -- 172.21.15.81:0/2187672828 wait complete. 2024-09-13T18:50:36.420 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:50:36.410+0000 7f13f5600700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1) n(v4 rc2024-09-13T18:50:18.930734+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6046=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x563c40f62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.930734+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:50:18.930734+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:50:36.420 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:50:36.410+0000 7f9c6a000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1) n(v1 rc2024-09-13T18:50:18.930734+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6046=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55a94b0ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.666740+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:50:18.930734+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:50:36.420 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:50:36.410+0000 7f0284600700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1) n(v0 rc2024-09-13T18:50:18.666740+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6046 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e3a41e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.666740+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:50:18.666740+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:50:36.421 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:50:36.410+0000 7f0284600700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/AsLsXsFsx@2},l=6046 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e3a41e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:50:36.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub abort 2024-09-13T18:50:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.606+0000 7f62c9800700 1 Processor -- start 2024-09-13T18:50:36.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c9800700 1 -- start start 2024-09-13T18:50:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c9800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c40b5770 0x7f62c4070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c9800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62c406f150 0x7f62c416aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c9800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c406a390 con 0x7f62c406e660 2024-09-13T18:50:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c9800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40b5d30 con 0x7f62c406f150 2024-09-13T18:50:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c9800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c406a5e0 con 0x7f62c40b5770 2024-09-13T18:50:36.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c3e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f62c406e660 0x7f62c406ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55718/0 (socket says 172.21.15.81:55718) 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c3e00700 1 -- 172.21.15.81:0/1066048587 learned_addr learned my addr 172.21.15.81:0/1066048587 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.610+0000 7f62c8e00700 1 --2- 172.21.15.81:0/1066048587 >> v2:172.21.15.81:3300/0 conn(0x7f62c406f150 0x7f62c416aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c3400700 1 --2- 172.21.15.81:0/1066048587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c40b5770 0x7f62c4070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c2a00700 1 -- 172.21.15.81:0/1066048587 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793344987 0 0) 0x7f62c406a390 con 0x7f62c406e660 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c2a00700 1 -- 172.21.15.81:0/1066048587 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a80035d0 con 0x7f62c406e660 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c8e00700 1 -- 172.21.15.81:0/1066048587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c40b5770 msgr2=0x7f62c4070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c8e00700 1 --2- 172.21.15.81:0/1066048587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c40b5770 0x7f62c4070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c8e00700 1 -- 172.21.15.81:0/1066048587 >> v1:172.21.15.81:6789/0 conn(0x7f62c406e660 legacy=0x7f62c406ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c8e00700 1 -- 172.21.15.81:0/1066048587 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c406a8c0 con 0x7f62c406f150 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c8e00700 1 --2- 172.21.15.81:0/1066048587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c406f150 0x7f62c416aa80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009d90 tx=0x7f62bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea50a283fe7c48a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c2a00700 1 -- 172.21.15.81:0/1066048587 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc00e070 con 0x7f62c406f150 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c2a00700 1 -- 172.21.15.81:0/1066048587 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc00bb20 con 0x7f62c406f150 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c2a00700 1 -- 172.21.15.81:0/1066048587 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc012430 con 0x7f62c406f150 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 -- 172.21.15.81:0/1066048587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c406f150 msgr2=0x7f62c416aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 --2- 172.21.15.81:0/1066048587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c406f150 0x7f62c416aa80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009d90 tx=0x7f62bc00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 -- 172.21.15.81:0/1066048587 shutdown_connections 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 --2- 172.21.15.81:0/1066048587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c406f150 0x7f62c416aa80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 --2- 172.21.15.81:0/1066048587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c40b5770 0x7f62c4070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 -- 172.21.15.81:0/1066048587 >> 172.21.15.81:0/1066048587 conn(0x7f62c40b2690 msgr2=0x7f62c40b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 -- 172.21.15.81:0/1066048587 shutdown_connections 2024-09-13T18:50:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.614+0000 7f62c9800700 1 -- 172.21.15.81:0/1066048587 wait complete. 2024-09-13T18:50:36.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.618+0000 7f62c9800700 1 Processor -- start 2024-09-13T18:50:36.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.618+0000 7f62c9800700 1 -- start start 2024-09-13T18:50:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c406e660 0x7f62c41f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c406f150 0x7f62c413d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 0x7f62c413dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c41f6810 con 0x7f62c40b5770 2024-09-13T18:50:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4157f20 con 0x7f62c406e660 2024-09-13T18:50:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4158200 con 0x7f62c406f150 2024-09-13T18:50:36.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 0x7f62c413dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 0x7f62c413dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43802/0 (socket says 172.21.15.81:43802) 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 -- 172.21.15.81:0/3220456006 learned_addr learned my addr 172.21.15.81:0/3220456006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c3e00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c406e660 0x7f62c41f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c3400700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c406f150 0x7f62c413d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 -- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c406f150 msgr2=0x7f62c413d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c406f150 0x7f62c413d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 -- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c406e660 msgr2=0x7f62c41f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c406e660 0x7f62c41f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 -- 172.21.15.81:0/3220456006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009a70 con 0x7f62c40b5770 2024-09-13T18:50:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 0x7f62c413dbf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f62bc014040 tx=0x7f62bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62bbe00700 1 -- 172.21.15.81:0/3220456006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc012430 con 0x7f62c40b5770 2024-09-13T18:50:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62bbe00700 1 -- 172.21.15.81:0/3220456006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc020070 con 0x7f62c40b5770 2024-09-13T18:50:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62bbe00700 1 -- 172.21.15.81:0/3220456006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0098f0 con 0x7f62c40b5770 2024-09-13T18:50:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41584e0 con 0x7f62c40b5770 2024-09-13T18:50:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.622+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c415a5d0 con 0x7f62c40b5770 2024-09-13T18:50:36.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.626+0000 7f62bbe00700 1 -- 172.21.15.81:0/3220456006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62bc004040 con 0x7f62c40b5770 2024-09-13T18:50:36.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.626+0000 7f62bbe00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62a4066730 0x7f62a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62bbe00700 1 -- 172.21.15.81:0/3220456006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62bc022070 con 0x7f62c40b5770 2024-09-13T18:50:36.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3e00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62a4066730 0x7f62a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 Processor -- start 2024-09-13T18:50:36.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 -- start start 2024-09-13T18:50:36.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3e00700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62a4066730 0x7f62a4068bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f62b4007fd0 tx=0x7f62b4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfb1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfd3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2df875f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2defadd0 con 0x2dfb14a0 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2def8560 con 0x2dfd3880 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2def3e50 con 0x2dfd2f60 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfd3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfd3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43818/0 (socket says 172.21.15.81:43818) 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 -- 172.21.15.81:0/1917751329 learned_addr learned my addr 172.21.15.81:0/1917751329 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3e00700 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfb1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c8e00700 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2df875f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 -- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 msgr2=0x2dfb1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfb1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 -- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 msgr2=0x2df875f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2df875f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 -- 172.21.15.81:0/1917751329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2dd66a00 con 0x2dfb14a0 2024-09-13T18:50:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62c3400700 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfd3340 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009c40 tx=0x7f62b0009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd47dc767c992d19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62b8c00700 1 -- 172.21.15.81:0/1917751329 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0011b90 con 0x2dfb14a0 2024-09-13T18:50:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62b8c00700 1 -- 172.21.15.81:0/1917751329 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0011cf0 con 0x2dfb14a0 2024-09-13T18:50:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.630+0000 7f62b8c00700 1 -- 172.21.15.81:0/1917751329 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0004250 con 0x2dfb14a0 2024-09-13T18:50:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- 172.21.15.81:0/1917751329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 msgr2=0x2dfd3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfd3340 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f62b0009c40 tx=0x7f62b0009f50 comp rx=0 tx=0).stop 2024-09-13T18:50:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- 172.21.15.81:0/1917751329 shutdown_connections 2024-09-13T18:50:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2df875f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfd3340 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- 172.21.15.81:0/1917751329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfb1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- 172.21.15.81:0/1917751329 >> 172.21.15.81:0/1917751329 conn(0x2dd1b570 msgr2=0x2dfb42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- 172.21.15.81:0/1917751329 shutdown_connections 2024-09-13T18:50:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- 172.21.15.81:0/1917751329 wait complete. 2024-09-13T18:50:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- start start 2024-09-13T18:50:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 Processor -- start 2024-09-13T18:50:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfc9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2dfda900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2deb1760 con 0x2dfb14a0 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2deb75e0 con 0x2dfd3880 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2dd9fb40 con 0x2dfd2f60 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62ce26b740 10 client.0 _ll_register_callbacks cb 0x2deb8b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62c3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfc9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62c3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfc9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43824/0 (socket says 172.21.15.81:43824) 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62c3e00700 1 -- 172.21.15.81:0/559470302 learned_addr learned my addr 172.21.15.81:0/559470302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62c3400700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.634+0000 7f62c8e00700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2dfda900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3e00700 1 -- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 msgr2=0x2dfca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3e00700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3e00700 1 -- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 msgr2=0x2dfda900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3e00700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2dfda900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3e00700 1 -- 172.21.15.81:0/559470302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b0009810 con 0x2dfb14a0 2024-09-13T18:50:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3e00700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfc9ac0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001e00 tx=0x7f62b4001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9980721119b51d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 1 -- 172.21.15.81:0/559470302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4026070 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 1 -- 172.21.15.81:0/559470302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62b401c040 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2dd28280 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 1 -- 172.21.15.81:0/559470302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62b4014c60 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 10 client.6432 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x2deba250 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 1 -- 172.21.15.81:0/559470302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4030020 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 1 -- 172.21.15.81:0/559470302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f62b4029020 con 0x2dfb14a0 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 10 client.6432 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 10 client.6432 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 20 client.6432 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2dfd96f0 0x2dfd9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 4 client.6432 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2dd72500 con 0x2dfd96f0 2024-09-13T18:50:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3400700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2dfd96f0 0x2dfd9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62ad600700 10 client.6432 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.638+0000 7f62c3400700 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2dfd96f0 0x2dfd9b00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14a333897a8c9911 server_cookie=35bd06a1c3098b40 in_seq=0 out_seq=0 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ad600700 1 -- 172.21.15.81:0/559470302 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2dd72500 con 0x2dfd96f0 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ad600700 10 client.6432 handle_command_reply: tid=0 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 client.6432 shutdown 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 msgr2=0x2dfc9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfc9ac0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f62b4001e00 tx=0x7f62b4001150 comp rx=0 tx=0).stop 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 shutdown_connections 2024-09-13T18:50:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2dfd96f0 0x2dfd9b00 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfd3880 0x2dfda900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 --2- 172.21.15.81:0/559470302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfb14a0 0x2dfc9ac0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 >> 172.21.15.81:0/559470302 conn(0x2dd1b570 msgr2=0x2dfac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ad600700 0 client.6432 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 shutdown_connections 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 1 -- 172.21.15.81:0/559470302 wait complete. 2024-09-13T18:50:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.642+0000 7f62ce26b740 20 client.6432 trim_cache size 0 max 16384 2024-09-13T18:50:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 Processor -- start 2024-09-13T18:50:36.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 -- start start 2024-09-13T18:50:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2dfad290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2debe520 con 0x2dfd3880 2024-09-13T18:50:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2debe330 con 0x2dfb14a0 2024-09-13T18:50:36.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2deb5ec0 con 0x2dfd2f60 2024-09-13T18:50:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62c8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62c8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43832/0 (socket says 172.21.15.81:43832) 2024-09-13T18:50:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62c8e00700 1 -- 172.21.15.81:0/3247049593 learned_addr learned my addr 172.21.15.81:0/3247049593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62c3400700 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.662+0000 7f62c3e00700 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2dfad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62c8e00700 1 -- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 msgr2=0x2dfd0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62c8e00700 1 -- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 msgr2=0x2dfad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2dfad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62c8e00700 1 -- 172.21.15.81:0/3247049593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2dea0480 con 0x2dfd3880 2024-09-13T18:50:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd0ec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0842c0 tx=0x7f62bc0569b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a1a1495e41fa29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62b9600700 1 -- 172.21.15.81:0/3247049593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc05ab70 con 0x2dfd3880 2024-09-13T18:50:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62b9600700 1 -- 172.21.15.81:0/3247049593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc05f130 con 0x2dfd3880 2024-09-13T18:50:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62b9600700 1 -- 172.21.15.81:0/3247049593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc003e10 con 0x2dfd3880 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 -- 172.21.15.81:0/3247049593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 msgr2=0x2dfd0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd0ec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0842c0 tx=0x7f62bc0569b0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 -- 172.21.15.81:0/3247049593 shutdown_connections 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd0ec0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3247049593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2dfad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 -- 172.21.15.81:0/3247049593 >> 172.21.15.81:0/3247049593 conn(0x2dd1b570 msgr2=0x2dfac710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 -- 172.21.15.81:0/3247049593 shutdown_connections 2024-09-13T18:50:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 -- 172.21.15.81:0/3247049593 wait complete. 2024-09-13T18:50:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.666+0000 7f62ce26b740 1 -- start start 2024-09-13T18:50:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 Processor -- start 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2e033e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2deb6110 con 0x2dfd3880 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2dff2710 con 0x2dfb14a0 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2dfd2160 con 0x2dfd2f60 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ce26b740 10 client.0 _ll_register_callbacks cb 0x2de99cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2e033e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c3400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43842/0 (socket says 172.21.15.81:43842) 2024-09-13T18:50:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 -- 172.21.15.81:0/3367118370 learned_addr learned my addr 172.21.15.81:0/3367118370 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 -- 172.21.15.81:0/3367118370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 msgr2=0x2dfd7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 -- 172.21.15.81:0/3367118370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 msgr2=0x2e033e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2e033e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 -- 172.21.15.81:0/3367118370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c415a5d0 con 0x2dfd3880 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62c8e00700 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd84f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f62bc05a040 tx=0x7f62bc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fce48e501069da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.670+0000 7f62ad600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 1 -- 172.21.15.81:0/3367118370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc05eea0 con 0x2dfd3880 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 1 -- 172.21.15.81:0/3367118370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f62bc05ab70 con 0x2dfd3880 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62b0011cf0 con 0x2dfd3880 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 1 -- 172.21.15.81:0/3367118370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62bc003e10 con 0x2dfd3880 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 10 client.6438 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x2de94750 con 0x2dfd3880 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 1 -- 172.21.15.81:0/3367118370 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0011cf0 con 0x2dfd3880 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 1 -- 172.21.15.81:0/3367118370 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f62bc06ab80 con 0x2dfd3880 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 10 client.6438 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 10 client.6438 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 20 client.6438 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2e0343a0 0x2dff0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 4 client.6438 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x2dd97280 con 0x2e0343a0 2024-09-13T18:50:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62c3e00700 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2e0343a0 0x2dff0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62c3e00700 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2e0343a0 0x2dff0110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=421cfecb72c4d217 server_cookie=d4d005ef772eb083 in_seq=0 out_seq=0 2024-09-13T18:50:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 10 client.6438 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 1 -- 172.21.15.81:0/3367118370 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x7f62b4030030 con 0x2e0343a0 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 10 client.6438 handle_command_reply: tid=0 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 client.6438 shutdown 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 msgr2=0x2dfd84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd84f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f62bc05a040 tx=0x7f62bc009750 comp rx=0 tx=0).stop 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 shutdown_connections 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x2e0343a0 0x2dff0110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2dfd3880 0x2dfd84f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2dfd2f60 0x2dfd7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 --2- 172.21.15.81:0/3367118370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2dfb14a0 0x2e033e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ad600700 0 client.6438 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 >> 172.21.15.81:0/3367118370 conn(0x2dd1b570 msgr2=0x2dfd9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 shutdown_connections 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 1 -- 172.21.15.81:0/3367118370 wait complete. 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62ce26b740 20 client.6438 trim_cache size 0 max 16384 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:50:36.688 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62a4066730 msgr2=0x7f62a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62c9800700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62a4066730 0x7f62a4068bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f62b4007fd0 tx=0x7f62b4007de0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 msgr2=0x7f62c413dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.674+0000 7f62c9800700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 0x7f62c413dbf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f62bc014040 tx=0x7f62bc004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 shutdown_connections 2024-09-13T18:50:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62a4066730 0x7f62a4068bf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62c40b5770 0x7f62c413dbf0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62c406f150 0x7f62c413d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 --2- 172.21.15.81:0/3220456006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62c406e660 0x7f62c41f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 >> 172.21.15.81:0/3220456006 conn(0x7f62c40b2690 msgr2=0x7f62c415f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 shutdown_connections 2024-09-13T18:50:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.678+0000 7f62c9800700 1 -- 172.21.15.81:0/3220456006 wait complete. 2024-09-13T18:50:36.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-13T18:50:36.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.874+0000 7f521fa00700 1 Processor -- start 2024-09-13T18:50:36.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.878+0000 7f521fa00700 1 -- start start 2024-09-13T18:50:36.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.878+0000 7f521fa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5218157500 0x7f52180ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.878+0000 7f521fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52180cd140 0x7f52180cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.878+0000 7f521fa00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52180b57e0 con 0x7f521815e030 2024-09-13T18:50:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.878+0000 7f521fa00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52180cdb30 con 0x7f5218157500 2024-09-13T18:50:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.878+0000 7f521fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180b3b80 con 0x7f52180cd140 2024-09-13T18:50:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f521815e030 0x7f5218070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55732/0 (socket says 172.21.15.81:55732) 2024-09-13T18:50:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217e00700 1 -- 172.21.15.81:0/1484855335 learned_addr learned my addr 172.21.15.81:0/1484855335 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521da00700 1 --2- 172.21.15.81:0/1484855335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52180cd140 0x7f52180cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521d000700 1 --2- 172.21.15.81:0/1484855335 >> v2:172.21.15.178:3300/0 conn(0x7f5218157500 0x7f52180ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217400700 1 -- 172.21.15.81:0/1484855335 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614873388 0 0) 0x7f52180b57e0 con 0x7f521815e030 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217400700 1 -- 172.21.15.81:0/1484855335 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52000035d0 con 0x7f521815e030 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521da00700 1 -- 172.21.15.81:0/1484855335 >> v2:172.21.15.178:3300/0 conn(0x7f5218157500 msgr2=0x7f52180ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521da00700 1 --2- 172.21.15.81:0/1484855335 >> v2:172.21.15.178:3300/0 conn(0x7f5218157500 0x7f52180ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521da00700 1 -- 172.21.15.81:0/1484855335 >> v1:172.21.15.81:6789/0 conn(0x7f521815e030 legacy=0x7f5218070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521da00700 1 -- 172.21.15.81:0/1484855335 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52180b5a80 con 0x7f52180cd140 2024-09-13T18:50:36.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521d000700 1 --2- 172.21.15.81:0/1484855335 >> v2:172.21.15.178:3300/0 conn(0x7f5218157500 0x7f52180ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521da00700 1 --2- 172.21.15.81:0/1484855335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52180cd140 0x7f52180cd5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5210009dc0 tx=0x7f521000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5fc3a24ccacd79f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217400700 1 -- 172.21.15.81:0/1484855335 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000e070 con 0x7f52180cd140 2024-09-13T18:50:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217400700 1 -- 172.21.15.81:0/1484855335 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521000bae0 con 0x7f52180cd140 2024-09-13T18:50:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f5217400700 1 -- 172.21.15.81:0/1484855335 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000be90 con 0x7f52180cd140 2024-09-13T18:50:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521fa00700 1 -- 172.21.15.81:0/1484855335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52180cd140 msgr2=0x7f52180cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.882+0000 7f521fa00700 1 --2- 172.21.15.81:0/1484855335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52180cd140 0x7f52180cd5f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5210009dc0 tx=0x7f521000b330 comp rx=0 tx=0).stop 2024-09-13T18:50:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- 172.21.15.81:0/1484855335 shutdown_connections 2024-09-13T18:50:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 --2- 172.21.15.81:0/1484855335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52180cd140 0x7f52180cd5f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 --2- 172.21.15.81:0/1484855335 >> v2:172.21.15.178:3300/0 conn(0x7f5218157500 0x7f52180ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- 172.21.15.81:0/1484855335 >> 172.21.15.81:0/1484855335 conn(0x7f521806e660 msgr2=0x7f521806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- 172.21.15.81:0/1484855335 shutdown_connections 2024-09-13T18:50:36.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- 172.21.15.81:0/1484855335 wait complete. 2024-09-13T18:50:36.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 Processor -- start 2024-09-13T18:50:36.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- start start 2024-09-13T18:50:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 0x7f521813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5218157500 0x7f521815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f521815e030 0x7f521815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52181525c0 con 0x7f52180cd140 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521813de80 con 0x7f521815e030 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52180cf360 con 0x7f5218157500 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 0x7f521813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 0x7f521813d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43854/0 (socket says 172.21.15.81:43854) 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521d000700 1 -- 172.21.15.81:0/2132064319 learned_addr learned my addr 172.21.15.81:0/2132064319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f5217e00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5218157500 0x7f521815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.886+0000 7f521da00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f521815e030 0x7f521815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521d000700 1 -- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5218157500 msgr2=0x7f521815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521d000700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5218157500 0x7f521815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521d000700 1 -- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f521815e030 msgr2=0x7f521815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521d000700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f521815e030 0x7f521815fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521d000700 1 -- 172.21.15.81:0/2132064319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0094b0 con 0x7f52180cd140 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521da00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f521815e030 0x7f521815fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521d000700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 0x7f521813d940 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f520c00ebe0 tx=0x7f520c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f5214c00700 1 -- 172.21.15.81:0/2132064319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c00c910 con 0x7f52180cd140 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f5214c00700 1 -- 172.21.15.81:0/2132064319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c00ca70 con 0x7f52180cd140 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210009a70 con 0x7f52180cd140 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f5214c00700 1 -- 172.21.15.81:0/2132064319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c00ce00 con 0x7f52180cd140 2024-09-13T18:50:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.890+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218152ab0 con 0x7f52180cd140 2024-09-13T18:50:36.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.894+0000 7f5214c00700 1 -- 172.21.15.81:0/2132064319 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f520c013470 con 0x7f52180cd140 2024-09-13T18:50:36.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.894+0000 7f5214c00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f51f8066730 0x7f51f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.894+0000 7f5214c00700 1 -- 172.21.15.81:0/2132064319 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f520c084820 con 0x7f52180cd140 2024-09-13T18:50:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.894+0000 7f5217e00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f51f8066730 0x7f51f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.894+0000 7f5217e00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f51f8066730 0x7f51f8068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f52180b0740 tx=0x7f5204009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 Processor -- start 2024-09-13T18:50:36.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 -- start start 2024-09-13T18:50:36.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39607d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39608270 0x395bb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3954f010 con 0x39607950 2024-09-13T18:50:36.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x394dcf40 con 0x39608270 2024-09-13T18:50:36.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3952fe30 con 0x395e5d00 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43860/0 (socket says 172.21.15.81:43860) 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 -- 172.21.15.81:0/3285395913 learned_addr learned my addr 172.21.15.81:0/3285395913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5217e00700 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39607d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521da00700 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39608270 0x395bb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 -- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 msgr2=0x39607d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39607d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 -- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39608270 msgr2=0x395bb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39608270 0x395bb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 -- 172.21.15.81:0/3285395913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3939ba40 con 0x39607950 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f521d000700 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e6240 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f520c051c20 tx=0x7f520c055080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3184a5b3312334d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5209600700 1 -- 172.21.15.81:0/3285395913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c059550 con 0x39607950 2024-09-13T18:50:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5209600700 1 -- 172.21.15.81:0/3285395913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c05db10 con 0x39607950 2024-09-13T18:50:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.898+0000 7f5209600700 1 -- 172.21.15.81:0/3285395913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c059170 con 0x39607950 2024-09-13T18:50:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- 172.21.15.81:0/3285395913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 msgr2=0x395e6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e6240 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f520c051c20 tx=0x7f520c055080 comp rx=0 tx=0).stop 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- 172.21.15.81:0/3285395913 shutdown_connections 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39608270 0x395bb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39607d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- 172.21.15.81:0/3285395913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e6240 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- 172.21.15.81:0/3285395913 >> 172.21.15.81:0/3285395913 conn(0x393505b0 msgr2=0x395c19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- 172.21.15.81:0/3285395913 shutdown_connections 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- 172.21.15.81:0/3285395913 wait complete. 2024-09-13T18:50:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- start start 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 Processor -- start 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x395e5d00 0x395e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39608270 0x39606530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3952b150 con 0x39607950 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x39528eb0 con 0x395e5d00 2024-09-13T18:50:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x394e68e0 con 0x39608270 2024-09-13T18:50:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5222e33740 10 client.0 _ll_register_callbacks cb 0x394c5670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:36.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5217e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5217e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43872/0 (socket says 172.21.15.81:43872) 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f5217e00700 1 -- 172.21.15.81:0/2391855235 learned_addr learned my addr 172.21.15.81:0/2391855235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f521d000700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x395e5d00 0x395e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.902+0000 7f521da00700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39608270 0x39606530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5217e00700 1 -- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39608270 msgr2=0x39606530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5217e00700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39608270 0x39606530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5217e00700 1 -- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x395e5d00 msgr2=0x395e53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5217e00700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x395e5d00 0x395e53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5217e00700 1 -- 172.21.15.81:0/2391855235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5218152ab0 con 0x39607950 2024-09-13T18:50:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5217e00700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e8680 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f52040074a0 tx=0x7f5204001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62998863112dc300 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 1 -- 172.21.15.81:0/2391855235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040148c0 con 0x39607950 2024-09-13T18:50:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3935d2c0 con 0x39607950 2024-09-13T18:50:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 1 -- 172.21.15.81:0/2391855235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5204014a20 con 0x39607950 2024-09-13T18:50:36.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 1 -- 172.21.15.81:0/2391855235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5204014be0 con 0x39607950 2024-09-13T18:50:36.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 10 client.6450 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:36.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x394ef290 con 0x39607950 2024-09-13T18:50:36.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 1 -- 172.21.15.81:0/2391855235 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3935d2c0 con 0x39607950 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 1 -- 172.21.15.81:0/2391855235 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5204004890 con 0x39607950 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 10 client.6450 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 10 client.6450 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 20 client.6450 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395e6ca0 0x395e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 4 client.6450 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x393a7540 con 0x395e6ca0 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f521d000700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395e6ca0 0x395e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f521d000700 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395e6ca0 0x395e70b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f1177186aff5eb2 server_cookie=89bd79a6c607b675 in_seq=0 out_seq=0 2024-09-13T18:50:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.906+0000 7f51fe000700 10 client.6450 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:36.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f51fe000700 1 -- 172.21.15.81:0/2391855235 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x393a7540 con 0x395e6ca0 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f51fe000700 10 client.6450 handle_command_reply: tid=0 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 client.6450 shutdown 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 msgr2=0x395e8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e8680 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f52040074a0 tx=0x7f5204001150 comp rx=0 tx=0).stop 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 shutdown_connections 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39608270 0x39606530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395e6ca0 0x395e70b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39607950 0x395e8680 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 --2- 172.21.15.81:0/2391855235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x395e5d00 0x395e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f51fe000700 0 client.6450 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 >> 172.21.15.81:0/2391855235 conn(0x393505b0 msgr2=0x395badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 shutdown_connections 2024-09-13T18:50:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 1 -- 172.21.15.81:0/2391855235 wait complete. 2024-09-13T18:50:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.910+0000 7f5222e33740 20 client.6450 trim_cache size 0 max 16384 2024-09-13T18:50:36.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 Processor -- start 2024-09-13T18:50:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 -- start start 2024-09-13T18:50:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x395e7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x395e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x395e7b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x393d4b80 con 0x39608270 2024-09-13T18:50:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x394b2a50 con 0x39607950 2024-09-13T18:50:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x394f9c00 con 0x395e5d00 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x395e7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x395e7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43886/0 (socket says 172.21.15.81:43886) 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 -- 172.21.15.81:0/520728475 learned_addr learned my addr 172.21.15.81:0/520728475 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5217e00700 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x395e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521d000700 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x395e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 -- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 msgr2=0x395e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x395e7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 -- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 msgr2=0x395e75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x395e75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f521da00700 1 -- 172.21.15.81:0/520728475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x394d54c0 con 0x39608270 2024-09-13T18:50:36.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.930+0000 7f5217e00700 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x395e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f521da00700 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x395e7b00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f52180b3cc0 tx=0x7f5210011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c92f45f5588d740 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f520a000700 1 -- 172.21.15.81:0/520728475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210003cd0 con 0x39608270 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f520a000700 1 -- 172.21.15.81:0/520728475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210003e30 con 0x39608270 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f520a000700 1 -- 172.21.15.81:0/520728475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210004280 con 0x39608270 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- 172.21.15.81:0/520728475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 msgr2=0x395e7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x395e7b00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f52180b3cc0 tx=0x7f5210011000 comp rx=0 tx=0).stop 2024-09-13T18:50:36.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- 172.21.15.81:0/520728475 shutdown_connections 2024-09-13T18:50:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x395e7b00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x395e75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- 172.21.15.81:0/520728475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x395e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- 172.21.15.81:0/520728475 >> 172.21.15.81:0/520728475 conn(0x393505b0 msgr2=0x396180a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- 172.21.15.81:0/520728475 shutdown_connections 2024-09-13T18:50:36.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- 172.21.15.81:0/520728475 wait complete. 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- start start 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 Processor -- start 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39668ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x39669a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x39669fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x395266c0 con 0x39608270 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3961f4e0 con 0x39607950 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x396278f0 con 0x395e5d00 2024-09-13T18:50:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.934+0000 7f5222e33740 10 client.0 _ll_register_callbacks cb 0x394f88f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x39669fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x39669fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43900/0 (socket says 172.21.15.81:43900) 2024-09-13T18:50:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 -- 172.21.15.81:0/3997943131 learned_addr learned my addr 172.21.15.81:0/3997943131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521d000700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39668ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5217e00700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x39669a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 -- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 msgr2=0x39668ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39668ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 -- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 msgr2=0x39669a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x39669a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 -- 172.21.15.81:0/3997943131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52180b5a80 con 0x39608270 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521da00700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x39669fb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f521000d010 tx=0x7f5210004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf73265b43f323c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 1 -- 172.21.15.81:0/3997943131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5210003cd0 con 0x39608270 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 1 -- 172.21.15.81:0/3997943131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5210031850 con 0x39608270 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f520c05db10 con 0x39608270 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 1 -- 172.21.15.81:0/3997943131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5210004950 con 0x39608270 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 10 client.6456 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:36.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x394c9790 con 0x39608270 2024-09-13T18:50:36.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 1 -- 172.21.15.81:0/3997943131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c05db10 con 0x39608270 2024-09-13T18:50:36.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 1 -- 172.21.15.81:0/3997943131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5210031a10 con 0x39608270 2024-09-13T18:50:36.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 10 client.6456 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:36.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 10 client.6456 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 20 client.6456 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395bd620 0x3966a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 4 client.6456 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x393cc2c0 con 0x395bd620 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521d000700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395bd620 0x3966a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f51fe000700 10 client.6456 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.938+0000 7f521d000700 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395bd620 0x3966a4f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bbb21362616894b server_cookie=1f1c76f70f1b6b9c in_seq=0 out_seq=0 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f51fe000700 1 -- 172.21.15.81:0/3997943131 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x393cc2c0 con 0x395bd620 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f51fe000700 10 client.6456 handle_command_reply: tid=0 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 client.6456 shutdown 2024-09-13T18:50:36.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 msgr2=0x39669fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x39669fb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f521000d010 tx=0x7f5210004b60 comp rx=0 tx=0).stop 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 shutdown_connections 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x395bd620 0x3966a4f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39608270 0x39669fb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x39607950 0x39669a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 --2- 172.21.15.81:0/3997943131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x395e5d00 0x39668ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f51fe000700 0 client.6456 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 >> 172.21.15.81:0/3997943131 conn(0x393505b0 msgr2=0x395e78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 shutdown_connections 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 1 -- 172.21.15.81:0/3997943131 wait complete. 2024-09-13T18:50:36.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f5222e33740 20 client.6456 trim_cache size 0 max 16384 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: "81a4e7f2-e8fe-4e90-86b1-32406d364c12": { 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "81a4e7f2-e8fe-4e90-86b1-32406d364c12", 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:36.955 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f51f8066730 msgr2=0x7f51f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f51f8066730 0x7f51f8068bf0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f52180b0740 tx=0x7f5204009040 comp rx=0 tx=0).stop 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 msgr2=0x7f521813d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 0x7f521813d940 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f520c00ebe0 tx=0x7f520c009ed0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 shutdown_connections 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f51f8066730 0x7f51f8068bf0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f521815e030 0x7f521815fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5218157500 0x7f521815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 --2- 172.21.15.81:0/2132064319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52180cd140 0x7f521813d940 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 >> 172.21.15.81:0/2132064319 conn(0x7f521806e660 msgr2=0x7f52180b4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 shutdown_connections 2024-09-13T18:50:36.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:36.942+0000 7f521fa00700 1 -- 172.21.15.81:0/2132064319 wait complete. 2024-09-13T18:50:41.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-13T18:50:42.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.142+0000 7f5bc0e00700 1 Processor -- start 2024-09-13T18:50:42.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.142+0000 7f5bc0e00700 1 -- start start 2024-09-13T18:50:42.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bc0e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bbc143b70 0x7f5bbc0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bc0e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5bbc06d070 0x7f5bbc0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bc0e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0b1980 con 0x7f5bbc06d620 2024-09-13T18:50:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bc0e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0b2500 con 0x7f5bbc143b70 2024-09-13T18:50:42.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bc0e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0b1bd0 con 0x7f5bbc06d070 2024-09-13T18:50:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbb400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bbc143b70 0x7f5bbc0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbaa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5bbc06d620 0x7f5bbc06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55740/0 (socket says 172.21.15.81:55740) 2024-09-13T18:50:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbaa00700 1 -- 172.21.15.81:0/2939964214 learned_addr learned my addr 172.21.15.81:0/2939964214 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/2939964214 >> v2:172.21.15.178:3300/0 conn(0x7f5bbc06d070 0x7f5bbc0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bba000700 1 -- 172.21.15.81:0/2939964214 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632389552 0 0) 0x7f5bbc0b1980 con 0x7f5bbc06d620 2024-09-13T18:50:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bba000700 1 -- 172.21.15.81:0/2939964214 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba00035d0 con 0x7f5bbc06d620 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbb400700 1 -- 172.21.15.81:0/2939964214 >> v2:172.21.15.178:3300/0 conn(0x7f5bbc06d070 msgr2=0x7f5bbc0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbb400700 1 --2- 172.21.15.81:0/2939964214 >> v2:172.21.15.178:3300/0 conn(0x7f5bbc06d070 0x7f5bbc0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbb400700 1 -- 172.21.15.81:0/2939964214 >> v1:172.21.15.81:6789/0 conn(0x7f5bbc06d620 legacy=0x7f5bbc06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbb400700 1 -- 172.21.15.81:0/2939964214 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0b1eb0 con 0x7f5bbc143b70 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.146+0000 7f5bbb400700 1 --2- 172.21.15.81:0/2939964214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc143b70 0x7f5bbc0cde20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0cb4d0 tx=0x7f5bac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909dbb148455f14f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bba000700 1 -- 172.21.15.81:0/2939964214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac011830 con 0x7f5bbc143b70 2024-09-13T18:50:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bba000700 1 -- 172.21.15.81:0/2939964214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac011990 con 0x7f5bbc143b70 2024-09-13T18:50:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bba000700 1 -- 172.21.15.81:0/2939964214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac011d20 con 0x7f5bbc143b70 2024-09-13T18:50:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 -- 172.21.15.81:0/2939964214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc143b70 msgr2=0x7f5bbc0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/2939964214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc143b70 0x7f5bbc0cde20 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0cb4d0 tx=0x7f5bac009b30 comp rx=0 tx=0).stop 2024-09-13T18:50:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 -- 172.21.15.81:0/2939964214 shutdown_connections 2024-09-13T18:50:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/2939964214 >> v2:172.21.15.178:3300/0 conn(0x7f5bbc06d070 0x7f5bbc0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/2939964214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc143b70 0x7f5bbc0cde20 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 -- 172.21.15.81:0/2939964214 >> 172.21.15.81:0/2939964214 conn(0x7f5bbc06a390 msgr2=0x7f5bbc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 -- 172.21.15.81:0/2939964214 shutdown_connections 2024-09-13T18:50:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.150+0000 7f5bc0e00700 1 -- 172.21.15.81:0/2939964214 wait complete. 2024-09-13T18:50:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 Processor -- start 2024-09-13T18:50:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 -- start start 2024-09-13T18:50:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 0x7f5bbc1f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bbc06d620 0x7f5bbc159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bbc143b70 0x7f5bbc1f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15a510 con 0x7f5bbc06d070 2024-09-13T18:50:42.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15a230 con 0x7f5bbc06d620 2024-09-13T18:50:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15a860 con 0x7f5bbc143b70 2024-09-13T18:50:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 0x7f5bbc1f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 0x7f5bbc1f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43916/0 (socket says 172.21.15.81:43916) 2024-09-13T18:50:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 -- 172.21.15.81:0/3972155576 learned_addr learned my addr 172.21.15.81:0/3972155576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 -- 172.21.15.81:0/3972155576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bbc143b70 msgr2=0x7f5bbc1f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bbc143b70 0x7f5bbc1f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 -- 172.21.15.81:0/3972155576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bbc06d620 msgr2=0x7f5bbc159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bbc06d620 0x7f5bbc159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 -- 172.21.15.81:0/3972155576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0094b0 con 0x7f5bbc06d070 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 0x7f5bbc1f37b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5bac014040 tx=0x7f5bac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bb3400700 1 -- 172.21.15.81:0/3972155576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac0036c0 con 0x7f5bbc06d070 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bb3400700 1 -- 172.21.15.81:0/3972155576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac01e070 con 0x7f5bbc06d070 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bb3400700 1 -- 172.21.15.81:0/3972155576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003a40 con 0x7f5bbc06d070 2024-09-13T18:50:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc15ab40 con 0x7f5bbc06d070 2024-09-13T18:50:42.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.154+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc157420 con 0x7f5bbc06d070 2024-09-13T18:50:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.158+0000 7f5bb3400700 1 -- 172.21.15.81:0/3972155576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5bac003ba0 con 0x7f5bbc06d070 2024-09-13T18:50:42.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.158+0000 7f5bb3400700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b9c066730 0x7f5b9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.158+0000 7f5bb3400700 1 -- 172.21.15.81:0/3972155576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5bac085380 con 0x7f5bbc06d070 2024-09-13T18:50:42.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.158+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b9c066730 0x7f5b9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b9c066730 0x7f5b9c068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0748f0 tx=0x7f5ba80079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 Processor -- start 2024-09-13T18:50:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 -- start start 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 0x3ed6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3efe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f20550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e67010 con 0x3f1fd90 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3df4f40 con 0x3ed5310 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.162+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3e47e30 con 0x3f20170 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 0x3ed6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 0x3ed6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43932/0 (socket says 172.21.15.81:43932) 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 -- 172.21.15.81:0/607752110 learned_addr learned my addr 172.21.15.81:0/607752110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:42.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3efe520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f20550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 -- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 msgr2=0x3f20550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f20550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 -- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 msgr2=0x3efe520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3efe520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 -- 172.21.15.81:0/607752110 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3cb3a40 con 0x3f1fd90 2024-09-13T18:50:42.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bbb400700 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 0x3ed6810 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5bac055f60 tx=0x7f5bac052650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a619d09f3acaf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5ba7e00700 1 -- 172.21.15.81:0/607752110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac05a090 con 0x3f1fd90 2024-09-13T18:50:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5ba7e00700 1 -- 172.21.15.81:0/607752110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac05e650 con 0x3f1fd90 2024-09-13T18:50:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5ba7e00700 1 -- 172.21.15.81:0/607752110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac054600 con 0x3f1fd90 2024-09-13T18:50:42.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 -- 172.21.15.81:0/607752110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 msgr2=0x3ed6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 0x3ed6810 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f5bac055f60 tx=0x7f5bac052650 comp rx=0 tx=0).stop 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 -- 172.21.15.81:0/607752110 shutdown_connections 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f20550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3efe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/607752110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f1fd90 0x3ed6810 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 -- 172.21.15.81:0/607752110 >> 172.21.15.81:0/607752110 conn(0x3c685b0 msgr2=0x3ed9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 -- 172.21.15.81:0/607752110 shutdown_connections 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 -- 172.21.15.81:0/607752110 wait complete. 2024-09-13T18:50:42.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 -- start start 2024-09-13T18:50:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.166+0000 7f5bc57c6740 1 Processor -- start 2024-09-13T18:50:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3efcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3ef94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f1e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e43150 con 0x3ed5310 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e40eb0 con 0x3f1fd90 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dfe8e0 con 0x3f20170 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 10 client.0 _ll_register_callbacks cb 0x3ddd670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3efcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3efcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43936/0 (socket says 172.21.15.81:43936) 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 -- 172.21.15.81:0/2390653248 learned_addr learned my addr 172.21.15.81:0/2390653248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3ef94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f1e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 -- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 msgr2=0x3f1e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f1e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 -- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 msgr2=0x3ef94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3ef94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 -- 172.21.15.81:0/2390653248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc157420 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbb400700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3efcde0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5bac055d30 tx=0x7f5bac009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61cefc573132e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5ba4c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5ba4c00700 1 -- 172.21.15.81:0/2390653248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac071070 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5ba4c00700 1 -- 172.21.15.81:0/2390653248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5bac054600 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3c752c0 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5ba4c00700 1 -- 172.21.15.81:0/2390653248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bac083210 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 10 client.6471 fetch_fsmap learned FSMap version 41 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=2+}) v3 -- 0x3e07290 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5ba4c00700 1 -- 172.21.15.81:0/2390653248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3c752c0 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5ba4c00700 1 -- 172.21.15.81:0/2390653248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 41) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5bac0564c0 con 0x3ed5310 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 10 client.6471 fetch_fsmap finished waiting for FSMap version 41 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 10 client.6471 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 20 client.6471 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3efd320 0x3ef7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 4 client.6471 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3cbf540 con 0x3efd320 2024-09-13T18:50:42.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.170+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3efd320 0x3ef7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5ba4c00700 10 client.6471 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3efd320 0x3ef7b30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=94889e3ed87a5f1d server_cookie=1b8ae6a30a2c7205 in_seq=0 out_seq=0 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5ba4c00700 1 -- 172.21.15.81:0/2390653248 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3cbf540 con 0x3efd320 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5ba4c00700 10 client.6471 handle_command_reply: tid=0 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 client.6471 shutdown 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 msgr2=0x3efcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3efcde0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f5bac055d30 tx=0x7f5bac009240 comp rx=0 tx=0).stop 2024-09-13T18:50:42.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 shutdown_connections 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f1e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3ef94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3efd320 0x3ef7b30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/2390653248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3efcde0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 >> 172.21.15.81:0/2390653248 conn(0x3c685b0 msgr2=0x3efe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5ba4c00700 0 client.6471 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 shutdown_connections 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 1 -- 172.21.15.81:0/2390653248 wait complete. 2024-09-13T18:50:42.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.174+0000 7f5bc57c6740 20 client.6471 trim_cache size 0 max 16384 2024-09-13T18:50:42.189 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:50:42.178+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:50:42.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 Processor -- start 2024-09-13T18:50:42.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 -- start start 2024-09-13T18:50:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3f28780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3f32b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f33040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3cecb80 con 0x3ed5310 2024-09-13T18:50:42.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3de62a0 con 0x3f1fd90 2024-09-13T18:50:42.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3de5bd0 con 0x3f20170 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3f28780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bbb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3f28780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43952/0 (socket says 172.21.15.81:43952) 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.194+0000 7f5bbb400700 1 -- 172.21.15.81:0/3006443040 learned_addr learned my addr 172.21.15.81:0/3006443040 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3f32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f33040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbb400700 1 -- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 msgr2=0x3f33040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f33040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbb400700 1 -- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 msgr2=0x3f32b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3f32b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbb400700 1 -- 172.21.15.81:0/3006443040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3ded4c0 con 0x3ed5310 2024-09-13T18:50:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f33040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:42.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3f28780 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5bac012fd0 tx=0x7f5bac07f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecee27ca5b6921c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bb0c00700 1 -- 172.21.15.81:0/3006443040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac071050 con 0x3ed5310 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bb0c00700 1 -- 172.21.15.81:0/3006443040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac081070 con 0x3ed5310 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bb0c00700 1 -- 172.21.15.81:0/3006443040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac055bc0 con 0x3ed5310 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3006443040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 msgr2=0x3f28780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3f28780 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5bac012fd0 tx=0x7f5bac07f070 comp rx=0 tx=0).stop 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3006443040 shutdown_connections 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f20170 0x3f33040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3f1fd90 0x3f32b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3006443040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ed5310 0x3f28780 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3006443040 >> 172.21.15.81:0/3006443040 conn(0x3c685b0 msgr2=0x3f2ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3006443040 shutdown_connections 2024-09-13T18:50:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.198+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3006443040 wait complete. 2024-09-13T18:50:42.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 -- start start 2024-09-13T18:50:42.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 Processor -- start 2024-09-13T18:50:42.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3f38330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f1fd90 0x3f80330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 0x3f80870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3efaeb0 con 0x3f20170 2024-09-13T18:50:42.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3f37800 con 0x3ed5310 2024-09-13T18:50:42.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3eda860 con 0x3f1fd90 2024-09-13T18:50:42.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bc57c6740 10 client.0 _ll_register_callbacks cb 0x3e3f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:42.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 0x3f80870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 0x3f80870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43964/0 (socket says 172.21.15.81:43964) 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 -- 172.21.15.81:0/3363250029 learned_addr learned my addr 172.21.15.81:0/3363250029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbaa00700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f1fd90 0x3f80330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3f38330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 -- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f1fd90 msgr2=0x3f80330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f1fd90 0x3f80330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 -- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 msgr2=0x3f38330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3f38330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 -- 172.21.15.81:0/3363250029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3e07290 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5bbbe00700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 0x3f80870 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4004430 tx=0x7f5bb4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=902ec75c1d8c1408 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.202+0000 7f5ba4c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 1 -- 172.21.15.81:0/3363250029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4013740 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 1 -- 172.21.15.81:0/3363250029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5bb40138a0 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5bac05e650 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 1 -- 172.21.15.81:0/3363250029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bb4013a60 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 10 client.6477 fetch_fsmap learned FSMap version 42 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x3de1790 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 1 -- 172.21.15.81:0/3363250029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac05e650 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 1 -- 172.21.15.81:0/3363250029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 42) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5bb4013bc0 con 0x3f20170 2024-09-13T18:50:42.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 10 client.6477 fetch_fsmap finished waiting for FSMap version 42 2024-09-13T18:50:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 10 client.6477 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 20 client.6477 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3f80db0 0x3f35cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 4 client.6477 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:50:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x3ce42c0 con 0x3f80db0 2024-09-13T18:50:42.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3f80db0 0x3f35cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bbb400700 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3f80db0 0x3f35cd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64d490e3eb97fbee server_cookie=ef638d52241b9764 in_seq=0 out_seq=0 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 10 client.6477 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 1 -- 172.21.15.81:0/3363250029 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x3ce42c0 con 0x3f80db0 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 10 client.6477 handle_command_reply: tid=0 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 client.6477 shutdown 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 msgr2=0x3f80870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 0x3f80870 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4004430 tx=0x7f5bb4004740 comp rx=0 tx=0).stop 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 shutdown_connections 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3f80db0 0x3f35cd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3f20170 0x3f80870 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3f1fd90 0x3f80330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 --2- 172.21.15.81:0/3363250029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ed5310 0x3f38330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5ba4c00700 0 client.6477 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 >> 172.21.15.81:0/3363250029 conn(0x3c685b0 msgr2=0x3f28780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 shutdown_connections 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 1 -- 172.21.15.81:0/3363250029 wait complete. 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.206+0000 7f5bc57c6740 20 client.6477 trim_cache size 0 max 16384 2024-09-13T18:50:42.219 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "81a4e7f2-e8fe-4e90-86b1-32406d364c12": { 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "81a4e7f2-e8fe-4e90-86b1-32406d364c12", 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:42.220 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b9c066730 msgr2=0x7f5b9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b9c066730 0x7f5b9c068bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0748f0 tx=0x7f5ba80079e0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 msgr2=0x7f5bbc1f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 0x7f5bbc1f37b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5bac014040 tx=0x7f5bac004770 comp rx=0 tx=0).stop 2024-09-13T18:50:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 shutdown_connections 2024-09-13T18:50:42.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b9c066730 0x7f5b9c068bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bbc143b70 0x7f5bbc1f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bbc06d620 0x7f5bbc159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 --2- 172.21.15.81:0/3972155576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bbc06d070 0x7f5bbc1f37b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 >> 172.21.15.81:0/3972155576 conn(0x7f5bbc06a390 msgr2=0x7f5bbc0af230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 shutdown_connections 2024-09-13T18:50:42.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:42.210+0000 7f5bc0e00700 1 -- 172.21.15.81:0/3972155576 wait complete. 2024-09-13T18:50:43.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:43.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:50:47.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-13T18:50:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.406+0000 7ff81fa00700 1 Processor -- start 2024-09-13T18:50:47.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81fa00700 1 -- start start 2024-09-13T18:50:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81fa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8180cf3b0 0x7ff81815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81fa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff81815a6b0 0x7ff818070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81fa00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff81815df90 con 0x7ff8180ce280 2024-09-13T18:50:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81fa00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81815e420 con 0x7ff81815a6b0 2024-09-13T18:50:47.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81fa00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff81815aea0 con 0x7ff8180cf3b0 2024-09-13T18:50:47.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81d000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff8180ce280 0x7ff8180ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34618/0 (socket says 172.21.15.81:34618) 2024-09-13T18:50:47.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81d000700 1 -- 172.21.15.81:0/3038887714 learned_addr learned my addr 172.21.15.81:0/3038887714 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:47.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff81da00700 1 --2- 172.21.15.81:0/3038887714 >> v2:172.21.15.81:3300/0 conn(0x7ff81815a6b0 0x7ff818070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.410+0000 7ff817e00700 1 --2- 172.21.15.81:0/3038887714 >> v2:172.21.15.178:3300/0 conn(0x7ff8180cf3b0 0x7ff81815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81da00700 1 -- 172.21.15.81:0/3038887714 >> v2:172.21.15.178:3300/0 conn(0x7ff8180cf3b0 msgr2=0x7ff81815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81da00700 1 --2- 172.21.15.81:0/3038887714 >> v2:172.21.15.178:3300/0 conn(0x7ff8180cf3b0 0x7ff81815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81da00700 1 -- 172.21.15.81:0/3038887714 >> v1:172.21.15.81:6789/0 conn(0x7ff8180ce280 legacy=0x7ff8180ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81da00700 1 -- 172.21.15.81:0/3038887714 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81815d660 con 0x7ff81815a6b0 2024-09-13T18:50:47.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff817400700 1 -- 172.21.15.81:0/3038887714 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424517496 0 0) 0x7ff81815df90 con 0x7ff8180ce280 2024-09-13T18:50:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81da00700 1 --2- 172.21.15.81:0/3038887714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81815a6b0 0x7ff818070ca0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff818154500 tx=0x7ff81000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5624f7b75173e081 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff817400700 1 -- 172.21.15.81:0/3038887714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000e070 con 0x7ff81815a6b0 2024-09-13T18:50:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff817400700 1 -- 172.21.15.81:0/3038887714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000bb20 con 0x7ff81815a6b0 2024-09-13T18:50:47.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff817400700 1 -- 172.21.15.81:0/3038887714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810012430 con 0x7ff81815a6b0 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 -- 172.21.15.81:0/3038887714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81815a6b0 msgr2=0x7ff818070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3038887714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81815a6b0 0x7ff818070ca0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ff818154500 tx=0x7ff81000b330 comp rx=0 tx=0).stop 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 -- 172.21.15.81:0/3038887714 shutdown_connections 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3038887714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff81815a6b0 0x7ff818070ca0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3038887714 >> v2:172.21.15.178:3300/0 conn(0x7ff8180cf3b0 0x7ff81815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 -- 172.21.15.81:0/3038887714 >> 172.21.15.81:0/3038887714 conn(0x7ff81806a570 msgr2=0x7ff81806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 -- 172.21.15.81:0/3038887714 shutdown_connections 2024-09-13T18:50:47.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.414+0000 7ff81fa00700 1 -- 172.21.15.81:0/3038887714 wait complete. 2024-09-13T18:50:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 Processor -- start 2024-09-13T18:50:47.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 -- start start 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 0x7ff81814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8180cf3b0 0x7ff8181f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff81815a6b0 0x7ff8181f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81814cd30 con 0x7ff8180ce280 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff81814eeb0 con 0x7ff81815a6b0 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff81814e330 con 0x7ff8180cf3b0 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 0x7ff81814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 0x7ff81814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56338/0 (socket says 172.21.15.81:56338) 2024-09-13T18:50:47.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 -- 172.21.15.81:0/3592790568 learned_addr learned my addr 172.21.15.81:0/3592790568 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 -- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8180cf3b0 msgr2=0x7ff8181f60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff817e00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8180cf3b0 0x7ff8181f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81da00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff81815a6b0 0x7ff8181f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8180cf3b0 0x7ff8181f60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 -- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff81815a6b0 msgr2=0x7ff8181f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff81815a6b0 0x7ff8181f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81d000700 1 -- 172.21.15.81:0/3592790568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810009a70 con 0x7ff8180ce280 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff817e00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8180cf3b0 0x7ff8181f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:47.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.418+0000 7ff81da00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff81815a6b0 0x7ff8181f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff81d000700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 0x7ff81814d9e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00c4e0 tx=0x7ff80c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff814c00700 1 -- 172.21.15.81:0/3592790568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c004ca0 con 0x7ff8180ce280 2024-09-13T18:50:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff814c00700 1 -- 172.21.15.81:0/3592790568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c004e20 con 0x7ff8180ce280 2024-09-13T18:50:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff814c00700 1 -- 172.21.15.81:0/3592790568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c007310 con 0x7ff8180ce280 2024-09-13T18:50:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff81814e610 con 0x7ff8180ce280 2024-09-13T18:50:47.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81814ebd0 con 0x7ff8180ce280 2024-09-13T18:50:47.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.422+0000 7ff814c00700 1 -- 172.21.15.81:0/3592790568 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff80c007470 con 0x7ff8180ce280 2024-09-13T18:50:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.426+0000 7ff814c00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7f8066730 0x7ff7f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.426+0000 7ff814c00700 1 -- 172.21.15.81:0/3592790568 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff80c083fe0 con 0x7ff8180ce280 2024-09-13T18:50:47.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.426+0000 7ff817e00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7f8066730 0x7ff7f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.426+0000 7ff817e00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7f8066730 0x7ff7f8068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff818153490 tx=0x7ff804008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.426+0000 7ff822cd3740 1 Processor -- start 2024-09-13T18:50:47.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.426+0000 7ff822cd3740 1 -- start start 2024-09-13T18:50:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11687240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x116a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x1165c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x115f0010 con 0x116a8950 2024-09-13T18:50:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1157df40 con 0x116a9270 2024-09-13T18:50:47.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x115d0e30 con 0x11686d00 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11687240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11687240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56342/0 (socket says 172.21.15.81:56342) 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 -- 172.21.15.81:0/3951770876 learned_addr learned my addr 172.21.15.81:0/3951770876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff817e00700 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x116a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81da00700 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x1165c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 -- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 msgr2=0x116a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x116a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 -- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 msgr2=0x1165c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x1165c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 -- 172.21.15.81:0/3951770876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1143ca40 con 0x116a8950 2024-09-13T18:50:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81da00700 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x1165c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff81d000700 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11687240 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff80c05cd50 tx=0x7ff80c0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5121e7334d1d8935 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff809600700 1 -- 172.21.15.81:0/3951770876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c055ea0 con 0x116a8950 2024-09-13T18:50:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff809600700 1 -- 172.21.15.81:0/3951770876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c054e90 con 0x116a8950 2024-09-13T18:50:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff809600700 1 -- 172.21.15.81:0/3951770876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c058cc0 con 0x116a8950 2024-09-13T18:50:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- 172.21.15.81:0/3951770876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 msgr2=0x11687240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11687240 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff80c05cd50 tx=0x7ff80c0077a0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- 172.21.15.81:0/3951770876 shutdown_connections 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x1165c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x116a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3951770876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11687240 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- 172.21.15.81:0/3951770876 >> 172.21.15.81:0/3951770876 conn(0x113f15b0 msgr2=0x116629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- 172.21.15.81:0/3951770876 shutdown_connections 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.430+0000 7ff822cd3740 1 -- 172.21.15.81:0/3951770876 wait complete. 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 -- start start 2024-09-13T18:50:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 Processor -- start 2024-09-13T18:50:47.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 0x11682550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a8950 0x11681ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x116a4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x115cc150 con 0x11686d00 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x115c9eb0 con 0x116a9270 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x115878e0 con 0x116a8950 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff822cd3740 10 client.0 _ll_register_callbacks cb 0x11566670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 0x11682550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 0x11682550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56348/0 (socket says 172.21.15.81:56348) 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 -- 172.21.15.81:0/1920035542 learned_addr learned my addr 172.21.15.81:0/1920035542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff817e00700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a8950 0x11681ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81da00700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x116a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 -- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a8950 msgr2=0x11681ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a8950 0x11681ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 -- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 msgr2=0x116a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x116a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 -- 172.21.15.81:0/1920035542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81814ebd0 con 0x11686d00 2024-09-13T18:50:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81da00700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x116a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.434+0000 7ff81d000700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 0x11682550 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00c4b0 tx=0x7ff80c057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b3bce8eba08eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 1 -- 172.21.15.81:0/1920035542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c055ea0 con 0x11686d00 2024-09-13T18:50:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 1 -- 172.21.15.81:0/1920035542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff80c05d280 con 0x11686d00 2024-09-13T18:50:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x113fe2c0 con 0x11686d00 2024-09-13T18:50:47.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 1 -- 172.21.15.81:0/1920035542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff80c0511d0 con 0x11686d00 2024-09-13T18:50:47.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 10 client.6492 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:47.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x11590290 con 0x11686d00 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 1 -- 172.21.15.81:0/1920035542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x113fe2c0 con 0x11686d00 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 1 -- 172.21.15.81:0/1920035542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff80c054380 con 0x11686d00 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 10 client.6492 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 10 client.6492 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 20 client.6492 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x11682000 0x116600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 4 client.6492 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11448540 con 0x11682000 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff817e00700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x11682000 0x116600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff817e00700 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x11682000 0x116600c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e3f323334f65512 server_cookie=dcc846bf4e1be4d0 in_seq=0 out_seq=0 2024-09-13T18:50:47.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 10 client.6492 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 1 -- 172.21.15.81:0/1920035542 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x11448540 con 0x11682000 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff7fe000700 10 client.6492 handle_command_reply: tid=0 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.438+0000 7ff822cd3740 1 client.6492 shutdown 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 msgr2=0x11682550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 0x11682550 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00c4b0 tx=0x7ff80c057040 comp rx=0 tx=0).stop 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 shutdown_connections 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a9270 0x116a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a8950 0x11681ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x11682000 0x116600c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1920035542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11686d00 0x11682550 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 >> 172.21.15.81:0/1920035542 conn(0x113f15b0 msgr2=0x1165ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff7fe000700 0 client.6492 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 shutdown_connections 2024-09-13T18:50:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 1 -- 172.21.15.81:0/1920035542 wait complete. 2024-09-13T18:50:47.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.442+0000 7ff822cd3740 20 client.6492 trim_cache size 0 max 16384 2024-09-13T18:50:47.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 Processor -- start 2024-09-13T18:50:47.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 -- start start 2024-09-13T18:50:47.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 0x116a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11680a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a9270 0x11680fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x11475b80 con 0x116a8950 2024-09-13T18:50:47.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x11553a50 con 0x11686d00 2024-09-13T18:50:47.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x115f1610 con 0x116a9270 2024-09-13T18:50:47.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff81d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 0x116a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff817e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11680a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff81da00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a9270 0x11680fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff81d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 0x116a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:36940/0 (socket says 172.21.15.81:36940) 2024-09-13T18:50:47.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.462+0000 7ff81d000700 1 -- 172.21.15.81:0/1777288838 learned_addr learned my addr 172.21.15.81:0/1777288838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff81d000700 1 -- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a9270 msgr2=0x11680fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff81d000700 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a9270 0x11680fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff81d000700 1 -- 172.21.15.81:0/1777288838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 msgr2=0x11680a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff81d000700 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11680a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff81d000700 1 -- 172.21.15.81:0/1777288838 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x115764c0 con 0x11686d00 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff81d000700 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 0x116a7900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff80c054e20 tx=0x7ff80c054d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a64f0b1c859062e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff80a000700 1 -- 172.21.15.81:0/1777288838 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c055ea0 con 0x11686d00 2024-09-13T18:50:47.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff80a000700 1 -- 172.21.15.81:0/1777288838 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c00e040 con 0x11686d00 2024-09-13T18:50:47.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff80a000700 1 -- 172.21.15.81:0/1777288838 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c00e280 con 0x11686d00 2024-09-13T18:50:47.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 -- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 msgr2=0x116a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 0x116a7900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff80c054e20 tx=0x7ff80c054d90 comp rx=0 tx=0).stop 2024-09-13T18:50:47.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 -- 172.21.15.81:0/1777288838 shutdown_connections 2024-09-13T18:50:47.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116a9270 0x11680fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a8950 0x11680a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 --2- 172.21.15.81:0/1777288838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11686d00 0x116a7900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 -- 172.21.15.81:0/1777288838 >> 172.21.15.81:0/1777288838 conn(0x113f15b0 msgr2=0x11661080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 -- 172.21.15.81:0/1777288838 shutdown_connections 2024-09-13T18:50:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 -- 172.21.15.81:0/1777288838 wait complete. 2024-09-13T18:50:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 -- start start 2024-09-13T18:50:47.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.466+0000 7ff822cd3740 1 Processor -- start 2024-09-13T18:50:47.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x11709990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a8950 0x1167f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 0x1167fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x115c76c0 con 0x116a9270 2024-09-13T18:50:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1159ac00 con 0x116a8950 2024-09-13T18:50:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11568620 con 0x11686d00 2024-09-13T18:50:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff822cd3740 10 client.0 _ll_register_callbacks cb 0x115998f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 0x1167fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 0x1167fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56374/0 (socket says 172.21.15.81:56374) 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 -- 172.21.15.81:0/3348819442 learned_addr learned my addr 172.21.15.81:0/3348819442 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff817e00700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a8950 0x1167f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81d000700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x11709990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 -- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 msgr2=0x11709990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x11709990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 -- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a8950 msgr2=0x1167f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a8950 0x1167f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 -- 172.21.15.81:0/3348819442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x11590290 con 0x116a9270 2024-09-13T18:50:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff81da00700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 0x1167fc20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff810012810 tx=0x7ff81000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c0e4745eacc0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.470+0000 7ff7fe000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 1 -- 172.21.15.81:0/3348819442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff810022070 con 0x116a9270 2024-09-13T18:50:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 1 -- 172.21.15.81:0/3348819442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff810003e20 con 0x116a9270 2024-09-13T18:50:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1146d2c0 con 0x116a9270 2024-09-13T18:50:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 1 -- 172.21.15.81:0/3348819442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8100128f0 con 0x116a9270 2024-09-13T18:50:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 10 client.6498 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x1156a790 con 0x116a9270 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 1 -- 172.21.15.81:0/3348819442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1146d2c0 con 0x116a9270 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 1 -- 172.21.15.81:0/3348819442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff810012a50 con 0x116a9270 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 10 client.6498 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 10 client.6498 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 20 client.6498 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x116c0910 0x116bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 4 client.6498 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x116a7030 con 0x116c0910 2024-09-13T18:50:47.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff81d000700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x116c0910 0x116bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff81d000700 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x116c0910 0x116bdd10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43ca8af13da6c8cc server_cookie=229a881c94529488 in_seq=0 out_seq=0 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 10 client.6498 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 1 -- 172.21.15.81:0/3348819442 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x116a7030 con 0x116c0910 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 10 client.6498 handle_command_reply: tid=0 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 client.6498 shutdown 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 msgr2=0x1167fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 0x1167fc20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff810012810 tx=0x7ff81000e000 comp rx=0 tx=0).stop 2024-09-13T18:50:47.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 shutdown_connections 2024-09-13T18:50:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x116c0910 0x116bdd10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x116a9270 0x1167fc20 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116a8950 0x1167f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 --2- 172.21.15.81:0/3348819442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11686d00 0x11709990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 >> 172.21.15.81:0/3348819442 conn(0x113f15b0 msgr2=0x116809b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff7fe000700 0 client.6498 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 shutdown_connections 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 1 -- 172.21.15.81:0/3348819442 wait complete. 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.474+0000 7ff822cd3740 20 client.6498 trim_cache size 0 max 16384 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "81a4e7f2-e8fe-4e90-86b1-32406d364c12": { 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:50:47.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "81a4e7f2-e8fe-4e90-86b1-32406d364c12", 2024-09-13T18:50:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:50:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:47.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:50:47.488 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7f8066730 msgr2=0x7ff7f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7f8066730 0x7ff7f8068bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff818153490 tx=0x7ff804008040 comp rx=0 tx=0).stop 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 msgr2=0x7ff81814d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 0x7ff81814d9e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00c4e0 tx=0x7ff80c00c8a0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 shutdown_connections 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7f8066730 0x7ff7f8068bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff81815a6b0 0x7ff8181f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8180cf3b0 0x7ff8181f60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 --2- 172.21.15.81:0/3592790568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8180ce280 0x7ff81814d9e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 >> 172.21.15.81:0/3592790568 conn(0x7ff81806a570 msgr2=0x7ff818070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 shutdown_connections 2024-09-13T18:50:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:47.478+0000 7ff81fa00700 1 -- 172.21.15.81:0/3592790568 wait complete. 2024-09-13T18:50:50.417 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:50:50.406+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:50:52.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-13T18:50:52.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.690+0000 7f1a8b200700 1 Processor -- start 2024-09-13T18:50:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.690+0000 7f1a8b200700 1 -- start start 2024-09-13T18:50:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a840b3dd0 0x7f1a84072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a840b41b0 0x7f1a8406dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a84162170 0x7f1a840cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a840729a0 con 0x7f1a840b41b0 2024-09-13T18:50:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a84161480 con 0x7f1a84162170 2024-09-13T18:50:52.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8406e290 con 0x7f1a840b3dd0 2024-09-13T18:50:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a89e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a840b3dd0 0x7f1a84072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a89400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a840b41b0 0x7f1a8406dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a8a800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a84162170 0x7f1a840cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a89e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a840b3dd0 0x7f1a84072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:43428/0 (socket says 172.21.15.81:43428) 2024-09-13T18:50:52.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.694+0000 7f1a89e00700 1 -- 172.21.15.81:0/4134287537 learned_addr learned my addr 172.21.15.81:0/4134287537 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8a800700 1 -- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a840b3dd0 msgr2=0x7f1a84072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8a800700 1 --2- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a840b3dd0 0x7f1a84072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8a800700 1 -- 172.21.15.81:0/4134287537 >> v2:172.21.15.81:3300/0 conn(0x7f1a840b41b0 msgr2=0x7f1a8406dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8a800700 1 --2- 172.21.15.81:0/4134287537 >> v2:172.21.15.81:3300/0 conn(0x7f1a840b41b0 0x7f1a8406dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8a800700 1 -- 172.21.15.81:0/4134287537 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840726c0 con 0x7f1a84162170 2024-09-13T18:50:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a89400700 1 --2- 172.21.15.81:0/4134287537 >> v2:172.21.15.81:3300/0 conn(0x7f1a840b41b0 0x7f1a8406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8a800700 1 --2- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a84162170 0x7f1a840cf3e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1a8406e430 tx=0x7f1a8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4386ab3d6ec6e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a88a00700 1 -- 172.21.15.81:0/4134287537 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80016070 con 0x7f1a84162170 2024-09-13T18:50:52.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a88a00700 1 -- 172.21.15.81:0/4134287537 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8000baf0 con 0x7f1a84162170 2024-09-13T18:50:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a88a00700 1 -- 172.21.15.81:0/4134287537 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8000e070 con 0x7f1a84162170 2024-09-13T18:50:52.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 -- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a84162170 msgr2=0x7f1a840cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 --2- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a84162170 0x7f1a840cf3e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1a8406e430 tx=0x7f1a8000b330 comp rx=0 tx=0).stop 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 -- 172.21.15.81:0/4134287537 shutdown_connections 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 --2- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a84162170 0x7f1a840cf3e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 --2- 172.21.15.81:0/4134287537 >> v2:172.21.15.81:3300/0 conn(0x7f1a840b41b0 0x7f1a8406dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 --2- 172.21.15.81:0/4134287537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a840b3dd0 0x7f1a84072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 -- 172.21.15.81:0/4134287537 >> 172.21.15.81:0/4134287537 conn(0x7f1a8406a780 msgr2=0x7f1a8406ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 -- 172.21.15.81:0/4134287537 shutdown_connections 2024-09-13T18:50:52.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.698+0000 7f1a8b200700 1 -- 172.21.15.81:0/4134287537 wait complete. 2024-09-13T18:50:52.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 Processor -- start 2024-09-13T18:50:52.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 -- start start 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 0x7f1a840cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a840b41b0 0x7f1a840cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a84162170 0x7f1a8415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840ce460 con 0x7f1a840b3dd0 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8415bc60 con 0x7f1a840b41b0 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a840b0af0 con 0x7f1a84162170 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a89e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 0x7f1a840cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a89e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 0x7f1a840cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56392/0 (socket says 172.21.15.81:56392) 2024-09-13T18:50:52.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a89e00700 1 -- 172.21.15.81:0/900598953 learned_addr learned my addr 172.21.15.81:0/900598953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a8a800700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a84162170 0x7f1a8415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a89400700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a840b41b0 0x7f1a840cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a89e00700 1 -- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a84162170 msgr2=0x7f1a8415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.702+0000 7f1a89e00700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a84162170 0x7f1a8415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a89e00700 1 -- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a840b41b0 msgr2=0x7f1a840cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a89e00700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a840b41b0 0x7f1a840cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a89e00700 1 -- 172.21.15.81:0/900598953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740094b0 con 0x7f1a840b3dd0 2024-09-13T18:50:52.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a89e00700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 0x7f1a840cb670 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e8a0 tx=0x7f1a7800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a7e000700 1 -- 172.21.15.81:0/900598953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78013680 con 0x7f1a840b3dd0 2024-09-13T18:50:52.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a7e000700 1 -- 172.21.15.81:0/900598953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a780137e0 con 0x7f1a840b3dd0 2024-09-13T18:50:52.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a80009a70 con 0x7f1a840b3dd0 2024-09-13T18:50:52.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a7e000700 1 -- 172.21.15.81:0/900598953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78013b90 con 0x7f1a840b3dd0 2024-09-13T18:50:52.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.706+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a840b01c0 con 0x7f1a840b3dd0 2024-09-13T18:50:52.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.710+0000 7f1a7e000700 1 -- 172.21.15.81:0/900598953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a78013cf0 con 0x7f1a840b3dd0 2024-09-13T18:50:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.710+0000 7f1a7e000700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a68066730 0x7f1a68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.710+0000 7f1a7e000700 1 -- 172.21.15.81:0/900598953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a78084070 con 0x7f1a840b3dd0 2024-09-13T18:50:52.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.710+0000 7f1a89400700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a68066730 0x7f1a68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.710+0000 7f1a89400700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a68066730 0x7f1a68068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a8415da00 tx=0x7f1a74009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.710+0000 7f1a8fb72740 1 Processor -- start 2024-09-13T18:50:52.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 -- start start 2024-09-13T18:50:52.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e5e7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e60f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e631170 0x3e631550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e578010 con 0x3e5e6310 2024-09-13T18:50:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e505f40 con 0x3e631170 2024-09-13T18:50:52.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3e558e30 con 0x3e630d90 2024-09-13T18:50:52.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e60f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e60f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56400/0 (socket says 172.21.15.81:56400) 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 -- 172.21.15.81:0/1447545311 learned_addr learned my addr 172.21.15.81:0/1447545311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89e00700 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e5e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8a800700 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e631170 0x3e631550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 -- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 msgr2=0x3e5e7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e5e7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 -- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e631170 msgr2=0x3e631550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e631170 0x3e631550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 -- 172.21.15.81:0/1447545311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3e3c4a40 con 0x3e5e6310 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a8a800700 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e631170 0x3e631550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a89400700 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e60f520 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1a74011e60 tx=0x7f1a74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2705a4f12dcd72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a72600700 1 -- 172.21.15.81:0/1447545311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74011e90 con 0x3e5e6310 2024-09-13T18:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a72600700 1 -- 172.21.15.81:0/1447545311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74014dc0 con 0x3e5e6310 2024-09-13T18:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.714+0000 7f1a72600700 1 -- 172.21.15.81:0/1447545311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740215f0 con 0x3e5e6310 2024-09-13T18:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1447545311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 msgr2=0x3e60f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e60f520 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1a74011e60 tx=0x7f1a74014000 comp rx=0 tx=0).stop 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1447545311 shutdown_connections 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e631170 0x3e631550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e60f520 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1447545311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e5e7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1447545311 >> 172.21.15.81:0/1447545311 conn(0x3e3795b0 msgr2=0x3e5eab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1447545311 shutdown_connections 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1447545311 wait complete. 2024-09-13T18:50:52.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- start start 2024-09-13T18:50:52.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 Processor -- start 2024-09-13T18:50:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e5e6310 0x3e60a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e631550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 0x3e60e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e554150 con 0x3e631170 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e551eb0 con 0x3e5e6310 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3e50f8e0 con 0x3e630d90 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.718+0000 7f1a8fb72740 10 client.0 _ll_register_callbacks cb 0x3e4ee670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 0x3e60e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 0x3e60e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56410/0 (socket says 172.21.15.81:56410) 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 -- 172.21.15.81:0/664896762 learned_addr learned my addr 172.21.15.81:0/664896762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a89400700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e631550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a89e00700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e5e6310 0x3e60a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 -- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 msgr2=0x3e631550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e631550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 -- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e5e6310 msgr2=0x3e60a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e5e6310 0x3e60a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 -- 172.21.15.81:0/664896762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a74011b10 con 0x3e631170 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8a800700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 0x3e60e030 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1a84070880 tx=0x7f1a80004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fe647a5ef62fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 1 -- 172.21.15.81:0/664896762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a80016040 con 0x3e631170 2024-09-13T18:50:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 1 -- 172.21.15.81:0/664896762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a80004780 con 0x3e631170 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3e3862c0 con 0x3e631170 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 1 -- 172.21.15.81:0/664896762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a80003e60 con 0x3e631170 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 10 client.6510 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x3e518290 con 0x3e631170 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 1 -- 172.21.15.81:0/664896762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3e3862c0 con 0x3e631170 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 1 -- 172.21.15.81:0/664896762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f1a80025480 con 0x3e631170 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 10 client.6510 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 10 client.6510 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 20 client.6510 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e60be30 0x3e608880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 4 client.6510 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3e3d0540 con 0x3e60be30 2024-09-13T18:50:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a89e00700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e60be30 0x3e608880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a89e00700 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e60be30 0x3e608880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=83aaf4898a8f5ed9 server_cookie=ffdb3e8726634240 in_seq=0 out_seq=0 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.722+0000 7f1a66a00700 10 client.6510 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a66a00700 1 -- 172.21.15.81:0/664896762 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3e3d0540 con 0x3e60be30 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a66a00700 10 client.6510 handle_command_reply: tid=0 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 client.6510 shutdown 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 msgr2=0x3e60e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 0x3e60e030 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f1a84070880 tx=0x7f1a80004b60 comp rx=0 tx=0).stop 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 shutdown_connections 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e60be30 0x3e608880 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e631170 0x3e60e030 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e630d90 0x3e631550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a66a00700 0 client.6510 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/664896762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e5e6310 0x3e60a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 >> 172.21.15.81:0/664896762 conn(0x3e3795b0 msgr2=0x3e60f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 shutdown_connections 2024-09-13T18:50:52.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 1 -- 172.21.15.81:0/664896762 wait complete. 2024-09-13T18:50:52.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.726+0000 7f1a8fb72740 20 client.6510 trim_cache size 0 max 16384 2024-09-13T18:50:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 Processor -- start 2024-09-13T18:50:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 -- start start 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e62d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e62dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e644920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e3fdb80 con 0x3e5e6310 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e4dba50 con 0x3e630d90 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3e54f6c0 con 0x3e3795b0 2024-09-13T18:50:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e62dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e62dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56422/0 (socket says 172.21.15.81:56422) 2024-09-13T18:50:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 -- 172.21.15.81:0/1071529527 learned_addr learned my addr 172.21.15.81:0/1071529527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a8a800700 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e644920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89e00700 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e62d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 -- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 msgr2=0x3e62d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e62d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 -- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 msgr2=0x3e644920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e644920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.746+0000 7f1a89400700 1 -- 172.21.15.81:0/1071529527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3e5e7a60 con 0x3e5e6310 2024-09-13T18:50:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a89400700 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e62dae0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1a74014a00 tx=0x7f1a74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4be099dfddd6842 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a73000700 1 -- 172.21.15.81:0/1071529527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74030070 con 0x3e5e6310 2024-09-13T18:50:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a73000700 1 -- 172.21.15.81:0/1071529527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a74011930 con 0x3e5e6310 2024-09-13T18:50:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a73000700 1 -- 172.21.15.81:0/1071529527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74004240 con 0x3e5e6310 2024-09-13T18:50:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1071529527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 msgr2=0x3e62dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e62dae0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1a74014a00 tx=0x7f1a74016000 comp rx=0 tx=0).stop 2024-09-13T18:50:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1071529527 shutdown_connections 2024-09-13T18:50:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e644920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e62dae0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1071529527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e62d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1071529527 >> 172.21.15.81:0/1071529527 conn(0x3e5eaf10 msgr2=0x3e648b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1071529527 shutdown_connections 2024-09-13T18:50:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1071529527 wait complete. 2024-09-13T18:50:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.750+0000 7f1a8fb72740 1 -- start start 2024-09-13T18:50:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 Processor -- start 2024-09-13T18:50:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e64f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e64de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e64e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e4f0620 con 0x3e5e6310 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3e522c00 con 0x3e630d90 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3e64f060 con 0x3e3795b0 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8fb72740 10 client.0 _ll_register_callbacks cb 0x3e550610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e64de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a8a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e64e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e64f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e64de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56428/0 (socket says 172.21.15.81:56428) 2024-09-13T18:50:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 -- 172.21.15.81:0/1240571272 learned_addr learned my addr 172.21.15.81:0/1240571272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 -- 172.21.15.81:0/1240571272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 msgr2=0x3e64f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e64f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 -- 172.21.15.81:0/1240571272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 msgr2=0x3e64e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e64e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 -- 172.21.15.81:0/1240571272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3e3c4a40 con 0x3e5e6310 2024-09-13T18:50:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a89400700 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e64de60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1a74016040 tx=0x7f1a740047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7815948dc174596 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.754+0000 7f1a66a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 1 -- 172.21.15.81:0/1240571272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740038c0 con 0x3e5e6310 2024-09-13T18:50:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 1 -- 172.21.15.81:0/1240571272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a7401c040 con 0x3e5e6310 2024-09-13T18:50:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3e3f52c0 con 0x3e5e6310 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 1 -- 172.21.15.81:0/1240571272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a74011930 con 0x3e5e6310 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 10 client.6516 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x3e5eb8d0 con 0x3e5e6310 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 1 -- 172.21.15.81:0/1240571272 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3e3f52c0 con 0x3e5e6310 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 1 -- 172.21.15.81:0/1240571272 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f1a74003a20 con 0x3e5e6310 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 10 client.6516 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 10 client.6516 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.c 2024-09-13T18:50:52.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 20 client.6516 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:52.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e631170 0x3e64e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 4 client.6516 mds_command: new command op to 6048 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:50:52.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 --> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x3e692960 con 0x3e631170 2024-09-13T18:50:52.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a89e00700 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e631170 0x3e64e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a89e00700 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e631170 0x3e64e8e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a82c9fa972c3d97 server_cookie=6fd5563a7ece215 in_seq=0 out_seq=0 2024-09-13T18:50:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 10 client.6516 ms_handle_connect on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 1 -- 172.21.15.81:0/1240571272 <== mds.1 v2:172.21.15.81:6834/729196456 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x3e692960 con 0x3e631170 2024-09-13T18:50:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 10 client.6516 handle_command_reply: tid=0 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 client.6516 shutdown 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 msgr2=0x3e64de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e64de60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f1a74016040 tx=0x7f1a740047e0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 shutdown_connections 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3e630d90 0x3e64e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:6834/729196456,v1:172.21.15.81:6836/729196456] conn(0x3e631170 0x3e64e8e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3e5e6310 0x3e64de60 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 --2- 172.21.15.81:0/1240571272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3e3795b0 0x3e64f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 >> 172.21.15.81:0/1240571272 conn(0x3e5eaf10 msgr2=0x3e6404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a66a00700 0 client.6516 ms_handle_reset on v2:172.21.15.81:6834/729196456 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 shutdown_connections 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.758+0000 7f1a8fb72740 1 -- 172.21.15.81:0/1240571272 wait complete. 2024-09-13T18:50:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8fb72740 20 client.6516 trim_cache size 0 max 16384 2024-09-13T18:50:52.772 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-13T18:50:52.772 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-13T18:50:52.772 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a68066730 msgr2=0x7f1a68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a68066730 0x7f1a68068bf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1a8415da00 tx=0x7f1a74009240 comp rx=0 tx=0).stop 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 msgr2=0x7f1a840cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 0x7f1a840cb670 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e8a0 tx=0x7f1a7800ebb0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 shutdown_connections 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a68066730 0x7f1a68068bf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a84162170 0x7f1a8415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a840b41b0 0x7f1a840cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 --2- 172.21.15.81:0/900598953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a840b3dd0 0x7f1a840cb670 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 >> 172.21.15.81:0/900598953 conn(0x7f1a8406a780 msgr2=0x7f1a8406ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 shutdown_connections 2024-09-13T18:50:52.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.762+0000 7f1a8b200700 1 -- 172.21.15.81:0/900598953 wait complete. 2024-09-13T18:50:52.793 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:50:52.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 scrub status 2024-09-13T18:50:52.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.966+0000 7fa31d600700 1 Processor -- start 2024-09-13T18:50:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.966+0000 7fa31d600700 1 -- start start 2024-09-13T18:50:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa31d600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa31815b460 0x7fa31815b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa31d600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815bd80 0x7fa3180b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa31d600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3180b52e0 con 0x7fa3180b4d70 2024-09-13T18:50:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa31d600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180d06e0 con 0x7fa31815b460 2024-09-13T18:50:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa31d600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180b55c0 con 0x7fa31815bd80 2024-09-13T18:50:52.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa31815b460 0x7fa31815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa31815b460 0x7fa31815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56450/0 (socket says 172.21.15.81:56450) 2024-09-13T18:50:52.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa317400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa3180b4d70 0x7fa31806f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34624/0 (socket says 172.21.15.81:34624) 2024-09-13T18:50:52.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 -- 172.21.15.81:0/765044763 learned_addr learned my addr 172.21.15.81:0/765044763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316000700 1 --2- 172.21.15.81:0/765044763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815bd80 0x7fa3180b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 -- 172.21.15.81:0/765044763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815bd80 msgr2=0x7fa3180b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:52.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 --2- 172.21.15.81:0/765044763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815bd80 0x7fa3180b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 -- 172.21.15.81:0/765044763 >> v1:172.21.15.81:6789/0 conn(0x7fa3180b4d70 legacy=0x7fa31806f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 -- 172.21.15.81:0/765044763 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180b58a0 con 0x7fa31815b460 2024-09-13T18:50:52.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa315600700 1 -- 172.21.15.81:0/765044763 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892704169 0 0) 0x7fa3180b52e0 con 0x7fa3180b4d70 2024-09-13T18:50:52.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa316a00700 1 --2- 172.21.15.81:0/765044763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31815b460 0x7fa31815b840 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa308009910 tx=0x7fa308009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc0ec2a66a179ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.970+0000 7fa315600700 1 -- 172.21.15.81:0/765044763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308011830 con 0x7fa31815b460 2024-09-13T18:50:52.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa315600700 1 -- 172.21.15.81:0/765044763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308011990 con 0x7fa31815b460 2024-09-13T18:50:52.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa315600700 1 -- 172.21.15.81:0/765044763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308011d40 con 0x7fa31815b460 2024-09-13T18:50:52.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 -- 172.21.15.81:0/765044763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31815b460 msgr2=0x7fa31815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 --2- 172.21.15.81:0/765044763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31815b460 0x7fa31815b840 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa308009910 tx=0x7fa308009c20 comp rx=0 tx=0).stop 2024-09-13T18:50:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 -- 172.21.15.81:0/765044763 shutdown_connections 2024-09-13T18:50:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 --2- 172.21.15.81:0/765044763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815bd80 0x7fa3180b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 --2- 172.21.15.81:0/765044763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31815b460 0x7fa31815b840 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 -- 172.21.15.81:0/765044763 >> 172.21.15.81:0/765044763 conn(0x7fa31806e660 msgr2=0x7fa31806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:52.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 -- 172.21.15.81:0/765044763 shutdown_connections 2024-09-13T18:50:52.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 -- 172.21.15.81:0/765044763 wait complete. 2024-09-13T18:50:52.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 Processor -- start 2024-09-13T18:50:52.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.974+0000 7fa31d600700 1 -- start start 2024-09-13T18:50:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 0x7fa3180c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815b460 0x7fa3181f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31815bd80 0x7fa318141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3181f38c0 con 0x7fa3180b4d70 2024-09-13T18:50:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31806b480 con 0x7fa31815bd80 2024-09-13T18:50:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31806b760 con 0x7fa31815b460 2024-09-13T18:50:52.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 0x7fa3180c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 0x7fa3180c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56452/0 (socket says 172.21.15.81:56452) 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 -- 172.21.15.81:0/2508579300 learned_addr learned my addr 172.21.15.81:0/2508579300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa317400700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31815bd80 0x7fa318141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316000700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815b460 0x7fa3181f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 -- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815b460 msgr2=0x7fa3181f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815b460 0x7fa3181f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 -- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31815bd80 msgr2=0x7fa318141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31815bd80 0x7fa318141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 -- 172.21.15.81:0/2508579300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa308009570 con 0x7fa3180b4d70 2024-09-13T18:50:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316000700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815b460 0x7fa3181f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa316a00700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 0x7fa3180c5bd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa308009f70 tx=0x7fa308004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa30ea00700 1 -- 172.21.15.81:0/2508579300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800ba70 con 0x7fa3180b4d70 2024-09-13T18:50:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa30ea00700 1 -- 172.21.15.81:0/2508579300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30801f070 con 0x7fa3180b4d70 2024-09-13T18:50:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31806ba40 con 0x7fa3180b4d70 2024-09-13T18:50:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa30ea00700 1 -- 172.21.15.81:0/2508579300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30800be10 con 0x7fa3180b4d70 2024-09-13T18:50:52.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.978+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3181419c0 con 0x7fa3180b4d70 2024-09-13T18:50:52.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.982+0000 7fa30ea00700 1 -- 172.21.15.81:0/2508579300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa30801a430 con 0x7fa3180b4d70 2024-09-13T18:50:52.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.986+0000 7fa30ea00700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2f8066730 0x7fa2f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.986+0000 7fa30ea00700 1 -- 172.21.15.81:0/2508579300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa308021070 con 0x7fa3180b4d70 2024-09-13T18:50:52.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.986+0000 7fa316000700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2f8066730 0x7fa2f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:52.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.986+0000 7fa316000700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2f8066730 0x7fa2f8068bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa31814f6b0 tx=0x7fa304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:52.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.986+0000 7fa320a4b740 1 Processor -- start 2024-09-13T18:50:52.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.986+0000 7fa320a4b740 1 -- start start 2024-09-13T18:50:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f5e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5965d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:52.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f52a010 con 0x2f5e2950 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f4b7f40 con 0x2f5e3270 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f50ae30 con 0x2f5c0d00 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56464/0 (socket says 172.21.15.81:56464) 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 -- 172.21.15.81:0/2442849218 learned_addr learned my addr 172.21.15.81:0/2442849218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316000700 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f5e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa317400700 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 -- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 msgr2=0x2f5e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f5e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 -- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 msgr2=0x2f5965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 -- 172.21.15.81:0/2442849218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2f376a40 con 0x2f5e2950 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316000700 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f5e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa316a00700 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c1240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa30805eab0 tx=0x7fa308056620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8efc27825d4ab39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa303000700 1 -- 172.21.15.81:0/2442849218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30806e070 con 0x2f5e2950 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa303000700 1 -- 172.21.15.81:0/2442849218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3080572f0 con 0x2f5e2950 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa303000700 1 -- 172.21.15.81:0/2442849218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa308056bf0 con 0x2f5e2950 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- 172.21.15.81:0/2442849218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 msgr2=0x2f5c1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c1240 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa30805eab0 tx=0x7fa308056620 comp rx=0 tx=0).stop 2024-09-13T18:50:53.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- 172.21.15.81:0/2442849218 shutdown_connections 2024-09-13T18:50:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f5e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 --2- 172.21.15.81:0/2442849218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c1240 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- 172.21.15.81:0/2442849218 >> 172.21.15.81:0/2442849218 conn(0x2f32b5b0 msgr2=0x2f59c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- 172.21.15.81:0/2442849218 shutdown_connections 2024-09-13T18:50:53.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.990+0000 7fa320a4b740 1 -- 172.21.15.81:0/2442849218 wait complete. 2024-09-13T18:50:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 -- start start 2024-09-13T18:50:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 Processor -- start 2024-09-13T18:50:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f5c3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f5c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f506150 con 0x2f5c0d00 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f503eb0 con 0x2f5e3270 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f4c18e0 con 0x2f5e2950 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 10 client.0 _ll_register_callbacks cb 0x2f4a0670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f5c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f5c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56478/0 (socket says 172.21.15.81:56478) 2024-09-13T18:50:53.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 -- 172.21.15.81:0/325424759 learned_addr learned my addr 172.21.15.81:0/325424759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa317400700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316000700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f5c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 -- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 msgr2=0x2f5c03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f5c03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 -- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 msgr2=0x2f5e1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5e1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 -- 172.21.15.81:0/325424759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3181419c0 con 0x2f5c0d00 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316000700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f5c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa316a00700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f5c3680 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa308009c60 tx=0x7fa308000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a3da13d9f6001a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa2f7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa2f7400700 1 -- 172.21.15.81:0/325424759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30806e040 con 0x2f5c0d00 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa2f7400700 1 -- 172.21.15.81:0/325424759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa30805aa20 con 0x2f5c0d00 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.994+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2f3382c0 con 0x2f5c0d00 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa2f7400700 1 -- 172.21.15.81:0/325424759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa30805efe0 con 0x2f5c0d00 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 10 client.6531 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x2f4ca290 con 0x2f5c0d00 2024-09-13T18:50:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa2f7400700 1 -- 172.21.15.81:0/325424759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2f3382c0 con 0x2f5c0d00 2024-09-13T18:50:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa2f7400700 1 -- 172.21.15.81:0/325424759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fa30805eb50 con 0x2f5c0d00 2024-09-13T18:50:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 10 client.6531 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 10 client.6531 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-13T18:50:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 20 client.6531 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f5c1ca0 0x2f5c20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 4 client.6531 mds_command: new command op to 5911 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 --> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2f382540 con 0x2f5c1ca0 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa316000700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f5c1ca0 0x2f5c20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa316000700 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f5c1ca0 0x2f5c20b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=60473a4f476ef2d6 server_cookie=51441eccd9752837 in_seq=0 out_seq=0 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa2f7400700 10 client.6531 ms_handle_connect on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:53.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa2f7400700 1 -- 172.21.15.81:0/325424759 <== mds.2 v2:172.21.15.178:6834/1611484847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2f382540 con 0x2f5c1ca0 2024-09-13T18:50:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa2f7400700 10 client.6531 handle_command_reply: tid=0 2024-09-13T18:50:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:52.998+0000 7fa320a4b740 1 client.6531 shutdown 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 msgr2=0x2f5c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f5c3680 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa308009c60 tx=0x7fa308000bc0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 shutdown_connections 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f5c1ca0 0x2f5c20b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5e1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f5c03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 --2- 172.21.15.81:0/325424759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f5c3680 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa2f7400700 0 client.6531 ms_handle_reset on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 >> 172.21.15.81:0/325424759 conn(0x2f32b5b0 msgr2=0x2f595db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 shutdown_connections 2024-09-13T18:50:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 1 -- 172.21.15.81:0/325424759 wait complete. 2024-09-13T18:50:53.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.002+0000 7fa320a4b740 20 client.6531 trim_cache size 0 max 16384 2024-09-13T18:50:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 Processor -- start 2024-09-13T18:50:53.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 -- start start 2024-09-13T18:50:53.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f63b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f3afb80 con 0x2f5e2950 2024-09-13T18:50:53.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f4c4a00 con 0x2f5e3270 2024-09-13T18:50:53.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f48da50 con 0x2f5c0d00 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa316000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa316a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f63b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f63b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:43518/0 (socket says 172.21.15.81:43518) 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.022+0000 7fa316000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56490/0 (socket says 172.21.15.81:56490) 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 -- 172.21.15.81:0/4246673282 learned_addr learned my addr 172.21.15.81:0/4246673282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa317400700 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 -- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 msgr2=0x2f5c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 -- 172.21.15.81:0/4246673282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 msgr2=0x2f5c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 -- 172.21.15.81:0/4246673282 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2f4b04c0 con 0x2f5c0d00 2024-09-13T18:50:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa316a00700 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f63b9e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa308054f40 tx=0x7fa308080070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f4f978c0796e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa303a00700 1 -- 172.21.15.81:0/4246673282 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30806e040 con 0x2f5c0d00 2024-09-13T18:50:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa303a00700 1 -- 172.21.15.81:0/4246673282 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa308082070 con 0x2f5c0d00 2024-09-13T18:50:53.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa303a00700 1 -- 172.21.15.81:0/4246673282 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30805efe0 con 0x2f5c0d00 2024-09-13T18:50:53.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 -- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 msgr2=0x2f63b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f63b9e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa308054f40 tx=0x7fa308080070 comp rx=0 tx=0).stop 2024-09-13T18:50:53.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 -- 172.21.15.81:0/4246673282 shutdown_connections 2024-09-13T18:50:53.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5e2950 0x2f5c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 --2- 172.21.15.81:0/4246673282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5c0d00 0x2f63b9e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 -- 172.21.15.81:0/4246673282 >> 172.21.15.81:0/4246673282 conn(0x2f32b5b0 msgr2=0x2f5f2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 -- 172.21.15.81:0/4246673282 shutdown_connections 2024-09-13T18:50:53.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.026+0000 7fa320a4b740 1 -- 172.21.15.81:0/4246673282 wait complete. 2024-09-13T18:50:53.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 -- start start 2024-09-13T18:50:53.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 Processor -- start 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f647920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f647e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f4a2620 con 0x2f5c0d00 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f4c18e0 con 0x2f5e3270 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f5029a0 con 0x2f5e2950 2024-09-13T18:50:53.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa320a4b740 10 client.0 _ll_register_callbacks cb 0x2f4d38f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f647920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa317400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa316a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f647920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56504/0 (socket says 172.21.15.81:56504) 2024-09-13T18:50:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa316000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f647e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.030+0000 7fa316a00700 1 -- 172.21.15.81:0/886833546 learned_addr learned my addr 172.21.15.81:0/886833546 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa317400700 1 -- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 msgr2=0x2f647e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa317400700 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f647e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa317400700 1 -- 172.21.15.81:0/886833546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 msgr2=0x2f647920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa317400700 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f647920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa317400700 1 -- 172.21.15.81:0/886833546 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2f4ca290 con 0x2f5e3270 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa316a00700 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f647920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:53.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa317400700 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5f7da0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa310002230 tx=0x7fa310007830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f80c42a9f9c2e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa2f7400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-13T18:50:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa2f7400700 1 -- 172.21.15.81:0/886833546 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310001d30 con 0x2f5e3270 2024-09-13T18:50:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa2f7400700 1 -- 172.21.15.81:0/886833546 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa310015760 con 0x2f5e3270 2024-09-13T18:50:53.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3080572f0 con 0x2f5e3270 2024-09-13T18:50:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa2f7400700 1 -- 172.21.15.81:0/886833546 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa310015920 con 0x2f5e3270 2024-09-13T18:50:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 10 client.6325 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x2f4a4790 con 0x2f5e3270 2024-09-13T18:50:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa2f7400700 1 -- 172.21.15.81:0/886833546 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3080572f0 con 0x2f5e3270 2024-09-13T18:50:53.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa2f7400700 1 -- 172.21.15.81:0/886833546 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fa31001d020 con 0x2f5e3270 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 10 client.6325 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 10 client.6325 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.d 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 20 client.6325 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f63af60 0x2f5f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 4 client.6325 mds_command: new command op to 5911 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 --> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2f3a72c0 con 0x2f63af60 2024-09-13T18:50:53.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.034+0000 7fa316a00700 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f63af60 0x2f5f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa2f7400700 10 client.6325 ms_handle_connect on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa316a00700 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f63af60 0x2f5f82e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dced3ab8c1a31795 server_cookie=cad1e5ad89378d2f in_seq=0 out_seq=0 2024-09-13T18:50:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa2f7400700 1 -- 172.21.15.81:0/886833546 <== mds.2 v2:172.21.15.178:6834/1611484847 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x2f3a72c0 con 0x2f63af60 2024-09-13T18:50:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa2f7400700 10 client.6325 handle_command_reply: tid=0 2024-09-13T18:50:53.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 client.6325 shutdown 2024-09-13T18:50:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 msgr2=0x2f5f7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5f7da0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa310002230 tx=0x7fa310007830 comp rx=0 tx=0).stop 2024-09-13T18:50:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 shutdown_connections 2024-09-13T18:50:53.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:6834/1611484847,v1:172.21.15.178:6835/1611484847] conn(0x2f63af60 0x2f5f82e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f5e3270 0x2f5f7da0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f5e2950 0x2f647e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa2f7400700 0 client.6325 ms_handle_reset on v2:172.21.15.178:6834/1611484847 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 --2- 172.21.15.81:0/886833546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f5c0d00 0x2f647920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 >> 172.21.15.81:0/886833546 conn(0x2f32b5b0 msgr2=0x2f5ddf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 shutdown_connections 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 1 -- 172.21.15.81:0/886833546 wait complete. 2024-09-13T18:50:53.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa320a4b740 20 client.6325 trim_cache size 0 max 16384 2024-09-13T18:50:53.050 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-13T18:50:53.050 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-13T18:50:53.050 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2f8066730 msgr2=0x7fa2f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2f8066730 0x7fa2f8068bf0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa31814f6b0 tx=0x7fa304008040 comp rx=0 tx=0).stop 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 msgr2=0x7fa3180c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 0x7fa3180c5bd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa308009f70 tx=0x7fa308004770 comp rx=0 tx=0).stop 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 shutdown_connections 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2f8066730 0x7fa2f8068bf0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31815bd80 0x7fa318141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31815b460 0x7fa3181f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 --2- 172.21.15.81:0/2508579300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3180b4d70 0x7fa3180c5bd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.038+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 >> 172.21.15.81:0/2508579300 conn(0x7fa31806e660 msgr2=0x7fa31806f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.042+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 shutdown_connections 2024-09-13T18:50:53.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.042+0000 7fa31d600700 1 -- 172.21.15.81:0/2508579300 wait complete. 2024-09-13T18:50:53.072 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:50:53.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-13T18:50:53.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 Processor -- start 2024-09-13T18:50:53.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 -- start start 2024-09-13T18:50:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406d620 0x7f561406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f561406cea0 0x7f56140b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140b1980 con 0x7f5614143b70 2024-09-13T18:50:53.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56140b2500 con 0x7f561406cea0 2024-09-13T18:50:53.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f561a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561406d2f0 con 0x7f561406d620 2024-09-13T18:50:53.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f5619600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f561406cea0 0x7f56140b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f5618c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5614143b70 0x7f56140cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34628/0 (socket says 172.21.15.81:34628) 2024-09-13T18:50:53.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.238+0000 7f5618c00700 1 -- 172.21.15.81:0/2162058539 learned_addr learned my addr 172.21.15.81:0/2162058539 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:53.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5613e00700 1 --2- 172.21.15.81:0/2162058539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406d620 0x7f561406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5619600700 1 -- 172.21.15.81:0/2162058539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406d620 msgr2=0x7f561406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5619600700 1 --2- 172.21.15.81:0/2162058539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406d620 0x7f561406c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5619600700 1 -- 172.21.15.81:0/2162058539 >> v1:172.21.15.81:6789/0 conn(0x7f5614143b70 legacy=0x7f56140cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5619600700 1 -- 172.21.15.81:0/2162058539 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56140b1bd0 con 0x7f561406cea0 2024-09-13T18:50:53.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5613400700 1 -- 172.21.15.81:0/2162058539 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418825599 0 0) 0x7f56140b1980 con 0x7f5614143b70 2024-09-13T18:50:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5619600700 1 --2- 172.21.15.81:0/2162058539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f561406cea0 0x7f56140b2990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33edf98c497dc0ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5613400700 1 -- 172.21.15.81:0/2162058539 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c00e070 con 0x7f561406cea0 2024-09-13T18:50:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5613400700 1 -- 172.21.15.81:0/2162058539 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c00bb20 con 0x7f561406cea0 2024-09-13T18:50:53.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f5613400700 1 -- 172.21.15.81:0/2162058539 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c012430 con 0x7f561406cea0 2024-09-13T18:50:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 -- 172.21.15.81:0/2162058539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f561406cea0 msgr2=0x7f56140b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 --2- 172.21.15.81:0/2162058539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f561406cea0 0x7f56140b2990 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c00b330 comp rx=0 tx=0).stop 2024-09-13T18:50:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 -- 172.21.15.81:0/2162058539 shutdown_connections 2024-09-13T18:50:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 --2- 172.21.15.81:0/2162058539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f561406cea0 0x7f56140b2990 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 --2- 172.21.15.81:0/2162058539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406d620 0x7f561406c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 -- 172.21.15.81:0/2162058539 >> 172.21.15.81:0/2162058539 conn(0x7f561406a390 msgr2=0x7f561406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 -- 172.21.15.81:0/2162058539 shutdown_connections 2024-09-13T18:50:53.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.242+0000 7f561a000700 1 -- 172.21.15.81:0/2162058539 wait complete. 2024-09-13T18:50:53.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.246+0000 7f561a000700 1 Processor -- start 2024-09-13T18:50:53.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.246+0000 7f561a000700 1 -- start start 2024-09-13T18:50:53.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406cea0 0x7f561413ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561406d620 0x7f561413ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 0x7f5614142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141f0c90 con 0x7f5614143b70 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141404a0 con 0x7f561406d620 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56141f11c0 con 0x7f561406cea0 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 0x7f5614142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 0x7f5614142460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56524/0 (socket says 172.21.15.81:56524) 2024-09-13T18:50:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 -- 172.21.15.81:0/927682620 learned_addr learned my addr 172.21.15.81:0/927682620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5618c00700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406cea0 0x7f561413ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5613e00700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561406d620 0x7f561413ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 -- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406cea0 msgr2=0x7f561413ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406cea0 0x7f561413ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 -- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561406d620 msgr2=0x7f561413ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561406d620 0x7f561413ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 -- 172.21.15.81:0/927682620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009a70 con 0x7f5614143b70 2024-09-13T18:50:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5613e00700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561406d620 0x7f561413ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5619600700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 0x7f5614142460 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b680 tx=0x7f560c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5610c00700 1 -- 172.21.15.81:0/927682620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c012430 con 0x7f5614143b70 2024-09-13T18:50:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5610c00700 1 -- 172.21.15.81:0/927682620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c020070 con 0x7f5614143b70 2024-09-13T18:50:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f5610c00700 1 -- 172.21.15.81:0/927682620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c004280 con 0x7f5614143b70 2024-09-13T18:50:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5614140910 con 0x7f5614143b70 2024-09-13T18:50:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.250+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5614140bb0 con 0x7f5614143b70 2024-09-13T18:50:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.254+0000 7f5610c00700 1 -- 172.21.15.81:0/927682620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f560c0043e0 con 0x7f5614143b70 2024-09-13T18:50:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5610c00700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f55f4066730 0x7f55f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 Processor -- start 2024-09-13T18:50:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5610c00700 1 -- 172.21.15.81:0/927682620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f560c022070 con 0x7f5614143b70 2024-09-13T18:50:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 -- start start 2024-09-13T18:50:53.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f55f4066730 0x7f55f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f55f4066730 0x7f55f4068bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5608000f60 tx=0x7f5608007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15618180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1555e010 con 0x155f5420 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x154ebf40 con 0x155f5800 2024-09-13T18:50:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1553ee30 con 0x156186c0 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15618180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15618180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56530/0 (socket says 172.21.15.81:56530) 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 -- 172.21.15.81:0/2211163729 learned_addr learned my addr 172.21.15.81:0/2211163729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5619600700 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5613e00700 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 -- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 msgr2=0x155f9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155f9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 -- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 msgr2=0x155ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 -- 172.21.15.81:0/2211163729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x153aaa40 con 0x155f5420 2024-09-13T18:50:53.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5619600700 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5618c00700 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15618180 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f56080011e0 tx=0x7f5608013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f42e647052deb5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5605200700 1 -- 172.21.15.81:0/2211163729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080012b0 con 0x155f5420 2024-09-13T18:50:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5605200700 1 -- 172.21.15.81:0/2211163729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608001410 con 0x155f5420 2024-09-13T18:50:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.258+0000 7f5605200700 1 -- 172.21.15.81:0/2211163729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080017a0 con 0x155f5420 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- 172.21.15.81:0/2211163729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 msgr2=0x15618180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15618180 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f56080011e0 tx=0x7f5608013000 comp rx=0 tx=0).stop 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- 172.21.15.81:0/2211163729 shutdown_connections 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155f9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- 172.21.15.81:0/2211163729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15618180 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- 172.21.15.81:0/2211163729 >> 172.21.15.81:0/2211163729 conn(0x1535f5b0 msgr2=0x155d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- 172.21.15.81:0/2211163729 shutdown_connections 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- 172.21.15.81:0/2211163729 wait complete. 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- start start 2024-09-13T18:50:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 Processor -- start 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x155f5420 0x1561a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 0x155f8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1553a150 con 0x156186c0 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15537eb0 con 0x155f5800 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x154f58e0 con 0x155f5420 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f561e92f740 10 client.0 _ll_register_callbacks cb 0x154d4670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 0x155f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 0x155f8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56540/0 (socket says 172.21.15.81:56540) 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 -- 172.21.15.81:0/785561325 learned_addr learned my addr 172.21.15.81:0/785561325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5613e00700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5618c00700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x155f5420 0x1561a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 -- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x155f5420 msgr2=0x1561a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x155f5420 0x1561a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 -- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 msgr2=0x155f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.262+0000 7f5619600700 1 -- 172.21.15.81:0/785561325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608013530 con 0x156186c0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f5619600700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 0x155f8560 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b370 tx=0x7f560c057350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b057278192bfd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 1 -- 172.21.15.81:0/785561325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c05ef70 con 0x156186c0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 1 -- 172.21.15.81:0/785561325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f560c057510 con 0x156186c0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1536c2c0 con 0x156186c0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 1 -- 172.21.15.81:0/785561325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f560c0098f0 con 0x156186c0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 10 client.6552 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x154fe290 con 0x156186c0 2024-09-13T18:50:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 1 -- 172.21.15.81:0/785561325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1536c2c0 con 0x156186c0 2024-09-13T18:50:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 1 -- 172.21.15.81:0/785561325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f560c004690 con 0x156186c0 2024-09-13T18:50:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 10 client.6552 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 10 client.6552 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:53.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 20 client.6552 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x155f70d0 0x155ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 4 client.6552 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x153b6540 con 0x155f70d0 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f5618c00700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x155f70d0 0x155ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 10 client.6552 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f5618c00700 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x155f70d0 0x155ddf00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=100e5d3cfddd7cc1 server_cookie=7aea377e621b8c64 in_seq=0 out_seq=0 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 1 -- 172.21.15.81:0/785561325 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x153b6540 con 0x155f70d0 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 10 client.6552 handle_command_reply: tid=0 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 client.6552 shutdown 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 msgr2=0x155f8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 0x155f8560 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b370 tx=0x7f560c057350 comp rx=0 tx=0).stop 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 shutdown_connections 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x155f70d0 0x155ddf00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x156186c0 0x155f8560 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5800 0x155f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 --2- 172.21.15.81:0/785561325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x155f5420 0x1561a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f55f9600700 0 client.6552 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.266+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 >> 172.21.15.81:0/785561325 conn(0x1535f5b0 msgr2=0x15617bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.270+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 shutdown_connections 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.270+0000 7f561e92f740 1 -- 172.21.15.81:0/785561325 wait complete. 2024-09-13T18:50:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.270+0000 7f561e92f740 20 client.6552 trim_cache size 0 max 16384 2024-09-13T18:50:53.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.286+0000 7f561e92f740 1 Processor -- start 2024-09-13T18:50:53.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.286+0000 7f561e92f740 1 -- start start 2024-09-13T18:50:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5420 0x155f1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x153e3b80 con 0x155f5800 2024-09-13T18:50:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15508c00 con 0x155f5420 2024-09-13T18:50:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x154ff590 con 0x156186c0 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56552/0 (socket says 172.21.15.81:56552) 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 -- 172.21.15.81:0/1078268076 learned_addr learned my addr 172.21.15.81:0/1078268076 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5618c00700 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5420 0x155f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5619600700 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 -- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 msgr2=0x155cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 -- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5420 msgr2=0x155f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5420 0x155f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 -- 172.21.15.81:0/1078268076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x154e44c0 con 0x155f5800 2024-09-13T18:50:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5613e00700 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 0x155ce9e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5600009e10 tx=0x7f5600009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb66b6c59be89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5605c00700 1 -- 172.21.15.81:0/1078268076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600016d20 con 0x155f5800 2024-09-13T18:50:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5605c00700 1 -- 172.21.15.81:0/1078268076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600016e80 con 0x155f5800 2024-09-13T18:50:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f5605c00700 1 -- 172.21.15.81:0/1078268076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600004230 con 0x155f5800 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 -- 172.21.15.81:0/1078268076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 msgr2=0x155ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 0x155ce9e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5600009e10 tx=0x7f5600009240 comp rx=0 tx=0).stop 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 -- 172.21.15.81:0/1078268076 shutdown_connections 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x156186c0 0x155cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5800 0x155ce9e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 --2- 172.21.15.81:0/1078268076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x155f5420 0x155f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.290+0000 7f561e92f740 1 -- 172.21.15.81:0/1078268076 >> 172.21.15.81:0/1078268076 conn(0x1535f5b0 msgr2=0x1562b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 -- 172.21.15.81:0/1078268076 shutdown_connections 2024-09-13T18:50:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 -- 172.21.15.81:0/1078268076 wait complete. 2024-09-13T18:50:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 -- start start 2024-09-13T18:50:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 Processor -- start 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15665cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x156186c0 0x15638d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15639240 0x156309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x15611d30 con 0x155f5420 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15633be0 con 0x156186c0 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15631be0 con 0x15639240 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f561e92f740 10 client.0 _ll_register_callbacks cb 0x15536610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15665cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15665cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56566/0 (socket says 172.21.15.81:56566) 2024-09-13T18:50:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 -- 172.21.15.81:0/1003707944 learned_addr learned my addr 172.21.15.81:0/1003707944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5613e00700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x156186c0 0x15638d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5619600700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15639240 0x156309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 -- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15639240 msgr2=0x156309a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15639240 0x156309a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 -- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x156186c0 msgr2=0x15638d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x156186c0 0x15638d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 -- 172.21.15.81:0/1003707944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5600009a90 con 0x155f5420 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5619600700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15639240 0x156309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f5618c00700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15665cf0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5608013820 tx=0x7f5608012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2959702cb87880 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.294+0000 7f55f9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 1 -- 172.21.15.81:0/1003707944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608032d10 con 0x155f5420 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 1 -- 172.21.15.81:0/1003707944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f560801b050 con 0x155f5420 2024-09-13T18:50:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x156175d0 con 0x155f5420 2024-09-13T18:50:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 1 -- 172.21.15.81:0/1003707944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5608032e70 con 0x155f5420 2024-09-13T18:50:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 10 client.6558 fetch_fsmap learned FSMap version 44 2024-09-13T18:50:53.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x154d8790 con 0x155f5420 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 1 -- 172.21.15.81:0/1003707944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x156175d0 con 0x155f5420 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 1 -- 172.21.15.81:0/1003707944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 44) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f56080321c0 con 0x155f5420 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 10 client.6558 fetch_fsmap finished waiting for FSMap version 44 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 10 client.6558 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 20 client.6558 populate_metadata read hostname 'smithi081' 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x15639620 0x15630ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 4 client.6558 mds_command: new command op to 6051 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:50:53.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 --> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f5608001410 con 0x15639620 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f5613e00700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x15639620 0x15630ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 10 client.6558 ms_handle_connect on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f5613e00700 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x15639620 0x15630ee0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e475ba744874fe02 server_cookie=77eac2cd4b8d3b27 in_seq=0 out_seq=0 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 1 -- 172.21.15.81:0/1003707944 <== mds.0 v2:172.21.15.81:6835/396996950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f5608001410 con 0x15639620 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 10 client.6558 handle_command_reply: tid=0 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 client.6558 shutdown 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 msgr2=0x15665cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15665cf0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5608013820 tx=0x7f5608012000 comp rx=0 tx=0).stop 2024-09-13T18:50:53.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 shutdown_connections 2024-09-13T18:50:53.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:6835/396996950,v1:172.21.15.81:6837/396996950] conn(0x15639620 0x15630ee0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15639240 0x156309a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x156186c0 0x15638d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 --2- 172.21.15.81:0/1003707944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x155f5420 0x15665cf0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 >> 172.21.15.81:0/1003707944 conn(0x1535f5b0 msgr2=0x155f7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f55f9600700 0 client.6558 ms_handle_reset on v2:172.21.15.81:6835/396996950 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 shutdown_connections 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.298+0000 7f561e92f740 1 -- 172.21.15.81:0/1003707944 wait complete. 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561e92f740 20 client.6558 trim_cache size 0 max 16384 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-13T18:50:53.312 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-13T18:50:53.313 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:50:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f55f4066730 msgr2=0x7f55f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f55f4066730 0x7f55f4068bf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5608000f60 tx=0x7f5608007e90 comp rx=0 tx=0).stop 2024-09-13T18:50:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 msgr2=0x7f5614142460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 0x7f5614142460 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b680 tx=0x7f560c004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 shutdown_connections 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f55f4066730 0x7f55f4068bf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5614143b70 0x7f5614142460 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f561406d620 0x7f561413ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 --2- 172.21.15.81:0/927682620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561406cea0 0x7f561413ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 >> 172.21.15.81:0/927682620 conn(0x7f561406a390 msgr2=0x7f56140af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 shutdown_connections 2024-09-13T18:50:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.302+0000 7f561a000700 1 -- 172.21.15.81:0/927682620 wait complete. 2024-09-13T18:50:53.332 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:50:53.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 Processor -- start 2024-09-13T18:50:53.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 -- start start 2024-09-13T18:50:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe00cc6f0 0x7f7fe015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fe006aaa0 0x7f7fe006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00b2ad0 con 0x7f7fe00cb020 2024-09-13T18:50:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe006b450 con 0x7f7fe006aaa0 2024-09-13T18:50:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.494+0000 7f7fe4c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00ccb10 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fe006aaa0 0x7f7fe006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fe006aaa0 0x7f7fe006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56568/0 (socket says 172.21.15.81:56568) 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1771234492 learned_addr learned my addr 172.21.15.81:0/1771234492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdf400700 1 --1- 172.21.15.81:0/1771234492 >> v1:172.21.15.81:6789/0 conn(0x7f7fe00cb020 0x7f7fe015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34630/0 (socket says 172.21.15.81:34630) 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fd7e00700 1 --2- 172.21.15.81:0/1771234492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe00cc6f0 0x7f7fe015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1771234492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe00cc6f0 msgr2=0x7f7fe015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 --2- 172.21.15.81:0/1771234492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe00cc6f0 0x7f7fe015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1771234492 >> v1:172.21.15.81:6789/0 conn(0x7f7fe00cb020 legacy=0x7f7fe015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1771234492 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe015b960 con 0x7f7fe006aaa0 2024-09-13T18:50:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdea00700 1 -- 172.21.15.81:0/1771234492 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499867274 0 0) 0x7f7fe00b2ad0 con 0x7f7fe00cb020 2024-09-13T18:50:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdfe00700 1 --2- 172.21.15.81:0/1771234492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe006aaa0 0x7f7fe006af10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009e50 tx=0x7f7fd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e0f7d63bdac0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdea00700 1 -- 172.21.15.81:0/1771234492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800e070 con 0x7f7fe006aaa0 2024-09-13T18:50:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdea00700 1 -- 172.21.15.81:0/1771234492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800b9c0 con 0x7f7fe006aaa0 2024-09-13T18:50:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fdea00700 1 -- 172.21.15.81:0/1771234492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800bd70 con 0x7f7fe006aaa0 2024-09-13T18:50:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1771234492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe006aaa0 msgr2=0x7f7fe006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1771234492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe006aaa0 0x7f7fe006af10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8009e50 tx=0x7f7fd800b330 comp rx=0 tx=0).stop 2024-09-13T18:50:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1771234492 shutdown_connections 2024-09-13T18:50:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1771234492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe006aaa0 0x7f7fe006af10 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1771234492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe00cc6f0 0x7f7fe015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1771234492 >> 172.21.15.81:0/1771234492 conn(0x7f7fe00b0c40 msgr2=0x7f7fe006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1771234492 shutdown_connections 2024-09-13T18:50:53.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.498+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1771234492 wait complete. 2024-09-13T18:50:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.502+0000 7f7fe4c00700 1 Processor -- start 2024-09-13T18:50:53.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.502+0000 7f7fe4c00700 1 -- start start 2024-09-13T18:50:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe006aaa0 0x7f7fe01563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe00cb020 0x7f7fe013a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 0x7f7fe0070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe013a6b0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe01429d0 con 0x7f7fe00cb020 2024-09-13T18:50:53.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0142cb0 con 0x7f7fe006aaa0 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 0x7f7fe0070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 0x7f7fe0070d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56578/0 (socket says 172.21.15.81:56578) 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1597298417 learned_addr learned my addr 172.21.15.81:0/1597298417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fd7e00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe00cb020 0x7f7fe013a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdf400700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe006aaa0 0x7f7fe01563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe006aaa0 msgr2=0x7f7fe01563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe006aaa0 0x7f7fe01563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe00cb020 msgr2=0x7f7fe013a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe00cb020 0x7f7fe013a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 -- 172.21.15.81:0/1597298417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd8009b30 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fdfe00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 0x7f7fe0070d90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800b730 tx=0x7f7fd8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8004960 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd80099b0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd801c6a0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe01558d0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.506+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe0155e90 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.510+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe00cb400 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.510+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7fd801c800 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.514+0000 7f7fd7400700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7fbc066760 0x7f7fbc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.514+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7fd8085fc0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.514+0000 7f7fdf400700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7fbc066760 0x7f7fbc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.514+0000 7f7fdf400700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7fbc066760 0x7f7fbc068c20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000f60 tx=0x7f7fd0007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.518+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7fd8053380 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.758+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fe0158fa0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fd7400700 1 -- 172.21.15.81:0/1597298417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f7fd80569a0 con 0x7f7fe00cc6f0 2024-09-13T18:50:53.770 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:53.770 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7fbc066760 msgr2=0x7f7fbc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7fbc066760 0x7f7fbc068c20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000f60 tx=0x7f7fd0007c00 comp rx=0 tx=0).stop 2024-09-13T18:50:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 msgr2=0x7f7fe0070d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 0x7f7fe0070d90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800b730 tx=0x7f7fd8004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 shutdown_connections 2024-09-13T18:50:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7fbc066760 0x7f7fbc068c20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fe00cc6f0 0x7f7fe0070d90 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fe00cb020 0x7f7fe013a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 --2- 172.21.15.81:0/1597298417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fe006aaa0 0x7f7fe01563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 >> 172.21.15.81:0/1597298417 conn(0x7f7fe00b0c40 msgr2=0x7f7fe00ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 shutdown_connections 2024-09-13T18:50:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.762+0000 7f7fe4c00700 1 -- 172.21.15.81:0/1597298417 wait complete. 2024-09-13T18:50:53.776 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:50:53.796 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:50:53.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:50:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.954+0000 7f0f65c00700 1 Processor -- start 2024-09-13T18:50:53.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.954+0000 7f0f65c00700 1 -- start start 2024-09-13T18:50:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f65c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f600ccda0 0x7f0f6006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f65c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0f6015baf0 0x7f0f601645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f65c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f60071030 con 0x7f0f600b0b10 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f65c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6006cd10 con 0x7f0f6015baf0 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f65c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600704b0 con 0x7f0f600ccda0 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f5ea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0f600b0b10 0x7f0f600b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34636/0 (socket says 172.21.15.81:34636) 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f5ea00700 1 -- 172.21.15.81:0/3229044879 learned_addr learned my addr 172.21.15.81:0/3229044879 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f5f400700 1 --2- 172.21.15.81:0/3229044879 >> v2:172.21.15.81:3300/0 conn(0x7f0f6015baf0 0x7f0f601645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f5e000700 1 --2- 172.21.15.81:0/3229044879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f600ccda0 0x7f0f6006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.958+0000 7f0f5d600700 1 -- 172.21.15.81:0/3229044879 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698773412 0 0) 0x7f0f60071030 con 0x7f0f600b0b10 2024-09-13T18:50:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5f400700 1 -- 172.21.15.81:0/3229044879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f600ccda0 msgr2=0x7f0f6006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5f400700 1 --2- 172.21.15.81:0/3229044879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f600ccda0 0x7f0f6006fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5f400700 1 -- 172.21.15.81:0/3229044879 >> v1:172.21.15.81:6789/0 conn(0x7f0f600b0b10 legacy=0x7f0f600b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5f400700 1 -- 172.21.15.81:0/3229044879 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f60070790 con 0x7f0f6015baf0 2024-09-13T18:50:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5f400700 1 --2- 172.21.15.81:0/3229044879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f601645e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009d90 tx=0x7f0f5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd272f4afaab531 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5d600700 1 -- 172.21.15.81:0/3229044879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800e070 con 0x7f0f6015baf0 2024-09-13T18:50:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5d600700 1 -- 172.21.15.81:0/3229044879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800bb20 con 0x7f0f6015baf0 2024-09-13T18:50:53.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f5d600700 1 -- 172.21.15.81:0/3229044879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58012430 con 0x7f0f6015baf0 2024-09-13T18:50:53.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 -- 172.21.15.81:0/3229044879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 msgr2=0x7f0f601645e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 --2- 172.21.15.81:0/3229044879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f601645e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009d90 tx=0x7f0f5800b330 comp rx=0 tx=0).stop 2024-09-13T18:50:53.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 -- 172.21.15.81:0/3229044879 shutdown_connections 2024-09-13T18:50:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 --2- 172.21.15.81:0/3229044879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f601645e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 --2- 172.21.15.81:0/3229044879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f600ccda0 0x7f0f6006fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 -- 172.21.15.81:0/3229044879 >> 172.21.15.81:0/3229044879 conn(0x7f0f6006a7b0 msgr2=0x7f0f6006abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 -- 172.21.15.81:0/3229044879 shutdown_connections 2024-09-13T18:50:53.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.962+0000 7f0f65c00700 1 -- 172.21.15.81:0/3229044879 wait complete. 2024-09-13T18:50:53.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 Processor -- start 2024-09-13T18:50:53.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 -- start start 2024-09-13T18:50:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f600b0b10 0x7f0f600b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f6015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f60146510 0x7f0f60153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6015e080 con 0x7f0f6015baf0 2024-09-13T18:50:53.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f601f33f0 con 0x7f0f600b0b10 2024-09-13T18:50:53.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f65c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600b2180 con 0x7f0f60146510 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f5e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f6015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f5e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f6015db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56590/0 (socket says 172.21.15.81:56590) 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.966+0000 7f0f5e000700 1 -- 172.21.15.81:0/2387471860 learned_addr learned my addr 172.21.15.81:0/2387471860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5ea00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f600b0b10 0x7f0f600b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5f400700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f60146510 0x7f0f60153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5e000700 1 -- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f60146510 msgr2=0x7f0f60153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5e000700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f60146510 0x7f0f60153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5e000700 1 -- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f600b0b10 msgr2=0x7f0f600b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5e000700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f600b0b10 0x7f0f600b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5e000700 1 -- 172.21.15.81:0/2387471860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009a70 con 0x7f0f6015baf0 2024-09-13T18:50:53.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f5e000700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f6015db40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00ea00 tx=0x7f0f4c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c009720 con 0x7f0f6015baf0 2024-09-13T18:50:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00c7f0 con 0x7f0f6015baf0 2024-09-13T18:50:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f601f23d0 con 0x7f0f6015baf0 2024-09-13T18:50:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00cb60 con 0x7f0f6015baf0 2024-09-13T18:50:53.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f601f2630 con 0x7f0f6015baf0 2024-09-13T18:50:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6006fdb0 con 0x7f0f6015baf0 2024-09-13T18:50:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.970+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0f4c00ccc0 con 0x7f0f6015baf0 2024-09-13T18:50:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.974+0000 7f0f56a00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0f40066730 0x7f0f40068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.974+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0f4c084340 con 0x7f0f6015baf0 2024-09-13T18:50:53.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.974+0000 7f0f5ea00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0f40066730 0x7f0f40068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:53.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.974+0000 7f0f5ea00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0f40066730 0x7f0f40068bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f50000f60 tx=0x7f0f50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:53.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:53.978+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0f4c0515e0 con 0x7f0f6015baf0 2024-09-13T18:50:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.222+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0f600cdc40 con 0x7f0f6015baf0 2024-09-13T18:50:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.222+0000 7f0f56a00700 1 -- 172.21.15.81:0/2387471860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1916 (secure 0 0 0) 0x7f0f4c054c00 con 0x7f0f6015baf0 2024-09-13T18:50:54.232 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:54.232 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":243,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":248889344,"bytes_avail":772845223936,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5911},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":6048},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":6051}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-13T18:50:51.042688+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:50:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0f40066730 msgr2=0x7f0f40068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0f40066730 0x7f0f40068bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f50000f60 tx=0x7f0f50009040 comp rx=0 tx=0).stop 2024-09-13T18:50:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 msgr2=0x7f0f6015db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f6015db40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00ea00 tx=0x7f0f4c00edc0 comp rx=0 tx=0).stop 2024-09-13T18:50:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 shutdown_connections 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0f40066730 0x7f0f40068bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f60146510 0x7f0f60153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f6015baf0 0x7f0f6015db40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 --2- 172.21.15.81:0/2387471860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f600b0b10 0x7f0f600b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 >> 172.21.15.81:0/2387471860 conn(0x7f0f6006a7b0 msgr2=0x7f0f600680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 shutdown_connections 2024-09-13T18:50:54.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:54.226+0000 7f0f65c00700 1 -- 172.21.15.81:0/2387471860 wait complete. 2024-09-13T18:50:54.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:50:55.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:55.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.422+0000 7fcdd0e00700 1 Processor -- start 2024-09-13T18:50:55.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.422+0000 7fcdd0e00700 1 -- start start 2024-09-13T18:50:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdd0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc06ace0 0x7fcdcc06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdd0e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc13fcc0 con 0x7fcdcc13ebc0 2024-09-13T18:50:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdd0e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc13f0f0 con 0x7fcdcc0703d0 2024-09-13T18:50:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdd0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc13f390 con 0x7fcdcc06ace0 2024-09-13T18:50:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcdcc13ebc0 0x7fcdcc06a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34640/0 (socket says 172.21.15.81:34640) 2024-09-13T18:50:55.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9e00700 1 -- 172.21.15.81:0/256956501 learned_addr learned my addr 172.21.15.81:0/256956501 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc1400700 1 --2- 172.21.15.81:0/256956501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc06ace0 0x7fcdcc06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090936752 0 0) 0x7fcdcc13fcc0 con 0x7fcdcc13ebc0 2024-09-13T18:50:55.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb00057e0 con 0x7fcdcc13ebc0 2024-09-13T18:50:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310696325 0 0) 0x7fcdcc13f0f0 con 0x7fcdcc0703d0 2024-09-13T18:50:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdcc13fcc0 con 0x7fcdcc0703d0 2024-09-13T18:50:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc1400700 1 -- 172.21.15.81:0/256956501 >> v1:172.21.15.178:6789/0 conn(0x7fcdcc0703d0 legacy=0x7fcdcc06bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc1400700 1 -- 172.21.15.81:0/256956501 >> v1:172.21.15.81:6789/0 conn(0x7fcdcc13ebc0 legacy=0x7fcdcc06a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741859335 0 0) 0x7fcdb00057e0 con 0x7fcdcc13ebc0 2024-09-13T18:50:55.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc1400700 1 -- 172.21.15.81:0/256956501 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc13f670 con 0x7fcdcc06ace0 2024-09-13T18:50:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc1400700 1 --2- 172.21.15.81:0/256956501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc06ace0 0x7fcdcc06fe90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009880 tx=0x7fcdb4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bc723960ec7809 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc001670 con 0x7fcdcc06ace0 2024-09-13T18:50:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb4004030 con 0x7fcdcc06ace0 2024-09-13T18:50:55.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.426+0000 7fcdc9400700 1 -- 172.21.15.81:0/256956501 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb40043c0 con 0x7fcdcc06ace0 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- 172.21.15.81:0/256956501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc06ace0 msgr2=0x7fcdcc06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/256956501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc06ace0 0x7fcdcc06fe90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009880 tx=0x7fcdb4009b90 comp rx=0 tx=0).stop 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- 172.21.15.81:0/256956501 shutdown_connections 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/256956501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc06ace0 0x7fcdcc06fe90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- 172.21.15.81:0/256956501 >> 172.21.15.81:0/256956501 conn(0x7fcdcc0b08d0 msgr2=0x7fcdcc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- 172.21.15.81:0/256956501 shutdown_connections 2024-09-13T18:50:55.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- 172.21.15.81:0/256956501 wait complete. 2024-09-13T18:50:55.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 Processor -- start 2024-09-13T18:50:55.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- start start 2024-09-13T18:50:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdcc06ace0 0x7fcdcc13b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 0x7fcdcc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc13ebc0 0x7fcdcc0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc1e3380 con 0x7fcdcc0703d0 2024-09-13T18:50:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc1e3be0 con 0x7fcdcc06ace0 2024-09-13T18:50:55.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.430+0000 7fcdd0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc156b60 con 0x7fcdcc13ebc0 2024-09-13T18:50:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 0x7fcdcc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 0x7fcdcc156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56602/0 (socket says 172.21.15.81:56602) 2024-09-13T18:50:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 -- 172.21.15.81:0/2517194769 learned_addr learned my addr 172.21.15.81:0/2517194769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc9e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdcc06ace0 0x7fcdcc13b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdca800700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc13ebc0 0x7fcdcc0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 -- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc13ebc0 msgr2=0x7fcdcc0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc13ebc0 0x7fcdcc0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 -- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdcc06ace0 msgr2=0x7fcdcc13b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdcc06ace0 0x7fcdcc13b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 -- 172.21.15.81:0/2517194769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb40094b0 con 0x7fcdcc0703d0 2024-09-13T18:50:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc1400700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 0x7fcdcc156330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40090b0 tx=0x7fcdb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4003c50 con 0x7fcdcc0703d0 2024-09-13T18:50:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb4003db0 con 0x7fcdcc0703d0 2024-09-13T18:50:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4011830 con 0x7fcdcc0703d0 2024-09-13T18:50:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc1e3590 con 0x7fcdcc0703d0 2024-09-13T18:50:55.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.434+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc156870 con 0x7fcdcc0703d0 2024-09-13T18:50:55.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.438+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc06fe90 con 0x7fcdcc0703d0 2024-09-13T18:50:55.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.438+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcdb4018050 con 0x7fcdcc0703d0 2024-09-13T18:50:55.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.438+0000 7fcdc2a00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcda8066730 0x7fcda8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.438+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcdb4084d50 con 0x7fcdcc0703d0 2024-09-13T18:50:55.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.438+0000 7fcdc9e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcda8066730 0x7fcda8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.442+0000 7fcdc9e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcda8066730 0x7fcda8068bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc000f60 tx=0x7fcdbc001690 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:55.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.446+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcdb4051f70 con 0x7fcdcc0703d0 2024-09-13T18:50:55.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.678+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdcc1e3d20 con 0x7fcdcc0703d0 2024-09-13T18:50:55.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.678+0000 7fcdc2a00700 1 -- 172.21.15.81:0/2517194769 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7fcdb402b090 con 0x7fcdcc0703d0 2024-09-13T18:50:55.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:55.690 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:55.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcda8066730 msgr2=0x7fcda8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcda8066730 0x7fcda8068bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc000f60 tx=0x7fcdbc001690 comp rx=0 tx=0).stop 2024-09-13T18:50:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 msgr2=0x7fcdcc156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 0x7fcdcc156330 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcdb40090b0 tx=0x7fcdb4004770 comp rx=0 tx=0).stop 2024-09-13T18:50:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 shutdown_connections 2024-09-13T18:50:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcda8066730 0x7fcda8068bf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdcc13ebc0 0x7fcdcc0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcdcc0703d0 0x7fcdcc156330 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 --2- 172.21.15.81:0/2517194769 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdcc06ace0 0x7fcdcc13b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 >> 172.21.15.81:0/2517194769 conn(0x7fcdcc0b08d0 msgr2=0x7fcdcc13be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 shutdown_connections 2024-09-13T18:50:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.682+0000 7fcdd0e00700 1 -- 172.21.15.81:0/2517194769 wait complete. 2024-09-13T18:50:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:50:55.714 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:50:55.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:50:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.878+0000 7f4572c00700 1 Processor -- start 2024-09-13T18:50:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4572c00700 1 -- start start 2024-09-13T18:50:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4572c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4572c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f456c0b1220 0x7f456c06bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4572c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c06d720 con 0x7f456c15cd00 2024-09-13T18:50:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4572c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c0b35e0 con 0x7f456c0b1220 2024-09-13T18:50:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4572c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c06cf10 con 0x7f456c15c920 2024-09-13T18:50:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f456c0b1220 0x7f456c06bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f456c0b1220 0x7f456c06bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56616/0 (socket says 172.21.15.81:56616) 2024-09-13T18:50:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 -- 172.21.15.81:0/502500715 learned_addr learned my addr 172.21.15.81:0/502500715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4563e00700 1 --1- 172.21.15.81:0/502500715 >> v1:172.21.15.81:6789/0 conn(0x7f456c15cd00 0x7f456c0b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34656/0 (socket says 172.21.15.81:34656) 2024-09-13T18:50:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f456be00700 1 --2- 172.21.15.81:0/502500715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 -- 172.21.15.81:0/502500715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 msgr2=0x7f456c06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 --2- 172.21.15.81:0/502500715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c06dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 -- 172.21.15.81:0/502500715 >> v1:172.21.15.81:6789/0 conn(0x7f456c15cd00 legacy=0x7f456c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 -- 172.21.15.81:0/502500715 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c06c300 con 0x7f456c0b1220 2024-09-13T18:50:55.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f456b400700 1 -- 172.21.15.81:0/502500715 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2777419296 0 0) 0x7f456c06d720 con 0x7f456c15cd00 2024-09-13T18:50:55.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.882+0000 7f4570c00700 1 --2- 172.21.15.81:0/502500715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c0b1220 0x7f456c06bc40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4564009e50 tx=0x7f456400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738169c21c8896cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:55.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f456b400700 1 -- 172.21.15.81:0/502500715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456400e070 con 0x7f456c0b1220 2024-09-13T18:50:55.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f456b400700 1 -- 172.21.15.81:0/502500715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456400b910 con 0x7f456c0b1220 2024-09-13T18:50:55.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f456b400700 1 -- 172.21.15.81:0/502500715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456400bcc0 con 0x7f456c0b1220 2024-09-13T18:50:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 -- 172.21.15.81:0/502500715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c0b1220 msgr2=0x7f456c06bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 --2- 172.21.15.81:0/502500715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c0b1220 0x7f456c06bc40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f4564009e50 tx=0x7f456400b330 comp rx=0 tx=0).stop 2024-09-13T18:50:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 -- 172.21.15.81:0/502500715 shutdown_connections 2024-09-13T18:50:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 --2- 172.21.15.81:0/502500715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c0b1220 0x7f456c06bc40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 --2- 172.21.15.81:0/502500715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c06dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 -- 172.21.15.81:0/502500715 >> 172.21.15.81:0/502500715 conn(0x7f456c06a7b0 msgr2=0x7f456c06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:55.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 -- 172.21.15.81:0/502500715 shutdown_connections 2024-09-13T18:50:55.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.886+0000 7f4572c00700 1 -- 172.21.15.81:0/502500715 wait complete. 2024-09-13T18:50:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 Processor -- start 2024-09-13T18:50:55.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 -- start start 2024-09-13T18:50:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f456c0b1220 0x7f456c15d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 0x7f456c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c15e900 con 0x7f456c15cd00 2024-09-13T18:50:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1f64e0 con 0x7f456c0b1220 2024-09-13T18:50:55.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4572c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1f6970 con 0x7f456c15c920 2024-09-13T18:50:55.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4570c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 0x7f456c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4563e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4570c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 0x7f456c158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56618/0 (socket says 172.21.15.81:56618) 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f4570c00700 1 -- 172.21.15.81:0/2372446198 learned_addr learned my addr 172.21.15.81:0/2372446198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.890+0000 7f456be00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f456c0b1220 0x7f456c15d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4570c00700 1 -- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 msgr2=0x7f456c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4570c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4570c00700 1 -- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f456c0b1220 msgr2=0x7f456c15d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4570c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f456c0b1220 0x7f456c15d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4570c00700 1 -- 172.21.15.81:0/2372446198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4564009b30 con 0x7f456c15cd00 2024-09-13T18:50:55.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4570c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 0x7f456c158530 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4564004270 tx=0x7f4564004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:55.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45640048a0 con 0x7f456c15cd00 2024-09-13T18:50:55.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45640099b0 con 0x7f456c15cd00 2024-09-13T18:50:55.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456401c680 con 0x7f456c15cd00 2024-09-13T18:50:55.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c1f5bb0 con 0x7f456c15cd00 2024-09-13T18:50:55.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c1f6170 con 0x7f456c15cd00 2024-09-13T18:50:55.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.894+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c06bc40 con 0x7f456c15cd00 2024-09-13T18:50:55.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.898+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f456401c7e0 con 0x7f456c15cd00 2024-09-13T18:50:55.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.898+0000 7f4568c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4548066730 0x7f4548068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:55.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.898+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4564085b30 con 0x7f456c15cd00 2024-09-13T18:50:55.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.898+0000 7f456be00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4548066730 0x7f4548068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:55.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.898+0000 7f456be00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4548066730 0x7f4548068bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f455c009bf0 tx=0x7f455c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:55.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:55.902+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4564052d50 con 0x7f456c15cd00 2024-09-13T18:50:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.146+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f456c1f6620 con 0x7f456c15cd00 2024-09-13T18:50:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.146+0000 7f4568c00700 1 -- 172.21.15.81:0/2372446198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1917 (secure 0 0 0) 0x7f4564056370 con 0x7f456c15cd00 2024-09-13T18:50:56.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:56.156 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":245,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":705738,"bytes_used":248897536,"bytes_avail":772845215744,"bytes_total":773094113280,"write_bytes_sec":1279,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5911},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":6048},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":6051}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-13T18:50:51.042688+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4548066730 msgr2=0x7f4548068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:56.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4548066730 0x7f4548068bf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f455c009bf0 tx=0x7f455c009240 comp rx=0 tx=0).stop 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 msgr2=0x7f456c158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 0x7f456c158530 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4564004270 tx=0x7f4564004af0 comp rx=0 tx=0).stop 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 shutdown_connections 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4548066730 0x7f4548068bf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f456c15cd00 0x7f456c158530 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f456c15c920 0x7f456c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:56.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 --2- 172.21.15.81:0/2372446198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f456c0b1220 0x7f456c15d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 >> 172.21.15.81:0/2372446198 conn(0x7f456c06a7b0 msgr2=0x7f456c0717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 shutdown_connections 2024-09-13T18:50:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:56.150+0000 7f4572c00700 1 -- 172.21.15.81:0/2372446198 wait complete. 2024-09-13T18:50:56.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:50:57.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:50:57.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.350+0000 7f368aa00700 1 Processor -- start 2024-09-13T18:50:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.350+0000 7f368aa00700 1 -- start start 2024-09-13T18:50:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f368aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3684072530 0x7f3684066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f368aa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f36840665d0 0x7f368415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f368aa00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368415db20 con 0x7f368415d6f0 2024-09-13T18:50:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f368aa00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3684066a40 con 0x7f3684072530 2024-09-13T18:50:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f368aa00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368406be80 con 0x7f36840665d0 2024-09-13T18:50:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3684072530 0x7f3684066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3684072530 0x7f3684066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38644/0 (socket says 172.21.15.81:38644) 2024-09-13T18:50:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 -- 172.21.15.81:0/2083562029 learned_addr learned my addr 172.21.15.81:0/2083562029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683400700 1 --2- 172.21.15.81:0/2083562029 >> v2:172.21.15.178:3300/0 conn(0x7f36840665d0 0x7f368415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 -- 172.21.15.81:0/2083562029 >> v2:172.21.15.178:3300/0 conn(0x7f36840665d0 msgr2=0x7f368415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 --2- 172.21.15.81:0/2083562029 >> v2:172.21.15.178:3300/0 conn(0x7f36840665d0 0x7f368415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 -- 172.21.15.81:0/2083562029 >> v1:172.21.15.178:6789/0 conn(0x7f368415d6f0 legacy=0x7f36841607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.354+0000 7f3683e00700 1 -- 172.21.15.81:0/2083562029 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36840b4cf0 con 0x7f3684072530 2024-09-13T18:50:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f3683e00700 1 --2- 172.21.15.81:0/2083562029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3684072530 0x7f3684066090 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f36840d0450 tx=0x7f3674009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2c67f70a0a315e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f3682a00700 1 -- 172.21.15.81:0/2083562029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674011830 con 0x7f3684072530 2024-09-13T18:50:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f3682a00700 1 -- 172.21.15.81:0/2083562029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674011990 con 0x7f3684072530 2024-09-13T18:50:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f3682a00700 1 -- 172.21.15.81:0/2083562029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3674011d20 con 0x7f3684072530 2024-09-13T18:50:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 -- 172.21.15.81:0/2083562029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3684072530 msgr2=0x7f3684066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 --2- 172.21.15.81:0/2083562029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3684072530 0x7f3684066090 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f36840d0450 tx=0x7f3674009bf0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 -- 172.21.15.81:0/2083562029 shutdown_connections 2024-09-13T18:50:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 --2- 172.21.15.81:0/2083562029 >> v2:172.21.15.178:3300/0 conn(0x7f36840665d0 0x7f368415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 --2- 172.21.15.81:0/2083562029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3684072530 0x7f3684066090 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 -- 172.21.15.81:0/2083562029 >> 172.21.15.81:0/2083562029 conn(0x7f36840b1e00 msgr2=0x7f36840cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 -- 172.21.15.81:0/2083562029 shutdown_connections 2024-09-13T18:50:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.358+0000 7f368aa00700 1 -- 172.21.15.81:0/2083562029 wait complete. 2024-09-13T18:50:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 Processor -- start 2024-09-13T18:50:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 -- start start 2024-09-13T18:50:57.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36840665d0 0x7f368414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3684072530 0x7f3684150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 0x7f36840b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3684156020 con 0x7f368415d6f0 2024-09-13T18:50:57.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3684152310 con 0x7f3684072530 2024-09-13T18:50:57.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f368aa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36841550c0 con 0x7f36840665d0 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f3688a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 0x7f36840b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f3688a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 0x7f36840b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38648/0 (socket says 172.21.15.81:38648) 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.362+0000 7f3688a00700 1 -- 172.21.15.81:0/1508070899 learned_addr learned my addr 172.21.15.81:0/1508070899 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3683400700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3684072530 0x7f3684150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3683e00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36840665d0 0x7f368414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3688a00700 1 -- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36840665d0 msgr2=0x7f368414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3688a00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36840665d0 0x7f368414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3688a00700 1 -- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3684072530 msgr2=0x7f3684150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3688a00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3684072530 0x7f3684150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3688a00700 1 -- 172.21.15.81:0/1508070899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3674009570 con 0x7f368415d6f0 2024-09-13T18:50:57.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3683e00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36840665d0 0x7f368414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f3688a00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 0x7f36840b0410 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f367c00cc50 tx=0x7f367c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c003c20 con 0x7f368415d6f0 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c003d80 con 0x7f368415d6f0 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c00ab60 con 0x7f368415d6f0 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3684155400 con 0x7f368415d6f0 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3684155c40 con 0x7f368415d6f0 2024-09-13T18:50:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368406a950 con 0x7f368415d6f0 2024-09-13T18:50:57.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.366+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f367c00acc0 con 0x7f368415d6f0 2024-09-13T18:50:57.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.370+0000 7f367be00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3664066730 0x7f3664068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.370+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f367c0843a0 con 0x7f368415d6f0 2024-09-13T18:50:57.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.370+0000 7f3683e00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3664066730 0x7f3664068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.370+0000 7f3683e00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3664066730 0x7f3664068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3674000c00 tx=0x7f3674008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.374+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f367c0515e0 con 0x7f368415d6f0 2024-09-13T18:50:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.602+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3684067730 con 0x7f368415d6f0 2024-09-13T18:50:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.606+0000 7f367be00700 1 -- 172.21.15.81:0/1508070899 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f367c054c00 con 0x7f368415d6f0 2024-09-13T18:50:57.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:57.615 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:50:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3664066730 msgr2=0x7f3664068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3664066730 0x7f3664068bf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3674000c00 tx=0x7f3674008030 comp rx=0 tx=0).stop 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 msgr2=0x7f36840b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 0x7f36840b0410 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f367c00cc50 tx=0x7f367c00cf60 comp rx=0 tx=0).stop 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 shutdown_connections 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3664066730 0x7f3664068bf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368415d6f0 0x7f36840b0410 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3684072530 0x7f3684150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 --2- 172.21.15.81:0/1508070899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36840665d0 0x7f368414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 >> 172.21.15.81:0/1508070899 conn(0x7f36840b1e00 msgr2=0x7f368415ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 shutdown_connections 2024-09-13T18:50:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.610+0000 7f368aa00700 1 -- 172.21.15.81:0/1508070899 wait complete. 2024-09-13T18:50:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:50:57.642 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:50:57.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:50:57.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4de1600700 1 Processor -- start 2024-09-13T18:50:57.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4de1600700 1 -- start start 2024-09-13T18:50:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4de1600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ddc15cd00 0x7f4ddc06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4de1600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc06d720 con 0x7f4ddc15c920 2024-09-13T18:50:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4de1600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc06cf10 con 0x7f4ddc0b1220 2024-09-13T18:50:57.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4de1600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0b35e0 con 0x7f4ddc15cd00 2024-09-13T18:50:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4ddb400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4ddc15cd00 0x7f4ddc06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4dd2000700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4ddc0b1220 0x7f4ddc0701c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33574/0 (socket says 172.21.15.81:33574) 2024-09-13T18:50:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4ddaa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ddc15c920 0x7f4ddc0b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40566/0 (socket says 172.21.15.81:40566) 2024-09-13T18:50:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4dd2000700 1 -- 172.21.15.81:0/3509152989 learned_addr learned my addr 172.21.15.81:0/3509152989 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4dda000700 1 -- 172.21.15.81:0/3509152989 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601029993 0 0) 0x7f4ddc06cf10 con 0x7f4ddc0b1220 2024-09-13T18:50:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4dda000700 1 -- 172.21.15.81:0/3509152989 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dc00035d0 con 0x7f4ddc0b1220 2024-09-13T18:50:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4dda000700 1 -- 172.21.15.81:0/3509152989 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096610909 0 0) 0x7f4ddc06d720 con 0x7f4ddc15c920 2024-09-13T18:50:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4ddb400700 1 -- 172.21.15.81:0/3509152989 >> v1:172.21.15.178:6789/0 conn(0x7f4ddc0b1220 legacy=0x7f4ddc0701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4ddb400700 1 -- 172.21.15.81:0/3509152989 >> v1:172.21.15.81:6789/0 conn(0x7f4ddc15c920 legacy=0x7f4ddc0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.806+0000 7f4ddb400700 1 -- 172.21.15.81:0/3509152989 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc06c300 con 0x7f4ddc15cd00 2024-09-13T18:50:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4ddb400700 1 --2- 172.21.15.81:0/3509152989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc06dba0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009850 tx=0x7f4dd4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730cbd95c6b44d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4dda000700 1 -- 172.21.15.81:0/3509152989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011830 con 0x7f4ddc15cd00 2024-09-13T18:50:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4dda000700 1 -- 172.21.15.81:0/3509152989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4011990 con 0x7f4ddc15cd00 2024-09-13T18:50:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4dda000700 1 -- 172.21.15.81:0/3509152989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011d40 con 0x7f4ddc15cd00 2024-09-13T18:50:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 -- 172.21.15.81:0/3509152989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 msgr2=0x7f4ddc06dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 --2- 172.21.15.81:0/3509152989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc06dba0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009850 tx=0x7f4dd4009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 -- 172.21.15.81:0/3509152989 shutdown_connections 2024-09-13T18:50:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 --2- 172.21.15.81:0/3509152989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc06dba0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 -- 172.21.15.81:0/3509152989 >> 172.21.15.81:0/3509152989 conn(0x7f4ddc06a7b0 msgr2=0x7f4ddc06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 -- 172.21.15.81:0/3509152989 shutdown_connections 2024-09-13T18:50:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.810+0000 7f4de1600700 1 -- 172.21.15.81:0/3509152989 wait complete. 2024-09-13T18:50:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 Processor -- start 2024-09-13T18:50:57.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 -- start start 2024-09-13T18:50:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0b1220 0x7f4ddc1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc15c920 0x7f4ddc1f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc15f410 con 0x7f4ddc15cd00 2024-09-13T18:50:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1f6580 con 0x7f4ddc15c920 2024-09-13T18:50:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4de1600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1f5ce0 con 0x7f4ddc0b1220 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4ddb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4ddb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc15eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38662/0 (socket says 172.21.15.81:38662) 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.814+0000 7f4ddb400700 1 -- 172.21.15.81:0/4246094077 learned_addr learned my addr 172.21.15.81:0/4246094077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4dd2000700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc15c920 0x7f4ddc1f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddaa00700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0b1220 0x7f4ddc1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddb400700 1 -- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0b1220 msgr2=0x7f4ddc1f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddb400700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0b1220 0x7f4ddc1f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddb400700 1 -- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc15c920 msgr2=0x7f4ddc1f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddb400700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc15c920 0x7f4ddc1f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddb400700 1 -- 172.21.15.81:0/4246094077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40094b0 con 0x7f4ddc15cd00 2024-09-13T18:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4ddb400700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc15eed0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40090b0 tx=0x7f4dd4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40198c0 con 0x7f4ddc15cd00 2024-09-13T18:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd401e070 con 0x7f4ddc15cd00 2024-09-13T18:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4019c80 con 0x7f4ddc15cd00 2024-09-13T18:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc1f5fc0 con 0x7f4ddc15cd00 2024-09-13T18:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc0cb390 con 0x7f4ddc15cd00 2024-09-13T18:50:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.818+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc0cb580 con 0x7f4ddc15cd00 2024-09-13T18:50:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.822+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4dd401a420 con 0x7f4ddc15cd00 2024-09-13T18:50:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.822+0000 7f4dd3400700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4db8066730 0x7f4db8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.822+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4dd4085260 con 0x7f4ddc15cd00 2024-09-13T18:50:57.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.822+0000 7f4ddaa00700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4db8066730 0x7f4db8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:57.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.826+0000 7f4ddaa00700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4db8066730 0x7f4db8068bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0012e0 tx=0x7f4dcc001b70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:57.830+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4dd4052480 con 0x7f4ddc15cd00 2024-09-13T18:50:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.074+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4ddc06bfd0 con 0x7f4ddc15cd00 2024-09-13T18:50:58.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.074+0000 7f4dd3400700 1 -- 172.21.15.81:0/4246094077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1822 (secure 0 0 0) 0x7f4dd4055aa0 con 0x7f4ddc15cd00 2024-09-13T18:50:58.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:58.086 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":247,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":705738,"bytes_used":248897536,"bytes_avail":772845215744,"bytes_total":773094113280,"write_bytes_sec":597,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":44,"id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"d","status":"up:active","gid":5911},{"filesystem_id":3,"rank":1,"name":"c","status":"up:active","gid":6048},{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":6051}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-13T18:50:57.044726+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4db8066730 msgr2=0x7f4db8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4db8066730 0x7f4db8068bf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0012e0 tx=0x7f4dcc001b70 comp rx=0 tx=0).stop 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 msgr2=0x7f4ddc15eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc15eed0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40090b0 tx=0x7f4dd4004770 comp rx=0 tx=0).stop 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 shutdown_connections 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4db8066730 0x7f4db8068bf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ddc15cd00 0x7f4ddc15eed0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ddc15c920 0x7f4ddc1f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 --2- 172.21.15.81:0/4246094077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ddc0b1220 0x7f4ddc1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 >> 172.21.15.81:0/4246094077 conn(0x7f4ddc06a7b0 msgr2=0x7f4ddc070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:58.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 shutdown_connections 2024-09-13T18:50:58.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.082+0000 7f4de1600700 1 -- 172.21.15.81:0/4246094077 wait complete. 2024-09-13T18:50:58.114 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:50:58.115 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:50:58.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:50:58.154 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:50:58.191 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:50:58.191 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:50:58.191 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:50:58.220 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:50:58.220 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:50:58.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:50:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 Processor -- start 2024-09-13T18:50:58.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 -- start start 2024-09-13T18:50:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f913413ebc0 0x7f913406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f913406ab10 0x7f913406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f91340703d0 0x7f913415d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913413fcc0 con 0x7f913406ab10 2024-09-13T18:50:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913406af50 con 0x7f91340703d0 2024-09-13T18:50:58.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9139800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913413f0f0 con 0x7f913413ebc0 2024-09-13T18:50:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f912be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f913406ab10 0x7f913406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f912be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f913406ab10 0x7f913406fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38678/0 (socket says 172.21.15.81:38678) 2024-09-13T18:50:58.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f912be00700 1 -- 172.21.15.81:0/3635067918 learned_addr learned my addr 172.21.15.81:0/3635067918 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9132a00700 1 --2- 172.21.15.81:0/3635067918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f913413ebc0 0x7f913406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.486+0000 7f9133400700 1 --2- 172.21.15.81:0/3635067918 >> v2:172.21.15.178:3300/0 conn(0x7f91340703d0 0x7f913415d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f912be00700 1 -- 172.21.15.81:0/3635067918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f913413ebc0 msgr2=0x7f913406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f912be00700 1 --2- 172.21.15.81:0/3635067918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f913413ebc0 0x7f913406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f912be00700 1 -- 172.21.15.81:0/3635067918 >> v2:172.21.15.178:3300/0 conn(0x7f91340703d0 msgr2=0x7f913415d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f912be00700 1 --2- 172.21.15.81:0/3635067918 >> v2:172.21.15.178:3300/0 conn(0x7f91340703d0 0x7f913415d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f912be00700 1 -- 172.21.15.81:0/3635067918 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913413f390 con 0x7f913406ab10 2024-09-13T18:50:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f912be00700 1 --2- 172.21.15.81:0/3635067918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913406ab10 0x7f913406fe90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9134157ab0 tx=0x7f911c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c861c62ff4b137e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9132000700 1 -- 172.21.15.81:0/3635067918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00f8a0 con 0x7f913406ab10 2024-09-13T18:50:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9132000700 1 -- 172.21.15.81:0/3635067918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00fa00 con 0x7f913406ab10 2024-09-13T18:50:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9132000700 1 -- 172.21.15.81:0/3635067918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00fd90 con 0x7f913406ab10 2024-09-13T18:50:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 -- 172.21.15.81:0/3635067918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913406ab10 msgr2=0x7f913406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 --2- 172.21.15.81:0/3635067918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913406ab10 0x7f913406fe90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9134157ab0 tx=0x7f911c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 -- 172.21.15.81:0/3635067918 shutdown_connections 2024-09-13T18:50:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 --2- 172.21.15.81:0/3635067918 >> v2:172.21.15.178:3300/0 conn(0x7f91340703d0 0x7f913415d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 --2- 172.21.15.81:0/3635067918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913406ab10 0x7f913406fe90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 --2- 172.21.15.81:0/3635067918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f913413ebc0 0x7f913406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 -- 172.21.15.81:0/3635067918 >> 172.21.15.81:0/3635067918 conn(0x7f91340b08d0 msgr2=0x7f91340b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 -- 172.21.15.81:0/3635067918 shutdown_connections 2024-09-13T18:50:58.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.490+0000 7f9139800700 1 -- 172.21.15.81:0/3635067918 wait complete. 2024-09-13T18:50:58.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 Processor -- start 2024-09-13T18:50:58.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 -- start start 2024-09-13T18:50:58.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f913406ab10 0x7f9134153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91340703d0 0x7f91340cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 0x7f91341e5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340cdee0 con 0x7f913413ebc0 2024-09-13T18:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340ce1c0 con 0x7f913406ab10 2024-09-13T18:50:58.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.494+0000 7f9139800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91340ce4a0 con 0x7f91340703d0 2024-09-13T18:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 0x7f91341e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 0x7f91341e5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38680/0 (socket says 172.21.15.81:38680) 2024-09-13T18:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 -- 172.21.15.81:0/2869845718 learned_addr learned my addr 172.21.15.81:0/2869845718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f912be00700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91340703d0 0x7f91340cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9132a00700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f913406ab10 0x7f9134153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 -- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91340703d0 msgr2=0x7f91340cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91340703d0 0x7f91340cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 -- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f913406ab10 msgr2=0x7f9134153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f913406ab10 0x7f9134153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 -- 172.21.15.81:0/2869845718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c009570 con 0x7f913413ebc0 2024-09-13T18:50:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9133400700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 0x7f91341e5600 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f912c00eed0 tx=0x7f912c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c010040 con 0x7f913413ebc0 2024-09-13T18:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c00bc80 con 0x7f913413ebc0 2024-09-13T18:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91340ce780 con 0x7f913413ebc0 2024-09-13T18:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c009e40 con 0x7f913413ebc0 2024-09-13T18:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91340cdb90 con 0x7f913413ebc0 2024-09-13T18:50:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.498+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91340ceca0 con 0x7f913413ebc0 2024-09-13T18:50:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.502+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f912c014400 con 0x7f913413ebc0 2024-09-13T18:50:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.502+0000 7f912aa00700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9110066730 0x7f9110068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.502+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f912c084720 con 0x7f913413ebc0 2024-09-13T18:50:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.502+0000 7f9132a00700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9110066730 0x7f9110068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.502+0000 7f9132a00700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9110066730 0x7f9110068bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91340cd900 tx=0x7f9124009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.510+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f91340ceca0 con 0x7f913413ebc0 2024-09-13T18:50:58.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.702+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91340ceca0 con 0x7f913413ebc0 2024-09-13T18:50:58.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.706+0000 7f912aa00700 1 -- 172.21.15.81:0/2869845718 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16870 (secure 0 0 0) 0x7f91340ceca0 con 0x7f913413ebc0 2024-09-13T18:50:58.715 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:50:58.715 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:58.270993+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2d","mappings":[{"from":0,"to":6}]},{"pgid":"8.39","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9110066730 msgr2=0x7f9110068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9110066730 0x7f9110068bf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91340cd900 tx=0x7f9124009240 comp rx=0 tx=0).stop 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 msgr2=0x7f91341e5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 0x7f91341e5600 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f912c00eed0 tx=0x7f912c00b390 comp rx=0 tx=0).stop 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 shutdown_connections 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9110066730 0x7f9110068bf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f913413ebc0 0x7f91341e5600 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91340703d0 0x7f91340cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 --2- 172.21.15.81:0/2869845718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f913406ab10 0x7f9134153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 >> 172.21.15.81:0/2869845718 conn(0x7f91340b08d0 msgr2=0x7f9134159180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:58.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 shutdown_connections 2024-09-13T18:50:58.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.710+0000 7f9139800700 1 -- 172.21.15.81:0/2869845718 wait complete. 2024-09-13T18:50:58.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:50:03.553082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:50:04.575006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:50:58.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:50:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.922+0000 7f3583c00700 1 Processor -- start 2024-09-13T18:50:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.922+0000 7f3583c00700 1 -- start start 2024-09-13T18:50:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.922+0000 7f3583c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f357c15a3a0 0x7f357c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.922+0000 7f3583c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f357c0b35b0 0x7f357c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.922+0000 7f3583c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0b58f0 con 0x7f357c06f2b0 2024-09-13T18:50:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.922+0000 7f3583c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c06f740 con 0x7f357c0b35b0 2024-09-13T18:50:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f3583c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357c0b3a90 con 0x7f357c15a3a0 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f357c0b35b0 0x7f357c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f357c0b35b0 0x7f357c06ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38692/0 (socket says 172.21.15.81:38692) 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f3581c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f357c06f2b0 0x7f357c06a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40576/0 (socket says 172.21.15.81:40576) 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 -- 172.21.15.81:0/921377766 learned_addr learned my addr 172.21.15.81:0/921377766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f3581200700 1 --2- 172.21.15.81:0/921377766 >> v2:172.21.15.178:3300/0 conn(0x7f357c15a3a0 0x7f357c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 -- 172.21.15.81:0/921377766 >> v2:172.21.15.178:3300/0 conn(0x7f357c15a3a0 msgr2=0x7f357c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 --2- 172.21.15.81:0/921377766 >> v2:172.21.15.178:3300/0 conn(0x7f357c15a3a0 0x7f357c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 -- 172.21.15.81:0/921377766 >> v1:172.21.15.81:6789/0 conn(0x7f357c06f2b0 legacy=0x7f357c06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357b400700 1 -- 172.21.15.81:0/921377766 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888329303 0 0) 0x7f357c0b58f0 con 0x7f357c06f2b0 2024-09-13T18:50:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 -- 172.21.15.81:0/921377766 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0b3d70 con 0x7f357c0b35b0 2024-09-13T18:50:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f3581200700 1 --2- 172.21.15.81:0/921377766 >> v2:172.21.15.178:3300/0 conn(0x7f357c15a3a0 0x7f357c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:50:58.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.926+0000 7f357be00700 1 --2- 172.21.15.81:0/921377766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c06ed70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f357c06f930 tx=0x7f356800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f00e6598c3cbac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f357b400700 1 -- 172.21.15.81:0/921377766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356800dd30 con 0x7f357c0b35b0 2024-09-13T18:50:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f357b400700 1 -- 172.21.15.81:0/921377766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356800de90 con 0x7f357c0b35b0 2024-09-13T18:50:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f357b400700 1 -- 172.21.15.81:0/921377766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568010690 con 0x7f357c0b35b0 2024-09-13T18:50:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 -- 172.21.15.81:0/921377766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 msgr2=0x7f357c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 --2- 172.21.15.81:0/921377766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c06ed70 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f357c06f930 tx=0x7f356800be90 comp rx=0 tx=0).stop 2024-09-13T18:50:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 -- 172.21.15.81:0/921377766 shutdown_connections 2024-09-13T18:50:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 --2- 172.21.15.81:0/921377766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c06ed70 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 --2- 172.21.15.81:0/921377766 >> v2:172.21.15.178:3300/0 conn(0x7f357c15a3a0 0x7f357c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 -- 172.21.15.81:0/921377766 >> 172.21.15.81:0/921377766 conn(0x7f357c06d530 msgr2=0x7f357c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 -- 172.21.15.81:0/921377766 shutdown_connections 2024-09-13T18:50:58.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.930+0000 7f3583c00700 1 -- 172.21.15.81:0/921377766 wait complete. 2024-09-13T18:50:58.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 Processor -- start 2024-09-13T18:50:58.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 -- start start 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f357c06f2b0 0x7f357c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f357c15a3a0 0x7f357c1476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c14aec0 con 0x7f357c0b35b0 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c149e20 con 0x7f357c15a3a0 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3583c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c14a100 con 0x7f357c06f2b0 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38696/0 (socket says 172.21.15.81:38696) 2024-09-13T18:50:58.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 -- 172.21.15.81:0/2594456605 learned_addr learned my addr 172.21.15.81:0/2594456605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:58.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3581c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f357c15a3a0 0x7f357c1476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3581200700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f357c06f2b0 0x7f357c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 -- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f357c06f2b0 msgr2=0x7f357c14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f357c06f2b0 0x7f357c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 -- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f357c15a3a0 msgr2=0x7f357c1476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f357c15a3a0 0x7f357c1476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 -- 172.21.15.81:0/2594456605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35700094b0 con 0x7f357c0b35b0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f3581c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f357c15a3a0 0x7f357c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.934+0000 7f357be00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c153ff0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f357c06df10 tx=0x7f3568004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356801d070 con 0x7f357c0b35b0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568010840 con 0x7f357c0b35b0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568010bd0 con 0x7f357c0b35b0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356800b810 con 0x7f357c0b35b0 2024-09-13T18:50:58.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c14a6c0 con 0x7f357c0b35b0 2024-09-13T18:50:58.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c06ed70 con 0x7f357c0b35b0 2024-09-13T18:50:58.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.938+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35680036c0 con 0x7f357c0b35b0 2024-09-13T18:50:58.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.942+0000 7f3578c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f355c066760 0x7f355c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:58.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.942+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f35680859d0 con 0x7f357c0b35b0 2024-09-13T18:50:58.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.942+0000 7f3581200700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f355c066760 0x7f355c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:58.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.942+0000 7f3581200700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f355c066760 0x7f355c068c20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f357c071740 tx=0x7f3570008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:58.946+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3568052bb0 con 0x7f357c0b35b0 2024-09-13T18:50:59.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.122+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f357c0cf450 con 0x7f357c0b35b0 2024-09-13T18:50:59.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.122+0000 7f3578c00700 1 -- 172.21.15.81:0/2594456605 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35680561d0 con 0x7f357c0b35b0 2024-09-13T18:50:59.131 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f355c066760 msgr2=0x7f355c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f355c066760 0x7f355c068c20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f357c071740 tx=0x7f3570008040 comp rx=0 tx=0).stop 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 msgr2=0x7f357c153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c153ff0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f357c06df10 tx=0x7f3568004770 comp rx=0 tx=0).stop 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 shutdown_connections 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f355c066760 0x7f355c068c20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f357c15a3a0 0x7f357c1476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357c0b35b0 0x7f357c153ff0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 --2- 172.21.15.81:0/2594456605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f357c06f2b0 0x7f357c14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 >> 172.21.15.81:0/2594456605 conn(0x7f357c06d530 msgr2=0x7f357c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 shutdown_connections 2024-09-13T18:50:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.126+0000 7f3583c00700 1 -- 172.21.15.81:0/2594456605 wait complete. 2024-09-13T18:50:59.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:50:59.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.321+0000 7fceaec00700 1 Processor -- start 2024-09-13T18:50:59.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.321+0000 7fceaec00700 1 -- start start 2024-09-13T18:50:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceaec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea8143b70 0x7fcea80cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceaec00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcea806d620 0x7fcea806c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceaec00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea80b1980 con 0x7fcea806cea0 2024-09-13T18:50:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceaec00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea80b2500 con 0x7fcea806d620 2024-09-13T18:50:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceaec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea806d2f0 con 0x7fcea8143b70 2024-09-13T18:50:59.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceae200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcea806cea0 0x7fcea815e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40588/0 (socket says 172.21.15.81:40588) 2024-09-13T18:50:59.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceae200700 1 -- 172.21.15.81:0/3948878599 learned_addr learned my addr 172.21.15.81:0/3948878599 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:59.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fceace00700 1 --2- 172.21.15.81:0/3948878599 >> v2:172.21.15.178:3300/0 conn(0x7fcea806d620 0x7fcea806c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fcead800700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea8143b70 0x7fcea80cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fcea7e00700 1 -- 172.21.15.81:0/3948878599 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408656936 0 0) 0x7fcea80b1980 con 0x7fcea806cea0 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.325+0000 7fcea7e00700 1 -- 172.21.15.81:0/3948878599 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce900035d0 con 0x7fcea806cea0 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceace00700 1 -- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea8143b70 msgr2=0x7fcea80cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceace00700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea8143b70 0x7fcea80cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceace00700 1 -- 172.21.15.81:0/3948878599 >> v1:172.21.15.81:6789/0 conn(0x7fcea806cea0 legacy=0x7fcea815e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceace00700 1 -- 172.21.15.81:0/3948878599 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea80b1bd0 con 0x7fcea806d620 2024-09-13T18:50:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fcead800700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea8143b70 0x7fcea80cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceace00700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea806c960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce94009850 tx=0x7fce94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d63755873cc67be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fcea7e00700 1 -- 172.21.15.81:0/3948878599 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94011830 con 0x7fcea806d620 2024-09-13T18:50:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fcea7e00700 1 -- 172.21.15.81:0/3948878599 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94011990 con 0x7fcea806d620 2024-09-13T18:50:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fcea7e00700 1 -- 172.21.15.81:0/3948878599 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94011d40 con 0x7fcea806d620 2024-09-13T18:50:59.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 -- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 msgr2=0x7fcea806c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea806c960 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce94009850 tx=0x7fce94009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:59.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 -- 172.21.15.81:0/3948878599 shutdown_connections 2024-09-13T18:50:59.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea806c960 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 --2- 172.21.15.81:0/3948878599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea8143b70 0x7fcea80cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 -- 172.21.15.81:0/3948878599 >> 172.21.15.81:0/3948878599 conn(0x7fcea806a390 msgr2=0x7fcea806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 -- 172.21.15.81:0/3948878599 shutdown_connections 2024-09-13T18:50:59.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.329+0000 7fceaec00700 1 -- 172.21.15.81:0/3948878599 wait complete. 2024-09-13T18:50:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 Processor -- start 2024-09-13T18:50:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 -- start start 2024-09-13T18:50:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea806cea0 0x7fcea81f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea8144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 0x7fcea80c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea81f2ce0 con 0x7fcea8143b70 2024-09-13T18:50:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea815dc30 con 0x7fcea806d620 2024-09-13T18:50:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.333+0000 7fceaec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea80c7f60 con 0x7fcea806cea0 2024-09-13T18:50:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 0x7fcea80c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 0x7fcea80c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38704/0 (socket says 172.21.15.81:38704) 2024-09-13T18:50:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 -- 172.21.15.81:0/3854320559 learned_addr learned my addr 172.21.15.81:0/3854320559 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceace00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea8144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fcead800700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea806cea0 0x7fcea81f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 -- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea806cea0 msgr2=0x7fcea81f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea806cea0 0x7fcea81f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 -- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 msgr2=0x7fcea8144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea8144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 -- 172.21.15.81:0/3854320559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce940094b0 con 0x7fcea8143b70 2024-09-13T18:50:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceae200700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 0x7fcea80c9000 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c4f0 tx=0x7fcea000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0005d90 con 0x7fcea8143b70 2024-09-13T18:50:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea00070d0 con 0x7fcea8143b70 2024-09-13T18:50:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea80c8240 con 0x7fcea8143b70 2024-09-13T18:50:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0007460 con 0x7fcea8143b70 2024-09-13T18:50:59.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea80c8800 con 0x7fcea8143b70 2024-09-13T18:50:59.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.337+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea80cab70 con 0x7fcea8143b70 2024-09-13T18:50:59.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.341+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcea00075c0 con 0x7fcea8143b70 2024-09-13T18:50:59.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.341+0000 7fcea5600700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce88066760 0x7fce88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.341+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fcea0083770 con 0x7fcea8143b70 2024-09-13T18:50:59.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.345+0000 7fcead800700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce88066760 0x7fce88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.345+0000 7fcead800700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce88066760 0x7fce88068c20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009fd0 tx=0x7fce9c009870 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:59.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.349+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcea00508c0 con 0x7fcea8143b70 2024-09-13T18:50:59.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.521+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcea8143f50 con 0x7fcea8143b70 2024-09-13T18:50:59.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.521+0000 7fcea5600700 1 -- 172.21.15.81:0/3854320559 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcea0053ee0 con 0x7fcea8143b70 2024-09-13T18:50:59.532 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce88066760 msgr2=0x7fce88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce88066760 0x7fce88068c20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009fd0 tx=0x7fce9c009870 comp rx=0 tx=0).stop 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 msgr2=0x7fcea80c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 0x7fcea80c9000 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c4f0 tx=0x7fcea000c800 comp rx=0 tx=0).stop 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 shutdown_connections 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fce88066760 0x7fce88068c20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcea8143b70 0x7fcea80c9000 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcea806d620 0x7fcea8144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 --2- 172.21.15.81:0/3854320559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcea806cea0 0x7fcea81f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 >> 172.21.15.81:0/3854320559 conn(0x7fcea806a390 msgr2=0x7fcea80ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:59.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 shutdown_connections 2024-09-13T18:50:59.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.525+0000 7fceaec00700 1 -- 172.21.15.81:0/3854320559 wait complete. 2024-09-13T18:50:59.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:50:59.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.717+0000 7f6f74800700 1 Processor -- start 2024-09-13T18:50:59.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.721+0000 7f6f74800700 1 -- start start 2024-09-13T18:50:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.721+0000 7f6f74800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6f6c157500 0x7f6f6c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.721+0000 7f6f74800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f74800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0b57e0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f74800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0b3b80 con 0x7f6f6c157500 2024-09-13T18:50:59.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f74800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0b5a80 con 0x7f6f6c15e030 2024-09-13T18:50:59.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f72800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6f6c0cd140 0x7f6f6c160ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40604/0 (socket says 172.21.15.81:40604) 2024-09-13T18:50:59.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f72800700 1 -- 172.21.15.81:0/1601929422 learned_addr learned my addr 172.21.15.81:0/1601929422 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:50:59.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71400700 1 --2- 172.21.15.81:0/1601929422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71e00700 1 --2- 172.21.15.81:0/1601929422 >> v2:172.21.15.178:3300/0 conn(0x7f6f6c157500 0x7f6f6c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f70a00700 1 -- 172.21.15.81:0/1601929422 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036035787 0 0) 0x7f6f6c0b57e0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f70a00700 1 -- 172.21.15.81:0/1601929422 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f540035d0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71400700 1 -- 172.21.15.81:0/1601929422 >> v2:172.21.15.178:3300/0 conn(0x7f6f6c157500 msgr2=0x7f6f6c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:50:59.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71400700 1 --2- 172.21.15.81:0/1601929422 >> v2:172.21.15.178:3300/0 conn(0x7f6f6c157500 0x7f6f6c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71400700 1 -- 172.21.15.81:0/1601929422 >> v1:172.21.15.81:6789/0 conn(0x7f6f6c0cd140 legacy=0x7f6f6c160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71400700 1 -- 172.21.15.81:0/1601929422 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0b5d60 con 0x7f6f6c15e030 2024-09-13T18:50:59.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f71400700 1 --2- 172.21.15.81:0/1601929422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c070380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009850 tx=0x7f6f5c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f5211380c8cdcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:59.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f70a00700 1 -- 172.21.15.81:0/1601929422 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c011830 con 0x7f6f6c15e030 2024-09-13T18:50:59.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f70a00700 1 -- 172.21.15.81:0/1601929422 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c011990 con 0x7f6f6c15e030 2024-09-13T18:50:59.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.725+0000 7f6f70a00700 1 -- 172.21.15.81:0/1601929422 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c011d40 con 0x7f6f6c15e030 2024-09-13T18:50:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 -- 172.21.15.81:0/1601929422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 msgr2=0x7f6f6c070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 --2- 172.21.15.81:0/1601929422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c070380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c009850 tx=0x7f6f5c009b60 comp rx=0 tx=0).stop 2024-09-13T18:50:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 -- 172.21.15.81:0/1601929422 shutdown_connections 2024-09-13T18:50:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 --2- 172.21.15.81:0/1601929422 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c070380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 --2- 172.21.15.81:0/1601929422 >> v2:172.21.15.178:3300/0 conn(0x7f6f6c157500 0x7f6f6c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 -- 172.21.15.81:0/1601929422 >> 172.21.15.81:0/1601929422 conn(0x7f6f6c06e660 msgr2=0x7f6f6c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 -- 172.21.15.81:0/1601929422 shutdown_connections 2024-09-13T18:50:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 -- 172.21.15.81:0/1601929422 wait complete. 2024-09-13T18:50:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.729+0000 7f6f74800700 1 Processor -- start 2024-09-13T18:50:59.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 -- start start 2024-09-13T18:50:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 0x7f6f6c146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f6c157500 0x7f6f6c15f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c15fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0ccc00 con 0x7f6f6c0cd140 2024-09-13T18:50:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0cbff0 con 0x7f6f6c157500 2024-09-13T18:50:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f74800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0cc2d0 con 0x7f6f6c15e030 2024-09-13T18:50:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 0x7f6f6c146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 0x7f6f6c146690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38712/0 (socket says 172.21.15.81:38712) 2024-09-13T18:50:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 -- 172.21.15.81:0/492786707 learned_addr learned my addr 172.21.15.81:0/492786707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:50:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71400700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f6c157500 0x7f6f6c15f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f72800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c15fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 -- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 msgr2=0x7f6f6c15fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c15fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 -- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f6c157500 msgr2=0x7f6f6c15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f6c157500 0x7f6f6c15f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 -- 172.21.15.81:0/492786707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0094b0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f72800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c15fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f71e00700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 0x7f6f6c146690 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000e9d0 tx=0x7f6f6000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60009720 con 0x7f6f6c0cd140 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.733+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000c850 con 0x7f6f6c0cd140 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.737+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c0cc5b0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.737+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000cbc0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.737+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c146bd0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.737+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0cda00 con 0x7f6f6c0cd140 2024-09-13T18:50:59.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.741+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6f6000cd20 con 0x7f6f6c0cd140 2024-09-13T18:50:59.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.741+0000 7f6f66000700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6f50066730 0x7f6f50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:50:59.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.741+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f6f60084470 con 0x7f6f6c0cd140 2024-09-13T18:50:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.741+0000 7f6f71400700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6f50066730 0x7f6f50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:50:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.741+0000 7f6f71400700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6f50066730 0x7f6f50068bf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0090b0 tx=0x7f6f5c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:50:59.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.745+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f600515c0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.941+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f6c070160 con 0x7f6f6c0cd140 2024-09-13T18:50:59.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.941+0000 7f6f66000700 1 -- 172.21.15.81:0/492786707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f60054be0 con 0x7f6f6c0cd140 2024-09-13T18:50:59.953 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6f50066730 msgr2=0x7f6f50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6f50066730 0x7f6f50068bf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0090b0 tx=0x7f6f5c01c040 comp rx=0 tx=0).stop 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 msgr2=0x7f6f6c146690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 0x7f6f6c146690 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000e9d0 tx=0x7f6f6000ece0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 shutdown_connections 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6f50066730 0x7f6f50068bf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f6c15e030 0x7f6f6c15fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f6c157500 0x7f6f6c15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 --2- 172.21.15.81:0/492786707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f6c0cd140 0x7f6f6c146690 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 >> 172.21.15.81:0/492786707 conn(0x7f6f6c06e660 msgr2=0x7f6f6c06ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:50:59.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 shutdown_connections 2024-09-13T18:50:59.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:50:59.945+0000 7f6f74800700 1 -- 172.21.15.81:0/492786707 wait complete. 2024-09-13T18:50:59.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:51:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0942000700 1 Processor -- start 2024-09-13T18:51:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0942000700 1 -- start start 2024-09-13T18:51:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0942000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f093c0d15d0 0x7f093c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0942000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c0b03f0 con 0x7f093c1570f0 2024-09-13T18:51:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0942000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c15dec0 con 0x7f093c0b2cc0 2024-09-13T18:51:00.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0942000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c15d040 con 0x7f093c0d15d0 2024-09-13T18:51:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0940c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f093c1570f0 0x7f093c0b25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40612/0 (socket says 172.21.15.81:40612) 2024-09-13T18:51:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.145+0000 7f0940c00700 1 -- 172.21.15.81:0/2979515443 learned_addr learned my addr 172.21.15.81:0/2979515443 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0941600700 1 --2- 172.21.15.81:0/2979515443 >> v2:172.21.15.178:3300/0 conn(0x7f093c0d15d0 0x7f093c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832584591 0 0) 0x7f0930001110 con 0x7f093c1570f0 2024-09-13T18:51:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09240035d0 con 0x7f093c1570f0 2024-09-13T18:51:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294787959 0 0) 0x7f093c15dec0 con 0x7f093c0b2cc0 2024-09-13T18:51:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930001110 con 0x7f093c0b2cc0 2024-09-13T18:51:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0941600700 1 -- 172.21.15.81:0/2979515443 >> v1:172.21.15.178:6789/0 conn(0x7f093c0b2cc0 legacy=0x7f093c0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0941600700 1 -- 172.21.15.81:0/2979515443 >> v1:172.21.15.81:6789/0 conn(0x7f093c1570f0 legacy=0x7f093c0b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0941600700 1 -- 172.21.15.81:0/2979515443 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c15d2b0 con 0x7f093c0d15d0 2024-09-13T18:51:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0941600700 1 --2- 172.21.15.81:0/2979515443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c0d15d0 0x7f093c0cf590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0934009d90 tx=0x7f093400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cb3ccb4ade2e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093400e070 con 0x7f093c0d15d0 2024-09-13T18:51:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093400bb20 con 0x7f093c0d15d0 2024-09-13T18:51:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f093b400700 1 -- 172.21.15.81:0/2979515443 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093400be90 con 0x7f093c0d15d0 2024-09-13T18:51:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0942000700 1 -- 172.21.15.81:0/2979515443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c0d15d0 msgr2=0x7f093c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0942000700 1 --2- 172.21.15.81:0/2979515443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c0d15d0 0x7f093c0cf590 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0934009d90 tx=0x7f093400b330 comp rx=0 tx=0).stop 2024-09-13T18:51:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0942000700 1 -- 172.21.15.81:0/2979515443 shutdown_connections 2024-09-13T18:51:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0942000700 1 --2- 172.21.15.81:0/2979515443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c0d15d0 0x7f093c0cf590 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.149+0000 7f0942000700 1 -- 172.21.15.81:0/2979515443 >> 172.21.15.81:0/2979515443 conn(0x7f093c06e660 msgr2=0x7f093c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.153+0000 7f0942000700 1 -- 172.21.15.81:0/2979515443 shutdown_connections 2024-09-13T18:51:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.153+0000 7f0942000700 1 -- 172.21.15.81:0/2979515443 wait complete. 2024-09-13T18:51:00.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.153+0000 7f0942000700 1 Processor -- start 2024-09-13T18:51:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.153+0000 7f0942000700 1 -- start start 2024-09-13T18:51:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f093c0b2cc0 0x7f093c0b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 0x7f093c0af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c1570f0 0x7f093c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0c89c0 con 0x7f093c0d15d0 2024-09-13T18:51:00.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0c7e40 con 0x7f093c1570f0 2024-09-13T18:51:00.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0c8120 con 0x7f093c0b2cc0 2024-09-13T18:51:00.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 0x7f093c0af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 0x7f093c0af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38714/0 (socket says 172.21.15.81:38714) 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 -- 172.21.15.81:0/8278350 learned_addr learned my addr 172.21.15.81:0/8278350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0941600700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c1570f0 0x7f093c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0940c00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f093c0b2cc0 0x7f093c0b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 -- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f093c0b2cc0 msgr2=0x7f093c0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f093c0b2cc0 0x7f093c0b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 -- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c1570f0 msgr2=0x7f093c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c1570f0 0x7f093c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 -- 172.21.15.81:0/8278350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0934009a70 con 0x7f093c0d15d0 2024-09-13T18:51:00.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0941600700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c1570f0 0x7f093c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f093be00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 0x7f093c0af840 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f092800c490 tx=0x7f092800c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092800cea0 con 0x7f093c0d15d0 2024-09-13T18:51:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09280052f0 con 0x7f093c0d15d0 2024-09-13T18:51:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c0c8400 con 0x7f093c0d15d0 2024-09-13T18:51:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280036a0 con 0x7f093c0d15d0 2024-09-13T18:51:00.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c0c7a80 con 0x7f093c0d15d0 2024-09-13T18:51:00.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.157+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c0c9770 con 0x7f093c0d15d0 2024-09-13T18:51:00.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.161+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0928003800 con 0x7f093c0d15d0 2024-09-13T18:51:00.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.161+0000 7f0938c00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f091c066730 0x7f091c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.161+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f09280836a0 con 0x7f093c0d15d0 2024-09-13T18:51:00.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.161+0000 7f0940c00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f091c066730 0x7f091c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.165+0000 7f0940c00700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f091c066730 0x7f091c068bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0930007fd0 tx=0x7f0930007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:00.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.169+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f093c0c9770 con 0x7f093c0d15d0 2024-09-13T18:51:00.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.365+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f093c0c9770 con 0x7f093c0d15d0 2024-09-13T18:51:00.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.365+0000 7f0938c00700 1 -- 172.21.15.81:0/8278350 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v55) v1 ==== 80+0+0 (secure 0 0 0) 0x7f093c0c9770 con 0x7f093c0d15d0 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f091c066730 msgr2=0x7f091c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f091c066730 0x7f091c068bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0930007fd0 tx=0x7f0930007de0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 msgr2=0x7f093c0af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 0x7f093c0af840 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f092800c490 tx=0x7f092800c7a0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 shutdown_connections 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f091c066730 0x7f091c068bf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f093c1570f0 0x7f093c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f093c0d15d0 0x7f093c0af840 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 --2- 172.21.15.81:0/8278350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f093c0b2cc0 0x7f093c0b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 >> 172.21.15.81:0/8278350 conn(0x7f093c06e660 msgr2=0x7f093c0c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:00.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 shutdown_connections 2024-09-13T18:51:00.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.369+0000 7f0942000700 1 -- 172.21.15.81:0/8278350 wait complete. 2024-09-13T18:51:00.383 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:51:00.402 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:51:00.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:00.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:51:00.442 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:51:00.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:00.442 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:51:00.505 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:51:00.505 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:00.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:51:00.523 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:51:00.523 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:00.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:51:00.561 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:51:00.562 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:00.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:51:00.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:00.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.765+0000 7f99c0e00700 1 Processor -- start 2024-09-13T18:51:00.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.765+0000 7f99c0e00700 1 -- start start 2024-09-13T18:51:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99bc161150 0x7f99bc0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99bc06aaa0 0x7f99bc0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0cb1a0 con 0x7f99bc0cc740 2024-09-13T18:51:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0cb440 con 0x7f99bc161150 2024-09-13T18:51:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0cb720 con 0x7f99bc06aaa0 2024-09-13T18:51:00.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99bc161150 0x7f99bc0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99bc161150 0x7f99bc0cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38728/0 (socket says 172.21.15.81:38728) 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 -- 172.21.15.81:0/3863348717 learned_addr learned my addr 172.21.15.81:0/3863348717 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bbe00700 1 --2- 172.21.15.81:0/3863348717 >> v2:172.21.15.178:3300/0 conn(0x7f99bc06aaa0 0x7f99bc0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 -- 172.21.15.81:0/3863348717 >> v2:172.21.15.178:3300/0 conn(0x7f99bc06aaa0 msgr2=0x7f99bc0ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 --2- 172.21.15.81:0/3863348717 >> v2:172.21.15.178:3300/0 conn(0x7f99bc06aaa0 0x7f99bc0ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 -- 172.21.15.81:0/3863348717 >> v1:172.21.15.81:6789/0 conn(0x7f99bc0cc740 legacy=0x7f99bc06a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 -- 172.21.15.81:0/3863348717 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cba00 con 0x7f99bc161150 2024-09-13T18:51:00.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99bb400700 1 --2- 172.21.15.81:0/3863348717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc161150 0x7f99bc0cc200 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0d0d70 tx=0x7f99ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1595a329cfbfffef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:00.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99ba000700 1 -- 172.21.15.81:0/3863348717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00b8a0 con 0x7f99bc161150 2024-09-13T18:51:00.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99ba000700 1 -- 172.21.15.81:0/3863348717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00ba00 con 0x7f99bc161150 2024-09-13T18:51:00.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99ba000700 1 -- 172.21.15.81:0/3863348717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00bd90 con 0x7f99bc161150 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- 172.21.15.81:0/3863348717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc161150 msgr2=0x7f99bc0cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3863348717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc161150 0x7f99bc0cc200 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0d0d70 tx=0x7f99ac009bf0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- 172.21.15.81:0/3863348717 shutdown_connections 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3863348717 >> v2:172.21.15.178:3300/0 conn(0x7f99bc06aaa0 0x7f99bc0ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3863348717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc161150 0x7f99bc0cc200 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- 172.21.15.81:0/3863348717 >> 172.21.15.81:0/3863348717 conn(0x7f99bc071f00 msgr2=0x7f99bc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- 172.21.15.81:0/3863348717 shutdown_connections 2024-09-13T18:51:00.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.769+0000 7f99c0e00700 1 -- 172.21.15.81:0/3863348717 wait complete. 2024-09-13T18:51:00.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 Processor -- start 2024-09-13T18:51:00.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 -- start start 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 0x7f99bc15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0cc740 0x7f99bc162850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc161150 0x7f99bc162d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c6220 con 0x7f99bc06aaa0 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c6640 con 0x7f99bc0cc740 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99c0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c55a0 con 0x7f99bc161150 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 0x7f99bc15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 0x7f99bc15dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38730/0 (socket says 172.21.15.81:38730) 2024-09-13T18:51:00.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.773+0000 7f99bb400700 1 -- 172.21.15.81:0/3233710751 learned_addr learned my addr 172.21.15.81:0/3233710751 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:00.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99baa00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0cc740 0x7f99bc162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bb400700 1 -- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc161150 msgr2=0x7f99bc162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bbe00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc161150 0x7f99bc162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bb400700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc161150 0x7f99bc162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bb400700 1 -- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0cc740 msgr2=0x7f99bc162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bb400700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0cc740 0x7f99bc162850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bb400700 1 -- 172.21.15.81:0/3233710751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac009570 con 0x7f99bc06aaa0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99baa00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0cc740 0x7f99bc162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99bb400700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 0x7f99bc15dee0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f99ac000c00 tx=0x7f99ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003ad0 con 0x7f99bc06aaa0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac01e070 con 0x7f99bc06aaa0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0c5880 con 0x7f99bc06aaa0 2024-09-13T18:51:00.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003e90 con 0x7f99bc06aaa0 2024-09-13T18:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0c5e40 con 0x7f99bc06aaa0 2024-09-13T18:51:00.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.777+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc0cd650 con 0x7f99bc06aaa0 2024-09-13T18:51:00.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.781+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99ac025480 con 0x7f99bc06aaa0 2024-09-13T18:51:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.781+0000 7f99b3400700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f999c066730 0x7f999c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.781+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f99ac020070 con 0x7f99bc06aaa0 2024-09-13T18:51:00.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.781+0000 7f99baa00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f999c066730 0x7f999c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:00.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.785+0000 7f99baa00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f999c066730 0x7f999c068bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06aef0 tx=0x7f99a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:00.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:00.789+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99ac052cd0 con 0x7f99bc06aaa0 2024-09-13T18:51:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.045+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99bc06a430 con 0x7f99bc06aaa0 2024-09-13T18:51:01.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.045+0000 7f99b3400700 1 -- 172.21.15.81:0/3233710751 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f99ac0562f0 con 0x7f99bc06aaa0 2024-09-13T18:51:01.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:01.057 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:51:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f999c066730 msgr2=0x7f999c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f999c066730 0x7f999c068bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f99bc06aef0 tx=0x7f99a8009040 comp rx=0 tx=0).stop 2024-09-13T18:51:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 msgr2=0x7f99bc15dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 0x7f99bc15dee0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f99ac000c00 tx=0x7f99ac004770 comp rx=0 tx=0).stop 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 shutdown_connections 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f999c066730 0x7f999c068bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99bc161150 0x7f99bc162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99bc0cc740 0x7f99bc162850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 --2- 172.21.15.81:0/3233710751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99bc06aaa0 0x7f99bc15dee0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 >> 172.21.15.81:0/3233710751 conn(0x7f99bc071f00 msgr2=0x7f99bc0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 shutdown_connections 2024-09-13T18:51:01.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.049+0000 7f99c0e00700 1 -- 172.21.15.81:0/3233710751 wait complete. 2024-09-13T18:51:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:51:01.085 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:01.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.241+0000 7ff7fee00700 1 Processor -- start 2024-09-13T18:51:01.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.241+0000 7ff7fee00700 1 -- start start 2024-09-13T18:51:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fee00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7f81610b0 0x7ff7f80719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7f806aaa0 0x7ff7f806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f80b2670 0x7ff7f80b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f8070b30 con 0x7ff7f806aaa0 2024-09-13T18:51:01.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fee00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f806b450 con 0x7ff7f81610b0 2024-09-13T18:51:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f80b3040 con 0x7ff7f80b2670 2024-09-13T18:51:01.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7f806aaa0 0x7ff7f806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7f806aaa0 0x7ff7f806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38742/0 (socket says 172.21.15.81:38742) 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 -- 172.21.15.81:0/2947580685 learned_addr learned my addr 172.21.15.81:0/2947580685 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fda00700 1 --2- 172.21.15.81:0/2947580685 >> v2:172.21.15.178:3300/0 conn(0x7ff7f81610b0 0x7ff7f80719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fe400700 1 --2- 172.21.15.81:0/2947580685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f80b2670 0x7ff7f80b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 -- 172.21.15.81:0/2947580685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f80b2670 msgr2=0x7ff7f80b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 --2- 172.21.15.81:0/2947580685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f80b2670 0x7ff7f80b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 -- 172.21.15.81:0/2947580685 >> v2:172.21.15.178:3300/0 conn(0x7ff7f81610b0 msgr2=0x7ff7f80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 --2- 172.21.15.81:0/2947580685 >> v2:172.21.15.178:3300/0 conn(0x7ff7f81610b0 0x7ff7f80719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.245+0000 7ff7fd000700 1 -- 172.21.15.81:0/2947580685 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80b3560 con 0x7ff7f806aaa0 2024-09-13T18:51:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fd000700 1 --2- 172.21.15.81:0/2947580685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f806aaa0 0x7ff7f806af10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009940 tx=0x7ff7e4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a66b7e631ce860d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7f7e00700 1 -- 172.21.15.81:0/2947580685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4011830 con 0x7ff7f806aaa0 2024-09-13T18:51:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7f7e00700 1 -- 172.21.15.81:0/2947580685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4011990 con 0x7ff7f806aaa0 2024-09-13T18:51:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7f7e00700 1 -- 172.21.15.81:0/2947580685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4011d20 con 0x7ff7f806aaa0 2024-09-13T18:51:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 -- 172.21.15.81:0/2947580685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f806aaa0 msgr2=0x7ff7f806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 --2- 172.21.15.81:0/2947580685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f806aaa0 0x7ff7f806af10 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009940 tx=0x7ff7e4009c50 comp rx=0 tx=0).stop 2024-09-13T18:51:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 -- 172.21.15.81:0/2947580685 shutdown_connections 2024-09-13T18:51:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 --2- 172.21.15.81:0/2947580685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f80b2670 0x7ff7f80b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 --2- 172.21.15.81:0/2947580685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f806aaa0 0x7ff7f806af10 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 --2- 172.21.15.81:0/2947580685 >> v2:172.21.15.178:3300/0 conn(0x7ff7f81610b0 0x7ff7f80719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 -- 172.21.15.81:0/2947580685 >> 172.21.15.81:0/2947580685 conn(0x7ff7f80b0c40 msgr2=0x7ff7f806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:01.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 -- 172.21.15.81:0/2947580685 shutdown_connections 2024-09-13T18:51:01.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.249+0000 7ff7fee00700 1 -- 172.21.15.81:0/2947580685 wait complete. 2024-09-13T18:51:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 Processor -- start 2024-09-13T18:51:01.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 -- start start 2024-09-13T18:51:01.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f806aaa0 0x7ff7f81624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f80b2670 0x7ff7f8156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 0x7ff7f81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8163c20 con 0x7ff7f81610b0 2024-09-13T18:51:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f81464b0 con 0x7ff7f80b2670 2024-09-13T18:51:01.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.253+0000 7ff7fee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8162fa0 con 0x7ff7f806aaa0 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 0x7ff7f81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 0x7ff7f81568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38746/0 (socket says 172.21.15.81:38746) 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 -- 172.21.15.81:0/1876091543 learned_addr learned my addr 172.21.15.81:0/1876091543 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fda00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f806aaa0 0x7ff7f81624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fd000700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f80b2670 0x7ff7f8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 -- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f806aaa0 msgr2=0x7ff7f81624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f806aaa0 0x7ff7f81624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 -- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f80b2670 msgr2=0x7ff7f8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f80b2670 0x7ff7f8156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 -- 172.21.15.81:0/1876091543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4009570 con 0x7ff7f81610b0 2024-09-13T18:51:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fd000700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f80b2670 0x7ff7f8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fe400700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 0x7ff7f81568c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000efc0 tx=0x7ff7f000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:01.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0009ea0 con 0x7ff7f81610b0 2024-09-13T18:51:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f000f040 con 0x7ff7f81610b0 2024-09-13T18:51:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0014480 con 0x7ff7f81610b0 2024-09-13T18:51:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f8163280 con 0x7ff7f81610b0 2024-09-13T18:51:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f8163840 con 0x7ff7f81610b0 2024-09-13T18:51:01.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.257+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f8163d60 con 0x7ff7f81610b0 2024-09-13T18:51:01.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.261+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7f00145e0 con 0x7ff7f81610b0 2024-09-13T18:51:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.261+0000 7ff7f5600700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7d8066730 0x7ff7d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.261+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff7f0084e20 con 0x7ff7f81610b0 2024-09-13T18:51:01.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.261+0000 7ff7fda00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7d8066730 0x7ff7d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.261+0000 7ff7fda00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7d8066730 0x7ff7d8068bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009b70 tx=0x7ff7ec009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.269+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff7f8163d60 con 0x7ff7f81610b0 2024-09-13T18:51:01.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.457+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7f8163d60 con 0x7ff7f81610b0 2024-09-13T18:51:01.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.461+0000 7ff7f5600700 1 -- 172.21.15.81:0/1876091543 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16870 (secure 0 0 0) 0x7ff7f8163d60 con 0x7ff7f81610b0 2024-09-13T18:51:01.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:01.473 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:59.281400+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2d","mappings":[{"from":0,"to":6}]},{"pgid":"8.39","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7d8066730 msgr2=0x7ff7d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7d8066730 0x7ff7d8068bf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009b70 tx=0x7ff7ec009240 comp rx=0 tx=0).stop 2024-09-13T18:51:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 msgr2=0x7ff7f81568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 0x7ff7f81568c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000efc0 tx=0x7ff7f000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 shutdown_connections 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff7d8066730 0x7ff7d8068bf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f81610b0 0x7ff7f81568c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7f80b2670 0x7ff7f8156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 --2- 172.21.15.81:0/1876091543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7f806aaa0 0x7ff7f81624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 >> 172.21.15.81:0/1876091543 conn(0x7ff7f80b0c40 msgr2=0x7ff7f80b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 shutdown_connections 2024-09-13T18:51:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.465+0000 7ff7fee00700 1 -- 172.21.15.81:0/1876091543 wait complete. 2024-09-13T18:51:01.501 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:50:03.553082+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:50:04.575006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:51:01.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:51:01.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.677+0000 7f354de00700 1 Processor -- start 2024-09-13T18:51:01.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.677+0000 7f354de00700 1 -- start start 2024-09-13T18:51:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f354806b170 0x7f35480b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354de00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354806b5c0 con 0x7f3548160d30 2024-09-13T18:51:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354de00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35480b0020 con 0x7f354806b170 2024-09-13T18:51:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354de00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35480d1770 con 0x7f3548161110 2024-09-13T18:51:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f354806b170 0x7f35480b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f354806b170 0x7f35480b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38752/0 (socket says 172.21.15.81:38752) 2024-09-13T18:51:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 -- 172.21.15.81:0/1211390790 learned_addr learned my addr 172.21.15.81:0/1211390790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f3547e00700 1 --2- 172.21.15.81:0/1211390790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 -- 172.21.15.81:0/1211390790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 msgr2=0x7f354806ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 --2- 172.21.15.81:0/1211390790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354806ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 -- 172.21.15.81:0/1211390790 >> v1:172.21.15.178:6789/0 conn(0x7f3548160d30 legacy=0x7f354806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 -- 172.21.15.81:0/1211390790 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35480d03f0 con 0x7f354806b170 2024-09-13T18:51:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f354d400700 1 --2- 172.21.15.81:0/1211390790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354806b170 0x7f35480b3ca0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3540009e50 tx=0x7f354000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeeb93fe1cd788a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f3547400700 1 -- 172.21.15.81:0/1211390790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354000e070 con 0x7f354806b170 2024-09-13T18:51:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f3547400700 1 -- 172.21.15.81:0/1211390790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540003a40 con 0x7f354806b170 2024-09-13T18:51:01.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.681+0000 7f3547400700 1 -- 172.21.15.81:0/1211390790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540003df0 con 0x7f354806b170 2024-09-13T18:51:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 -- 172.21.15.81:0/1211390790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354806b170 msgr2=0x7f35480b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 --2- 172.21.15.81:0/1211390790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354806b170 0x7f35480b3ca0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3540009e50 tx=0x7f354000b330 comp rx=0 tx=0).stop 2024-09-13T18:51:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 -- 172.21.15.81:0/1211390790 shutdown_connections 2024-09-13T18:51:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 --2- 172.21.15.81:0/1211390790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f354806b170 0x7f35480b3ca0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 --2- 172.21.15.81:0/1211390790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354806ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 -- 172.21.15.81:0/1211390790 >> 172.21.15.81:0/1211390790 conn(0x7f3548071d20 msgr2=0x7f3548072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 -- 172.21.15.81:0/1211390790 shutdown_connections 2024-09-13T18:51:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.685+0000 7f354de00700 1 -- 172.21.15.81:0/1211390790 wait complete. 2024-09-13T18:51:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 Processor -- start 2024-09-13T18:51:01.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 -- start start 2024-09-13T18:51:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f354806b170 0x7f3548156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 0x7f3548163290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3548162590 con 0x7f3548160d30 2024-09-13T18:51:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35481e9810 con 0x7f354806b170 2024-09-13T18:51:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354de00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35481f6be0 con 0x7f3548161110 2024-09-13T18:51:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 0x7f3548163290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 0x7f3548163290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38766/0 (socket says 172.21.15.81:38766) 2024-09-13T18:51:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 -- 172.21.15.81:0/1417724277 learned_addr learned my addr 172.21.15.81:0/1417724277 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354ca00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f354806b170 0x7f3548156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354d400700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 -- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 msgr2=0x7f354815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 -- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f354806b170 msgr2=0x7f3548156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f354806b170 0x7f3548156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f3547e00700 1 -- 172.21.15.81:0/1417724277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009b30 con 0x7f3548160d30 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.689+0000 7f354ca00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f354806b170 0x7f3548156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f3547e00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 0x7f3548163290 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f353400d7d0 tx=0x7f353400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35340125f0 con 0x7f3548160d30 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3534012770 con 0x7f3548160d30 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3548161a10 con 0x7f3548160d30 2024-09-13T18:51:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534012b20 con 0x7f3548160d30 2024-09-13T18:51:01.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35481622b0 con 0x7f3548160d30 2024-09-13T18:51:01.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35481f6da0 con 0x7f3548160d30 2024-09-13T18:51:01.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.693+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3534012c80 con 0x7f3548160d30 2024-09-13T18:51:01.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.697+0000 7f3544c00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3528066730 0x7f3528068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:01.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.697+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f35340843f0 con 0x7f3548160d30 2024-09-13T18:51:01.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.697+0000 7f354ca00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3528066730 0x7f3528068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:01.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.697+0000 7f354ca00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3528066730 0x7f3528068bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f353c004000 tx=0x7f353c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:01.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.701+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35481f6da0 con 0x7f3548160d30 2024-09-13T18:51:01.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.881+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35481f6da0 con 0x7f3548160d30 2024-09-13T18:51:01.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.881+0000 7f3544c00700 1 -- 172.21.15.81:0/1417724277 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35481f6da0 con 0x7f3548160d30 2024-09-13T18:51:01.894 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:51:01.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3528066730 msgr2=0x7f3528068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3528066730 0x7f3528068bf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f353c004000 tx=0x7f353c009040 comp rx=0 tx=0).stop 2024-09-13T18:51:01.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 msgr2=0x7f3548163290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 0x7f3548163290 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f353400d7d0 tx=0x7f353400dae0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 shutdown_connections 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3528066730 0x7f3528068bf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3548161110 0x7f354815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3548160d30 0x7f3548163290 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 --2- 172.21.15.81:0/1417724277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f354806b170 0x7f3548156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 >> 172.21.15.81:0/1417724277 conn(0x7f3548071d20 msgr2=0x7f35481ed7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 shutdown_connections 2024-09-13T18:51:01.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:01.889+0000 7f354de00700 1 -- 172.21.15.81:0/1417724277 wait complete. 2024-09-13T18:51:01.923 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:51:02.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.089+0000 7fb85dc00700 1 Processor -- start 2024-09-13T18:51:02.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.089+0000 7fb85dc00700 1 -- start start 2024-09-13T18:51:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.089+0000 7fb85dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb85815a770 0x7fb858071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.089+0000 7fb85dc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb85806f480 0x7fb858161200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb858161740 con 0x7fb8580b39b0 2024-09-13T18:51:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8581607b0 con 0x7fb85806f480 2024-09-13T18:51:02.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580b4120 con 0x7fb85815a770 2024-09-13T18:51:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb85806f480 0x7fb858161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb85806f480 0x7fb858161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38774/0 (socket says 172.21.15.81:38774) 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 -- 172.21.15.81:0/1862074739 learned_addr learned my addr 172.21.15.81:0/1862074739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb856000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8580b39b0 0x7fb85806ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40630/0 (socket says 172.21.15.81:40630) 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb856a00700 1 --2- 172.21.15.81:0/1862074739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb85815a770 0x7fb858071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 -- 172.21.15.81:0/1862074739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb85815a770 msgr2=0x7fb858071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 --2- 172.21.15.81:0/1862074739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb85815a770 0x7fb858071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 -- 172.21.15.81:0/1862074739 >> v1:172.21.15.81:6789/0 conn(0x7fb8580b39b0 legacy=0x7fb85806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 -- 172.21.15.81:0/1862074739 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580b4400 con 0x7fb85806f480 2024-09-13T18:51:02.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb855600700 1 -- 172.21.15.81:0/1862074739 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136241919 0 0) 0x7fb844001110 con 0x7fb8580b39b0 2024-09-13T18:51:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb857400700 1 --2- 172.21.15.81:0/1862074739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb858161200 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e50 tx=0x7fb85000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2cf44bc603fe1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb855600700 1 -- 172.21.15.81:0/1862074739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000e070 con 0x7fb85806f480 2024-09-13T18:51:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb855600700 1 -- 172.21.15.81:0/1862074739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000b9c0 con 0x7fb85806f480 2024-09-13T18:51:02.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb855600700 1 -- 172.21.15.81:0/1862074739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85000bd70 con 0x7fb85806f480 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 -- 172.21.15.81:0/1862074739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 msgr2=0x7fb858161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1862074739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb858161200 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb850009e50 tx=0x7fb85000b330 comp rx=0 tx=0).stop 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 -- 172.21.15.81:0/1862074739 shutdown_connections 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1862074739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb858161200 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1862074739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb85815a770 0x7fb858071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.093+0000 7fb85dc00700 1 -- 172.21.15.81:0/1862074739 >> 172.21.15.81:0/1862074739 conn(0x7fb8580b1e10 msgr2=0x7fb85806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.097+0000 7fb85dc00700 1 -- 172.21.15.81:0/1862074739 shutdown_connections 2024-09-13T18:51:02.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.097+0000 7fb85dc00700 1 -- 172.21.15.81:0/1862074739 wait complete. 2024-09-13T18:51:02.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.097+0000 7fb85dc00700 1 Processor -- start 2024-09-13T18:51:02.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.097+0000 7fb85dc00700 1 -- start start 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb85814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8580b39b0 0x7fb8581f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb85815a770 0x7fb85815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8581f3310 con 0x7fb85806f480 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85815b180 con 0x7fb85815a770 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85815b460 con 0x7fb8580b39b0 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb85814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb85814c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38788/0 (socket says 172.21.15.81:38788) 2024-09-13T18:51:02.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 -- 172.21.15.81:0/1293035901 learned_addr learned my addr 172.21.15.81:0/1293035901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb857400700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb85815a770 0x7fb85815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856000700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8580b39b0 0x7fb8581f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 -- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8580b39b0 msgr2=0x7fb8581f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8580b39b0 0x7fb8581f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 -- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb85815a770 msgr2=0x7fb85815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb85815a770 0x7fb85815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 -- 172.21.15.81:0/1293035901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb850009b30 con 0x7fb85806f480 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb856a00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb85814c570 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb84800d800 tx=0x7fb84800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8480125f0 con 0x7fb85806f480 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848012750 con 0x7fb85806f480 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85815b740 con 0x7fb85806f480 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848012ac0 con 0x7fb85806f480 2024-09-13T18:51:02.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.101+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85815bd00 con 0x7fb85806f480 2024-09-13T18:51:02.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.105+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb858161200 con 0x7fb85806f480 2024-09-13T18:51:02.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.105+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb848012c20 con 0x7fb85806f480 2024-09-13T18:51:02.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.109+0000 7fb84ea00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb838066730 0x7fb838068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.109+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fb848084720 con 0x7fb85806f480 2024-09-13T18:51:02.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.109+0000 7fb856000700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb838066730 0x7fb838068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.109+0000 7fb856000700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb838066730 0x7fb838068bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb8580b1320 tx=0x7fb844007a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.113+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb848051870 con 0x7fb85806f480 2024-09-13T18:51:02.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.293+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb858073c90 con 0x7fb85806f480 2024-09-13T18:51:02.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb84ea00700 1 -- 172.21.15.81:0/1293035901 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb848012ed0 con 0x7fb85806f480 2024-09-13T18:51:02.306 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb838066730 msgr2=0x7fb838068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb838066730 0x7fb838068bf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb8580b1320 tx=0x7fb844007a60 comp rx=0 tx=0).stop 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 msgr2=0x7fb85814c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb85814c570 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb84800d800 tx=0x7fb84800dbc0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 shutdown_connections 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb838066730 0x7fb838068bf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb85815a770 0x7fb85815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8580b39b0 0x7fb8581f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 --2- 172.21.15.81:0/1293035901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb85806f480 0x7fb85814c570 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 >> 172.21.15.81:0/1293035901 conn(0x7fb8580b1e10 msgr2=0x7fb8580ad740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:02.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 shutdown_connections 2024-09-13T18:51:02.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.297+0000 7fb85dc00700 1 -- 172.21.15.81:0/1293035901 wait complete. 2024-09-13T18:51:02.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:51:02.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.489+0000 7f01f8200700 1 Processor -- start 2024-09-13T18:51:02.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.489+0000 7f01f8200700 1 -- start start 2024-09-13T18:51:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f8200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01f0143b60 0x7f01f00d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f8200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 0x7f01f00cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f8200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01f00d0780 con 0x7f01f015e720 2024-09-13T18:51:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f8200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01f015f710 con 0x7f01f0143b60 2024-09-13T18:51:02.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f8200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f00d19e0 con 0x7f01f00cf3b0 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f4e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 0x7f01f00cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f5800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01f0143b60 0x7f01f00d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f4e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 0x7f01f00cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39864/0 (socket says 172.21.15.81:39864) 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f4e00700 1 -- 172.21.15.81:0/1838076799 learned_addr learned my addr 172.21.15.81:0/1838076799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f5800700 1 -- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 msgr2=0x7f01f00cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f5800700 1 --2- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 0x7f01f00cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f5800700 1 -- 172.21.15.81:0/1838076799 >> v1:172.21.15.178:6789/0 conn(0x7f01f015e720 legacy=0x7f01f015ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f5800700 1 -- 172.21.15.81:0/1838076799 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00cfd30 con 0x7f01f0143b60 2024-09-13T18:51:02.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f4e00700 1 --2- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 0x7f01f00cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01f5800700 1 --2- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f0143b60 0x7f01f00d14a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009850 tx=0x7f01e4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9709a86b9a39206 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.493+0000 7f01efe00700 1 -- 172.21.15.81:0/1838076799 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011830 con 0x7f01f0143b60 2024-09-13T18:51:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01efe00700 1 -- 172.21.15.81:0/1838076799 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4011990 con 0x7f01f0143b60 2024-09-13T18:51:02.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01efe00700 1 -- 172.21.15.81:0/1838076799 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4011d40 con 0x7f01f0143b60 2024-09-13T18:51:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 -- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f0143b60 msgr2=0x7f01f00d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 --2- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f0143b60 0x7f01f00d14a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009850 tx=0x7f01e4009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 -- 172.21.15.81:0/1838076799 shutdown_connections 2024-09-13T18:51:02.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 --2- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f00cf3b0 0x7f01f00cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 --2- 172.21.15.81:0/1838076799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f0143b60 0x7f01f00d14a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 -- 172.21.15.81:0/1838076799 >> 172.21.15.81:0/1838076799 conn(0x7f01f006e660 msgr2=0x7f01f006ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 -- 172.21.15.81:0/1838076799 shutdown_connections 2024-09-13T18:51:02.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 -- 172.21.15.81:0/1838076799 wait complete. 2024-09-13T18:51:02.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 Processor -- start 2024-09-13T18:51:02.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.497+0000 7f01f8200700 1 -- start start 2024-09-13T18:51:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 0x7f01f0139a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f0143b60 0x7f01f015d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f015e720 0x7f01f01f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f013b220 con 0x7f01f00cf3b0 2024-09-13T18:51:02.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f0139f90 con 0x7f01f015e720 2024-09-13T18:51:02.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01f015da70 con 0x7f01f0143b60 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 0x7f01f0139a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 0x7f01f0139a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38804/0 (socket says 172.21.15.81:38804) 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 -- 172.21.15.81:0/3566528743 learned_addr learned my addr 172.21.15.81:0/3566528743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f4e00700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f0143b60 0x7f01f015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f6200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f015e720 0x7f01f01f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 -- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f0143b60 msgr2=0x7f01f015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f0143b60 0x7f01f015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 -- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f015e720 msgr2=0x7f01f01f0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f015e720 0x7f01f01f0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 -- 172.21.15.81:0/3566528743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc009570 con 0x7f01f00cf3b0 2024-09-13T18:51:02.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f5800700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 0x7f01f0139a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f01f0071c10 tx=0x7f01e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4004480 con 0x7f01f00cf3b0 2024-09-13T18:51:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e401f070 con 0x7f01f00cf3b0 2024-09-13T18:51:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e40094b0 con 0x7f01f00cf3b0 2024-09-13T18:51:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40038e0 con 0x7f01f00cf3b0 2024-09-13T18:51:02.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.501+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f013a880 con 0x7f01f00cf3b0 2024-09-13T18:51:02.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.505+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f013b360 con 0x7f01f00cf3b0 2024-09-13T18:51:02.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.505+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01e4021030 con 0x7f01f00cf3b0 2024-09-13T18:51:02.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.509+0000 7f01ed600700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01d0066730 0x7f01d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.509+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f01e4085630 con 0x7f01f00cf3b0 2024-09-13T18:51:02.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.509+0000 7f01f4e00700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01d0066730 0x7f01d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.509+0000 7f01f4e00700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01d0066730 0x7f01d0068bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b5bd0 tx=0x7f01dc0092e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.513+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f01f013b360 con 0x7f01f00cf3b0 2024-09-13T18:51:02.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.697+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01f013b360 con 0x7f01f00cf3b0 2024-09-13T18:51:02.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.701+0000 7f01ed600700 1 -- 172.21.15.81:0/3566528743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f01f013b360 con 0x7f01f00cf3b0 2024-09-13T18:51:02.711 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:51:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01d0066730 msgr2=0x7f01d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01d0066730 0x7f01d0068bf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f01f00b5bd0 tx=0x7f01dc0092e0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 msgr2=0x7f01f0139a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 0x7f01f0139a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f01f0071c10 tx=0x7f01e4004770 comp rx=0 tx=0).stop 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 shutdown_connections 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f01d0066730 0x7f01d0068bf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01f015e720 0x7f01f01f0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01f0143b60 0x7f01f015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 --2- 172.21.15.81:0/3566528743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01f00cf3b0 0x7f01f0139a50 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 >> 172.21.15.81:0/3566528743 conn(0x7f01f006e660 msgr2=0x7f01f00b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 shutdown_connections 2024-09-13T18:51:02.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.705+0000 7f01f8200700 1 -- 172.21.15.81:0/3566528743 wait complete. 2024-09-13T18:51:02.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 Processor -- start 2024-09-13T18:51:02.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 -- start start 2024-09-13T18:51:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01940cb020 0x7f01940cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019406aaa0 0x7f019406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019406b430 con 0x7f019415c2a0 2024-09-13T18:51:02.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01940b2ad0 con 0x7f01940cb020 2024-09-13T18:51:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019415b960 con 0x7f019406aaa0 2024-09-13T18:51:02.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01940cb020 0x7f01940cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01940cb020 0x7f01940cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38808/0 (socket says 172.21.15.81:38808) 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 -- 172.21.15.81:0/487644535 learned_addr learned my addr 172.21.15.81:0/487644535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0193400700 1 --2- 172.21.15.81:0/487644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019406aaa0 0x7f019406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 -- 172.21.15.81:0/487644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019406aaa0 msgr2=0x7f019406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 --2- 172.21.15.81:0/487644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019406aaa0 0x7f019406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 -- 172.21.15.81:0/487644535 >> v1:172.21.15.178:6789/0 conn(0x7f019415c2a0 legacy=0x7f019415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.901+0000 7f0192a00700 1 -- 172.21.15.81:0/487644535 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019415bc40 con 0x7f01940cb020 2024-09-13T18:51:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0192a00700 1 --2- 172.21.15.81:0/487644535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01940cb020 0x7f01940cc6f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f018c009910 tx=0x7f018c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d19b2a6efda6ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0191600700 1 -- 172.21.15.81:0/487644535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c00ba60 con 0x7f01940cb020 2024-09-13T18:51:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0191600700 1 -- 172.21.15.81:0/487644535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00bbc0 con 0x7f01940cb020 2024-09-13T18:51:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0191600700 1 -- 172.21.15.81:0/487644535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c009e60 con 0x7f01940cb020 2024-09-13T18:51:02.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 -- 172.21.15.81:0/487644535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01940cb020 msgr2=0x7f01940cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 --2- 172.21.15.81:0/487644535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01940cb020 0x7f01940cc6f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f018c009910 tx=0x7f018c009c20 comp rx=0 tx=0).stop 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 -- 172.21.15.81:0/487644535 shutdown_connections 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 --2- 172.21.15.81:0/487644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019406aaa0 0x7f019406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 --2- 172.21.15.81:0/487644535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01940cb020 0x7f01940cc6f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 -- 172.21.15.81:0/487644535 >> 172.21.15.81:0/487644535 conn(0x7f01940b0c40 msgr2=0x7f019406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 -- 172.21.15.81:0/487644535 shutdown_connections 2024-09-13T18:51:02.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 -- 172.21.15.81:0/487644535 wait complete. 2024-09-13T18:51:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.905+0000 7f0193e00700 1 Processor -- start 2024-09-13T18:51:02.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 -- start start 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 0x7f0194144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01940cb020 0x7f0194154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019415c2a0 0x7f01940c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194156430 con 0x7f019406aaa0 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01941557b0 con 0x7f01940cb020 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0194155a90 con 0x7f019415c2a0 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 0x7f0194144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 0x7f0194144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38816/0 (socket says 172.21.15.81:38816) 2024-09-13T18:51:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 -- 172.21.15.81:0/2775301661 learned_addr learned my addr 172.21.15.81:0/2775301661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192000700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01940cb020 0x7f0194154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 -- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019415c2a0 msgr2=0x7f01940c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193400700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019415c2a0 0x7f01940c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019415c2a0 0x7f01940c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 -- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01940cb020 msgr2=0x7f0194154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01940cb020 0x7f0194154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 -- 172.21.15.81:0/2775301661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009570 con 0x7f019406aaa0 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192000700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01940cb020 0x7f0194154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193400700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019415c2a0 0x7f01940c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0192a00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 0x7f0194144110 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f01940b1690 tx=0x7f018c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c004610 con 0x7f019406aaa0 2024-09-13T18:51:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c01f070 con 0x7f019406aaa0 2024-09-13T18:51:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c003900 con 0x7f019406aaa0 2024-09-13T18:51:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0194155d70 con 0x7f019406aaa0 2024-09-13T18:51:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.909+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0194144650 con 0x7f019406aaa0 2024-09-13T18:51:02.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.913+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019406aef0 con 0x7f019406aaa0 2024-09-13T18:51:02.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.913+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f018c003a60 con 0x7f019406aaa0 2024-09-13T18:51:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.917+0000 7f018b400700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0170066730 0x7f0170068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.917+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f018c021070 con 0x7f019406aaa0 2024-09-13T18:51:02.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.917+0000 7f0192000700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0170066730 0x7f0170068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:02.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.917+0000 7f0192000700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0170066730 0x7f0170068bf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f019414ef40 tx=0x7f017c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:02.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:02.921+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f018c052df0 con 0x7f019406aaa0 2024-09-13T18:51:03.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.157+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0194071890 con 0x7f019406aaa0 2024-09-13T18:51:03.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.157+0000 7f018b400700 1 -- 172.21.15.81:0/2775301661 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7f018c02b090 con 0x7f019406aaa0 2024-09-13T18:51:03.168 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:03.168 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:51:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0170066730 msgr2=0x7f0170068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0170066730 0x7f0170068bf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f019414ef40 tx=0x7f017c009040 comp rx=0 tx=0).stop 2024-09-13T18:51:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 msgr2=0x7f0194144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 0x7f0194144110 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f01940b1690 tx=0x7f018c004770 comp rx=0 tx=0).stop 2024-09-13T18:51:03.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 shutdown_connections 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0170066730 0x7f0170068bf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f019415c2a0 0x7f01940c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01940cb020 0x7f0194154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 --2- 172.21.15.81:0/2775301661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f019406aaa0 0x7f0194144110 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 >> 172.21.15.81:0/2775301661 conn(0x7f01940b0c40 msgr2=0x7f019415d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 shutdown_connections 2024-09-13T18:51:03.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.161+0000 7f0193e00700 1 -- 172.21.15.81:0/2775301661 wait complete. 2024-09-13T18:51:03.173 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:51:03.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 Processor -- start 2024-09-13T18:51:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 -- start start 2024-09-13T18:51:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f158015cd90 0x7f15800b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f15800cdfe0 0x7f15800ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15800d1390 con 0x7f158015d170 2024-09-13T18:51:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15800b2530 con 0x7f15800cdfe0 2024-09-13T18:51:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15800d05f0 con 0x7f158015cd90 2024-09-13T18:51:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f15800cdfe0 0x7f15800ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f15800cdfe0 0x7f15800ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38832/0 (socket says 172.21.15.81:38832) 2024-09-13T18:51:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 -- 172.21.15.81:0/530984514 learned_addr learned my addr 172.21.15.81:0/530984514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1585600700 1 --2- 172.21.15.81:0/530984514 >> v2:172.21.15.178:3300/0 conn(0x7f158015cd90 0x7f15800b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 -- 172.21.15.81:0/530984514 >> v2:172.21.15.178:3300/0 conn(0x7f158015cd90 msgr2=0x7f15800b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 --2- 172.21.15.81:0/530984514 >> v2:172.21.15.178:3300/0 conn(0x7f158015cd90 0x7f15800b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 -- 172.21.15.81:0/530984514 >> v1:172.21.15.178:6789/0 conn(0x7f158015d170 legacy=0x7f15800cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.353+0000 7f1586000700 1 -- 172.21.15.81:0/530984514 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15800d1670 con 0x7f15800cdfe0 2024-09-13T18:51:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586000700 1 --2- 172.21.15.81:0/530984514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15800cdfe0 0x7f15800ce410 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1580073750 tx=0x7f157800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1c5856b7692d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f157fe00700 1 -- 172.21.15.81:0/530984514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800e070 con 0x7f15800cdfe0 2024-09-13T18:51:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f157fe00700 1 -- 172.21.15.81:0/530984514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157800b910 con 0x7f15800cdfe0 2024-09-13T18:51:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f157fe00700 1 -- 172.21.15.81:0/530984514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800bcc0 con 0x7f15800cdfe0 2024-09-13T18:51:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 -- 172.21.15.81:0/530984514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15800cdfe0 msgr2=0x7f15800ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 --2- 172.21.15.81:0/530984514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15800cdfe0 0x7f15800ce410 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1580073750 tx=0x7f157800b330 comp rx=0 tx=0).stop 2024-09-13T18:51:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 -- 172.21.15.81:0/530984514 shutdown_connections 2024-09-13T18:51:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 --2- 172.21.15.81:0/530984514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15800cdfe0 0x7f15800ce410 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 --2- 172.21.15.81:0/530984514 >> v2:172.21.15.178:3300/0 conn(0x7f158015cd90 0x7f15800b1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 -- 172.21.15.81:0/530984514 >> 172.21.15.81:0/530984514 conn(0x7f15800d2c10 msgr2=0x7f15800d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 -- 172.21.15.81:0/530984514 shutdown_connections 2024-09-13T18:51:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.357+0000 7f1586a00700 1 -- 172.21.15.81:0/530984514 wait complete. 2024-09-13T18:51:03.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 Processor -- start 2024-09-13T18:51:03.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 -- start start 2024-09-13T18:51:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15800cdfe0 0x7f15800c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158015cd90 0x7f15800b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 0x7f15800b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15800b4a90 con 0x7f158015d170 2024-09-13T18:51:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15800b3c00 con 0x7f158015cd90 2024-09-13T18:51:03.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15800b3e80 con 0x7f15800cdfe0 2024-09-13T18:51:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 0x7f15800b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 0x7f15800b70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38846/0 (socket says 172.21.15.81:38846) 2024-09-13T18:51:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 -- 172.21.15.81:0/2801931262 learned_addr learned my addr 172.21.15.81:0/2801931262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1584c00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158015cd90 0x7f15800b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1585600700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15800cdfe0 0x7f15800c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 -- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15800cdfe0 msgr2=0x7f15800c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15800cdfe0 0x7f15800c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 -- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158015cd90 msgr2=0x7f15800b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158015cd90 0x7f15800b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.361+0000 7f1586000700 1 -- 172.21.15.81:0/2801931262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009b30 con 0x7f158015d170 2024-09-13T18:51:03.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f1586000700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 0x7f15800b70c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f157800b680 tx=0x7f1578004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15780092e0 con 0x7f158015d170 2024-09-13T18:51:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157801c440 con 0x7f158015d170 2024-09-13T18:51:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157801c7f0 con 0x7f158015d170 2024-09-13T18:51:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15800b4160 con 0x7f158015d170 2024-09-13T18:51:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15800b4720 con 0x7f158015d170 2024-09-13T18:51:03.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15800b4c40 con 0x7f158015d170 2024-09-13T18:51:03.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.365+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f157801c950 con 0x7f158015d170 2024-09-13T18:51:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.369+0000 7f157d600700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1560066730 0x7f1560068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.369+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f1578085ff0 con 0x7f158015d170 2024-09-13T18:51:03.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.369+0000 7f1585600700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1560066730 0x7f1560068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.369+0000 7f1585600700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1560066730 0x7f1560068bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1574009b80 tx=0x7f1574008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:03.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.377+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15780b7db0 con 0x7f158015d170 2024-09-13T18:51:03.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.561+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15800ce410 con 0x7f158015d170 2024-09-13T18:51:03.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.565+0000 7f157d600700 1 -- 172.21.15.81:0/2801931262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16870 (secure 0 0 0) 0x7f15800b4c40 con 0x7f158015d170 2024-09-13T18:51:03.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:03.575 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:59.281400+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2d","mappings":[{"from":0,"to":6}]},{"pgid":"8.39","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1560066730 msgr2=0x7f1560068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1560066730 0x7f1560068bf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1574009b80 tx=0x7f1574008040 comp rx=0 tx=0).stop 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 msgr2=0x7f15800b70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 0x7f15800b70c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f157800b680 tx=0x7f1578004af0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 shutdown_connections 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1560066730 0x7f1560068bf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f158015d170 0x7f15800b70c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f158015cd90 0x7f15800b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 --2- 172.21.15.81:0/2801931262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15800cdfe0 0x7f15800c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 >> 172.21.15.81:0/2801931262 conn(0x7f15800d2c10 msgr2=0x7f158006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 shutdown_connections 2024-09-13T18:51:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.569+0000 7f1586a00700 1 -- 172.21.15.81:0/2801931262 wait complete. 2024-09-13T18:51:03.604 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:51:03.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.761+0000 7fc7f2c00700 1 Processor -- start 2024-09-13T18:51:03.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.761+0000 7fc7f2c00700 1 -- start start 2024-09-13T18:51:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f2c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec15a9b0 0x7fc7ec070270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f2c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7ec0cedf0 0x7fc7ec0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f2c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec06fcd0 con 0x7fc7ec0cf230 2024-09-13T18:51:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f2c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0ce6c0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f2c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0cfec0 con 0x7fc7ec15a9b0 2024-09-13T18:51:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eb400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7ec0cedf0 0x7fc7ec0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f0c00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc7ec0cf230 0x7fc7ec0b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:33624/0 (socket says 172.21.15.81:33624) 2024-09-13T18:51:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7f0c00700 1 -- 172.21.15.81:0/4034250198 learned_addr learned my addr 172.21.15.81:0/4034250198 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7ebe00700 1 --2- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec15a9b0 0x7fc7ec070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eb400700 1 -- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec15a9b0 msgr2=0x7fc7ec070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eb400700 1 --2- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec15a9b0 0x7fc7ec070270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eb400700 1 -- 172.21.15.81:0/4034250198 >> v1:172.21.15.178:6789/0 conn(0x7fc7ec0cf230 legacy=0x7fc7ec0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eb400700 1 -- 172.21.15.81:0/4034250198 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0d01a0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eaa00700 1 -- 172.21.15.81:0/4034250198 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813920982 0 0) 0x7fc7ec06fcd0 con 0x7fc7ec0cf230 2024-09-13T18:51:03.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.765+0000 7fc7eb400700 1 --2- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec0cd500 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009850 tx=0x7fc7d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bad78d6c500309 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7eaa00700 1 -- 172.21.15.81:0/4034250198 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8011830 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7eaa00700 1 -- 172.21.15.81:0/4034250198 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d8011990 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7eaa00700 1 -- 172.21.15.81:0/4034250198 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8011d40 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 -- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0cedf0 msgr2=0x7fc7ec0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec0cd500 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009850 tx=0x7fc7d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 -- 172.21.15.81:0/4034250198 shutdown_connections 2024-09-13T18:51:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec0cd500 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/4034250198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec15a9b0 0x7fc7ec070270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 -- 172.21.15.81:0/4034250198 >> 172.21.15.81:0/4034250198 conn(0x7fc7ec0b27a0 msgr2=0x7fc7ec0b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 -- 172.21.15.81:0/4034250198 shutdown_connections 2024-09-13T18:51:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.769+0000 7fc7f2c00700 1 -- 172.21.15.81:0/4034250198 wait complete. 2024-09-13T18:51:03.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 Processor -- start 2024-09-13T18:51:03.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 -- start start 2024-09-13T18:51:03.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0cf230 0x7fc7ec06bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec15a9b0 0x7fc7ec0c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec15d280 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec15d6a0 con 0x7fc7ec15a9b0 2024-09-13T18:51:03.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7f2c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec15c600 con 0x7fc7ec0cf230 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.773+0000 7fc7ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38862/0 (socket says 172.21.15.81:38862) 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7eb400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0cf230 0x7fc7ec06bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 -- 172.21.15.81:0/780627601 learned_addr learned my addr 172.21.15.81:0/780627601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7f0c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec15a9b0 0x7fc7ec0c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 -- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0cf230 msgr2=0x7fc7ec06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0cf230 0x7fc7ec06bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 -- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec15a9b0 msgr2=0x7fc7ec0c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:03.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec15a9b0 0x7fc7ec0c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 -- 172.21.15.81:0/780627601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d80094b0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7eb400700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0cf230 0x7fc7ec06bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7ebe00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec148790 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00e840 tx=0x7fc7dc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0095a0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc013680 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec15c8e0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0139f0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec15cea0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.777+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec15d4f0 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.781+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7dc013b50 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.781+0000 7fc7e3e00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7cc066730 0x7fc7cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.781+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc7dc084180 con 0x7fc7ec0cedf0 2024-09-13T18:51:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.781+0000 7fc7eb400700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7cc066730 0x7fc7cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.785+0000 7fc7eb400700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7cc066730 0x7fc7cc068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009850 tx=0x7fc7d8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:03.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:03.789+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7dc051360 con 0x7fc7ec0cedf0 2024-09-13T18:51:04.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.017+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7ec070270 con 0x7fc7ec0cedf0 2024-09-13T18:51:04.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.017+0000 7fc7e3e00700 1 -- 172.21.15.81:0/780627601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7fc7dc054980 con 0x7fc7ec0cedf0 2024-09-13T18:51:04.028 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:04.028 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:51:04.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7cc066730 msgr2=0x7fc7cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7cc066730 0x7fc7cc068bf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009850 tx=0x7fc7d8008030 comp rx=0 tx=0).stop 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 msgr2=0x7fc7ec148790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec148790 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00e840 tx=0x7fc7dc00eb50 comp rx=0 tx=0).stop 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 shutdown_connections 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7cc066730 0x7fc7cc068bf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec15a9b0 0x7fc7ec0c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0cf230 0x7fc7ec06bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 --2- 172.21.15.81:0/780627601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ec0cedf0 0x7fc7ec148790 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 >> 172.21.15.81:0/780627601 conn(0x7fc7ec0b27a0 msgr2=0x7fc7ec0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 shutdown_connections 2024-09-13T18:51:04.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.021+0000 7fc7f2c00700 1 -- 172.21.15.81:0/780627601 wait complete. 2024-09-13T18:51:04.033 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:51:04.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.217+0000 7fd5a3200700 1 Processor -- start 2024-09-13T18:51:04.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.217+0000 7fd5a3200700 1 -- start start 2024-09-13T18:51:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a3200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd5a40cb700 0x7fd5a406aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a406afe0 0x7fd5a41636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a3200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a40707d0 con 0x7fd5a4159bd0 2024-09-13T18:51:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a3200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a406b470 con 0x7fd5a40cb700 2024-09-13T18:51:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a40720a0 con 0x7fd5a406afe0 2024-09-13T18:51:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a1e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd5a4159bd0 0x7fd5a4071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40640/0 (socket says 172.21.15.81:40640) 2024-09-13T18:51:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a1e00700 1 -- 172.21.15.81:0/3684349759 learned_addr learned my addr 172.21.15.81:0/3684349759 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a1400700 1 --2- 172.21.15.81:0/3684349759 >> v2:172.21.15.81:3300/0 conn(0x7fd5a40cb700 0x7fd5a406aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.221+0000 7fd5a2800700 1 --2- 172.21.15.81:0/3684349759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a406afe0 0x7fd5a41636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a0a00700 1 -- 172.21.15.81:0/3684349759 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443673324 0 0) 0x7fd5a40707d0 con 0x7fd5a4159bd0 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a0a00700 1 -- 172.21.15.81:0/3684349759 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5880057e0 con 0x7fd5a4159bd0 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a1400700 1 -- 172.21.15.81:0/3684349759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a406afe0 msgr2=0x7fd5a41636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a1400700 1 --2- 172.21.15.81:0/3684349759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a406afe0 0x7fd5a41636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a1400700 1 -- 172.21.15.81:0/3684349759 >> v1:172.21.15.81:6789/0 conn(0x7fd5a4159bd0 legacy=0x7fd5a4071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a1400700 1 -- 172.21.15.81:0/3684349759 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a406fee0 con 0x7fd5a40cb700 2024-09-13T18:51:04.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a1400700 1 --2- 172.21.15.81:0/3684349759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a406aaa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd590009880 tx=0x7fd590009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa37e1484c71b29a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:04.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a0a00700 1 -- 172.21.15.81:0/3684349759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590011830 con 0x7fd5a40cb700 2024-09-13T18:51:04.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a0a00700 1 -- 172.21.15.81:0/3684349759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590011990 con 0x7fd5a40cb700 2024-09-13T18:51:04.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a0a00700 1 -- 172.21.15.81:0/3684349759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590011d00 con 0x7fd5a40cb700 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 -- 172.21.15.81:0/3684349759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 msgr2=0x7fd5a406aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 --2- 172.21.15.81:0/3684349759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a406aaa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd590009880 tx=0x7fd590009b90 comp rx=0 tx=0).stop 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 -- 172.21.15.81:0/3684349759 shutdown_connections 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 --2- 172.21.15.81:0/3684349759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a406afe0 0x7fd5a41636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 --2- 172.21.15.81:0/3684349759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a406aaa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 -- 172.21.15.81:0/3684349759 >> 172.21.15.81:0/3684349759 conn(0x7fd5a40b0c40 msgr2=0x7fd5a406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 -- 172.21.15.81:0/3684349759 shutdown_connections 2024-09-13T18:51:04.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.225+0000 7fd5a3200700 1 -- 172.21.15.81:0/3684349759 wait complete. 2024-09-13T18:51:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 Processor -- start 2024-09-13T18:51:04.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 -- start start 2024-09-13T18:51:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a406afe0 0x7fd5a40ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a4143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a4159bd0 0x7fd5a41f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4143c60 con 0x7fd5a40cb700 2024-09-13T18:51:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4142cd0 con 0x7fd5a406afe0 2024-09-13T18:51:04.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41f2030 con 0x7fd5a4159bd0 2024-09-13T18:51:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a4143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a4143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38886/0 (socket says 172.21.15.81:38886) 2024-09-13T18:51:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 -- 172.21.15.81:0/846770389 learned_addr learned my addr 172.21.15.81:0/846770389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1e00700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a406afe0 0x7fd5a40ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a2800700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a4159bd0 0x7fd5a41f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 -- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a4159bd0 msgr2=0x7fd5a41f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a4159bd0 0x7fd5a41f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 -- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a406afe0 msgr2=0x7fd5a40ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a406afe0 0x7fd5a40ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.229+0000 7fd5a1400700 1 -- 172.21.15.81:0/846770389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900094b0 con 0x7fd5a40cb700 2024-09-13T18:51:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd5a1400700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a4143720 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd590009bd0 tx=0x7fd590004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590004550 con 0x7fd5a40cb700 2024-09-13T18:51:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59001f070 con 0x7fd5a40cb700 2024-09-13T18:51:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590003900 con 0x7fd5a40cb700 2024-09-13T18:51:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a41f2310 con 0x7fd5a40cb700 2024-09-13T18:51:04.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a4143200 con 0x7fd5a40cb700 2024-09-13T18:51:04.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.233+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a406aaa0 con 0x7fd5a40cb700 2024-09-13T18:51:04.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.237+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd590003a60 con 0x7fd5a40cb700 2024-09-13T18:51:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.237+0000 7fd59a000700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd58406ab40 0x7fd58406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.237+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fd590021070 con 0x7fd5a40cb700 2024-09-13T18:51:04.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.237+0000 7fd5a1e00700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd58406ab40 0x7fd58406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.237+0000 7fd5a1e00700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd58406ab40 0x7fd58406d000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd594007fd0 tx=0x7fd594009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:04.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.245+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd590052bc0 con 0x7fd5a40cb700 2024-09-13T18:51:04.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.473+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5a40ce140 con 0x7fd5a40cb700 2024-09-13T18:51:04.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.473+0000 7fd59a000700 1 -- 172.21.15.81:0/846770389 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4771 (secure 0 0 0) 0x7fd590015090 con 0x7fd5a40cb700 2024-09-13T18:51:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:04.485 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:50:05.574515+0000","modified":"2024-09-13T18:50:44.203681+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6051,"mds_1":6048,"mds_2":5911},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5911":{"gid":5911,"name":"d","rank":2,"incarnation":37,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1611484847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1611484847},{"type":"v1","addr":"172.21.15.178:6835","nonce":1611484847}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6048":{"gid":6048,"name":"c","rank":1,"incarnation":35,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/729196456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":729196456},{"type":"v1","addr":"172.21.15.81:6836","nonce":729196456}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6051":{"gid":6051,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/396996950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":396996950},{"type":"v1","addr":"172.21.15.81:6837","nonce":396996950}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd58406ab40 msgr2=0x7fd58406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd58406ab40 0x7fd58406d000 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd594007fd0 tx=0x7fd594009040 comp rx=0 tx=0).stop 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 msgr2=0x7fd5a4143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a4143720 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd590009bd0 tx=0x7fd590004770 comp rx=0 tx=0).stop 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 shutdown_connections 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd58406ab40 0x7fd58406d000 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5a4159bd0 0x7fd5a41f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5a40cb700 0x7fd5a4143720 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 --2- 172.21.15.81:0/846770389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5a406afe0 0x7fd5a40ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 >> 172.21.15.81:0/846770389 conn(0x7fd5a40b0c40 msgr2=0x7fd5a40cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 shutdown_connections 2024-09-13T18:51:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.477+0000 7fd5a3200700 1 -- 172.21.15.81:0/846770389 wait complete. 2024-09-13T18:51:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 44 2024-09-13T18:51:04.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.661+0000 7fab93200700 1 Processor -- start 2024-09-13T18:51:04.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.661+0000 7fab93200700 1 -- start start 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab93200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cc6f0 0x7fab9415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab93200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab9406aaa0 0x7fab9406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab93200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab940b2ad0 con 0x7fab940cb020 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab93200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9406b450 con 0x7fab9406aaa0 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab93200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab940ccb10 con 0x7fab940cc6f0 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab9406aaa0 0x7fab9406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab9406aaa0 0x7fab9406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38900/0 (socket says 172.21.15.81:38900) 2024-09-13T18:51:04.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 -- 172.21.15.81:0/3039334929 learned_addr learned my addr 172.21.15.81:0/3039334929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab91400700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cc6f0 0x7fab9415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 -- 172.21.15.81:0/3039334929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cc6f0 msgr2=0x7fab9415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cc6f0 0x7fab9415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 -- 172.21.15.81:0/3039334929 >> v1:172.21.15.178:6789/0 conn(0x7fab940cb020 legacy=0x7fab9415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 -- 172.21.15.81:0/3039334929 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9415b960 con 0x7fab9406aaa0 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab91400700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cc6f0 0x7fab9415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:04.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab92800700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab9406aaa0 0x7fab9406af10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009910 tx=0x7fab8c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35ae049b90d267f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:04.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab90a00700 1 -- 172.21.15.81:0/3039334929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c00ba60 con 0x7fab9406aaa0 2024-09-13T18:51:04.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab90a00700 1 -- 172.21.15.81:0/3039334929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c00bbc0 con 0x7fab9406aaa0 2024-09-13T18:51:04.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.665+0000 7fab90a00700 1 -- 172.21.15.81:0/3039334929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c009e60 con 0x7fab9406aaa0 2024-09-13T18:51:04.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 -- 172.21.15.81:0/3039334929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab9406aaa0 msgr2=0x7fab9406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab9406aaa0 0x7fab9406af10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009910 tx=0x7fab8c009c20 comp rx=0 tx=0).stop 2024-09-13T18:51:04.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 -- 172.21.15.81:0/3039334929 shutdown_connections 2024-09-13T18:51:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab9406aaa0 0x7fab9406af10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 --2- 172.21.15.81:0/3039334929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cc6f0 0x7fab9415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 -- 172.21.15.81:0/3039334929 >> 172.21.15.81:0/3039334929 conn(0x7fab940b0c40 msgr2=0x7fab9406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 -- 172.21.15.81:0/3039334929 shutdown_connections 2024-09-13T18:51:04.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.669+0000 7fab93200700 1 -- 172.21.15.81:0/3039334929 wait complete. 2024-09-13T18:51:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 Processor -- start 2024-09-13T18:51:04.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 -- start start 2024-09-13T18:51:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9406aaa0 0x7fab94071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cb020 0x7fab94159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 0x7fab9415a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab94070c10 con 0x7fab940cc6f0 2024-09-13T18:51:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9406fd40 con 0x7fab9406aaa0 2024-09-13T18:51:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.673+0000 7fab93200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9406ff90 con 0x7fab940cb020 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 0x7fab9415a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 0x7fab9415a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38916/0 (socket says 172.21.15.81:38916) 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 -- 172.21.15.81:0/3762459013 learned_addr learned my addr 172.21.15.81:0/3762459013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab91400700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cb020 0x7fab94159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab91e00700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9406aaa0 0x7fab94071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 -- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cb020 msgr2=0x7fab94159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cb020 0x7fab94159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 -- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9406aaa0 msgr2=0x7fab94071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9406aaa0 0x7fab94071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 -- 172.21.15.81:0/3762459013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c009570 con 0x7fab940cc6f0 2024-09-13T18:51:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab92800700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 0x7fab9415a4f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009c60 tx=0x7fab8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c004310 con 0x7fab940cc6f0 2024-09-13T18:51:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c01f070 con 0x7fab940cc6f0 2024-09-13T18:51:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c0036c0 con 0x7fab940cc6f0 2024-09-13T18:51:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab94070270 con 0x7fab940cc6f0 2024-09-13T18:51:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab94070830 con 0x7fab940cc6f0 2024-09-13T18:51:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.677+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab94070d50 con 0x7fab940cc6f0 2024-09-13T18:51:04.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.681+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab8c021030 con 0x7fab940cc6f0 2024-09-13T18:51:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.681+0000 7fab8a000700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fab74066730 0x7fab74068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.681+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fab8c085610 con 0x7fab940cc6f0 2024-09-13T18:51:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.681+0000 7fab91e00700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fab74066730 0x7fab74068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.681+0000 7fab91e00700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fab74066730 0x7fab74068bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fab840012e0 tx=0x7fab84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.689+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab8c0527f0 con 0x7fab940cc6f0 2024-09-13T18:51:04.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.877+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab940cb400 con 0x7fab940cc6f0 2024-09-13T18:51:04.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab8a000700 1 -- 172.21.15.81:0/3762459013 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16870 (secure 0 0 0) 0x7fab8c055e10 con 0x7fab940cc6f0 2024-09-13T18:51:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:04.891 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":55,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:50:59.281400+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:50:03.553082+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-13T18:50:04.575006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2d","mappings":[{"from":0,"to":6}]},{"pgid":"8.39","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fab74066730 msgr2=0x7fab74068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fab74066730 0x7fab74068bf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fab840012e0 tx=0x7fab84009040 comp rx=0 tx=0).stop 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 msgr2=0x7fab9415a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 0x7fab9415a4f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009c60 tx=0x7fab8c004770 comp rx=0 tx=0).stop 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 shutdown_connections 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fab74066730 0x7fab74068bf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab940cc6f0 0x7fab9415a4f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab940cb020 0x7fab94159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 --2- 172.21.15.81:0/3762459013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab9406aaa0 0x7fab94071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:04.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 >> 172.21.15.81:0/3762459013 conn(0x7fab940b0c40 msgr2=0x7fab940b3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:04.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 shutdown_connections 2024-09-13T18:51:04.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:04.881+0000 7fab93200700 1 -- 172.21.15.81:0/3762459013 wait complete. 2024-09-13T18:51:04.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:51:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7666000700 1 Processor -- start 2024-09-13T18:51:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7666000700 1 -- start start 2024-09-13T18:51:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7666000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f766006aaa0 0x7f766006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7666000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600ccb40 con 0x7f76600cb020 2024-09-13T18:51:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7666000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766006b430 con 0x7f76600cc6f0 2024-09-13T18:51:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7666000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600b2ad0 con 0x7f766006aaa0 2024-09-13T18:51:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7664c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f76600cb020 0x7f766015c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40646/0 (socket says 172.21.15.81:40646) 2024-09-13T18:51:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7664c00700 1 -- 172.21.15.81:0/3052658729 learned_addr learned my addr 172.21.15.81:0/3052658729 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7665600700 1 --2- 172.21.15.81:0/3052658729 >> v2:172.21.15.178:3300/0 conn(0x7f766006aaa0 0x7f766006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f765fe00700 1 -- 172.21.15.81:0/3052658729 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786375848 0 0) 0x7f76600ccb40 con 0x7f76600cb020 2024-09-13T18:51:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f765fe00700 1 -- 172.21.15.81:0/3052658729 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76440035d0 con 0x7f76600cb020 2024-09-13T18:51:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7665600700 1 -- 172.21.15.81:0/3052658729 >> v1:172.21.15.178:6789/0 conn(0x7f76600cc6f0 legacy=0x7f766015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7665600700 1 -- 172.21.15.81:0/3052658729 >> v1:172.21.15.81:6789/0 conn(0x7f76600cb020 legacy=0x7f766015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.073+0000 7f7665600700 1 -- 172.21.15.81:0/3052658729 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766015b960 con 0x7f766006aaa0 2024-09-13T18:51:05.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7665600700 1 --2- 172.21.15.81:0/3052658729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f766006aaa0 0x7f766006aef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7658009d90 tx=0x7f765800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb23f66f1f8369f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f765fe00700 1 -- 172.21.15.81:0/3052658729 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800e070 con 0x7f766006aaa0 2024-09-13T18:51:05.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f765fe00700 1 -- 172.21.15.81:0/3052658729 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800bb20 con 0x7f766006aaa0 2024-09-13T18:51:05.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f765fe00700 1 -- 172.21.15.81:0/3052658729 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658012430 con 0x7f766006aaa0 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 -- 172.21.15.81:0/3052658729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f766006aaa0 msgr2=0x7f766006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 --2- 172.21.15.81:0/3052658729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f766006aaa0 0x7f766006aef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7658009d90 tx=0x7f765800b330 comp rx=0 tx=0).stop 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 -- 172.21.15.81:0/3052658729 shutdown_connections 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 --2- 172.21.15.81:0/3052658729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f766006aaa0 0x7f766006aef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 -- 172.21.15.81:0/3052658729 >> 172.21.15.81:0/3052658729 conn(0x7f76600b0c40 msgr2=0x7f766006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 -- 172.21.15.81:0/3052658729 shutdown_connections 2024-09-13T18:51:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.077+0000 7f7666000700 1 -- 172.21.15.81:0/3052658729 wait complete. 2024-09-13T18:51:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 Processor -- start 2024-09-13T18:51:05.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 -- start start 2024-09-13T18:51:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 0x7f76601441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76600cb020 0x7f76600c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76600cc6f0 0x7f76600c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76601446e0 con 0x7f766006aaa0 2024-09-13T18:51:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c41f0 con 0x7f76600cc6f0 2024-09-13T18:51:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7666000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c44d0 con 0x7f76600cb020 2024-09-13T18:51:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7664c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 0x7f76601441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7664c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 0x7f76601441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38924/0 (socket says 172.21.15.81:38924) 2024-09-13T18:51:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7664c00700 1 -- 172.21.15.81:0/4189813892 learned_addr learned my addr 172.21.15.81:0/4189813892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7665600700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76600cc6f0 0x7f76600c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.081+0000 7f7657e00700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76600cb020 0x7f76600c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7664c00700 1 -- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76600cb020 msgr2=0x7f76600c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7664c00700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76600cb020 0x7f76600c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7664c00700 1 -- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76600cc6f0 msgr2=0x7f76600c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7664c00700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76600cc6f0 0x7f76600c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7664c00700 1 -- 172.21.15.81:0/4189813892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658009a70 con 0x7f766006aaa0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7664c00700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 0x7f76601441a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f765000c700 tx=0x7f765000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650005d90 con 0x7f766006aaa0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76500070d0 con 0x7f766006aaa0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76600c47b0 con 0x7f766006aaa0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650007480 con 0x7f766006aaa0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7660155a40 con 0x7f766006aaa0 2024-09-13T18:51:05.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.085+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7660155c30 con 0x7f766006aaa0 2024-09-13T18:51:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.089+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f76500075e0 con 0x7f766006aaa0 2024-09-13T18:51:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.089+0000 7f765d600700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f763c066730 0x7f763c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.089+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6087+0+0 (secure 0 0 0) 0x7f7650083790 con 0x7f766006aaa0 2024-09-13T18:51:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.089+0000 7f7657e00700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f763c066730 0x7f763c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.089+0000 7f7657e00700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f763c066730 0x7f763c068bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76600c7270 tx=0x7f7648009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.093+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7650050a10 con 0x7f766006aaa0 2024-09-13T18:51:05.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.309+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f766006aef0 con 0x7f766006aaa0 2024-09-13T18:51:05.322 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:51:05.313+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:51:05.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.325+0000 7f765d600700 1 -- 172.21.15.81:0/4189813892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7650054030 con 0x7f766006aaa0 2024-09-13T18:51:05.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f763c066730 msgr2=0x7f763c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f763c066730 0x7f763c068bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f76600c7270 tx=0x7f7648009040 comp rx=0 tx=0).stop 2024-09-13T18:51:05.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 msgr2=0x7f76601441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 0x7f76601441a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f765000c700 tx=0x7f765000ca10 comp rx=0 tx=0).stop 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 shutdown_connections 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f763c066730 0x7f763c068bf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76600cc6f0 0x7f76600c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76600cb020 0x7f76600c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 --2- 172.21.15.81:0/4189813892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f766006aaa0 0x7f76601441a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 >> 172.21.15.81:0/4189813892 conn(0x7f76600b0c40 msgr2=0x7f766006ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 shutdown_connections 2024-09-13T18:51:05.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.329+0000 7f7666000700 1 -- 172.21.15.81:0/4189813892 wait complete. 2024-09-13T18:51:05.341 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:51:05.349 INFO:tasks.ceph.mds.c.smithi081.stderr: -1357> 2024-09-13T18:50:36.406+0000 7f9c62800700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1) n(v2 rc2024-09-13T18:50:18.930734+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6046 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55a94a29b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.930734+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:50:18.930734+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:51:05.349 INFO:tasks.ceph.mds.c.smithi081.stderr: -1226> 2024-09-13T18:50:36.410+0000 7f9c6a000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1) n(v1 rc2024-09-13T18:50:18.930734+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6046=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55a94b0ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.666740+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:50:18.930734+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:51:05.351 INFO:tasks.ceph.mds.a.smithi081.stderr: -7235> 2024-09-13T18:50:21.026+0000 7f13f2400700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:51:05.353 INFO:tasks.ceph.mds.d.smithi178.stderr: -1111> 2024-09-13T18:50:36.410+0000 7f0284600700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1) n(v0 rc2024-09-13T18:50:18.666740+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6046 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e3a41e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.666740+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.666740+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:50:18.666740+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:51:05.353 INFO:tasks.ceph.mds.d.smithi178.stderr: -1096> 2024-09-13T18:50:36.410+0000 7f0284600700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/AsLsXsFsx@2},l=6046 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55e3a41e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:51:05.357 INFO:tasks.ceph.mds.a.smithi081.stderr: -2856> 2024-09-13T18:50:36.406+0000 7f13ede00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1) n(v3 rc2024-09-13T18:50:18.930734+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6046=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6046 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x563c40f61b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.930734+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:50:18.930734+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:51:05.357 INFO:tasks.ceph.mds.a.smithi081.stderr: -2751> 2024-09-13T18:50:36.410+0000 7f13f5600700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1) n(v4 rc2024-09-13T18:50:18.930734+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6046=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x563c40f62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:50:18.930734+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:50:18.662740+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:50:18.930734+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:51:05.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:51:05.404 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:51:05.407 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:51:05.408 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:51:05.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.509+0000 7f66e1400700 1 Processor -- start 2024-09-13T18:51:05.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e1400700 1 -- start start 2024-09-13T18:51:05.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e1400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 0x7f66dc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e1400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0b4680 con 0x7f66dc0cf830 2024-09-13T18:51:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e1400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0b4960 con 0x7f66dc06c5a0 2024-09-13T18:51:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e1400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc15aeb0 con 0x7f66dc15aa90 2024-09-13T18:51:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e0a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f66dc0cf830 0x7f66dc0cfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40668/0 (socket says 172.21.15.81:40668) 2024-09-13T18:51:05.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.513+0000 7f66e0a00700 1 -- 172.21.15.81:0/3834651050 learned_addr learned my addr 172.21.15.81:0/3834651050 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66db400700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 0x7f66dc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582639000 0 0) 0x7f66dc0b4680 con 0x7f66dc0cf830 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c00035d0 con 0x7f66dc0cf830 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1880960198 0 0) 0x7f66c00035d0 con 0x7f66dc0cf830 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 msgr2=0x7f66dc0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 0x7f66dc0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 >> v1:172.21.15.178:6789/0 conn(0x7f66dc06c5a0 legacy=0x7f66dc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0cf030 con 0x7f66dc0cf830 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f66d40019f0 con 0x7f66dc0cf830 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 >> v1:172.21.15.81:6789/0 conn(0x7f66dc0cf830 legacy=0x7f66dc0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 0x7f66c0003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0003f90 0x7f66c0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c0004db0 0x7f66c0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc15aeb0 con 0x7f66c0004db0 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c000ba90 con 0x7f66c0003f90 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c000bc50 con 0x7f66dc15aa90 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c0004db0 0x7f66c0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66dbe00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 0x7f66c0003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66db400700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0003f90 0x7f66c0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 -- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 msgr2=0x7f66c0003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66dc15aa90 0x7f66c0003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 -- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0003f90 msgr2=0x7f66c0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66c0003f90 0x7f66c0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 -- 172.21.15.81:0/3834651050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c00035d0 con 0x7f66c0004db0 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66e0a00700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c0004db0 0x7f66c0005230 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f66d400a830 tx=0x7f66c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943c6517c132e489 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40072d0 con 0x7f66c0004db0 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d4007450 con 0x7f66c0004db0 2024-09-13T18:51:05.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.517+0000 7f66daa00700 1 -- 172.21.15.81:0/3834651050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4007800 con 0x7f66c0004db0 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 -- 172.21.15.81:0/3834651050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c0004db0 msgr2=0x7f66c0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 --2- 172.21.15.81:0/3834651050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c0004db0 0x7f66c0005230 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f66d400a830 tx=0x7f66c00058a0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e0a00700 1 -- 172.21.15.81:0/3834651050 reap_dead start 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 -- 172.21.15.81:0/3834651050 shutdown_connections 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 -- 172.21.15.81:0/3834651050 >> 172.21.15.81:0/3834651050 conn(0x7f66dc071d20 msgr2=0x7f66dc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 -- 172.21.15.81:0/3834651050 shutdown_connections 2024-09-13T18:51:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 -- 172.21.15.81:0/3834651050 wait complete. 2024-09-13T18:51:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 Processor -- start 2024-09-13T18:51:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.521+0000 7f66e1400700 1 -- start start 2024-09-13T18:51:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66c0004db0 0x7f66dc147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66dc152590 0x7f66dc1f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 0x7f66dc1f1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc14d850 con 0x7f66dc1f0c10 2024-09-13T18:51:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc14db30 con 0x7f66dc152590 2024-09-13T18:51:05.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc14de10 con 0x7f66c0004db0 2024-09-13T18:51:05.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 0x7f66dc1f1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 0x7f66dc1f1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38980/0 (socket says 172.21.15.81:38980) 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 -- 172.21.15.81:0/254157226 learned_addr learned my addr 172.21.15.81:0/254157226 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66dbe00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66c0004db0 0x7f66dc147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66db400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66dc152590 0x7f66dc1f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 -- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66c0004db0 msgr2=0x7f66dc147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66c0004db0 0x7f66dc147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 -- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66dc152590 msgr2=0x7f66dc1f06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66dc152590 0x7f66dc1f06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 -- 172.21.15.81:0/254157226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc14e0f0 con 0x7f66dc1f0c10 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66db400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66dc152590 0x7f66dc1f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e0a00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 0x7f66dc1f1090 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f66d4000f80 tx=0x7f66d4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4025070 con 0x7f66dc1f0c10 2024-09-13T18:51:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d40077d0 con 0x7f66dc1f0c10 2024-09-13T18:51:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc14e3d0 con 0x7f66dc1f0c10 2024-09-13T18:51:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4007ba0 con 0x7f66dc1f0c10 2024-09-13T18:51:05.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.525+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc14f460 con 0x7f66dc1f0c10 2024-09-13T18:51:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.529+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc06edc0 con 0x7f66dc1f0c10 2024-09-13T18:51:05.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.529+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66d401a070 con 0x7f66dc1f0c10 2024-09-13T18:51:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.529+0000 7f66d3e00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66bc066760 0x7f66bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.529+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6345+0+0 (secure 0 0 0) 0x7f66d4085720 con 0x7f66dc1f0c10 2024-09-13T18:51:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.529+0000 7f66dbe00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66bc066760 0x7f66bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:05.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.529+0000 7f66dbe00700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66bc066760 0x7f66bc068c20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f66dc14f040 tx=0x7f66cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:05.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.537+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66d4052960 con 0x7f66dc1f0c10 2024-09-13T18:51:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:05.757+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f66dc06eae0 con 0x7f66dc1f0c10 2024-09-13T18:51:06.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.329+0000 7f66d3e00700 1 -- 172.21.15.81:0/254157226 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) v1 ==== 104+0+0 (secure 0 0 0) 0x7f66d4055f80 con 0x7f66dc1f0c10 2024-09-13T18:51:06.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66bc066760 msgr2=0x7f66bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:06.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66bc066760 0x7f66bc068c20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f66dc14f040 tx=0x7f66cc009040 comp rx=0 tx=0).stop 2024-09-13T18:51:06.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 msgr2=0x7f66dc1f1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:06.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 0x7f66dc1f1090 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f66d4000f80 tx=0x7f66d4001d80 comp rx=0 tx=0).stop 2024-09-13T18:51:06.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 shutdown_connections 2024-09-13T18:51:06.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66bc066760 0x7f66bc068c20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66dc1f0c10 0x7f66dc1f1090 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66dc152590 0x7f66dc1f06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 --2- 172.21.15.81:0/254157226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66c0004db0 0x7f66dc147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 >> 172.21.15.81:0/254157226 conn(0x7f66dc071d20 msgr2=0x7f66dc0d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:06.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 shutdown_connections 2024-09-13T18:51:06.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.333+0000 7f66e1400700 1 -- 172.21.15.81:0/254157226 wait complete. 2024-09-13T18:51:06.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:51:06.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.577+0000 7f62b2000700 1 Processor -- start 2024-09-13T18:51:06.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.577+0000 7f62b2000700 1 -- start start 2024-09-13T18:51:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62b2000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62ac0b2c60 0x7f62ac066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62b2000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62ac06b2f0 0x7f62ac0665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62b2000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0af2a0 con 0x7f62ac15ccb0 2024-09-13T18:51:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62b2000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac06ae60 con 0x7f62ac0b2c60 2024-09-13T18:51:06.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62b2000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac06a530 con 0x7f62ac06b2f0 2024-09-13T18:51:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62aaa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62ac0b2c60 0x7f62ac066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62aaa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62ac0b2c60 0x7f62ac066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43052/0 (socket says 172.21.15.81:43052) 2024-09-13T18:51:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62aaa00700 1 -- 172.21.15.81:0/3896913717 learned_addr learned my addr 172.21.15.81:0/3896913717 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:06.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.581+0000 7f62abe00700 1 --2- 172.21.15.81:0/3896913717 >> v2:172.21.15.178:3300/0 conn(0x7f62ac06b2f0 0x7f62ac0665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aaa00700 1 -- 172.21.15.81:0/3896913717 >> v2:172.21.15.178:3300/0 conn(0x7f62ac06b2f0 msgr2=0x7f62ac0665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aaa00700 1 --2- 172.21.15.81:0/3896913717 >> v2:172.21.15.178:3300/0 conn(0x7f62ac06b2f0 0x7f62ac0665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aaa00700 1 -- 172.21.15.81:0/3896913717 >> v1:172.21.15.178:6789/0 conn(0x7f62ac15ccb0 legacy=0x7f62ac0aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:06.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aaa00700 1 -- 172.21.15.81:0/3896913717 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac06a810 con 0x7f62ac0b2c60 2024-09-13T18:51:06.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aaa00700 1 --2- 172.21.15.81:0/3896913717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac0b2c60 0x7f62ac066090 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06add0 tx=0x7f6298009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06ea4d5de588e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:06.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aa000700 1 -- 172.21.15.81:0/3896913717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298011830 con 0x7f62ac0b2c60 2024-09-13T18:51:06.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aa000700 1 -- 172.21.15.81:0/3896913717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6298011990 con 0x7f62ac0b2c60 2024-09-13T18:51:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62aa000700 1 -- 172.21.15.81:0/3896913717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6298011d20 con 0x7f62ac0b2c60 2024-09-13T18:51:06.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 -- 172.21.15.81:0/3896913717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac0b2c60 msgr2=0x7f62ac066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 --2- 172.21.15.81:0/3896913717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac0b2c60 0x7f62ac066090 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f62ac06add0 tx=0x7f6298009bf0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 -- 172.21.15.81:0/3896913717 shutdown_connections 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 --2- 172.21.15.81:0/3896913717 >> v2:172.21.15.178:3300/0 conn(0x7f62ac06b2f0 0x7f62ac0665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 --2- 172.21.15.81:0/3896913717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac0b2c60 0x7f62ac066090 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 -- 172.21.15.81:0/3896913717 >> 172.21.15.81:0/3896913717 conn(0x7f62ac06ce30 msgr2=0x7f62ac06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 -- 172.21.15.81:0/3896913717 shutdown_connections 2024-09-13T18:51:06.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.585+0000 7f62b2000700 1 -- 172.21.15.81:0/3896913717 wait complete. 2024-09-13T18:51:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 Processor -- start 2024-09-13T18:51:06.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 -- start start 2024-09-13T18:51:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62ac06b2f0 0x7f62ac150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62ac0b2c60 0x7f62ac1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 0x7f62ac150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0cd650 con 0x7f62ac15ccb0 2024-09-13T18:51:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0cd830 con 0x7f62ac06b2f0 2024-09-13T18:51:06.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62b2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0cdb10 con 0x7f62ac0b2c60 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 0x7f62ac150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 0x7f62ac150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43058/0 (socket says 172.21.15.81:43058) 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 -- 172.21.15.81:0/3506337575 learned_addr learned my addr 172.21.15.81:0/3506337575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62aaa00700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62ac0b2c60 0x7f62ac1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62ab400700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62ac06b2f0 0x7f62ac150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 -- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62ac0b2c60 msgr2=0x7f62ac1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62ac0b2c60 0x7f62ac1410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 -- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62ac06b2f0 msgr2=0x7f62ac150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62ac06b2f0 0x7f62ac150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.589+0000 7f62abe00700 1 -- 172.21.15.81:0/3506337575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6298009570 con 0x7f62ac15ccb0 2024-09-13T18:51:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62abe00700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 0x7f62ac150ea0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f62a400efc0 tx=0x7f62a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a400cd40 con 0x7f62ac15ccb0 2024-09-13T18:51:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac15d210 con 0x7f62ac15ccb0 2024-09-13T18:51:06.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a400f040 con 0x7f62ac15ccb0 2024-09-13T18:51:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40146c0 con 0x7f62ac15ccb0 2024-09-13T18:51:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac0ce0d0 con 0x7f62ac15ccb0 2024-09-13T18:51:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.593+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac0ce2f0 con 0x7f62ac15ccb0 2024-09-13T18:51:06.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.597+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62a4014820 con 0x7f62ac15ccb0 2024-09-13T18:51:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.597+0000 7f62a3400700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f628c066730 0x7f628c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.597+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6345+0+0 (secure 0 0 0) 0x7f62a4084d30 con 0x7f62ac15ccb0 2024-09-13T18:51:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.597+0000 7f62ab400700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f628c066730 0x7f628c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.597+0000 7f62ab400700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f628c066730 0x7f628c068bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0cf600 tx=0x7f629c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:06.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.605+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62a4051d90 con 0x7f62ac15ccb0 2024-09-13T18:51:06.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:06.781+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62ac0aea50 con 0x7f62ac15ccb0 2024-09-13T18:51:07.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.345+0000 7f62a3400700 1 -- 172.21.15.81:0/3506337575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f62a40180d0 con 0x7f62ac15ccb0 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.349+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f628c066730 msgr2=0x7f628c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f628c066730 0x7f628c068bf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0cf600 tx=0x7f629c009040 comp rx=0 tx=0).stop 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 msgr2=0x7f62ac150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 0x7f62ac150ea0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f62a400efc0 tx=0x7f62a400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 shutdown_connections 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f628c066730 0x7f628c068bf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac15ccb0 0x7f62ac150ea0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62ac0b2c60 0x7f62ac1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 --2- 172.21.15.81:0/3506337575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62ac06b2f0 0x7f62ac150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 >> 172.21.15.81:0/3506337575 conn(0x7f62ac06ce30 msgr2=0x7f62ac066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.353+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 shutdown_connections 2024-09-13T18:51:07.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.357+0000 7f62b2000700 1 -- 172.21.15.81:0/3506337575 wait complete. 2024-09-13T18:51:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:51:07.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:51:07.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.557+0000 7fe35ee00700 1 Processor -- start 2024-09-13T18:51:07.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.557+0000 7fe35ee00700 1 -- start start 2024-09-13T18:51:07.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe358146720 0x7fe35815e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:07.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ee00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3580cf280 0x7fe358071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:07.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ee00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358070670 con 0x7fe35806c4c0 2024-09-13T18:51:07.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ee00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe358070950 con 0x7fe3580cf280 2024-09-13T18:51:07.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe358070c30 con 0x7fe358146720 2024-09-13T18:51:07.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe357400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe35806c4c0 0x7fe3580ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59664/0 (socket says 172.21.15.81:59664) 2024-09-13T18:51:07.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe357400700 1 -- 172.21.15.81:0/2853789624 learned_addr learned my addr 172.21.15.81:0/2853789624 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ce00700 1 --2- 172.21.15.81:0/2853789624 >> v2:172.21.15.178:3300/0 conn(0x7fe3580cf280 0x7fe358071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe357e00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe358146720 0x7fe35815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe356a00700 1 -- 172.21.15.81:0/2853789624 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217749327 0 0) 0x7fe358070670 con 0x7fe35806c4c0 2024-09-13T18:51:07.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe356a00700 1 -- 172.21.15.81:0/2853789624 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe33c0035d0 con 0x7fe35806c4c0 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ce00700 1 -- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe358146720 msgr2=0x7fe35815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ce00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe358146720 0x7fe35815e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ce00700 1 -- 172.21.15.81:0/2853789624 >> v1:172.21.15.81:6789/0 conn(0x7fe35806c4c0 legacy=0x7fe3580ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe356a00700 1 -- 172.21.15.81:0/2853789624 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991988446 0 0) 0x7fe33c0035d0 con 0x7fe35806c4c0 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ce00700 1 -- 172.21.15.81:0/2853789624 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358070f10 con 0x7fe3580cf280 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe357e00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe358146720 0x7fe35815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:07.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe35ce00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3580cf280 0x7fe358071710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe350009d90 tx=0x7fe35000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d63abc63fcc046 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.561+0000 7fe356a00700 1 -- 172.21.15.81:0/2853789624 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35000e070 con 0x7fe3580cf280 2024-09-13T18:51:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe356a00700 1 -- 172.21.15.81:0/2853789624 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe350003a40 con 0x7fe3580cf280 2024-09-13T18:51:07.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe356a00700 1 -- 172.21.15.81:0/2853789624 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344001670 con 0x7fe3580cf280 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 -- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3580cf280 msgr2=0x7fe358071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3580cf280 0x7fe358071710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe350009d90 tx=0x7fe35000b330 comp rx=0 tx=0).stop 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 -- 172.21.15.81:0/2853789624 shutdown_connections 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3580cf280 0x7fe358071710 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 --2- 172.21.15.81:0/2853789624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe358146720 0x7fe35815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 -- 172.21.15.81:0/2853789624 >> 172.21.15.81:0/2853789624 conn(0x7fe35806a570 msgr2=0x7fe35806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:07.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 -- 172.21.15.81:0/2853789624 shutdown_connections 2024-09-13T18:51:07.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 -- 172.21.15.81:0/2853789624 wait complete. 2024-09-13T18:51:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.565+0000 7fe35ee00700 1 Processor -- start 2024-09-13T18:51:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 -- start start 2024-09-13T18:51:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe35806c4c0 0x7fe3581574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3580cf280 0x7fe358144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 0x7fe35815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581448b0 con 0x7fe358146720 2024-09-13T18:51:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe358158fb0 con 0x7fe35806c4c0 2024-09-13T18:51:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3581f2490 con 0x7fe3580cf280 2024-09-13T18:51:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 0x7fe35815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 0x7fe35815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43072/0 (socket says 172.21.15.81:43072) 2024-09-13T18:51:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 -- 172.21.15.81:0/147013851 learned_addr learned my addr 172.21.15.81:0/147013851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe357e00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe35806c4c0 0x7fe3581574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe357400700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3580cf280 0x7fe358144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 -- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3580cf280 msgr2=0x7fe358144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3580cf280 0x7fe358144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 -- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe35806c4c0 msgr2=0x7fe3581574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe35806c4c0 0x7fe3581574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 -- 172.21.15.81:0/147013851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480094b0 con 0x7fe358146720 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ce00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 0x7fe35815b320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe350004000 tx=0x7fe350004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350004440 con 0x7fe358146720 2024-09-13T18:51:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3500045c0 con 0x7fe358146720 2024-09-13T18:51:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350004970 con 0x7fe358146720 2024-09-13T18:51:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe350009a70 con 0x7fe358146720 2024-09-13T18:51:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.569+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe358157d60 con 0x7fe358146720 2024-09-13T18:51:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.573+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe358159140 con 0x7fe358146720 2024-09-13T18:51:07.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.573+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe350012430 con 0x7fe358146720 2024-09-13T18:51:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.577+0000 7fe34fe00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe338066730 0x7fe338068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:07.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.577+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5907+0+0 (secure 0 0 0) 0x7fe350085cc0 con 0x7fe358146720 2024-09-13T18:51:07.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.577+0000 7fe357e00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe338066730 0x7fe338068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:07.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.577+0000 7fe357e00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe338066730 0x7fe338068bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe348009ce0 tx=0x7fe348009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:07.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.581+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe35008c080 con 0x7fe358146720 2024-09-13T18:51:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:07.849+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe35815aa10 con 0x7fe358146720 2024-09-13T18:51:08.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.357+0000 7fe34fe00700 1 -- 172.21.15.81:0/147013851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe350052f50 con 0x7fe358146720 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe338066730 msgr2=0x7fe338068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe338066730 0x7fe338068bf0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe348009ce0 tx=0x7fe348009240 comp rx=0 tx=0).stop 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 msgr2=0x7fe35815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 0x7fe35815b320 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe350004000 tx=0x7fe350004af0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 shutdown_connections 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe338066730 0x7fe338068bf0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe358146720 0x7fe35815b320 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3580cf280 0x7fe358144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 --2- 172.21.15.81:0/147013851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe35806c4c0 0x7fe3581574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 >> 172.21.15.81:0/147013851 conn(0x7fe35806a570 msgr2=0x7fe3580ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 shutdown_connections 2024-09-13T18:51:08.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.365+0000 7fe35ee00700 1 -- 172.21.15.81:0/147013851 wait complete. 2024-09-13T18:51:08.379 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:51:08.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:51:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.561+0000 7f9604400700 1 Processor -- start 2024-09-13T18:51:08.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.565+0000 7f9604400700 1 -- start start 2024-09-13T18:51:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.565+0000 7f9604400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0ce280 0x7f95fc0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.565+0000 7f9604400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95fc0cf1e0 0x7f95fc15a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.565+0000 7f9604400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0cf640 con 0x7f95fc15a6b0 2024-09-13T18:51:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.565+0000 7f9604400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc15e420 con 0x7f95fc0cf1e0 2024-09-13T18:51:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.565+0000 7f9604400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc15df90 con 0x7f95fc0ce280 2024-09-13T18:51:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95fc0cf1e0 0x7f95fc15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95fc0cf1e0 0x7f95fc15a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43086/0 (socket says 172.21.15.81:43086) 2024-09-13T18:51:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 -- 172.21.15.81:0/3142524308 learned_addr learned my addr 172.21.15.81:0/3142524308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601a00700 1 --2- 172.21.15.81:0/3142524308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0ce280 0x7f95fc0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 -- 172.21.15.81:0/3142524308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0ce280 msgr2=0x7f95fc0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 --2- 172.21.15.81:0/3142524308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0ce280 0x7f95fc0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 -- 172.21.15.81:0/3142524308 >> v1:172.21.15.178:6789/0 conn(0x7f95fc15a6b0 legacy=0x7f95fc0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 -- 172.21.15.81:0/3142524308 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc15aea0 con 0x7f95fc0cf1e0 2024-09-13T18:51:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9601000700 1 --2- 172.21.15.81:0/3142524308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cf1e0 0x7f95fc15a170 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009910 tx=0x7f95e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aa839f44a878bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f95fbe00700 1 -- 172.21.15.81:0/3142524308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800ba60 con 0x7f95fc0cf1e0 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f95fbe00700 1 -- 172.21.15.81:0/3142524308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800bbc0 con 0x7f95fc0cf1e0 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f95fbe00700 1 -- 172.21.15.81:0/3142524308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8009e60 con 0x7f95fc0cf1e0 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 -- 172.21.15.81:0/3142524308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cf1e0 msgr2=0x7f95fc15a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 --2- 172.21.15.81:0/3142524308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cf1e0 0x7f95fc15a170 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f95e8009910 tx=0x7f95e8009c20 comp rx=0 tx=0).stop 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 -- 172.21.15.81:0/3142524308 shutdown_connections 2024-09-13T18:51:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 --2- 172.21.15.81:0/3142524308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cf1e0 0x7f95fc15a170 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 --2- 172.21.15.81:0/3142524308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0ce280 0x7f95fc0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 -- 172.21.15.81:0/3142524308 >> 172.21.15.81:0/3142524308 conn(0x7f95fc06a570 msgr2=0x7f95fc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 -- 172.21.15.81:0/3142524308 shutdown_connections 2024-09-13T18:51:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.569+0000 7f9604400700 1 -- 172.21.15.81:0/3142524308 wait complete. 2024-09-13T18:51:08.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 Processor -- start 2024-09-13T18:51:08.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 -- start start 2024-09-13T18:51:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95fc0ce280 0x7f95fc145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0cf1e0 0x7f95fc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 0x7f95fc0b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc1459a0 con 0x7f95fc15a6b0 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc154330 con 0x7f95fc0ce280 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.573+0000 7f9604400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0afd80 con 0x7f95fc0cf1e0 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 0x7f95fc0b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 0x7f95fc0b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43088/0 (socket says 172.21.15.81:43088) 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 -- 172.21.15.81:0/4118839288 learned_addr learned my addr 172.21.15.81:0/4118839288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9601000700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0cf1e0 0x7f95fc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9601a00700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95fc0ce280 0x7f95fc145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 -- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0cf1e0 msgr2=0x7f95fc0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0cf1e0 0x7f95fc0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 -- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95fc0ce280 msgr2=0x7f95fc145460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95fc0ce280 0x7f95fc145460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 -- 172.21.15.81:0/4118839288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009570 con 0x7f95fc15a6b0 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9602400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 0x7f95fc0b1080 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f95f400cad0 tx=0x7f95f400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003c20 con 0x7f95fc15a6b0 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc0b0060 con 0x7f95fc15a6b0 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4003d80 con 0x7f95fc15a6b0 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f400a9e0 con 0x7f95fc15a6b0 2024-09-13T18:51:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc0b0620 con 0x7f95fc15a6b0 2024-09-13T18:51:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.577+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc15aae0 con 0x7f95fc15a6b0 2024-09-13T18:51:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.581+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95f400ab40 con 0x7f95fc15a6b0 2024-09-13T18:51:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.581+0000 7f95f9600700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95dc066730 0x7f95dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.581+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f95f4083f40 con 0x7f95fc15a6b0 2024-09-13T18:51:08.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.581+0000 7f9601a00700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95dc066730 0x7f95dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.581+0000 7f9601a00700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95dc066730 0x7f95dc068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009a00 tx=0x7f95f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.585+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95f4051320 con 0x7f95fc15a6b0 2024-09-13T18:51:08.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.769+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f95fc0b0810 con 0x7f95fc15a6b0 2024-09-13T18:51:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.773+0000 7f95f9600700 1 -- 172.21.15.81:0/4118839288 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f95f4054940 con 0x7f95fc15a6b0 2024-09-13T18:51:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95dc066730 msgr2=0x7f95dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95dc066730 0x7f95dc068bf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009a00 tx=0x7f95f0008040 comp rx=0 tx=0).stop 2024-09-13T18:51:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 msgr2=0x7f95fc0b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 0x7f95fc0b1080 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f95f400cad0 tx=0x7f95f400cde0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 shutdown_connections 2024-09-13T18:51:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95dc066730 0x7f95dc068bf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc15a6b0 0x7f95fc0b1080 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95fc0cf1e0 0x7f95fc0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 --2- 172.21.15.81:0/4118839288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95fc0ce280 0x7f95fc145460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 >> 172.21.15.81:0/4118839288 conn(0x7f95fc06a570 msgr2=0x7f95fc0b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 shutdown_connections 2024-09-13T18:51:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.781+0000 7f9604400700 1 -- 172.21.15.81:0/4118839288 wait complete. 2024-09-13T18:51:08.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2024-09-13T18:51:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.965+0000 7f852b200700 1 Processor -- start 2024-09-13T18:51:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.965+0000 7f852b200700 1 -- start start 2024-09-13T18:51:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f852c06aaa0 0x7f852c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f852c06cbb0 0x7f852c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0adf90 con 0x7f852c06aaa0 2024-09-13T18:51:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c15e560 con 0x7f852c06cbb0 2024-09-13T18:51:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c06b3c0 con 0x7f852c0b3980 2024-09-13T18:51:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f852c06aaa0 0x7f852c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f852c06aaa0 0x7f852c15d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43102/0 (socket says 172.21.15.81:43102) 2024-09-13T18:51:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 -- 172.21.15.81:0/1497458235 learned_addr learned my addr 172.21.15.81:0/1497458235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852a800700 1 --2- 172.21.15.81:0/1497458235 >> v2:172.21.15.178:3300/0 conn(0x7f852c06cbb0 0x7f852c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8521400700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 -- 172.21.15.81:0/1497458235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 msgr2=0x7f852c06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c06ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 -- 172.21.15.81:0/1497458235 >> v2:172.21.15.178:3300/0 conn(0x7f852c06cbb0 msgr2=0x7f852c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 --2- 172.21.15.81:0/1497458235 >> v2:172.21.15.178:3300/0 conn(0x7f852c06cbb0 0x7f852c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 -- 172.21.15.81:0/1497458235 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c15d920 con 0x7f852c06aaa0 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8521400700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f852a800700 1 --2- 172.21.15.81:0/1497458235 >> v2:172.21.15.178:3300/0 conn(0x7f852c06cbb0 0x7f852c06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529e00700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c15d310 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f852c06fb90 tx=0x7f851c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcfbf6b0101b9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529400700 1 -- 172.21.15.81:0/1497458235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00b8a0 con 0x7f852c06aaa0 2024-09-13T18:51:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529400700 1 -- 172.21.15.81:0/1497458235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00ba00 con 0x7f852c06aaa0 2024-09-13T18:51:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.969+0000 7f8529400700 1 -- 172.21.15.81:0/1497458235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00bd90 con 0x7f852c06aaa0 2024-09-13T18:51:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 -- 172.21.15.81:0/1497458235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 msgr2=0x7f852c15d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c15d310 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f852c06fb90 tx=0x7f851c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 -- 172.21.15.81:0/1497458235 shutdown_connections 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 --2- 172.21.15.81:0/1497458235 >> v2:172.21.15.178:3300/0 conn(0x7f852c06cbb0 0x7f852c06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 --2- 172.21.15.81:0/1497458235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c15d310 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 -- 172.21.15.81:0/1497458235 >> 172.21.15.81:0/1497458235 conn(0x7f852c0b0c40 msgr2=0x7f852c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 -- 172.21.15.81:0/1497458235 shutdown_connections 2024-09-13T18:51:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 -- 172.21.15.81:0/1497458235 wait complete. 2024-09-13T18:51:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.973+0000 7f852b200700 1 Processor -- start 2024-09-13T18:51:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 -- start start 2024-09-13T18:51:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c13acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f852c06cbb0 0x7f852c1454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c15c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c145e10 con 0x7f852c06aaa0 2024-09-13T18:51:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1460f0 con 0x7f852c06cbb0 2024-09-13T18:51:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c1463d0 con 0x7f852c0b3980 2024-09-13T18:51:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c13acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c13acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43112/0 (socket says 172.21.15.81:43112) 2024-09-13T18:51:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 -- 172.21.15.81:0/1330516753 learned_addr learned my addr 172.21.15.81:0/1330516753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8521400700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f852c06cbb0 0x7f852c1454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f852a800700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c15c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 -- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 msgr2=0x7f852c15c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c15c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 -- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f852c06cbb0 msgr2=0x7f852c1454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f852c06cbb0 0x7f852c1454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.977+0000 7f8529e00700 1 -- 172.21.15.81:0/1330516753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c009570 con 0x7f852c06aaa0 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f8529e00700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c13acc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f852c0b1690 tx=0x7f851c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00bee0 con 0x7f852c06aaa0 2024-09-13T18:51:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c01f070 con 0x7f852c06aaa0 2024-09-13T18:51:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c1466b0 con 0x7f852c06aaa0 2024-09-13T18:51:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c003b20 con 0x7f852c06aaa0 2024-09-13T18:51:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c145a00 con 0x7f852c06aaa0 2024-09-13T18:51:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c1468f0 con 0x7f852c06aaa0 2024-09-13T18:51:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.981+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f851c003c80 con 0x7f852c06aaa0 2024-09-13T18:51:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.985+0000 7f8522a00700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8508066730 0x7f8508068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.985+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f851c021070 con 0x7f852c06aaa0 2024-09-13T18:51:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.985+0000 7f8521400700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8508066730 0x7f8508068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.985+0000 7f8521400700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8508066730 0x7f8508068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f852c0cad80 tx=0x7f8514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:08.989+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f851c052fe0 con 0x7f852c06aaa0 2024-09-13T18:51:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.245+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) v1 -- 0x7f852c143540 con 0x7f852c06aaa0 2024-09-13T18:51:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.365+0000 7f8522a00700 1 -- 172.21.15.81:0/1330516753 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v214) v1 ==== 143+0+0 (secure 0 0 0) 0x7f851c056600 con 0x7f852c06aaa0 2024-09-13T18:51:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8508066730 msgr2=0x7f8508068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8508066730 0x7f8508068bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f852c0cad80 tx=0x7f8514008040 comp rx=0 tx=0).stop 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 msgr2=0x7f852c13acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c13acc0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f852c0b1690 tx=0x7f851c004770 comp rx=0 tx=0).stop 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 shutdown_connections 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8508066730 0x7f8508068bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f852c0b3980 0x7f852c15c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f852c06cbb0 0x7f852c1454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 --2- 172.21.15.81:0/1330516753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f852c06aaa0 0x7f852c13acc0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 >> 172.21.15.81:0/1330516753 conn(0x7f852c0b0c40 msgr2=0x7f852c070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 shutdown_connections 2024-09-13T18:51:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.369+0000 7f852b200700 1 -- 172.21.15.81:0/1330516753 wait complete. 2024-09-13T18:51:09.401 INFO:tasks.cephfs_test_runner:test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-13T18:51:09.402 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-13T18:51:09.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.573+0000 7f7f1a600700 1 Processor -- start 2024-09-13T18:51:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.573+0000 7f7f1a600700 1 -- start start 2024-09-13T18:51:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f1a600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f140cb020 0x7f7f140cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f1a600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f1406aaa0 0x7f7f1406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f1a600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1406b430 con 0x7f7f1415c2a0 2024-09-13T18:51:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f1a600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f140b2ad0 con 0x7f7f140cb020 2024-09-13T18:51:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f1a600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1415b960 con 0x7f7f1406aaa0 2024-09-13T18:51:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f140cb020 0x7f7f140cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f13e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7f1415c2a0 0x7f7f1415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59672/0 (socket says 172.21.15.81:59672) 2024-09-13T18:51:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f13e00700 1 -- 172.21.15.81:0/781239615 learned_addr learned my addr 172.21.15.81:0/781239615 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:09.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19c00700 1 --2- 172.21.15.81:0/781239615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f1406aaa0 0x7f7f1406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19c00700 1 -- 172.21.15.81:0/781239615 >> v2:172.21.15.178:3300/0 conn(0x7f7f140cb020 msgr2=0x7f7f140cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19c00700 1 --2- 172.21.15.81:0/781239615 >> v2:172.21.15.178:3300/0 conn(0x7f7f140cb020 0x7f7f140cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19c00700 1 -- 172.21.15.81:0/781239615 >> v1:172.21.15.81:6789/0 conn(0x7f7f1415c2a0 legacy=0x7f7f1415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19c00700 1 -- 172.21.15.81:0/781239615 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1415bc40 con 0x7f7f1406aaa0 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19200700 1 --2- 172.21.15.81:0/781239615 >> v2:172.21.15.178:3300/0 conn(0x7f7f140cb020 0x7f7f140cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f13400700 1 -- 172.21.15.81:0/781239615 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586828657 0 0) 0x7f7f00001110 con 0x7f7f1415c2a0 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f19c00700 1 --2- 172.21.15.81:0/781239615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f1406aaa0 0x7f7f1406aef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009d90 tx=0x7f7f0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d24ea4c9091e347 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:09.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f13400700 1 -- 172.21.15.81:0/781239615 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00e070 con 0x7f7f1406aaa0 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f13400700 1 -- 172.21.15.81:0/781239615 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c00bb20 con 0x7f7f1406aaa0 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.577+0000 7f7f13400700 1 -- 172.21.15.81:0/781239615 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c012430 con 0x7f7f1406aaa0 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 -- 172.21.15.81:0/781239615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f1406aaa0 msgr2=0x7f7f1406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 --2- 172.21.15.81:0/781239615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f1406aaa0 0x7f7f1406aef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009d90 tx=0x7f7f0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 -- 172.21.15.81:0/781239615 shutdown_connections 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 --2- 172.21.15.81:0/781239615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f1406aaa0 0x7f7f1406aef0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 --2- 172.21.15.81:0/781239615 >> v2:172.21.15.178:3300/0 conn(0x7f7f140cb020 0x7f7f140cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 -- 172.21.15.81:0/781239615 >> 172.21.15.81:0/781239615 conn(0x7f7f140b0c40 msgr2=0x7f7f1406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:09.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 -- 172.21.15.81:0/781239615 shutdown_connections 2024-09-13T18:51:09.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 -- 172.21.15.81:0/781239615 wait complete. 2024-09-13T18:51:09.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.581+0000 7f7f1a600700 1 Processor -- start 2024-09-13T18:51:09.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 -- start start 2024-09-13T18:51:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f1406aaa0 0x7f7f1413d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f140cb020 0x7f7f140c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 0x7f7f1414d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1413d770 con 0x7f7f1415c2a0 2024-09-13T18:51:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f140c9de0 con 0x7f7f1406aaa0 2024-09-13T18:51:09.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f1a600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f14149530 con 0x7f7f140cb020 2024-09-13T18:51:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 0x7f7f1414d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 0x7f7f1414d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43120/0 (socket says 172.21.15.81:43120) 2024-09-13T18:51:09.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f1406aaa0 0x7f7f1413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 -- 172.21.15.81:0/3060430932 learned_addr learned my addr 172.21.15.81:0/3060430932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f13e00700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f140cb020 0x7f7f140c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 -- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f140cb020 msgr2=0x7f7f140c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f140cb020 0x7f7f140c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 -- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f1406aaa0 msgr2=0x7f7f1413d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f1406aaa0 0x7f7f1413d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 -- 172.21.15.81:0/3060430932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080094b0 con 0x7f7f1415c2a0 2024-09-13T18:51:09.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19200700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f1406aaa0 0x7f7f1413d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.585+0000 7f7f19c00700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 0x7f7f1414d8f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7f1415baa0 tx=0x7f7f0c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.589+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c012430 con 0x7f7f1415c2a0 2024-09-13T18:51:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.589+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c020070 con 0x7f7f1415c2a0 2024-09-13T18:51:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.589+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c009a70 con 0x7f7f1415c2a0 2024-09-13T18:51:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.589+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c004280 con 0x7f7f1415c2a0 2024-09-13T18:51:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.589+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f14157f50 con 0x7f7f1415c2a0 2024-09-13T18:51:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.589+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1406aef0 con 0x7f7f1415c2a0 2024-09-13T18:51:09.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.593+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f0c0043e0 con 0x7f7f1415c2a0 2024-09-13T18:51:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.593+0000 7f7f10c00700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ef4066730 0x7f7ef4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.593+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7f0c022070 con 0x7f7f1415c2a0 2024-09-13T18:51:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.593+0000 7f7f19200700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ef4066730 0x7f7ef4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.593+0000 7f7f19200700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ef4066730 0x7f7ef4068bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f080114b0 tx=0x7f7f08009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:09.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.597+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f0c0534e0 con 0x7f7f1415c2a0 2024-09-13T18:51:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.793+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f1415b2f0 con 0x7f7f1415c2a0 2024-09-13T18:51:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.793+0000 7f7f10c00700 1 -- 172.21.15.81:0/3060430932 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13449 (secure 0 0 0) 0x7f7f0c056b00 con 0x7f7f1415c2a0 2024-09-13T18:51:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:09.806 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:51:08.350996+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.178:6835/1611484847":"2024-09-14T18:51:05.316594+0000","172.21.15.178:6834/1611484847":"2024-09-14T18:51:05.316594+0000","172.21.15.81:6836/729196456":"2024-09-14T18:51:05.316635+0000","172.21.15.81:6834/729196456":"2024-09-14T18:51:05.316635+0000","172.21.15.81:6837/396996950":"2024-09-14T18:51:05.316647+0000","172.21.15.81:6835/396996950":"2024-09-14T18:51:05.316647+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.797+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ef4066730 msgr2=0x7f7ef4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.797+0000 7f7f1a600700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ef4066730 0x7f7ef4068bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7f080114b0 tx=0x7f7f08009240 comp rx=0 tx=0).stop 2024-09-13T18:51:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.797+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 msgr2=0x7f7f1414d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.797+0000 7f7f1a600700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 0x7f7f1414d8f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f7f1415baa0 tx=0x7f7f0c004af0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 shutdown_connections 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ef4066730 0x7f7ef4068bf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f1415c2a0 0x7f7f1414d8f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f140cb020 0x7f7f140c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 --2- 172.21.15.81:0/3060430932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f1406aaa0 0x7f7f1413d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 >> 172.21.15.81:0/3060430932 conn(0x7f7f140b0c40 msgr2=0x7f7f140b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 shutdown_connections 2024-09-13T18:51:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.801+0000 7f7f1a600700 1 -- 172.21.15.81:0/3060430932 wait complete. 2024-09-13T18:51:09.834 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:51:09.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:51:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.997+0000 7f4809c00700 1 Processor -- start 2024-09-13T18:51:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:09.997+0000 7f4809c00700 1 -- start start 2024-09-13T18:51:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f480406ada0 0x7f480406b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480406b710 con 0x7f480406cd80 2024-09-13T18:51:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4804160680 con 0x7f480415ca20 2024-09-13T18:51:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040b4a20 con 0x7f480406ada0 2024-09-13T18:51:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f480406ada0 0x7f480406b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4803400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f480406cd80 0x7f48040b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59684/0 (socket says 172.21.15.81:59684) 2024-09-13T18:51:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4803400700 1 -- 172.21.15.81:0/2278463549 learned_addr learned my addr 172.21.15.81:0/2278463549 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809200700 1 -- 172.21.15.81:0/2278463549 >> v1:172.21.15.178:6789/0 conn(0x7f480415ca20 legacy=0x7f480415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809200700 1 -- 172.21.15.81:0/2278463549 >> v1:172.21.15.81:6789/0 conn(0x7f480406cd80 legacy=0x7f48040b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809200700 1 -- 172.21.15.81:0/2278463549 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480415d670 con 0x7f480406ada0 2024-09-13T18:51:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4809200700 1 --2- 172.21.15.81:0/2278463549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480406ada0 0x7f480406b1d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009d90 tx=0x7f47fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1910fe4171055ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4802a00700 1 -- 172.21.15.81:0/2278463549 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00e070 con 0x7f480406ada0 2024-09-13T18:51:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4802a00700 1 -- 172.21.15.81:0/2278463549 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc00bbd0 con 0x7f480406ada0 2024-09-13T18:51:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.001+0000 7f4802a00700 1 -- 172.21.15.81:0/2278463549 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc012430 con 0x7f480406ada0 2024-09-13T18:51:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 -- 172.21.15.81:0/2278463549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480406ada0 msgr2=0x7f480406b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 --2- 172.21.15.81:0/2278463549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480406ada0 0x7f480406b1d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009d90 tx=0x7f47fc00b330 comp rx=0 tx=0).stop 2024-09-13T18:51:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 -- 172.21.15.81:0/2278463549 shutdown_connections 2024-09-13T18:51:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 --2- 172.21.15.81:0/2278463549 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480406ada0 0x7f480406b1d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 -- 172.21.15.81:0/2278463549 >> 172.21.15.81:0/2278463549 conn(0x7f4804071d20 msgr2=0x7f4804072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 -- 172.21.15.81:0/2278463549 shutdown_connections 2024-09-13T18:51:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 -- 172.21.15.81:0/2278463549 wait complete. 2024-09-13T18:51:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 Processor -- start 2024-09-13T18:51:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.005+0000 7f4809c00700 1 -- start start 2024-09-13T18:51:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f480406ada0 0x7f480414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f480406cd80 0x7f4804152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 0x7f48041526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041e82b0 con 0x7f480415ca20 2024-09-13T18:51:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041e7c60 con 0x7f480406cd80 2024-09-13T18:51:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48041e8cf0 con 0x7f480406ada0 2024-09-13T18:51:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 0x7f48041526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 0x7f48041526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43142/0 (socket says 172.21.15.81:43142) 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 -- 172.21.15.81:0/1160872179 learned_addr learned my addr 172.21.15.81:0/1160872179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4803e00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f480406ada0 0x7f480414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4803400700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f480406cd80 0x7f4804152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 -- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f480406ada0 msgr2=0x7f480414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f480406ada0 0x7f480414e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 -- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f480406cd80 msgr2=0x7f4804152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f480406cd80 0x7f4804152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 -- 172.21.15.81:0/1160872179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc009a70 con 0x7f480415ca20 2024-09-13T18:51:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809200700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 0x7f48041526a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f480406b8a0 tx=0x7f47fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc012430 con 0x7f480415ca20 2024-09-13T18:51:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc020070 con 0x7f480415ca20 2024-09-13T18:51:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48041e8fd0 con 0x7f480415ca20 2024-09-13T18:51:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc004280 con 0x7f480415ca20 2024-09-13T18:51:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.009+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480414e790 con 0x7f480415ca20 2024-09-13T18:51:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.013+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48041e83f0 con 0x7f480415ca20 2024-09-13T18:51:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.013+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f47fc0043e0 con 0x7f480415ca20 2024-09-13T18:51:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.017+0000 7f47fbe00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f47e4066730 0x7f47e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.017+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f47fc022070 con 0x7f480415ca20 2024-09-13T18:51:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.017+0000 7f4803e00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f47e4066730 0x7f47e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.017+0000 7f4803e00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f47e4066730 0x7f47e4068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f47f4000f60 tx=0x7f47f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:10.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.017+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48041e83f0 con 0x7f480415ca20 2024-09-13T18:51:10.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.197+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48041e83f0 con 0x7f480415ca20 2024-09-13T18:51:10.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.197+0000 7f47fbe00700 1 -- 172.21.15.81:0/1160872179 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48041e83f0 con 0x7f480415ca20 2024-09-13T18:51:10.208 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:51:10.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f47e4066730 msgr2=0x7f47e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f47e4066730 0x7f47e4068bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f47f4000f60 tx=0x7f47f4009040 comp rx=0 tx=0).stop 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 msgr2=0x7f48041526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 0x7f48041526a0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f480406b8a0 tx=0x7f47fc004af0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 shutdown_connections 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f47e4066730 0x7f47e4068bf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f480415ca20 0x7f48041526a0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f480406cd80 0x7f4804152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 --2- 172.21.15.81:0/1160872179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f480406ada0 0x7f480414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 >> 172.21.15.81:0/1160872179 conn(0x7f4804071d20 msgr2=0x7f4804160880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 shutdown_connections 2024-09-13T18:51:10.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.201+0000 7f4809c00700 1 -- 172.21.15.81:0/1160872179 wait complete. 2024-09-13T18:51:10.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2024-09-13T18:51:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.389+0000 7fbd8d400700 1 Processor -- start 2024-09-13T18:51:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.389+0000 7fbd8d400700 1 -- start start 2024-09-13T18:51:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd8d400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 0x7fbd880adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd8d400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd880ad030 con 0x7fbd88146440 2024-09-13T18:51:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd8d400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd880ad2d0 con 0x7fbd88066090 2024-09-13T18:51:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd8d400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8806b680 con 0x7fbd88066500 2024-09-13T18:51:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd87e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd88146440 0x7fbd8806a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59700/0 (socket says 172.21.15.81:59700) 2024-09-13T18:51:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd87e00700 1 -- 172.21.15.81:0/3507905322 learned_addr learned my addr 172.21.15.81:0/3507905322 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.393+0000 7fbd8ca00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 0x7fbd880adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005937130 0 0) 0x7fbd880ad030 con 0x7fbd88146440 2024-09-13T18:51:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd6c0035d0 con 0x7fbd88146440 2024-09-13T18:51:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989014795 0 0) 0x7fbd880ad2d0 con 0x7fbd88066090 2024-09-13T18:51:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd880ad030 con 0x7fbd88066090 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3452209225 0 0) 0x7fbd6c0035d0 con 0x7fbd88146440 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 msgr2=0x7fbd880adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 0x7fbd880adec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 >> v1:172.21.15.178:6789/0 conn(0x7fbd88066090 legacy=0x7fbd880ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8806ade0 con 0x7fbd88146440 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fbd78001670 con 0x7fbd88146440 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 >> v1:172.21.15.81:6789/0 conn(0x7fbd88146440 legacy=0x7fbd8806a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c003c50 0x7fbd6c004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd6c004870 0x7fbd6c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 0x7fbd6c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8806b680 con 0x7fbd6c004870 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c00bb10 con 0x7fbd6c003c50 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c00bcd0 con 0x7fbd88066500 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd6c004870 0x7fbd6c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87e00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c003c50 0x7fbd6c004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd8ca00700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 0x7fbd6c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 -- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 msgr2=0x7fbd6c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd88066500 0x7fbd6c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 -- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c003c50 msgr2=0x7fbd6c004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c003c50 0x7fbd6c004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 -- 172.21.15.81:0/3507905322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0035d0 con 0x7fbd6c004870 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd87400700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd6c004870 0x7fbd6c004cf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbd74007fd0 tx=0x7fbd6c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1d77d074d82883 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74001450 con 0x7fbd6c004870 2024-09-13T18:51:10.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd740052f0 con 0x7fbd6c004870 2024-09-13T18:51:10.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.397+0000 7fbd86a00700 1 -- 172.21.15.81:0/3507905322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74001d60 con 0x7fbd6c004870 2024-09-13T18:51:10.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 -- 172.21.15.81:0/3507905322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd6c004870 msgr2=0x7fbd6c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3507905322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd6c004870 0x7fbd6c004cf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fbd74007fd0 tx=0x7fbd6c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8ca00700 1 -- 172.21.15.81:0/3507905322 reap_dead start 2024-09-13T18:51:10.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 -- 172.21.15.81:0/3507905322 shutdown_connections 2024-09-13T18:51:10.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 -- 172.21.15.81:0/3507905322 >> 172.21.15.81:0/3507905322 conn(0x7fbd8806e660 msgr2=0x7fbd8806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:10.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 -- 172.21.15.81:0/3507905322 shutdown_connections 2024-09-13T18:51:10.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 -- 172.21.15.81:0/3507905322 wait complete. 2024-09-13T18:51:10.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 Processor -- start 2024-09-13T18:51:10.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.401+0000 7fbd8d400700 1 -- start start 2024-09-13T18:51:10.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c004870 0x7fbd88159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd8815cbf0 0x7fbd8815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 0x7fbd8815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd88158000 con 0x7fbd8815e8f0 2024-09-13T18:51:10.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8815f7e0 con 0x7fbd6c004870 2024-09-13T18:51:10.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8815fac0 con 0x7fbd8815cbf0 2024-09-13T18:51:10.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 0x7fbd8815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 0x7fbd8815ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43160/0 (socket says 172.21.15.81:43160) 2024-09-13T18:51:10.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 -- 172.21.15.81:0/3849720524 learned_addr learned my addr 172.21.15.81:0/3849720524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd87e00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c004870 0x7fbd88159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd87400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd8815cbf0 0x7fbd8815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 -- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd8815cbf0 msgr2=0x7fbd8815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd8815cbf0 0x7fbd8815d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 -- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c004870 msgr2=0x7fbd88159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c004870 0x7fbd88159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 -- 172.21.15.81:0/3849720524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8815fda0 con 0x7fbd8815e8f0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd87400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd8815cbf0 0x7fbd8815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8ca00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 0x7fbd8815ed70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbd8806da40 tx=0x7fbd800114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8000e070 con 0x7fbd8815e8f0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd80003d10 con 0x7fbd8815e8f0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd88160080 con 0x7fbd8815e8f0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80011a10 con 0x7fbd8815e8f0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8815f2b0 con 0x7fbd8815e8f0 2024-09-13T18:51:10.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.405+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd88158170 con 0x7fbd8815e8f0 2024-09-13T18:51:10.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.409+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd80011b70 con 0x7fbd8815e8f0 2024-09-13T18:51:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.409+0000 7fbd7fe00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd68066760 0x7fbd68068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:10.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.409+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fbd80085090 con 0x7fbd8815e8f0 2024-09-13T18:51:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.409+0000 7fbd87e00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd68066760 0x7fbd68068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:10.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.409+0000 7fbd87e00700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd68066760 0x7fbd68068c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005a40 tx=0x7fbd78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:10.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.413+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd800525f0 con 0x7fbd8815e8f0 2024-09-13T18:51:10.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:10.669+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) v1 -- 0x7fbd8815f590 con 0x7fbd8815e8f0 2024-09-13T18:51:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.377+0000 7fbd7fe00700 1 -- 172.21.15.81:0/3849720524 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v216) v1 ==== 145+0+0 (secure 0 0 0) 0x7fbd80055c10 con 0x7fbd8815e8f0 2024-09-13T18:51:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd68066760 msgr2=0x7fbd68068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd68066760 0x7fbd68068c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd78005a40 tx=0x7fbd78009040 comp rx=0 tx=0).stop 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 msgr2=0x7fbd8815ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 0x7fbd8815ed70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fbd8806da40 tx=0x7fbd800114b0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 shutdown_connections 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd68066760 0x7fbd68068c20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd8815e8f0 0x7fbd8815ed70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd8815cbf0 0x7fbd8815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 --2- 172.21.15.81:0/3849720524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd6c004870 0x7fbd88159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 >> 172.21.15.81:0/3849720524 conn(0x7fbd8806e660 msgr2=0x7fbd880b0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 shutdown_connections 2024-09-13T18:51:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.381+0000 7fbd8d400700 1 -- 172.21.15.81:0/3849720524 wait complete. 2024-09-13T18:51:11.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:51:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.593+0000 7f63a0c00700 1 Processor -- start 2024-09-13T18:51:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.593+0000 7f63a0c00700 1 -- start start 2024-09-13T18:51:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f63a0c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f639c15ca20 0x7f639c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f63a0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06ada0 0x7f639c06b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f63a0c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639c160680 con 0x7f639c06cd80 2024-09-13T18:51:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f63a0c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639c0b4a20 con 0x7f639c15ca20 2024-09-13T18:51:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f63a0c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c06b750 con 0x7f639c06ada0 2024-09-13T18:51:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f639c06cd80 0x7f639c0b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59710/0 (socket says 172.21.15.81:59710) 2024-09-13T18:51:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639aa00700 1 -- 172.21.15.81:0/1269374965 learned_addr learned my addr 172.21.15.81:0/1269374965 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639be00700 1 --2- 172.21.15.81:0/1269374965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06ada0 0x7f639c06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639b400700 1 --2- 172.21.15.81:0/1269374965 >> v2:172.21.15.178:3300/0 conn(0x7f639c15ca20 0x7f639c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639a000700 1 -- 172.21.15.81:0/1269374965 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51889644 0 0) 0x7f639c160680 con 0x7f639c06cd80 2024-09-13T18:51:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639a000700 1 -- 172.21.15.81:0/1269374965 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63800035d0 con 0x7f639c06cd80 2024-09-13T18:51:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639be00700 1 -- 172.21.15.81:0/1269374965 >> v2:172.21.15.178:3300/0 conn(0x7f639c15ca20 msgr2=0x7f639c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639be00700 1 --2- 172.21.15.81:0/1269374965 >> v2:172.21.15.178:3300/0 conn(0x7f639c15ca20 0x7f639c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639be00700 1 -- 172.21.15.81:0/1269374965 >> v1:172.21.15.81:6789/0 conn(0x7f639c06cd80 legacy=0x7f639c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639a000700 1 -- 172.21.15.81:0/1269374965 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 286330441 0 0) 0x7f63800035d0 con 0x7f639c06cd80 2024-09-13T18:51:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.597+0000 7f639be00700 1 -- 172.21.15.81:0/1269374965 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c15d670 con 0x7f639c06ada0 2024-09-13T18:51:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f639be00700 1 --2- 172.21.15.81:0/1269374965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06ada0 0x7f639c06b210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6394009d90 tx=0x7f639400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d75e12af64c4a2a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f639a000700 1 -- 172.21.15.81:0/1269374965 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639400e070 con 0x7f639c06ada0 2024-09-13T18:51:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f639a000700 1 -- 172.21.15.81:0/1269374965 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639400bb20 con 0x7f639c06ada0 2024-09-13T18:51:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f639a000700 1 -- 172.21.15.81:0/1269374965 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394012430 con 0x7f639c06ada0 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 -- 172.21.15.81:0/1269374965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06ada0 msgr2=0x7f639c06b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1269374965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06ada0 0x7f639c06b210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6394009d90 tx=0x7f639400b330 comp rx=0 tx=0).stop 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 -- 172.21.15.81:0/1269374965 shutdown_connections 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1269374965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06ada0 0x7f639c06b210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1269374965 >> v2:172.21.15.178:3300/0 conn(0x7f639c15ca20 0x7f639c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 -- 172.21.15.81:0/1269374965 >> 172.21.15.81:0/1269374965 conn(0x7f639c071d20 msgr2=0x7f639c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 -- 172.21.15.81:0/1269374965 shutdown_connections 2024-09-13T18:51:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.601+0000 7f63a0c00700 1 -- 172.21.15.81:0/1269374965 wait complete. 2024-09-13T18:51:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 Processor -- start 2024-09-13T18:51:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 -- start start 2024-09-13T18:51:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f639c06ada0 0x7f639c1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 0x7f639c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f639c15ca20 0x7f639c14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c157d60 con 0x7f639c15ca20 2024-09-13T18:51:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c157a80 con 0x7f639c06ada0 2024-09-13T18:51:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c1535b0 con 0x7f639c06cd80 2024-09-13T18:51:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f639c15ca20 0x7f639c14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 0x7f639c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639b400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f639c06ada0 0x7f639c1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 0x7f639c0ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:51110/0 (socket says 172.21.15.81:51110) 2024-09-13T18:51:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 -- 172.21.15.81:0/1796712642 learned_addr learned my addr 172.21.15.81:0/1796712642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 -- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f639c06ada0 msgr2=0x7f639c1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f639c06ada0 0x7f639c1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 -- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f639c15ca20 msgr2=0x7f639c14f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f639c15ca20 0x7f639c14f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 -- 172.21.15.81:0/1796712642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394009a70 con 0x7f639c06cd80 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f639aa00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 0x7f639c0ce040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f638800c780 tx=0x7f638800ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388005d90 con 0x7f639c06cd80 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880070d0 con 0x7f639c06cd80 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c153890 con 0x7f639c06cd80 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388007460 con 0x7f639c06cd80 2024-09-13T18:51:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.605+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c14f940 con 0x7f639c06cd80 2024-09-13T18:51:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.609+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c153db0 con 0x7f639c06cd80 2024-09-13T18:51:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.609+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63880075c0 con 0x7f639c06cd80 2024-09-13T18:51:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.613+0000 7f6393400700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f637c066730 0x7f637c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.613+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f63880834d0 con 0x7f639c06cd80 2024-09-13T18:51:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.613+0000 7f639b400700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f637c066730 0x7f637c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.613+0000 7f639b400700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f637c066730 0x7f637c068bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f638c009b50 tx=0x7f638c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:11.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.621+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f639c153db0 con 0x7f639c06cd80 2024-09-13T18:51:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.809+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f639c153db0 con 0x7f639c06cd80 2024-09-13T18:51:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.821+0000 7f6393400700 1 -- 172.21.15.81:0/1796712642 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f639c153db0 con 0x7f639c06cd80 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f637c066730 msgr2=0x7f637c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f637c066730 0x7f637c068bf0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f638c009b50 tx=0x7f638c009240 comp rx=0 tx=0).stop 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 msgr2=0x7f639c0ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 0x7f639c0ce040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f638800c780 tx=0x7f638800ca90 comp rx=0 tx=0).stop 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 shutdown_connections 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f637c066730 0x7f637c068bf0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f639c15ca20 0x7f639c14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f639c06cd80 0x7f639c0ce040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 --2- 172.21.15.81:0/1796712642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f639c06ada0 0x7f639c1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 >> 172.21.15.81:0/1796712642 conn(0x7f639c071d20 msgr2=0x7f639c0b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 shutdown_connections 2024-09-13T18:51:11.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:11.825+0000 7f63a0c00700 1 -- 172.21.15.81:0/1796712642 wait complete. 2024-09-13T18:51:11.858 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:51:11.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:51:11.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:51:11.938 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:51:11.939 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:51:11.939 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:11.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:51:11.957 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:51:11.957 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:12.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:51:12.002 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:51:12.002 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:12.020 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:51:12.020 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:51:12.020 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:12.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:51:12.061 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:51:12.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:12.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.221+0000 7fc67e800700 1 Processor -- start 2024-09-13T18:51:12.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.221+0000 7fc67e800700 1 -- start start 2024-09-13T18:51:12.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc67815ba90 0x7fc678066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67e800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc678070d80 con 0x7fc6780aedd0 2024-09-13T18:51:12.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67e800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc678070fd0 con 0x7fc6780665d0 2024-09-13T18:51:12.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67e800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc678066a60 con 0x7fc67815ba90 2024-09-13T18:51:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc6780aedd0 0x7fc6780cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59724/0 (socket says 172.21.15.81:59724) 2024-09-13T18:51:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67d400700 1 -- 172.21.15.81:0/2604737948 learned_addr learned my addr 172.21.15.81:0/2604737948 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:12.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc67ca00700 1 --2- 172.21.15.81:0/2604737948 >> v2:172.21.15.81:3300/0 conn(0x7fc67815ba90 0x7fc678066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc677e00700 1 -- 172.21.15.81:0/2604737948 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076857244 0 0) 0x7fc678070d80 con 0x7fc6780aedd0 2024-09-13T18:51:12.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.225+0000 7fc677e00700 1 -- 172.21.15.81:0/2604737948 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6600035d0 con 0x7fc6780aedd0 2024-09-13T18:51:12.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67ca00700 1 -- 172.21.15.81:0/2604737948 >> v1:172.21.15.178:6789/0 conn(0x7fc6780665d0 legacy=0x7fc67806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67ca00700 1 -- 172.21.15.81:0/2604737948 >> v1:172.21.15.81:6789/0 conn(0x7fc6780aedd0 legacy=0x7fc6780cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67ca00700 1 -- 172.21.15.81:0/2604737948 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780712b0 con 0x7fc67815ba90 2024-09-13T18:51:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67ca00700 1 --2- 172.21.15.81:0/2604737948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc67815ba90 0x7fc678066090 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc664009850 tx=0x7fc664009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a10f3ec15ebdbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc677e00700 1 -- 172.21.15.81:0/2604737948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664011830 con 0x7fc67815ba90 2024-09-13T18:51:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc677e00700 1 -- 172.21.15.81:0/2604737948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc664011990 con 0x7fc67815ba90 2024-09-13T18:51:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc677e00700 1 -- 172.21.15.81:0/2604737948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664011d00 con 0x7fc67815ba90 2024-09-13T18:51:12.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 -- 172.21.15.81:0/2604737948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc67815ba90 msgr2=0x7fc678066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 --2- 172.21.15.81:0/2604737948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc67815ba90 0x7fc678066090 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc664009850 tx=0x7fc664009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:12.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 -- 172.21.15.81:0/2604737948 shutdown_connections 2024-09-13T18:51:12.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 --2- 172.21.15.81:0/2604737948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc67815ba90 0x7fc678066090 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 -- 172.21.15.81:0/2604737948 >> 172.21.15.81:0/2604737948 conn(0x7fc67806ca10 msgr2=0x7fc67806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:12.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 -- 172.21.15.81:0/2604737948 shutdown_connections 2024-09-13T18:51:12.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.229+0000 7fc67e800700 1 -- 172.21.15.81:0/2604737948 wait complete. 2024-09-13T18:51:12.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 Processor -- start 2024-09-13T18:51:12.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 -- start start 2024-09-13T18:51:12.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6780665d0 0x7fc6780a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 0x7fc6781f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc67815ba90 0x7fc6781f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780ada20 con 0x7fc6780aedd0 2024-09-13T18:51:12.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc678157140 con 0x7fc67815ba90 2024-09-13T18:51:12.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc678157420 con 0x7fc6780665d0 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 0x7fc6781f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 0x7fc6781f37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43186/0 (socket says 172.21.15.81:43186) 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.233+0000 7fc67ca00700 1 -- 172.21.15.81:0/3027411683 learned_addr learned my addr 172.21.15.81:0/3027411683 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67de00700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc67815ba90 0x7fc6781f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67d400700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6780665d0 0x7fc6780a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67ca00700 1 -- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6780665d0 msgr2=0x7fc6780a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67ca00700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6780665d0 0x7fc6780a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67ca00700 1 -- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc67815ba90 msgr2=0x7fc6781f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67ca00700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc67815ba90 0x7fc6781f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67ca00700 1 -- 172.21.15.81:0/3027411683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640094b0 con 0x7fc6780aedd0 2024-09-13T18:51:12.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67ca00700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 0x7fc6781f37a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc664004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6640036c0 con 0x7fc6780aedd0 2024-09-13T18:51:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66401e070 con 0x7fc6780aedd0 2024-09-13T18:51:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664003a80 con 0x7fc6780aedd0 2024-09-13T18:51:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc678157700 con 0x7fc6780aedd0 2024-09-13T18:51:12.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc678157cc0 con 0x7fc6780aedd0 2024-09-13T18:51:12.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.237+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc678157ee0 con 0x7fc6780aedd0 2024-09-13T18:51:12.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.241+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc664003be0 con 0x7fc6780aedd0 2024-09-13T18:51:12.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.241+0000 7fc675600700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc658066730 0x7fc658068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.241+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fc6640850a0 con 0x7fc6780aedd0 2024-09-13T18:51:12.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.241+0000 7fc67d400700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc658066730 0x7fc658068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.245+0000 7fc67d400700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc658066730 0x7fc658068bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc66c001560 tx=0x7fc66c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:12.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.249+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc6640b6db0 con 0x7fc6780aedd0 2024-09-13T18:51:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.477+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc678066090 con 0x7fc6780aedd0 2024-09-13T18:51:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.477+0000 7fc675600700 1 -- 172.21.15.81:0/3027411683 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc664015de0 con 0x7fc6780aedd0 2024-09-13T18:51:12.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:12.488 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":46,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5438,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/3375158340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3375158340},{"type":"v1","addr":"172.21.15.178:6833","nonce":3375158340}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6484,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/953060217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":953060217},{"type":"v1","addr":"172.21.15.178:6835","nonce":953060217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6720,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/747280971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":747280971},{"type":"v1","addr":"172.21.15.81:6835","nonce":747280971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46},{"gid":6723,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1966302997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1966302997},{"type":"v1","addr":"172.21.15.81:6837","nonce":1966302997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[]} 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc658066730 msgr2=0x7fc658068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc658066730 0x7fc658068bf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc66c001560 tx=0x7fc66c009040 comp rx=0 tx=0).stop 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 msgr2=0x7fc6781f37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 0x7fc6781f37a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc664000c00 tx=0x7fc664004770 comp rx=0 tx=0).stop 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 shutdown_connections 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc658066730 0x7fc658068bf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc67815ba90 0x7fc6781f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6780aedd0 0x7fc6781f37a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 --2- 172.21.15.81:0/3027411683 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6780665d0 0x7fc6780a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.481+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 >> 172.21.15.81:0/3027411683 conn(0x7fc67806ca10 msgr2=0x7fc67806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:12.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.485+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 shutdown_connections 2024-09-13T18:51:12.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.485+0000 7fc67e800700 1 -- 172.21.15.81:0/3027411683 wait complete. 2024-09-13T18:51:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 46 2024-09-13T18:51:12.520 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:51:12.520 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:51:12.520 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:51:12.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:51:12.521 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:51:12.521 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:51:12.521 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:51:12.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:51:12.521 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:51:12.521 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:51:12.522 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:51:12.522 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:51:12.522 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:51:12.522 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:51:12.522 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:51:12.522 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:51:12.541 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:51:12.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:51:12.545 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:51:12.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:51:12.549 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:51:12.550 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:51:12.550 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:51:12.551 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:51:12.595 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:51:12.595 DEBUG:teuthology.parallel:result is None 2024-09-13T18:51:12.600 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:51:12.600 DEBUG:teuthology.parallel:result is None 2024-09-13T18:51:12.601 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:51:12.601 DEBUG:teuthology.parallel:result is None 2024-09-13T18:51:12.605 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:51:12.605 DEBUG:teuthology.parallel:result is None 2024-09-13T18:51:12.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:51:12.707 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:51:12.714 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:51:12.716 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:51:12.721 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:51:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 Processor -- start 2024-09-13T18:51:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 -- start start 2024-09-13T18:51:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1a900ae980 0x7f1a900aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a9015d4f0 0x7f1a9015d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a901576a0 con 0x7f1a90070e30 2024-09-13T18:51:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900b32e0 con 0x7f1a900ae980 2024-09-13T18:51:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a97800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900af2a0 con 0x7f1a9015d4f0 2024-09-13T18:51:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.781+0000 7f1a95800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a90070e30 0x7f1a90071210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59732/0 (socket says 172.21.15.81:59732) 2024-09-13T18:51:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a95800700 1 -- 172.21.15.81:0/1102353943 learned_addr learned my addr 172.21.15.81:0/1102353943 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a94e00700 1 --2- 172.21.15.81:0/1102353943 >> v2:172.21.15.81:3300/0 conn(0x7f1a900ae980 0x7f1a900aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a8fe00700 1 --2- 172.21.15.81:0/1102353943 >> v2:172.21.15.178:3300/0 conn(0x7f1a9015d4f0 0x7f1a9015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a8f400700 1 -- 172.21.15.81:0/1102353943 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977913526 0 0) 0x7f1a901576a0 con 0x7f1a90070e30 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a94e00700 1 -- 172.21.15.81:0/1102353943 >> v2:172.21.15.178:3300/0 conn(0x7f1a9015d4f0 msgr2=0x7f1a9015d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a94e00700 1 --2- 172.21.15.81:0/1102353943 >> v2:172.21.15.178:3300/0 conn(0x7f1a9015d4f0 0x7f1a9015d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a94e00700 1 -- 172.21.15.81:0/1102353943 >> v1:172.21.15.81:6789/0 conn(0x7f1a90070e30 legacy=0x7f1a90071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a94e00700 1 -- 172.21.15.81:0/1102353943 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900b34f0 con 0x7f1a900ae980 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a94e00700 1 --2- 172.21.15.81:0/1102353943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a900ae980 0x7f1a900aed60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b2600 tx=0x7f1a84009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561b1fc0c51ae04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a8f400700 1 -- 172.21.15.81:0/1102353943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84011830 con 0x7f1a900ae980 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a8f400700 1 -- 172.21.15.81:0/1102353943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84011990 con 0x7f1a900ae980 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a8f400700 1 -- 172.21.15.81:0/1102353943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84011d40 con 0x7f1a900ae980 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 -- 172.21.15.81:0/1102353943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a900ae980 msgr2=0x7f1a900aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 --2- 172.21.15.81:0/1102353943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a900ae980 0x7f1a900aed60 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1a900b2600 tx=0x7f1a84009b30 comp rx=0 tx=0).stop 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 -- 172.21.15.81:0/1102353943 shutdown_connections 2024-09-13T18:51:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 --2- 172.21.15.81:0/1102353943 >> v2:172.21.15.178:3300/0 conn(0x7f1a9015d4f0 0x7f1a9015d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 --2- 172.21.15.81:0/1102353943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a900ae980 0x7f1a900aed60 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 -- 172.21.15.81:0/1102353943 >> 172.21.15.81:0/1102353943 conn(0x7f1a900b18f0 msgr2=0x7f1a900b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 -- 172.21.15.81:0/1102353943 shutdown_connections 2024-09-13T18:51:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.785+0000 7f1a97800700 1 -- 172.21.15.81:0/1102353943 wait complete. 2024-09-13T18:51:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 Processor -- start 2024-09-13T18:51:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 -- start start 2024-09-13T18:51:12.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 0x7f1a90144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a900ae980 0x7f1a90145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a9015d4f0 0x7f1a900ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90144cd0 con 0x7f1a90070e30 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90145b20 con 0x7f1a900ae980 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a97800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90145e00 con 0x7f1a9015d4f0 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 0x7f1a90144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 0x7f1a90144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43246/0 (socket says 172.21.15.81:43246) 2024-09-13T18:51:12.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 -- 172.21.15.81:0/3577532601 learned_addr learned my addr 172.21.15.81:0/3577532601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a8fe00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a900ae980 0x7f1a90145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a95800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a9015d4f0 0x7f1a900ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 -- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a9015d4f0 msgr2=0x7f1a900ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a9015d4f0 0x7f1a900ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 -- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a900ae980 msgr2=0x7f1a90145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a900ae980 0x7f1a90145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 -- 172.21.15.81:0/3577532601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840094b0 con 0x7f1a90070e30 2024-09-13T18:51:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.789+0000 7f1a94e00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 0x7f1a90144790 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1a84000c00 tx=0x7f1a84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8401aac0 con 0x7f1a90070e30 2024-09-13T18:51:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8401f070 con 0x7f1a90070e30 2024-09-13T18:51:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8401ae80 con 0x7f1a90070e30 2024-09-13T18:51:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a901460e0 con 0x7f1a90070e30 2024-09-13T18:51:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a901466a0 con 0x7f1a90070e30 2024-09-13T18:51:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a900acde0 con 0x7f1a90070e30 2024-09-13T18:51:12.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.793+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a8401b430 con 0x7f1a90070e30 2024-09-13T18:51:12.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.797+0000 7f1a8cc00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a70066760 0x7f1a70068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:12.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.797+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f1a840851b0 con 0x7f1a90070e30 2024-09-13T18:51:12.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.797+0000 7f1a8fe00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a70066760 0x7f1a70068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:12.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.797+0000 7f1a8fe00700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a70066760 0x7f1a70068c20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1a9015cc70 tx=0x7f1a7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.801+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a840526c0 con 0x7f1a90070e30 2024-09-13T18:51:13.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:12.993+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1a900b42b0 con 0x7f1a90070e30 2024-09-13T18:51:13.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:13.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:13.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.753+0000 7f1a8cc00700 1 -- 172.21.15.81:0/3577532601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1a84021080 con 0x7f1a90070e30 2024-09-13T18:51:13.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a70066760 msgr2=0x7f1a70068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a70066760 0x7f1a70068c20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1a9015cc70 tx=0x7f1a7c008040 comp rx=0 tx=0).stop 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 msgr2=0x7f1a90144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 0x7f1a90144790 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f1a84000c00 tx=0x7f1a84004770 comp rx=0 tx=0).stop 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 shutdown_connections 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a70066760 0x7f1a70068c20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a9015d4f0 0x7f1a900ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a900ae980 0x7f1a90145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 --2- 172.21.15.81:0/3577532601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a90070e30 0x7f1a90144790 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 >> 172.21.15.81:0/3577532601 conn(0x7f1a900b18f0 msgr2=0x7f1a9006b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 shutdown_connections 2024-09-13T18:51:13.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.757+0000 7f1a97800700 1 -- 172.21.15.81:0/3577532601 wait complete. 2024-09-13T18:51:13.769 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-13T18:51:13.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:51:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.961+0000 7f8733200700 1 Processor -- start 2024-09-13T18:51:13.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.961+0000 7f8733200700 1 -- start start 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8733200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f87340cb020 0x7f87340cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8733200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f873406aaa0 0x7f873406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8733200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873406b430 con 0x7f873415c2a0 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8733200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340b2ad0 con 0x7f873406aaa0 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8733200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873415b960 con 0x7f87340cb020 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8732800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f873406aaa0 0x7f873406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8731400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f873415c2a0 0x7f873415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59748/0 (socket says 172.21.15.81:59748) 2024-09-13T18:51:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8731400700 1 -- 172.21.15.81:0/3952894924 learned_addr learned my addr 172.21.15.81:0/3952894924 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8731e00700 1 --2- 172.21.15.81:0/3952894924 >> v2:172.21.15.178:3300/0 conn(0x7f87340cb020 0x7f87340cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8732800700 1 -- 172.21.15.81:0/3952894924 >> v2:172.21.15.178:3300/0 conn(0x7f87340cb020 msgr2=0x7f87340cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8732800700 1 --2- 172.21.15.81:0/3952894924 >> v2:172.21.15.178:3300/0 conn(0x7f87340cb020 0x7f87340cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8732800700 1 -- 172.21.15.81:0/3952894924 >> v1:172.21.15.81:6789/0 conn(0x7f873415c2a0 legacy=0x7f873415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8732800700 1 -- 172.21.15.81:0/3952894924 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873415bc40 con 0x7f873406aaa0 2024-09-13T18:51:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8732800700 1 --2- 172.21.15.81:0/3952894924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873406aef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f873406b660 tx=0x7f872c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e57fba7ab37d278 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8730a00700 1 -- 172.21.15.81:0/3952894924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011830 con 0x7f873406aaa0 2024-09-13T18:51:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.965+0000 7f8730a00700 1 -- 172.21.15.81:0/3952894924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c011990 con 0x7f873406aaa0 2024-09-13T18:51:13.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8730a00700 1 -- 172.21.15.81:0/3952894924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c011d20 con 0x7f873406aaa0 2024-09-13T18:51:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 -- 172.21.15.81:0/3952894924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 msgr2=0x7f873406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 --2- 172.21.15.81:0/3952894924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873406aef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f873406b660 tx=0x7f872c009b30 comp rx=0 tx=0).stop 2024-09-13T18:51:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 -- 172.21.15.81:0/3952894924 shutdown_connections 2024-09-13T18:51:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 --2- 172.21.15.81:0/3952894924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873406aef0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 --2- 172.21.15.81:0/3952894924 >> v2:172.21.15.178:3300/0 conn(0x7f87340cb020 0x7f87340cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 -- 172.21.15.81:0/3952894924 >> 172.21.15.81:0/3952894924 conn(0x7f87340b0c40 msgr2=0x7f873406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 -- 172.21.15.81:0/3952894924 shutdown_connections 2024-09-13T18:51:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 -- 172.21.15.81:0/3952894924 wait complete. 2024-09-13T18:51:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 Processor -- start 2024-09-13T18:51:13.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.969+0000 7f8733200700 1 -- start start 2024-09-13T18:51:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873414a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87340cb020 0x7f8734140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f873415c2a0 0x7f8734157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341560b0 con 0x7f873406aaa0 2024-09-13T18:51:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873414a9a0 con 0x7f873415c2a0 2024-09-13T18:51:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87341557a0 con 0x7f87340cb020 2024-09-13T18:51:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873414a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873414a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43278/0 (socket says 172.21.15.81:43278) 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 -- 172.21.15.81:0/2878643509 learned_addr learned my addr 172.21.15.81:0/2878643509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8732800700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f873415c2a0 0x7f8734157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731400700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87340cb020 0x7f8734140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 -- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87340cb020 msgr2=0x7f8734140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87340cb020 0x7f8734140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 -- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f873415c2a0 msgr2=0x7f8734157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f873415c2a0 0x7f8734157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 -- 172.21.15.81:0/2878643509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c0094b0 con 0x7f873406aaa0 2024-09-13T18:51:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8731e00700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873414a460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f872400efc0 tx=0x7f872400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400cdc0 con 0x7f873406aaa0 2024-09-13T18:51:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400f040 con 0x7f873406aaa0 2024-09-13T18:51:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873414e260 con 0x7f873406aaa0 2024-09-13T18:51:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240146a0 con 0x7f873406aaa0 2024-09-13T18:51:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.973+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8734155cd0 con 0x7f873406aaa0 2024-09-13T18:51:13.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.977+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734156320 con 0x7f873406aaa0 2024-09-13T18:51:13.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.977+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8724014800 con 0x7f873406aaa0 2024-09-13T18:51:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.977+0000 7f872a000700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8714066730 0x7f8714068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.977+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8724084960 con 0x7f873406aaa0 2024-09-13T18:51:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.977+0000 7f8731400700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8714066730 0x7f8714068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.981+0000 7f8731400700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8714066730 0x7f8714068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8734152b30 tx=0x7f8720009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:13.985+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8724051e50 con 0x7f873406aaa0 2024-09-13T18:51:14.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.237+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f873406aef0 con 0x7f873406aaa0 2024-09-13T18:51:14.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f872a000700 1 -- 172.21.15.81:0/2878643509 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8724055470 con 0x7f873406aaa0 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw==", 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:51:14.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw==", 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q==", 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-13T18:51:14.253 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g==", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g==", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw==", 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA==", 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg==", 2024-09-13T18:51:14.256 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw==", 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.257 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw==", 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-13T18:51:14.258 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A==", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q==", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:51:14.259 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ==", 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.260 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg==", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg==", 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng==", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:51:14.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB2iORm9hwhIRAASJc+x3PH9tdxfNlBIxr8ZA==", 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-13T18:51:14.263 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA==", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g==", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:51:14.264 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:51:14.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:14.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T18:51:14.265 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8714066730 msgr2=0x7f8714068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8714066730 0x7f8714068bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8734152b30 tx=0x7f8720009040 comp rx=0 tx=0).stop 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 msgr2=0x7f873414a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873414a460 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f872400efc0 tx=0x7f872400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 shutdown_connections 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8714066730 0x7f8714068bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f873415c2a0 0x7f8734157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87340cb020 0x7f8734140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 --2- 172.21.15.81:0/2878643509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f873406aaa0 0x7f873414a460 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 >> 172.21.15.81:0/2878643509 conn(0x7f87340b0c40 msgr2=0x7f873406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 shutdown_connections 2024-09-13T18:51:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.241+0000 7f8733200700 1 -- 172.21.15.81:0/2878643509 wait complete. 2024-09-13T18:51:14.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.433+0000 7f274b200700 1 Processor -- start 2024-09-13T18:51:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.433+0000 7f274b200700 1 -- start start 2024-09-13T18:51:14.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f274c06aaa0 0x7f274c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274b200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c0b3560 con 0x7f274c0b2670 2024-09-13T18:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c070b30 con 0x7f274c06aaa0 2024-09-13T18:51:14.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c06b420 con 0x7f274c1610b0 2024-09-13T18:51:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274a800700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f274c0b2670 0x7f274c0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:41982/0 (socket says 172.21.15.81:41982) 2024-09-13T18:51:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f274a800700 1 -- 172.21.15.81:0/180932830 learned_addr learned my addr 172.21.15.81:0/180932830 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2741400700 1 --2- 172.21.15.81:0/180932830 >> v2:172.21.15.178:3300/0 conn(0x7f274c06aaa0 0x7f274c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2749e00700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2749400700 1 -- 172.21.15.81:0/180932830 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664922274 0 0) 0x7f274c0b3560 con 0x7f274c0b2670 2024-09-13T18:51:14.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2749400700 1 -- 172.21.15.81:0/180932830 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27300035d0 con 0x7f274c0b2670 2024-09-13T18:51:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2741400700 1 -- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 msgr2=0x7f274c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2741400700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2741400700 1 -- 172.21.15.81:0/180932830 >> v1:172.21.15.178:6789/0 conn(0x7f274c0b2670 legacy=0x7f274c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2741400700 1 -- 172.21.15.81:0/180932830 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0b3280 con 0x7f274c06aaa0 2024-09-13T18:51:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2749e00700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.437+0000 7f2741400700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c06aaa0 0x7f274c06aee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2734009850 tx=0x7f2734009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d13963ead8bb8a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f2749400700 1 -- 172.21.15.81:0/180932830 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734011830 con 0x7f274c06aaa0 2024-09-13T18:51:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f2749400700 1 -- 172.21.15.81:0/180932830 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734011990 con 0x7f274c06aaa0 2024-09-13T18:51:14.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f2749400700 1 -- 172.21.15.81:0/180932830 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734011d00 con 0x7f274c06aaa0 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 -- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c06aaa0 msgr2=0x7f274c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c06aaa0 0x7f274c06aee0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2734009850 tx=0x7f2734009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 -- 172.21.15.81:0/180932830 shutdown_connections 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c06aaa0 0x7f274c06aee0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 --2- 172.21.15.81:0/180932830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 -- 172.21.15.81:0/180932830 >> 172.21.15.81:0/180932830 conn(0x7f274c0b0c40 msgr2=0x7f274c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 -- 172.21.15.81:0/180932830 shutdown_connections 2024-09-13T18:51:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.441+0000 7f274b200700 1 -- 172.21.15.81:0/180932830 wait complete. 2024-09-13T18:51:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 Processor -- start 2024-09-13T18:51:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 -- start start 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 0x7f274c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b2670 0x7f274c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c1f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c162730 con 0x7f274c06aaa0 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0a87e0 con 0x7f274c0b2670 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c162970 con 0x7f274c1610b0 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f2749e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 0x7f274c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f2749e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 0x7f274c15b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43294/0 (socket says 172.21.15.81:43294) 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f2749e00700 1 -- 172.21.15.81:0/1710682317 learned_addr learned my addr 172.21.15.81:0/1710682317 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f274a800700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c1f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.445+0000 7f2741400700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b2670 0x7f274c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2749e00700 1 -- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 msgr2=0x7f274c1f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2749e00700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c1f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2749e00700 1 -- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b2670 msgr2=0x7f274c157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2749e00700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b2670 0x7f274c157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2749e00700 1 -- 172.21.15.81:0/1710682317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c009a70 con 0x7f274c06aaa0 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2749e00700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 0x7f274c15b2b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f273c00efc0 tx=0x7f273c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c00cdd0 con 0x7f274c06aaa0 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c00f040 con 0x7f274c06aaa0 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27340094b0 con 0x7f274c06aaa0 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0146a0 con 0x7f274c06aaa0 2024-09-13T18:51:14.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c162f30 con 0x7f274c06aaa0 2024-09-13T18:51:14.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.449+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c0b03c0 con 0x7f274c06aaa0 2024-09-13T18:51:14.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.453+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f273c014800 con 0x7f274c06aaa0 2024-09-13T18:51:14.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.453+0000 7f2742a00700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2728066730 0x7f2728068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.453+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f273c084bc0 con 0x7f274c06aaa0 2024-09-13T18:51:14.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.453+0000 7f2741400700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2728066730 0x7f2728068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.457+0000 7f2741400700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2728066730 0x7f2728068bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2734009850 tx=0x7f2734008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:14.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.461+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f273c052130 con 0x7f274c06aaa0 2024-09-13T18:51:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.669+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f274c161570 con 0x7f274c06aaa0 2024-09-13T18:51:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.669+0000 7f2742a00700 1 -- 172.21.15.81:0/1710682317 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f273c055750 con 0x7f274c06aaa0 2024-09-13T18:51:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:14.682 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:51:13.743943+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.673+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2728066730 msgr2=0x7f2728068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.673+0000 7f274b200700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2728066730 0x7f2728068bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2734009850 tx=0x7f2734008030 comp rx=0 tx=0).stop 2024-09-13T18:51:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.673+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 msgr2=0x7f274c15b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.673+0000 7f274b200700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 0x7f274c15b2b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f273c00efc0 tx=0x7f273c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 shutdown_connections 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2728066730 0x7f2728068bf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c1610b0 0x7f274c1f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b2670 0x7f274c157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 --2- 172.21.15.81:0/1710682317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c06aaa0 0x7f274c15b2b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 >> 172.21.15.81:0/1710682317 conn(0x7f274c0b0c40 msgr2=0x7f274c0cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 shutdown_connections 2024-09-13T18:51:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.677+0000 7f274b200700 1 -- 172.21.15.81:0/1710682317 wait complete. 2024-09-13T18:51:14.708 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:51:14.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:51:14.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.877+0000 7fd809200700 1 Processor -- start 2024-09-13T18:51:14.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.877+0000 7fd809200700 1 -- start start 2024-09-13T18:51:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.877+0000 7fd809200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd80406d760 0x7fd8040b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.877+0000 7fd809200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80406bcf0 con 0x7fd804144710 2024-09-13T18:51:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.877+0000 7fd809200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80406cb50 con 0x7fd804144330 2024-09-13T18:51:14.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.877+0000 7fd809200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8040cce10 con 0x7fd80406d760 2024-09-13T18:51:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd802800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd804144710 0x7fd8040b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59758/0 (socket says 172.21.15.81:59758) 2024-09-13T18:51:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd802800700 1 -- 172.21.15.81:0/104655711 learned_addr learned my addr 172.21.15.81:0/104655711 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd801400700 1 --2- 172.21.15.81:0/104655711 >> v2:172.21.15.178:3300/0 conn(0x7fd80406d760 0x7fd8040b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159713660 0 0) 0x7fd80406bcf0 con 0x7fd804144710 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e80035d0 con 0x7fd804144710 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861160517 0 0) 0x7fd80406cb50 con 0x7fd804144330 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd80406bcf0 con 0x7fd804144330 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd801400700 1 -- 172.21.15.81:0/104655711 >> v1:172.21.15.178:6789/0 conn(0x7fd804144330 legacy=0x7fd8040cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd801400700 1 -- 172.21.15.81:0/104655711 >> v1:172.21.15.81:6789/0 conn(0x7fd804144710 legacy=0x7fd8040b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd801400700 1 -- 172.21.15.81:0/104655711 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80406bf40 con 0x7fd80406d760 2024-09-13T18:51:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd801400700 1 --2- 172.21.15.81:0/104655711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8040b35a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009850 tx=0x7fd7f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d151e2f76a8340 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011830 con 0x7fd80406d760 2024-09-13T18:51:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f0011990 con 0x7fd80406d760 2024-09-13T18:51:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.881+0000 7fd800a00700 1 -- 172.21.15.81:0/104655711 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0011d40 con 0x7fd80406d760 2024-09-13T18:51:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 -- 172.21.15.81:0/104655711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 msgr2=0x7fd8040b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 --2- 172.21.15.81:0/104655711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8040b35a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009850 tx=0x7fd7f0009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 -- 172.21.15.81:0/104655711 shutdown_connections 2024-09-13T18:51:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 --2- 172.21.15.81:0/104655711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8040b35a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 -- 172.21.15.81:0/104655711 >> 172.21.15.81:0/104655711 conn(0x7fd80406a570 msgr2=0x7fd80406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 -- 172.21.15.81:0/104655711 shutdown_connections 2024-09-13T18:51:14.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 -- 172.21.15.81:0/104655711 wait complete. 2024-09-13T18:51:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 Processor -- start 2024-09-13T18:51:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.885+0000 7fd809200700 1 -- start start 2024-09-13T18:51:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8041f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd804144330 0x7fd80413ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 0x7fd80413b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd804073170 con 0x7fd8040b00a0 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b1140 con 0x7fd80406d760 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8040b15d0 con 0x7fd804144330 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 0x7fd80413b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 0x7fd80413b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43310/0 (socket says 172.21.15.81:43310) 2024-09-13T18:51:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 -- 172.21.15.81:0/921823221 learned_addr learned my addr 172.21.15.81:0/921823221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd801400700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd804144330 0x7fd80413ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd801e00700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8041f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 -- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd804144330 msgr2=0x7fd80413ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd804144330 0x7fd80413ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 -- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 msgr2=0x7fd8041f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8041f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:14.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 -- 172.21.15.81:0/921823221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00094b0 con 0x7fd8040b00a0 2024-09-13T18:51:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd802800700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 0x7fd80413b360 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00ca80 tx=0x7fd7fc00cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0074e0 con 0x7fd8040b00a0 2024-09-13T18:51:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc007640 con 0x7fd8040b00a0 2024-09-13T18:51:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8040b0530 con 0x7fd8040b00a0 2024-09-13T18:51:14.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0079d0 con 0x7fd8040b00a0 2024-09-13T18:51:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.889+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8040b0af0 con 0x7fd8040b00a0 2024-09-13T18:51:14.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.893+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040b12b0 con 0x7fd8040b00a0 2024-09-13T18:51:14.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.893+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd7fc01b3b0 con 0x7fd8040b00a0 2024-09-13T18:51:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.897+0000 7fd7fa000700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd7e4066730 0x7fd7e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.897+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd7fc083800 con 0x7fd8040b00a0 2024-09-13T18:51:14.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.897+0000 7fd801e00700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd7e4066730 0x7fd7e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:14.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.897+0000 7fd801e00700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd7e4066730 0x7fd7e4068bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40011e0 tx=0x7fd7f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:14.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:14.901+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7fc054800 con 0x7fd8040b00a0 2024-09-13T18:51:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.077+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8040b3ea0 con 0x7fd8040b00a0 2024-09-13T18:51:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.081+0000 7fd7fa000700 1 -- 172.21.15.81:0/921823221 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7fc054390 con 0x7fd8040b00a0 2024-09-13T18:51:15.091 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:51:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd7e4066730 msgr2=0x7fd7e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd7e4066730 0x7fd7e4068bf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd7f40011e0 tx=0x7fd7f4009040 comp rx=0 tx=0).stop 2024-09-13T18:51:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 msgr2=0x7fd80413b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 0x7fd80413b360 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00ca80 tx=0x7fd7fc00cab0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 shutdown_connections 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd7e4066730 0x7fd7e4068bf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8040b00a0 0x7fd80413b360 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd804144330 0x7fd80413ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 --2- 172.21.15.81:0/921823221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd80406d760 0x7fd8041f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 >> 172.21.15.81:0/921823221 conn(0x7fd80406a570 msgr2=0x7fd80415e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 shutdown_connections 2024-09-13T18:51:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.085+0000 7fd809200700 1 -- 172.21.15.81:0/921823221 wait complete. 2024-09-13T18:51:15.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:51:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 Processor -- start 2024-09-13T18:51:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 -- start start 2024-09-13T18:51:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f480ce4c0 0x7f9f4806a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4806ab10 0x7f9f4806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f480ad480 con 0x7f9f481573b0 2024-09-13T18:51:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4806afa0 con 0x7f9f480ce4c0 2024-09-13T18:51:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48157790 con 0x7f9f4806ab10 2024-09-13T18:51:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4d000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9f481573b0 0x7f9f480cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59772/0 (socket says 172.21.15.81:59772) 2024-09-13T18:51:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4d000700 1 -- 172.21.15.81:0/3428054184 learned_addr learned my addr 172.21.15.81:0/3428054184 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f3fe00700 1 --2- 172.21.15.81:0/3428054184 >> v2:172.21.15.81:3300/0 conn(0x7f9f480ce4c0 0x7f9f4806a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.277+0000 7f9f4da00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4806ab10 0x7f9f4806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f47e00700 1 -- 172.21.15.81:0/3428054184 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088170945 0 0) 0x7f9f480ad480 con 0x7f9f481573b0 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f47e00700 1 -- 172.21.15.81:0/3428054184 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f2c0035d0 con 0x7f9f481573b0 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f3fe00700 1 -- 172.21.15.81:0/3428054184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4806ab10 msgr2=0x7f9f4806ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f3fe00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4806ab10 0x7f9f4806ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f3fe00700 1 -- 172.21.15.81:0/3428054184 >> v1:172.21.15.81:6789/0 conn(0x7f9f481573b0 legacy=0x7f9f480cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f3fe00700 1 -- 172.21.15.81:0/3428054184 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f480ad6d0 con 0x7f9f480ce4c0 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4da00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4806ab10 0x7f9f4806ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f3fe00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f480ce4c0 0x7f9f4806a5d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009850 tx=0x7f9f30009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb55d2931192e4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f47e00700 1 -- 172.21.15.81:0/3428054184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30011830 con 0x7f9f480ce4c0 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f47e00700 1 -- 172.21.15.81:0/3428054184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30011990 con 0x7f9f480ce4c0 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f47e00700 1 -- 172.21.15.81:0/3428054184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f30011d40 con 0x7f9f480ce4c0 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 -- 172.21.15.81:0/3428054184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f480ce4c0 msgr2=0x7f9f4806a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f480ce4c0 0x7f9f4806a5d0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009850 tx=0x7f9f30009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 -- 172.21.15.81:0/3428054184 shutdown_connections 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4806ab10 0x7f9f4806ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/3428054184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f480ce4c0 0x7f9f4806a5d0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 -- 172.21.15.81:0/3428054184 >> 172.21.15.81:0/3428054184 conn(0x7f9f480b08d0 msgr2=0x7f9f480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 -- 172.21.15.81:0/3428054184 shutdown_connections 2024-09-13T18:51:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.281+0000 7f9f4fa00700 1 -- 172.21.15.81:0/3428054184 wait complete. 2024-09-13T18:51:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 Processor -- start 2024-09-13T18:51:15.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 -- start start 2024-09-13T18:51:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 0x7f9f4814f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f480ce4c0 0x7f9f48151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f481573b0 0x7f9f480b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f481f7310 con 0x7f9f4806ab10 2024-09-13T18:51:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48151490 con 0x7f9f481573b0 2024-09-13T18:51:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4fa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f48151770 con 0x7f9f480ce4c0 2024-09-13T18:51:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 0x7f9f4814f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 0x7f9f4814f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43334/0 (socket says 172.21.15.81:43334) 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 -- 172.21.15.81:0/388545145 learned_addr learned my addr 172.21.15.81:0/388545145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f3fe00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f480ce4c0 0x7f9f48151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4da00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f481573b0 0x7f9f480b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 -- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f480ce4c0 msgr2=0x7f9f48151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f480ce4c0 0x7f9f48151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 -- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f481573b0 msgr2=0x7f9f480b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f481573b0 0x7f9f480b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4d000700 1 -- 172.21.15.81:0/388545145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40009a70 con 0x7f9f4806ab10 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.285+0000 7f9f4da00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f481573b0 0x7f9f480b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f4d000700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 0x7f9f4814f600 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c4d0 tx=0x7f9f3800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38005d90 con 0x7f9f4806ab10 2024-09-13T18:51:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f380070d0 con 0x7f9f4806ab10 2024-09-13T18:51:15.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f300094b0 con 0x7f9f4806ab10 2024-09-13T18:51:15.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f38007480 con 0x7f9f4806ab10 2024-09-13T18:51:15.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4814fb40 con 0x7f9f4806ab10 2024-09-13T18:51:15.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.289+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4806a5d0 con 0x7f9f4806ab10 2024-09-13T18:51:15.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.293+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f380075e0 con 0x7f9f4806ab10 2024-09-13T18:51:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.293+0000 7f9f45600700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f24066730 0x7f9f24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.293+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9f380833d0 con 0x7f9f4806ab10 2024-09-13T18:51:15.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.293+0000 7f9f3fe00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f24066730 0x7f9f24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.293+0000 7f9f3fe00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f24066730 0x7f9f24068bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9f300090b0 tx=0x7f9f30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:15.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.301+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f38050960 con 0x7f9f4806ab10 2024-09-13T18:51:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.485+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9f480b0f60 con 0x7f9f4806ab10 2024-09-13T18:51:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.485+0000 7f9f45600700 1 -- 172.21.15.81:0/388545145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9f38053f80 con 0x7f9f4806ab10 2024-09-13T18:51:15.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:15.496 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:51:15.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:51:15.496 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:51:15.496 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:51:15.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:15.496 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:51:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.485+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f24066730 msgr2=0x7f9f24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.485+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f24066730 0x7f9f24068bf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9f300090b0 tx=0x7f9f30008030 comp rx=0 tx=0).stop 2024-09-13T18:51:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 msgr2=0x7f9f4814f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 0x7f9f4814f600 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800c4d0 tx=0x7f9f3800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 shutdown_connections 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f24066730 0x7f9f24068bf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f481573b0 0x7f9f480b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f480ce4c0 0x7f9f48151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 --2- 172.21.15.81:0/388545145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4806ab10 0x7f9f4814f600 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 >> 172.21.15.81:0/388545145 conn(0x7f9f480b08d0 msgr2=0x7f9f4806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 shutdown_connections 2024-09-13T18:51:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.489+0000 7f9f4fa00700 1 -- 172.21.15.81:0/388545145 wait complete. 2024-09-13T18:51:15.519 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:51:15.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:51:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.693+0000 7fe897200700 1 Processor -- start 2024-09-13T18:51:15.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.693+0000 7fe897200700 1 -- start start 2024-09-13T18:51:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe897200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe89015cb40 0x7fe8900b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe897200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8900cfcf0 0x7fe8900b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe897200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8900af700 con 0x7fe8900b25b0 2024-09-13T18:51:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe897200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900b2f60 con 0x7fe89015cb40 2024-09-13T18:51:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe897200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900ce850 con 0x7fe8900cfcf0 2024-09-13T18:51:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe89015cb40 0x7fe8900b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe89015cb40 0x7fe8900b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43342/0 (socket says 172.21.15.81:43342) 2024-09-13T18:51:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 -- 172.21.15.81:0/3363047168 learned_addr learned my addr 172.21.15.81:0/3363047168 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe896800700 1 --2- 172.21.15.81:0/3363047168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8900cfcf0 0x7fe8900b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 -- 172.21.15.81:0/3363047168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8900cfcf0 msgr2=0x7fe8900b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 --2- 172.21.15.81:0/3363047168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8900cfcf0 0x7fe8900b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 -- 172.21.15.81:0/3363047168 >> v1:172.21.15.178:6789/0 conn(0x7fe8900b25b0 legacy=0x7fe8900d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 -- 172.21.15.81:0/3363047168 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89015cf20 con 0x7fe89015cb40 2024-09-13T18:51:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe894a00700 1 -- 172.21.15.81:0/3363047168 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589721959 0 0) 0x7fe8900af700 con 0x7fe8900b25b0 2024-09-13T18:51:15.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe895e00700 1 --2- 172.21.15.81:0/3363047168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89015cb40 0x7fe8900b3920 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe884009910 tx=0x7fe884009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204202bc1a7ba2bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe894a00700 1 -- 172.21.15.81:0/3363047168 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884011830 con 0x7fe89015cb40 2024-09-13T18:51:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe894a00700 1 -- 172.21.15.81:0/3363047168 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884011990 con 0x7fe89015cb40 2024-09-13T18:51:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.697+0000 7fe894a00700 1 -- 172.21.15.81:0/3363047168 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884011d40 con 0x7fe89015cb40 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 -- 172.21.15.81:0/3363047168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89015cb40 msgr2=0x7fe8900b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 --2- 172.21.15.81:0/3363047168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89015cb40 0x7fe8900b3920 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe884009910 tx=0x7fe884009c20 comp rx=0 tx=0).stop 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 -- 172.21.15.81:0/3363047168 shutdown_connections 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 --2- 172.21.15.81:0/3363047168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8900cfcf0 0x7fe8900b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 --2- 172.21.15.81:0/3363047168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe89015cb40 0x7fe8900b3920 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 -- 172.21.15.81:0/3363047168 >> 172.21.15.81:0/3363047168 conn(0x7fe890066270 msgr2=0x7fe890071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 -- 172.21.15.81:0/3363047168 shutdown_connections 2024-09-13T18:51:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 -- 172.21.15.81:0/3363047168 wait complete. 2024-09-13T18:51:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.701+0000 7fe897200700 1 Processor -- start 2024-09-13T18:51:15.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 -- start start 2024-09-13T18:51:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 0x7fe8901f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8900cfcf0 0x7fe89014a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89015cb40 0x7fe89015fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901f31a0 con 0x7fe8900b25b0 2024-09-13T18:51:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901f3440 con 0x7fe8900cfcf0 2024-09-13T18:51:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901f3720 con 0x7fe89015cb40 2024-09-13T18:51:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 0x7fe8901f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 0x7fe8901f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43358/0 (socket says 172.21.15.81:43358) 2024-09-13T18:51:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 -- 172.21.15.81:0/3531529951 learned_addr learned my addr 172.21.15.81:0/3531529951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe896800700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89015cb40 0x7fe89015fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895400700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8900cfcf0 0x7fe89014a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 -- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89015cb40 msgr2=0x7fe89015fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89015cb40 0x7fe89015fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 -- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8900cfcf0 msgr2=0x7fe89014a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8900cfcf0 0x7fe89014a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 -- 172.21.15.81:0/3531529951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884009570 con 0x7fe8900b25b0 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe895e00700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 0x7fe8901f2c60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe8900d1990 tx=0x7fe884004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884004590 con 0x7fe8900b25b0 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88401e070 con 0x7fe8900b25b0 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8901f3a00 con 0x7fe8900b25b0 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884003900 con 0x7fe8900b25b0 2024-09-13T18:51:15.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.705+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89014a950 con 0x7fe8900b25b0 2024-09-13T18:51:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.709+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89006b830 con 0x7fe8900b25b0 2024-09-13T18:51:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.709+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe884003a60 con 0x7fe8900b25b0 2024-09-13T18:51:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.713+0000 7fe88a000700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe874066730 0x7fe874068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.713+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe884020070 con 0x7fe8900b25b0 2024-09-13T18:51:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.713+0000 7fe895400700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe874066730 0x7fe874068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.713+0000 7fe895400700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe874066730 0x7fe874068bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe880000f60 tx=0x7fe880009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:15.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.717+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe884052a50 con 0x7fe8900b25b0 2024-09-13T18:51:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:15.901+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe8900d04d0 con 0x7fe8900b25b0 2024-09-13T18:51:16.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.417+0000 7fe88a000700 1 -- 172.21.15.81:0/3531529951 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe884056070 con 0x7fe8900b25b0 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe874066730 msgr2=0x7fe874068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe874066730 0x7fe874068bf0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe880000f60 tx=0x7fe880009040 comp rx=0 tx=0).stop 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 msgr2=0x7fe8901f2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 0x7fe8901f2c60 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe8900d1990 tx=0x7fe884004770 comp rx=0 tx=0).stop 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 shutdown_connections 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe874066730 0x7fe874068bf0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89015cb40 0x7fe89015fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8900cfcf0 0x7fe89014a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 --2- 172.21.15.81:0/3531529951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8900b25b0 0x7fe8901f2c60 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 >> 172.21.15.81:0/3531529951 conn(0x7fe890066270 msgr2=0x7fe8900d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 shutdown_connections 2024-09-13T18:51:16.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.425+0000 7fe897200700 1 -- 172.21.15.81:0/3531529951 wait complete. 2024-09-13T18:51:16.439 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:51:16.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:51:16.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.629+0000 7f66ff200700 1 Processor -- start 2024-09-13T18:51:16.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.629+0000 7f66ff200700 1 -- start start 2024-09-13T18:51:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.633+0000 7f66ff200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66f813ebc0 0x7f66f806a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.633+0000 7f66ff200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f813fcc0 con 0x7f66f806ab10 2024-09-13T18:51:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.633+0000 7f66ff200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f806af50 con 0x7f66f80705a0 2024-09-13T18:51:16.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.633+0000 7f66ff200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f8070a30 con 0x7f66f813ebc0 2024-09-13T18:51:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.633+0000 7f66f7400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f66f806ab10 0x7f66f806fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35410/0 (socket says 172.21.15.81:35410) 2024-09-13T18:51:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.633+0000 7f66f7400700 1 -- 172.21.15.81:0/300040770 learned_addr learned my addr 172.21.15.81:0/300040770 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f7e00700 1 --2- 172.21.15.81:0/300040770 >> v2:172.21.15.178:3300/0 conn(0x7f66f813ebc0 0x7f66f806a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f6a00700 1 -- 172.21.15.81:0/300040770 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019125621 0 0) 0x7f66f813fcc0 con 0x7f66f806ab10 2024-09-13T18:51:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f6a00700 1 -- 172.21.15.81:0/300040770 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66dc0035d0 con 0x7f66f806ab10 2024-09-13T18:51:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f7e00700 1 -- 172.21.15.81:0/300040770 >> v1:172.21.15.178:6789/0 conn(0x7f66f80705a0 legacy=0x7f66f806bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f7e00700 1 -- 172.21.15.81:0/300040770 >> v1:172.21.15.81:6789/0 conn(0x7f66f806ab10 legacy=0x7f66f806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f7e00700 1 -- 172.21.15.81:0/300040770 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f813f0f0 con 0x7f66f813ebc0 2024-09-13T18:51:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f7e00700 1 --2- 172.21.15.81:0/300040770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f813ebc0 0x7f66f806a5d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009850 tx=0x7f66e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ee9992f791fd1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f6a00700 1 -- 172.21.15.81:0/300040770 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011830 con 0x7f66f813ebc0 2024-09-13T18:51:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f6a00700 1 -- 172.21.15.81:0/300040770 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8011990 con 0x7f66f813ebc0 2024-09-13T18:51:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66f6a00700 1 -- 172.21.15.81:0/300040770 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011d00 con 0x7f66f813ebc0 2024-09-13T18:51:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 -- 172.21.15.81:0/300040770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f813ebc0 msgr2=0x7f66f806a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 --2- 172.21.15.81:0/300040770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f813ebc0 0x7f66f806a5d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009850 tx=0x7f66e8009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 -- 172.21.15.81:0/300040770 shutdown_connections 2024-09-13T18:51:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 --2- 172.21.15.81:0/300040770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f813ebc0 0x7f66f806a5d0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 -- 172.21.15.81:0/300040770 >> 172.21.15.81:0/300040770 conn(0x7f66f80b08d0 msgr2=0x7f66f80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 -- 172.21.15.81:0/300040770 shutdown_connections 2024-09-13T18:51:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.637+0000 7f66ff200700 1 -- 172.21.15.81:0/300040770 wait complete. 2024-09-13T18:51:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 Processor -- start 2024-09-13T18:51:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 -- start start 2024-09-13T18:51:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 0x7f66f81545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f80705a0 0x7f66f8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66f813ebc0 0x7f66f81329a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80cf1d0 con 0x7f66f806ab10 2024-09-13T18:51:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8152050 con 0x7f66f80705a0 2024-09-13T18:51:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66ff200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80cec10 con 0x7f66f813ebc0 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 0x7f66f81545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 0x7f66f81545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52908/0 (socket says 172.21.15.81:52908) 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 -- 172.21.15.81:0/2896987499 learned_addr learned my addr 172.21.15.81:0/2896987499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7400700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f80705a0 0x7f66f8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66fd200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66f813ebc0 0x7f66f81329a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 -- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66f813ebc0 msgr2=0x7f66f81329a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66f813ebc0 0x7f66f81329a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 -- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f80705a0 msgr2=0x7f66f8154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f80705a0 0x7f66f8154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 -- 172.21.15.81:0/2896987499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e80094b0 con 0x7f66f806ab10 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7400700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f80705a0 0x7f66f8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.641+0000 7f66f7e00700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 0x7f66f81545a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f66e80090b0 tx=0x7f66e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:16.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.645+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80036c0 con 0x7f66f806ab10 2024-09-13T18:51:16.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.645+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e801f070 con 0x7f66f806ab10 2024-09-13T18:51:16.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.645+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8003a80 con 0x7f66f806ab10 2024-09-13T18:51:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.645+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f80ceef0 con 0x7f66f806ab10 2024-09-13T18:51:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.645+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f813c4c0 con 0x7f66f806ab10 2024-09-13T18:51:16.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.645+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f813c710 con 0x7f66f806ab10 2024-09-13T18:51:16.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.649+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f66e8003be0 con 0x7f66f806ab10 2024-09-13T18:51:16.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.653+0000 7f66efe00700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66d8066760 0x7f66d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:16.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.653+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f66e8021070 con 0x7f66f806ab10 2024-09-13T18:51:16.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.653+0000 7f66f7400700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66d8066760 0x7f66d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.653+0000 7f66f7400700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66d8066760 0x7f66d8068c20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f66f8133a80 tx=0x7f66e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:16.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.657+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f66e8053060 con 0x7f66f806ab10 2024-09-13T18:51:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:16.833+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f66f806a5d0 con 0x7f66f806ab10 2024-09-13T18:51:17.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.437+0000 7f66efe00700 1 -- 172.21.15.81:0/2896987499 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f66e80150d0 con 0x7f66f806ab10 2024-09-13T18:51:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66d8066760 msgr2=0x7f66d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66d8066760 0x7f66d8068c20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f66f8133a80 tx=0x7f66e4009040 comp rx=0 tx=0).stop 2024-09-13T18:51:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 msgr2=0x7f66f81545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 0x7f66f81545a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f66e80090b0 tx=0x7f66e8004770 comp rx=0 tx=0).stop 2024-09-13T18:51:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 shutdown_connections 2024-09-13T18:51:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f66d8066760 0x7f66d8068c20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66f813ebc0 0x7f66f81329a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66f80705a0 0x7f66f8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 --2- 172.21.15.81:0/2896987499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66f806ab10 0x7f66f81545a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.445+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 >> 172.21.15.81:0/2896987499 conn(0x7f66f80b08d0 msgr2=0x7f66f815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:17.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.449+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 shutdown_connections 2024-09-13T18:51:17.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.449+0000 7f66ff200700 1 -- 172.21.15.81:0/2896987499 wait complete. 2024-09-13T18:51:17.465 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:51:17.485 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:51:17.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 Processor -- start 2024-09-13T18:51:17.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 -- start start 2024-09-13T18:51:17.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c0415a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:17.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1c0415a6b0 0x7f1c04070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0415df90 con 0x7f1c040ce280 2024-09-13T18:51:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c0415e420 con 0x7f1c0415a6b0 2024-09-13T18:51:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.645+0000 7f1c0c200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415aea0 con 0x7f1c040cf3b0 2024-09-13T18:51:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1c0415a6b0 0x7f1c04070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1c0415a6b0 0x7f1c04070ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:53102/0 (socket says 172.21.15.81:53102) 2024-09-13T18:51:17.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 -- 172.21.15.81:0/599383059 learned_addr learned my addr 172.21.15.81:0/599383059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c08e00700 1 --2- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c0415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 -- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 msgr2=0x7f1c0415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 --2- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c0415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 -- 172.21.15.81:0/599383059 >> v1:172.21.15.178:6789/0 conn(0x7f1c040ce280 legacy=0x7f1c040ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 -- 172.21.15.81:0/599383059 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0415d660 con 0x7f1c0415a6b0 2024-09-13T18:51:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0a200700 1 --2- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c0415a6b0 0x7f1c04070ca0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009e50 tx=0x7f1bfc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81bbe01b23fee96c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:17.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c03e00700 1 -- 172.21.15.81:0/599383059 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00e070 con 0x7f1c0415a6b0 2024-09-13T18:51:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c03e00700 1 -- 172.21.15.81:0/599383059 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00b910 con 0x7f1c0415a6b0 2024-09-13T18:51:17.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c03e00700 1 -- 172.21.15.81:0/599383059 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00bcc0 con 0x7f1c0415a6b0 2024-09-13T18:51:17.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0c200700 1 -- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c0415a6b0 msgr2=0x7f1c04070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.649+0000 7f1c0c200700 1 --2- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c0415a6b0 0x7f1c04070ca0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009e50 tx=0x7f1bfc00b330 comp rx=0 tx=0).stop 2024-09-13T18:51:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 -- 172.21.15.81:0/599383059 shutdown_connections 2024-09-13T18:51:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 --2- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c0415a6b0 0x7f1c04070ca0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 --2- 172.21.15.81:0/599383059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c0415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 -- 172.21.15.81:0/599383059 >> 172.21.15.81:0/599383059 conn(0x7f1c0406a570 msgr2=0x7f1c0406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 -- 172.21.15.81:0/599383059 shutdown_connections 2024-09-13T18:51:17.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 -- 172.21.15.81:0/599383059 wait complete. 2024-09-13T18:51:17.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 Processor -- start 2024-09-13T18:51:17.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.653+0000 7f1c0c200700 1 -- start start 2024-09-13T18:51:17.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c040ce280 0x7f1c041f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:17.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c040cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:17.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 0x7f1c040b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c040cce80 con 0x7f1c0415a6b0 2024-09-13T18:51:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0415bd10 con 0x7f1c040ce280 2024-09-13T18:51:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c041524c0 con 0x7f1c040cf3b0 2024-09-13T18:51:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 0x7f1c040b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 0x7f1c040b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52914/0 (socket says 172.21.15.81:52914) 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0a200700 1 -- 172.21.15.81:0/1413762131 learned_addr learned my addr 172.21.15.81:0/1413762131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c040ce280 0x7f1c041f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c08e00700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c040cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 -- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 msgr2=0x7f1c040cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c040cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 -- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 msgr2=0x7f1c040b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 0x7f1c040b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 -- 172.21.15.81:0/1413762131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc009b30 con 0x7f1c040ce280 2024-09-13T18:51:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0a200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 0x7f1c040b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c09800700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c040ce280 0x7f1c041f2410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c410 tx=0x7f1bf8001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80052d0 con 0x7f1c040ce280 2024-09-13T18:51:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8005430 con 0x7f1c040ce280 2024-09-13T18:51:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c040cc300 con 0x7f1c040ce280 2024-09-13T18:51:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80055a0 con 0x7f1c040ce280 2024-09-13T18:51:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.657+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c040ccba0 con 0x7f1c040ce280 2024-09-13T18:51:17.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.661+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c04152680 con 0x7f1c040ce280 2024-09-13T18:51:17.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.661+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1bf80038e0 con 0x7f1c040ce280 2024-09-13T18:51:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.665+0000 7f1c01600700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1be4066730 0x7f1be4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.665+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f1bf8083490 con 0x7f1c040ce280 2024-09-13T18:51:17.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.665+0000 7f1c08e00700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1be4066730 0x7f1be4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:17.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.665+0000 7f1c08e00700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1be4066730 0x7f1be4068bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1c041f6ac0 tx=0x7f1bf0009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:17.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.673+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1bf8050720 con 0x7f1c040ce280 2024-09-13T18:51:17.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.889+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1c0415aac0 con 0x7f1c040ce280 2024-09-13T18:51:17.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.909+0000 7f1c01600700 1 -- 172.21.15.81:0/1413762131 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v48) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1bf8053d40 con 0x7f1c040ce280 2024-09-13T18:51:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.913+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1be4066730 msgr2=0x7f1be4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.913+0000 7f1c0c200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1be4066730 0x7f1be4068bf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1c041f6ac0 tx=0x7f1bf0009240 comp rx=0 tx=0).stop 2024-09-13T18:51:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.913+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c040ce280 msgr2=0x7f1c041f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.913+0000 7f1c0c200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c040ce280 0x7f1c041f2410 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c410 tx=0x7f1bf8001e70 comp rx=0 tx=0).stop 2024-09-13T18:51:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.917+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 shutdown_connections 2024-09-13T18:51:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.917+0000 7f1c0c200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1be4066730 0x7f1be4068bf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.917+0000 7f1c0c200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c0415a6b0 0x7f1c040b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.917+0000 7f1c0c200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c040cf3b0 0x7f1c040cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.917+0000 7f1c0c200700 1 --2- 172.21.15.81:0/1413762131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c040ce280 0x7f1c041f2410 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:17.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.917+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 >> 172.21.15.81:0/1413762131 conn(0x7f1c0406a570 msgr2=0x7f1c04158980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:17.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.921+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 shutdown_connections 2024-09-13T18:51:17.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:17.921+0000 7f1c0c200700 1 -- 172.21.15.81:0/1413762131 wait complete. 2024-09-13T18:51:17.939 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 9 and data pool 10 2024-09-13T18:51:17.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:18.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.109+0000 7fb364000700 1 Processor -- start 2024-09-13T18:51:18.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.109+0000 7fb364000700 1 -- start start 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.109+0000 7fb364000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb35c0b19f0 0x7fb35c06ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.109+0000 7fb364000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c0ce140 con 0x7fb35c071d20 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.109+0000 7fb364000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c0b1e40 con 0x7fb35c06a5d0 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.109+0000 7fb364000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0cde60 con 0x7fb35c0b19f0 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb35c0b19f0 0x7fb35c06ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb35c0b19f0 0x7fb35c06ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52918/0 (socket says 172.21.15.81:52918) 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 -- 172.21.15.81:0/2767238231 learned_addr learned my addr 172.21.15.81:0/2767238231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 -- 172.21.15.81:0/2767238231 >> v1:172.21.15.178:6789/0 conn(0x7fb35c06a5d0 legacy=0x7fb35c06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 -- 172.21.15.81:0/2767238231 >> v1:172.21.15.81:6789/0 conn(0x7fb35c071d20 legacy=0x7fb35c0cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 -- 172.21.15.81:0/2767238231 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c06c3b0 con 0x7fb35c0b19f0 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb362000700 1 --2- 172.21.15.81:0/2767238231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c0b19f0 0x7fb35c06ce90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb354009e50 tx=0x7fb35400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10827809895938c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb35be00700 1 -- 172.21.15.81:0/2767238231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400e070 con 0x7fb35c0b19f0 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb35be00700 1 -- 172.21.15.81:0/2767238231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354003a40 con 0x7fb35c0b19f0 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb35be00700 1 -- 172.21.15.81:0/2767238231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354003df0 con 0x7fb35c0b19f0 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 -- 172.21.15.81:0/2767238231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c0b19f0 msgr2=0x7fb35c06ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 --2- 172.21.15.81:0/2767238231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c0b19f0 0x7fb35c06ce90 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb354009e50 tx=0x7fb35400b330 comp rx=0 tx=0).stop 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 -- 172.21.15.81:0/2767238231 shutdown_connections 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 --2- 172.21.15.81:0/2767238231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c0b19f0 0x7fb35c06ce90 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 -- 172.21.15.81:0/2767238231 >> 172.21.15.81:0/2767238231 conn(0x7fb35c0b08d0 msgr2=0x7fb35c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 -- 172.21.15.81:0/2767238231 shutdown_connections 2024-09-13T18:51:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.113+0000 7fb364000700 1 -- 172.21.15.81:0/2767238231 wait complete. 2024-09-13T18:51:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 Processor -- start 2024-09-13T18:51:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 -- start start 2024-09-13T18:51:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb35c06a5d0 0x7fb35c145c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 0x7fb35c160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35c0b19f0 0x7fb35c1ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c160ed0 con 0x7fb35c071d20 2024-09-13T18:51:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c1462d0 con 0x7fb35c0b19f0 2024-09-13T18:51:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb364000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c1465b0 con 0x7fb35c06a5d0 2024-09-13T18:51:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb360c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 0x7fb35c160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb360c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 0x7fb35c160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52930/0 (socket says 172.21.15.81:52930) 2024-09-13T18:51:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.117+0000 7fb360c00700 1 -- 172.21.15.81:0/3894483592 learned_addr learned my addr 172.21.15.81:0/3894483592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb361600700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb35c06a5d0 0x7fb35c145c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb362000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35c0b19f0 0x7fb35c1ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb360c00700 1 -- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb35c06a5d0 msgr2=0x7fb35c145c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb360c00700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb35c06a5d0 0x7fb35c145c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb360c00700 1 -- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35c0b19f0 msgr2=0x7fb35c1ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb360c00700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35c0b19f0 0x7fb35c1ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb360c00700 1 -- 172.21.15.81:0/3894483592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009b30 con 0x7fb35c071d20 2024-09-13T18:51:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb360c00700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 0x7fb35c160990 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c500 tx=0x7fb34800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480052d0 con 0x7fb35c071d20 2024-09-13T18:51:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348005430 con 0x7fb35c071d20 2024-09-13T18:51:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3480055a0 con 0x7fb35c071d20 2024-09-13T18:51:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c146890 con 0x7fb35c071d20 2024-09-13T18:51:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c146e50 con 0x7fb35c071d20 2024-09-13T18:51:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.121+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c0709a0 con 0x7fb35c071d20 2024-09-13T18:51:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.125+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb3480036a0 con 0x7fb35c071d20 2024-09-13T18:51:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.125+0000 7fb359600700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb33c066730 0x7fb33c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.125+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb348083500 con 0x7fb35c071d20 2024-09-13T18:51:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.125+0000 7fb361600700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb33c066730 0x7fb33c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.129+0000 7fb361600700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb33c066730 0x7fb33c068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb3500012b0 tx=0x7fb350001240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.133+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb348050690 con 0x7fb35c071d20 2024-09-13T18:51:18.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.321+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35c1623f0 con 0x7fb35c071d20 2024-09-13T18:51:18.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.325+0000 7fb359600700 1 -- 172.21.15.81:0/3894483592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16729 (secure 0 0 0) 0x7fb348053cb0 con 0x7fb35c071d20 2024-09-13T18:51:18.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:18.336 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:51:17.897968+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.325+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb33c066730 msgr2=0x7fb33c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.325+0000 7fb364000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb33c066730 0x7fb33c068bf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb3500012b0 tx=0x7fb350001240 comp rx=0 tx=0).stop 2024-09-13T18:51:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.325+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 msgr2=0x7fb35c160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.325+0000 7fb364000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 0x7fb35c160990 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c500 tx=0x7fb34800c810 comp rx=0 tx=0).stop 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 shutdown_connections 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb33c066730 0x7fb33c068bf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb35c0b19f0 0x7fb35c1ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c071d20 0x7fb35c160990 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 --2- 172.21.15.81:0/3894483592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb35c06a5d0 0x7fb35c145c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 >> 172.21.15.81:0/3894483592 conn(0x7fb35c0b08d0 msgr2=0x7fb35c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 shutdown_connections 2024-09-13T18:51:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.329+0000 7fb364000700 1 -- 172.21.15.81:0/3894483592 wait complete. 2024-09-13T18:51:18.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.517+0000 7f324ea00700 1 Processor -- start 2024-09-13T18:51:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.517+0000 7f324ea00700 1 -- start start 2024-09-13T18:51:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f324806a5d0 0x7f3248071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32480cd610 0x7f324806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480ce140 con 0x7f32480b19f0 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480b1e60 con 0x7f32480cd610 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480cde60 con 0x7f324806a5d0 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32480cd610 0x7f324806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f32480cd610 0x7f324806ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52942/0 (socket says 172.21.15.81:52942) 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 -- 172.21.15.81:0/1425198622 learned_addr learned my addr 172.21.15.81:0/1425198622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f3247e00700 1 --2- 172.21.15.81:0/1425198622 >> v2:172.21.15.178:3300/0 conn(0x7f324806a5d0 0x7f3248071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 -- 172.21.15.81:0/1425198622 >> v2:172.21.15.178:3300/0 conn(0x7f324806a5d0 msgr2=0x7f3248071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 --2- 172.21.15.81:0/1425198622 >> v2:172.21.15.178:3300/0 conn(0x7f324806a5d0 0x7f3248071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 -- 172.21.15.81:0/1425198622 >> v1:172.21.15.81:6789/0 conn(0x7f32480b19f0 legacy=0x7f324806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 -- 172.21.15.81:0/1425198622 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324806c3b0 con 0x7f32480cd610 2024-09-13T18:51:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ca00700 1 --2- 172.21.15.81:0/1425198622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480cd610 0x7f324806ce90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f32480cc4e0 tx=0x7f324000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c589a7f48adaf26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f3246a00700 1 -- 172.21.15.81:0/1425198622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000e070 con 0x7f32480cd610 2024-09-13T18:51:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f3246a00700 1 -- 172.21.15.81:0/1425198622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324000b9c0 con 0x7f32480cd610 2024-09-13T18:51:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f3246a00700 1 -- 172.21.15.81:0/1425198622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000bd70 con 0x7f32480cd610 2024-09-13T18:51:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- 172.21.15.81:0/1425198622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480cd610 msgr2=0x7f324806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 --2- 172.21.15.81:0/1425198622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480cd610 0x7f324806ce90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f32480cc4e0 tx=0x7f324000b330 comp rx=0 tx=0).stop 2024-09-13T18:51:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- 172.21.15.81:0/1425198622 shutdown_connections 2024-09-13T18:51:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 --2- 172.21.15.81:0/1425198622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480cd610 0x7f324806ce90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 --2- 172.21.15.81:0/1425198622 >> v2:172.21.15.178:3300/0 conn(0x7f324806a5d0 0x7f3248071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- 172.21.15.81:0/1425198622 >> 172.21.15.81:0/1425198622 conn(0x7f32480b08d0 msgr2=0x7f32480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- 172.21.15.81:0/1425198622 shutdown_connections 2024-09-13T18:51:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.521+0000 7f324ea00700 1 -- 172.21.15.81:0/1425198622 wait complete. 2024-09-13T18:51:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.525+0000 7f324ea00700 1 Processor -- start 2024-09-13T18:51:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.525+0000 7f324ea00700 1 -- start start 2024-09-13T18:51:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.525+0000 7f324ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324806a5d0 0x7f324813e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 0x7f32480b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32480cd610 0x7f32480b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248145a50 con 0x7f32480b19f0 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32481451b0 con 0x7f32480cd610 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3248145490 con 0x7f324806a5d0 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 0x7f32480b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 0x7f32480b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52956/0 (socket says 172.21.15.81:52956) 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 -- 172.21.15.81:0/2984471551 learned_addr learned my addr 172.21.15.81:0/2984471551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247e00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324806a5d0 0x7f324813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ca00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32480cd610 0x7f32480b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 -- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324806a5d0 msgr2=0x7f324813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324806a5d0 0x7f324813e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 -- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32480cd610 msgr2=0x7f32480b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32480cd610 0x7f32480b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 -- 172.21.15.81:0/2984471551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3240009b30 con 0x7f32480b19f0 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f3247400700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 0x7f32480b2030 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f323400c500 tx=0x7f323400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340052d0 con 0x7f32480b19f0 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234005430 con 0x7f32480b19f0 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32340055a0 con 0x7f32480b19f0 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3248145770 con 0x7f32480b19f0 2024-09-13T18:51:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3248144430 con 0x7f32480b19f0 2024-09-13T18:51:18.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.529+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3248140540 con 0x7f32480b19f0 2024-09-13T18:51:18.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.533+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32340038e0 con 0x7f32480b19f0 2024-09-13T18:51:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.533+0000 7f323fe00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3228066730 0x7f3228068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.533+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f32340836f0 con 0x7f32480b19f0 2024-09-13T18:51:18.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.533+0000 7f3247e00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3228066730 0x7f3228068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.537+0000 7f3247e00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3228066730 0x7f3228068bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3238007a60 tx=0x7f3238008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.541+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3248140540 con 0x7f32480b19f0 2024-09-13T18:51:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.733+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3248140540 con 0x7f32480b19f0 2024-09-13T18:51:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.733+0000 7f323fe00700 1 -- 172.21.15.81:0/2984471551 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f3248140540 con 0x7f32480b19f0 2024-09-13T18:51:18.746 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:18.746 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":66,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:51:17.897968+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.737+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3228066730 msgr2=0x7f3228068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.737+0000 7f324ea00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3228066730 0x7f3228068bf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3238007a60 tx=0x7f3238008040 comp rx=0 tx=0).stop 2024-09-13T18:51:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.737+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 msgr2=0x7f32480b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.737+0000 7f324ea00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 0x7f32480b2030 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f323400c500 tx=0x7f323400c810 comp rx=0 tx=0).stop 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 shutdown_connections 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3228066730 0x7f3228068bf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32480cd610 0x7f32480b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32480b19f0 0x7f32480b2030 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 --2- 172.21.15.81:0/2984471551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324806a5d0 0x7f324813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 >> 172.21.15.81:0/2984471551 conn(0x7f32480b08d0 msgr2=0x7f32480b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 shutdown_connections 2024-09-13T18:51:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.741+0000 7f324ea00700 1 -- 172.21.15.81:0/2984471551 wait complete. 2024-09-13T18:51:18.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:51:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 Processor -- start 2024-09-13T18:51:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 -- start start 2024-09-13T18:51:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcfa415ca20 0x7fcfa415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcfa406ada0 0x7fcfa406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa406b770 con 0x7fcfa415ca20 2024-09-13T18:51:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa4160680 con 0x7fcfa406ada0 2024-09-13T18:51:18.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415d670 con 0x7fcfa406cd80 2024-09-13T18:51:18.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcfa415ca20 0x7fcfa415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcfa415ca20 0x7fcfa415ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52970/0 (socket says 172.21.15.81:52970) 2024-09-13T18:51:18.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2459455978 learned_addr learned my addr 172.21.15.81:0/2459455978 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:18.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.925+0000 7fcfa3400700 1 --2- 172.21.15.81:0/2459455978 >> v2:172.21.15.178:3300/0 conn(0x7fcfa406ada0 0x7fcfa406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2000700 1 --2- 172.21.15.81:0/2459455978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2459455978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 msgr2=0x7fcfa40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2a00700 1 --2- 172.21.15.81:0/2459455978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2459455978 >> v2:172.21.15.178:3300/0 conn(0x7fcfa406ada0 msgr2=0x7fcfa406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2a00700 1 --2- 172.21.15.81:0/2459455978 >> v2:172.21.15.178:3300/0 conn(0x7fcfa406ada0 0x7fcfa406b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2459455978 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa415d950 con 0x7fcfa415ca20 2024-09-13T18:51:18.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3400700 1 --2- 172.21.15.81:0/2459455978 >> v2:172.21.15.178:3300/0 conn(0x7fcfa406ada0 0x7fcfa406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:18.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa2a00700 1 --2- 172.21.15.81:0/2459455978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa415ca20 0x7fcfa415ce00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40b42a0 tx=0x7fcf94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5338c6a39c1071b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa1600700 1 -- 172.21.15.81:0/2459455978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011830 con 0x7fcfa415ca20 2024-09-13T18:51:18.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa1600700 1 -- 172.21.15.81:0/2459455978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf94011990 con 0x7fcfa415ca20 2024-09-13T18:51:18.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa1600700 1 -- 172.21.15.81:0/2459455978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94011d20 con 0x7fcfa415ca20 2024-09-13T18:51:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2459455978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa415ca20 msgr2=0x7fcfa415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2459455978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa415ca20 0x7fcfa415ce00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40b42a0 tx=0x7fcf94009bf0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2459455978 shutdown_connections 2024-09-13T18:51:18.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2459455978 >> v2:172.21.15.178:3300/0 conn(0x7fcfa406ada0 0x7fcfa406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2459455978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2459455978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa415ca20 0x7fcfa415ce00 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2459455978 >> 172.21.15.81:0/2459455978 conn(0x7fcfa4071d20 msgr2=0x7fcfa4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2459455978 shutdown_connections 2024-09-13T18:51:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.929+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2459455978 wait complete. 2024-09-13T18:51:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.933+0000 7fcfa3e00700 1 Processor -- start 2024-09-13T18:51:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.933+0000 7fcfa3e00700 1 -- start start 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 0x7fcfa41514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa415ca20 0x7fcfa4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40ce450 con 0x7fcfa406ada0 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40ce6c0 con 0x7fcfa415ca20 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40ce9a0 con 0x7fcfa406cd80 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 0x7fcfa41514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 0x7fcfa41514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52982/0 (socket says 172.21.15.81:52982) 2024-09-13T18:51:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2892898252 learned_addr learned my addr 172.21.15.81:0/2892898252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:18.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2000700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3400700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa415ca20 0x7fcfa4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 msgr2=0x7fcfa40cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa415ca20 msgr2=0x7fcfa4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa415ca20 0x7fcfa4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 -- 172.21.15.81:0/2892898252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009a70 con 0x7fcfa406ada0 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2000700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3400700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa415ca20 0x7fcfa4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa2a00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 0x7fcfa41514d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fcf94000c00 tx=0x7fcf94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940044d0 con 0x7fcfa406ada0 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940036c0 con 0x7fcfa406ada0 2024-09-13T18:51:18.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf94009570 con 0x7fcfa406ada0 2024-09-13T18:51:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94003a70 con 0x7fcfa406ada0 2024-09-13T18:51:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa40cef60 con 0x7fcfa406ada0 2024-09-13T18:51:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.937+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa406d1c0 con 0x7fcfa406ada0 2024-09-13T18:51:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.941+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf94003bd0 con 0x7fcfa406ada0 2024-09-13T18:51:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.941+0000 7fcf9b400700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf84066730 0x7fcf84068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:18.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.941+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf94021030 con 0x7fcfa406ada0 2024-09-13T18:51:18.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.945+0000 7fcfa2000700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf84066730 0x7fcf84068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:18.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.945+0000 7fcfa2000700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf84066730 0x7fcf84068bf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40b59e0 tx=0x7fcf90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:18.949+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf94052b40 con 0x7fcfa406ada0 2024-09-13T18:51:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.165+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcfa4158c50 con 0x7fcfa406ada0 2024-09-13T18:51:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.921+0000 7fcf9b400700 1 -- 172.21.15.81:0/2892898252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf9402b0b0 con 0x7fcfa406ada0 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf84066730 msgr2=0x7fcf84068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf84066730 0x7fcf84068bf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcfa40b59e0 tx=0x7fcf90008040 comp rx=0 tx=0).stop 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 msgr2=0x7fcfa41514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 0x7fcfa41514d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fcf94000c00 tx=0x7fcf94004770 comp rx=0 tx=0).stop 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 shutdown_connections 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf84066730 0x7fcf84068bf0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa415ca20 0x7fcfa4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa406cd80 0x7fcfa40cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 --2- 172.21.15.81:0/2892898252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfa406ada0 0x7fcfa41514d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 >> 172.21.15.81:0/2892898252 conn(0x7fcfa4071d20 msgr2=0x7fcfa415b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 shutdown_connections 2024-09-13T18:51:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:19.925+0000 7fcfa3e00700 1 -- 172.21.15.81:0/2892898252 wait complete. 2024-09-13T18:51:19.963 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:51:19.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:51:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.129+0000 7f42a8c00700 1 Processor -- start 2024-09-13T18:51:20.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.129+0000 7f42a8c00700 1 -- start start 2024-09-13T18:51:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a8c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42a406c960 0x7f42a406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a8c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40cd730 0x7f42a40cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a8c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a406d2f0 con 0x7f42a4159920 2024-09-13T18:51:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a8c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40cd2a0 con 0x7f42a406c960 2024-09-13T18:51:20.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a8c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40ccc90 con 0x7f42a40cd730 2024-09-13T18:51:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f429be00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42a406c960 0x7f42a406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40cd730 0x7f42a40cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a3400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f42a4159920 0x7f42a40b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:58212/0 (socket says 172.21.15.81:58212) 2024-09-13T18:51:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.133+0000 7f42a3400700 1 -- 172.21.15.81:0/1705795409 learned_addr learned my addr 172.21.15.81:0/1705795409 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a2a00700 1 -- 172.21.15.81:0/1705795409 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559843505 0 0) 0x7f4294001110 con 0x7f42a4159920 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a2a00700 1 -- 172.21.15.81:0/1705795409 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42880057e0 con 0x7f42a4159920 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a3e00700 1 -- 172.21.15.81:0/1705795409 >> v2:172.21.15.178:3300/0 conn(0x7f42a406c960 msgr2=0x7f42a406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a3e00700 1 --2- 172.21.15.81:0/1705795409 >> v2:172.21.15.178:3300/0 conn(0x7f42a406c960 0x7f42a406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a3e00700 1 -- 172.21.15.81:0/1705795409 >> v1:172.21.15.178:6789/0 conn(0x7f42a4159920 legacy=0x7f42a40b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a3e00700 1 -- 172.21.15.81:0/1705795409 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40b3580 con 0x7f42a40cd730 2024-09-13T18:51:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f429be00700 1 --2- 172.21.15.81:0/1705795409 >> v2:172.21.15.178:3300/0 conn(0x7f42a406c960 0x7f42a406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a3e00700 1 --2- 172.21.15.81:0/1705795409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40cd730 0x7f42a40cdb80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f429c009d90 tx=0x7f429c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b3393d98191c965 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a2a00700 1 -- 172.21.15.81:0/1705795409 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00e070 con 0x7f42a40cd730 2024-09-13T18:51:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a2a00700 1 -- 172.21.15.81:0/1705795409 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00bb20 con 0x7f42a40cd730 2024-09-13T18:51:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a2a00700 1 -- 172.21.15.81:0/1705795409 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c012430 con 0x7f42a40cd730 2024-09-13T18:51:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 -- 172.21.15.81:0/1705795409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40cd730 msgr2=0x7f42a40cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 --2- 172.21.15.81:0/1705795409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40cd730 0x7f42a40cdb80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f429c009d90 tx=0x7f429c00b330 comp rx=0 tx=0).stop 2024-09-13T18:51:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 -- 172.21.15.81:0/1705795409 shutdown_connections 2024-09-13T18:51:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 --2- 172.21.15.81:0/1705795409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a40cd730 0x7f42a40cdb80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 --2- 172.21.15.81:0/1705795409 >> v2:172.21.15.178:3300/0 conn(0x7f42a406c960 0x7f42a406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 -- 172.21.15.81:0/1705795409 >> 172.21.15.81:0/1705795409 conn(0x7f42a406a390 msgr2=0x7f42a406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:20.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 -- 172.21.15.81:0/1705795409 shutdown_connections 2024-09-13T18:51:20.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.137+0000 7f42a8c00700 1 -- 172.21.15.81:0/1705795409 wait complete. 2024-09-13T18:51:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.141+0000 7f42a8c00700 1 Processor -- start 2024-09-13T18:51:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.141+0000 7f42a8c00700 1 -- start start 2024-09-13T18:51:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.141+0000 7f42a8c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 0x7f42a4140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40cd730 0x7f42a41409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a414a510 0x7f42a414f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41517e0 con 0x7f42a414a510 2024-09-13T18:51:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41407a0 con 0x7f42a40cd730 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a4140f30 con 0x7f42a406c960 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 0x7f42a4140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 0x7f42a4140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:58836/0 (socket says 172.21.15.81:58836) 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a414a510 0x7f42a414f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 -- 172.21.15.81:0/2801596300 learned_addr learned my addr 172.21.15.81:0/2801596300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f429be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40cd730 0x7f42a41409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 -- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40cd730 msgr2=0x7f42a41409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40cd730 0x7f42a41409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 -- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a414a510 msgr2=0x7f42a414f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a414a510 0x7f42a414f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 -- 172.21.15.81:0/2801596300 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0094b0 con 0x7f42a406c960 2024-09-13T18:51:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3e00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a414a510 0x7f42a414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a3400700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 0x7f42a4140260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4294001270 tx=0x7f429400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294005d90 con 0x7f42a406c960 2024-09-13T18:51:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42940070d0 con 0x7f42a406c960 2024-09-13T18:51:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c009a70 con 0x7f42a406c960 2024-09-13T18:51:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294007480 con 0x7f42a406c960 2024-09-13T18:51:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.145+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a4150210 con 0x7f42a406c960 2024-09-13T18:51:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.149+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a406d760 con 0x7f42a406c960 2024-09-13T18:51:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.149+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42940075e0 con 0x7f42a406c960 2024-09-13T18:51:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.149+0000 7f429b400700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4280066730 0x7f4280068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.149+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f42940835e0 con 0x7f42a406c960 2024-09-13T18:51:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.149+0000 7f429be00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4280066730 0x7f4280068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.153+0000 7f429be00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4280066730 0x7f4280068bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f42a4070d60 tx=0x7f428c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.161+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4294050770 con 0x7f42a406c960 2024-09-13T18:51:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.377+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42a406d2f0 con 0x7f42a406c960 2024-09-13T18:51:20.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.929+0000 7f429b400700 1 -- 172.21.15.81:0/2801596300 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42a406d2f0 con 0x7f42a406c960 2024-09-13T18:51:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4280066730 msgr2=0x7f4280068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4280066730 0x7f4280068bf0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f42a4070d60 tx=0x7f428c009240 comp rx=0 tx=0).stop 2024-09-13T18:51:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 msgr2=0x7f42a4140260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 0x7f42a4140260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4294001270 tx=0x7f429400c7d0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 shutdown_connections 2024-09-13T18:51:20.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4280066730 0x7f4280068bf0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a414a510 0x7f42a414f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a40cd730 0x7f42a41409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 --2- 172.21.15.81:0/2801596300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a406c960 0x7f42a4140260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:20.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 >> 172.21.15.81:0/2801596300 conn(0x7f42a406a390 msgr2=0x7f42a4157140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:20.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 shutdown_connections 2024-09-13T18:51:20.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:20.933+0000 7f42a8c00700 1 -- 172.21.15.81:0/2801596300 wait complete. 2024-09-13T18:51:20.969 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:51:20.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:21.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.125+0000 7f7b6be00700 1 Processor -- start 2024-09-13T18:51:21.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.125+0000 7f7b6be00700 1 -- start start 2024-09-13T18:51:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 0x7f7b6c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0b3560 con 0x7f7b6c1610b0 2024-09-13T18:51:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0b3280 con 0x7f7b6c06aaa0 2024-09-13T18:51:21.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c070b30 con 0x7f7b6c0b2d80 2024-09-13T18:51:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7b6c1610b0 0x7f7b6c0719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35434/0 (socket says 172.21.15.81:35434) 2024-09-13T18:51:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6aa00700 1 -- 172.21.15.81:0/1821765964 learned_addr learned my addr 172.21.15.81:0/1821765964 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6b400700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 0x7f7b6c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822005024 0 0) 0x7f7b6c0b3560 con 0x7f7b6c1610b0 2024-09-13T18:51:21.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b500035d0 con 0x7f7b6c1610b0 2024-09-13T18:51:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3601980602 0 0) 0x7f7b500035d0 con 0x7f7b6c1610b0 2024-09-13T18:51:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 msgr2=0x7f7b6c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 0x7f7b6c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 >> v1:172.21.15.178:6789/0 conn(0x7f7b6c06aaa0 legacy=0x7f7b6c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c070ee0 con 0x7f7b6c1610b0 2024-09-13T18:51:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f7b5c001670 con 0x7f7b6c1610b0 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 >> v1:172.21.15.81:6789/0 conn(0x7f7b6c1610b0 legacy=0x7f7b6c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50003ac0 0x7f7b50003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b50004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 0x7f7b500052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c070b30 con 0x7f7b50003ac0 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5000bbf0 con 0x7f7b50004870 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.129+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5000bdb0 con 0x7f7b6c0b2d80 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b50004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b6aa00700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50003ac0 0x7f7b50003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b6b400700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 0x7f7b500052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 -- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 msgr2=0x7f7b500052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c0b2d80 0x7f7b500052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 -- 172.21.15.81:0/1821765964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50003ac0 msgr2=0x7f7b50003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50003ac0 0x7f7b50003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 -- 172.21.15.81:0/1821765964 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b500035d0 con 0x7f7b50004870 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b6aa00700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b50003ac0 0x7f7b50003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b62000700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b50004cf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b54007fd0 tx=0x7f7b500058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1bafacb0e65232d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540052d0 con 0x7f7b50004870 2024-09-13T18:51:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54005450 con 0x7f7b50004870 2024-09-13T18:51:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.133+0000 7f7b6a000700 1 -- 172.21.15.81:0/1821765964 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540038e0 con 0x7f7b50004870 2024-09-13T18:51:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 -- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 msgr2=0x7f7b50004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1821765964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b50004cf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b54007fd0 tx=0x7f7b500058a0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6b400700 1 -- 172.21.15.81:0/1821765964 reap_dead start 2024-09-13T18:51:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 -- 172.21.15.81:0/1821765964 shutdown_connections 2024-09-13T18:51:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 -- 172.21.15.81:0/1821765964 >> 172.21.15.81:0/1821765964 conn(0x7f7b6c0b0c40 msgr2=0x7f7b6c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 -- 172.21.15.81:0/1821765964 shutdown_connections 2024-09-13T18:51:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 -- 172.21.15.81:0/1821765964 wait complete. 2024-09-13T18:51:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.137+0000 7f7b6be00700 1 Processor -- start 2024-09-13T18:51:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 -- start start 2024-09-13T18:51:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b6c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c164360 0x7f7b6c153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 0x7f7b6c1632d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c153e60 con 0x7f7b6c1529a0 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c154140 con 0x7f7b50004870 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c154420 con 0x7f7b6c164360 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 0x7f7b6c1632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 0x7f7b6c1632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53010/0 (socket says 172.21.15.81:53010) 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 -- 172.21.15.81:0/1317890947 learned_addr learned my addr 172.21.15.81:0/1317890947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b62000700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c164360 0x7f7b6c153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6aa00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b6c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 -- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c164360 msgr2=0x7f7b6c153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c164360 0x7f7b6c153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 -- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 msgr2=0x7f7b6c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b6c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 -- 172.21.15.81:0/1317890947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c154700 con 0x7f7b6c1529a0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.141+0000 7f7b6b400700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 0x7f7b6c1632d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c070d60 tx=0x7f7b64011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400e040 con 0x7f7b6c1529a0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6400f040 con 0x7f7b6c1529a0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c1549e0 con 0x7f7b6c1529a0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400fe30 con 0x7f7b6c1529a0 2024-09-13T18:51:21.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c153c30 con 0x7f7b6c1529a0 2024-09-13T18:51:21.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c154bd0 con 0x7f7b6c1529a0 2024-09-13T18:51:21.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.145+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b64022460 con 0x7f7b6c1529a0 2024-09-13T18:51:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.149+0000 7f7b63400700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b48066730 0x7f7b48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.149+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7b64084680 con 0x7f7b6c1529a0 2024-09-13T18:51:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.149+0000 7f7b6aa00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b48066730 0x7f7b48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.149+0000 7f7b6aa00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b48066730 0x7f7b48068bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c007fd0 tx=0x7f7b5c001850 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:21.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.153+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b64051810 con 0x7f7b6c1529a0 2024-09-13T18:51:21.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.373+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b6c06af10 con 0x7f7b6c1529a0 2024-09-13T18:51:21.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b63400700 1 -- 172.21.15.81:0/1317890947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f7b64054e30 con 0x7f7b6c1529a0 2024-09-13T18:51:21.388 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:21.388 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6816,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:20.925465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:51:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b48066730 msgr2=0x7f7b48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b48066730 0x7f7b48068bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c007fd0 tx=0x7f7b5c001850 comp rx=0 tx=0).stop 2024-09-13T18:51:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 msgr2=0x7f7b6c1632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 0x7f7b6c1632d0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c070d60 tx=0x7f7b64011f60 comp rx=0 tx=0).stop 2024-09-13T18:51:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 shutdown_connections 2024-09-13T18:51:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b48066730 0x7f7b48068bf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b6c1529a0 0x7f7b6c1632d0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b6c164360 0x7f7b6c153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 --2- 172.21.15.81:0/1317890947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b50004870 0x7f7b6c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 >> 172.21.15.81:0/1317890947 conn(0x7f7b6c0b0c40 msgr2=0x7f7b6c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.377+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 shutdown_connections 2024-09-13T18:51:21.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.381+0000 7f7b6be00700 1 -- 172.21.15.81:0/1317890947 wait complete. 2024-09-13T18:51:21.392 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-13T18:51:21.410 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:51:21.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 Processor -- start 2024-09-13T18:51:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 -- start start 2024-09-13T18:51:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6640cb020 0x7fc6640cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc66406aaa0 0x7fc66406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66406b430 con 0x7fc66415c2a0 2024-09-13T18:51:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6640b2ad0 con 0x7fc6640cb020 2024-09-13T18:51:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415b960 con 0x7fc66406aaa0 2024-09-13T18:51:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc663e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6640cb020 0x7fc6640cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc663400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc66415c2a0 0x7fc66415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35436/0 (socket says 172.21.15.81:35436) 2024-09-13T18:51:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc663400700 1 -- 172.21.15.81:0/1122784485 learned_addr learned my addr 172.21.15.81:0/1122784485 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.569+0000 7fc669200700 1 --2- 172.21.15.81:0/1122784485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc66406aaa0 0x7fc66406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc663e00700 1 -- 172.21.15.81:0/1122784485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc66406aaa0 msgr2=0x7fc66406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc663e00700 1 --2- 172.21.15.81:0/1122784485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc66406aaa0 0x7fc66406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc663e00700 1 -- 172.21.15.81:0/1122784485 >> v1:172.21.15.81:6789/0 conn(0x7fc66415c2a0 legacy=0x7fc66415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc663e00700 1 -- 172.21.15.81:0/1122784485 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66415bc40 con 0x7fc6640cb020 2024-09-13T18:51:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc662a00700 1 -- 172.21.15.81:0/1122784485 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244475464 0 0) 0x7fc650001110 con 0x7fc66415c2a0 2024-09-13T18:51:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc663e00700 1 --2- 172.21.15.81:0/1122784485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6640cb020 0x7fc6640cc6f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc654009850 tx=0x7fc654009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def9cb5c47489372 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc662a00700 1 -- 172.21.15.81:0/1122784485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654011830 con 0x7fc6640cb020 2024-09-13T18:51:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc662a00700 1 -- 172.21.15.81:0/1122784485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654011990 con 0x7fc6640cb020 2024-09-13T18:51:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc662a00700 1 -- 172.21.15.81:0/1122784485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654011d40 con 0x7fc6640cb020 2024-09-13T18:51:21.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 -- 172.21.15.81:0/1122784485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6640cb020 msgr2=0x7fc6640cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 --2- 172.21.15.81:0/1122784485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6640cb020 0x7fc6640cc6f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc654009850 tx=0x7fc654009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:21.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 -- 172.21.15.81:0/1122784485 shutdown_connections 2024-09-13T18:51:21.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 --2- 172.21.15.81:0/1122784485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc66406aaa0 0x7fc66406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 --2- 172.21.15.81:0/1122784485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6640cb020 0x7fc6640cc6f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 -- 172.21.15.81:0/1122784485 >> 172.21.15.81:0/1122784485 conn(0x7fc6640b0c40 msgr2=0x7fc66406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:21.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 -- 172.21.15.81:0/1122784485 shutdown_connections 2024-09-13T18:51:21.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.573+0000 7fc669c00700 1 -- 172.21.15.81:0/1122784485 wait complete. 2024-09-13T18:51:21.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 Processor -- start 2024-09-13T18:51:21.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 -- start start 2024-09-13T18:51:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc66406aaa0 0x7fc66413f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6640cb020 0x7fc664157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 0x7fc6641529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664155dd0 con 0x7fc66415c2a0 2024-09-13T18:51:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.577+0000 7fc669c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641557a0 con 0x7fc66406aaa0 2024-09-13T18:51:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc664157cc0 con 0x7fc6640cb020 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 0x7fc6641529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 0x7fc6641529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53024/0 (socket says 172.21.15.81:53024) 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 -- 172.21.15.81:0/1548636928 learned_addr learned my addr 172.21.15.81:0/1548636928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc663400700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6640cb020 0x7fc664157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 -- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6640cb020 msgr2=0x7fc664157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6640cb020 0x7fc664157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 -- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc66406aaa0 msgr2=0x7fc66413f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc663e00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc66406aaa0 0x7fc66413f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc66406aaa0 0x7fc66413f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 -- 172.21.15.81:0/1548636928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540094b0 con 0x7fc66415c2a0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc663400700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6640cb020 0x7fc664157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc663e00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc66406aaa0 0x7fc66413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669200700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 0x7fc6641529f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00efc0 tx=0x7fc65c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00cd40 con 0x7fc66415c2a0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c00f040 con 0x7fc66415c2a0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc664157fa0 con 0x7fc66415c2a0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0146c0 con 0x7fc66415c2a0 2024-09-13T18:51:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66413f600 con 0x7fc66415c2a0 2024-09-13T18:51:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.581+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc664155f80 con 0x7fc66415c2a0 2024-09-13T18:51:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.585+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc65c014820 con 0x7fc66415c2a0 2024-09-13T18:51:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.585+0000 7fc65be00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc644066730 0x7fc644068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.585+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc65c084fe0 con 0x7fc66415c2a0 2024-09-13T18:51:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.585+0000 7fc663e00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc644066730 0x7fc644068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.585+0000 7fc663e00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc644066730 0x7fc644068bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc6540090b0 tx=0x7fc654008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.593+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc65c052120 con 0x7fc66415c2a0 2024-09-13T18:51:21.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.785+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc66406aef0 con 0x7fc66415c2a0 2024-09-13T18:51:21.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.785+0000 7fc65be00700 1 -- 172.21.15.81:0/1548636928 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16716 (secure 0 0 0) 0x7fc65c018070 con 0x7fc66415c2a0 2024-09-13T18:51:21.797 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:21.797 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":67,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:51:18.903486+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:51:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc644066730 msgr2=0x7fc644068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc644066730 0x7fc644068bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc6540090b0 tx=0x7fc654008030 comp rx=0 tx=0).stop 2024-09-13T18:51:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 msgr2=0x7fc6641529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:21.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 0x7fc6641529f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00efc0 tx=0x7fc65c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 shutdown_connections 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc644066730 0x7fc644068bf0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc66415c2a0 0x7fc6641529f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6640cb020 0x7fc664157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 --2- 172.21.15.81:0/1548636928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc66406aaa0 0x7fc66413f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 >> 172.21.15.81:0/1548636928 conn(0x7fc6640b0c40 msgr2=0x7fc66415dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 shutdown_connections 2024-09-13T18:51:21.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.789+0000 7fc669c00700 1 -- 172.21.15.81:0/1548636928 wait complete. 2024-09-13T18:51:21.825 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:51:21.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:51:21.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.989+0000 7f2ace000700 1 Processor -- start 2024-09-13T18:51:21.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.989+0000 7f2ace000700 1 -- start start 2024-09-13T18:51:22.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.989+0000 7f2ace000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ac806cbb0 0x7f2ac806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac80cd190 con 0x7f2ac80b2140 2024-09-13T18:51:22.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac806d530 con 0x7f2ac81593f0 2024-09-13T18:51:22.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac81597d0 con 0x7f2ac806cbb0 2024-09-13T18:51:22.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ac806cbb0 0x7f2ac806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ac806cbb0 0x7f2ac806cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53036/0 (socket says 172.21.15.81:53036) 2024-09-13T18:51:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 -- 172.21.15.81:0/563743731 learned_addr learned my addr 172.21.15.81:0/563743731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2acd600700 1 --1- 172.21.15.81:0/563743731 >> v1:172.21.15.81:6789/0 conn(0x7f2ac80b2140 0x7f2ac80b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35446/0 (socket says 172.21.15.81:35446) 2024-09-13T18:51:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 -- 172.21.15.81:0/563743731 >> v1:172.21.15.178:6789/0 conn(0x7f2ac81593f0 legacy=0x7f2ac80718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 -- 172.21.15.81:0/563743731 >> v1:172.21.15.81:6789/0 conn(0x7f2ac80b2140 legacy=0x7f2ac80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 -- 172.21.15.81:0/563743731 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80b19b0 con 0x7f2ac806cbb0 2024-09-13T18:51:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7e00700 1 --2- 172.21.15.81:0/563743731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac806cbb0 0x7f2ac806cff0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400bbb0 tx=0x7f2ab400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa71ccae80a531f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7400700 1 -- 172.21.15.81:0/563743731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab400dd90 con 0x7f2ac806cbb0 2024-09-13T18:51:22.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7400700 1 -- 172.21.15.81:0/563743731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab4010470 con 0x7f2ac806cbb0 2024-09-13T18:51:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ac7400700 1 -- 172.21.15.81:0/563743731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4010820 con 0x7f2ac806cbb0 2024-09-13T18:51:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- 172.21.15.81:0/563743731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac806cbb0 msgr2=0x7f2ac806cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 --2- 172.21.15.81:0/563743731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac806cbb0 0x7f2ac806cff0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400bbb0 tx=0x7f2ab400bec0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- 172.21.15.81:0/563743731 shutdown_connections 2024-09-13T18:51:22.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 --2- 172.21.15.81:0/563743731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac806cbb0 0x7f2ac806cff0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- 172.21.15.81:0/563743731 >> 172.21.15.81:0/563743731 conn(0x7f2ac80b0c40 msgr2=0x7f2ac806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:22.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- 172.21.15.81:0/563743731 shutdown_connections 2024-09-13T18:51:22.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.993+0000 7f2ace000700 1 -- 172.21.15.81:0/563743731 wait complete. 2024-09-13T18:51:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.997+0000 7f2ace000700 1 Processor -- start 2024-09-13T18:51:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:21.997+0000 7f2ace000700 1 -- start start 2024-09-13T18:51:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ace000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ac806cbb0 0x7f2ac814e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ace000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80b2140 0x7f2ac815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ace000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 0x7f2ac815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ace000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81e1f50 con 0x7f2ac81593f0 2024-09-13T18:51:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ace000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81e2230 con 0x7f2ac806cbb0 2024-09-13T18:51:22.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ace000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81e2510 con 0x7f2ac80b2140 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 0x7f2ac815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 0x7f2ac815c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53052/0 (socket says 172.21.15.81:53052) 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 -- 172.21.15.81:0/1375531619 learned_addr learned my addr 172.21.15.81:0/1375531619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2accc00700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ac806cbb0 0x7f2ac814e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ac7e00700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80b2140 0x7f2ac815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 -- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80b2140 msgr2=0x7f2ac815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80b2140 0x7f2ac815beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 -- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ac806cbb0 msgr2=0x7f2ac814e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ac806cbb0 0x7f2ac814e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 -- 172.21.15.81:0/1375531619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab400b810 con 0x7f2ac81593f0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ac7e00700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80b2140 0x7f2ac815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2acd600700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 0x7f2ac815c3f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000cbd0 tx=0x7f2ac000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.001+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000ab00 con 0x7f2ac81593f0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.005+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000ac60 con 0x7f2ac81593f0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.005+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac81e27f0 con 0x7f2ac81593f0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.005+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0007070 con 0x7f2ac81593f0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.005+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac81e1ac0 con 0x7f2ac81593f0 2024-09-13T18:51:22.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.005+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac81e1d10 con 0x7f2ac81593f0 2024-09-13T18:51:22.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.005+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ac00071d0 con 0x7f2ac81593f0 2024-09-13T18:51:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.009+0000 7f2ac4c00700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2aa8066730 0x7f2aa8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.009+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2ac0083ff0 con 0x7f2ac81593f0 2024-09-13T18:51:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.009+0000 7f2accc00700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2aa8066730 0x7f2aa8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.009+0000 7f2accc00700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2aa8066730 0x7f2aa8068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2abc000f60 tx=0x7f2abc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.013+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ac81e1d10 con 0x7f2ac81593f0 2024-09-13T18:51:22.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.197+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ac81e23a0 con 0x7f2aa8066730 2024-09-13T18:51:22.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.213+0000 7f2ac4c00700 1 -- 172.21.15.81:0/1375531619 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286725 (secure 0 0 0) 0x7f2ac81e23a0 con 0x7f2aa8066730 2024-09-13T18:51:22.229 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2aa8066730 msgr2=0x7f2aa8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2aa8066730 0x7f2aa8068bf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2abc000f60 tx=0x7f2abc009040 comp rx=0 tx=0).stop 2024-09-13T18:51:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 msgr2=0x7f2ac815c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 0x7f2ac815c3f0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000cbd0 tx=0x7f2ac000cee0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 shutdown_connections 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2aa8066730 0x7f2aa8068bf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ac81593f0 0x7f2ac815c3f0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ac80b2140 0x7f2ac815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 --2- 172.21.15.81:0/1375531619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ac806cbb0 0x7f2ac814e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 >> 172.21.15.81:0/1375531619 conn(0x7f2ac80b0c40 msgr2=0x7f2ac8070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 shutdown_connections 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.221+0000 7f2ace000700 1 -- 172.21.15.81:0/1375531619 wait complete. 2024-09-13T18:51:22.233 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:51:22.251 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-13T18:51:21.052185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243928,"kb_used_data":7272,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754730792,"statfs":{"total":773094113280,"available":772844331008,"internally_reserved":0,"allocated":7446528,"data_stored":3985418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":242208315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.630088"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931449+0000","last_change":"2024-09-13T18:51:17.927705+0000","last_active":"2024-09-13T18:51:17.931449+0000","last_peered":"2024-09-13T18:51:17.931449+0000","last_clean":"2024-09-13T18:51:17.931449+0000","last_became_active":"2024-09-13T18:51:17.927034+0000","last_became_peered":"2024-09-13T18:51:17.927034+0000","last_unstale":"2024-09-13T18:51:17.931449+0000","last_undegraded":"2024-09-13T18:51:17.931449+0000","last_fullsized":"2024-09-13T18:51:17.931449+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:42.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932124+0000","last_change":"2024-09-13T18:51:17.930600+0000","last_active":"2024-09-13T18:51:17.932124+0000","last_peered":"2024-09-13T18:51:17.932124+0000","last_clean":"2024-09-13T18:51:17.932124+0000","last_became_active":"2024-09-13T18:51:17.930330+0000","last_became_peered":"2024-09-13T18:51:17.930330+0000","last_unstale":"2024-09-13T18:51:17.932124+0000","last_undegraded":"2024-09-13T18:51:17.932124+0000","last_fullsized":"2024-09-13T18:51:17.932124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:31.252836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943614+0000","last_change":"2024-09-13T18:51:17.940292+0000","last_active":"2024-09-13T18:51:17.943614+0000","last_peered":"2024-09-13T18:51:17.943614+0000","last_clean":"2024-09-13T18:51:17.943614+0000","last_became_active":"2024-09-13T18:51:17.938710+0000","last_became_peered":"2024-09-13T18:51:17.938710+0000","last_unstale":"2024-09-13T18:51:17.943614+0000","last_undegraded":"2024-09-13T18:51:17.943614+0000","last_fullsized":"2024-09-13T18:51:17.943614+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:45.265416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932603+0000","last_change":"2024-09-13T18:51:17.923127+0000","last_active":"2024-09-13T18:51:17.932603+0000","last_peered":"2024-09-13T18:51:17.932603+0000","last_clean":"2024-09-13T18:51:17.932603+0000","last_became_active":"2024-09-13T18:51:17.922893+0000","last_became_peered":"2024-09-13T18:51:17.922893+0000","last_unstale":"2024-09-13T18:51:17.932603+0000","last_undegraded":"2024-09-13T18:51:17.932603+0000","last_fullsized":"2024-09-13T18:51:17.932603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:07.452764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.950613+0000","last_change":"2024-09-13T18:51:17.949374+0000","last_active":"2024-09-13T18:51:17.950613+0000","last_peered":"2024-09-13T18:51:17.950613+0000","last_clean":"2024-09-13T18:51:17.950613+0000","last_became_active":"2024-09-13T18:51:17.949093+0000","last_became_peered":"2024-09-13T18:51:17.949093+0000","last_unstale":"2024-09-13T18:51:17.950613+0000","last_undegraded":"2024-09-13T18:51:17.950613+0000","last_fullsized":"2024-09-13T18:51:17.950613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:39.866865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932935+0000","last_change":"2024-09-13T18:51:17.931220+0000","last_active":"2024-09-13T18:51:17.932935+0000","last_peered":"2024-09-13T18:51:17.932935+0000","last_clean":"2024-09-13T18:51:17.932935+0000","last_became_active":"2024-09-13T18:51:17.928990+0000","last_became_peered":"2024-09-13T18:51:17.928990+0000","last_unstale":"2024-09-13T18:51:17.932935+0000","last_undegraded":"2024-09-13T18:51:17.932935+0000","last_fullsized":"2024-09-13T18:51:17.932935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:19.388090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931660+0000","last_change":"2024-09-13T18:51:17.928048+0000","last_active":"2024-09-13T18:51:17.931660+0000","last_peered":"2024-09-13T18:51:17.931660+0000","last_clean":"2024-09-13T18:51:17.931660+0000","last_became_active":"2024-09-13T18:51:17.927819+0000","last_became_peered":"2024-09-13T18:51:17.927819+0000","last_unstale":"2024-09-13T18:51:17.931660+0000","last_undegraded":"2024-09-13T18:51:17.931660+0000","last_fullsized":"2024-09-13T18:51:17.931660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:23.633257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945792+0000","last_change":"2024-09-13T18:51:17.935604+0000","last_active":"2024-09-13T18:51:17.945792+0000","last_peered":"2024-09-13T18:51:17.945792+0000","last_clean":"2024-09-13T18:51:17.945792+0000","last_became_active":"2024-09-13T18:51:17.933458+0000","last_became_peered":"2024-09-13T18:51:17.933458+0000","last_unstale":"2024-09-13T18:51:17.945792+0000","last_undegraded":"2024-09-13T18:51:17.945792+0000","last_fullsized":"2024-09-13T18:51:17.945792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:18.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.947293+0000","last_change":"2024-09-13T18:51:17.945325+0000","last_active":"2024-09-13T18:51:17.947293+0000","last_peered":"2024-09-13T18:51:17.947293+0000","last_clean":"2024-09-13T18:51:17.947293+0000","last_became_active":"2024-09-13T18:51:17.945056+0000","last_became_peered":"2024-09-13T18:51:17.945056+0000","last_unstale":"2024-09-13T18:51:17.947293+0000","last_undegraded":"2024-09-13T18:51:17.947293+0000","last_fullsized":"2024-09-13T18:51:17.947293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:18.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941983+0000","last_change":"2024-09-13T18:51:17.938106+0000","last_active":"2024-09-13T18:51:17.941983+0000","last_peered":"2024-09-13T18:51:17.941983+0000","last_clean":"2024-09-13T18:51:17.941983+0000","last_became_active":"2024-09-13T18:51:17.937837+0000","last_became_peered":"2024-09-13T18:51:17.937837+0000","last_unstale":"2024-09-13T18:51:17.941983+0000","last_undegraded":"2024-09-13T18:51:17.941983+0000","last_fullsized":"2024-09-13T18:51:17.941983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:27.251370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932792+0000","last_change":"2024-09-13T18:51:17.927165+0000","last_active":"2024-09-13T18:51:17.932792+0000","last_peered":"2024-09-13T18:51:17.932792+0000","last_clean":"2024-09-13T18:51:17.932792+0000","last_became_active":"2024-09-13T18:51:17.926919+0000","last_became_peered":"2024-09-13T18:51:17.926919+0000","last_unstale":"2024-09-13T18:51:17.932792+0000","last_undegraded":"2024-09-13T18:51:17.932792+0000","last_fullsized":"2024-09-13T18:51:17.932792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:16.838884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.934434+0000","last_change":"2024-09-13T18:51:17.930021+0000","last_active":"2024-09-13T18:51:17.934434+0000","last_peered":"2024-09-13T18:51:17.934434+0000","last_clean":"2024-09-13T18:51:17.934434+0000","last_became_active":"2024-09-13T18:51:17.929670+0000","last_became_peered":"2024-09-13T18:51:17.929670+0000","last_unstale":"2024-09-13T18:51:17.934434+0000","last_undegraded":"2024-09-13T18:51:17.934434+0000","last_fullsized":"2024-09-13T18:51:17.934434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.382047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945780+0000","last_change":"2024-09-13T18:51:17.933876+0000","last_active":"2024-09-13T18:51:17.945780+0000","last_peered":"2024-09-13T18:51:17.945780+0000","last_clean":"2024-09-13T18:51:17.945780+0000","last_became_active":"2024-09-13T18:51:17.931297+0000","last_became_peered":"2024-09-13T18:51:17.931297+0000","last_unstale":"2024-09-13T18:51:17.945780+0000","last_undegraded":"2024-09-13T18:51:17.945780+0000","last_fullsized":"2024-09-13T18:51:17.945780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.602736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943560+0000","last_change":"2024-09-13T18:51:17.939482+0000","last_active":"2024-09-13T18:51:17.943560+0000","last_peered":"2024-09-13T18:51:17.943560+0000","last_clean":"2024-09-13T18:51:17.943560+0000","last_became_active":"2024-09-13T18:51:17.939184+0000","last_became_peered":"2024-09-13T18:51:17.939184+0000","last_unstale":"2024-09-13T18:51:17.943560+0000","last_undegraded":"2024-09-13T18:51:17.943560+0000","last_fullsized":"2024-09-13T18:51:17.943560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:03.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940657+0000","last_change":"2024-09-13T18:51:17.937628+0000","last_active":"2024-09-13T18:51:17.940657+0000","last_peered":"2024-09-13T18:51:17.940657+0000","last_clean":"2024-09-13T18:51:17.940657+0000","last_became_active":"2024-09-13T18:51:17.937313+0000","last_became_peered":"2024-09-13T18:51:17.937313+0000","last_unstale":"2024-09-13T18:51:17.940657+0000","last_undegraded":"2024-09-13T18:51:17.940657+0000","last_fullsized":"2024-09-13T18:51:17.940657+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:07.452764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.927427+0000","last_change":"2024-09-13T18:51:17.924086+0000","last_active":"2024-09-13T18:51:17.927427+0000","last_peered":"2024-09-13T18:51:17.927427+0000","last_clean":"2024-09-13T18:51:17.927427+0000","last_became_active":"2024-09-13T18:51:17.923814+0000","last_became_peered":"2024-09-13T18:51:17.923814+0000","last_unstale":"2024-09-13T18:51:17.927427+0000","last_undegraded":"2024-09-13T18:51:17.927427+0000","last_fullsized":"2024-09-13T18:51:17.927427+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:19.098546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931467+0000","last_change":"2024-09-13T18:51:17.927874+0000","last_active":"2024-09-13T18:51:17.931467+0000","last_peered":"2024-09-13T18:51:17.931467+0000","last_clean":"2024-09-13T18:51:17.931467+0000","last_became_active":"2024-09-13T18:51:17.927426+0000","last_became_peered":"2024-09-13T18:51:17.927426+0000","last_unstale":"2024-09-13T18:51:17.931467+0000","last_undegraded":"2024-09-13T18:51:17.931467+0000","last_fullsized":"2024-09-13T18:51:17.931467+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:28.189074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.936347+0000","last_change":"2024-09-13T18:51:17.932140+0000","last_active":"2024-09-13T18:51:17.936347+0000","last_peered":"2024-09-13T18:51:17.936347+0000","last_clean":"2024-09-13T18:51:17.936347+0000","last_became_active":"2024-09-13T18:51:17.929836+0000","last_became_peered":"2024-09-13T18:51:17.929836+0000","last_unstale":"2024-09-13T18:51:17.936347+0000","last_undegraded":"2024-09-13T18:51:17.936347+0000","last_fullsized":"2024-09-13T18:51:17.936347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:18.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941895+0000","last_change":"2024-09-13T18:51:17.939463+0000","last_active":"2024-09-13T18:51:17.941895+0000","last_peered":"2024-09-13T18:51:17.941895+0000","last_clean":"2024-09-13T18:51:17.941895+0000","last_became_active":"2024-09-13T18:51:17.937069+0000","last_became_peered":"2024-09-13T18:51:17.937069+0000","last_unstale":"2024-09-13T18:51:17.941895+0000","last_undegraded":"2024-09-13T18:51:17.941895+0000","last_fullsized":"2024-09-13T18:51:17.941895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:28.189074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945636+0000","last_change":"2024-09-13T18:51:17.944735+0000","last_active":"2024-09-13T18:51:17.945636+0000","last_peered":"2024-09-13T18:51:17.945636+0000","last_clean":"2024-09-13T18:51:17.945636+0000","last_became_active":"2024-09-13T18:51:17.944434+0000","last_became_peered":"2024-09-13T18:51:17.944434+0000","last_unstale":"2024-09-13T18:51:17.945636+0000","last_undegraded":"2024-09-13T18:51:17.945636+0000","last_fullsized":"2024-09-13T18:51:17.945636+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:25.004427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.933974+0000","last_change":"2024-09-13T18:51:17.929264+0000","last_active":"2024-09-13T18:51:17.933974+0000","last_peered":"2024-09-13T18:51:17.933974+0000","last_clean":"2024-09-13T18:51:17.933974+0000","last_became_active":"2024-09-13T18:51:17.929034+0000","last_became_peered":"2024-09-13T18:51:17.929034+0000","last_unstale":"2024-09-13T18:51:17.933974+0000","last_undegraded":"2024-09-13T18:51:17.933974+0000","last_fullsized":"2024-09-13T18:51:17.933974+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:31.252836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941239+0000","last_change":"2024-09-13T18:51:17.938102+0000","last_active":"2024-09-13T18:51:17.941239+0000","last_peered":"2024-09-13T18:51:17.941239+0000","last_clean":"2024-09-13T18:51:17.941239+0000","last_became_active":"2024-09-13T18:51:17.937787+0000","last_became_peered":"2024-09-13T18:51:17.937787+0000","last_unstale":"2024-09-13T18:51:17.941239+0000","last_undegraded":"2024-09-13T18:51:17.941239+0000","last_fullsized":"2024-09-13T18:51:17.941239+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:38.158358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940261+0000","last_change":"2024-09-13T18:51:17.937253+0000","last_active":"2024-09-13T18:51:17.940261+0000","last_peered":"2024-09-13T18:51:17.940261+0000","last_clean":"2024-09-13T18:51:17.940261+0000","last_became_active":"2024-09-13T18:51:17.936909+0000","last_became_peered":"2024-09-13T18:51:17.936909+0000","last_unstale":"2024-09-13T18:51:17.940261+0000","last_undegraded":"2024-09-13T18:51:17.940261+0000","last_fullsized":"2024-09-13T18:51:17.940261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:19.625970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940689+0000","last_change":"2024-09-13T18:51:17.937749+0000","last_active":"2024-09-13T18:51:17.940689+0000","last_peered":"2024-09-13T18:51:17.940689+0000","last_clean":"2024-09-13T18:51:17.940689+0000","last_became_active":"2024-09-13T18:51:17.937498+0000","last_became_peered":"2024-09-13T18:51:17.937498+0000","last_unstale":"2024-09-13T18:51:17.940689+0000","last_undegraded":"2024-09-13T18:51:17.940689+0000","last_fullsized":"2024-09-13T18:51:17.940689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:16.838884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.947685+0000","last_change":"2024-09-13T18:51:17.934009+0000","last_active":"2024-09-13T18:51:17.947685+0000","last_peered":"2024-09-13T18:51:17.947685+0000","last_clean":"2024-09-13T18:51:17.947685+0000","last_became_active":"2024-09-13T18:51:17.933691+0000","last_became_peered":"2024-09-13T18:51:17.933691+0000","last_unstale":"2024-09-13T18:51:17.947685+0000","last_undegraded":"2024-09-13T18:51:17.947685+0000","last_fullsized":"2024-09-13T18:51:17.947685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:57.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.936125+0000","last_change":"2024-09-13T18:51:17.930356+0000","last_active":"2024-09-13T18:51:17.936125+0000","last_peered":"2024-09-13T18:51:17.936125+0000","last_clean":"2024-09-13T18:51:17.936125+0000","last_became_active":"2024-09-13T18:51:17.930112+0000","last_became_peered":"2024-09-13T18:51:17.930112+0000","last_unstale":"2024-09-13T18:51:17.936125+0000","last_undegraded":"2024-09-13T18:51:17.936125+0000","last_fullsized":"2024-09-13T18:51:17.936125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:16.838884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931244+0000","last_change":"2024-09-13T18:51:17.922405+0000","last_active":"2024-09-13T18:51:17.931244+0000","last_peered":"2024-09-13T18:51:17.931244+0000","last_clean":"2024-09-13T18:51:17.931244+0000","last_became_active":"2024-09-13T18:51:17.922037+0000","last_became_peered":"2024-09-13T18:51:17.922037+0000","last_unstale":"2024-09-13T18:51:17.931244+0000","last_undegraded":"2024-09-13T18:51:17.931244+0000","last_fullsized":"2024-09-13T18:51:17.931244+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.382047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940349+0000","last_change":"2024-09-13T18:51:17.937597+0000","last_active":"2024-09-13T18:51:17.940349+0000","last_peered":"2024-09-13T18:51:17.940349+0000","last_clean":"2024-09-13T18:51:17.940349+0000","last_became_active":"2024-09-13T18:51:17.937352+0000","last_became_peered":"2024-09-13T18:51:17.937352+0000","last_unstale":"2024-09-13T18:51:17.940349+0000","last_undegraded":"2024-09-13T18:51:17.940349+0000","last_fullsized":"2024-09-13T18:51:17.940349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:27.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.944772+0000","last_change":"2024-09-13T18:51:17.943755+0000","last_active":"2024-09-13T18:51:17.944772+0000","last_peered":"2024-09-13T18:51:17.944772+0000","last_clean":"2024-09-13T18:51:17.944772+0000","last_became_active":"2024-09-13T18:51:17.941345+0000","last_became_peered":"2024-09-13T18:51:17.941345+0000","last_unstale":"2024-09-13T18:51:17.944772+0000","last_undegraded":"2024-09-13T18:51:17.944772+0000","last_fullsized":"2024-09-13T18:51:17.944772+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.382047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945895+0000","last_change":"2024-09-13T18:51:17.941265+0000","last_active":"2024-09-13T18:51:17.945895+0000","last_peered":"2024-09-13T18:51:17.945895+0000","last_clean":"2024-09-13T18:51:17.945895+0000","last_became_active":"2024-09-13T18:51:17.941027+0000","last_became_peered":"2024-09-13T18:51:17.941027+0000","last_unstale":"2024-09-13T18:51:17.945895+0000","last_undegraded":"2024-09-13T18:51:17.945895+0000","last_fullsized":"2024-09-13T18:51:17.945895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:07.452764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924533+0000","last_change":"2024-09-13T18:51:17.917749+0000","last_active":"2024-09-13T18:51:17.924533+0000","last_peered":"2024-09-13T18:51:17.924533+0000","last_clean":"2024-09-13T18:51:17.924533+0000","last_became_active":"2024-09-13T18:51:17.917464+0000","last_became_peered":"2024-09-13T18:51:17.917464+0000","last_unstale":"2024-09-13T18:51:17.924533+0000","last_undegraded":"2024-09-13T18:51:17.924533+0000","last_fullsized":"2024-09-13T18:51:17.924533+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:27.251370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928593+0000","last_change":"2024-09-13T18:51:17.917811+0000","last_active":"2024-09-13T18:51:17.928593+0000","last_peered":"2024-09-13T18:51:17.928593+0000","last_clean":"2024-09-13T18:51:17.928593+0000","last_became_active":"2024-09-13T18:51:17.917557+0000","last_became_peered":"2024-09-13T18:51:17.917557+0000","last_unstale":"2024-09-13T18:51:17.928593+0000","last_undegraded":"2024-09-13T18:51:17.928593+0000","last_fullsized":"2024-09-13T18:51:17.928593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:30.272456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946575+0000","last_change":"2024-09-13T18:51:17.943450+0000","last_active":"2024-09-13T18:51:17.946575+0000","last_peered":"2024-09-13T18:51:17.946575+0000","last_clean":"2024-09-13T18:51:17.946575+0000","last_became_active":"2024-09-13T18:51:17.940908+0000","last_became_peered":"2024-09-13T18:51:17.940908+0000","last_unstale":"2024-09-13T18:51:17.946575+0000","last_undegraded":"2024-09-13T18:51:17.946575+0000","last_fullsized":"2024-09-13T18:51:17.946575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:16.961384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.939624+0000","last_change":"2024-09-13T18:51:17.464441+0000","last_active":"2024-09-13T18:51:17.939624+0000","last_peered":"2024-09-13T18:51:17.939624+0000","last_clean":"2024-09-13T18:51:17.939624+0000","last_became_active":"2024-09-13T18:51:17.464189+0000","last_became_peered":"2024-09-13T18:51:17.464189+0000","last_unstale":"2024-09-13T18:51:17.939624+0000","last_undegraded":"2024-09-13T18:51:17.939624+0000","last_fullsized":"2024-09-13T18:51:17.939624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.926199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948055+0000","last_change":"2024-09-13T18:51:17.945286+0000","last_active":"2024-09-13T18:51:17.948055+0000","last_peered":"2024-09-13T18:51:17.948055+0000","last_clean":"2024-09-13T18:51:17.948055+0000","last_became_active":"2024-09-13T18:51:17.945016+0000","last_became_peered":"2024-09-13T18:51:17.945016+0000","last_unstale":"2024-09-13T18:51:17.948055+0000","last_undegraded":"2024-09-13T18:51:17.948055+0000","last_fullsized":"2024-09-13T18:51:17.948055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.602736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.933775+0000","last_change":"2024-09-13T18:51:17.462100+0000","last_active":"2024-09-13T18:51:17.933775+0000","last_peered":"2024-09-13T18:51:17.933775+0000","last_clean":"2024-09-13T18:51:17.933775+0000","last_became_active":"2024-09-13T18:51:17.461697+0000","last_became_peered":"2024-09-13T18:51:17.461697+0000","last_unstale":"2024-09-13T18:51:17.933775+0000","last_undegraded":"2024-09-13T18:51:17.933775+0000","last_fullsized":"2024-09-13T18:51:17.933775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:40.427681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928026+0000","last_change":"2024-09-13T18:51:17.919507+0000","last_active":"2024-09-13T18:51:17.928026+0000","last_peered":"2024-09-13T18:51:17.928026+0000","last_clean":"2024-09-13T18:51:17.928026+0000","last_became_active":"2024-09-13T18:51:17.919272+0000","last_became_peered":"2024-09-13T18:51:17.919272+0000","last_unstale":"2024-09-13T18:51:17.928026+0000","last_undegraded":"2024-09-13T18:51:17.928026+0000","last_fullsized":"2024-09-13T18:51:17.928026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:02.539977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928773+0000","last_change":"2024-09-13T18:51:17.461792+0000","last_active":"2024-09-13T18:51:17.928773+0000","last_peered":"2024-09-13T18:51:17.928773+0000","last_clean":"2024-09-13T18:51:17.928773+0000","last_became_active":"2024-09-13T18:51:17.461577+0000","last_became_peered":"2024-09-13T18:51:17.461577+0000","last_unstale":"2024-09-13T18:51:17.928773+0000","last_undegraded":"2024-09-13T18:51:17.928773+0000","last_fullsized":"2024-09-13T18:51:17.928773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:26.194317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943507+0000","last_change":"2024-09-13T18:51:17.939993+0000","last_active":"2024-09-13T18:51:17.943507+0000","last_peered":"2024-09-13T18:51:17.943507+0000","last_clean":"2024-09-13T18:51:17.943507+0000","last_became_active":"2024-09-13T18:51:17.938898+0000","last_became_peered":"2024-09-13T18:51:17.938898+0000","last_unstale":"2024-09-13T18:51:17.943507+0000","last_undegraded":"2024-09-13T18:51:17.943507+0000","last_fullsized":"2024-09-13T18:51:17.943507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:57.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932053+0000","last_change":"2024-09-13T18:51:17.453634+0000","last_active":"2024-09-13T18:51:17.932053+0000","last_peered":"2024-09-13T18:51:17.932053+0000","last_clean":"2024-09-13T18:51:17.932053+0000","last_became_active":"2024-09-13T18:51:17.453399+0000","last_became_peered":"2024-09-13T18:51:17.453399+0000","last_unstale":"2024-09-13T18:51:17.932053+0000","last_undegraded":"2024-09-13T18:51:17.932053+0000","last_fullsized":"2024-09-13T18:51:17.932053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:32.585876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.925912+0000","last_change":"2024-09-13T18:51:17.923086+0000","last_active":"2024-09-13T18:51:17.925912+0000","last_peered":"2024-09-13T18:51:17.925912+0000","last_clean":"2024-09-13T18:51:17.925912+0000","last_became_active":"2024-09-13T18:51:17.922843+0000","last_became_peered":"2024-09-13T18:51:17.922843+0000","last_unstale":"2024-09-13T18:51:17.925912+0000","last_undegraded":"2024-09-13T18:51:17.925912+0000","last_fullsized":"2024-09-13T18:51:17.925912+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:46.216067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932173+0000","last_change":"2024-09-13T18:51:17.459235+0000","last_active":"2024-09-13T18:51:17.932173+0000","last_peered":"2024-09-13T18:51:17.932173+0000","last_clean":"2024-09-13T18:51:17.932173+0000","last_became_active":"2024-09-13T18:51:17.458955+0000","last_became_peered":"2024-09-13T18:51:17.458955+0000","last_unstale":"2024-09-13T18:51:17.932173+0000","last_undegraded":"2024-09-13T18:51:17.932173+0000","last_fullsized":"2024-09-13T18:51:17.932173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:01.523117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931819+0000","last_change":"2024-09-13T18:51:17.928442+0000","last_active":"2024-09-13T18:51:17.931819+0000","last_peered":"2024-09-13T18:51:17.931819+0000","last_clean":"2024-09-13T18:51:17.931819+0000","last_became_active":"2024-09-13T18:51:17.928207+0000","last_became_peered":"2024-09-13T18:51:17.928207+0000","last_unstale":"2024-09-13T18:51:17.931819+0000","last_undegraded":"2024-09-13T18:51:17.931819+0000","last_fullsized":"2024-09-13T18:51:17.931819+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:39.247449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.930139+0000","last_change":"2024-09-13T18:51:17.458903+0000","last_active":"2024-09-13T18:51:17.930139+0000","last_peered":"2024-09-13T18:51:17.930139+0000","last_clean":"2024-09-13T18:51:17.930139+0000","last_became_active":"2024-09-13T18:51:17.458661+0000","last_became_peered":"2024-09-13T18:51:17.458661+0000","last_unstale":"2024-09-13T18:51:17.930139+0000","last_undegraded":"2024-09-13T18:51:17.930139+0000","last_fullsized":"2024-09-13T18:51:17.930139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:28.199707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948393+0000","last_change":"2024-09-13T18:51:17.947159+0000","last_active":"2024-09-13T18:51:17.948393+0000","last_peered":"2024-09-13T18:51:17.948393+0000","last_clean":"2024-09-13T18:51:17.948393+0000","last_became_active":"2024-09-13T18:51:17.946784+0000","last_became_peered":"2024-09-13T18:51:17.946784+0000","last_unstale":"2024-09-13T18:51:17.948393+0000","last_undegraded":"2024-09-13T18:51:17.948393+0000","last_fullsized":"2024-09-13T18:51:17.948393+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.444541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924684+0000","last_change":"2024-09-13T18:51:17.464136+0000","last_active":"2024-09-13T18:51:17.924684+0000","last_peered":"2024-09-13T18:51:17.924684+0000","last_clean":"2024-09-13T18:51:17.924684+0000","last_became_active":"2024-09-13T18:51:17.463906+0000","last_became_peered":"2024-09-13T18:51:17.463906+0000","last_unstale":"2024-09-13T18:51:17.924684+0000","last_undegraded":"2024-09-13T18:51:17.924684+0000","last_fullsized":"2024-09-13T18:51:17.924684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:35.492310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.933991+0000","last_change":"2024-09-13T18:51:17.933003+0000","last_active":"2024-09-13T18:51:17.933991+0000","last_peered":"2024-09-13T18:51:17.933991+0000","last_clean":"2024-09-13T18:51:17.933991+0000","last_became_active":"2024-09-13T18:51:17.932464+0000","last_became_peered":"2024-09-13T18:51:17.932464+0000","last_unstale":"2024-09-13T18:51:17.933991+0000","last_undegraded":"2024-09-13T18:51:17.933991+0000","last_fullsized":"2024-09-13T18:51:17.933991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:48.924559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.923747+0000","last_change":"2024-09-13T18:51:17.467663+0000","last_active":"2024-09-13T18:51:17.923747+0000","last_peered":"2024-09-13T18:51:17.923747+0000","last_clean":"2024-09-13T18:51:17.923747+0000","last_became_active":"2024-09-13T18:51:17.467375+0000","last_became_peered":"2024-09-13T18:51:17.467375+0000","last_unstale":"2024-09-13T18:51:17.923747+0000","last_undegraded":"2024-09-13T18:51:17.923747+0000","last_fullsized":"2024-09-13T18:51:17.923747+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:22.388614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928140+0000","last_change":"2024-09-13T18:51:17.922359+0000","last_active":"2024-09-13T18:51:17.928140+0000","last_peered":"2024-09-13T18:51:17.928140+0000","last_clean":"2024-09-13T18:51:17.928140+0000","last_became_active":"2024-09-13T18:51:17.920789+0000","last_became_peered":"2024-09-13T18:51:17.920789+0000","last_unstale":"2024-09-13T18:51:17.928140+0000","last_undegraded":"2024-09-13T18:51:17.928140+0000","last_fullsized":"2024-09-13T18:51:17.928140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.444541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932299+0000","last_change":"2024-09-13T18:51:17.464190+0000","last_active":"2024-09-13T18:51:17.932299+0000","last_peered":"2024-09-13T18:51:17.932299+0000","last_clean":"2024-09-13T18:51:17.932299+0000","last_became_active":"2024-09-13T18:51:17.463498+0000","last_became_peered":"2024-09-13T18:51:17.463498+0000","last_unstale":"2024-09-13T18:51:17.932299+0000","last_undegraded":"2024-09-13T18:51:17.932299+0000","last_fullsized":"2024-09-13T18:51:17.932299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:02.172649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931446+0000","last_change":"2024-09-13T18:51:17.929300+0000","last_active":"2024-09-13T18:51:17.931446+0000","last_peered":"2024-09-13T18:51:17.931446+0000","last_clean":"2024-09-13T18:51:17.931446+0000","last_became_active":"2024-09-13T18:51:17.928500+0000","last_became_peered":"2024-09-13T18:51:17.928500+0000","last_unstale":"2024-09-13T18:51:17.931446+0000","last_undegraded":"2024-09-13T18:51:17.931446+0000","last_fullsized":"2024-09-13T18:51:17.931446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:45.850329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.914304+0000","last_change":"2024-09-13T18:51:17.460228+0000","last_active":"2024-09-13T18:51:17.914304+0000","last_peered":"2024-09-13T18:51:17.914304+0000","last_clean":"2024-09-13T18:51:17.914304+0000","last_became_active":"2024-09-13T18:51:17.456796+0000","last_became_peered":"2024-09-13T18:51:17.456796+0000","last_unstale":"2024-09-13T18:51:17.914304+0000","last_undegraded":"2024-09-13T18:51:17.914304+0000","last_fullsized":"2024-09-13T18:51:17.914304+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:50.559149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.950096+0000","last_change":"2024-09-13T18:51:17.948572+0000","last_active":"2024-09-13T18:51:17.950096+0000","last_peered":"2024-09-13T18:51:17.950096+0000","last_clean":"2024-09-13T18:51:17.950096+0000","last_became_active":"2024-09-13T18:51:17.948058+0000","last_became_peered":"2024-09-13T18:51:17.948058+0000","last_unstale":"2024-09-13T18:51:17.950096+0000","last_undegraded":"2024-09-13T18:51:17.950096+0000","last_fullsized":"2024-09-13T18:51:17.950096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:42.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943235+0000","last_change":"2024-09-13T18:51:17.462836+0000","last_active":"2024-09-13T18:51:17.943235+0000","last_peered":"2024-09-13T18:51:17.943235+0000","last_clean":"2024-09-13T18:51:17.943235+0000","last_became_active":"2024-09-13T18:51:17.462512+0000","last_became_peered":"2024-09-13T18:51:17.462512+0000","last_unstale":"2024-09-13T18:51:17.943235+0000","last_undegraded":"2024-09-13T18:51:17.943235+0000","last_fullsized":"2024-09-13T18:51:17.943235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:02.637290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.942615+0000","last_change":"2024-09-13T18:51:17.940681+0000","last_active":"2024-09-13T18:51:17.942615+0000","last_peered":"2024-09-13T18:51:17.942615+0000","last_clean":"2024-09-13T18:51:17.942615+0000","last_became_active":"2024-09-13T18:51:17.934486+0000","last_became_peered":"2024-09-13T18:51:17.934486+0000","last_unstale":"2024-09-13T18:51:17.942615+0000","last_undegraded":"2024-09-13T18:51:17.942615+0000","last_fullsized":"2024-09-13T18:51:17.942615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:31.252836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948187+0000","last_change":"2024-09-13T18:51:17.454939+0000","last_active":"2024-09-13T18:51:17.948187+0000","last_peered":"2024-09-13T18:51:17.948187+0000","last_clean":"2024-09-13T18:51:17.948187+0000","last_became_active":"2024-09-13T18:51:17.453180+0000","last_became_peered":"2024-09-13T18:51:17.453180+0000","last_unstale":"2024-09-13T18:51:17.948187+0000","last_undegraded":"2024-09-13T18:51:17.948187+0000","last_fullsized":"2024-09-13T18:51:17.948187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:33.254147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.935899+0000","last_change":"2024-09-13T18:51:17.929809+0000","last_active":"2024-09-13T18:51:17.935899+0000","last_peered":"2024-09-13T18:51:17.935899+0000","last_clean":"2024-09-13T18:51:17.935899+0000","last_became_active":"2024-09-13T18:51:17.929477+0000","last_became_peered":"2024-09-13T18:51:17.929477+0000","last_unstale":"2024-09-13T18:51:17.935899+0000","last_undegraded":"2024-09-13T18:51:17.935899+0000","last_fullsized":"2024-09-13T18:51:17.935899+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:38.726052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.949184+0000","last_change":"2024-09-13T18:51:17.466840+0000","last_active":"2024-09-13T18:51:17.949184+0000","last_peered":"2024-09-13T18:51:17.949184+0000","last_clean":"2024-09-13T18:51:17.949184+0000","last_became_active":"2024-09-13T18:51:17.466608+0000","last_became_peered":"2024-09-13T18:51:17.466608+0000","last_unstale":"2024-09-13T18:51:17.949184+0000","last_undegraded":"2024-09-13T18:51:17.949184+0000","last_fullsized":"2024-09-13T18:51:17.949184+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:50.559149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945884+0000","last_change":"2024-09-13T18:51:17.938259+0000","last_active":"2024-09-13T18:51:17.945884+0000","last_peered":"2024-09-13T18:51:17.945884+0000","last_clean":"2024-09-13T18:51:17.945884+0000","last_became_active":"2024-09-13T18:51:17.937993+0000","last_became_peered":"2024-09-13T18:51:17.937993+0000","last_unstale":"2024-09-13T18:51:17.945884+0000","last_undegraded":"2024-09-13T18:51:17.945884+0000","last_fullsized":"2024-09-13T18:51:17.945884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:03.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.920503+0000","last_change":"2024-09-13T18:51:17.465366+0000","last_active":"2024-09-13T18:51:17.920503+0000","last_peered":"2024-09-13T18:51:17.920503+0000","last_clean":"2024-09-13T18:51:17.920503+0000","last_became_active":"2024-09-13T18:51:17.465032+0000","last_became_peered":"2024-09-13T18:51:17.465032+0000","last_unstale":"2024-09-13T18:51:17.920503+0000","last_undegraded":"2024-09-13T18:51:17.920503+0000","last_fullsized":"2024-09-13T18:51:17.920503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:48.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941693+0000","last_change":"2024-09-13T18:51:17.936315+0000","last_active":"2024-09-13T18:51:17.941693+0000","last_peered":"2024-09-13T18:51:17.941693+0000","last_clean":"2024-09-13T18:51:17.941693+0000","last_became_active":"2024-09-13T18:51:17.936053+0000","last_became_peered":"2024-09-13T18:51:17.936053+0000","last_unstale":"2024-09-13T18:51:17.941693+0000","last_undegraded":"2024-09-13T18:51:17.941693+0000","last_fullsized":"2024-09-13T18:51:17.941693+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:56.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.927206+0000","last_change":"2024-09-13T18:51:17.463549+0000","last_active":"2024-09-13T18:51:17.927206+0000","last_peered":"2024-09-13T18:51:17.927206+0000","last_clean":"2024-09-13T18:51:17.927206+0000","last_became_active":"2024-09-13T18:51:17.463080+0000","last_became_peered":"2024-09-13T18:51:17.463080+0000","last_unstale":"2024-09-13T18:51:17.927206+0000","last_undegraded":"2024-09-13T18:51:17.927206+0000","last_fullsized":"2024-09-13T18:51:17.927206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.380248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928774+0000","last_change":"2024-09-13T18:51:17.924040+0000","last_active":"2024-09-13T18:51:17.928774+0000","last_peered":"2024-09-13T18:51:17.928774+0000","last_clean":"2024-09-13T18:51:17.928774+0000","last_became_active":"2024-09-13T18:51:17.923798+0000","last_became_peered":"2024-09-13T18:51:17.923798+0000","last_unstale":"2024-09-13T18:51:17.928774+0000","last_undegraded":"2024-09-13T18:51:17.928774+0000","last_fullsized":"2024-09-13T18:51:17.928774+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:42.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.938900+0000","last_change":"2024-09-13T18:51:17.460020+0000","last_active":"2024-09-13T18:51:17.938900+0000","last_peered":"2024-09-13T18:51:17.938900+0000","last_clean":"2024-09-13T18:51:17.938900+0000","last_became_active":"2024-09-13T18:51:17.459771+0000","last_became_peered":"2024-09-13T18:51:17.459771+0000","last_unstale":"2024-09-13T18:51:17.938900+0000","last_undegraded":"2024-09-13T18:51:17.938900+0000","last_fullsized":"2024-09-13T18:51:17.938900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:48.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945694+0000","last_change":"2024-09-13T18:51:17.944334+0000","last_active":"2024-09-13T18:51:17.945694+0000","last_peered":"2024-09-13T18:51:17.945694+0000","last_clean":"2024-09-13T18:51:17.945694+0000","last_became_active":"2024-09-13T18:51:17.940800+0000","last_became_peered":"2024-09-13T18:51:17.940800+0000","last_unstale":"2024-09-13T18:51:17.945694+0000","last_undegraded":"2024-09-13T18:51:17.945694+0000","last_fullsized":"2024-09-13T18:51:17.945694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.943058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.935607+0000","last_change":"2024-09-13T18:51:17.467375+0000","last_active":"2024-09-13T18:51:17.935607+0000","last_peered":"2024-09-13T18:51:17.935607+0000","last_clean":"2024-09-13T18:51:17.935607+0000","last_became_active":"2024-09-13T18:51:17.465541+0000","last_became_peered":"2024-09-13T18:51:17.465541+0000","last_unstale":"2024-09-13T18:51:17.935607+0000","last_undegraded":"2024-09-13T18:51:17.935607+0000","last_fullsized":"2024-09-13T18:51:17.935607+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:50.559149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.950616+0000","last_change":"2024-09-13T18:51:17.949511+0000","last_active":"2024-09-13T18:51:17.950616+0000","last_peered":"2024-09-13T18:51:17.950616+0000","last_clean":"2024-09-13T18:51:17.950616+0000","last_became_active":"2024-09-13T18:51:17.949193+0000","last_became_peered":"2024-09-13T18:51:17.949193+0000","last_unstale":"2024-09-13T18:51:17.950616+0000","last_undegraded":"2024-09-13T18:51:17.950616+0000","last_fullsized":"2024-09-13T18:51:17.950616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:44.875427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945008+0000","last_change":"2024-09-13T18:51:17.466030+0000","last_active":"2024-09-13T18:51:17.945008+0000","last_peered":"2024-09-13T18:51:17.945008+0000","last_clean":"2024-09-13T18:51:17.945008+0000","last_became_active":"2024-09-13T18:51:17.465574+0000","last_became_peered":"2024-09-13T18:51:17.465574+0000","last_unstale":"2024-09-13T18:51:17.945008+0000","last_undegraded":"2024-09-13T18:51:17.945008+0000","last_fullsized":"2024-09-13T18:51:17.945008+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:12.363044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946608+0000","last_change":"2024-09-13T18:51:17.944117+0000","last_active":"2024-09-13T18:51:17.946608+0000","last_peered":"2024-09-13T18:51:17.946608+0000","last_clean":"2024-09-13T18:51:17.946608+0000","last_became_active":"2024-09-13T18:51:17.943846+0000","last_became_peered":"2024-09-13T18:51:17.943846+0000","last_unstale":"2024-09-13T18:51:17.946608+0000","last_undegraded":"2024-09-13T18:51:17.946608+0000","last_fullsized":"2024-09-13T18:51:17.946608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:57.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.939028+0000","last_change":"2024-09-13T18:51:17.463037+0000","last_active":"2024-09-13T18:51:17.939028+0000","last_peered":"2024-09-13T18:51:17.939028+0000","last_clean":"2024-09-13T18:51:17.939028+0000","last_became_active":"2024-09-13T18:51:17.462520+0000","last_became_peered":"2024-09-13T18:51:17.462520+0000","last_unstale":"2024-09-13T18:51:17.939028+0000","last_undegraded":"2024-09-13T18:51:17.939028+0000","last_fullsized":"2024-09-13T18:51:17.939028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:18.603084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.944484+0000","last_change":"2024-09-13T18:51:17.942838+0000","last_active":"2024-09-13T18:51:17.944484+0000","last_peered":"2024-09-13T18:51:17.944484+0000","last_clean":"2024-09-13T18:51:17.944484+0000","last_became_active":"2024-09-13T18:51:17.942557+0000","last_became_peered":"2024-09-13T18:51:17.942557+0000","last_unstale":"2024-09-13T18:51:17.944484+0000","last_undegraded":"2024-09-13T18:51:17.944484+0000","last_fullsized":"2024-09-13T18:51:17.944484+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:59.150796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.926868+0000","last_change":"2024-09-13T18:51:17.463315+0000","last_active":"2024-09-13T18:51:17.926868+0000","last_peered":"2024-09-13T18:51:17.926868+0000","last_clean":"2024-09-13T18:51:17.926868+0000","last_became_active":"2024-09-13T18:51:17.462949+0000","last_became_peered":"2024-09-13T18:51:17.462949+0000","last_unstale":"2024-09-13T18:51:17.926868+0000","last_undegraded":"2024-09-13T18:51:17.926868+0000","last_fullsized":"2024-09-13T18:51:17.926868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:57.098140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928615+0000","last_change":"2024-09-13T18:51:17.918042+0000","last_active":"2024-09-13T18:51:17.928615+0000","last_peered":"2024-09-13T18:51:17.928615+0000","last_clean":"2024-09-13T18:51:17.928615+0000","last_became_active":"2024-09-13T18:51:17.917740+0000","last_became_peered":"2024-09-13T18:51:17.917740+0000","last_unstale":"2024-09-13T18:51:17.928615+0000","last_undegraded":"2024-09-13T18:51:17.928615+0000","last_fullsized":"2024-09-13T18:51:17.928615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:20.989004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.944035+0000","last_change":"2024-09-13T18:51:17.460596+0000","last_active":"2024-09-13T18:51:17.944035+0000","last_peered":"2024-09-13T18:51:17.944035+0000","last_clean":"2024-09-13T18:51:17.944035+0000","last_became_active":"2024-09-13T18:51:17.460339+0000","last_became_peered":"2024-09-13T18:51:17.460339+0000","last_unstale":"2024-09-13T18:51:17.944035+0000","last_undegraded":"2024-09-13T18:51:17.944035+0000","last_fullsized":"2024-09-13T18:51:17.944035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:41.389015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.934447+0000","last_change":"2024-09-13T18:51:17.930616+0000","last_active":"2024-09-13T18:51:17.934447+0000","last_peered":"2024-09-13T18:51:17.934447+0000","last_clean":"2024-09-13T18:51:17.934447+0000","last_became_active":"2024-09-13T18:51:17.929779+0000","last_became_peered":"2024-09-13T18:51:17.929779+0000","last_unstale":"2024-09-13T18:51:17.934447+0000","last_undegraded":"2024-09-13T18:51:17.934447+0000","last_fullsized":"2024-09-13T18:51:17.934447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:45.265416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.920614+0000","last_change":"2024-09-13T18:51:17.465367+0000","last_active":"2024-09-13T18:51:17.920614+0000","last_peered":"2024-09-13T18:51:17.920614+0000","last_clean":"2024-09-13T18:51:17.920614+0000","last_became_active":"2024-09-13T18:51:17.465006+0000","last_became_peered":"2024-09-13T18:51:17.465006+0000","last_unstale":"2024-09-13T18:51:17.920614+0000","last_undegraded":"2024-09-13T18:51:17.920614+0000","last_fullsized":"2024-09-13T18:51:17.920614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:12.363044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948377+0000","last_change":"2024-09-13T18:51:17.947009+0000","last_active":"2024-09-13T18:51:17.948377+0000","last_peered":"2024-09-13T18:51:17.948377+0000","last_clean":"2024-09-13T18:51:17.948377+0000","last_became_active":"2024-09-13T18:51:17.946332+0000","last_became_peered":"2024-09-13T18:51:17.946332+0000","last_unstale":"2024-09-13T18:51:17.948377+0000","last_undegraded":"2024-09-13T18:51:17.948377+0000","last_fullsized":"2024-09-13T18:51:17.948377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:39.247449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.908769+0000","last_change":"2024-09-13T18:51:17.457169+0000","last_active":"2024-09-13T18:51:17.908769+0000","last_peered":"2024-09-13T18:51:17.908769+0000","last_clean":"2024-09-13T18:51:17.908769+0000","last_became_active":"2024-09-13T18:51:17.456888+0000","last_became_peered":"2024-09-13T18:51:17.456888+0000","last_unstale":"2024-09-13T18:51:17.908769+0000","last_undegraded":"2024-09-13T18:51:17.908769+0000","last_fullsized":"2024-09-13T18:51:17.908769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:55.560111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928134+0000","last_change":"2024-09-13T18:51:17.918881+0000","last_active":"2024-09-13T18:51:17.928134+0000","last_peered":"2024-09-13T18:51:17.928134+0000","last_clean":"2024-09-13T18:51:17.928134+0000","last_became_active":"2024-09-13T18:51:17.918638+0000","last_became_peered":"2024-09-13T18:51:17.918638+0000","last_unstale":"2024-09-13T18:51:17.928134+0000","last_undegraded":"2024-09-13T18:51:17.928134+0000","last_fullsized":"2024-09-13T18:51:17.928134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:48.943263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941847+0000","last_change":"2024-09-13T18:51:17.468929+0000","last_active":"2024-09-13T18:51:17.941847+0000","last_peered":"2024-09-13T18:51:17.941847+0000","last_clean":"2024-09-13T18:51:17.941847+0000","last_became_active":"2024-09-13T18:51:17.468147+0000","last_became_peered":"2024-09-13T18:51:17.468147+0000","last_unstale":"2024-09-13T18:51:17.941847+0000","last_undegraded":"2024-09-13T18:51:17.941847+0000","last_fullsized":"2024-09-13T18:51:17.941847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:02.637290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.923967+0000","last_change":"2024-09-13T18:51:17.921207+0000","last_active":"2024-09-13T18:51:17.923967+0000","last_peered":"2024-09-13T18:51:17.923967+0000","last_clean":"2024-09-13T18:51:17.923967+0000","last_became_active":"2024-09-13T18:51:17.919955+0000","last_became_peered":"2024-09-13T18:51:17.919955+0000","last_unstale":"2024-09-13T18:51:17.923967+0000","last_undegraded":"2024-09-13T18:51:17.923967+0000","last_fullsized":"2024-09-13T18:51:17.923967+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:06.600265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.921586+0000","last_change":"2024-09-13T18:51:17.468983+0000","last_active":"2024-09-13T18:51:17.921586+0000","last_peered":"2024-09-13T18:51:17.921586+0000","last_clean":"2024-09-13T18:51:17.921586+0000","last_became_active":"2024-09-13T18:51:17.468381+0000","last_became_peered":"2024-09-13T18:51:17.468381+0000","last_unstale":"2024-09-13T18:51:17.921586+0000","last_undegraded":"2024-09-13T18:51:17.921586+0000","last_fullsized":"2024-09-13T18:51:17.921586+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:02.172649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945930+0000","last_change":"2024-09-13T18:51:17.936055+0000","last_active":"2024-09-13T18:51:17.945930+0000","last_peered":"2024-09-13T18:51:17.945930+0000","last_clean":"2024-09-13T18:51:17.945930+0000","last_became_active":"2024-09-13T18:51:17.934047+0000","last_became_peered":"2024-09-13T18:51:17.934047+0000","last_unstale":"2024-09-13T18:51:17.945930+0000","last_undegraded":"2024-09-13T18:51:17.945930+0000","last_fullsized":"2024-09-13T18:51:17.945930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:38.726052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.909491+0000","last_change":"2024-09-13T18:51:17.456273+0000","last_active":"2024-09-13T18:51:17.909491+0000","last_peered":"2024-09-13T18:51:17.909491+0000","last_clean":"2024-09-13T18:51:17.909491+0000","last_became_active":"2024-09-13T18:51:17.455985+0000","last_became_peered":"2024-09-13T18:51:17.455985+0000","last_unstale":"2024-09-13T18:51:17.909491+0000","last_undegraded":"2024-09-13T18:51:17.909491+0000","last_fullsized":"2024-09-13T18:51:17.909491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:41.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946320+0000","last_change":"2024-09-13T18:51:17.943353+0000","last_active":"2024-09-13T18:51:17.946320+0000","last_peered":"2024-09-13T18:51:17.946320+0000","last_clean":"2024-09-13T18:51:17.946320+0000","last_became_active":"2024-09-13T18:51:17.943098+0000","last_became_peered":"2024-09-13T18:51:17.943098+0000","last_unstale":"2024-09-13T18:51:17.946320+0000","last_undegraded":"2024-09-13T18:51:17.946320+0000","last_fullsized":"2024-09-13T18:51:17.946320+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:27.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.916998+0000","last_change":"2024-09-13T18:51:17.455282+0000","last_active":"2024-09-13T18:51:17.916998+0000","last_peered":"2024-09-13T18:51:17.916998+0000","last_clean":"2024-09-13T18:51:17.916998+0000","last_became_active":"2024-09-13T18:51:17.454699+0000","last_became_peered":"2024-09-13T18:51:17.454699+0000","last_unstale":"2024-09-13T18:51:17.916998+0000","last_undegraded":"2024-09-13T18:51:17.916998+0000","last_fullsized":"2024-09-13T18:51:17.916998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:57.735226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.942113+0000","last_change":"2024-09-13T18:51:17.941404+0000","last_active":"2024-09-13T18:51:17.942113+0000","last_peered":"2024-09-13T18:51:17.942113+0000","last_clean":"2024-09-13T18:51:17.942113+0000","last_became_active":"2024-09-13T18:51:17.940136+0000","last_became_peered":"2024-09-13T18:51:17.940136+0000","last_unstale":"2024-09-13T18:51:17.942113+0000","last_undegraded":"2024-09-13T18:51:17.942113+0000","last_fullsized":"2024-09-13T18:51:17.942113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:42.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928051+0000","last_change":"2024-09-13T18:51:17.463445+0000","last_active":"2024-09-13T18:51:17.928051+0000","last_peered":"2024-09-13T18:51:17.928051+0000","last_clean":"2024-09-13T18:51:17.928051+0000","last_became_active":"2024-09-13T18:51:17.463154+0000","last_became_peered":"2024-09-13T18:51:17.463154+0000","last_unstale":"2024-09-13T18:51:17.928051+0000","last_undegraded":"2024-09-13T18:51:17.928051+0000","last_fullsized":"2024-09-13T18:51:17.928051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:30.622815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932694+0000","last_change":"2024-09-13T18:51:17.926218+0000","last_active":"2024-09-13T18:51:17.932694+0000","last_peered":"2024-09-13T18:51:17.932694+0000","last_clean":"2024-09-13T18:51:17.932694+0000","last_became_active":"2024-09-13T18:51:17.925938+0000","last_became_peered":"2024-09-13T18:51:17.925938+0000","last_unstale":"2024-09-13T18:51:17.932694+0000","last_undegraded":"2024-09-13T18:51:17.932694+0000","last_fullsized":"2024-09-13T18:51:17.932694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:03.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924241+0000","last_change":"2024-09-13T18:51:17.457910+0000","last_active":"2024-09-13T18:51:17.924241+0000","last_peered":"2024-09-13T18:51:17.924241+0000","last_clean":"2024-09-13T18:51:17.924241+0000","last_became_active":"2024-09-13T18:51:17.457648+0000","last_became_peered":"2024-09-13T18:51:17.457648+0000","last_unstale":"2024-09-13T18:51:17.924241+0000","last_undegraded":"2024-09-13T18:51:17.924241+0000","last_fullsized":"2024-09-13T18:51:17.924241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:18.371231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.930053+0000","last_change":"2024-09-13T18:51:17.926457+0000","last_active":"2024-09-13T18:51:17.930053+0000","last_peered":"2024-09-13T18:51:17.930053+0000","last_clean":"2024-09-13T18:51:17.930053+0000","last_became_active":"2024-09-13T18:51:17.926223+0000","last_became_peered":"2024-09-13T18:51:17.926223+0000","last_unstale":"2024-09-13T18:51:17.930053+0000","last_undegraded":"2024-09-13T18:51:17.930053+0000","last_fullsized":"2024-09-13T18:51:17.930053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:56.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924776+0000","last_change":"2024-09-13T18:51:17.463876+0000","last_active":"2024-09-13T18:51:17.924776+0000","last_peered":"2024-09-13T18:51:17.924776+0000","last_clean":"2024-09-13T18:51:17.924776+0000","last_became_active":"2024-09-13T18:51:17.463566+0000","last_became_peered":"2024-09-13T18:51:17.463566+0000","last_unstale":"2024-09-13T18:51:17.924776+0000","last_undegraded":"2024-09-13T18:51:17.924776+0000","last_fullsized":"2024-09-13T18:51:17.924776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.255596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.927840+0000","last_change":"2024-09-13T18:51:17.923922+0000","last_active":"2024-09-13T18:51:17.927840+0000","last_peered":"2024-09-13T18:51:17.927840+0000","last_clean":"2024-09-13T18:51:17.927840+0000","last_became_active":"2024-09-13T18:51:17.923665+0000","last_became_peered":"2024-09-13T18:51:17.923665+0000","last_unstale":"2024-09-13T18:51:17.927840+0000","last_undegraded":"2024-09-13T18:51:17.927840+0000","last_fullsized":"2024-09-13T18:51:17.927840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:34.703437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.916464+0000","last_change":"2024-09-13T18:51:17.462534+0000","last_active":"2024-09-13T18:51:17.916464+0000","last_peered":"2024-09-13T18:51:17.916464+0000","last_clean":"2024-09-13T18:51:17.916464+0000","last_became_active":"2024-09-13T18:51:17.462257+0000","last_became_peered":"2024-09-13T18:51:17.462257+0000","last_unstale":"2024-09-13T18:51:17.916464+0000","last_undegraded":"2024-09-13T18:51:17.916464+0000","last_fullsized":"2024-09-13T18:51:17.916464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:44.248557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946427+0000","last_change":"2024-09-13T18:51:17.943659+0000","last_active":"2024-09-13T18:51:17.946427+0000","last_peered":"2024-09-13T18:51:17.946427+0000","last_clean":"2024-09-13T18:51:17.946427+0000","last_became_active":"2024-09-13T18:51:17.942484+0000","last_became_peered":"2024-09-13T18:51:17.942484+0000","last_unstale":"2024-09-13T18:51:17.946427+0000","last_undegraded":"2024-09-13T18:51:17.946427+0000","last_fullsized":"2024-09-13T18:51:17.946427+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:38.362886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.922247+0000","last_change":"2024-09-13T18:51:17.461190+0000","last_active":"2024-09-13T18:51:17.922247+0000","last_peered":"2024-09-13T18:51:17.922247+0000","last_clean":"2024-09-13T18:51:17.922247+0000","last_became_active":"2024-09-13T18:51:17.460895+0000","last_became_peered":"2024-09-13T18:51:17.460895+0000","last_unstale":"2024-09-13T18:51:17.922247+0000","last_undegraded":"2024-09-13T18:51:17.922247+0000","last_fullsized":"2024-09-13T18:51:17.922247+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:38.850005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.452856+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:51:17.452856+0000","last_peered":"2024-09-13T18:51:17.452856+0000","last_clean":"2024-09-13T18:51:17.452856+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:51:17.452856+0000","last_undegraded":"2024-09-13T18:51:17.452856+0000","last_fullsized":"2024-09-13T18:51:17.452856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1368064,"data_stored":937333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.88,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.341},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.73999999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.6479999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1299999999999999,"15min":1.141},"min":{"1min":0.85699999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.478,"5min":1.619,"15min":1.619},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.179,"15min":1.2250000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.7869999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.288,"15min":1.341},"min":{"1min":0.79400000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.194,"15min":1.208},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.462,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.27,"15min":1.276},"min":{"1min":0.88,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3799999999999999,"15min":1.444},"min":{"1min":1.071,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.861,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.861}]},{"osd":4,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.111,"15min":1.115},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.552,"15min":1.552},"last":1.546},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.218,"15min":1.1890000000000001},"min":{"1min":0.751,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.609}]},{"osd":5,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2749999999999999,"15min":1.325},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.9370000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2230000000000001,"15min":1.228},"min":{"1min":0.76900000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.6919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3919999999999999,"15min":1.405},"min":{"1min":1.2090000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.788,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.238},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.405,"15min":1.4239999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.4670000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":802816,"data_stored":360681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1080000000000001,"15min":1.1419999999999999},"min":{"1min":0.71599999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.506,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1379999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.119,"15min":1.117},"min":{"1min":0.83299999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.407,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.149,"5min":1.1899999999999999,"15min":1.204},"min":{"1min":0.83399999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.377,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.014}]},{"osd":2,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.337,"15min":1.4550000000000001},"min":{"1min":0.77900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4319999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.351,"15min":1.4950000000000001},"min":{"1min":0.86499999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.538,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.747}]},{"osd":3,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.401,"15min":1.518},"min":{"1min":0.91800000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.5529999999999999,"5min":4.883,"15min":4.883},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.266,"5min":1.4059999999999999,"15min":1.5369999999999999},"min":{"1min":0.90100000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.577,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.0720000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2470000000000001,"15min":1.3149999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5189999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3009999999999999,"15min":1.345},"min":{"1min":0.89800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.629,"5min":2.077,"15min":2.077},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.353,"15min":1.423},"min":{"1min":0.79700000000000004,"5min":0.755,"15min":0.755},"max":{"1min":1.764,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4590000000000001,"15min":1.49},"min":{"1min":1.1859999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":1.5720000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0389999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.4299999999999999,"15min":1.474},"min":{"1min":0.85499999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.516,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.456,"15min":1.5369999999999999},"min":{"1min":0.82299999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8169999999999999,"5min":2.367,"15min":2.367},"last":1.1399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1200000000000001,"15min":1.198},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3959999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.1519999999999999,"15min":1.1639999999999999},"min":{"1min":0.73999999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5880000000000001,"5min":2.278,"15min":2.278},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2250000000000001,"15min":1.276},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5389999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.411,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.238,"15min":1.29},"min":{"1min":0.70099999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5289999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.097},{"interface":"front","average":{"1min":1.109,"5min":1.2050000000000001,"15min":1.2629999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.532,"5min":2.157,"15min":2.157},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3160000000000001,"15min":1.3799999999999999},"min":{"1min":0.998,"5min":0.749,"15min":0.749},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3600000000000001,"15min":1.4419999999999999},"min":{"1min":0.88700000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.599,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.161,"15min":1.22},"min":{"1min":0.79100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3959999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.069},{"interface":"front","average":{"1min":1.228,"5min":1.254,"15min":1.282},"min":{"1min":0.93000000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6339999999999999,"5min":1.974,"15min":1.974},"last":1.2}]},{"osd":6,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2829999999999999,"15min":1.3080000000000001},"min":{"1min":0.85499999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.669,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3109999999999999,"15min":1.3580000000000001},"min":{"1min":0.93300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5049999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.1559999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":1.024,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.681,"5min":2.169,"15min":2.169},"last":1.024},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4630000000000001,"15min":1.52},"min":{"1min":1.1759999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.589,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.3360000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":362211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.135,"15min":1.139},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.159}]},{"osd":1,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3340000000000001,"15min":1.3640000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5840000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.256},{"interface":"front","average":{"1min":1.224,"5min":1.292,"15min":1.3300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.748,"5min":2.423,"15min":2.423},"last":1.052}]},{"osd":2,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.246,"15min":1.2889999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4910000000000001,"5min":1.99,"15min":1.99},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7110000000000001,"5min":2.335,"15min":2.335},"last":1.1879999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.258,"15min":1.3180000000000001},"min":{"1min":0.77800000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.633,"5min":2.621,"15min":2.621},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.2310000000000001,"15min":1.2729999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5389999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.1000000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2490000000000001,"15min":1.3160000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6279999999999999,"5min":2.274,"15min":2.274},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.3169999999999999},"min":{"1min":0.73899999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5860000000000001,"5min":2.266,"15min":2.266},"last":1.327}]},{"osd":6,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2829999999999999,"15min":1.359},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5960000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.4239999999999999,"15min":1.47},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.851,"5min":2.5,"15min":2.5},"last":1.387}]},{"osd":7,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.407,"15min":1.4650000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.944,"5min":2.395,"15min":2.395},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.4019999999999999,"15min":1.47},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.744,"5min":2.415,"15min":2.415},"last":1.4410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86599999999999999,"15min":0.90000000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1619999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86599999999999999,"15min":0.89000000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.2889999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.85299999999999998,"15min":0.872},"min":{"1min":0.625,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.997,"5min":1.468,"15min":1.468},"last":0.75},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.024,"15min":1.113},"min":{"1min":0.56299999999999994,"5min":0.505,"15min":0.505},"max":{"1min":1.2609999999999999,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.99099999999999999,"15min":0.998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.474,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.395},{"interface":"front","average":{"1min":1.145,"5min":1.1399999999999999,"15min":1.165},"min":{"1min":0.60399999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5549999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.198,"15min":1.244},"min":{"1min":0.872,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.458,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.194,"15min":1.24},"min":{"1min":0.92100000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.47,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2689999999999999,"15min":1.3220000000000001},"min":{"1min":0.95799999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4990000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.244},{"interface":"front","average":{"1min":1.25,"5min":1.321,"15min":1.379},"min":{"1min":0.90000000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4370000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.206}]},{"osd":6,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3759999999999999,"15min":1.4359999999999999},"min":{"1min":0.85399999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4399999999999999,"5min":2.714,"15min":2.714},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.365,"15min":1.4330000000000001},"min":{"1min":1.0880000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.637,"5min":2.52,"15min":2.52},"last":1.3520000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.413,"15min":1.5249999999999999},"min":{"1min":0.91600000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.446},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.4399999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5089999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88600000000000001,"15min":0.99399999999999999},"min":{"1min":0.59999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2769999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.93799999999999994,"15min":1.0640000000000001},"min":{"1min":0.60099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0089999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.998,"15min":1.151},"min":{"1min":0.61899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.347,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.2430000000000001},"min":{"1min":0.88500000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6679999999999999,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.018}]},{"osd":3,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2330000000000001,"15min":1.333},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4870000000000001,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.121,"15min":1.24},"min":{"1min":0.70399999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6040000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.46,"15min":1.6830000000000001},"min":{"1min":1.02,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.486,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.3500000000000001,"15min":1.464},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.6739999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.159}]},{"osd":5,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.4119999999999999,"15min":1.528},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.8740000000000001,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.373,"15min":1.5049999999999999},"min":{"1min":1.0169999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7370000000000001,"5min":4.335,"15min":4.335},"last":1.1299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.423,"15min":1.5600000000000001},"min":{"1min":0.93799999999999994,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5800000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.524},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.53,"15min":1.7909999999999999},"min":{"1min":0.996,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.5049999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.2470000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4610000000000001,"15min":1.5800000000000001},"min":{"1min":1.081,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.8480000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.284},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4930000000000001,"15min":1.635},"min":{"1min":1.0960000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6359999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.427}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1020000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.94799999999999995,"15min":1.0700000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.115,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1240000000000001,"15min":1.2010000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.9350000000000001,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0389999999999999,"15min":1.083},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.804,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2370000000000001,"15min":1.337},"min":{"1min":0.70099999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.637,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.2430000000000001,"15min":1.444},"min":{"1min":0.57099999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.768,"5min":10.368,"15min":10.368},"last":1.141}]},{"osd":4,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3180000000000001,"15min":1.391},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8660000000000001,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.3109999999999999,"15min":1.373},"min":{"1min":0.82499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.958,"5min":2.911,"15min":2.911},"last":1.1180000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.496,"15min":1.772},"min":{"1min":1.01,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.464,"5min":10.214,"15min":10.214},"last":1.095},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.399,"15min":1.4950000000000001},"min":{"1min":0.80700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.659,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.1990000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.45,"15min":1.603},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.915,"5min":6.032,"15min":6.032},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.5469999999999999,"15min":1.8149999999999999},"min":{"1min":1.0269999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6870000000000001,"5min":10.112,"15min":10.112},"last":1.1870000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.609,"15min":1.8759999999999999},"min":{"1min":1.107,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.649,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.48,"15min":1.5880000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.762,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3480000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1368064,"data_stored":937333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.88200000000000001,"15min":1.014},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.405,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91400000000000003,"15min":1.014},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5149999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.119}]},{"osd":2,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.028,"15min":1.165},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.204,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.099,"15min":1.232},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3959999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.103,"15min":1.21},"min":{"1min":0.55400000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.319,"5min":4.093,"15min":4.093},"last":1.145},{"interface":"front","average":{"1min":1.079,"5min":1.2909999999999999,"15min":1.4419999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.456}]},{"osd":4,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3320000000000001,"15min":1.464},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5640000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.407},{"interface":"front","average":{"1min":1.266,"5min":1.3620000000000001,"15min":1.474},"min":{"1min":0.93400000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.518,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.371}]},{"osd":5,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.472,"15min":1.6419999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5589999999999999,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.288},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4079999999999999,"15min":1.5629999999999999},"min":{"1min":0.97099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6000000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.502}]},{"osd":6,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.4119999999999999,"15min":1.571},"min":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.581,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.429},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5269999999999999,"15min":1.73},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.631,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.556}]},{"osd":7,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.472,"15min":1.6160000000000001},"min":{"1min":0.873,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.538,"5min":3.056,"15min":3.056},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.472,"15min":1.6459999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.579,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.5269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:51:22.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:51:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.449+0000 7f22c9000700 1 Processor -- start 2024-09-13T18:51:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c9000700 1 -- start start 2024-09-13T18:51:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c9000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c40ccb40 con 0x7f22c40cb020 2024-09-13T18:51:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c9000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c406b430 con 0x7f22c40cc6f0 2024-09-13T18:51:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40b2ad0 con 0x7f22c406aaa0 2024-09-13T18:51:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c3400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f22c40cb020 0x7f22c415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35454/0 (socket says 172.21.15.81:35454) 2024-09-13T18:51:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c3400700 1 -- 172.21.15.81:0/783490807 learned_addr learned my addr 172.21.15.81:0/783490807 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c3e00700 1 --2- 172.21.15.81:0/783490807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826326856 0 0) 0x7f22c40ccb40 con 0x7f22c40cb020 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a80035d0 con 0x7f22c40cb020 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569455992 0 0) 0x7f22ac001110 con 0x7f22c40cc6f0 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c40ccb40 con 0x7f22c40cc6f0 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c3e00700 1 -- 172.21.15.81:0/783490807 >> v1:172.21.15.178:6789/0 conn(0x7f22c40cc6f0 legacy=0x7f22c415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c3e00700 1 -- 172.21.15.81:0/783490807 >> v1:172.21.15.81:6789/0 conn(0x7f22c40cb020 legacy=0x7f22c415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.453+0000 7f22c3e00700 1 -- 172.21.15.81:0/783490807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c415b960 con 0x7f22c406aaa0 2024-09-13T18:51:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c3e00700 1 --2- 172.21.15.81:0/783490807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c406aef0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009dc0 tx=0x7f22bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d10b29cb23bc0ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc00e070 con 0x7f22c406aaa0 2024-09-13T18:51:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc00bb20 con 0x7f22c406aaa0 2024-09-13T18:51:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c2a00700 1 -- 172.21.15.81:0/783490807 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc012430 con 0x7f22c406aaa0 2024-09-13T18:51:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 -- 172.21.15.81:0/783490807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 msgr2=0x7f22c406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 --2- 172.21.15.81:0/783490807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c406aef0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009dc0 tx=0x7f22bc00b330 comp rx=0 tx=0).stop 2024-09-13T18:51:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 -- 172.21.15.81:0/783490807 shutdown_connections 2024-09-13T18:51:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 --2- 172.21.15.81:0/783490807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c406aef0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 -- 172.21.15.81:0/783490807 >> 172.21.15.81:0/783490807 conn(0x7f22c40b0c40 msgr2=0x7f22c406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 -- 172.21.15.81:0/783490807 shutdown_connections 2024-09-13T18:51:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.457+0000 7f22c9000700 1 -- 172.21.15.81:0/783490807 wait complete. 2024-09-13T18:51:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 Processor -- start 2024-09-13T18:51:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 -- start start 2024-09-13T18:51:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c4142f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 0x7f22c41596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22c40cc6f0 0x7f22c40b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4155b20 con 0x7f22c40cb020 2024-09-13T18:51:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4155e00 con 0x7f22c40cc6f0 2024-09-13T18:51:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41560e0 con 0x7f22c406aaa0 2024-09-13T18:51:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 0x7f22c41596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 0x7f22c41596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53066/0 (socket says 172.21.15.81:53066) 2024-09-13T18:51:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 -- 172.21.15.81:0/271548593 learned_addr learned my addr 172.21.15.81:0/271548593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c3e00700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22c40cc6f0 0x7f22c40b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c3400700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c4142f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 -- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 msgr2=0x7f22c4142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c4142f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 -- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22c40cc6f0 msgr2=0x7f22c40b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22c40cc6f0 0x7f22c40b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 -- 172.21.15.81:0/271548593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009a70 con 0x7f22c40cb020 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bbe00700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 0x7f22c41596f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00c4d0 tx=0x7f22ac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0052d0 con 0x7f22c40cb020 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac005450 con 0x7f22c40cb020 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0038e0 con 0x7f22c40cb020 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.461+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c41563c0 con 0x7f22c40cb020 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.465+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c41557a0 con 0x7f22c40cb020 2024-09-13T18:51:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.465+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c406aef0 con 0x7f22c40cb020 2024-09-13T18:51:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.465+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f22ac003a40 con 0x7f22c40cb020 2024-09-13T18:51:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.469+0000 7f22bb400700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f22a0066730 0x7f22a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.469+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f22ac083610 con 0x7f22c40cb020 2024-09-13T18:51:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.469+0000 7f22c3400700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f22a0066730 0x7f22a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.469+0000 7f22c3400700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f22a0066730 0x7f22a0068bf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f22b40011e0 tx=0x7f22b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.477+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22ac050830 con 0x7f22c40cb020 2024-09-13T18:51:22.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.661+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22c4155f70 con 0x7f22a0066730 2024-09-13T18:51:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.673+0000 7f22bb400700 1 -- 172.21.15.81:0/271548593 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286725 (secure 0 0 0) 0x7f22c4155f70 con 0x7f22a0066730 2024-09-13T18:51:22.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f22a0066730 msgr2=0x7f22a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f22a0066730 0x7f22a0068bf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f22b40011e0 tx=0x7f22b4009040 comp rx=0 tx=0).stop 2024-09-13T18:51:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 msgr2=0x7f22c41596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 0x7f22c41596f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00c4d0 tx=0x7f22ac00c890 comp rx=0 tx=0).stop 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 shutdown_connections 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f22a0066730 0x7f22a0068bf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22c40cc6f0 0x7f22c40b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22c40cb020 0x7f22c41596f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 --2- 172.21.15.81:0/271548593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22c406aaa0 0x7f22c4142f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 >> 172.21.15.81:0/271548593 conn(0x7f22c40b0c40 msgr2=0x7f22c406fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 shutdown_connections 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.681+0000 7f22c9000700 1 -- 172.21.15.81:0/271548593 wait complete. 2024-09-13T18:51:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:51:22.715 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2024-09-13T18:51:21.052185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243928,"kb_used_data":7272,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754730792,"statfs":{"total":773094113280,"available":772844331008,"internally_reserved":0,"allocated":7446528,"data_stored":3985418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":242208315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.630088"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931449+0000","last_change":"2024-09-13T18:51:17.927705+0000","last_active":"2024-09-13T18:51:17.931449+0000","last_peered":"2024-09-13T18:51:17.931449+0000","last_clean":"2024-09-13T18:51:17.931449+0000","last_became_active":"2024-09-13T18:51:17.927034+0000","last_became_peered":"2024-09-13T18:51:17.927034+0000","last_unstale":"2024-09-13T18:51:17.931449+0000","last_undegraded":"2024-09-13T18:51:17.931449+0000","last_fullsized":"2024-09-13T18:51:17.931449+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:42.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932124+0000","last_change":"2024-09-13T18:51:17.930600+0000","last_active":"2024-09-13T18:51:17.932124+0000","last_peered":"2024-09-13T18:51:17.932124+0000","last_clean":"2024-09-13T18:51:17.932124+0000","last_became_active":"2024-09-13T18:51:17.930330+0000","last_became_peered":"2024-09-13T18:51:17.930330+0000","last_unstale":"2024-09-13T18:51:17.932124+0000","last_undegraded":"2024-09-13T18:51:17.932124+0000","last_fullsized":"2024-09-13T18:51:17.932124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:31.252836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943614+0000","last_change":"2024-09-13T18:51:17.940292+0000","last_active":"2024-09-13T18:51:17.943614+0000","last_peered":"2024-09-13T18:51:17.943614+0000","last_clean":"2024-09-13T18:51:17.943614+0000","last_became_active":"2024-09-13T18:51:17.938710+0000","last_became_peered":"2024-09-13T18:51:17.938710+0000","last_unstale":"2024-09-13T18:51:17.943614+0000","last_undegraded":"2024-09-13T18:51:17.943614+0000","last_fullsized":"2024-09-13T18:51:17.943614+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:45.265416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932603+0000","last_change":"2024-09-13T18:51:17.923127+0000","last_active":"2024-09-13T18:51:17.932603+0000","last_peered":"2024-09-13T18:51:17.932603+0000","last_clean":"2024-09-13T18:51:17.932603+0000","last_became_active":"2024-09-13T18:51:17.922893+0000","last_became_peered":"2024-09-13T18:51:17.922893+0000","last_unstale":"2024-09-13T18:51:17.932603+0000","last_undegraded":"2024-09-13T18:51:17.932603+0000","last_fullsized":"2024-09-13T18:51:17.932603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:07.452764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.950613+0000","last_change":"2024-09-13T18:51:17.949374+0000","last_active":"2024-09-13T18:51:17.950613+0000","last_peered":"2024-09-13T18:51:17.950613+0000","last_clean":"2024-09-13T18:51:17.950613+0000","last_became_active":"2024-09-13T18:51:17.949093+0000","last_became_peered":"2024-09-13T18:51:17.949093+0000","last_unstale":"2024-09-13T18:51:17.950613+0000","last_undegraded":"2024-09-13T18:51:17.950613+0000","last_fullsized":"2024-09-13T18:51:17.950613+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:39.866865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932935+0000","last_change":"2024-09-13T18:51:17.931220+0000","last_active":"2024-09-13T18:51:17.932935+0000","last_peered":"2024-09-13T18:51:17.932935+0000","last_clean":"2024-09-13T18:51:17.932935+0000","last_became_active":"2024-09-13T18:51:17.928990+0000","last_became_peered":"2024-09-13T18:51:17.928990+0000","last_unstale":"2024-09-13T18:51:17.932935+0000","last_undegraded":"2024-09-13T18:51:17.932935+0000","last_fullsized":"2024-09-13T18:51:17.932935+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:19.388090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931660+0000","last_change":"2024-09-13T18:51:17.928048+0000","last_active":"2024-09-13T18:51:17.931660+0000","last_peered":"2024-09-13T18:51:17.931660+0000","last_clean":"2024-09-13T18:51:17.931660+0000","last_became_active":"2024-09-13T18:51:17.927819+0000","last_became_peered":"2024-09-13T18:51:17.927819+0000","last_unstale":"2024-09-13T18:51:17.931660+0000","last_undegraded":"2024-09-13T18:51:17.931660+0000","last_fullsized":"2024-09-13T18:51:17.931660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:06:23.633257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945792+0000","last_change":"2024-09-13T18:51:17.935604+0000","last_active":"2024-09-13T18:51:17.945792+0000","last_peered":"2024-09-13T18:51:17.945792+0000","last_clean":"2024-09-13T18:51:17.945792+0000","last_became_active":"2024-09-13T18:51:17.933458+0000","last_became_peered":"2024-09-13T18:51:17.933458+0000","last_unstale":"2024-09-13T18:51:17.945792+0000","last_undegraded":"2024-09-13T18:51:17.945792+0000","last_fullsized":"2024-09-13T18:51:17.945792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:18.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.947293+0000","last_change":"2024-09-13T18:51:17.945325+0000","last_active":"2024-09-13T18:51:17.947293+0000","last_peered":"2024-09-13T18:51:17.947293+0000","last_clean":"2024-09-13T18:51:17.947293+0000","last_became_active":"2024-09-13T18:51:17.945056+0000","last_became_peered":"2024-09-13T18:51:17.945056+0000","last_unstale":"2024-09-13T18:51:17.947293+0000","last_undegraded":"2024-09-13T18:51:17.947293+0000","last_fullsized":"2024-09-13T18:51:17.947293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:18.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941983+0000","last_change":"2024-09-13T18:51:17.938106+0000","last_active":"2024-09-13T18:51:17.941983+0000","last_peered":"2024-09-13T18:51:17.941983+0000","last_clean":"2024-09-13T18:51:17.941983+0000","last_became_active":"2024-09-13T18:51:17.937837+0000","last_became_peered":"2024-09-13T18:51:17.937837+0000","last_unstale":"2024-09-13T18:51:17.941983+0000","last_undegraded":"2024-09-13T18:51:17.941983+0000","last_fullsized":"2024-09-13T18:51:17.941983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:27.251370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932792+0000","last_change":"2024-09-13T18:51:17.927165+0000","last_active":"2024-09-13T18:51:17.932792+0000","last_peered":"2024-09-13T18:51:17.932792+0000","last_clean":"2024-09-13T18:51:17.932792+0000","last_became_active":"2024-09-13T18:51:17.926919+0000","last_became_peered":"2024-09-13T18:51:17.926919+0000","last_unstale":"2024-09-13T18:51:17.932792+0000","last_undegraded":"2024-09-13T18:51:17.932792+0000","last_fullsized":"2024-09-13T18:51:17.932792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:16.838884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.934434+0000","last_change":"2024-09-13T18:51:17.930021+0000","last_active":"2024-09-13T18:51:17.934434+0000","last_peered":"2024-09-13T18:51:17.934434+0000","last_clean":"2024-09-13T18:51:17.934434+0000","last_became_active":"2024-09-13T18:51:17.929670+0000","last_became_peered":"2024-09-13T18:51:17.929670+0000","last_unstale":"2024-09-13T18:51:17.934434+0000","last_undegraded":"2024-09-13T18:51:17.934434+0000","last_fullsized":"2024-09-13T18:51:17.934434+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.382047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945780+0000","last_change":"2024-09-13T18:51:17.933876+0000","last_active":"2024-09-13T18:51:17.945780+0000","last_peered":"2024-09-13T18:51:17.945780+0000","last_clean":"2024-09-13T18:51:17.945780+0000","last_became_active":"2024-09-13T18:51:17.931297+0000","last_became_peered":"2024-09-13T18:51:17.931297+0000","last_unstale":"2024-09-13T18:51:17.945780+0000","last_undegraded":"2024-09-13T18:51:17.945780+0000","last_fullsized":"2024-09-13T18:51:17.945780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.602736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943560+0000","last_change":"2024-09-13T18:51:17.939482+0000","last_active":"2024-09-13T18:51:17.943560+0000","last_peered":"2024-09-13T18:51:17.943560+0000","last_clean":"2024-09-13T18:51:17.943560+0000","last_became_active":"2024-09-13T18:51:17.939184+0000","last_became_peered":"2024-09-13T18:51:17.939184+0000","last_unstale":"2024-09-13T18:51:17.943560+0000","last_undegraded":"2024-09-13T18:51:17.943560+0000","last_fullsized":"2024-09-13T18:51:17.943560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:03.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940657+0000","last_change":"2024-09-13T18:51:17.937628+0000","last_active":"2024-09-13T18:51:17.940657+0000","last_peered":"2024-09-13T18:51:17.940657+0000","last_clean":"2024-09-13T18:51:17.940657+0000","last_became_active":"2024-09-13T18:51:17.937313+0000","last_became_peered":"2024-09-13T18:51:17.937313+0000","last_unstale":"2024-09-13T18:51:17.940657+0000","last_undegraded":"2024-09-13T18:51:17.940657+0000","last_fullsized":"2024-09-13T18:51:17.940657+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:07.452764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.927427+0000","last_change":"2024-09-13T18:51:17.924086+0000","last_active":"2024-09-13T18:51:17.927427+0000","last_peered":"2024-09-13T18:51:17.927427+0000","last_clean":"2024-09-13T18:51:17.927427+0000","last_became_active":"2024-09-13T18:51:17.923814+0000","last_became_peered":"2024-09-13T18:51:17.923814+0000","last_unstale":"2024-09-13T18:51:17.927427+0000","last_undegraded":"2024-09-13T18:51:17.927427+0000","last_fullsized":"2024-09-13T18:51:17.927427+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:19.098546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931467+0000","last_change":"2024-09-13T18:51:17.927874+0000","last_active":"2024-09-13T18:51:17.931467+0000","last_peered":"2024-09-13T18:51:17.931467+0000","last_clean":"2024-09-13T18:51:17.931467+0000","last_became_active":"2024-09-13T18:51:17.927426+0000","last_became_peered":"2024-09-13T18:51:17.927426+0000","last_unstale":"2024-09-13T18:51:17.931467+0000","last_undegraded":"2024-09-13T18:51:17.931467+0000","last_fullsized":"2024-09-13T18:51:17.931467+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:28.189074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.936347+0000","last_change":"2024-09-13T18:51:17.932140+0000","last_active":"2024-09-13T18:51:17.936347+0000","last_peered":"2024-09-13T18:51:17.936347+0000","last_clean":"2024-09-13T18:51:17.936347+0000","last_became_active":"2024-09-13T18:51:17.929836+0000","last_became_peered":"2024-09-13T18:51:17.929836+0000","last_unstale":"2024-09-13T18:51:17.936347+0000","last_undegraded":"2024-09-13T18:51:17.936347+0000","last_fullsized":"2024-09-13T18:51:17.936347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:18.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941895+0000","last_change":"2024-09-13T18:51:17.939463+0000","last_active":"2024-09-13T18:51:17.941895+0000","last_peered":"2024-09-13T18:51:17.941895+0000","last_clean":"2024-09-13T18:51:17.941895+0000","last_became_active":"2024-09-13T18:51:17.937069+0000","last_became_peered":"2024-09-13T18:51:17.937069+0000","last_unstale":"2024-09-13T18:51:17.941895+0000","last_undegraded":"2024-09-13T18:51:17.941895+0000","last_fullsized":"2024-09-13T18:51:17.941895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:17:28.189074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945636+0000","last_change":"2024-09-13T18:51:17.944735+0000","last_active":"2024-09-13T18:51:17.945636+0000","last_peered":"2024-09-13T18:51:17.945636+0000","last_clean":"2024-09-13T18:51:17.945636+0000","last_became_active":"2024-09-13T18:51:17.944434+0000","last_became_peered":"2024-09-13T18:51:17.944434+0000","last_unstale":"2024-09-13T18:51:17.945636+0000","last_undegraded":"2024-09-13T18:51:17.945636+0000","last_fullsized":"2024-09-13T18:51:17.945636+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:41:25.004427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.933974+0000","last_change":"2024-09-13T18:51:17.929264+0000","last_active":"2024-09-13T18:51:17.933974+0000","last_peered":"2024-09-13T18:51:17.933974+0000","last_clean":"2024-09-13T18:51:17.933974+0000","last_became_active":"2024-09-13T18:51:17.929034+0000","last_became_peered":"2024-09-13T18:51:17.929034+0000","last_unstale":"2024-09-13T18:51:17.933974+0000","last_undegraded":"2024-09-13T18:51:17.933974+0000","last_fullsized":"2024-09-13T18:51:17.933974+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:31.252836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941239+0000","last_change":"2024-09-13T18:51:17.938102+0000","last_active":"2024-09-13T18:51:17.941239+0000","last_peered":"2024-09-13T18:51:17.941239+0000","last_clean":"2024-09-13T18:51:17.941239+0000","last_became_active":"2024-09-13T18:51:17.937787+0000","last_became_peered":"2024-09-13T18:51:17.937787+0000","last_unstale":"2024-09-13T18:51:17.941239+0000","last_undegraded":"2024-09-13T18:51:17.941239+0000","last_fullsized":"2024-09-13T18:51:17.941239+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:38.158358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940261+0000","last_change":"2024-09-13T18:51:17.937253+0000","last_active":"2024-09-13T18:51:17.940261+0000","last_peered":"2024-09-13T18:51:17.940261+0000","last_clean":"2024-09-13T18:51:17.940261+0000","last_became_active":"2024-09-13T18:51:17.936909+0000","last_became_peered":"2024-09-13T18:51:17.936909+0000","last_unstale":"2024-09-13T18:51:17.940261+0000","last_undegraded":"2024-09-13T18:51:17.940261+0000","last_fullsized":"2024-09-13T18:51:17.940261+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:19.625970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940689+0000","last_change":"2024-09-13T18:51:17.937749+0000","last_active":"2024-09-13T18:51:17.940689+0000","last_peered":"2024-09-13T18:51:17.940689+0000","last_clean":"2024-09-13T18:51:17.940689+0000","last_became_active":"2024-09-13T18:51:17.937498+0000","last_became_peered":"2024-09-13T18:51:17.937498+0000","last_unstale":"2024-09-13T18:51:17.940689+0000","last_undegraded":"2024-09-13T18:51:17.940689+0000","last_fullsized":"2024-09-13T18:51:17.940689+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:16.838884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.947685+0000","last_change":"2024-09-13T18:51:17.934009+0000","last_active":"2024-09-13T18:51:17.947685+0000","last_peered":"2024-09-13T18:51:17.947685+0000","last_clean":"2024-09-13T18:51:17.947685+0000","last_became_active":"2024-09-13T18:51:17.933691+0000","last_became_peered":"2024-09-13T18:51:17.933691+0000","last_unstale":"2024-09-13T18:51:17.947685+0000","last_undegraded":"2024-09-13T18:51:17.947685+0000","last_fullsized":"2024-09-13T18:51:17.947685+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:57.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.936125+0000","last_change":"2024-09-13T18:51:17.930356+0000","last_active":"2024-09-13T18:51:17.936125+0000","last_peered":"2024-09-13T18:51:17.936125+0000","last_clean":"2024-09-13T18:51:17.936125+0000","last_became_active":"2024-09-13T18:51:17.930112+0000","last_became_peered":"2024-09-13T18:51:17.930112+0000","last_unstale":"2024-09-13T18:51:17.936125+0000","last_undegraded":"2024-09-13T18:51:17.936125+0000","last_fullsized":"2024-09-13T18:51:17.936125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:16.838884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931244+0000","last_change":"2024-09-13T18:51:17.922405+0000","last_active":"2024-09-13T18:51:17.931244+0000","last_peered":"2024-09-13T18:51:17.931244+0000","last_clean":"2024-09-13T18:51:17.931244+0000","last_became_active":"2024-09-13T18:51:17.922037+0000","last_became_peered":"2024-09-13T18:51:17.922037+0000","last_unstale":"2024-09-13T18:51:17.931244+0000","last_undegraded":"2024-09-13T18:51:17.931244+0000","last_fullsized":"2024-09-13T18:51:17.931244+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.382047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.940349+0000","last_change":"2024-09-13T18:51:17.937597+0000","last_active":"2024-09-13T18:51:17.940349+0000","last_peered":"2024-09-13T18:51:17.940349+0000","last_clean":"2024-09-13T18:51:17.940349+0000","last_became_active":"2024-09-13T18:51:17.937352+0000","last_became_peered":"2024-09-13T18:51:17.937352+0000","last_unstale":"2024-09-13T18:51:17.940349+0000","last_undegraded":"2024-09-13T18:51:17.940349+0000","last_fullsized":"2024-09-13T18:51:17.940349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:27.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.944772+0000","last_change":"2024-09-13T18:51:17.943755+0000","last_active":"2024-09-13T18:51:17.944772+0000","last_peered":"2024-09-13T18:51:17.944772+0000","last_clean":"2024-09-13T18:51:17.944772+0000","last_became_active":"2024-09-13T18:51:17.941345+0000","last_became_peered":"2024-09-13T18:51:17.941345+0000","last_unstale":"2024-09-13T18:51:17.944772+0000","last_undegraded":"2024-09-13T18:51:17.944772+0000","last_fullsized":"2024-09-13T18:51:17.944772+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:27.382047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945895+0000","last_change":"2024-09-13T18:51:17.941265+0000","last_active":"2024-09-13T18:51:17.945895+0000","last_peered":"2024-09-13T18:51:17.945895+0000","last_clean":"2024-09-13T18:51:17.945895+0000","last_became_active":"2024-09-13T18:51:17.941027+0000","last_became_peered":"2024-09-13T18:51:17.941027+0000","last_unstale":"2024-09-13T18:51:17.945895+0000","last_undegraded":"2024-09-13T18:51:17.945895+0000","last_fullsized":"2024-09-13T18:51:17.945895+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:07.452764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924533+0000","last_change":"2024-09-13T18:51:17.917749+0000","last_active":"2024-09-13T18:51:17.924533+0000","last_peered":"2024-09-13T18:51:17.924533+0000","last_clean":"2024-09-13T18:51:17.924533+0000","last_became_active":"2024-09-13T18:51:17.917464+0000","last_became_peered":"2024-09-13T18:51:17.917464+0000","last_unstale":"2024-09-13T18:51:17.924533+0000","last_undegraded":"2024-09-13T18:51:17.924533+0000","last_fullsized":"2024-09-13T18:51:17.924533+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:27.251370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928593+0000","last_change":"2024-09-13T18:51:17.917811+0000","last_active":"2024-09-13T18:51:17.928593+0000","last_peered":"2024-09-13T18:51:17.928593+0000","last_clean":"2024-09-13T18:51:17.928593+0000","last_became_active":"2024-09-13T18:51:17.917557+0000","last_became_peered":"2024-09-13T18:51:17.917557+0000","last_unstale":"2024-09-13T18:51:17.928593+0000","last_undegraded":"2024-09-13T18:51:17.928593+0000","last_fullsized":"2024-09-13T18:51:17.928593+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:30.272456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946575+0000","last_change":"2024-09-13T18:51:17.943450+0000","last_active":"2024-09-13T18:51:17.946575+0000","last_peered":"2024-09-13T18:51:17.946575+0000","last_clean":"2024-09-13T18:51:17.946575+0000","last_became_active":"2024-09-13T18:51:17.940908+0000","last_became_peered":"2024-09-13T18:51:17.940908+0000","last_unstale":"2024-09-13T18:51:17.946575+0000","last_undegraded":"2024-09-13T18:51:17.946575+0000","last_fullsized":"2024-09-13T18:51:17.946575+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:16.961384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.939624+0000","last_change":"2024-09-13T18:51:17.464441+0000","last_active":"2024-09-13T18:51:17.939624+0000","last_peered":"2024-09-13T18:51:17.939624+0000","last_clean":"2024-09-13T18:51:17.939624+0000","last_became_active":"2024-09-13T18:51:17.464189+0000","last_became_peered":"2024-09-13T18:51:17.464189+0000","last_unstale":"2024-09-13T18:51:17.939624+0000","last_undegraded":"2024-09-13T18:51:17.939624+0000","last_fullsized":"2024-09-13T18:51:17.939624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:31.926199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948055+0000","last_change":"2024-09-13T18:51:17.945286+0000","last_active":"2024-09-13T18:51:17.948055+0000","last_peered":"2024-09-13T18:51:17.948055+0000","last_clean":"2024-09-13T18:51:17.948055+0000","last_became_active":"2024-09-13T18:51:17.945016+0000","last_became_peered":"2024-09-13T18:51:17.945016+0000","last_unstale":"2024-09-13T18:51:17.948055+0000","last_undegraded":"2024-09-13T18:51:17.948055+0000","last_fullsized":"2024-09-13T18:51:17.948055+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:33.602736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.933775+0000","last_change":"2024-09-13T18:51:17.462100+0000","last_active":"2024-09-13T18:51:17.933775+0000","last_peered":"2024-09-13T18:51:17.933775+0000","last_clean":"2024-09-13T18:51:17.933775+0000","last_became_active":"2024-09-13T18:51:17.461697+0000","last_became_peered":"2024-09-13T18:51:17.461697+0000","last_unstale":"2024-09-13T18:51:17.933775+0000","last_undegraded":"2024-09-13T18:51:17.933775+0000","last_fullsized":"2024-09-13T18:51:17.933775+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:40.427681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928026+0000","last_change":"2024-09-13T18:51:17.919507+0000","last_active":"2024-09-13T18:51:17.928026+0000","last_peered":"2024-09-13T18:51:17.928026+0000","last_clean":"2024-09-13T18:51:17.928026+0000","last_became_active":"2024-09-13T18:51:17.919272+0000","last_became_peered":"2024-09-13T18:51:17.919272+0000","last_unstale":"2024-09-13T18:51:17.928026+0000","last_undegraded":"2024-09-13T18:51:17.928026+0000","last_fullsized":"2024-09-13T18:51:17.928026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:02.539977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928773+0000","last_change":"2024-09-13T18:51:17.461792+0000","last_active":"2024-09-13T18:51:17.928773+0000","last_peered":"2024-09-13T18:51:17.928773+0000","last_clean":"2024-09-13T18:51:17.928773+0000","last_became_active":"2024-09-13T18:51:17.461577+0000","last_became_peered":"2024-09-13T18:51:17.461577+0000","last_unstale":"2024-09-13T18:51:17.928773+0000","last_undegraded":"2024-09-13T18:51:17.928773+0000","last_fullsized":"2024-09-13T18:51:17.928773+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:26.194317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943507+0000","last_change":"2024-09-13T18:51:17.939993+0000","last_active":"2024-09-13T18:51:17.943507+0000","last_peered":"2024-09-13T18:51:17.943507+0000","last_clean":"2024-09-13T18:51:17.943507+0000","last_became_active":"2024-09-13T18:51:17.938898+0000","last_became_peered":"2024-09-13T18:51:17.938898+0000","last_unstale":"2024-09-13T18:51:17.943507+0000","last_undegraded":"2024-09-13T18:51:17.943507+0000","last_fullsized":"2024-09-13T18:51:17.943507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:57.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932053+0000","last_change":"2024-09-13T18:51:17.453634+0000","last_active":"2024-09-13T18:51:17.932053+0000","last_peered":"2024-09-13T18:51:17.932053+0000","last_clean":"2024-09-13T18:51:17.932053+0000","last_became_active":"2024-09-13T18:51:17.453399+0000","last_became_peered":"2024-09-13T18:51:17.453399+0000","last_unstale":"2024-09-13T18:51:17.932053+0000","last_undegraded":"2024-09-13T18:51:17.932053+0000","last_fullsized":"2024-09-13T18:51:17.932053+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:32.585876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.925912+0000","last_change":"2024-09-13T18:51:17.923086+0000","last_active":"2024-09-13T18:51:17.925912+0000","last_peered":"2024-09-13T18:51:17.925912+0000","last_clean":"2024-09-13T18:51:17.925912+0000","last_became_active":"2024-09-13T18:51:17.922843+0000","last_became_peered":"2024-09-13T18:51:17.922843+0000","last_unstale":"2024-09-13T18:51:17.925912+0000","last_undegraded":"2024-09-13T18:51:17.925912+0000","last_fullsized":"2024-09-13T18:51:17.925912+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:58:46.216067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932173+0000","last_change":"2024-09-13T18:51:17.459235+0000","last_active":"2024-09-13T18:51:17.932173+0000","last_peered":"2024-09-13T18:51:17.932173+0000","last_clean":"2024-09-13T18:51:17.932173+0000","last_became_active":"2024-09-13T18:51:17.458955+0000","last_became_peered":"2024-09-13T18:51:17.458955+0000","last_unstale":"2024-09-13T18:51:17.932173+0000","last_undegraded":"2024-09-13T18:51:17.932173+0000","last_fullsized":"2024-09-13T18:51:17.932173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:01.523117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931819+0000","last_change":"2024-09-13T18:51:17.928442+0000","last_active":"2024-09-13T18:51:17.931819+0000","last_peered":"2024-09-13T18:51:17.931819+0000","last_clean":"2024-09-13T18:51:17.931819+0000","last_became_active":"2024-09-13T18:51:17.928207+0000","last_became_peered":"2024-09-13T18:51:17.928207+0000","last_unstale":"2024-09-13T18:51:17.931819+0000","last_undegraded":"2024-09-13T18:51:17.931819+0000","last_fullsized":"2024-09-13T18:51:17.931819+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:39.247449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.930139+0000","last_change":"2024-09-13T18:51:17.458903+0000","last_active":"2024-09-13T18:51:17.930139+0000","last_peered":"2024-09-13T18:51:17.930139+0000","last_clean":"2024-09-13T18:51:17.930139+0000","last_became_active":"2024-09-13T18:51:17.458661+0000","last_became_peered":"2024-09-13T18:51:17.458661+0000","last_unstale":"2024-09-13T18:51:17.930139+0000","last_undegraded":"2024-09-13T18:51:17.930139+0000","last_fullsized":"2024-09-13T18:51:17.930139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:19:28.199707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948393+0000","last_change":"2024-09-13T18:51:17.947159+0000","last_active":"2024-09-13T18:51:17.948393+0000","last_peered":"2024-09-13T18:51:17.948393+0000","last_clean":"2024-09-13T18:51:17.948393+0000","last_became_active":"2024-09-13T18:51:17.946784+0000","last_became_peered":"2024-09-13T18:51:17.946784+0000","last_unstale":"2024-09-13T18:51:17.948393+0000","last_undegraded":"2024-09-13T18:51:17.948393+0000","last_fullsized":"2024-09-13T18:51:17.948393+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.444541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924684+0000","last_change":"2024-09-13T18:51:17.464136+0000","last_active":"2024-09-13T18:51:17.924684+0000","last_peered":"2024-09-13T18:51:17.924684+0000","last_clean":"2024-09-13T18:51:17.924684+0000","last_became_active":"2024-09-13T18:51:17.463906+0000","last_became_peered":"2024-09-13T18:51:17.463906+0000","last_unstale":"2024-09-13T18:51:17.924684+0000","last_undegraded":"2024-09-13T18:51:17.924684+0000","last_fullsized":"2024-09-13T18:51:17.924684+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:35.492310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.933991+0000","last_change":"2024-09-13T18:51:17.933003+0000","last_active":"2024-09-13T18:51:17.933991+0000","last_peered":"2024-09-13T18:51:17.933991+0000","last_clean":"2024-09-13T18:51:17.933991+0000","last_became_active":"2024-09-13T18:51:17.932464+0000","last_became_peered":"2024-09-13T18:51:17.932464+0000","last_unstale":"2024-09-13T18:51:17.933991+0000","last_undegraded":"2024-09-13T18:51:17.933991+0000","last_fullsized":"2024-09-13T18:51:17.933991+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:48.924559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.923747+0000","last_change":"2024-09-13T18:51:17.467663+0000","last_active":"2024-09-13T18:51:17.923747+0000","last_peered":"2024-09-13T18:51:17.923747+0000","last_clean":"2024-09-13T18:51:17.923747+0000","last_became_active":"2024-09-13T18:51:17.467375+0000","last_became_peered":"2024-09-13T18:51:17.467375+0000","last_unstale":"2024-09-13T18:51:17.923747+0000","last_undegraded":"2024-09-13T18:51:17.923747+0000","last_fullsized":"2024-09-13T18:51:17.923747+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:22.388614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928140+0000","last_change":"2024-09-13T18:51:17.922359+0000","last_active":"2024-09-13T18:51:17.928140+0000","last_peered":"2024-09-13T18:51:17.928140+0000","last_clean":"2024-09-13T18:51:17.928140+0000","last_became_active":"2024-09-13T18:51:17.920789+0000","last_became_peered":"2024-09-13T18:51:17.920789+0000","last_unstale":"2024-09-13T18:51:17.928140+0000","last_undegraded":"2024-09-13T18:51:17.928140+0000","last_fullsized":"2024-09-13T18:51:17.928140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:41.444541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932299+0000","last_change":"2024-09-13T18:51:17.464190+0000","last_active":"2024-09-13T18:51:17.932299+0000","last_peered":"2024-09-13T18:51:17.932299+0000","last_clean":"2024-09-13T18:51:17.932299+0000","last_became_active":"2024-09-13T18:51:17.463498+0000","last_became_peered":"2024-09-13T18:51:17.463498+0000","last_unstale":"2024-09-13T18:51:17.932299+0000","last_undegraded":"2024-09-13T18:51:17.932299+0000","last_fullsized":"2024-09-13T18:51:17.932299+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:02.172649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.931446+0000","last_change":"2024-09-13T18:51:17.929300+0000","last_active":"2024-09-13T18:51:17.931446+0000","last_peered":"2024-09-13T18:51:17.931446+0000","last_clean":"2024-09-13T18:51:17.931446+0000","last_became_active":"2024-09-13T18:51:17.928500+0000","last_became_peered":"2024-09-13T18:51:17.928500+0000","last_unstale":"2024-09-13T18:51:17.931446+0000","last_undegraded":"2024-09-13T18:51:17.931446+0000","last_fullsized":"2024-09-13T18:51:17.931446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:45.850329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.914304+0000","last_change":"2024-09-13T18:51:17.460228+0000","last_active":"2024-09-13T18:51:17.914304+0000","last_peered":"2024-09-13T18:51:17.914304+0000","last_clean":"2024-09-13T18:51:17.914304+0000","last_became_active":"2024-09-13T18:51:17.456796+0000","last_became_peered":"2024-09-13T18:51:17.456796+0000","last_unstale":"2024-09-13T18:51:17.914304+0000","last_undegraded":"2024-09-13T18:51:17.914304+0000","last_fullsized":"2024-09-13T18:51:17.914304+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:50.559149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.950096+0000","last_change":"2024-09-13T18:51:17.948572+0000","last_active":"2024-09-13T18:51:17.950096+0000","last_peered":"2024-09-13T18:51:17.950096+0000","last_clean":"2024-09-13T18:51:17.950096+0000","last_became_active":"2024-09-13T18:51:17.948058+0000","last_became_peered":"2024-09-13T18:51:17.948058+0000","last_unstale":"2024-09-13T18:51:17.950096+0000","last_undegraded":"2024-09-13T18:51:17.950096+0000","last_fullsized":"2024-09-13T18:51:17.950096+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:42.405875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":13,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.943235+0000","last_change":"2024-09-13T18:51:17.462836+0000","last_active":"2024-09-13T18:51:17.943235+0000","last_peered":"2024-09-13T18:51:17.943235+0000","last_clean":"2024-09-13T18:51:17.943235+0000","last_became_active":"2024-09-13T18:51:17.462512+0000","last_became_peered":"2024-09-13T18:51:17.462512+0000","last_unstale":"2024-09-13T18:51:17.943235+0000","last_undegraded":"2024-09-13T18:51:17.943235+0000","last_fullsized":"2024-09-13T18:51:17.943235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:02.637290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.942615+0000","last_change":"2024-09-13T18:51:17.940681+0000","last_active":"2024-09-13T18:51:17.942615+0000","last_peered":"2024-09-13T18:51:17.942615+0000","last_clean":"2024-09-13T18:51:17.942615+0000","last_became_active":"2024-09-13T18:51:17.934486+0000","last_became_peered":"2024-09-13T18:51:17.934486+0000","last_unstale":"2024-09-13T18:51:17.942615+0000","last_undegraded":"2024-09-13T18:51:17.942615+0000","last_fullsized":"2024-09-13T18:51:17.942615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:31.252836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948187+0000","last_change":"2024-09-13T18:51:17.454939+0000","last_active":"2024-09-13T18:51:17.948187+0000","last_peered":"2024-09-13T18:51:17.948187+0000","last_clean":"2024-09-13T18:51:17.948187+0000","last_became_active":"2024-09-13T18:51:17.453180+0000","last_became_peered":"2024-09-13T18:51:17.453180+0000","last_unstale":"2024-09-13T18:51:17.948187+0000","last_undegraded":"2024-09-13T18:51:17.948187+0000","last_fullsized":"2024-09-13T18:51:17.948187+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:39:33.254147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.935899+0000","last_change":"2024-09-13T18:51:17.929809+0000","last_active":"2024-09-13T18:51:17.935899+0000","last_peered":"2024-09-13T18:51:17.935899+0000","last_clean":"2024-09-13T18:51:17.935899+0000","last_became_active":"2024-09-13T18:51:17.929477+0000","last_became_peered":"2024-09-13T18:51:17.929477+0000","last_unstale":"2024-09-13T18:51:17.935899+0000","last_undegraded":"2024-09-13T18:51:17.935899+0000","last_fullsized":"2024-09-13T18:51:17.935899+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:38.726052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.949184+0000","last_change":"2024-09-13T18:51:17.466840+0000","last_active":"2024-09-13T18:51:17.949184+0000","last_peered":"2024-09-13T18:51:17.949184+0000","last_clean":"2024-09-13T18:51:17.949184+0000","last_became_active":"2024-09-13T18:51:17.466608+0000","last_became_peered":"2024-09-13T18:51:17.466608+0000","last_unstale":"2024-09-13T18:51:17.949184+0000","last_undegraded":"2024-09-13T18:51:17.949184+0000","last_fullsized":"2024-09-13T18:51:17.949184+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:50.559149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945884+0000","last_change":"2024-09-13T18:51:17.938259+0000","last_active":"2024-09-13T18:51:17.945884+0000","last_peered":"2024-09-13T18:51:17.945884+0000","last_clean":"2024-09-13T18:51:17.945884+0000","last_became_active":"2024-09-13T18:51:17.937993+0000","last_became_peered":"2024-09-13T18:51:17.937993+0000","last_unstale":"2024-09-13T18:51:17.945884+0000","last_undegraded":"2024-09-13T18:51:17.945884+0000","last_fullsized":"2024-09-13T18:51:17.945884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:03.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.920503+0000","last_change":"2024-09-13T18:51:17.465366+0000","last_active":"2024-09-13T18:51:17.920503+0000","last_peered":"2024-09-13T18:51:17.920503+0000","last_clean":"2024-09-13T18:51:17.920503+0000","last_became_active":"2024-09-13T18:51:17.465032+0000","last_became_peered":"2024-09-13T18:51:17.465032+0000","last_unstale":"2024-09-13T18:51:17.920503+0000","last_undegraded":"2024-09-13T18:51:17.920503+0000","last_fullsized":"2024-09-13T18:51:17.920503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:48.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941693+0000","last_change":"2024-09-13T18:51:17.936315+0000","last_active":"2024-09-13T18:51:17.941693+0000","last_peered":"2024-09-13T18:51:17.941693+0000","last_clean":"2024-09-13T18:51:17.941693+0000","last_became_active":"2024-09-13T18:51:17.936053+0000","last_became_peered":"2024-09-13T18:51:17.936053+0000","last_unstale":"2024-09-13T18:51:17.941693+0000","last_undegraded":"2024-09-13T18:51:17.941693+0000","last_fullsized":"2024-09-13T18:51:17.941693+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:56.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.927206+0000","last_change":"2024-09-13T18:51:17.463549+0000","last_active":"2024-09-13T18:51:17.927206+0000","last_peered":"2024-09-13T18:51:17.927206+0000","last_clean":"2024-09-13T18:51:17.927206+0000","last_became_active":"2024-09-13T18:51:17.463080+0000","last_became_peered":"2024-09-13T18:51:17.463080+0000","last_unstale":"2024-09-13T18:51:17.927206+0000","last_undegraded":"2024-09-13T18:51:17.927206+0000","last_fullsized":"2024-09-13T18:51:17.927206+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.380248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928774+0000","last_change":"2024-09-13T18:51:17.924040+0000","last_active":"2024-09-13T18:51:17.928774+0000","last_peered":"2024-09-13T18:51:17.928774+0000","last_clean":"2024-09-13T18:51:17.928774+0000","last_became_active":"2024-09-13T18:51:17.923798+0000","last_became_peered":"2024-09-13T18:51:17.923798+0000","last_unstale":"2024-09-13T18:51:17.928774+0000","last_undegraded":"2024-09-13T18:51:17.928774+0000","last_fullsized":"2024-09-13T18:51:17.928774+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:42.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.938900+0000","last_change":"2024-09-13T18:51:17.460020+0000","last_active":"2024-09-13T18:51:17.938900+0000","last_peered":"2024-09-13T18:51:17.938900+0000","last_clean":"2024-09-13T18:51:17.938900+0000","last_became_active":"2024-09-13T18:51:17.459771+0000","last_became_peered":"2024-09-13T18:51:17.459771+0000","last_unstale":"2024-09-13T18:51:17.938900+0000","last_undegraded":"2024-09-13T18:51:17.938900+0000","last_fullsized":"2024-09-13T18:51:17.938900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:48.345612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945694+0000","last_change":"2024-09-13T18:51:17.944334+0000","last_active":"2024-09-13T18:51:17.945694+0000","last_peered":"2024-09-13T18:51:17.945694+0000","last_clean":"2024-09-13T18:51:17.945694+0000","last_became_active":"2024-09-13T18:51:17.940800+0000","last_became_peered":"2024-09-13T18:51:17.940800+0000","last_unstale":"2024-09-13T18:51:17.945694+0000","last_undegraded":"2024-09-13T18:51:17.945694+0000","last_fullsized":"2024-09-13T18:51:17.945694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.943058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.935607+0000","last_change":"2024-09-13T18:51:17.467375+0000","last_active":"2024-09-13T18:51:17.935607+0000","last_peered":"2024-09-13T18:51:17.935607+0000","last_clean":"2024-09-13T18:51:17.935607+0000","last_became_active":"2024-09-13T18:51:17.465541+0000","last_became_peered":"2024-09-13T18:51:17.465541+0000","last_unstale":"2024-09-13T18:51:17.935607+0000","last_undegraded":"2024-09-13T18:51:17.935607+0000","last_fullsized":"2024-09-13T18:51:17.935607+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:33:50.559149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.950616+0000","last_change":"2024-09-13T18:51:17.949511+0000","last_active":"2024-09-13T18:51:17.950616+0000","last_peered":"2024-09-13T18:51:17.950616+0000","last_clean":"2024-09-13T18:51:17.950616+0000","last_became_active":"2024-09-13T18:51:17.949193+0000","last_became_peered":"2024-09-13T18:51:17.949193+0000","last_unstale":"2024-09-13T18:51:17.950616+0000","last_undegraded":"2024-09-13T18:51:17.950616+0000","last_fullsized":"2024-09-13T18:51:17.950616+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:44.875427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945008+0000","last_change":"2024-09-13T18:51:17.466030+0000","last_active":"2024-09-13T18:51:17.945008+0000","last_peered":"2024-09-13T18:51:17.945008+0000","last_clean":"2024-09-13T18:51:17.945008+0000","last_became_active":"2024-09-13T18:51:17.465574+0000","last_became_peered":"2024-09-13T18:51:17.465574+0000","last_unstale":"2024-09-13T18:51:17.945008+0000","last_undegraded":"2024-09-13T18:51:17.945008+0000","last_fullsized":"2024-09-13T18:51:17.945008+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:12.363044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946608+0000","last_change":"2024-09-13T18:51:17.944117+0000","last_active":"2024-09-13T18:51:17.946608+0000","last_peered":"2024-09-13T18:51:17.946608+0000","last_clean":"2024-09-13T18:51:17.946608+0000","last_became_active":"2024-09-13T18:51:17.943846+0000","last_became_peered":"2024-09-13T18:51:17.943846+0000","last_unstale":"2024-09-13T18:51:17.946608+0000","last_undegraded":"2024-09-13T18:51:17.946608+0000","last_fullsized":"2024-09-13T18:51:17.946608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:57.949328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":11,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.939028+0000","last_change":"2024-09-13T18:51:17.463037+0000","last_active":"2024-09-13T18:51:17.939028+0000","last_peered":"2024-09-13T18:51:17.939028+0000","last_clean":"2024-09-13T18:51:17.939028+0000","last_became_active":"2024-09-13T18:51:17.462520+0000","last_became_peered":"2024-09-13T18:51:17.462520+0000","last_unstale":"2024-09-13T18:51:17.939028+0000","last_undegraded":"2024-09-13T18:51:17.939028+0000","last_fullsized":"2024-09-13T18:51:17.939028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:18.603084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.944484+0000","last_change":"2024-09-13T18:51:17.942838+0000","last_active":"2024-09-13T18:51:17.944484+0000","last_peered":"2024-09-13T18:51:17.944484+0000","last_clean":"2024-09-13T18:51:17.944484+0000","last_became_active":"2024-09-13T18:51:17.942557+0000","last_became_peered":"2024-09-13T18:51:17.942557+0000","last_unstale":"2024-09-13T18:51:17.944484+0000","last_undegraded":"2024-09-13T18:51:17.944484+0000","last_fullsized":"2024-09-13T18:51:17.944484+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:08:59.150796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.926868+0000","last_change":"2024-09-13T18:51:17.463315+0000","last_active":"2024-09-13T18:51:17.926868+0000","last_peered":"2024-09-13T18:51:17.926868+0000","last_clean":"2024-09-13T18:51:17.926868+0000","last_became_active":"2024-09-13T18:51:17.462949+0000","last_became_peered":"2024-09-13T18:51:17.462949+0000","last_unstale":"2024-09-13T18:51:17.926868+0000","last_undegraded":"2024-09-13T18:51:17.926868+0000","last_fullsized":"2024-09-13T18:51:17.926868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:57.098140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928615+0000","last_change":"2024-09-13T18:51:17.918042+0000","last_active":"2024-09-13T18:51:17.928615+0000","last_peered":"2024-09-13T18:51:17.928615+0000","last_clean":"2024-09-13T18:51:17.928615+0000","last_became_active":"2024-09-13T18:51:17.917740+0000","last_became_peered":"2024-09-13T18:51:17.917740+0000","last_unstale":"2024-09-13T18:51:17.928615+0000","last_undegraded":"2024-09-13T18:51:17.928615+0000","last_fullsized":"2024-09-13T18:51:17.928615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:16:20.989004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.944035+0000","last_change":"2024-09-13T18:51:17.460596+0000","last_active":"2024-09-13T18:51:17.944035+0000","last_peered":"2024-09-13T18:51:17.944035+0000","last_clean":"2024-09-13T18:51:17.944035+0000","last_became_active":"2024-09-13T18:51:17.460339+0000","last_became_peered":"2024-09-13T18:51:17.460339+0000","last_unstale":"2024-09-13T18:51:17.944035+0000","last_undegraded":"2024-09-13T18:51:17.944035+0000","last_fullsized":"2024-09-13T18:51:17.944035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:13:41.389015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.934447+0000","last_change":"2024-09-13T18:51:17.930616+0000","last_active":"2024-09-13T18:51:17.934447+0000","last_peered":"2024-09-13T18:51:17.934447+0000","last_clean":"2024-09-13T18:51:17.934447+0000","last_became_active":"2024-09-13T18:51:17.929779+0000","last_became_peered":"2024-09-13T18:51:17.929779+0000","last_unstale":"2024-09-13T18:51:17.934447+0000","last_undegraded":"2024-09-13T18:51:17.934447+0000","last_fullsized":"2024-09-13T18:51:17.934447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:45.265416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.920614+0000","last_change":"2024-09-13T18:51:17.465367+0000","last_active":"2024-09-13T18:51:17.920614+0000","last_peered":"2024-09-13T18:51:17.920614+0000","last_clean":"2024-09-13T18:51:17.920614+0000","last_became_active":"2024-09-13T18:51:17.465006+0000","last_became_peered":"2024-09-13T18:51:17.465006+0000","last_unstale":"2024-09-13T18:51:17.920614+0000","last_undegraded":"2024-09-13T18:51:17.920614+0000","last_fullsized":"2024-09-13T18:51:17.920614+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:40:12.363044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.948377+0000","last_change":"2024-09-13T18:51:17.947009+0000","last_active":"2024-09-13T18:51:17.948377+0000","last_peered":"2024-09-13T18:51:17.948377+0000","last_clean":"2024-09-13T18:51:17.948377+0000","last_became_active":"2024-09-13T18:51:17.946332+0000","last_became_peered":"2024-09-13T18:51:17.946332+0000","last_unstale":"2024-09-13T18:51:17.948377+0000","last_undegraded":"2024-09-13T18:51:17.948377+0000","last_fullsized":"2024-09-13T18:51:17.948377+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:39.247449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.908769+0000","last_change":"2024-09-13T18:51:17.457169+0000","last_active":"2024-09-13T18:51:17.908769+0000","last_peered":"2024-09-13T18:51:17.908769+0000","last_clean":"2024-09-13T18:51:17.908769+0000","last_became_active":"2024-09-13T18:51:17.456888+0000","last_became_peered":"2024-09-13T18:51:17.456888+0000","last_unstale":"2024-09-13T18:51:17.908769+0000","last_undegraded":"2024-09-13T18:51:17.908769+0000","last_fullsized":"2024-09-13T18:51:17.908769+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:55.560111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928134+0000","last_change":"2024-09-13T18:51:17.918881+0000","last_active":"2024-09-13T18:51:17.928134+0000","last_peered":"2024-09-13T18:51:17.928134+0000","last_clean":"2024-09-13T18:51:17.928134+0000","last_became_active":"2024-09-13T18:51:17.918638+0000","last_became_peered":"2024-09-13T18:51:17.918638+0000","last_unstale":"2024-09-13T18:51:17.928134+0000","last_undegraded":"2024-09-13T18:51:17.928134+0000","last_fullsized":"2024-09-13T18:51:17.928134+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:00:48.943263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.941847+0000","last_change":"2024-09-13T18:51:17.468929+0000","last_active":"2024-09-13T18:51:17.941847+0000","last_peered":"2024-09-13T18:51:17.941847+0000","last_clean":"2024-09-13T18:51:17.941847+0000","last_became_active":"2024-09-13T18:51:17.468147+0000","last_became_peered":"2024-09-13T18:51:17.468147+0000","last_unstale":"2024-09-13T18:51:17.941847+0000","last_undegraded":"2024-09-13T18:51:17.941847+0000","last_fullsized":"2024-09-13T18:51:17.941847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:53:02.637290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.923967+0000","last_change":"2024-09-13T18:51:17.921207+0000","last_active":"2024-09-13T18:51:17.923967+0000","last_peered":"2024-09-13T18:51:17.923967+0000","last_clean":"2024-09-13T18:51:17.923967+0000","last_became_active":"2024-09-13T18:51:17.919955+0000","last_became_peered":"2024-09-13T18:51:17.919955+0000","last_unstale":"2024-09-13T18:51:17.923967+0000","last_undegraded":"2024-09-13T18:51:17.923967+0000","last_fullsized":"2024-09-13T18:51:17.923967+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:06:06.600265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.921586+0000","last_change":"2024-09-13T18:51:17.468983+0000","last_active":"2024-09-13T18:51:17.921586+0000","last_peered":"2024-09-13T18:51:17.921586+0000","last_clean":"2024-09-13T18:51:17.921586+0000","last_became_active":"2024-09-13T18:51:17.468381+0000","last_became_peered":"2024-09-13T18:51:17.468381+0000","last_unstale":"2024-09-13T18:51:17.921586+0000","last_undegraded":"2024-09-13T18:51:17.921586+0000","last_fullsized":"2024-09-13T18:51:17.921586+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:02.172649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.945930+0000","last_change":"2024-09-13T18:51:17.936055+0000","last_active":"2024-09-13T18:51:17.945930+0000","last_peered":"2024-09-13T18:51:17.945930+0000","last_clean":"2024-09-13T18:51:17.945930+0000","last_became_active":"2024-09-13T18:51:17.934047+0000","last_became_peered":"2024-09-13T18:51:17.934047+0000","last_unstale":"2024-09-13T18:51:17.945930+0000","last_undegraded":"2024-09-13T18:51:17.945930+0000","last_fullsized":"2024-09-13T18:51:17.945930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:38.726052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.909491+0000","last_change":"2024-09-13T18:51:17.456273+0000","last_active":"2024-09-13T18:51:17.909491+0000","last_peered":"2024-09-13T18:51:17.909491+0000","last_clean":"2024-09-13T18:51:17.909491+0000","last_became_active":"2024-09-13T18:51:17.455985+0000","last_became_peered":"2024-09-13T18:51:17.455985+0000","last_unstale":"2024-09-13T18:51:17.909491+0000","last_undegraded":"2024-09-13T18:51:17.909491+0000","last_fullsized":"2024-09-13T18:51:17.909491+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:41.791388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946320+0000","last_change":"2024-09-13T18:51:17.943353+0000","last_active":"2024-09-13T18:51:17.946320+0000","last_peered":"2024-09-13T18:51:17.946320+0000","last_clean":"2024-09-13T18:51:17.946320+0000","last_became_active":"2024-09-13T18:51:17.943098+0000","last_became_peered":"2024-09-13T18:51:17.943098+0000","last_unstale":"2024-09-13T18:51:17.946320+0000","last_undegraded":"2024-09-13T18:51:17.946320+0000","last_fullsized":"2024-09-13T18:51:17.946320+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:27.211177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.916998+0000","last_change":"2024-09-13T18:51:17.455282+0000","last_active":"2024-09-13T18:51:17.916998+0000","last_peered":"2024-09-13T18:51:17.916998+0000","last_clean":"2024-09-13T18:51:17.916998+0000","last_became_active":"2024-09-13T18:51:17.454699+0000","last_became_peered":"2024-09-13T18:51:17.454699+0000","last_unstale":"2024-09-13T18:51:17.916998+0000","last_undegraded":"2024-09-13T18:51:17.916998+0000","last_fullsized":"2024-09-13T18:51:17.916998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:57.735226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.942113+0000","last_change":"2024-09-13T18:51:17.941404+0000","last_active":"2024-09-13T18:51:17.942113+0000","last_peered":"2024-09-13T18:51:17.942113+0000","last_clean":"2024-09-13T18:51:17.942113+0000","last_became_active":"2024-09-13T18:51:17.940136+0000","last_became_peered":"2024-09-13T18:51:17.940136+0000","last_unstale":"2024-09-13T18:51:17.942113+0000","last_undegraded":"2024-09-13T18:51:17.942113+0000","last_fullsized":"2024-09-13T18:51:17.942113+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:42.808248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.928051+0000","last_change":"2024-09-13T18:51:17.463445+0000","last_active":"2024-09-13T18:51:17.928051+0000","last_peered":"2024-09-13T18:51:17.928051+0000","last_clean":"2024-09-13T18:51:17.928051+0000","last_became_active":"2024-09-13T18:51:17.463154+0000","last_became_peered":"2024-09-13T18:51:17.463154+0000","last_unstale":"2024-09-13T18:51:17.928051+0000","last_undegraded":"2024-09-13T18:51:17.928051+0000","last_fullsized":"2024-09-13T18:51:17.928051+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:30.622815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.932694+0000","last_change":"2024-09-13T18:51:17.926218+0000","last_active":"2024-09-13T18:51:17.932694+0000","last_peered":"2024-09-13T18:51:17.932694+0000","last_clean":"2024-09-13T18:51:17.932694+0000","last_became_active":"2024-09-13T18:51:17.925938+0000","last_became_peered":"2024-09-13T18:51:17.925938+0000","last_unstale":"2024-09-13T18:51:17.932694+0000","last_undegraded":"2024-09-13T18:51:17.932694+0000","last_fullsized":"2024-09-13T18:51:17.932694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:03.109813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924241+0000","last_change":"2024-09-13T18:51:17.457910+0000","last_active":"2024-09-13T18:51:17.924241+0000","last_peered":"2024-09-13T18:51:17.924241+0000","last_clean":"2024-09-13T18:51:17.924241+0000","last_became_active":"2024-09-13T18:51:17.457648+0000","last_became_peered":"2024-09-13T18:51:17.457648+0000","last_unstale":"2024-09-13T18:51:17.924241+0000","last_undegraded":"2024-09-13T18:51:17.924241+0000","last_fullsized":"2024-09-13T18:51:17.924241+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:18.371231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.930053+0000","last_change":"2024-09-13T18:51:17.926457+0000","last_active":"2024-09-13T18:51:17.930053+0000","last_peered":"2024-09-13T18:51:17.930053+0000","last_clean":"2024-09-13T18:51:17.930053+0000","last_became_active":"2024-09-13T18:51:17.926223+0000","last_became_peered":"2024-09-13T18:51:17.926223+0000","last_unstale":"2024-09-13T18:51:17.930053+0000","last_undegraded":"2024-09-13T18:51:17.930053+0000","last_fullsized":"2024-09-13T18:51:17.930053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:56.576971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.924776+0000","last_change":"2024-09-13T18:51:17.463876+0000","last_active":"2024-09-13T18:51:17.924776+0000","last_peered":"2024-09-13T18:51:17.924776+0000","last_clean":"2024-09-13T18:51:17.924776+0000","last_became_active":"2024-09-13T18:51:17.463566+0000","last_became_peered":"2024-09-13T18:51:17.463566+0000","last_unstale":"2024-09-13T18:51:17.924776+0000","last_undegraded":"2024-09-13T18:51:17.924776+0000","last_fullsized":"2024-09-13T18:51:17.924776+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:29.255596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.927840+0000","last_change":"2024-09-13T18:51:17.923922+0000","last_active":"2024-09-13T18:51:17.927840+0000","last_peered":"2024-09-13T18:51:17.927840+0000","last_clean":"2024-09-13T18:51:17.927840+0000","last_became_active":"2024-09-13T18:51:17.923665+0000","last_became_peered":"2024-09-13T18:51:17.923665+0000","last_unstale":"2024-09-13T18:51:17.927840+0000","last_undegraded":"2024-09-13T18:51:17.927840+0000","last_fullsized":"2024-09-13T18:51:17.927840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:34.703437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.916464+0000","last_change":"2024-09-13T18:51:17.462534+0000","last_active":"2024-09-13T18:51:17.916464+0000","last_peered":"2024-09-13T18:51:17.916464+0000","last_clean":"2024-09-13T18:51:17.916464+0000","last_became_active":"2024-09-13T18:51:17.462257+0000","last_became_peered":"2024-09-13T18:51:17.462257+0000","last_unstale":"2024-09-13T18:51:17.916464+0000","last_undegraded":"2024-09-13T18:51:17.916464+0000","last_fullsized":"2024-09-13T18:51:17.916464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:44.248557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.946427+0000","last_change":"2024-09-13T18:51:17.943659+0000","last_active":"2024-09-13T18:51:17.946427+0000","last_peered":"2024-09-13T18:51:17.946427+0000","last_clean":"2024-09-13T18:51:17.946427+0000","last_became_active":"2024-09-13T18:51:17.942484+0000","last_became_peered":"2024-09-13T18:51:17.942484+0000","last_unstale":"2024-09-13T18:51:17.946427+0000","last_undegraded":"2024-09-13T18:51:17.946427+0000","last_fullsized":"2024-09-13T18:51:17.946427+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:17.422873+0000","last_clean_scrub_stamp":"2024-09-13T18:51:17.422873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:38.362886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.922247+0000","last_change":"2024-09-13T18:51:17.461190+0000","last_active":"2024-09-13T18:51:17.922247+0000","last_peered":"2024-09-13T18:51:17.922247+0000","last_clean":"2024-09-13T18:51:17.922247+0000","last_became_active":"2024-09-13T18:51:17.460895+0000","last_became_peered":"2024-09-13T18:51:17.460895+0000","last_unstale":"2024-09-13T18:51:17.922247+0000","last_undegraded":"2024-09-13T18:51:17.922247+0000","last_fullsized":"2024-09-13T18:51:17.922247+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:51:16.406013+0000","last_clean_scrub_stamp":"2024-09-13T18:51:16.406013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:38.850005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":201,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-13T18:51:17.452856+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:51:17.452856+0000","last_peered":"2024-09-13T18:51:17.452856+0000","last_clean":"2024-09-13T18:51:17.452856+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:51:17.452856+0000","last_undegraded":"2024-09-13T18:51:17.452856+0000","last_fullsized":"2024-09-13T18:51:17.452856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1368064,"data_stored":937333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.0940000000000001,"15min":1.0980000000000001},"min":{"1min":0.88,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.341},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.1299999999999999},"min":{"1min":0.73999999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.6479999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1299999999999999,"15min":1.141},"min":{"1min":0.85699999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.478,"5min":1.619,"15min":1.619},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.179,"15min":1.2250000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7869999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.7869999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.288,"15min":1.341},"min":{"1min":0.79400000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.194,"15min":1.208},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.462,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.90600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.27,"15min":1.276},"min":{"1min":0.88,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3799999999999999,"15min":1.444},"min":{"1min":1.071,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.861,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.861}]},{"osd":4,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.111,"15min":1.115},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.552,"15min":1.552},"last":1.546},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.218,"15min":1.1890000000000001},"min":{"1min":0.751,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.609}]},{"osd":5,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2749999999999999,"15min":1.325},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.9370000000000001,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2230000000000001,"15min":1.228},"min":{"1min":0.76900000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.6919999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:51:12 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3919999999999999,"15min":1.405},"min":{"1min":1.2090000000000001,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.788,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.238},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.405,"15min":1.4239999999999999},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.4670000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":802816,"data_stored":360681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.1080000000000001,"15min":1.1419999999999999},"min":{"1min":0.71599999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.506,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1379999999999999,"15min":1.1739999999999999},"min":{"1min":0.72299999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.119,"15min":1.117},"min":{"1min":0.83299999999999996,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.407,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.149,"5min":1.1899999999999999,"15min":1.204},"min":{"1min":0.83399999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.377,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.014}]},{"osd":2,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.337,"15min":1.4550000000000001},"min":{"1min":0.77900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4319999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.351,"15min":1.4950000000000001},"min":{"1min":0.86499999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.538,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.747}]},{"osd":3,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.401,"15min":1.518},"min":{"1min":0.91800000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.5529999999999999,"5min":4.883,"15min":4.883},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.266,"5min":1.4059999999999999,"15min":1.5369999999999999},"min":{"1min":0.90100000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.577,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.0720000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2470000000000001,"15min":1.3149999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.5189999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3009999999999999,"15min":1.345},"min":{"1min":0.89800000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.629,"5min":2.077,"15min":2.077},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.353,"15min":1.423},"min":{"1min":0.79700000000000004,"5min":0.755,"15min":0.755},"max":{"1min":1.764,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.4590000000000001,"15min":1.49},"min":{"1min":1.1859999999999999,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":1.5720000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.0389999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.4299999999999999,"15min":1.474},"min":{"1min":0.85499999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.516,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.456,"15min":1.5369999999999999},"min":{"1min":0.82299999999999995,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8169999999999999,"5min":2.367,"15min":2.367},"last":1.1399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1200000000000001,"15min":1.198},"min":{"1min":0.63700000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.3959999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.1519999999999999,"15min":1.1639999999999999},"min":{"1min":0.73999999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5880000000000001,"5min":2.278,"15min":2.278},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2250000000000001,"15min":1.276},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5389999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.411,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.1719999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.238,"15min":1.29},"min":{"1min":0.70099999999999996,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5289999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.097},{"interface":"front","average":{"1min":1.109,"5min":1.2050000000000001,"15min":1.2629999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.532,"5min":2.157,"15min":2.157},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.3160000000000001,"15min":1.3799999999999999},"min":{"1min":0.998,"5min":0.749,"15min":0.749},"max":{"1min":1.5329999999999999,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3600000000000001,"15min":1.4419999999999999},"min":{"1min":0.88700000000000001,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.599,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.2270000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.161,"15min":1.22},"min":{"1min":0.79100000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3959999999999999,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.069},{"interface":"front","average":{"1min":1.228,"5min":1.254,"15min":1.282},"min":{"1min":0.93000000000000005,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.6339999999999999,"5min":1.974,"15min":1.974},"last":1.2}]},{"osd":6,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2829999999999999,"15min":1.3080000000000001},"min":{"1min":0.85499999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.669,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.3109999999999999,"15min":1.3580000000000001},"min":{"1min":0.93300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5049999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.1559999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:51:14 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.4079999999999999,"15min":1.4350000000000001},"min":{"1min":1.024,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.681,"5min":2.169,"15min":2.169},"last":1.024},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.4630000000000001,"15min":1.52},"min":{"1min":1.1759999999999999,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.589,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.3360000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":811008,"data_stored":362211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1140000000000001,"15min":1.1299999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4670000000000001,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.135,"15min":1.139},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.159}]},{"osd":1,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.3340000000000001,"15min":1.3640000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5840000000000001,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.256},{"interface":"front","average":{"1min":1.224,"5min":1.292,"15min":1.3300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.748,"5min":2.423,"15min":2.423},"last":1.052}]},{"osd":2,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.246,"15min":1.2889999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4910000000000001,"5min":1.99,"15min":1.99},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3500000000000001,"15min":1.3879999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7110000000000001,"5min":2.335,"15min":2.335},"last":1.1879999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.258,"15min":1.3180000000000001},"min":{"1min":0.77800000000000002,"5min":0.626,"15min":0.626},"max":{"1min":1.633,"5min":2.621,"15min":2.621},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.2310000000000001,"15min":1.2729999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5389999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.1000000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2490000000000001,"15min":1.3160000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6279999999999999,"5min":2.274,"15min":2.274},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.3169999999999999},"min":{"1min":0.73899999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.5860000000000001,"5min":2.266,"15min":2.266},"last":1.327}]},{"osd":6,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2829999999999999,"15min":1.359},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5960000000000001,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.4239999999999999,"15min":1.47},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.851,"5min":2.5,"15min":2.5},"last":1.387}]},{"osd":7,"last update":"Fri Sep 13 18:51:09 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.407,"15min":1.4650000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.944,"5min":2.395,"15min":2.395},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.4019999999999999,"15min":1.47},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.744,"5min":2.415,"15min":2.415},"last":1.4410000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.86599999999999999,"15min":0.90000000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.1619999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86599999999999999,"15min":0.89000000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.2889999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.85299999999999998,"15min":0.872},"min":{"1min":0.625,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.997,"5min":1.468,"15min":1.468},"last":0.75},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.024,"15min":1.113},"min":{"1min":0.56299999999999994,"5min":0.505,"15min":0.505},"max":{"1min":1.2609999999999999,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.99099999999999999,"15min":0.998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.474,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.395},{"interface":"front","average":{"1min":1.145,"5min":1.1399999999999999,"15min":1.165},"min":{"1min":0.60399999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5549999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.4199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.198,"15min":1.244},"min":{"1min":0.872,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.458,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.194,"15min":1.24},"min":{"1min":0.92100000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.47,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":0.89300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2689999999999999,"15min":1.3220000000000001},"min":{"1min":0.95799999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.4990000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.244},{"interface":"front","average":{"1min":1.25,"5min":1.321,"15min":1.379},"min":{"1min":0.90000000000000002,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.4370000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.206}]},{"osd":6,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.3759999999999999,"15min":1.4359999999999999},"min":{"1min":0.85399999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.4399999999999999,"5min":2.714,"15min":2.714},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.365,"15min":1.4330000000000001},"min":{"1min":1.0880000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.637,"5min":2.52,"15min":2.52},"last":1.3520000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:08 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.413,"15min":1.5249999999999999},"min":{"1min":0.91600000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.446},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.3620000000000001,"15min":1.4399999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5089999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3149999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88600000000000001,"15min":0.99399999999999999},"min":{"1min":0.59999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2769999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.93799999999999994,"15min":1.0640000000000001},"min":{"1min":0.60099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0089999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.76300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.998,"15min":1.151},"min":{"1min":0.61899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.347,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.139,"5min":1.1639999999999999,"15min":1.2430000000000001},"min":{"1min":0.88500000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6679999999999999,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.018}]},{"osd":3,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2330000000000001,"15min":1.333},"min":{"1min":0.96999999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.4870000000000001,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.121,"15min":1.24},"min":{"1min":0.70399999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6040000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.85899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.46,"15min":1.6830000000000001},"min":{"1min":1.02,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":1.486,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.3500000000000001,"15min":1.464},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.6739999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.159}]},{"osd":5,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.4119999999999999,"15min":1.528},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.8740000000000001,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.373,"15min":1.5049999999999999},"min":{"1min":1.0169999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.7370000000000001,"5min":4.335,"15min":4.335},"last":1.1299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.423,"15min":1.5600000000000001},"min":{"1min":0.93799999999999994,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5800000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.524},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.53,"15min":1.7909999999999999},"min":{"1min":0.996,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":1.5049999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.2470000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3959999999999999,"5min":1.4610000000000001,"15min":1.5800000000000001},"min":{"1min":1.081,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.8480000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.284},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.4930000000000001,"15min":1.635},"min":{"1min":1.0960000000000001,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6359999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.427}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27776,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344064,"statfs":{"total":96636764160,"available":96608321536,"internally_reserved":0,"allocated":774144,"data_stored":346965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.83699999999999997,"15min":0.89100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1020000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.94799999999999995,"15min":1.0700000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.115,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.76100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1240000000000001,"15min":1.2010000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.9350000000000001,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.046,"5min":1.0389999999999999,"15min":1.083},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.804,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.2370000000000001,"15min":1.337},"min":{"1min":0.70099999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.637,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.2430000000000001,"15min":1.444},"min":{"1min":0.57099999999999995,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.768,"5min":10.368,"15min":10.368},"last":1.141}]},{"osd":4,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.3180000000000001,"15min":1.391},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8660000000000001,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.3109999999999999,"15min":1.373},"min":{"1min":0.82499999999999996,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.958,"5min":2.911,"15min":2.911},"last":1.1180000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.496,"15min":1.772},"min":{"1min":1.01,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.464,"5min":10.214,"15min":10.214},"last":1.095},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.399,"15min":1.4950000000000001},"min":{"1min":0.80700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.659,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.1990000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.45,"15min":1.603},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.915,"5min":6.032,"15min":6.032},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.5469999999999999,"15min":1.8149999999999999},"min":{"1min":1.0269999999999999,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6870000000000001,"5min":10.112,"15min":10.112},"last":1.1870000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:51:13 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.609,"15min":1.8759999999999999},"min":{"1min":1.107,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.649,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.48,"15min":1.5880000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.762,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3480000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1336,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1368064,"data_stored":937333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.88200000000000001,"15min":1.014},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.405,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91400000000000003,"15min":1.014},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.5149999999999999,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.119}]},{"osd":2,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":1.028,"15min":1.165},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.204,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.099,"15min":1.232},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.3959999999999999,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":1.103,"15min":1.21},"min":{"1min":0.55400000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.319,"5min":4.093,"15min":4.093},"last":1.145},{"interface":"front","average":{"1min":1.079,"5min":1.2909999999999999,"15min":1.4419999999999999},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.456}]},{"osd":4,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3320000000000001,"15min":1.464},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5640000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.407},{"interface":"front","average":{"1min":1.266,"5min":1.3620000000000001,"15min":1.474},"min":{"1min":0.93400000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.518,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.371}]},{"osd":5,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.472,"15min":1.6419999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":1.5589999999999999,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.288},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.4079999999999999,"15min":1.5629999999999999},"min":{"1min":0.97099999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.6000000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.502}]},{"osd":6,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.218,"5min":1.4119999999999999,"15min":1.571},"min":{"1min":0.84499999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.581,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.429},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5269999999999999,"15min":1.73},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.631,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.556}]},{"osd":7,"last update":"Fri Sep 13 18:51:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.472,"15min":1.6160000000000001},"min":{"1min":0.873,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.538,"5min":3.056,"15min":3.056},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.472,"15min":1.6459999999999999},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.579,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.5269999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:51:22.720 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:51:22.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:51:22.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.933+0000 7f5b6fe00700 1 Processor -- start 2024-09-13T18:51:22.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.933+0000 7f5b6fe00700 1 -- start start 2024-09-13T18:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b70146330 0x7f5b700b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b700b3100 0x7f5b70160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b700b1940 con 0x7f5b70160cc0 2024-09-13T18:51:22.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b700b3520 con 0x7f5b70146330 2024-09-13T18:51:22.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b700b1bb0 con 0x7f5b700b3100 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6f400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5b70160cc0 0x7f5b7006ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35458/0 (socket says 172.21.15.81:35458) 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6f400700 1 -- 172.21.15.81:0/3395162063 learned_addr learned my addr 172.21.15.81:0/3395162063 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b67e00700 1 --2- 172.21.15.81:0/3395162063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b700b3100 0x7f5b70160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b6ea00700 1 --2- 172.21.15.81:0/3395162063 >> v2:172.21.15.178:3300/0 conn(0x7f5b70146330 0x7f5b700b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b67e00700 1 -- 172.21.15.81:0/3395162063 >> v2:172.21.15.178:3300/0 conn(0x7f5b70146330 msgr2=0x7f5b700b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b67e00700 1 --2- 172.21.15.81:0/3395162063 >> v2:172.21.15.178:3300/0 conn(0x7f5b70146330 0x7f5b700b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b67e00700 1 -- 172.21.15.81:0/3395162063 >> v1:172.21.15.81:6789/0 conn(0x7f5b70160cc0 legacy=0x7f5b7006ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b67e00700 1 -- 172.21.15.81:0/3395162063 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700b1e90 con 0x7f5b700b3100 2024-09-13T18:51:22.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.937+0000 7f5b67e00700 1 --2- 172.21.15.81:0/3395162063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b700b3100 0x7f5b70160780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009850 tx=0x7f5b58009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d531a3950711f33e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6e000700 1 -- 172.21.15.81:0/3395162063 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58011830 con 0x7f5b700b3100 2024-09-13T18:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6e000700 1 -- 172.21.15.81:0/3395162063 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58011990 con 0x7f5b700b3100 2024-09-13T18:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6e000700 1 -- 172.21.15.81:0/3395162063 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58011d40 con 0x7f5b700b3100 2024-09-13T18:51:22.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 -- 172.21.15.81:0/3395162063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b700b3100 msgr2=0x7f5b70160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/3395162063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b700b3100 0x7f5b70160780 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009850 tx=0x7f5b58009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 -- 172.21.15.81:0/3395162063 shutdown_connections 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/3395162063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b700b3100 0x7f5b70160780 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/3395162063 >> v2:172.21.15.178:3300/0 conn(0x7f5b70146330 0x7f5b700b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 -- 172.21.15.81:0/3395162063 >> 172.21.15.81:0/3395162063 conn(0x7f5b7006a390 msgr2=0x7f5b7006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 -- 172.21.15.81:0/3395162063 shutdown_connections 2024-09-13T18:51:22.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.941+0000 7f5b6fe00700 1 -- 172.21.15.81:0/3395162063 wait complete. 2024-09-13T18:51:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 Processor -- start 2024-09-13T18:51:22.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 -- start start 2024-09-13T18:51:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 0x7f5b7015be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b70146330 0x7f5b7015ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b70160cc0 0x7f5b70138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7015f1a0 con 0x7f5b700b3100 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7015f440 con 0x7f5b70160cc0 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7013ce20 con 0x7f5b70146330 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 0x7f5b7015be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 0x7f5b7015be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53072/0 (socket says 172.21.15.81:53072) 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6ea00700 1 -- 172.21.15.81:0/4260257022 learned_addr learned my addr 172.21.15.81:0/4260257022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b6f400700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b70160cc0 0x7f5b70138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.945+0000 7f5b67e00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b70146330 0x7f5b7015ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6f400700 1 -- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b70146330 msgr2=0x7f5b7015ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6f400700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b70146330 0x7f5b7015ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6f400700 1 -- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 msgr2=0x7f5b7015be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6f400700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 0x7f5b7015be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6f400700 1 -- 172.21.15.81:0/4260257022 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b580094b0 con 0x7f5b70160cc0 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6ea00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 0x7f5b7015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:22.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6f400700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b70160cc0 0x7f5b70138b70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800caa0 tx=0x7f5b6800cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007480 con 0x7f5b70160cc0 2024-09-13T18:51:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b680075e0 con 0x7f5b70160cc0 2024-09-13T18:51:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b68007950 con 0x7f5b70160cc0 2024-09-13T18:51:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7013d100 con 0x7f5b70160cc0 2024-09-13T18:51:22.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7013d6c0 con 0x7f5b70160cc0 2024-09-13T18:51:22.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b70161150 con 0x7f5b70160cc0 2024-09-13T18:51:22.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.949+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b6801b3b0 con 0x7f5b70160cc0 2024-09-13T18:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.953+0000 7f5b66a00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b4c066730 0x7f5b4c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.953+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b68083a30 con 0x7f5b70160cc0 2024-09-13T18:51:22.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.953+0000 7f5b6ea00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b4c066730 0x7f5b4c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:22.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.953+0000 7f5b6ea00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b4c066730 0x7f5b4c068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5b600112c0 tx=0x7f5b60009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:22.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:22.961+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b68050c70 con 0x7f5b70160cc0 2024-09-13T18:51:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.213+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5b7006bca0 con 0x7f5b70160cc0 2024-09-13T18:51:23.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.225+0000 7f5b66a00700 1 -- 172.21.15.81:0/4260257022 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5b68017020 con 0x7f5b70160cc0 2024-09-13T18:51:23.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b4c066730 msgr2=0x7f5b4c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b4c066730 0x7f5b4c068bf0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5b600112c0 tx=0x7f5b60009240 comp rx=0 tx=0).stop 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b70160cc0 msgr2=0x7f5b70138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b70160cc0 0x7f5b70138b70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5b6800caa0 tx=0x7f5b6800cad0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 shutdown_connections 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b4c066730 0x7f5b4c068bf0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b70160cc0 0x7f5b70138b70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b70146330 0x7f5b7015ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 --2- 172.21.15.81:0/4260257022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b700b3100 0x7f5b7015be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 >> 172.21.15.81:0/4260257022 conn(0x7f5b7006a390 msgr2=0x7f5b700ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 shutdown_connections 2024-09-13T18:51:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.229+0000 7f5b6fe00700 1 -- 172.21.15.81:0/4260257022 wait complete. 2024-09-13T18:51:23.243 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-13T18:51:23.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:23.404 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:51:23.397+0000 7f0767400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:51:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.413+0000 7f9e7a800700 1 Processor -- start 2024-09-13T18:51:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e7a800700 1 -- start start 2024-09-13T18:51:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e7a800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 0x7f9e7415e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e7a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e7415e5d0 0x7f9e7406a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e7a800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7406baa0 con 0x7f9e740d0b50 2024-09-13T18:51:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e7a800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e7415ea10 con 0x7f9e7415e5d0 2024-09-13T18:51:23.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e7a800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7406af30 con 0x7f9e74160300 2024-09-13T18:51:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 0x7f9e7415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 0x7f9e7415e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:58926/0 (socket says 172.21.15.81:58926) 2024-09-13T18:51:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e72a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e7415e5d0 0x7f9e7406a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:23.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 -- 172.21.15.81:0/2300987758 learned_addr learned my addr 172.21.15.81:0/2300987758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 -- 172.21.15.81:0/2300987758 >> v2:172.21.15.81:3300/0 conn(0x7f9e7415e5d0 msgr2=0x7f9e7406a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 --2- 172.21.15.81:0/2300987758 >> v2:172.21.15.81:3300/0 conn(0x7f9e7415e5d0 0x7f9e7406a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 -- 172.21.15.81:0/2300987758 >> v1:172.21.15.178:6789/0 conn(0x7f9e740d0b50 legacy=0x7f9e740b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e73400700 1 -- 172.21.15.81:0/2300987758 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7406b200 con 0x7f9e74160300 2024-09-13T18:51:23.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.417+0000 7f9e72000700 1 -- 172.21.15.81:0/2300987758 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291220338 0 0) 0x7f9e7406baa0 con 0x7f9e740d0b50 2024-09-13T18:51:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e73400700 1 --2- 172.21.15.81:0/2300987758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 0x7f9e7415e020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009910 tx=0x7f9e64009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29605702c2601bf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e72000700 1 -- 172.21.15.81:0/2300987758 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64011830 con 0x7f9e74160300 2024-09-13T18:51:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e72000700 1 -- 172.21.15.81:0/2300987758 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e64011990 con 0x7f9e74160300 2024-09-13T18:51:23.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e72000700 1 -- 172.21.15.81:0/2300987758 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64011d40 con 0x7f9e74160300 2024-09-13T18:51:23.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 -- 172.21.15.81:0/2300987758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 msgr2=0x7f9e7415e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 --2- 172.21.15.81:0/2300987758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 0x7f9e7415e020 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009910 tx=0x7f9e64009c20 comp rx=0 tx=0).stop 2024-09-13T18:51:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 -- 172.21.15.81:0/2300987758 shutdown_connections 2024-09-13T18:51:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 --2- 172.21.15.81:0/2300987758 >> v2:172.21.15.81:3300/0 conn(0x7f9e7415e5d0 0x7f9e7406a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 --2- 172.21.15.81:0/2300987758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e74160300 0x7f9e7415e020 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 -- 172.21.15.81:0/2300987758 >> 172.21.15.81:0/2300987758 conn(0x7f9e7406e660 msgr2=0x7f9e7406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 -- 172.21.15.81:0/2300987758 shutdown_connections 2024-09-13T18:51:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.421+0000 7f9e7a800700 1 -- 172.21.15.81:0/2300987758 wait complete. 2024-09-13T18:51:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.425+0000 7f9e7a800700 1 Processor -- start 2024-09-13T18:51:23.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.425+0000 7f9e7a800700 1 -- start start 2024-09-13T18:51:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e740d0b50 0x7f9e74145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 0x7f9e740ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e74160300 0x7f9e740cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740b2490 con 0x7f9e7415e5d0 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740b1810 con 0x7f9e74160300 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740b1af0 con 0x7f9e740d0b50 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 0x7f9e740ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 0x7f9e740ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53090/0 (socket says 172.21.15.81:53090) 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 -- 172.21.15.81:0/1967819405 learned_addr learned my addr 172.21.15.81:0/1967819405 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e73400700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e740d0b50 0x7f9e74145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e73e00700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e74160300 0x7f9e740cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 -- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e740d0b50 msgr2=0x7f9e74145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e740d0b50 0x7f9e74145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 -- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e74160300 msgr2=0x7f9e740cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e74160300 0x7f9e740cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 -- 172.21.15.81:0/1967819405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e64009570 con 0x7f9e7415e5d0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e73e00700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e74160300 0x7f9e740cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e72a00700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 0x7f9e740ccf00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000e9a0 tx=0x7f9e6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60009720 con 0x7f9e7415e5d0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000c850 con 0x7f9e7415e5d0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e740b1dd0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000cbe0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e740b28b0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.429+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e740b25d0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.433+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e6000cd40 con 0x7f9e7415e5d0 2024-09-13T18:51:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.433+0000 7f9e6b400700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9e54066730 0x7f9e54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.433+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9e60084520 con 0x7f9e7415e5d0 2024-09-13T18:51:23.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.433+0000 7f9e73400700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9e54066730 0x7f9e54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:23.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.433+0000 7f9e73400700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9e54066730 0x7f9e54068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9e64000c00 tx=0x7f9e64008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:23.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.441+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e740b25d0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.665+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e740b25d0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e6b400700 1 -- 172.21.15.81:0/1967819405 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f9e740b25d0 con 0x7f9e7415e5d0 2024-09-13T18:51:23.679 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:23.679 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6816,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:20.925465+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6822},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:51:23.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9e54066730 msgr2=0x7f9e54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9e54066730 0x7f9e54068bf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9e64000c00 tx=0x7f9e64008030 comp rx=0 tx=0).stop 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 msgr2=0x7f9e740ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 0x7f9e740ccf00 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000e9a0 tx=0x7f9e6000ed60 comp rx=0 tx=0).stop 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 shutdown_connections 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9e54066730 0x7f9e54068bf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e74160300 0x7f9e740cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e7415e5d0 0x7f9e740ccf00 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 --2- 172.21.15.81:0/1967819405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e740d0b50 0x7f9e74145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:23.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 >> 172.21.15.81:0/1967819405 conn(0x7f9e7406e660 msgr2=0x7f9e7415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:23.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.669+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 shutdown_connections 2024-09-13T18:51:23.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:23.673+0000 7f9e7a800700 1 -- 172.21.15.81:0/1967819405 wait complete. 2024-09-13T18:51:23.684 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-13T18:51:24.104 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:51:17.898837+0000', 'modified': '2024-09-13T18:51:20.925465+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6822}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6822': {'gid': 6822, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/3000844155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3000844155}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 3000844155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:51:24.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:51:24.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:51:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.305+0000 7f9605e00700 1 Processor -- start 2024-09-13T18:51:24.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.305+0000 7f9605e00700 1 -- start start 2024-09-13T18:51:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96001610b0 0x7f96000719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f960006aaa0 0x7f960006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000b3560 con 0x7f96000b2670 2024-09-13T18:51:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9600070b30 con 0x7f96001610b0 2024-09-13T18:51:24.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960006b450 con 0x7f960006aaa0 2024-09-13T18:51:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f96000b2670 0x7f96000b2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35466/0 (socket says 172.21.15.81:35466) 2024-09-13T18:51:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9605400700 1 -- 172.21.15.81:0/2186675841 learned_addr learned my addr 172.21.15.81:0/2186675841 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9604a00700 1 --2- 172.21.15.81:0/2186675841 >> v2:172.21.15.81:3300/0 conn(0x7f96001610b0 0x7f96000719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f95ffe00700 1 --2- 172.21.15.81:0/2186675841 >> v2:172.21.15.178:3300/0 conn(0x7f960006aaa0 0x7f960006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f95ff400700 1 -- 172.21.15.81:0/2186675841 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127247313 0 0) 0x7f96000b3560 con 0x7f96000b2670 2024-09-13T18:51:24.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f95ff400700 1 -- 172.21.15.81:0/2186675841 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e80035d0 con 0x7f96000b2670 2024-09-13T18:51:24.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9604a00700 1 -- 172.21.15.81:0/2186675841 >> v2:172.21.15.178:3300/0 conn(0x7f960006aaa0 msgr2=0x7f960006af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9604a00700 1 --2- 172.21.15.81:0/2186675841 >> v2:172.21.15.178:3300/0 conn(0x7f960006aaa0 0x7f960006af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9604a00700 1 -- 172.21.15.81:0/2186675841 >> v1:172.21.15.81:6789/0 conn(0x7f96000b2670 legacy=0x7f96000b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.309+0000 7f9604a00700 1 -- 172.21.15.81:0/2186675841 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000b3280 con 0x7f96001610b0 2024-09-13T18:51:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9604a00700 1 --2- 172.21.15.81:0/2186675841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96000719c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009880 tx=0x7f95f4009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7398a227051a9317 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f95ff400700 1 -- 172.21.15.81:0/2186675841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4011830 con 0x7f96001610b0 2024-09-13T18:51:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f95ff400700 1 -- 172.21.15.81:0/2186675841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f4011990 con 0x7f96001610b0 2024-09-13T18:51:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f95ff400700 1 -- 172.21.15.81:0/2186675841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4011d00 con 0x7f96001610b0 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 -- 172.21.15.81:0/2186675841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 msgr2=0x7f96000719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 --2- 172.21.15.81:0/2186675841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96000719c0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009880 tx=0x7f95f4009b90 comp rx=0 tx=0).stop 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 -- 172.21.15.81:0/2186675841 shutdown_connections 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 --2- 172.21.15.81:0/2186675841 >> v2:172.21.15.178:3300/0 conn(0x7f960006aaa0 0x7f960006af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 --2- 172.21.15.81:0/2186675841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96000719c0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 -- 172.21.15.81:0/2186675841 >> 172.21.15.81:0/2186675841 conn(0x7f96000b0c40 msgr2=0x7f960006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 -- 172.21.15.81:0/2186675841 shutdown_connections 2024-09-13T18:51:24.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.313+0000 7f9605e00700 1 -- 172.21.15.81:0/2186675841 wait complete. 2024-09-13T18:51:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 Processor -- start 2024-09-13T18:51:24.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 -- start start 2024-09-13T18:51:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960006aaa0 0x7f96000a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96000b2670 0x7f96001fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96001fa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001643c0 con 0x7f96001610b0 2024-09-13T18:51:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9600163ab0 con 0x7f96000b2670 2024-09-13T18:51:24.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.317+0000 7f9605e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96001faba0 con 0x7f960006aaa0 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96001fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96001fa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53100/0 (socket says 172.21.15.81:53100) 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 -- 172.21.15.81:0/135810534 learned_addr learned my addr 172.21.15.81:0/135810534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9604a00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960006aaa0 0x7f96000a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f95ffe00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96000b2670 0x7f96001fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 -- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960006aaa0 msgr2=0x7f96000a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960006aaa0 0x7f96000a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 -- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96000b2670 msgr2=0x7f96001fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96000b2670 0x7f96001fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 -- 172.21.15.81:0/135810534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40094b0 con 0x7f96001610b0 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f95ffe00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96000b2670 0x7f96001fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605400700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96001fa660 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f95f800cb70 tx=0x7f95f800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f95fcc00700 1 -- 172.21.15.81:0/135810534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800a7b0 con 0x7f96001610b0 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f95fcc00700 1 -- 172.21.15.81:0/135810534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f800a910 con 0x7f96001610b0 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f95fcc00700 1 -- 172.21.15.81:0/135810534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800aca0 con 0x7f96001610b0 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96001fae10 con 0x7f96001610b0 2024-09-13T18:51:24.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.321+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9600163fe0 con 0x7f96001610b0 2024-09-13T18:51:24.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.325+0000 7f95fcc00700 1 -- 172.21.15.81:0/135810534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95f801b3b0 con 0x7f96001610b0 2024-09-13T18:51:24.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.325+0000 7f95fcc00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e0066730 0x7f95e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.325+0000 7f95fcc00700 1 -- 172.21.15.81:0/135810534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95f8083cd0 con 0x7f96001610b0 2024-09-13T18:51:24.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.325+0000 7f9604a00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e0066730 0x7f95e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.325+0000 7f960a81e740 1 Processor -- start 2024-09-13T18:51:24.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.325+0000 7f960a81e740 1 -- start start 2024-09-13T18:51:24.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e0066730 0x7f95e0068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f95f40090b0 tx=0x7f95f4010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eb5e90 0x1e9f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b50 0x1e9fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dfed80 con 0x1ed7230 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dfc510 con 0x1eb5e90 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1df7e00 con 0x1ed7b50 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53108/0 (socket says 172.21.15.81:53108) 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 -- 172.21.15.81:0/391345600 learned_addr learned my addr 172.21.15.81:0/391345600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9605400700 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b50 0x1e9fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f95ffe00700 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eb5e90 0x1e9f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 -- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b50 msgr2=0x1e9fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b50 0x1e9fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 -- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eb5e90 msgr2=0x1e9f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eb5e90 0x1e9f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 -- 172.21.15.81:0/391345600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c6a960 con 0x1ed7230 2024-09-13T18:51:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f95ffe00700 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eb5e90 0x1e9f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f9604a00700 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed7610 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f96000b1690 tx=0x7f95f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a2babdb29bfa60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f95f1200700 1 -- 172.21.15.81:0/391345600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40038c0 con 0x1ed7230 2024-09-13T18:51:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f95f1200700 1 -- 172.21.15.81:0/391345600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f402c070 con 0x1ed7230 2024-09-13T18:51:24.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f95f1200700 1 -- 172.21.15.81:0/391345600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f4003c40 con 0x1ed7230 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 -- 172.21.15.81:0/391345600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 msgr2=0x1ed7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.329+0000 7f960a81e740 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed7610 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f96000b1690 tx=0x7f95f4009f90 comp rx=0 tx=0).stop 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- 172.21.15.81:0/391345600 shutdown_connections 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7b50 0x1e9fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eb5e90 0x1e9f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 --2- 172.21.15.81:0/391345600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed7610 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- 172.21.15.81:0/391345600 >> 172.21.15.81:0/391345600 conn(0x1c1f4d0 msgr2=0x1eb8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- 172.21.15.81:0/391345600 shutdown_connections 2024-09-13T18:51:24.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- 172.21.15.81:0/391345600 wait complete. 2024-09-13T18:51:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- start start 2024-09-13T18:51:24.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 Processor -- start 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1eb53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7230 0x1eb7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b50 0x1eb7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db5730 con 0x1eb5e90 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dbb5b0 con 0x1ed7b50 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ca3aa0 con 0x1ed7230 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f960a81e740 10 client.0 _ll_register_callbacks cb 0x1df1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1eb53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1eb53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53122/0 (socket says 172.21.15.81:53122) 2024-09-13T18:51:24.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 -- 172.21.15.81:0/1286630660 learned_addr learned my addr 172.21.15.81:0/1286630660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9605400700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b50 0x1eb7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f95ffe00700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7230 0x1eb7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 -- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7230 msgr2=0x1eb7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7230 0x1eb7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 -- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b50 msgr2=0x1eb7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b50 0x1eb7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.333+0000 7f9604a00700 1 -- 172.21.15.81:0/1286630660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f4022070 con 0x1eb5e90 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f9604a00700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1eb53c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f95f4004740 tx=0x7f95f40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0c530df613ee42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 1 -- 172.21.15.81:0/1286630660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40092b0 con 0x1eb5e90 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 1 -- 172.21.15.81:0/1286630660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95f4003a50 con 0x1eb5e90 2024-09-13T18:51:24.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c2c1e0 con 0x1eb5e90 2024-09-13T18:51:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 1 -- 172.21.15.81:0/1286630660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95f4003c10 con 0x1eb5e90 2024-09-13T18:51:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 10 client.6954 fetch_fsmap learned FSMap version 52 2024-09-13T18:51:24.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x1dbe220 con 0x1eb5e90 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 1 -- 172.21.15.81:0/1286630660 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c2c1e0 con 0x1eb5e90 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 1 -- 172.21.15.81:0/1286630660 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 52) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f95f403a480 con 0x1eb5e90 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 10 client.6954 fetch_fsmap finished waiting for FSMap version 52 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 10 client.6954 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 20 client.6954 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1e902a0 0x1eeac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 4 client.6954 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c76460 con 0x1e902a0 2024-09-13T18:51:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95ffe00700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1e902a0 0x1eeac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95ffe00700 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1e902a0 0x1eeac90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3498114104cd0ce server_cookie=33ae0ed781e9491a in_seq=0 out_seq=0 2024-09-13T18:51:24.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.337+0000 7f95e5600700 10 client.6954 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f95e5600700 1 -- 172.21.15.81:0/1286630660 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1c76460 con 0x1e902a0 2024-09-13T18:51:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f95e5600700 10 client.6954 handle_command_reply: tid=0 2024-09-13T18:51:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 client.6954 shutdown 2024-09-13T18:51:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 msgr2=0x1eb53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1eb53c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f95f4004740 tx=0x7f95f40047e0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 shutdown_connections 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1e902a0 0x1eeac90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7b50 0x1eb7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ed7230 0x1eb7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 --2- 172.21.15.81:0/1286630660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1eb53c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f95e5600700 0 client.6954 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 >> 172.21.15.81:0/1286630660 conn(0x1c1f4d0 msgr2=0x1e8b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 shutdown_connections 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 1 -- 172.21.15.81:0/1286630660 wait complete. 2024-09-13T18:51:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.341+0000 7f960a81e740 20 client.6954 trim_cache size 0 max 16384 2024-09-13T18:51:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.361+0000 7f960a81e740 1 Processor -- start 2024-09-13T18:51:24.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.361+0000 7f960a81e740 1 -- start start 2024-09-13T18:51:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c1f4d0 0x1eb7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1eb5e90 0x1ed7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f960a81e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f960a81e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dc1050 con 0x1ed7230 2024-09-13T18:51:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1db4690 con 0x1c1f4d0 2024-09-13T18:51:24.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1defb00 con 0x1eb5e90 2024-09-13T18:51:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53136/0 (socket says 172.21.15.81:53136) 2024-09-13T18:51:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 -- 172.21.15.81:0/179636380 learned_addr learned my addr 172.21.15.81:0/179636380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9604a00700 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c1f4d0 0x1eb7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f95ffe00700 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1eb5e90 0x1ed7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 -- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1eb5e90 msgr2=0x1ed7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1eb5e90 0x1ed7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 -- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c1f4d0 msgr2=0x1eb7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c1f4d0 0x1eb7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 -- 172.21.15.81:0/179636380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1da4450 con 0x1ed7230 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f9605400700 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed8470 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f95f80510b0 tx=0x7f95f80014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83a2402613f7091 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f95f1c00700 1 -- 172.21.15.81:0/179636380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f80589e0 con 0x1ed7230 2024-09-13T18:51:24.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f95f1c00700 1 -- 172.21.15.81:0/179636380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f805cfa0 con 0x1ed7230 2024-09-13T18:51:24.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.365+0000 7f95f1c00700 1 -- 172.21.15.81:0/179636380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8082130 con 0x1ed7230 2024-09-13T18:51:24.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 -- 172.21.15.81:0/179636380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 msgr2=0x1ed8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed8470 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f95f80510b0 tx=0x7f95f80014d0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 -- 172.21.15.81:0/179636380 shutdown_connections 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1ed7230 0x1ed8470 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1eb5e90 0x1ed7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 --2- 172.21.15.81:0/179636380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c1f4d0 0x1eb7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 -- 172.21.15.81:0/179636380 >> 172.21.15.81:0/179636380 conn(0x1eb5820 msgr2=0x1eb5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 -- 172.21.15.81:0/179636380 shutdown_connections 2024-09-13T18:51:24.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 -- 172.21.15.81:0/179636380 wait complete. 2024-09-13T18:51:24.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 -- start start 2024-09-13T18:51:24.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.369+0000 7f960a81e740 1 Processor -- start 2024-09-13T18:51:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c1f4d0 0x1f37b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1f38060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7230 0x1ef4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eb7b20 con 0x1eb5e90 2024-09-13T18:51:24.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1edd1e0 con 0x1ed7230 2024-09-13T18:51:24.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1edd680 con 0x1c1f4d0 2024-09-13T18:51:24.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f960a81e740 10 client.0 _ll_register_callbacks cb 0x1da9ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1f38060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1f38060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53152/0 (socket says 172.21.15.81:53152) 2024-09-13T18:51:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 -- 172.21.15.81:0/21094330 learned_addr learned my addr 172.21.15.81:0/21094330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f9604a00700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c1f4d0 0x1f37b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f9605400700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7230 0x1ef4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 -- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c1f4d0 msgr2=0x1f37b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c1f4d0 0x1f37b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 -- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7230 msgr2=0x1ef4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7230 0x1ef4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 -- 172.21.15.81:0/21094330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9600163fe0 con 0x1eb5e90 2024-09-13T18:51:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95ffe00700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1f38060 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x1db5820 tx=0x7f95ec01fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dce881e4d5d61bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95e5600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.373+0000 7f95e5600700 1 -- 172.21.15.81:0/21094330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec01c040 con 0x1eb5e90 2024-09-13T18:51:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 1 -- 172.21.15.81:0/21094330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f95ec029c70 con 0x1eb5e90 2024-09-13T18:51:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95f402c070 con 0x1eb5e90 2024-09-13T18:51:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 1 -- 172.21.15.81:0/21094330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95ec029e30 con 0x1eb5e90 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 10 client.6960 fetch_fsmap learned FSMap version 52 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x1d98720 con 0x1eb5e90 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 1 -- 172.21.15.81:0/21094330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f402c070 con 0x1eb5e90 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 1 -- 172.21.15.81:0/21094330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 52) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f95ec028480 con 0x1eb5e90 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 10 client.6960 fetch_fsmap finished waiting for FSMap version 52 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 10 client.6960 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 20 client.6960 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1ed7b50 0x1edb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 4 client.6960 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:51:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1c9b1e0 con 0x1ed7b50 2024-09-13T18:51:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f9604a00700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1ed7b50 0x1edb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 10 client.6960 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f9604a00700 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1ed7b50 0x1edb8c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6026b15297ee2438 server_cookie=74543f463cbd1d73 in_seq=0 out_seq=0 2024-09-13T18:51:24.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 1 -- 172.21.15.81:0/21094330 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1c9b1e0 con 0x1ed7b50 2024-09-13T18:51:24.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f95e5600700 10 client.6960 handle_command_reply: tid=0 2024-09-13T18:51:24.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.377+0000 7f960a81e740 1 client.6960 shutdown 2024-09-13T18:51:24.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 msgr2=0x1f38060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1f38060 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x1db5820 tx=0x7f95ec01fec0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 shutdown_connections 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x1ed7b50 0x1edb8c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ed7230 0x1ef4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1eb5e90 0x1f38060 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 --2- 172.21.15.81:0/21094330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c1f4d0 0x1f37b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f95e5600700 0 client.6960 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 >> 172.21.15.81:0/21094330 conn(0x1eb5820 msgr2=0x1eb5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 shutdown_connections 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 1 -- 172.21.15.81:0/21094330 wait complete. 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f960a81e740 20 client.6960 trim_cache size 0 max 16384 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6822, 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:51:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.4810074389999999, 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 52, 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 67, 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 67, 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.662754938000001 2024-09-13T18:51:24.393 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e0066730 msgr2=0x7f95e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e0066730 0x7f95e0068bf0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f95f40090b0 tx=0x7f95f4010000 comp rx=0 tx=0).stop 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 msgr2=0x7f96001fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96001fa660 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f95f800cb70 tx=0x7f95f800cba0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 shutdown_connections 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95e0066730 0x7f95e0068bf0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96001610b0 0x7f96001fa660 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96000b2670 0x7f96001fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 --2- 172.21.15.81:0/135810534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960006aaa0 0x7f96000a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 >> 172.21.15.81:0/135810534 conn(0x7f96000b0c40 msgr2=0x7f96000af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 shutdown_connections 2024-09-13T18:51:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.381+0000 7f9605e00700 1 -- 172.21.15.81:0/135810534 wait complete. 2024-09-13T18:51:24.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:51:24.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.573+0000 7f1b0e800700 1 Processor -- start 2024-09-13T18:51:24.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.573+0000 7f1b0e800700 1 -- start start 2024-09-13T18:51:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0e800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b0806aaa0 0x7f1b0806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b080b2670 0x7f1b080b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0e800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b080b3040 con 0x7f1b081610b0 2024-09-13T18:51:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0e800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b08070b30 con 0x7f1b0806aaa0 2024-09-13T18:51:24.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0806b450 con 0x7f1b080b2670 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1b081610b0 0x7f1b080719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35472/0 (socket says 172.21.15.81:35472) 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0d400700 1 -- 172.21.15.81:0/1442842040 learned_addr learned my addr 172.21.15.81:0/1442842040 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0ca00700 1 --2- 172.21.15.81:0/1442842040 >> v2:172.21.15.178:3300/0 conn(0x7f1b0806aaa0 0x7f1b0806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b0de00700 1 --2- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b080b2670 0x7f1b080b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b07e00700 1 -- 172.21.15.81:0/1442842040 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444422243 0 0) 0x7f1afc001110 con 0x7f1b081610b0 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.577+0000 7f1b07e00700 1 -- 172.21.15.81:0/1442842040 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af00035d0 con 0x7f1b081610b0 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0ca00700 1 -- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b080b2670 msgr2=0x7f1b080b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:24.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0ca00700 1 --2- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b080b2670 0x7f1b080b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0ca00700 1 -- 172.21.15.81:0/1442842040 >> v1:172.21.15.81:6789/0 conn(0x7f1b081610b0 legacy=0x7f1b080719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0ca00700 1 -- 172.21.15.81:0/1442842040 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080b3560 con 0x7f1b0806aaa0 2024-09-13T18:51:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0ca00700 1 --2- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b0806aaa0 0x7f1b0806af10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009880 tx=0x7f1af4009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b81cfef60f014c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b07e00700 1 -- 172.21.15.81:0/1442842040 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011830 con 0x7f1b0806aaa0 2024-09-13T18:51:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b07e00700 1 -- 172.21.15.81:0/1442842040 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4011990 con 0x7f1b0806aaa0 2024-09-13T18:51:24.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b07e00700 1 -- 172.21.15.81:0/1442842040 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011d20 con 0x7f1b0806aaa0 2024-09-13T18:51:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 -- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b0806aaa0 msgr2=0x7f1b0806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 --2- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b0806aaa0 0x7f1b0806af10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1af4009880 tx=0x7f1af4009b90 comp rx=0 tx=0).stop 2024-09-13T18:51:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 -- 172.21.15.81:0/1442842040 shutdown_connections 2024-09-13T18:51:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 --2- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b080b2670 0x7f1b080b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 --2- 172.21.15.81:0/1442842040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b0806aaa0 0x7f1b0806af10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 -- 172.21.15.81:0/1442842040 >> 172.21.15.81:0/1442842040 conn(0x7f1b080b0c40 msgr2=0x7f1b0806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 -- 172.21.15.81:0/1442842040 shutdown_connections 2024-09-13T18:51:24.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.581+0000 7f1b0e800700 1 -- 172.21.15.81:0/1442842040 wait complete. 2024-09-13T18:51:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 Processor -- start 2024-09-13T18:51:24.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 -- start start 2024-09-13T18:51:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b0806aaa0 0x7f1b0815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b080b2670 0x7f1b081517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 0x7f1b08151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08152430 con 0x7f1b081610b0 2024-09-13T18:51:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b08152710 con 0x7f1b080b2670 2024-09-13T18:51:24.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081529f0 con 0x7f1b0806aaa0 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 0x7f1b08151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 0x7f1b08151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53160/0 (socket says 172.21.15.81:53160) 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0de00700 1 -- 172.21.15.81:0/2002022801 learned_addr learned my addr 172.21.15.81:0/2002022801 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.585+0000 7f1b0ca00700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b080b2670 0x7f1b081517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0d400700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b0806aaa0 0x7f1b0815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0de00700 1 -- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b0806aaa0 msgr2=0x7f1b0815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0de00700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b0806aaa0 0x7f1b0815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0de00700 1 -- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b080b2670 msgr2=0x7f1b081517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0de00700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b080b2670 0x7f1b081517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0de00700 1 -- 172.21.15.81:0/2002022801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40094b0 con 0x7f1b081610b0 2024-09-13T18:51:24.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0d400700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b0806aaa0 0x7f1b0815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:24.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0de00700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 0x7f1b08151d20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000efc0 tx=0x7f1b0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00009ea0 con 0x7f1b081610b0 2024-09-13T18:51:24.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0000f040 con 0x7f1b081610b0 2024-09-13T18:51:24.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b08152cd0 con 0x7f1b081610b0 2024-09-13T18:51:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00014480 con 0x7f1b081610b0 2024-09-13T18:51:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0815fe60 con 0x7f1b081610b0 2024-09-13T18:51:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.589+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b08161490 con 0x7f1b081610b0 2024-09-13T18:51:24.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.593+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1b000145e0 con 0x7f1b081610b0 2024-09-13T18:51:24.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.593+0000 7f1b05600700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ae8066730 0x7f1ae8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:24.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.593+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b00084b90 con 0x7f1b081610b0 2024-09-13T18:51:24.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.593+0000 7f1b0d400700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ae8066730 0x7f1ae8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:24.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.597+0000 7f1b0d400700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ae8066730 0x7f1ae8068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1afc001270 tx=0x7f1afc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:24.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.601+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b00051d20 con 0x7f1b081610b0 2024-09-13T18:51:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.825+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b080b2210 con 0x7f1b081610b0 2024-09-13T18:51:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.829+0000 7f1b05600700 1 -- 172.21.15.81:0/2002022801 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1b00018020 con 0x7f1b081610b0 2024-09-13T18:51:24.839 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:51:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ae8066730 msgr2=0x7f1ae8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ae8066730 0x7f1ae8068bf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1afc001270 tx=0x7f1afc009040 comp rx=0 tx=0).stop 2024-09-13T18:51:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 msgr2=0x7f1b08151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 0x7f1b08151d20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1b0000efc0 tx=0x7f1b0000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 shutdown_connections 2024-09-13T18:51:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1ae8066730 0x7f1ae8068bf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b081610b0 0x7f1b08151d20 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b080b2670 0x7f1b081517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 --2- 172.21.15.81:0/2002022801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b0806aaa0 0x7f1b0815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 >> 172.21.15.81:0/2002022801 conn(0x7f1b080b0c40 msgr2=0x7f1b0806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 shutdown_connections 2024-09-13T18:51:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:24.833+0000 7f1b0e800700 1 -- 172.21.15.81:0/2002022801 wait complete. 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:51:24.867 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:51:24.868 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:51:24.868 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:51:24.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:24.868 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:51:24.887 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:51:24.888 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42207sec preferred_lft 42207sec 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:51:24.889 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::3069:26ff:fefd:eadb/64 scope link 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:51:24.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:24.890 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:51:24.967 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:51:24.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:24.970 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:51:25.031 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:51:25.032 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:51:25.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:25.033 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:51:25.033 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:51:25.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:51:25.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:51:25.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:51:25.033 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:51:25.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:25.169 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:51:25.184 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:51:25.184 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:51:25.185 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:51:25.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:25.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:51:25.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:51:25.263 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:51:25.324 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:51:25.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:51:25.324 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:51:25.382 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:51:25.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:25.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:51:25.515 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:51:25.515 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:51:25.546 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:51:25.546 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:51:25.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:51:25.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:51:25.547 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:51:25.556 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:51:25.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:25.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:51:25.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:25.591 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:51:25.672 INFO:teuthology.orchestra.run.smithi081.stdout:client6969 2024-09-13T18:51:25.672 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:51:25.672 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:51:25.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:51:25.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc091200700 1 Processor -- start 2024-09-13T18:51:25.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc091200700 1 -- start start 2024-09-13T18:51:25.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc091200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc08c15aec0 0x7fc08c0cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc091200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c15b4f0 con 0x7fc08c15aae0 2024-09-13T18:51:25.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc091200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c15b7d0 con 0x7fc08c0cefd0 2024-09-13T18:51:25.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc091200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c15c100 con 0x7fc08c15aec0 2024-09-13T18:51:25.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc08b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc08c15aae0 0x7fc08c0710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35476/0 (socket says 172.21.15.81:35476) 2024-09-13T18:51:25.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc08b400700 1 -- 172.21.15.81:0/2631284361 learned_addr learned my addr 172.21.15.81:0/2631284361 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:25.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.949+0000 7fc08aa00700 1 --2- 172.21.15.81:0/2631284361 >> v2:172.21.15.178:3300/0 conn(0x7fc08c15aec0 0x7fc08c0cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.953+0000 7fc08aa00700 1 -- 172.21.15.81:0/2631284361 >> v1:172.21.15.178:6789/0 conn(0x7fc08c0cefd0 legacy=0x7fc08c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.953+0000 7fc08aa00700 1 -- 172.21.15.81:0/2631284361 >> v1:172.21.15.81:6789/0 conn(0x7fc08c15aae0 legacy=0x7fc08c0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.953+0000 7fc08aa00700 1 -- 172.21.15.81:0/2631284361 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c15bab0 con 0x7fc08c15aec0 2024-09-13T18:51:25.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.953+0000 7fc08aa00700 1 --2- 172.21.15.81:0/2631284361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c0cc4a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc078009850 tx=0x7fc078009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f75e46b6c20f69 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:25.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc08a000700 1 -- 172.21.15.81:0/2631284361 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078011830 con 0x7fc08c15aec0 2024-09-13T18:51:25.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc08a000700 1 -- 172.21.15.81:0/2631284361 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078011990 con 0x7fc08c15aec0 2024-09-13T18:51:25.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc08a000700 1 -- 172.21.15.81:0/2631284361 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078011d20 con 0x7fc08c15aec0 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 -- 172.21.15.81:0/2631284361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 msgr2=0x7fc08c0cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 --2- 172.21.15.81:0/2631284361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c0cc4a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc078009850 tx=0x7fc078009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 -- 172.21.15.81:0/2631284361 shutdown_connections 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 --2- 172.21.15.81:0/2631284361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c0cc4a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 -- 172.21.15.81:0/2631284361 >> 172.21.15.81:0/2631284361 conn(0x7fc08c06a390 msgr2=0x7fc08c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 -- 172.21.15.81:0/2631284361 shutdown_connections 2024-09-13T18:51:25.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.957+0000 7fc091200700 1 -- 172.21.15.81:0/2631284361 wait complete. 2024-09-13T18:51:25.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 Processor -- start 2024-09-13T18:51:25.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 -- start start 2024-09-13T18:51:25.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc08c0cefd0 0x7fc08c142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 0x7fc08c1efb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1f00b0 con 0x7fc08c15aae0 2024-09-13T18:51:25.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0c9a20 con 0x7fc08c15aec0 2024-09-13T18:51:25.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc091200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c145840 con 0x7fc08c0cefd0 2024-09-13T18:51:25.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 0x7fc08c1efb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 0x7fc08c1efb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53176/0 (socket says 172.21.15.81:53176) 2024-09-13T18:51:25.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 -- 172.21.15.81:0/2390881941 learned_addr learned my addr 172.21.15.81:0/2390881941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:25.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08b400700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc08c0cefd0 0x7fc08c142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08be00700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 -- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc08c0cefd0 msgr2=0x7fc08c142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc08c0cefd0 0x7fc08c142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 -- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 msgr2=0x7fc08c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 -- 172.21.15.81:0/2390881941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780094b0 con 0x7fc08c15aae0 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08be00700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:25.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc08aa00700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 0x7fc08c1efb70 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc078009fd0 tx=0x7fc078004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:25.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.961+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780036c0 con 0x7fc08c15aae0 2024-09-13T18:51:25.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c0c9fc0 con 0x7fc08c15aae0 2024-09-13T18:51:25.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07801e070 con 0x7fc08c15aae0 2024-09-13T18:51:25.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078003a80 con 0x7fc08c15aae0 2024-09-13T18:51:25.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c142550 con 0x7fc08c15aae0 2024-09-13T18:51:25.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c0679b0 con 0x7fc08c15aae0 2024-09-13T18:51:25.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc078003be0 con 0x7fc08c15aae0 2024-09-13T18:51:25.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc083400700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc06c066760 0x7fc06c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:25.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.965+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc078020070 con 0x7fc08c15aae0 2024-09-13T18:51:25.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.969+0000 7fc08b400700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc06c066760 0x7fc06c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:25.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.969+0000 7fc08b400700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc06c066760 0x7fc06c068c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005930 tx=0x7fc07c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:25.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:25.973+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc078052b70 con 0x7fc08c15aae0 2024-09-13T18:51:26.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.189+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fc08c0cc4a0 con 0x7fc08c15aae0 2024-09-13T18:51:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.969+0000 7fc083400700 1 -- 172.21.15.81:0/2390881941 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v53) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc078056190 con 0x7fc08c15aae0 2024-09-13T18:51:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc06c066760 msgr2=0x7fc06c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc06c066760 0x7fc06c068c20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc07c005930 tx=0x7fc07c009040 comp rx=0 tx=0).stop 2024-09-13T18:51:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 msgr2=0x7fc08c1efb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 0x7fc08c1efb70 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc078009fd0 tx=0x7fc078004770 comp rx=0 tx=0).stop 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 shutdown_connections 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc06c066760 0x7fc06c068c20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc08c15aec0 0x7fc08c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc08c15aae0 0x7fc08c1efb70 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 --2- 172.21.15.81:0/2390881941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc08c0cefd0 0x7fc08c142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 >> 172.21.15.81:0/2390881941 conn(0x7fc08c06a390 msgr2=0x7fc08c15c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 shutdown_connections 2024-09-13T18:51:26.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:26.977+0000 7fc091200700 1 -- 172.21.15.81:0/2390881941 wait complete. 2024-09-13T18:51:27.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.169+0000 7fcc01400700 1 Processor -- start 2024-09-13T18:51:27.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.169+0000 7fcc01400700 1 -- start start 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc01400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbfc159bd0 0x7fcbfc0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc01400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc01400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc0707d0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc01400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc06b490 con 0x7fcbfc159bd0 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc01400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc0720a0 con 0x7fcbfc071870 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbfc159bd0 0x7fcbfc0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc00a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcbfc06afe0 0x7fcbfc0b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58112/0 (socket says 172.21.15.81:58112) 2024-09-13T18:51:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcc00a00700 1 -- 172.21.15.81:0/1400152857 learned_addr learned my addr 172.21.15.81:0/1400152857 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfb400700 1 --2- 172.21.15.81:0/1400152857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfaa00700 1 -- 172.21.15.81:0/1400152857 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805408808 0 0) 0x7fcbfc0707d0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfaa00700 1 -- 172.21.15.81:0/1400152857 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe00035d0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfbe00700 1 -- 172.21.15.81:0/1400152857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 msgr2=0x7fcbfc06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfbe00700 1 --2- 172.21.15.81:0/1400152857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfbe00700 1 -- 172.21.15.81:0/1400152857 >> v1:172.21.15.81:6789/0 conn(0x7fcbfc06afe0 legacy=0x7fcbfc0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfbe00700 1 -- 172.21.15.81:0/1400152857 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc06fee0 con 0x7fcbfc159bd0 2024-09-13T18:51:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfbe00700 1 --2- 172.21.15.81:0/1400152857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc0cb700 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009880 tx=0x7fcbec009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3143fafc071636ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfaa00700 1 -- 172.21.15.81:0/1400152857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec011830 con 0x7fcbfc159bd0 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfaa00700 1 -- 172.21.15.81:0/1400152857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec011990 con 0x7fcbfc159bd0 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.173+0000 7fcbfaa00700 1 -- 172.21.15.81:0/1400152857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec011d20 con 0x7fcbfc159bd0 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 -- 172.21.15.81:0/1400152857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc159bd0 msgr2=0x7fcbfc0cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 --2- 172.21.15.81:0/1400152857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc0cb700 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009880 tx=0x7fcbec009b90 comp rx=0 tx=0).stop 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 -- 172.21.15.81:0/1400152857 shutdown_connections 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 --2- 172.21.15.81:0/1400152857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 --2- 172.21.15.81:0/1400152857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc0cb700 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 -- 172.21.15.81:0/1400152857 >> 172.21.15.81:0/1400152857 conn(0x7fcbfc0b0c40 msgr2=0x7fcbfc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 -- 172.21.15.81:0/1400152857 shutdown_connections 2024-09-13T18:51:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 -- 172.21.15.81:0/1400152857 wait complete. 2024-09-13T18:51:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.177+0000 7fcc01400700 1 Processor -- start 2024-09-13T18:51:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 -- start start 2024-09-13T18:51:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 0x7fcbfc1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc1f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc1e6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc155900 con 0x7fcbfc06afe0 2024-09-13T18:51:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1e3db0 con 0x7fcbfc159bd0 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc01400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1e4070 con 0x7fcbfc071870 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 0x7fcbfc1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 0x7fcbfc1553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54210/0 (socket says 172.21.15.81:54210) 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 -- 172.21.15.81:0/744197636 learned_addr learned my addr 172.21.15.81:0/744197636 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfb400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc1f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc00a00700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc1e6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 -- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 msgr2=0x7fcbfc1f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc1f6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 -- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc159bd0 msgr2=0x7fcbfc1e6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc1e6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 -- 172.21.15.81:0/744197636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0094b0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcc00a00700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc1e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.181+0000 7fcbfbe00700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 0x7fcbfc1553c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0090b0 tx=0x7fcbec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.185+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0045d0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.185+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec01e070 con 0x7fcbfc06afe0 2024-09-13T18:51:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.185+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc1e4350 con 0x7fcbfc06afe0 2024-09-13T18:51:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.185+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0038e0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.185+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc1e4910 con 0x7fcbfc06afe0 2024-09-13T18:51:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.185+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc1571d0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.189+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcbec003a40 con 0x7fcbfc06afe0 2024-09-13T18:51:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.189+0000 7fcbf3e00700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcbdc066730 0x7fcbdc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.189+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcbec085170 con 0x7fcbfc06afe0 2024-09-13T18:51:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.189+0000 7fcbfb400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcbdc066730 0x7fcbdc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:27.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.189+0000 7fcbfb400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcbdc066730 0x7fcbdc068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc1e3b30 tx=0x7fcbe8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.197+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcbec052430 con 0x7fcbfc06afe0 2024-09-13T18:51:27.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.425+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbfc158ae0 con 0x7fcbfc06afe0 2024-09-13T18:51:27.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.425+0000 7fcbf3e00700 1 -- 172.21.15.81:0/744197636 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4757 (secure 0 0 0) 0x7fcbec055a50 con 0x7fcbfc06afe0 2024-09-13T18:51:27.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:27.437 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:26.977081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6822,"mds_1":6816},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:creating","state_seq":1,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:51:27.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcbdc066730 msgr2=0x7fcbdc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcbdc066730 0x7fcbdc068bf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc1e3b30 tx=0x7fcbe8008040 comp rx=0 tx=0).stop 2024-09-13T18:51:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 msgr2=0x7fcbfc1553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 0x7fcbfc1553c0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0090b0 tx=0x7fcbec004770 comp rx=0 tx=0).stop 2024-09-13T18:51:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 shutdown_connections 2024-09-13T18:51:27.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcbdc066730 0x7fcbdc068bf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbfc159bd0 0x7fcbfc1e6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbfc071870 0x7fcbfc1f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 --2- 172.21.15.81:0/744197636 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbfc06afe0 0x7fcbfc1553c0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 >> 172.21.15.81:0/744197636 conn(0x7fcbfc0b0c40 msgr2=0x7fcbfc0b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 shutdown_connections 2024-09-13T18:51:27.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:27.429+0000 7fcc01400700 1 -- 172.21.15.81:0/744197636 wait complete. 2024-09-13T18:51:27.443 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2024-09-13T18:51:27.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:51:17.898837+0000', 'modified': '2024-09-13T18:51:26.977081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6822, 'mds_1': 6816}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6816': {'gid': 6816, 'name': 'c', 'rank': 1, 'incarnation': 54, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.81:6837/2228642132', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2228642132}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2228642132}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6822': {'gid': 6822, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/3000844155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3000844155}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 3000844155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:51:27.864 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6816:up:creating 2024-09-13T18:51:28.405 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:51:28.401+0000 7f0767400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T18:51:28.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:29.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 Processor -- start 2024-09-13T18:51:29.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 -- start start 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f194815ab80 0x7f194815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f194815e650 0x7f194815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194815f0a0 con 0x7f19480cf2f0 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194815f380 con 0x7f194815e650 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f194d200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194815b320 con 0x7f194815ab80 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f1947e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19480cf2f0 0x7f19480cd410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58118/0 (socket says 172.21.15.81:58118) 2024-09-13T18:51:29.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f1946a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f194815e650 0x7f194815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f1947e00700 1 -- 172.21.15.81:0/1135917591 learned_addr learned my addr 172.21.15.81:0/1135917591 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.029+0000 7f1947400700 1 --2- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f194815ab80 0x7f194815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946a00700 1 -- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f194815ab80 msgr2=0x7f194815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946a00700 1 --2- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f194815ab80 0x7f194815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946a00700 1 -- 172.21.15.81:0/1135917591 >> v1:172.21.15.81:6789/0 conn(0x7f19480cf2f0 legacy=0x7f19480cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946a00700 1 -- 172.21.15.81:0/1135917591 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194815b600 con 0x7f194815e650 2024-09-13T18:51:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946a00700 1 --2- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f194815ea90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1934009850 tx=0x7f1934009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95796750d4f8b548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946000700 1 -- 172.21.15.81:0/1135917591 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934011830 con 0x7f194815e650 2024-09-13T18:51:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946000700 1 -- 172.21.15.81:0/1135917591 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934011990 con 0x7f194815e650 2024-09-13T18:51:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f1946000700 1 -- 172.21.15.81:0/1135917591 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934011d40 con 0x7f194815e650 2024-09-13T18:51:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 -- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 msgr2=0x7f194815ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 --2- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f194815ea90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1934009850 tx=0x7f1934009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 -- 172.21.15.81:0/1135917591 shutdown_connections 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 --2- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f194815ea90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 --2- 172.21.15.81:0/1135917591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f194815ab80 0x7f194815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 -- 172.21.15.81:0/1135917591 >> 172.21.15.81:0/1135917591 conn(0x7f1948071d90 msgr2=0x7f1948072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 -- 172.21.15.81:0/1135917591 shutdown_connections 2024-09-13T18:51:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.033+0000 7f194d200700 1 -- 172.21.15.81:0/1135917591 wait complete. 2024-09-13T18:51:29.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.037+0000 7f194d200700 1 Processor -- start 2024-09-13T18:51:29.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.037+0000 7f194d200700 1 -- start start 2024-09-13T18:51:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.037+0000 7f194d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19480cf2f0 0x7f1948141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 0x7f1948152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f19481588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948141850 con 0x7f194815ab80 2024-09-13T18:51:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948156d60 con 0x7f194815e650 2024-09-13T18:51:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1948153010 con 0x7f19480cf2f0 2024-09-13T18:51:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 0x7f1948152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 0x7f1948152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54222/0 (socket says 172.21.15.81:54222) 2024-09-13T18:51:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 -- 172.21.15.81:0/2196666246 learned_addr learned my addr 172.21.15.81:0/2196666246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1947400700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19480cf2f0 0x7f1948141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1947e00700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f19481588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 -- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19480cf2f0 msgr2=0x7f1948141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19480cf2f0 0x7f1948141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 -- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 msgr2=0x7f19481588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f19481588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 -- 172.21.15.81:0/2196666246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340094b0 con 0x7f194815ab80 2024-09-13T18:51:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1947e00700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f19481588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f1946a00700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 0x7f1948152ad0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1934014040 tx=0x7f1934004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340036c0 con 0x7f194815ab80 2024-09-13T18:51:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193401e070 con 0x7f194815ab80 2024-09-13T18:51:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934003a60 con 0x7f194815ab80 2024-09-13T18:51:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1948156fb0 con 0x7f194815ab80 2024-09-13T18:51:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19481597d0 con 0x7f194815ab80 2024-09-13T18:51:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.041+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194815da20 con 0x7f194815ab80 2024-09-13T18:51:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.045+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1934003bc0 con 0x7f194815ab80 2024-09-13T18:51:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.045+0000 7f193f400700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1928066730 0x7f1928068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.045+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1934020070 con 0x7f194815ab80 2024-09-13T18:51:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.045+0000 7f1947400700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1928066730 0x7f1928068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.045+0000 7f1947400700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1928066730 0x7f1928068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1938009bf0 tx=0x7f1938009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.053+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1934052960 con 0x7f194815ab80 2024-09-13T18:51:29.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.277+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19480cfb60 con 0x7f194815ab80 2024-09-13T18:51:29.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.277+0000 7f193f400700 1 -- 172.21.15.81:0/2196666246 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4769 (secure 0 0 0) 0x7f1934055f80 con 0x7f194815ab80 2024-09-13T18:51:29.288 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:29.289 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:28.992431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6822,"mds_1":6816,"mds_2":6559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6559":{"gid":6559,"name":"a","rank":2,"incarnation":56,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1928066730 msgr2=0x7f1928068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1928066730 0x7f1928068bf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1938009bf0 tx=0x7f1938009240 comp rx=0 tx=0).stop 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 msgr2=0x7f1948152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 0x7f1948152ad0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1934014040 tx=0x7f1934004770 comp rx=0 tx=0).stop 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 shutdown_connections 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1928066730 0x7f1928068bf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f194815e650 0x7f19481588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f194815ab80 0x7f1948152ad0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 --2- 172.21.15.81:0/2196666246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19480cf2f0 0x7f1948141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 >> 172.21.15.81:0/2196666246 conn(0x7f1948071d90 msgr2=0x7f194815c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 shutdown_connections 2024-09-13T18:51:29.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.281+0000 7f194d200700 1 -- 172.21.15.81:0/2196666246 wait complete. 2024-09-13T18:51:29.293 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 57 2024-09-13T18:51:29.714 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:51:17.898837+0000', 'modified': '2024-09-13T18:51:28.992431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6822, 'mds_1': 6816, 'mds_2': 6559}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6559': {'gid': 6559, 'name': 'a', 'rank': 2, 'incarnation': 56, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.81:6835/3088682584', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 3088682584}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 3088682584}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6816': {'gid': 6816, 'name': 'c', 'rank': 1, 'incarnation': 54, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.81:6837/2228642132', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 2228642132}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2228642132}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_6822': {'gid': 6822, 'name': 'd', 'rank': 0, 'incarnation': 48, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/3000844155', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3000844155}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 3000844155}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:51:29.715 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:51:29.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:51:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.885+0000 7f100f200700 1 Processor -- start 2024-09-13T18:51:29.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.885+0000 7f100f200700 1 -- start start 2024-09-13T18:51:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f10100b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f10100b2a80 0x7f10100b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100f200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100d1800 con 0x7f101015e070 2024-09-13T18:51:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100f200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100b2ef0 con 0x7f10100b2a80 2024-09-13T18:51:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101015e450 con 0x7f10100cd430 2024-09-13T18:51:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100de00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f101015e070 0x7f10100d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:58126/0 (socket says 172.21.15.81:58126) 2024-09-13T18:51:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100de00700 1 -- 172.21.15.81:0/1421324063 learned_addr learned my addr 172.21.15.81:0/1421324063 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100d400700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f10100b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100e800700 1 --2- 172.21.15.81:0/1421324063 >> v2:172.21.15.178:3300/0 conn(0x7f10100b2a80 0x7f10100b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033656078 0 0) 0x7f10100d1800 con 0x7f101015e070 2024-09-13T18:51:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ff40035d0 con 0x7f101015e070 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1026015647 0 0) 0x7f0ff40035d0 con 0x7f101015e070 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 msgr2=0x7f10100b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f10100b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 >> v2:172.21.15.178:3300/0 conn(0x7f10100b2a80 msgr2=0x7f10100b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 --2- 172.21.15.81:0/1421324063 >> v2:172.21.15.178:3300/0 conn(0x7f10100b2a80 0x7f10100b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10100d0050 con 0x7f101015e070 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f1000001670 con 0x7f101015e070 2024-09-13T18:51:29.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 >> v1:172.21.15.81:6789/0 conn(0x7f101015e070 legacy=0x7f10100d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f0ff4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4004010 0x7f0ff4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ff4004db0 0x7f0ff4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100b2ef0 con 0x7f0ff4004010 2024-09-13T18:51:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101015e450 con 0x7f0ff4004db0 2024-09-13T18:51:29.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.889+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff400bae0 con 0x7f10100cd430 2024-09-13T18:51:29.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4004010 0x7f0ff4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100e800700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ff4004db0 0x7f0ff4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100de00700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f0ff4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 -- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 msgr2=0x7f0ff4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f0ff4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 -- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ff4004db0 msgr2=0x7f0ff4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ff4004db0 0x7f0ff4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 -- 172.21.15.81:0/1421324063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40035d0 con 0x7f0ff4004010 2024-09-13T18:51:29.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100de00700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd430 0x7f0ff4003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100d400700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4004010 0x7f0ff4004870 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009b70 tx=0x7f0ff40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f92bf6b3883a07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00e6c0 con 0x7f0ff4004010 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc00e820 con 0x7f0ff4004010 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100ca00700 1 -- 172.21.15.81:0/1421324063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00eb90 con 0x7f0ff4004010 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100f200700 1 -- 172.21.15.81:0/1421324063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4004010 msgr2=0x7f0ff4004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100f200700 1 --2- 172.21.15.81:0/1421324063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ff4004010 0x7f0ff4004870 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009b70 tx=0x7f0ff40058a0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100e800700 1 -- 172.21.15.81:0/1421324063 reap_dead start 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100f200700 1 -- 172.21.15.81:0/1421324063 shutdown_connections 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100f200700 1 -- 172.21.15.81:0/1421324063 >> 172.21.15.81:0/1421324063 conn(0x7f1010071f00 msgr2=0x7f10100722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100f200700 1 -- 172.21.15.81:0/1421324063 shutdown_connections 2024-09-13T18:51:29.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.893+0000 7f100f200700 1 -- 172.21.15.81:0/1421324063 wait complete. 2024-09-13T18:51:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.897+0000 7f100f200700 1 Processor -- start 2024-09-13T18:51:29.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.897+0000 7f100f200700 1 -- start start 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ff4004010 0x7f101006b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 0x7f10100c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100c4d40 0x7f10100c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101006b3f0 con 0x7f1010157020 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10100c5730 con 0x7f10100c4d40 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10101f7850 con 0x7f0ff4004010 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 0x7f10100c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 0x7f10100c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54236/0 (socket says 172.21.15.81:54236) 2024-09-13T18:51:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 -- 172.21.15.81:0/70945941 learned_addr learned my addr 172.21.15.81:0/70945941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100de00700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ff4004010 0x7f101006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100e800700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100c4d40 0x7f10100c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 -- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ff4004010 msgr2=0x7f101006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ff4004010 0x7f101006b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 -- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100c4d40 msgr2=0x7f10100c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100c4d40 0x7f10100c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 -- 172.21.15.81:0/70945941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101006bd50 con 0x7f1010157020 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100e800700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100c4d40 0x7f10100c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:29.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100d400700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 0x7f10100c6d40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e4b0 tx=0x7f0ffc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f1006000700 1 -- 172.21.15.81:0/70945941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00e6c0 con 0x7f1010157020 2024-09-13T18:51:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f1006000700 1 -- 172.21.15.81:0/70945941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc013df0 con 0x7f1010157020 2024-09-13T18:51:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f1006000700 1 -- 172.21.15.81:0/70945941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc01c690 con 0x7f1010157020 2024-09-13T18:51:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101006a770 con 0x7f1010157020 2024-09-13T18:51:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.901+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101006ad30 con 0x7f1010157020 2024-09-13T18:51:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.905+0000 7f1006000700 1 -- 172.21.15.81:0/70945941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0ffc01c7f0 con 0x7f1010157020 2024-09-13T18:51:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.905+0000 7f1018250740 1 Processor -- start 2024-09-13T18:51:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.905+0000 7f1018250740 1 -- start start 2024-09-13T18:51:29.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.905+0000 7f1006000700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066760 0x7f0ff0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1006000700 1 -- 172.21.15.81:0/70945941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ffc085b10 con 0x7f1010157020 2024-09-13T18:51:29.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066760 0x7f0ff0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717ada0 0x717b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x7143890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x7143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x70a2d80 con 0x717b6c0 2024-09-13T18:51:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x70a0510 con 0x7159d00 2024-09-13T18:51:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x709be00 con 0x717ada0 2024-09-13T18:51:29.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x7143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x7143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100de00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717ada0 0x717b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x7143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54248/0 (socket says 172.21.15.81:54248) 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 -- 172.21.15.81:0/4151208181 learned_addr learned my addr 172.21.15.81:0/4151208181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066760 0x7f0ff0068c20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f101015e590 tx=0x7f1008009750 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 -- 172.21.15.81:0/4151208181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717ada0 msgr2=0x717b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717ada0 0x717b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 -- 172.21.15.81:0/4151208181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 msgr2=0x7143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x7143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 -- 172.21.15.81:0/4151208181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x6f0e960 con 0x717b6c0 2024-09-13T18:51:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f100e800700 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x7143dd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f101006d560 tx=0x7f100801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aea849d09a76c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f0ffaa00700 1 -- 172.21.15.81:0/4151208181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e040 con 0x717b6c0 2024-09-13T18:51:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f0ffaa00700 1 -- 172.21.15.81:0/4151208181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008018dc0 con 0x717b6c0 2024-09-13T18:51:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f0ffaa00700 1 -- 172.21.15.81:0/4151208181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1008022660 con 0x717b6c0 2024-09-13T18:51:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- 172.21.15.81:0/4151208181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 msgr2=0x7143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x7143dd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f101006d560 tx=0x7f100801d000 comp rx=0 tx=0).stop 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- 172.21.15.81:0/4151208181 shutdown_connections 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x7143dd0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x7143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 --2- 172.21.15.81:0/4151208181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717ada0 0x717b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- 172.21.15.81:0/4151208181 >> 172.21.15.81:0/4151208181 conn(0x6ec34d0 msgr2=0x715cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- 172.21.15.81:0/4151208181 shutdown_connections 2024-09-13T18:51:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.909+0000 7f1018250740 1 -- 172.21.15.81:0/4151208181 wait complete. 2024-09-13T18:51:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 -- start start 2024-09-13T18:51:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 Processor -- start 2024-09-13T18:51:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 0x717b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7134850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x7130bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7059730 con 0x7159d00 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x705f5b0 con 0x717ada0 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x6f47aa0 con 0x717b6c0 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f1018250740 10 client.0 _ll_register_callbacks cb 0x7095610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 0x717b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 0x717b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54262/0 (socket says 172.21.15.81:54262) 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 -- 172.21.15.81:0/3943524829 learned_addr learned my addr 172.21.15.81:0/3943524829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100d400700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100e800700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x7130bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 -- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 msgr2=0x7130bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x7130bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 -- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 msgr2=0x7134850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7134850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 -- 172.21.15.81:0/3943524829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1008007ae0 con 0x7159d00 2024-09-13T18:51:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100e800700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x7130bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f100de00700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 0x717b180 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1000012640 tx=0x7f1000012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b508f2c5e8eef19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f0fef400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.913+0000 7f0fef400700 1 -- 172.21.15.81:0/3943524829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100001a030 con 0x7159d00 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 1 -- 172.21.15.81:0/3943524829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f100001b070 con 0x7159d00 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x6ed01e0 con 0x7159d00 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 1 -- 172.21.15.81:0/3943524829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1000004b60 con 0x7159d00 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 10 client.6999 fetch_fsmap learned FSMap version 57 2024-09-13T18:51:29.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x7062220 con 0x7159d00 2024-09-13T18:51:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 1 -- 172.21.15.81:0/3943524829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x6ed01e0 con 0x7159d00 2024-09-13T18:51:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 1 -- 172.21.15.81:0/3943524829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 57) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f1000004cc0 con 0x7159d00 2024-09-13T18:51:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 10 client.6999 fetch_fsmap finished waiting for FSMap version 57 2024-09-13T18:51:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 10 client.6999 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:51:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 20 client.6999 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x7181920 0x7181d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 4 client.6999 mds_command: new command op to 6559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 --> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x6f1a460 con 0x7181920 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f100d400700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x7181920 0x7181d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f100d400700 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x7181920 0x7181d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50c026e7ab750ed8 server_cookie=739b926786e5073f in_seq=0 out_seq=0 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 10 client.6999 ms_handle_connect on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 1 -- 172.21.15.81:0/3943524829 <== mds.2 v2:172.21.15.81:6834/3088682584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x6f1a460 con 0x7181920 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 10 client.6999 handle_command_reply: tid=0 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 client.6999 shutdown 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 msgr2=0x717b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 0x717b180 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1000012640 tx=0x7f1000012a00 comp rx=0 tx=0).stop 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 shutdown_connections 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x7130bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7134850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x7181920 0x7181d00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 --2- 172.21.15.81:0/3943524829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7159d00 0x717b180 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f0fef400700 0 client.6999 ms_handle_reset on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.917+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 >> 172.21.15.81:0/3943524829 conn(0x6ec34d0 msgr2=0x7156680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.921+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 shutdown_connections 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.921+0000 7f1018250740 1 -- 172.21.15.81:0/3943524829 wait complete. 2024-09-13T18:51:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.921+0000 7f1018250740 20 client.6999 trim_cache size 0 max 16384 2024-09-13T18:51:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 Processor -- start 2024-09-13T18:51:29.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- start start 2024-09-13T18:51:29.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7159d00 0x71795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7179b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x717a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x709c660 con 0x717b6c0 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x715a470 con 0x717ada0 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7064540 con 0x7159d00 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x717a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x717a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54274/0 (socket says 172.21.15.81:54274) 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 -- 172.21.15.81:0/4151932958 learned_addr learned my addr 172.21.15.81:0/4151932958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:29.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 -- 172.21.15.81:0/4151932958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7159d00 msgr2=0x71795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7159d00 0x71795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 -- 172.21.15.81:0/4151932958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 msgr2=0x7179b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7179b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 -- 172.21.15.81:0/4151932958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7048450 con 0x717b6c0 2024-09-13T18:51:29.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f100e800700 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x717a060 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1008025040 tx=0x7f100800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc09c22ff93bc52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f0ffb400700 1 -- 172.21.15.81:0/4151932958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e040 con 0x717b6c0 2024-09-13T18:51:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f0ffb400700 1 -- 172.21.15.81:0/4151932958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100802e450 con 0x717b6c0 2024-09-13T18:51:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f0ffb400700 1 -- 172.21.15.81:0/4151932958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100802e7e0 con 0x717b6c0 2024-09-13T18:51:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- 172.21.15.81:0/4151932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 msgr2=0x717a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x717a060 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1008025040 tx=0x7f100800b040 comp rx=0 tx=0).stop 2024-09-13T18:51:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- 172.21.15.81:0/4151932958 shutdown_connections 2024-09-13T18:51:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717b6c0 0x717a060 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x717ada0 0x7179b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 --2- 172.21.15.81:0/4151932958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7159d00 0x71795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.941+0000 7f1018250740 1 -- 172.21.15.81:0/4151932958 >> 172.21.15.81:0/4151932958 conn(0x6ec34d0 msgr2=0x718af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 -- 172.21.15.81:0/4151932958 shutdown_connections 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 -- 172.21.15.81:0/4151932958 wait complete. 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 -- start start 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 Processor -- start 2024-09-13T18:51:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x71308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 0x71dbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.945+0000 7f1018250740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x71dce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x717fa10 con 0x717ada0 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7156150 con 0x7159d00 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x71599f0 con 0x717b6c0 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 10 client.0 _ll_register_callbacks cb 0x70f2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 0x71dbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 0x71dbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54290/0 (socket says 172.21.15.81:54290) 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 -- 172.21.15.81:0/418654934 learned_addr learned my addr 172.21.15.81:0/418654934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100de00700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x71308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100e800700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x71dce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 -- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 msgr2=0x71dce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x71dce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 -- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 msgr2=0x71308e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x71308e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 -- 172.21.15.81:0/418654934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x6f0e960 con 0x717ada0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100e800700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x71dce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100de00700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x71308e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100d400700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 0x71dbae0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00a010 tx=0x7f0ffc052f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df777512b974064 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f0fef400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f0fef400700 1 -- 172.21.15.81:0/418654934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc05ef00 con 0x717ada0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f0fef400700 1 -- 172.21.15.81:0/418654934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ffc054eb0 con 0x717ada0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1008018dc0 con 0x717ada0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f0fef400700 1 -- 172.21.15.81:0/418654934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ffc009700 con 0x717ada0 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 10 client.7005 fetch_fsmap learned FSMap version 57 2024-09-13T18:51:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x703c720 con 0x717ada0 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f0fef400700 1 -- 172.21.15.81:0/418654934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1008018dc0 con 0x717ada0 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f0fef400700 1 -- 172.21.15.81:0/418654934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 57) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f0ffc056d70 con 0x717ada0 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 10 client.7005 fetch_fsmap finished waiting for FSMap version 57 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 10 client.7005 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 20 client.7005 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x71dd340 0x717dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 4 client.7005 mds_command: new command op to 6559 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 --> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] -- command(tid 0: {"prefix": "status"}) v1 -- 0x6f3f1e0 con 0x71dd340 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.949+0000 7f100de00700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x71dd340 0x717dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100de00700 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x71dd340 0x717dab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f4351eb3c61f4c4 server_cookie=c65ee62be73a68b0 in_seq=0 out_seq=0 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f0fef400700 10 client.7005 ms_handle_connect on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:29.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f0fef400700 1 -- 172.21.15.81:0/418654934 <== mds.2 v2:172.21.15.81:6834/3088682584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x6f3f1e0 con 0x71dd340 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f0fef400700 10 client.7005 handle_command_reply: tid=0 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 client.7005 shutdown 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 msgr2=0x71dbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 0x71dbae0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00a010 tx=0x7f0ffc052f00 comp rx=0 tx=0).stop 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 shutdown_connections 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x717b6c0 0x71dce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x71dd340 0x717dab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x717ada0 0x71dbae0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f0fef400700 0 client.7005 ms_handle_reset on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 --2- 172.21.15.81:0/418654934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7159d00 0x71308e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 >> 172.21.15.81:0/418654934 conn(0x6ec34d0 msgr2=0x7155040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 shutdown_connections 2024-09-13T18:51:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 1 -- 172.21.15.81:0/418654934 wait complete. 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f1018250740 20 client.7005 trim_cache size 0 max 16384 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6559, 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 1.965525631, 2024-09-13T18:51:29.971 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 57, 2024-09-13T18:51:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 67, 2024-09-13T18:51:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 67, 2024-09-13T18:51:29.972 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.249906276000001 2024-09-13T18:51:29.972 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066760 msgr2=0x7f0ff0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066760 0x7f0ff0068c20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f101015e590 tx=0x7f1008009750 comp rx=0 tx=0).stop 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 msgr2=0x7f10100c6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 0x7f10100c6d40 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00e4b0 tx=0x7f0ffc0047e0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 shutdown_connections 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066760 0x7f0ff0068c20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100c4d40 0x7f10100c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1010157020 0x7f10100c6d40 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 --2- 172.21.15.81:0/70945941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ff4004010 0x7f101006b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 >> 172.21.15.81:0/70945941 conn(0x7f1010071f00 msgr2=0x7f10100cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 shutdown_connections 2024-09-13T18:51:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:29.953+0000 7f100f200700 1 -- 172.21.15.81:0/70945941 wait complete. 2024-09-13T18:51:29.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:51:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 Processor -- start 2024-09-13T18:51:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 -- start start 2024-09-13T18:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 0x7f0aac070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0aac0ce940 0x7f0aac0ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aac0cdf10 con 0x7f0aac0cc0b0 2024-09-13T18:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aac06b660 con 0x7f0aac0ce940 2024-09-13T18:51:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab4000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac06b0a0 con 0x7f0aac1446f0 2024-09-13T18:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab1600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 0x7f0aac070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab2000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0aac0ce940 0x7f0aac0ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab1600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 0x7f0aac070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:44550/0 (socket says 172.21.15.81:44550) 2024-09-13T18:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab1600700 1 -- 172.21.15.81:0/1618887158 learned_addr learned my addr 172.21.15.81:0/1618887158 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.149+0000 7f0ab0c00700 1 --1- 172.21.15.81:0/1618887158 >> v1:172.21.15.178:6789/0 conn(0x7f0aac0cc0b0 0x7f0aac0cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:48324/0 (socket says 172.21.15.81:48324) 2024-09-13T18:51:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab1600700 1 -- 172.21.15.81:0/1618887158 >> v2:172.21.15.178:3300/0 conn(0x7f0aac0ce940 msgr2=0x7f0aac0ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab1600700 1 --2- 172.21.15.81:0/1618887158 >> v2:172.21.15.178:3300/0 conn(0x7f0aac0ce940 0x7f0aac0ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab1600700 1 -- 172.21.15.81:0/1618887158 >> v1:172.21.15.178:6789/0 conn(0x7f0aac0cc0b0 legacy=0x7f0aac0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab1600700 1 -- 172.21.15.81:0/1618887158 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac06b380 con 0x7f0aac1446f0 2024-09-13T18:51:30.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0aabe00700 1 -- 172.21.15.81:0/1618887158 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645670488 0 0) 0x7f0aac0cdf10 con 0x7f0aac0cc0b0 2024-09-13T18:51:30.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab1600700 1 --2- 172.21.15.81:0/1618887158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 0x7f0aac070d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009e50 tx=0x7f0aa000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a51ef88214211224 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0aabe00700 1 -- 172.21.15.81:0/1618887158 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000e070 con 0x7f0aac1446f0 2024-09-13T18:51:30.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0aabe00700 1 -- 172.21.15.81:0/1618887158 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000b910 con 0x7f0aac1446f0 2024-09-13T18:51:30.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0aabe00700 1 -- 172.21.15.81:0/1618887158 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000bcc0 con 0x7f0aac1446f0 2024-09-13T18:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 -- 172.21.15.81:0/1618887158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 msgr2=0x7f0aac070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 --2- 172.21.15.81:0/1618887158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 0x7f0aac070d10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009e50 tx=0x7f0aa000b330 comp rx=0 tx=0).stop 2024-09-13T18:51:30.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 -- 172.21.15.81:0/1618887158 shutdown_connections 2024-09-13T18:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 --2- 172.21.15.81:0/1618887158 >> v2:172.21.15.178:3300/0 conn(0x7f0aac0ce940 0x7f0aac0ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 --2- 172.21.15.81:0/1618887158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac1446f0 0x7f0aac070d10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 -- 172.21.15.81:0/1618887158 >> 172.21.15.81:0/1618887158 conn(0x7f0aac0b1e00 msgr2=0x7f0aac0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 -- 172.21.15.81:0/1618887158 shutdown_connections 2024-09-13T18:51:30.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.153+0000 7f0ab4000700 1 -- 172.21.15.81:0/1618887158 wait complete. 2024-09-13T18:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 Processor -- start 2024-09-13T18:51:30.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 -- start start 2024-09-13T18:51:30.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac0cc0b0 0x7f0aac13aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 0x7f0aac139f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aac1446f0 0x7f0aac156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac156b50 con 0x7f0aac0ce940 2024-09-13T18:51:30.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac155f40 con 0x7f0aac1446f0 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab4000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac156220 con 0x7f0aac0cc0b0 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 0x7f0aac139f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 0x7f0aac139f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54306/0 (socket says 172.21.15.81:54306) 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab0c00700 1 -- 172.21.15.81:0/2328644790 learned_addr learned my addr 172.21.15.81:0/2328644790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab1600700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac0cc0b0 0x7f0aac13aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.157+0000 7f0ab2000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aac1446f0 0x7f0aac156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab0c00700 1 -- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac0cc0b0 msgr2=0x7f0aac13aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac0cc0b0 0x7f0aac13aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab0c00700 1 -- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aac1446f0 msgr2=0x7f0aac156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aac1446f0 0x7f0aac156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab0c00700 1 -- 172.21.15.81:0/2328644790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009b30 con 0x7f0aac0ce940 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab2000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aac1446f0 0x7f0aac156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 0x7f0aac139f90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c4e0 tx=0x7f0a9800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0aa9600700 1 -- 172.21.15.81:0/2328644790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98004ca0 con 0x7f0aac0ce940 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0aa9600700 1 -- 172.21.15.81:0/2328644790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98004e20 con 0x7f0aac0ce940 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aac156500 con 0x7f0aac0ce940 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0aa9600700 1 -- 172.21.15.81:0/2328644790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98007310 con 0x7f0aac0ce940 2024-09-13T18:51:30.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.161+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac155bf0 con 0x7f0aac0ce940 2024-09-13T18:51:30.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.165+0000 7f0aa9600700 1 -- 172.21.15.81:0/2328644790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a98007470 con 0x7f0aac0ce940 2024-09-13T18:51:30.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.165+0000 7f0aa9600700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a8c066730 0x7f0a8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.165+0000 7f0aa9600700 1 -- 172.21.15.81:0/2328644790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a98083ff0 con 0x7f0aac0ce940 2024-09-13T18:51:30.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.165+0000 7f0ab1600700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a8c066730 0x7f0a8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.165+0000 7f0ab737d740 1 Processor -- start 2024-09-13T18:51:30.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.165+0000 7f0ab1600700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a8c066730 0x7f0a8c068bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000b370 tx=0x7f0aa0009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- start start 2024-09-13T18:51:30.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x38215d80 con 0x382edda0 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x38213510 con 0x382ccd00 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3820ee00 con 0x382ee6c0 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ee180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54314/0 (socket says 172.21.15.81:54314) 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 -- 172.21.15.81:0/3856187430 learned_addr learned my addr 172.21.15.81:0/3856187430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab2000700 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 -- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 msgr2=0x382b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 -- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 msgr2=0x382b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 -- 172.21.15.81:0/3856187430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x38081960 con 0x382edda0 2024-09-13T18:51:30.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:30.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ee180 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0aac06b1e0 tx=0x7f0aa0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eca20ddf53fcd77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0a9dc00700 1 -- 172.21.15.81:0/3856187430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0004340 con 0x382edda0 2024-09-13T18:51:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0a9dc00700 1 -- 172.21.15.81:0/3856187430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa0021070 con 0x382edda0 2024-09-13T18:51:30.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0a9dc00700 1 -- 172.21.15.81:0/3856187430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa00046a0 con 0x382edda0 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- 172.21.15.81:0/3856187430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 msgr2=0x382ee180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ee180 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f0aac06b1e0 tx=0x7f0aa0010000 comp rx=0 tx=0).stop 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- 172.21.15.81:0/3856187430 shutdown_connections 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3856187430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ee180 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- 172.21.15.81:0/3856187430 >> 172.21.15.81:0/3856187430 conn(0x380364d0 msgr2=0x382cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- 172.21.15.81:0/3856187430 shutdown_connections 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.169+0000 7f0ab737d740 1 -- 172.21.15.81:0/3856187430 wait complete. 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 -- start start 2024-09-13T18:51:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 Processor -- start 2024-09-13T18:51:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ccd00 0x382ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ee6c0 0x382a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x381cc730 con 0x382edda0 2024-09-13T18:51:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x381d25b0 con 0x382ee6c0 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x380baaa0 con 0x382ccd00 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 10 client.0 _ll_register_callbacks cb 0x38208610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54330/0 (socket says 172.21.15.81:54330) 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 -- 172.21.15.81:0/3150714675 learned_addr learned my addr 172.21.15.81:0/3150714675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab2000700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ee6c0 0x382a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ccd00 0x382ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 -- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ccd00 msgr2=0x382ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ccd00 0x382ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 -- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ee6c0 msgr2=0x382a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ee6c0 0x382a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 -- 172.21.15.81:0/3150714675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa000be70 con 0x382edda0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab2000700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ee6c0 0x382a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ccd00 0x382ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382cff60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0a98020030 tx=0x7f0a980077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9d61f22e9e7b23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0a92000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0a92000700 1 -- 172.21.15.81:0/3150714675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98054550 con 0x382edda0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x380431e0 con 0x382edda0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0a92000700 1 -- 172.21.15.81:0/3150714675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a98054e60 con 0x382edda0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.173+0000 7f0a92000700 1 -- 172.21.15.81:0/3150714675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a98058c90 con 0x382edda0 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 10 client.7014 fetch_fsmap learned FSMap version 57 2024-09-13T18:51:30.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x381d5220 con 0x382edda0 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0a92000700 1 -- 172.21.15.81:0/3150714675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x380431e0 con 0x382edda0 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0a92000700 1 -- 172.21.15.81:0/3150714675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 57) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f0a9805cdc0 con 0x382edda0 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 10 client.7014 fetch_fsmap finished waiting for FSMap version 57 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 10 client.7014 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 20 client.7014 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382f8a90 0x382f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 4 client.7014 mds_command: new command op to 6816 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 --> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3808d460 con 0x382f8a90 2024-09-13T18:51:30.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382f8a90 0x382f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab1600700 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382f8a90 0x382f8e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a2f6dd716eb8421 server_cookie=6683bfba8d338ccf in_seq=0 out_seq=0 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0a92000700 10 client.7014 ms_handle_connect on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0a92000700 1 -- 172.21.15.81:0/3150714675 <== mds.1 v2:172.21.15.81:6836/2228642132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3808d460 con 0x382f8a90 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0a92000700 10 client.7014 handle_command_reply: tid=0 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 client.7014 shutdown 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 msgr2=0x382cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382cff60 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f0a98020030 tx=0x7f0a980077d0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 shutdown_connections 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382f8a90 0x382f8e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ee6c0 0x382a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382cff60 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 --2- 172.21.15.81:0/3150714675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ccd00 0x382ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0a92000700 0 client.7014 ms_handle_reset on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:30.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.177+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 >> 172.21.15.81:0/3150714675 conn(0x380364d0 msgr2=0x382c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.181+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 shutdown_connections 2024-09-13T18:51:30.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.181+0000 7f0ab737d740 1 -- 172.21.15.81:0/3150714675 wait complete. 2024-09-13T18:51:30.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.181+0000 7f0ab737d740 20 client.7014 trim_cache size 0 max 16384 2024-09-13T18:51:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 Processor -- start 2024-09-13T18:51:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 -- start start 2024-09-13T18:51:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382ced40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x381d0e90 con 0x382edda0 2024-09-13T18:51:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x381cceb0 con 0x382ccd00 2024-09-13T18:51:30.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x381d7190 con 0x382ee6c0 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54342/0 (socket says 172.21.15.81:54342) 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 -- 172.21.15.81:0/269666215 learned_addr learned my addr 172.21.15.81:0/269666215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab1600700 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab2000700 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 -- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 msgr2=0x382ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382ced40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 -- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 msgr2=0x382f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab0c00700 1 -- 172.21.15.81:0/269666215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x381bb450 con 0x382edda0 2024-09-13T18:51:30.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.201+0000 7f0ab1600700 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ce800 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0a9805cd20 tx=0x7f0a98057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57df9971d22911b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0a9e600700 1 -- 172.21.15.81:0/269666215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98054e60 con 0x382edda0 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0a9e600700 1 -- 172.21.15.81:0/269666215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98058c90 con 0x382edda0 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0a9e600700 1 -- 172.21.15.81:0/269666215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9805d250 con 0x382edda0 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 -- 172.21.15.81:0/269666215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 msgr2=0x382ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ce800 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f0a9805cd20 tx=0x7f0a98057000 comp rx=0 tx=0).stop 2024-09-13T18:51:30.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 -- 172.21.15.81:0/269666215 shutdown_connections 2024-09-13T18:51:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x382ee6c0 0x382ced40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382edda0 0x382ce800 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 --2- 172.21.15.81:0/269666215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x382f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 -- 172.21.15.81:0/269666215 >> 172.21.15.81:0/269666215 conn(0x380364d0 msgr2=0x38302430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 -- 172.21.15.81:0/269666215 shutdown_connections 2024-09-13T18:51:30.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 -- 172.21.15.81:0/269666215 wait complete. 2024-09-13T18:51:30.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 -- start start 2024-09-13T18:51:30.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.205+0000 7f0ab737d740 1 Processor -- start 2024-09-13T18:51:30.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x383082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 0x38307190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x383076d0 0x382cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x382ed6b0 con 0x382ee6c0 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x38308970 con 0x382ccd00 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3820f560 con 0x383076d0 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 10 client.0 _ll_register_callbacks cb 0x38265710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 0x38307190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 0x38307190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54352/0 (socket says 172.21.15.81:54352) 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 -- 172.21.15.81:0/1533597282 learned_addr learned my addr 172.21.15.81:0/1533597282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab2000700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x383076d0 0x382cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab1600700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x383082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 -- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x383076d0 msgr2=0x382cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x383076d0 0x382cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 -- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 msgr2=0x383082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x383082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 -- 172.21.15.81:0/1533597282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x38081960 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab0c00700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 0x38307190 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0a980531b0 tx=0x7f0a98082230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4aacd10c052127d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0a92000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0a92000700 1 -- 172.21.15.81:0/1533597282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a980549a0 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0a92000700 1 -- 172.21.15.81:0/1533597282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a98054e60 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.209+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0aa0021070 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 1 -- 172.21.15.81:0/1533597282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9805d250 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 10 client.7020 fetch_fsmap learned FSMap version 57 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x381d5220 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 1 -- 172.21.15.81:0/1533597282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa0021070 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 1 -- 172.21.15.81:0/1533597282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 57) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f0a98050c50 con 0x382ee6c0 2024-09-13T18:51:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 10 client.7020 fetch_fsmap finished waiting for FSMap version 57 2024-09-13T18:51:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 10 client.7020 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:51:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 20 client.7020 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382ce350 0x38356ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 4 client.7020 mds_command: new command op to 6816 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:51:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 --> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] -- command(tid 0: {"prefix": "status"}) v1 -- 0x380b21e0 con 0x382ce350 2024-09-13T18:51:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab1600700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382ce350 0x38356ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab1600700 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382ce350 0x38356ed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef7ad7f416081050 server_cookie=28116dcd003a50a8 in_seq=0 out_seq=0 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 10 client.7020 ms_handle_connect on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 1 -- 172.21.15.81:0/1533597282 <== mds.1 v2:172.21.15.81:6836/2228642132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x380b21e0 con 0x382ce350 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 10 client.7020 handle_command_reply: tid=0 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 client.7020 shutdown 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 msgr2=0x38307190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 0x38307190 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0a980531b0 tx=0x7f0a98082230 comp rx=0 tx=0).stop 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 shutdown_connections 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x382ce350 0x38356ed0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x383076d0 0x382cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x382ee6c0 0x38307190 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 --2- 172.21.15.81:0/1533597282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x382ccd00 0x383082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 >> 172.21.15.81:0/1533597282 conn(0x380364d0 msgr2=0x38302430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0a92000700 0 client.7020 ms_handle_reset on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 shutdown_connections 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 1 -- 172.21.15.81:0/1533597282 wait complete. 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.213+0000 7f0ab737d740 20 client.7020 trim_cache size 0 max 16384 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-13T18:51:30.228 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6816, 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 3.2377373719999998, 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 57, 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 67, 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 67, 2024-09-13T18:51:30.229 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.50439956 2024-09-13T18:51:30.230 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a8c066730 msgr2=0x7f0a8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a8c066730 0x7f0a8c068bf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000b370 tx=0x7f0aa0009000 comp rx=0 tx=0).stop 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 msgr2=0x7f0aac139f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 0x7f0aac139f90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c4e0 tx=0x7f0a9800c7f0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 shutdown_connections 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a8c066730 0x7f0a8c068bf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0aac1446f0 0x7f0aac156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0ce940 0x7f0aac139f90 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 --2- 172.21.15.81:0/2328644790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0aac0cc0b0 0x7f0aac13aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 >> 172.21.15.81:0/2328644790 conn(0x7f0aac0b1e00 msgr2=0x7f0aac0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 shutdown_connections 2024-09-13T18:51:30.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.217+0000 7f0ab4000700 1 -- 172.21.15.81:0/2328644790 wait complete. 2024-09-13T18:51:30.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:51:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.409+0000 7f497bc00700 1 Processor -- start 2024-09-13T18:51:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.409+0000 7f497bc00700 1 -- start start 2024-09-13T18:51:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f497bc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f497415b700 0x7f497415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f497bc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f497406a5d0 0x7f497406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f497bc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49740cdd90 con 0x7f497406c460 2024-09-13T18:51:30.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f497bc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497406afa0 con 0x7f497415b700 2024-09-13T18:51:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f497bc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497406ce10 con 0x7f497406a5d0 2024-09-13T18:51:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f497415b700 0x7f497415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f497406a5d0 0x7f497406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f497415b700 0x7f497415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54366/0 (socket says 172.21.15.81:54366) 2024-09-13T18:51:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 -- 172.21.15.81:0/1100794232 learned_addr learned my addr 172.21.15.81:0/1100794232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 -- 172.21.15.81:0/1100794232 >> v2:172.21.15.178:3300/0 conn(0x7f497406a5d0 msgr2=0x7f497406aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 --2- 172.21.15.81:0/1100794232 >> v2:172.21.15.178:3300/0 conn(0x7f497406a5d0 0x7f497406aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 -- 172.21.15.81:0/1100794232 >> v1:172.21.15.178:6789/0 conn(0x7f497406c460 legacy=0x7f497406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 -- 172.21.15.81:0/1100794232 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497415c020 con 0x7f497415b700 2024-09-13T18:51:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4979200700 1 --2- 172.21.15.81:0/1100794232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497415b700 0x7f497415bae0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f497406dd00 tx=0x7f4968009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f341f92513ad229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4973400700 1 -- 172.21.15.81:0/1100794232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968011830 con 0x7f497415b700 2024-09-13T18:51:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4973400700 1 -- 172.21.15.81:0/1100794232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4968011990 con 0x7f497415b700 2024-09-13T18:51:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.413+0000 7f4973400700 1 -- 172.21.15.81:0/1100794232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968011d20 con 0x7f497415b700 2024-09-13T18:51:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 -- 172.21.15.81:0/1100794232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497415b700 msgr2=0x7f497415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 --2- 172.21.15.81:0/1100794232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497415b700 0x7f497415bae0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f497406dd00 tx=0x7f4968009bf0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 -- 172.21.15.81:0/1100794232 shutdown_connections 2024-09-13T18:51:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 --2- 172.21.15.81:0/1100794232 >> v2:172.21.15.178:3300/0 conn(0x7f497406a5d0 0x7f497406aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 --2- 172.21.15.81:0/1100794232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497415b700 0x7f497415bae0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 -- 172.21.15.81:0/1100794232 >> 172.21.15.81:0/1100794232 conn(0x7f49740b08d0 msgr2=0x7f49740b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 -- 172.21.15.81:0/1100794232 shutdown_connections 2024-09-13T18:51:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 -- 172.21.15.81:0/1100794232 wait complete. 2024-09-13T18:51:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 Processor -- start 2024-09-13T18:51:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.417+0000 7f497bc00700 1 -- start start 2024-09-13T18:51:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f497406a5d0 0x7f49741e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 0x7f497415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f497415b700 0x7f497414e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974070580 con 0x7f497406c460 2024-09-13T18:51:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49740adfb0 con 0x7f497415b700 2024-09-13T18:51:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49741e4ba0 con 0x7f497406a5d0 2024-09-13T18:51:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 0x7f497415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 0x7f497415c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54382/0 (socket says 172.21.15.81:54382) 2024-09-13T18:51:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 -- 172.21.15.81:0/1160384750 learned_addr learned my addr 172.21.15.81:0/1160384750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4979200700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f497406a5d0 0x7f49741e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4979c00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f497415b700 0x7f497414e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 -- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f497406a5d0 msgr2=0x7f49741e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f497406a5d0 0x7f49741e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 -- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f497415b700 msgr2=0x7f497414e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f497415b700 0x7f497414e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 -- 172.21.15.81:0/1160384750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968009570 con 0x7f497406c460 2024-09-13T18:51:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4979200700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f497406a5d0 0x7f49741e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:30.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4979c00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f497415b700 0x7f497414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4973e00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 0x7f497415c4e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f496000c500 tx=0x7f496000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4970c00700 1 -- 172.21.15.81:0/1160384750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600052d0 con 0x7f497406c460 2024-09-13T18:51:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4970c00700 1 -- 172.21.15.81:0/1160384750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960005430 con 0x7f497406c460 2024-09-13T18:51:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49741e4e80 con 0x7f497406c460 2024-09-13T18:51:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f4970c00700 1 -- 172.21.15.81:0/1160384750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600055a0 con 0x7f497406c460 2024-09-13T18:51:30.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.421+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49740701a0 con 0x7f497406c460 2024-09-13T18:51:30.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.425+0000 7f4970c00700 1 -- 172.21.15.81:0/1160384750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49600038e0 con 0x7f497406c460 2024-09-13T18:51:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.425+0000 7f4970c00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4954066730 0x7f4954068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.425+0000 7f4970c00700 1 -- 172.21.15.81:0/1160384750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4960083810 con 0x7f497406c460 2024-09-13T18:51:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.425+0000 7f4979200700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4954066730 0x7f4954068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f4979200700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4954066730 0x7f4954068bf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4968000c00 tx=0x7f4968008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 Processor -- start 2024-09-13T18:51:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 -- start start 2024-09-13T18:51:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed82180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed4a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed4add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2eca9d80 con 0x2ed60d00 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2eca7510 con 0x2ed81da0 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2eca2e00 con 0x2ed826c0 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f4973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed4a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f4973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed4a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54398/0 (socket says 172.21.15.81:54398) 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.429+0000 7f4973e00700 1 -- 172.21.15.81:0/3811568793 learned_addr learned my addr 172.21.15.81:0/3811568793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4979200700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed82180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4979c00700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed4add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4973e00700 1 -- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 msgr2=0x2ed4add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4973e00700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed4add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4973e00700 1 -- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 msgr2=0x2ed82180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4973e00700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed82180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4973e00700 1 -- 172.21.15.81:0/3811568793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2eb15960 con 0x2ed60d00 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4979200700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed82180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4979c00700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed4add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4973e00700 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed4a890 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f496000cfd0 tx=0x7f4960054090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9578bfb5ff3fb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4965600700 1 -- 172.21.15.81:0/3811568793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960058490 con 0x2ed60d00 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4965600700 1 -- 172.21.15.81:0/3811568793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496005ca50 con 0x2ed60d00 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f4965600700 1 -- 172.21.15.81:0/3811568793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960058160 con 0x2ed60d00 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 -- 172.21.15.81:0/3811568793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 msgr2=0x2ed4a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed4a890 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f496000cfd0 tx=0x7f4960054090 comp rx=0 tx=0).stop 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 -- 172.21.15.81:0/3811568793 shutdown_connections 2024-09-13T18:51:30.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed4add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed4a890 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 --2- 172.21.15.81:0/3811568793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed82180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 -- 172.21.15.81:0/3811568793 >> 172.21.15.81:0/3811568793 conn(0x2eaca4d0 msgr2=0x2ed63c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 -- 172.21.15.81:0/3811568793 shutdown_connections 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.433+0000 7f497efee740 1 -- 172.21.15.81:0/3811568793 wait complete. 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 -- start start 2024-09-13T18:51:30.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 Processor -- start 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed82180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed59bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ec60730 con 0x2ed60d00 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ec665b0 con 0x2ed81da0 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2eb4eaa0 con 0x2ed826c0 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f497efee740 10 client.0 _ll_register_callbacks cb 0x2ec9c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed82180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed82180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54406/0 (socket says 172.21.15.81:54406) 2024-09-13T18:51:30.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 -- 172.21.15.81:0/1222388658 learned_addr learned my addr 172.21.15.81:0/1222388658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4973e00700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed59bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979c00700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 -- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 msgr2=0x2ed36700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed36700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 -- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 msgr2=0x2ed59bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed59bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.437+0000 7f4979200700 1 -- 172.21.15.81:0/1222388658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49740701a0 con 0x2ed60d00 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f4979200700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed82180 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4968009f40 tx=0x7f49680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6574e9d1a7737b5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 1 -- 172.21.15.81:0/1222388658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968003b90 con 0x2ed60d00 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 1 -- 172.21.15.81:0/1222388658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4968003cf0 con 0x2ed60d00 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2ead71e0 con 0x2ed60d00 2024-09-13T18:51:30.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 1 -- 172.21.15.81:0/1222388658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f496801b430 con 0x2ed60d00 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 10 client.7032 fetch_fsmap learned FSMap version 57 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x2ec69220 con 0x2ed60d00 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 1 -- 172.21.15.81:0/1222388658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2ead71e0 con 0x2ed60d00 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 1 -- 172.21.15.81:0/1222388658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 57) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f496801b590 con 0x2ed60d00 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 10 client.7032 fetch_fsmap finished waiting for FSMap version 57 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 10 client.7032 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 20 client.7032 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ed383e0 0x2ed387c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 4 client.7032 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2eb21460 con 0x2ed383e0 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f4973e00700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ed383e0 0x2ed387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f495a000700 10 client.7032 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.441+0000 7f4973e00700 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ed383e0 0x2ed387c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343cbbb0ad9a4b66 server_cookie=e306eb6faa7dd7bd in_seq=0 out_seq=0 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f495a000700 1 -- 172.21.15.81:0/1222388658 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2eb21460 con 0x2ed383e0 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f495a000700 10 client.7032 handle_command_reply: tid=0 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 client.7032 shutdown 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 msgr2=0x2ed82180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed82180 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4968009f40 tx=0x7f49680047e0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 shutdown_connections 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ed383e0 0x2ed387c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed826c0 0x2ed36700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f495a000700 0 client.7032 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed81da0 0x2ed59bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 --2- 172.21.15.81:0/1222388658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed60d00 0x2ed82180 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 >> 172.21.15.81:0/1222388658 conn(0x2eaca4d0 msgr2=0x2ed5d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 shutdown_connections 2024-09-13T18:51:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 1 -- 172.21.15.81:0/1222388658 wait complete. 2024-09-13T18:51:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.445+0000 7f497efee740 20 client.7032 trim_cache size 0 max 16384 2024-09-13T18:51:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 Processor -- start 2024-09-13T18:51:30.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 -- start start 2024-09-13T18:51:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed60d00 0x2ede6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 0x2ede73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed826c0 0x2ede7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ecd1ec0 con 0x2ed81da0 2024-09-13T18:51:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ed39070 con 0x2ed826c0 2024-09-13T18:51:30.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.465+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ec49950 con 0x2ed60d00 2024-09-13T18:51:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 0x2ede73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 0x2ede73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54416/0 (socket says 172.21.15.81:54416) 2024-09-13T18:51:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 -- 172.21.15.81:0/567866916 learned_addr learned my addr 172.21.15.81:0/567866916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4979c00700 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed826c0 0x2ede7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4979200700 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed60d00 0x2ede6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 -- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed60d00 msgr2=0x2ede6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed60d00 0x2ede6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 -- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed826c0 msgr2=0x2ede7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed826c0 0x2ede7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 -- 172.21.15.81:0/567866916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ec4f450 con 0x2ed81da0 2024-09-13T18:51:30.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4973e00700 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 0x2ede73f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f496005c520 tx=0x7f4960083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61193e70fc418b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4966000700 1 -- 172.21.15.81:0/567866916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960058490 con 0x2ed81da0 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4966000700 1 -- 172.21.15.81:0/567866916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4960052a00 con 0x2ed81da0 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f4966000700 1 -- 172.21.15.81:0/567866916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960053b50 con 0x2ed81da0 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 -- 172.21.15.81:0/567866916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 msgr2=0x2ede73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 0x2ede73f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f496005c520 tx=0x7f4960083000 comp rx=0 tx=0).stop 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 -- 172.21.15.81:0/567866916 shutdown_connections 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed826c0 0x2ede7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed81da0 0x2ede73f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 --2- 172.21.15.81:0/567866916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed60d00 0x2ede6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 -- 172.21.15.81:0/567866916 >> 172.21.15.81:0/567866916 conn(0x2eaca4d0 msgr2=0x2ed812f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 -- 172.21.15.81:0/567866916 shutdown_connections 2024-09-13T18:51:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 -- 172.21.15.81:0/567866916 wait complete. 2024-09-13T18:51:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 -- start start 2024-09-13T18:51:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.469+0000 7f497efee740 1 Processor -- start 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed60d00 0x2edeb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed81da0 0x2edec710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 0x2edecc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ed04160 con 0x2ed826c0 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ed5c670 con 0x2ed60d00 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ed5c8a0 con 0x2ed81da0 2024-09-13T18:51:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 10 client.0 _ll_register_callbacks cb 0x2ecf9710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 0x2edecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 0x2edecc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54424/0 (socket says 172.21.15.81:54424) 2024-09-13T18:51:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 -- 172.21.15.81:0/3209302510 learned_addr learned my addr 172.21.15.81:0/3209302510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4973e00700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed81da0 0x2edec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979200700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed60d00 0x2edeb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 -- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed81da0 msgr2=0x2edec710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed81da0 0x2edec710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 -- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed60d00 msgr2=0x2edeb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed60d00 0x2edeb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 -- 172.21.15.81:0/3209302510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496006c040 con 0x2ed826c0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f4979c00700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 0x2edecc50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f496c016d20 tx=0x7f496c007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6f3c444fff388a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f495a000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f495a000700 1 -- 172.21.15.81:0/3209302510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00e040 con 0x2ed826c0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2ed3d810 con 0x2ed826c0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f495a000700 1 -- 172.21.15.81:0/3209302510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f496c016e70 con 0x2ed826c0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f495a000700 1 -- 172.21.15.81:0/3209302510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f496c021460 con 0x2ed826c0 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 10 client.7038 fetch_fsmap learned FSMap version 57 2024-09-13T18:51:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.473+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x2ec43720 con 0x2ed826c0 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f495a000700 1 -- 172.21.15.81:0/3209302510 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2ed3d810 con 0x2ed826c0 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f495a000700 1 -- 172.21.15.81:0/3209302510 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 57) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f496c014050 con 0x2ed826c0 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 10 client.7038 fetch_fsmap finished waiting for FSMap version 57 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 10 client.7038 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 20 client.7038 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2eded4c0 0x2ed98c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 4 client.7038 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:51:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f496005ca50 con 0x2eded4c0 2024-09-13T18:51:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f4979200700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2eded4c0 0x2ed98c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f495a000700 10 client.7038 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:30.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f4979200700 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2eded4c0 0x2ed98c70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93a437a635f4ac9e server_cookie=333e293b9f12158f in_seq=0 out_seq=0 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f495a000700 1 -- 172.21.15.81:0/3209302510 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f496005ca50 con 0x2eded4c0 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f495a000700 10 client.7038 handle_command_reply: tid=0 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 client.7038 shutdown 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 msgr2=0x2edecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 0x2edecc50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f496c016d20 tx=0x7f496c007610 comp rx=0 tx=0).stop 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 shutdown_connections 2024-09-13T18:51:30.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2eded4c0 0x2ed98c70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ed826c0 0x2edecc50 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ed81da0 0x2edec710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 --2- 172.21.15.81:0/3209302510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ed60d00 0x2edeb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f495a000700 0 client.7038 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 >> 172.21.15.81:0/3209302510 conn(0x2eaca4d0 msgr2=0x2ed93d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 shutdown_connections 2024-09-13T18:51:30.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 1 -- 172.21.15.81:0/3209302510 wait complete. 2024-09-13T18:51:30.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.477+0000 7f497efee740 20 client.7038 trim_cache size 0 max 16384 2024-09-13T18:51:30.493 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:51:30.493 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:51:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6822, 2024-09-13T18:51:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:51:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:51:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:51:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 12.579850633, 2024-09-13T18:51:30.494 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 57, 2024-09-13T18:51:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 67, 2024-09-13T18:51:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 67, 2024-09-13T18:51:30.495 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.761599702000002 2024-09-13T18:51:30.495 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4954066730 msgr2=0x7f4954068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4954066730 0x7f4954068bf0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4968000c00 tx=0x7f4968008030 comp rx=0 tx=0).stop 2024-09-13T18:51:30.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 msgr2=0x7f497415c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 0x7f497415c4e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f496000c500 tx=0x7f496000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 shutdown_connections 2024-09-13T18:51:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4954066730 0x7f4954068bf0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f497415b700 0x7f497414e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f497406c460 0x7f497415c4e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 --2- 172.21.15.81:0/1160384750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f497406a5d0 0x7f49741e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 >> 172.21.15.81:0/1160384750 conn(0x7f49740b08d0 msgr2=0x7f497406d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 shutdown_connections 2024-09-13T18:51:30.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.481+0000 7f497bc00700 1 -- 172.21.15.81:0/1160384750 wait complete. 2024-09-13T18:51:30.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:51:30.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 Processor -- start 2024-09-13T18:51:30.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 -- start start 2024-09-13T18:51:30.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b341610b0 0x7f5b340719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b3406aaa0 0x7f5b3406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b340b2670 0x7f5b340b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b34070b30 con 0x7f5b3406aaa0 2024-09-13T18:51:30.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3406b450 con 0x7f5b341610b0 2024-09-13T18:51:30.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.673+0000 7f5b3a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340b3040 con 0x7f5b340b2670 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b3406aaa0 0x7f5b3406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b38e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b341610b0 0x7f5b340719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5b3406aaa0 0x7f5b3406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54436/0 (socket says 172.21.15.81:54436) 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 -- 172.21.15.81:0/445198385 learned_addr learned my addr 172.21.15.81:0/445198385 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b39800700 1 --2- 172.21.15.81:0/445198385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b340b2670 0x7f5b340b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 -- 172.21.15.81:0/445198385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b340b2670 msgr2=0x7f5b340b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 --2- 172.21.15.81:0/445198385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b340b2670 0x7f5b340b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 -- 172.21.15.81:0/445198385 >> v2:172.21.15.178:3300/0 conn(0x7f5b341610b0 msgr2=0x7f5b340719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:30.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 --2- 172.21.15.81:0/445198385 >> v2:172.21.15.178:3300/0 conn(0x7f5b341610b0 0x7f5b340719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 -- 172.21.15.81:0/445198385 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340b3560 con 0x7f5b3406aaa0 2024-09-13T18:51:30.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b38e00700 1 --2- 172.21.15.81:0/445198385 >> v2:172.21.15.178:3300/0 conn(0x7f5b341610b0 0x7f5b340719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:30.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33e00700 1 --2- 172.21.15.81:0/445198385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3406aaa0 0x7f5b3406af10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009940 tx=0x7f5b20009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d5cd5117e0213d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33400700 1 -- 172.21.15.81:0/445198385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20011830 con 0x7f5b3406aaa0 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33400700 1 -- 172.21.15.81:0/445198385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b20011990 con 0x7f5b3406aaa0 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b33400700 1 -- 172.21.15.81:0/445198385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20011d20 con 0x7f5b3406aaa0 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 -- 172.21.15.81:0/445198385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3406aaa0 msgr2=0x7f5b3406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 --2- 172.21.15.81:0/445198385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3406aaa0 0x7f5b3406af10 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f5b20009940 tx=0x7f5b20009c50 comp rx=0 tx=0).stop 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 -- 172.21.15.81:0/445198385 shutdown_connections 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 --2- 172.21.15.81:0/445198385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b340b2670 0x7f5b340b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 --2- 172.21.15.81:0/445198385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3406aaa0 0x7f5b3406af10 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 --2- 172.21.15.81:0/445198385 >> v2:172.21.15.178:3300/0 conn(0x7f5b341610b0 0x7f5b340719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 -- 172.21.15.81:0/445198385 >> 172.21.15.81:0/445198385 conn(0x7f5b340b0c40 msgr2=0x7f5b3406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 -- 172.21.15.81:0/445198385 shutdown_connections 2024-09-13T18:51:30.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.677+0000 7f5b3a200700 1 -- 172.21.15.81:0/445198385 wait complete. 2024-09-13T18:51:30.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 Processor -- start 2024-09-13T18:51:30.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 -- start start 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b3406aaa0 0x7f5b341624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 0x7f5b34156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b341610b0 0x7f5b341568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34163c20 con 0x7f5b340b2670 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b341464b0 con 0x7f5b341610b0 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b3a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34162fa0 con 0x7f5b3406aaa0 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 0x7f5b34156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 0x7f5b34156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54442/0 (socket says 172.21.15.81:54442) 2024-09-13T18:51:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.681+0000 7f5b33e00700 1 -- 172.21.15.81:0/726247947 learned_addr learned my addr 172.21.15.81:0/726247947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:30.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b38e00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b3406aaa0 0x7f5b341624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b39800700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b341610b0 0x7f5b341568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b33e00700 1 -- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b3406aaa0 msgr2=0x7f5b341624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b33e00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b3406aaa0 0x7f5b341624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b33e00700 1 -- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b341610b0 msgr2=0x7f5b341568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b33e00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b341610b0 0x7f5b341568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b33e00700 1 -- 172.21.15.81:0/726247947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280094b0 con 0x7f5b340b2670 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b33e00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 0x7f5b34156380 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5b20000c00 tx=0x7f5b20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20004510 con 0x7f5b340b2670 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2001e070 con 0x7f5b340b2670 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b20009570 con 0x7f5b340b2670 2024-09-13T18:51:30.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20003900 con 0x7f5b340b2670 2024-09-13T18:51:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b34163560 con 0x7f5b340b2670 2024-09-13T18:51:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.685+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b34163d60 con 0x7f5b340b2670 2024-09-13T18:51:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.689+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b20003a60 con 0x7f5b340b2670 2024-09-13T18:51:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.689+0000 7f5b30c00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b14066730 0x7f5b14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.689+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5b20084b70 con 0x7f5b340b2670 2024-09-13T18:51:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.689+0000 7f5b38e00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b14066730 0x7f5b14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:30.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.689+0000 7f5b38e00700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b14066730 0x7f5b14068bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009d00 tx=0x7f5b28009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:30.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.697+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b20051f50 con 0x7f5b340b2670 2024-09-13T18:51:30.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.921+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b340673f0 con 0x7f5b340b2670 2024-09-13T18:51:30.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b30c00700 1 -- 172.21.15.81:0/726247947 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4769 (secure 0 0 0) 0x7f5b20015090 con 0x7f5b340b2670 2024-09-13T18:51:30.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:51:30.935 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:28.992431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6822,"mds_1":6816,"mds_2":6559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6559":{"gid":6559,"name":"a","rank":2,"incarnation":56,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b14066730 msgr2=0x7f5b14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b14066730 0x7f5b14068bf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009d00 tx=0x7f5b28009240 comp rx=0 tx=0).stop 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 msgr2=0x7f5b34156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 0x7f5b34156380 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f5b20000c00 tx=0x7f5b20004770 comp rx=0 tx=0).stop 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 shutdown_connections 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b14066730 0x7f5b14068bf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b341610b0 0x7f5b341568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b340b2670 0x7f5b34156380 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 --2- 172.21.15.81:0/726247947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b3406aaa0 0x7f5b341624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 >> 172.21.15.81:0/726247947 conn(0x7f5b340b0c40 msgr2=0x7f5b340b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:30.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 shutdown_connections 2024-09-13T18:51:30.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:30.925+0000 7f5b3a200700 1 -- 172.21.15.81:0/726247947 wait complete. 2024-09-13T18:51:30.940 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 57 2024-09-13T18:51:30.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:30.958 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:51:31.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:31.004 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:51:31.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:31.078 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-13T18:51:31.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:31.147 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-13T18:51:31.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:31.213 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-13T18:51:31.277 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:51:31.461 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:51:31.462 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:51:31.462 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:51:33.405 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:51:33.401+0000 7f0767400700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:51:33.464 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:51:33.638 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:51:33.638 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:51:33.638 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:51:35.640 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:51:35.817 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:51:35.817 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:51:35.818 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:51:37.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:51:38.009 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-13T18:51:38.010 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:51:38.010 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:51:40.011 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:51:40.198 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-13T18:51:40.199 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:51:40.199 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:51:40.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:51:40.383 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:51:40.384 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:51:40.384 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:51:42.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:51:42.567 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:51:42.567 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:51:42.567 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:51:43.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:43.169 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:51:44.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:51:44.756 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:51:44.757 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:51:44.757 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:51:44.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:51:44.929 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:51:44.929 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:51:44.929 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:51:44.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-13T18:51:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 Processor -- start 2024-09-13T18:51:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 -- start start 2024-09-13T18:51:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f669406c960 0x7f6694161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f66940b1980 0x7f6694162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6694162340 con 0x7f669406cd40 2024-09-13T18:51:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940b2280 con 0x7f66940b1980 2024-09-13T18:51:45.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6698c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66940b2560 con 0x7f669406c960 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f66940b1980 0x7f6694162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f66940b1980 0x7f6694162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42804/0 (socket says 172.21.15.81:42804) 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 -- 172.21.15.81:0/2686636737 learned_addr learned my addr 172.21.15.81:0/2686636737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693400700 1 --2- 172.21.15.81:0/2686636737 >> v2:172.21.15.178:3300/0 conn(0x7f669406c960 0x7f6694161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 -- 172.21.15.81:0/2686636737 >> v2:172.21.15.178:3300/0 conn(0x7f669406c960 msgr2=0x7f6694161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 --2- 172.21.15.81:0/2686636737 >> v2:172.21.15.178:3300/0 conn(0x7f669406c960 0x7f6694161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 -- 172.21.15.81:0/2686636737 >> v1:172.21.15.81:6789/0 conn(0x7f669406cd40 legacy=0x7f66940b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.093+0000 7f6693e00700 1 -- 172.21.15.81:0/2686636737 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66940b2840 con 0x7f66940b1980 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6693e00700 1 --2- 172.21.15.81:0/2686636737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f6694162560 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f66940725d0 tx=0x7f668c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759cdad64354c664 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6692000700 1 -- 172.21.15.81:0/2686636737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00e070 con 0x7f66940b1980 2024-09-13T18:51:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6692000700 1 -- 172.21.15.81:0/2686636737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c00b9c0 con 0x7f66940b1980 2024-09-13T18:51:45.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6692000700 1 -- 172.21.15.81:0/2686636737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c00bd70 con 0x7f66940b1980 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 -- 172.21.15.81:0/2686636737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 msgr2=0x7f6694162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 --2- 172.21.15.81:0/2686636737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f6694162560 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f66940725d0 tx=0x7f668c00b330 comp rx=0 tx=0).stop 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 -- 172.21.15.81:0/2686636737 shutdown_connections 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 --2- 172.21.15.81:0/2686636737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f6694162560 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 --2- 172.21.15.81:0/2686636737 >> v2:172.21.15.178:3300/0 conn(0x7f669406c960 0x7f6694161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 -- 172.21.15.81:0/2686636737 >> 172.21.15.81:0/2686636737 conn(0x7f669406a390 msgr2=0x7f669406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 -- 172.21.15.81:0/2686636737 shutdown_connections 2024-09-13T18:51:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.097+0000 7f6698c00700 1 -- 172.21.15.81:0/2686636737 wait complete. 2024-09-13T18:51:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 Processor -- start 2024-09-13T18:51:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 -- start start 2024-09-13T18:51:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f669406c960 0x7f66941509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669406cd40 0x7f66941e7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f66941e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66941e9f20 con 0x7f66940b1980 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66941e9350 con 0x7f669406cd40 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6698c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66941e95f0 con 0x7f669406c960 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6693e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f66941e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6693e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f66941e7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42806/0 (socket says 172.21.15.81:42806) 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6693e00700 1 -- 172.21.15.81:0/2179871540 learned_addr learned my addr 172.21.15.81:0/2179871540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6692a00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669406cd40 0x7f66941e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.101+0000 7f6693400700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f669406c960 0x7f66941509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6693e00700 1 -- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f669406c960 msgr2=0x7f66941509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6693e00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f669406c960 0x7f66941509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6693e00700 1 -- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669406cd40 msgr2=0x7f66941e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6693e00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669406cd40 0x7f66941e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6693e00700 1 -- 172.21.15.81:0/2179871540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c009b30 con 0x7f66940b1980 2024-09-13T18:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6693e00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f66941e7740 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f668c00b370 tx=0x7f668c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f668b400700 1 -- 172.21.15.81:0/2179871540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c004900 con 0x7f66940b1980 2024-09-13T18:51:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f668b400700 1 -- 172.21.15.81:0/2179871540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c0099b0 con 0x7f66940b1980 2024-09-13T18:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f668b400700 1 -- 172.21.15.81:0/2179871540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c01b670 con 0x7f66940b1980 2024-09-13T18:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66941e98d0 con 0x7f66940b1980 2024-09-13T18:51:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.105+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694150ef0 con 0x7f66940b1980 2024-09-13T18:51:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.109+0000 7f668b400700 1 -- 172.21.15.81:0/2179871540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f668c01b7d0 con 0x7f66940b1980 2024-09-13T18:51:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.109+0000 7f668b400700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6674066730 0x7f6674068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.109+0000 7f668b400700 1 -- 172.21.15.81:0/2179871540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f668c085ab0 con 0x7f66940b1980 2024-09-13T18:51:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.109+0000 7f6693400700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6674066730 0x7f6674068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.109+0000 7f6693400700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6674066730 0x7f6674068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6684009a00 tx=0x7f6684008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.109+0000 7f669d639740 1 Processor -- start 2024-09-13T18:51:45.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 -- start start 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161ac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x161d4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f6170 0x161f6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1613d010 con 0x161f5d90 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x160caf40 con 0x161f6170 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1611de30 con 0x161ab310 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42816/0 (socket says 172.21.15.81:42816) 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 -- 172.21.15.81:0/3023810818 learned_addr learned my addr 172.21.15.81:0/3023810818 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6692a00700 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x161d4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693e00700 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f6170 0x161f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 -- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 msgr2=0x161d4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x161d4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 -- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f6170 msgr2=0x161f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f6170 0x161f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 -- 172.21.15.81:0/3023810818 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15f89a40 con 0x161f5d90 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f6693400700 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161ac810 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6684011950 tx=0x7f6684014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73539d469fa8486b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f667f400700 1 -- 172.21.15.81:0/3023810818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840157c0 con 0x161f5d90 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f667f400700 1 -- 172.21.15.81:0/3023810818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684015920 con 0x161f5d90 2024-09-13T18:51:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.113+0000 7f667f400700 1 -- 172.21.15.81:0/3023810818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684015c90 con 0x161f5d90 2024-09-13T18:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 -- 172.21.15.81:0/3023810818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 msgr2=0x161ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161ac810 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6684011950 tx=0x7f6684014000 comp rx=0 tx=0).stop 2024-09-13T18:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 -- 172.21.15.81:0/3023810818 shutdown_connections 2024-09-13T18:51:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f6170 0x161f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x161d4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 --2- 172.21.15.81:0/3023810818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161ac810 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 -- 172.21.15.81:0/3023810818 >> 172.21.15.81:0/3023810818 conn(0x15f3e5b0 msgr2=0x161afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 -- 172.21.15.81:0/3023810818 shutdown_connections 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 -- 172.21.15.81:0/3023810818 wait complete. 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 -- start start 2024-09-13T18:51:45.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.117+0000 7f669d639740 1 Processor -- start 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 0x161f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x161f6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16119150 con 0x161ab310 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16116eb0 con 0x161f5d90 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x160d48e0 con 0x161f6170 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 10 client.0 _ll_register_callbacks cb 0x160b3670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 0x161f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 0x161f4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42820/0 (socket says 172.21.15.81:42820) 2024-09-13T18:51:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 -- 172.21.15.81:0/3893908554 learned_addr learned my addr 172.21.15.81:0/3893908554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6692a00700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693e00700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x161f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 -- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 msgr2=0x161f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x161f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 -- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 msgr2=0x161cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 -- 172.21.15.81:0/3893908554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668400e040 con 0x161ab310 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6692a00700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6693400700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 0x161f4d00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6684023040 tx=0x7f66840047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52398277b26437fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6673e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6673e00700 1 -- 172.21.15.81:0/3893908554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684005a40 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6673e00700 1 -- 172.21.15.81:0/3893908554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6684036c20 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15f4b2c0 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6673e00700 1 -- 172.21.15.81:0/3893908554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6684036e40 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 10 client.7059 fetch_fsmap learned FSMap version 59 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x160dd290 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6673e00700 1 -- 172.21.15.81:0/3893908554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15f4b2c0 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f6673e00700 1 -- 172.21.15.81:0/3893908554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f6684005ba0 con 0x161ab310 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 10 client.7059 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 10 client.7059 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 20 client.7059 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x161d09f0 0x161d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 4 client.7059 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:45.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.121+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15f95540 con 0x161d09f0 2024-09-13T18:51:45.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f6692a00700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x161d09f0 0x161d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f6692a00700 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x161d09f0 0x161d0e00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=debbeeda0d904f9f server_cookie=845d4142fb5c79af in_seq=0 out_seq=0 2024-09-13T18:51:45.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f6673e00700 10 client.7059 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:45.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f6673e00700 1 -- 172.21.15.81:0/3893908554 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x15f95540 con 0x161d09f0 2024-09-13T18:51:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f6673e00700 10 client.7059 handle_command_reply: tid=0 2024-09-13T18:51:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 client.7059 shutdown 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 msgr2=0x161f4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 0x161f4d00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6684023040 tx=0x7f66840047e0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 shutdown_connections 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x161d09f0 0x161d0e00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x161f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 --2- 172.21.15.81:0/3893908554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161ab310 0x161f4d00 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f6673e00700 0 client.7059 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 >> 172.21.15.81:0/3893908554 conn(0x15f3e5b0 msgr2=0x161d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 shutdown_connections 2024-09-13T18:51:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 1 -- 172.21.15.81:0/3893908554 wait complete. 2024-09-13T18:51:45.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.125+0000 7f669d639740 20 client.7059 trim_cache size 0 max 16384 2024-09-13T18:51:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 Processor -- start 2024-09-13T18:51:45.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 -- start start 2024-09-13T18:51:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x1620e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 0x161ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x15fc2b80 con 0x161f6170 2024-09-13T18:51:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x161166c0 con 0x161f5d90 2024-09-13T18:51:45.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x160e7e80 con 0x161ab310 2024-09-13T18:51:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 0x161ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 0x161ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42822/0 (socket says 172.21.15.81:42822) 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 -- 172.21.15.81:0/2508094071 learned_addr learned my addr 172.21.15.81:0/2508094071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693400700 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x1620e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6692a00700 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 -- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 msgr2=0x1620e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x1620e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 -- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 msgr2=0x161cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 -- 172.21.15.81:0/2508094071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x160c34c0 con 0x161f6170 2024-09-13T18:51:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.145+0000 7f6693e00700 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 0x161ce130 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f668c052e90 tx=0x7f668c056870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61af4038eabaf35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f667fe00700 1 -- 172.21.15.81:0/2508094071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c056990 con 0x161f6170 2024-09-13T18:51:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f667fe00700 1 -- 172.21.15.81:0/2508094071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c05a7c0 con 0x161f6170 2024-09-13T18:51:45.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f667fe00700 1 -- 172.21.15.81:0/2508094071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c05ed80 con 0x161f6170 2024-09-13T18:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 -- 172.21.15.81:0/2508094071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 msgr2=0x161ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 0x161ce130 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f668c052e90 tx=0x7f668c056870 comp rx=0 tx=0).stop 2024-09-13T18:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 -- 172.21.15.81:0/2508094071 shutdown_connections 2024-09-13T18:51:45.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f6170 0x161ce130 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161f5d90 0x161cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 --2- 172.21.15.81:0/2508094071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161ab310 0x1620e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 -- 172.21.15.81:0/2508094071 >> 172.21.15.81:0/2508094071 conn(0x15f3e5b0 msgr2=0x161f5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 -- 172.21.15.81:0/2508094071 shutdown_connections 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 -- 172.21.15.81:0/2508094071 wait complete. 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 -- start start 2024-09-13T18:51:45.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.149+0000 7f669d639740 1 Processor -- start 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161ab310 0x161d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x16259410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x161abed0 con 0x161f5d90 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1620e770 con 0x161ab310 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1620ea10 con 0x161f6170 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 10 client.0 _ll_register_callbacks cb 0x16115610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161d2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42832/0 (socket says 172.21.15.81:42832) 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 -- 172.21.15.81:0/696150404 learned_addr learned my addr 172.21.15.81:0/696150404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6693e00700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x16259410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6693400700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161ab310 0x161d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 -- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 msgr2=0x16259410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x16259410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 -- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161ab310 msgr2=0x161d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161ab310 0x161d25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 -- 172.21.15.81:0/696150404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6694150ef0 con 0x161f5d90 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6692a00700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161d2b00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6680001270 tx=0x7f6680004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f98acbf3288060fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6673e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6673e00700 1 -- 172.21.15.81:0/696150404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668001f070 con 0x161f5d90 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6673e00700 1 -- 172.21.15.81:0/696150404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f668001a620 con 0x161f5d90 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x161d4230 con 0x161f5d90 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f6673e00700 1 -- 172.21.15.81:0/696150404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f668001a7e0 con 0x161f5d90 2024-09-13T18:51:45.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 10 client.7065 fetch_fsmap learned FSMap version 59 2024-09-13T18:51:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.153+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x160b7790 con 0x161f5d90 2024-09-13T18:51:45.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f6673e00700 1 -- 172.21.15.81:0/696150404 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x161d4230 con 0x161f5d90 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f6673e00700 1 -- 172.21.15.81:0/696150404 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f6680018440 con 0x161f5d90 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f669d639740 10 client.7065 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f669d639740 10 client.7065 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f669d639740 20 client.7065 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f669d639740 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x16259950 0x16259d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f669d639740 4 client.7065 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f6684015920 con 0x16259950 2024-09-13T18:51:45.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f6693400700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x16259950 0x16259d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f6693400700 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x16259950 0x16259d60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b630cf7b244ab2a0 server_cookie=185113c8848fac0d in_seq=0 out_seq=0 2024-09-13T18:51:45.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.157+0000 7f6673e00700 10 client.7065 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f6673e00700 1 -- 172.21.15.81:0/696150404 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f6684015920 con 0x16259950 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f6673e00700 10 client.7065 handle_command_reply: tid=0 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 client.7065 shutdown 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 msgr2=0x161d2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161d2b00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6680001270 tx=0x7f6680004f40 comp rx=0 tx=0).stop 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 shutdown_connections 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x16259950 0x16259d60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x161f6170 0x16259410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f6673e00700 0 client.7065 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x161f5d90 0x161d2b00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 --2- 172.21.15.81:0/696150404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x161ab310 0x161d25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 >> 172.21.15.81:0/696150404 conn(0x15f3e5b0 msgr2=0x161cf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.177+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 shutdown_connections 2024-09-13T18:51:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f669d639740 1 -- 172.21.15.81:0/696150404 wait complete. 2024-09-13T18:51:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f669d639740 20 client.7065 trim_cache size 0 max 16384 2024-09-13T18:51:45.188 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:45.188 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:51:45.189 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:51:45.189 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6674066730 msgr2=0x7f6674068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6674066730 0x7f6674068bf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6684009a00 tx=0x7f6684008040 comp rx=0 tx=0).stop 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 msgr2=0x7f66941e7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f66941e7740 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f668c00b370 tx=0x7f668c004af0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 shutdown_connections 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6674066730 0x7f6674068bf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66940b1980 0x7f66941e7740 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669406cd40 0x7f66941e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 --2- 172.21.15.81:0/2179871540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f669406c960 0x7f66941509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 >> 172.21.15.81:0/2179871540 conn(0x7f669406a390 msgr2=0x7f66940cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 shutdown_connections 2024-09-13T18:51:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.181+0000 7f6698c00700 1 -- 172.21.15.81:0/2179871540 wait complete. 2024-09-13T18:51:45.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 flush journal 2024-09-13T18:51:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec3000700 1 Processor -- start 2024-09-13T18:51:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec3000700 1 -- start start 2024-09-13T18:51:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec3000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ebc1657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec3000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0b1980 con 0x7f0ebc06d620 2024-09-13T18:51:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec3000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ebc0b2500 con 0x7f0ebc143b70 2024-09-13T18:51:45.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec3000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b1bd0 con 0x7f0ebc06d070 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec1200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0ebc06d620 0x7f0ebc06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46468/0 (socket says 172.21.15.81:46468) 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec1200700 1 -- 172.21.15.81:0/907711006 learned_addr learned my addr 172.21.15.81:0/907711006 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ec2600700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ebc1657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058192837 0 0) 0x7f0ebc0b1980 con 0x7f0ebc06d620 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea40035d0 con 0x7f0ebc06d620 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633739162 0 0) 0x7f0ea40035d0 con 0x7f0ebc06d620 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 msgr2=0x7f0ebc1657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ebc1657b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 >> v1:172.21.15.178:6789/0 conn(0x7f0ebc143b70 legacy=0x7f0ebc0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0b1eb0 con 0x7f0ebc06d620 2024-09-13T18:51:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.385+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f0ea8001670 con 0x7f0ebc06d620 2024-09-13T18:51:45.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 >> v1:172.21.15.81:6789/0 conn(0x7f0ebc06d620 legacy=0x7f0ebc06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ea4003a50 0x7f0ea4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ea4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ea4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0b1bd0 con 0x7f0ea4004db0 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea400ba60 con 0x7f0ea4003a50 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea400bc20 con 0x7f0ebc06d070 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ea4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ea4003a50 0x7f0ea4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 -- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 msgr2=0x7f0ea4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec1200700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ea4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ea4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 -- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ea4003a50 msgr2=0x7f0ea4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ea4003a50 0x7f0ea4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 -- 172.21.15.81:0/907711006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40035d0 con 0x7f0ea4004db0 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec1200700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc06d070 0x7f0ea4004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ea4003a50 0x7f0ea4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ea4005230 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009b70 tx=0x7f0ea40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a6a5694ad238c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400e6c0 con 0x7f0ea4004db0 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400e820 con 0x7f0ea4004db0 2024-09-13T18:51:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ebbe00700 1 -- 172.21.15.81:0/907711006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400eb90 con 0x7f0ea4004db0 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec3000700 1 -- 172.21.15.81:0/907711006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 msgr2=0x7f0ea4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec3000700 1 --2- 172.21.15.81:0/907711006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ea4005230 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4009b70 tx=0x7f0ea40058a0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec2600700 1 -- 172.21.15.81:0/907711006 reap_dead start 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec3000700 1 -- 172.21.15.81:0/907711006 shutdown_connections 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec3000700 1 -- 172.21.15.81:0/907711006 >> 172.21.15.81:0/907711006 conn(0x7f0ebc06a390 msgr2=0x7f0ebc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec3000700 1 -- 172.21.15.81:0/907711006 shutdown_connections 2024-09-13T18:51:45.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.389+0000 7f0ec3000700 1 -- 172.21.15.81:0/907711006 wait complete. 2024-09-13T18:51:45.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.393+0000 7f0ec3000700 1 Processor -- start 2024-09-13T18:51:45.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.393+0000 7f0ec3000700 1 -- start start 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ebc0ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ebc0ac890 0x7f0ebc13eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc142d40 0x7f0ebc13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc1421e0 con 0x7f0ea4004db0 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0ad9d0 con 0x7f0ebc0ac890 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ebc0acdc0 con 0x7f0ebc142d40 2024-09-13T18:51:45.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ebc0ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ebc0ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42852/0 (socket says 172.21.15.81:42852) 2024-09-13T18:51:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 -- 172.21.15.81:0/3516283486 learned_addr learned my addr 172.21.15.81:0/3516283486 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1200700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ebc0ac890 0x7f0ebc13eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc142d40 0x7f0ebc13fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 -- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc142d40 msgr2=0x7f0ebc13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc142d40 0x7f0ebc13fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 -- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ebc0ac890 msgr2=0x7f0ebc13eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ebc0ac890 0x7f0ebc13eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 -- 172.21.15.81:0/3516283486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ebc0ad0a0 con 0x7f0ea4004db0 2024-09-13T18:51:45.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc142d40 0x7f0ebc13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ebc0ade60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0002230 tx=0x7f0eb000c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0eb9600700 1 -- 172.21.15.81:0/3516283486 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000cd50 con 0x7f0ea4004db0 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0eb9600700 1 -- 172.21.15.81:0/3516283486 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000ceb0 con 0x7f0ea4004db0 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0eb9600700 1 -- 172.21.15.81:0/3516283486 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0003c20 con 0x7f0ea4004db0 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc0ad380 con 0x7f0ea4004db0 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.397+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ebc1431c0 con 0x7f0ea4004db0 2024-09-13T18:51:45.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.401+0000 7f0eb9600700 1 -- 172.21.15.81:0/3516283486 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0eb00050d0 con 0x7f0ea4004db0 2024-09-13T18:51:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.401+0000 7f0ec791d740 1 Processor -- start 2024-09-13T18:51:45.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.401+0000 7f0ec791d740 1 -- start start 2024-09-13T18:51:45.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.401+0000 7f0eb9600700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e9c066760 0x7f0e9c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.401+0000 7f0eb9600700 1 -- 172.21.15.81:0/3516283486 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0eb00848a0 con 0x7f0ea4004db0 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e9c066760 0x7f0e9c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x33849810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x33871520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x33893550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x337da010 con 0x33893170 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x33767f40 con 0x33892d90 2024-09-13T18:51:45.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x337bae30 con 0x33848310 2024-09-13T18:51:45.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x33893550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x33893550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42860/0 (socket says 172.21.15.81:42860) 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec2600700 1 -- 172.21.15.81:0/375470873 learned_addr learned my addr 172.21.15.81:0/375470873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x33849810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1200700 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x33871520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 -- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 msgr2=0x33871520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x33871520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 -- 172.21.15.81:0/375470873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 msgr2=0x33893550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x33893550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 -- 172.21.15.81:0/375470873 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x33626a40 con 0x33892d90 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec2600700 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x33893550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e9c066760 0x7f0e9c068c20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4016000 tx=0x7f0eb4011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x33849810 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0082bf0 tx=0x7f0eb00555f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b68880b89d566741 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0eae000700 1 -- 172.21.15.81:0/375470873 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00556f0 con 0x33892d90 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0eae000700 1 -- 172.21.15.81:0/375470873 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0059520 con 0x33892d90 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0eae000700 1 -- 172.21.15.81:0/375470873 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb005dae0 con 0x33892d90 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 -- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 msgr2=0x33849810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.405+0000 7f0ec791d740 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x33849810 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0082bf0 tx=0x7f0eb00555f0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- 172.21.15.81:0/375470873 shutdown_connections 2024-09-13T18:51:45.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x33893550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x33871520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 --2- 172.21.15.81:0/375470873 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x33849810 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- 172.21.15.81:0/375470873 >> 172.21.15.81:0/375470873 conn(0x335db5b0 msgr2=0x3384cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- 172.21.15.81:0/375470873 shutdown_connections 2024-09-13T18:51:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- 172.21.15.81:0/375470873 wait complete. 2024-09-13T18:51:45.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- start start 2024-09-13T18:51:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 Processor -- start 2024-09-13T18:51:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x3384d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 0x3386b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33893170 0x3386d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x337b6150 con 0x33892d90 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x337b3eb0 con 0x33848310 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x337718e0 con 0x33893170 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec791d740 10 client.0 _ll_register_callbacks cb 0x33750670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 0x3386b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 0x3386b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42868/0 (socket says 172.21.15.81:42868) 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 -- 172.21.15.81:0/359848472 learned_addr learned my addr 172.21.15.81:0/359848472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec2600700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33893170 0x3386d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x3384d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 -- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33893170 msgr2=0x3386d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33893170 0x3386d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 -- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 msgr2=0x3384d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x3384d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 -- 172.21.15.81:0/359848472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea40035d0 con 0x33892d90 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x3384d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ec1200700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 0x3386b830 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8012660 tx=0x7f0ea8012a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c989a371b06fb286 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.409+0000 7f0ea2a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 1 -- 172.21.15.81:0/359848472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8014730 con 0x33892d90 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 1 -- 172.21.15.81:0/359848472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0ea8014890 con 0x33892d90 2024-09-13T18:51:45.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x335e82c0 con 0x33892d90 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 1 -- 172.21.15.81:0/359848472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea8014a50 con 0x33892d90 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 10 client.7077 fetch_fsmap learned FSMap version 59 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x7f0ebc1431c0 con 0x33892d90 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 1 -- 172.21.15.81:0/359848472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x335e82c0 con 0x33892d90 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 1 -- 172.21.15.81:0/359848472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0ea8014bb0 con 0x33892d90 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 10 client.7077 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 10 client.7077 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-13T18:51:45.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 20 client.7077 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x33870770 0x3389cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 4 client.7077 mds_command: new command op to 6816 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 --> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x33632540 con 0x33870770 2024-09-13T18:51:45.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x33870770 0x3389cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x33870770 0x3389cb20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30df93fa895aab57 server_cookie=bc93ada2948d68be in_seq=0 out_seq=0 2024-09-13T18:51:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 10 client.7077 ms_handle_connect on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 1 -- 172.21.15.81:0/359848472 <== mds.1 v2:172.21.15.81:6836/2228642132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x33632540 con 0x33870770 2024-09-13T18:51:45.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 10 client.7077 handle_command_reply: tid=0 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 client.7077 shutdown 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 msgr2=0x3386b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 0x3386b830 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8012660 tx=0x7f0ea8012a20 comp rx=0 tx=0).stop 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 shutdown_connections 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x33870770 0x3389cb20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33893170 0x3386d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33892d90 0x3386b830 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 --2- 172.21.15.81:0/359848472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x3384d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ea2a00700 0 client.7077 ms_handle_reset on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.413+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 >> 172.21.15.81:0/359848472 conn(0x335db5b0 msgr2=0x338714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.417+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 shutdown_connections 2024-09-13T18:51:45.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.417+0000 7f0ec791d740 1 -- 172.21.15.81:0/359848472 wait complete. 2024-09-13T18:51:45.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.417+0000 7f0ec791d740 20 client.7077 trim_cache size 0 max 16384 2024-09-13T18:51:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 Processor -- start 2024-09-13T18:51:45.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 -- start start 2024-09-13T18:51:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x338eef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33892d90 0x3386e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x3386ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3365fb80 con 0x33893170 2024-09-13T18:51:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3386dcc0 con 0x33848310 2024-09-13T18:51:45.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x337b2bd0 con 0x33892d90 2024-09-13T18:51:45.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x3386ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x3386ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42870/0 (socket says 172.21.15.81:42870) 2024-09-13T18:51:45.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec2600700 1 -- 172.21.15.81:0/1871199304 learned_addr learned my addr 172.21.15.81:0/1871199304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x338eef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.433+0000 7f0ec1200700 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33892d90 0x3386e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec2600700 1 -- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33892d90 msgr2=0x3386e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec2600700 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33892d90 0x3386e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec2600700 1 -- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 msgr2=0x338eef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec2600700 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x338eef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec2600700 1 -- 172.21.15.81:0/1871199304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3377a290 con 0x33893170 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x338eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:45.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec2600700 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x3386ea10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400fdf0 tx=0x7f0eb4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f09eb8f6c69dda7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0eaea00700 1 -- 172.21.15.81:0/1871199304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4031030 con 0x33893170 2024-09-13T18:51:45.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0eaea00700 1 -- 172.21.15.81:0/1871199304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4027070 con 0x33893170 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0eaea00700 1 -- 172.21.15.81:0/1871199304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4013ac0 con 0x33893170 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 -- 172.21.15.81:0/1871199304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 msgr2=0x3386ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x3386ea10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400fdf0 tx=0x7f0eb4009240 comp rx=0 tx=0).stop 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 -- 172.21.15.81:0/1871199304 shutdown_connections 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x3386ea10 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33892d90 0x3386e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 --2- 172.21.15.81:0/1871199304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33848310 0x338eef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 -- 172.21.15.81:0/1871199304 >> 172.21.15.81:0/1871199304 conn(0x335db5b0 msgr2=0x3386ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 -- 172.21.15.81:0/1871199304 shutdown_connections 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.437+0000 7f0ec791d740 1 -- 172.21.15.81:0/1871199304 wait complete. 2024-09-13T18:51:45.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 -- start start 2024-09-13T18:51:45.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 Processor -- start 2024-09-13T18:51:45.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x338a9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x338a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x338ebca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x33784c00 con 0x33893170 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x338ab6a0 con 0x33892d90 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3384c370 con 0x33848310 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec791d740 10 client.0 _ll_register_callbacks cb 0x337b2610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x338ebca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x338ebca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42882/0 (socket says 172.21.15.81:42882) 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 -- 172.21.15.81:0/3031317955 learned_addr learned my addr 172.21.15.81:0/3031317955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec1200700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x338a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x338a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 -- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 msgr2=0x338a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x338a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 -- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 msgr2=0x338a8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.441+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x338a8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec2600700 1 -- 172.21.15.81:0/3031317955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x33626a40 con 0x33893170 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec2600700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x338ebca0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4032040 tx=0x7f0eb4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180925a320e7e612 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:45.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 1 -- 172.21.15.81:0/3031317955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb401d460 con 0x33893170 2024-09-13T18:51:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 1 -- 172.21.15.81:0/3031317955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0eb4032070 con 0x33893170 2024-09-13T18:51:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0eb0059520 con 0x33893170 2024-09-13T18:51:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 1 -- 172.21.15.81:0/3031317955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0eb401d5c0 con 0x33893170 2024-09-13T18:51:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 10 client.7083 fetch_fsmap learned FSMap version 59 2024-09-13T18:51:45.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x7f0eb400fb20 con 0x33893170 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 1 -- 172.21.15.81:0/3031317955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0059520 con 0x33893170 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 1 -- 172.21.15.81:0/3031317955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0eb401d9f0 con 0x33893170 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 10 client.7083 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 10 client.7083 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 20 client.7083 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x338a89d0 0x338ec1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 4 client.7083 mds_command: new command op to 6816 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:51:45.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 --> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x336572c0 con 0x338a89d0 2024-09-13T18:51:45.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x338a89d0 0x338ec1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ec1c00700 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x338a89d0 0x338ec1e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97484dda3abfb762 server_cookie=e2b8c28e94fae363 in_seq=0 out_seq=0 2024-09-13T18:51:45.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.445+0000 7f0ea2a00700 10 client.7083 ms_handle_connect on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ea2a00700 1 -- 172.21.15.81:0/3031317955 <== mds.1 v2:172.21.15.81:6836/2228642132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x336572c0 con 0x338a89d0 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ea2a00700 10 client.7083 handle_command_reply: tid=0 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 client.7083 shutdown 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 msgr2=0x338ebca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x338ebca0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4032040 tx=0x7f0eb4004770 comp rx=0 tx=0).stop 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 shutdown_connections 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x338a89d0 0x338ec1e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x33893170 0x338ebca0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x33892d90 0x338a8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 --2- 172.21.15.81:0/3031317955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x33848310 0x338a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 >> 172.21.15.81:0/3031317955 conn(0x335db5b0 msgr2=0x3386b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ea2a00700 0 client.7083 ms_handle_reset on v2:172.21.15.81:6836/2228642132 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 shutdown_connections 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 1 -- 172.21.15.81:0/3031317955 wait complete. 2024-09-13T18:51:45.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.465+0000 7f0ec791d740 20 client.7083 trim_cache size 0 max 16384 2024-09-13T18:51:45.475 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:51:45.475 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:51:45.475 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:45.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e9c066760 msgr2=0x7f0e9c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e9c066760 0x7f0e9c068c20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4016000 tx=0x7f0eb4011000 comp rx=0 tx=0).stop 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 msgr2=0x7f0ebc0ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ebc0ade60 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0002230 tx=0x7f0eb000c470 comp rx=0 tx=0).stop 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 shutdown_connections 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e9c066760 0x7f0e9c068c20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ebc142d40 0x7f0ebc13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ebc0ac890 0x7f0ebc13eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 --2- 172.21.15.81:0/3516283486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ea4004db0 0x7f0ebc0ade60 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 >> 172.21.15.81:0/3516283486 conn(0x7f0ebc06a390 msgr2=0x7f0ebc071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 shutdown_connections 2024-09-13T18:51:45.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.469+0000 7f0ec3000700 1 -- 172.21.15.81:0/3516283486 wait complete. 2024-09-13T18:51:45.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 flush journal 2024-09-13T18:51:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 Processor -- start 2024-09-13T18:51:45.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 -- start start 2024-09-13T18:51:45.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e4815ed90 0x7f0e480cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e4806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e480cdc30 con 0x7f0e480cf5b0 2024-09-13T18:51:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4815b050 con 0x7f0e4815ed90 2024-09-13T18:51:45.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4fc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4815b330 con 0x7f0e4815f170 2024-09-13T18:51:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.665+0000 7f0e4d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e4815ed90 0x7f0e480cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e4815ed90 0x7f0e480cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42884/0 (socket says 172.21.15.81:42884) 2024-09-13T18:51:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 -- 172.21.15.81:0/861196450 learned_addr learned my addr 172.21.15.81:0/861196450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/861196450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e4806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 -- 172.21.15.81:0/861196450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 msgr2=0x7f0e4806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 --2- 172.21.15.81:0/861196450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e4806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 -- 172.21.15.81:0/861196450 >> v1:172.21.15.178:6789/0 conn(0x7f0e480cf5b0 legacy=0x7f0e48066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 -- 172.21.15.81:0/861196450 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4815b610 con 0x7f0e4815ed90 2024-09-13T18:51:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4d200700 1 --2- 172.21.15.81:0/861196450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4815ed90 0x7f0e480cf070 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009910 tx=0x7f0e38009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12086b0f856971b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e47e00700 1 -- 172.21.15.81:0/861196450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38011830 con 0x7f0e4815ed90 2024-09-13T18:51:45.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e47e00700 1 -- 172.21.15.81:0/861196450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e38011990 con 0x7f0e4815ed90 2024-09-13T18:51:45.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e47e00700 1 -- 172.21.15.81:0/861196450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38011d40 con 0x7f0e4815ed90 2024-09-13T18:51:45.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 -- 172.21.15.81:0/861196450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4815ed90 msgr2=0x7f0e480cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/861196450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4815ed90 0x7f0e480cf070 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009910 tx=0x7f0e38009c20 comp rx=0 tx=0).stop 2024-09-13T18:51:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 -- 172.21.15.81:0/861196450 shutdown_connections 2024-09-13T18:51:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/861196450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e4806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/861196450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e4815ed90 0x7f0e480cf070 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 -- 172.21.15.81:0/861196450 >> 172.21.15.81:0/861196450 conn(0x7f0e480b1e10 msgr2=0x7f0e4806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 -- 172.21.15.81:0/861196450 shutdown_connections 2024-09-13T18:51:45.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.669+0000 7f0e4fc00700 1 -- 172.21.15.81:0/861196450 wait complete. 2024-09-13T18:51:45.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.673+0000 7f0e4fc00700 1 Processor -- start 2024-09-13T18:51:45.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 -- start start 2024-09-13T18:51:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 0x7f0e480b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e4815ed90 0x7f0e4814d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e480b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480b3750 con 0x7f0e480cf5b0 2024-09-13T18:51:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480b3a30 con 0x7f0e4815ed90 2024-09-13T18:51:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480b3d10 con 0x7f0e4815f170 2024-09-13T18:51:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 0x7f0e480b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 0x7f0e480b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42886/0 (socket says 172.21.15.81:42886) 2024-09-13T18:51:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 -- 172.21.15.81:0/2312680975 learned_addr learned my addr 172.21.15.81:0/2312680975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e480b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e4815ed90 0x7f0e4814d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 -- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 msgr2=0x7f0e480b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e480b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 -- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e4815ed90 msgr2=0x7f0e4814d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e4815ed90 0x7f0e4814d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 -- 172.21.15.81:0/2312680975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e38009570 con 0x7f0e480cf5b0 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e480b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e4815ed90 0x7f0e4814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4d200700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 0x7f0e480b47f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009c60 tx=0x7f0e38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e45600700 1 -- 172.21.15.81:0/2312680975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38004480 con 0x7f0e480cf5b0 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e45600700 1 -- 172.21.15.81:0/2312680975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3801f070 con 0x7f0e480cf5b0 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e45600700 1 -- 172.21.15.81:0/2312680975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38003900 con 0x7f0e480cf5b0 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e480b3ff0 con 0x7f0e480cf5b0 2024-09-13T18:51:45.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.677+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4815c330 con 0x7f0e480cf5b0 2024-09-13T18:51:45.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.681+0000 7f0e45600700 1 -- 172.21.15.81:0/2312680975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e38021030 con 0x7f0e480cf5b0 2024-09-13T18:51:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e45600700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e24066730 0x7f0e24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e45600700 1 -- 172.21.15.81:0/2312680975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e380856f0 con 0x7f0e480cf5b0 2024-09-13T18:51:45.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e24066730 0x7f0e24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e24066730 0x7f0e24068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e481e6920 tx=0x7f0e30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e52ec5740 1 Processor -- start 2024-09-13T18:51:45.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e52ec5740 1 -- start start 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f912240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f933d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.685+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8e75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f87b010 con 0x2f934270 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f808f40 con 0x2f933950 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f85be30 con 0x2f911d00 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8e75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8e75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42902/0 (socket says 172.21.15.81:42902) 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 -- 172.21.15.81:0/1948119709 learned_addr learned my addr 172.21.15.81:0/1948119709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4d200700 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f912240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f933d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 -- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 msgr2=0x2f933d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f933d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 -- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 msgr2=0x2f912240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f912240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 -- 172.21.15.81:0/1948119709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2f6c7a40 con 0x2f934270 2024-09-13T18:51:45.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8e75d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0e40002180 tx=0x7f0e4000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44bc7c64524c6f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e3d600700 1 -- 172.21.15.81:0/1948119709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40003c30 con 0x2f934270 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e3d600700 1 -- 172.21.15.81:0/1948119709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40003d90 con 0x2f934270 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e3d600700 1 -- 172.21.15.81:0/1948119709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4000ec20 con 0x2f934270 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- 172.21.15.81:0/1948119709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 msgr2=0x2f8e75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8e75d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0e40002180 tx=0x7f0e4000e440 comp rx=0 tx=0).stop 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- 172.21.15.81:0/1948119709 shutdown_connections 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8e75d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f933d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/1948119709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f912240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- 172.21.15.81:0/1948119709 >> 172.21.15.81:0/1948119709 conn(0x2f67c5b0 msgr2=0x2f8ed9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- 172.21.15.81:0/1948119709 shutdown_connections 2024-09-13T18:51:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.689+0000 7f0e52ec5740 1 -- 172.21.15.81:0/1948119709 wait complete. 2024-09-13T18:51:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 -- start start 2024-09-13T18:51:45.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 Processor -- start 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f8fc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f933950 0x2f92f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8fac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f857150 con 0x2f934270 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f854eb0 con 0x2f911d00 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f8128e0 con 0x2f933950 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 10 client.0 _ll_register_callbacks cb 0x2f7f1670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:45.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8fac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42918/0 (socket says 172.21.15.81:42918) 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 -- 172.21.15.81:0/175622996 learned_addr learned my addr 172.21.15.81:0/175622996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f933950 0x2f92f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4d200700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f8fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 -- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f933950 msgr2=0x2f92f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f933950 0x2f92f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 -- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 msgr2=0x2f8fc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f8fc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 -- 172.21.15.81:0/175622996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4000f040 con 0x2f934270 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8fac90 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0e40017040 tx=0x7f0e40001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0b79e0eeb0b4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e36000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e36000700 1 -- 172.21.15.81:0/175622996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40003c30 con 0x2f934270 2024-09-13T18:51:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e36000700 1 -- 172.21.15.81:0/175622996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e400052e0 con 0x2f934270 2024-09-13T18:51:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.693+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2f6892c0 con 0x2f934270 2024-09-13T18:51:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 1 -- 172.21.15.81:0/175622996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e40001e10 con 0x2f934270 2024-09-13T18:51:45.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 10 client.7095 fetch_fsmap learned FSMap version 59 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x2f81b290 con 0x2f934270 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 1 -- 172.21.15.81:0/175622996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2f6892c0 con 0x2f934270 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 1 -- 172.21.15.81:0/175622996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 59) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0e400054a0 con 0x2f934270 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 10 client.7095 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 10 client.7095 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 20 client.7095 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fd210 0x2f912ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 4 client.7095 mds_command: new command op to 6559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 --> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2f6d3540 con 0x2f8fd210 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e4d200700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fd210 0x2f912ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 10 client.7095 ms_handle_connect on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:45.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e4d200700 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fd210 0x2f912ca0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dead4b680bb1ba9c server_cookie=76bef222091b25e0 in_seq=0 out_seq=0 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 1 -- 172.21.15.81:0/175622996 <== mds.2 v2:172.21.15.81:6834/3088682584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2f6d3540 con 0x2f8fd210 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 10 client.7095 handle_command_reply: tid=0 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 client.7095 shutdown 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 msgr2=0x2f8fac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8fac90 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0e40017040 tx=0x7f0e40001250 comp rx=0 tx=0).stop 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 shutdown_connections 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fd210 0x2f912ca0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f8fac90 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f933950 0x2f92f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e36000700 0 client.7095 ms_handle_reset on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/175622996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f8fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 >> 172.21.15.81:0/175622996 conn(0x2f67c5b0 msgr2=0x2f8e8dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 shutdown_connections 2024-09-13T18:51:45.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.697+0000 7f0e52ec5740 1 -- 172.21.15.81:0/175622996 wait complete. 2024-09-13T18:51:45.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.701+0000 7f0e52ec5740 20 client.7095 trim_cache size 0 max 16384 2024-09-13T18:51:45.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 Processor -- start 2024-09-13T18:51:45.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 -- start start 2024-09-13T18:51:45.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f932280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 0x2f946b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f934270 0x2f947040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f700b80 con 0x2f933950 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f7dea50 con 0x2f911d00 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f8526c0 con 0x2f934270 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e3fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 0x2f946b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e3fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 0x2f946b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42928/0 (socket says 172.21.15.81:42928) 2024-09-13T18:51:45.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.717+0000 7f0e3fe00700 1 -- 172.21.15.81:0/4174289678 learned_addr learned my addr 172.21.15.81:0/4174289678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f934270 0x2f947040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e4d200700 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f932280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3fe00700 1 -- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f934270 msgr2=0x2f947040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f934270 0x2f947040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3fe00700 1 -- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 msgr2=0x2f932280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f932280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3fe00700 1 -- 172.21.15.81:0/4174289678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2f8014c0 con 0x2f933950 2024-09-13T18:51:45.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 0x2f946b00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0e30004380 tx=0x7f0e30014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6943c5391b84e1b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3e000700 1 -- 172.21.15.81:0/4174289678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30011d80 con 0x2f933950 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3e000700 1 -- 172.21.15.81:0/4174289678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300036c0 con 0x2f933950 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e3e000700 1 -- 172.21.15.81:0/4174289678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30011ee0 con 0x2f933950 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 -- 172.21.15.81:0/4174289678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 msgr2=0x2f946b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 0x2f946b00 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f0e30004380 tx=0x7f0e30014000 comp rx=0 tx=0).stop 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 -- 172.21.15.81:0/4174289678 shutdown_connections 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f934270 0x2f947040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f933950 0x2f946b00 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/4174289678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f911d00 0x2f932280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 -- 172.21.15.81:0/4174289678 >> 172.21.15.81:0/4174289678 conn(0x2f67c5b0 msgr2=0x2f92ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 -- 172.21.15.81:0/4174289678 shutdown_connections 2024-09-13T18:51:45.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 -- 172.21.15.81:0/4174289678 wait complete. 2024-09-13T18:51:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.721+0000 7f0e52ec5740 1 -- start start 2024-09-13T18:51:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 Processor -- start 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f994710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f994c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f995560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f7f3620 con 0x2f934270 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2f8ee820 con 0x2f933950 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2f94bdf0 con 0x2f911d00 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e52ec5740 10 client.0 _ll_register_callbacks cb 0x2f8248f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f994710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f995560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f994710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:42210/0 (socket says 172.21.15.81:42210) 2024-09-13T18:51:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 -- 172.21.15.81:0/2127955185 learned_addr learned my addr 172.21.15.81:0/2127955185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:45.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f994c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 -- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 msgr2=0x2f994c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f994c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 -- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 msgr2=0x2f995560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f995560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4d200700 1 -- 172.21.15.81:0/2127955185 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3001b040 con 0x2f911d00 2024-09-13T18:51:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.725+0000 7f0e4dc00700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f995560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:51:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e4d200700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f994710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e38000c00 tx=0x7f0e38085040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8f101bf49935158 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:45.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 1 -- 172.21.15.81:0/2127955185 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e38006ea0 con 0x2f911d00 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 1 -- 172.21.15.81:0/2127955185 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0e3805a400 con 0x2f911d00 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e40003d90 con 0x2f911d00 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 1 -- 172.21.15.81:0/2127955185 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e38083ea0 con 0x2f911d00 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 10 client.6203 fetch_fsmap learned FSMap version 59 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) v3 -- 0x2f7f5790 con 0x2f911d00 2024-09-13T18:51:45.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 1 -- 172.21.15.81:0/2127955185 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40003d90 con 0x2f911d00 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 1 -- 172.21.15.81:0/2127955185 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 59) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0e38052ce0 con 0x2f911d00 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 10 client.6203 fetch_fsmap finished waiting for FSMap version 59 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 10 client.6203 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 20 client.6203 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fbed0 0x2f995aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 4 client.6203 mds_command: new command op to 6559 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 --> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x2f6f82c0 con 0x2f8fbed0 2024-09-13T18:51:45.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fbed0 0x2f995aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e36000700 10 client.6203 ms_handle_connect on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:45.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.729+0000 7f0e3fe00700 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fbed0 0x2f995aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb5837b32c047648 server_cookie=545ce1e1ea714e76 in_seq=0 out_seq=0 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e36000700 1 -- 172.21.15.81:0/2127955185 <== mds.2 v2:172.21.15.81:6834/3088682584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x2f6f82c0 con 0x2f8fbed0 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e36000700 10 client.6203 handle_command_reply: tid=0 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 client.6203 shutdown 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 msgr2=0x2f994710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f994710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0e38000c00 tx=0x7f0e38085040 comp rx=0 tx=0).stop 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 shutdown_connections 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0x2f8fbed0 0x2f995aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2f934270 0x2f995560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2f933950 0x2f994c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 --2- 172.21.15.81:0/2127955185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2f911d00 0x2f994710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e36000700 0 client.6203 ms_handle_reset on v2:172.21.15.81:6834/3088682584 2024-09-13T18:51:45.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 >> 172.21.15.81:0/2127955185 conn(0x2f67c5b0 msgr2=0x2f92ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.745+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 shutdown_connections 2024-09-13T18:51:45.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e52ec5740 1 -- 172.21.15.81:0/2127955185 wait complete. 2024-09-13T18:51:45.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e52ec5740 20 client.6203 trim_cache size 0 max 16384 2024-09-13T18:51:45.755 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:45.756 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:51:45.756 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:51:45.756 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:45.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e24066730 msgr2=0x7f0e24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e24066730 0x7f0e24068bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0e481e6920 tx=0x7f0e30008040 comp rx=0 tx=0).stop 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 msgr2=0x7f0e480b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 0x7f0e480b47f0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0e38009c60 tx=0x7f0e38004770 comp rx=0 tx=0).stop 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 shutdown_connections 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e24066730 0x7f0e24068bf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e4815f170 0x7f0e480b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e4815ed90 0x7f0e4814d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 --2- 172.21.15.81:0/2312680975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e480cf5b0 0x7f0e480b47f0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 >> 172.21.15.81:0/2312680975 conn(0x7f0e480b1e10 msgr2=0x7f0e480ae780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 shutdown_connections 2024-09-13T18:51:45.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:45.749+0000 7f0e4fc00700 1 -- 172.21.15.81:0/2312680975 wait complete. 2024-09-13T18:51:45.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:51:45.777 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-13T18:51:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/ 2024-09-13T18:51:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4 2024-09-13T18:51:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5 2024-09-13T18:51:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6 2024-09-13T18:51:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-13T18:51:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-13T18:51:45.808 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:51:45.809 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:51:45.809 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:51:45.809 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:51:45.809 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-13T18:51:45.809 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:51:45.955 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2024-09-13T18:51:46.137 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:51:46.137 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:51:46.137 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:51:46.137 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:51:46.137 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-13T18:51:46.138 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:51:46.275 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627779 2024-09-13T18:51:46.463 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:51:46.464 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:51:46.464 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:51:46.464 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:51:46.464 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-13T18:51:46.464 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:51:46.604 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627780 2024-09-13T18:51:46.796 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:51:46.796 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:51:46.796 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:51:46.796 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:51:46.796 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-13T18:51:46.796 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:51:46.933 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627781 2024-09-13T18:51:47.124 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:51:47.124 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:51:47.124 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:51:47.124 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:51:47.125 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-13T18:51:47.125 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:51:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627782 2024-09-13T18:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-13T18:51:47.453 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:51:47.596 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627783 2024-09-13T18:51:47.782 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-13T18:51:47.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 Processor -- start 2024-09-13T18:51:47.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 -- start start 2024-09-13T18:51:47.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616a50 0x5588106f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 0x55881077ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588106f27e0 0x558810638f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588105aa2f0 con 0x558810616e30 2024-09-13T18:51:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588105668e0 con 0x558810616a50 2024-09-13T18:51:47.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba9d69140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558810566580 con 0x5588106f27e0 2024-09-13T18:51:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 0x55881077ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 0x55881077ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51202/0 (socket says 172.21.15.81:51202) 2024-09-13T18:51:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 -- 172.21.15.81:0/3615402557 learned_addr learned my addr 172.21.15.81:0/3615402557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba7a00700 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588106f27e0 0x558810638f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba7000700 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616a50 0x5588106f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 -- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588106f27e0 msgr2=0x558810638f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588106f27e0 0x558810638f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 -- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616a50 msgr2=0x5588106f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616a50 0x5588106f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.889+0000 7f9ba6600700 1 -- 172.21.15.81:0/3615402557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9800a100 con 0x558810616e30 2024-09-13T18:51:47.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba6600700 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 0x55881077ce00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9b940098b0 tx=0x7f9b94005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3b011eeea39dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba5200700 1 -- 172.21.15.81:0/3615402557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400f040 con 0x558810616e30 2024-09-13T18:51:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba5200700 1 -- 172.21.15.81:0/3615402557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94008a30 con 0x558810616e30 2024-09-13T18:51:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba5200700 1 -- 172.21.15.81:0/3615402557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94008de0 con 0x558810616e30 2024-09-13T18:51:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 -- 172.21.15.81:0/3615402557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 msgr2=0x55881077ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 0x55881077ce00 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f9b940098b0 tx=0x7f9b94005a00 comp rx=0 tx=0).stop 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 -- 172.21.15.81:0/3615402557 shutdown_connections 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588106f27e0 0x558810638f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558810616e30 0x55881077ce00 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/3615402557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616a50 0x5588106f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 -- 172.21.15.81:0/3615402557 >> 172.21.15.81:0/3615402557 conn(0x5588106430e0 msgr2=0x558810646d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 -- 172.21.15.81:0/3615402557 shutdown_connections 2024-09-13T18:51:47.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 -- 172.21.15.81:0/3615402557 wait complete. 2024-09-13T18:51:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 Processor -- start 2024-09-13T18:51:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.893+0000 7f9ba9d69140 1 -- start start 2024-09-13T18:51:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558810616a50 0x558810640490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616e30 0x5588106dd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588106f27e0 0x55881077cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55881053c8d0 con 0x5588106f27e0 2024-09-13T18:51:47.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588106de470 con 0x558810616e30 2024-09-13T18:51:47.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588106de710 con 0x558810616a50 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558810616a50 0x558810640490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588106f27e0 0x55881077cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558810616a50 0x558810640490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39380/0 (socket says 172.21.15.81:39380) 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7000700 1 -- 172.21.15.81:0/1840494061 learned_addr learned my addr 172.21.15.81:0/1840494061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba6600700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616e30 0x5588106dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 -- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558810616a50 msgr2=0x558810640490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558810616a50 0x558810640490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 -- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616e30 msgr2=0x5588106dd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616e30 0x5588106dd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 -- 172.21.15.81:0/1840494061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94009510 con 0x5588106f27e0 2024-09-13T18:51:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba6600700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558810616e30 0x5588106dd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:47.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba7a00700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588106f27e0 0x55881077cd90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0000f60 tx=0x7f9ba000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:47.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9b9f400700 1 -- 172.21.15.81:0/1840494061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000bca0 con 0x5588106f27e0 2024-09-13T18:51:47.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9b9f400700 1 -- 172.21.15.81:0/1840494061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000be20 con 0x5588106f27e0 2024-09-13T18:51:47.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558810554b00 con 0x5588106f27e0 2024-09-13T18:51:47.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9b9f400700 1 -- 172.21.15.81:0/1840494061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000f690 con 0x5588106f27e0 2024-09-13T18:51:47.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.897+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558810547f40 con 0x5588106f27e0 2024-09-13T18:51:47.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.901+0000 7f9b9f400700 1 -- 172.21.15.81:0/1840494061 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ba000f7f0 con 0x5588106f27e0 2024-09-13T18:51:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.901+0000 7f9b9f400700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b88065090 0x7f9b88067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.901+0000 7f9b9f400700 1 -- 172.21.15.81:0/1840494061 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9ba0083280 con 0x5588106f27e0 2024-09-13T18:51:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.901+0000 7f9ba7000700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b88065090 0x7f9b88067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.901+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x5588106ddfa0 0x5588106df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.901+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- osd_op(unknown.0.0:1 9.12 9:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x5588106dfde0 con 0x5588106ddfa0 2024-09-13T18:51:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.905+0000 7f9ba6600700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x5588106ddfa0 0x5588106df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.905+0000 7f9ba7000700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b88065090 0x7f9b88067550 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800a7c0 tx=0x7f9b98007030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:47.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.905+0000 7f9ba6600700 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x5588106ddfa0 0x5588106df8a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba6600700 1 -- 172.21.15.81:0/1840494061 <== osd.5 v2:172.21.15.178:6824/2042484449 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v67'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9b94019020 con 0x5588106ddfa0 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x5588106ddfa0 msgr2=0x5588106df8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x5588106ddfa0 0x5588106df8a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b88065090 msgr2=0x7f9b88067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b88065090 0x7f9b88067550 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800a7c0 tx=0x7f9b98007030 comp rx=0 tx=0).stop 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588106f27e0 msgr2=0x55881077cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 --2- 172.21.15.81:0/1840494061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588106f27e0 0x55881077cd90 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0000f60 tx=0x7f9ba000def0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba7a00700 1 -- 172.21.15.81:0/1840494061 reap_dead start 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 shutdown_connections 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 >> 172.21.15.81:0/1840494061 conn(0x5588106430e0 msgr2=0x5588106f4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 shutdown_connections 2024-09-13T18:51:47.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.909+0000 7f9ba9d69140 1 -- 172.21.15.81:0/1840494061 wait complete. 2024-09-13T18:51:47.926 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-13T18:51:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 Processor -- start 2024-09-13T18:51:47.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 -- start start 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300b127b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300b838e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563300a60a00 con 0x563300b847a0 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563300a5c2f0 con 0x563300b146f0 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1970240140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563300a188e0 con 0x563300af9040 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300b838e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300b838e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51216/0 (socket says 172.21.15.81:51216) 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 -- 172.21.15.81:0/3171681943 learned_addr learned my addr 172.21.15.81:0/3171681943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:47.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196d400700 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196ca00700 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300b127b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 -- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 msgr2=0x563300b9f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 -- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 msgr2=0x563300b127b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300b127b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:47.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 -- 172.21.15.81:0/3171681943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196800a100 con 0x563300b847a0 2024-09-13T18:51:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f196de00700 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300b838e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1968013040 tx=0x7f196800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd1786ec52e5ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1967400700 1 -- 172.21.15.81:0/3171681943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800f790 con 0x563300b847a0 2024-09-13T18:51:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1967400700 1 -- 172.21.15.81:0/3171681943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196800ae70 con 0x563300b847a0 2024-09-13T18:51:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.989+0000 7f1967400700 1 -- 172.21.15.81:0/3171681943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196800fc80 con 0x563300b847a0 2024-09-13T18:51:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- 172.21.15.81:0/3171681943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 msgr2=0x563300b838e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:47.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300b838e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1968013040 tx=0x7f196800f000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- 172.21.15.81:0/3171681943 shutdown_connections 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300b838e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300b127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- 172.21.15.81:0/3171681943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- 172.21.15.81:0/3171681943 >> 172.21.15.81:0/3171681943 conn(0x563300acbd90 msgr2=0x563300afa670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- 172.21.15.81:0/3171681943 shutdown_connections 2024-09-13T18:51:48.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- 172.21.15.81:0/3171681943 wait complete. 2024-09-13T18:51:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 Processor -- start 2024-09-13T18:51:48.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- start start 2024-09-13T18:51:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300af4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300afa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563300a18580 con 0x563300b847a0 2024-09-13T18:51:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633009ee8d0 con 0x563300b146f0 2024-09-13T18:51:48.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f1970240140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563300ba0940 con 0x563300af9040 2024-09-13T18:51:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f196de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300afa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f196d400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.993+0000 7f196de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300afa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51232/0 (socket says 172.21.15.81:51232) 2024-09-13T18:51:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196d400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39392/0 (socket says 172.21.15.81:39392) 2024-09-13T18:51:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 -- 172.21.15.81:0/2949397311 learned_addr learned my addr 172.21.15.81:0/2949397311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196ca00700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300af4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 -- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 msgr2=0x563300b9fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563300af9040 0x563300b9fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 -- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 msgr2=0x563300af4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563300b146f0 0x563300af4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 -- 172.21.15.81:0/2949397311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563300a06b00 con 0x563300b847a0 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f196de00700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300afa470 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f196800a4a0 tx=0x7f1968003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f1966000700 1 -- 172.21.15.81:0/2949397311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968025650 con 0x563300b847a0 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f1966000700 1 -- 172.21.15.81:0/2949397311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196801e040 con 0x563300b847a0 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f1966000700 1 -- 172.21.15.81:0/2949397311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968025a10 con 0x563300b847a0 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5633009f9f40 con 0x563300b847a0 2024-09-13T18:51:48.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:47.997+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5633009f99a0 con 0x563300b847a0 2024-09-13T18:51:48.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f1966000700 1 -- 172.21.15.81:0/2949397311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1968017050 con 0x563300b847a0 2024-09-13T18:51:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f1966000700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950065090 0x7f1950067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f1966000700 1 -- 172.21.15.81:0/2949397311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f19680855a0 con 0x563300b847a0 2024-09-13T18:51:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f196d400700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950065090 0x7f1950067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f1970240140 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x563300aecdd0 0x563300aed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- osd_op(unknown.0.0:1 9.12 9:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x563300c39890 con 0x563300aecdd0 2024-09-13T18:51:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f196ca00700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x563300aecdd0 0x563300aed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.001+0000 7f196d400700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950065090 0x7f1950067550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1960004170 tx=0x7f1960000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f196ca00700 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x563300aecdd0 0x563300aed1e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f196ca00700 1 -- 172.21.15.81:0/2949397311 <== osd.5 v2:172.21.15.178:6824/2042484449 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v67'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f195c0105f0 con 0x563300aecdd0 2024-09-13T18:51:48.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x563300aecdd0 msgr2=0x563300aed1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x563300aecdd0 0x563300aed1e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950065090 msgr2=0x7f1950067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950065090 0x7f1950067550 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1960004170 tx=0x7f1960000bc0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 msgr2=0x563300afa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 --2- 172.21.15.81:0/2949397311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563300b847a0 0x563300afa470 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f196800a4a0 tx=0x7f1968003330 comp rx=0 tx=0).stop 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f196de00700 1 -- 172.21.15.81:0/2949397311 reap_dead start 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 shutdown_connections 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 >> 172.21.15.81:0/2949397311 conn(0x563300acbd90 msgr2=0x563300af5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 shutdown_connections 2024-09-13T18:51:48.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.005+0000 7f1970240140 1 -- 172.21.15.81:0/2949397311 wait complete. 2024-09-13T18:51:48.021 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-13T18:51:48.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 Processor -- start 2024-09-13T18:51:48.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 -- start start 2024-09-13T18:51:48.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x561142467160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x5611424f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611423cf2f0 con 0x5611424f77a0 2024-09-13T18:51:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56114238b8e0 con 0x5611424876f0 2024-09-13T18:51:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f786bcb8140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56114238b580 con 0x5611424857c0 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.081+0000 7f7869800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x5611424f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x5611424f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51248/0 (socket says 172.21.15.81:51248) 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 -- 172.21.15.81:0/3088975701 learned_addr learned my addr 172.21.15.81:0/3088975701 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7868e00700 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7868400700 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x561142467160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 -- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 msgr2=0x5611425119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 -- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 msgr2=0x561142467160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x561142467160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 -- 172.21.15.81:0/3088975701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786000a100 con 0x5611424f77a0 2024-09-13T18:51:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7868400700 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x561142467160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:48.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7869800700 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x5611424f9430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x56114246adf0 tx=0x7f786000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6578a3f190c5a8a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7867000700 1 -- 172.21.15.81:0/3088975701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786000f790 con 0x5611424f77a0 2024-09-13T18:51:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7867000700 1 -- 172.21.15.81:0/3088975701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786000ae80 con 0x5611424f77a0 2024-09-13T18:51:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f7867000700 1 -- 172.21.15.81:0/3088975701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786000fca0 con 0x5611424f77a0 2024-09-13T18:51:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 -- 172.21.15.81:0/3088975701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 msgr2=0x5611424f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x5611424f9430 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x56114246adf0 tx=0x7f786000f000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 -- 172.21.15.81:0/3088975701 shutdown_connections 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x5611424f9430 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x561142467160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 --2- 172.21.15.81:0/3088975701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 -- 172.21.15.81:0/3088975701 >> 172.21.15.81:0/3088975701 conn(0x56114243ed90 msgr2=0x5611424f67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 -- 172.21.15.81:0/3088975701 shutdown_connections 2024-09-13T18:51:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 -- 172.21.15.81:0/3088975701 wait complete. 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 Processor -- start 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.085+0000 7f786bcb8140 1 -- start start 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x56114259dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x56114259e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611423618d0 con 0x5611424f77a0 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611425a8550 con 0x5611424876f0 2024-09-13T18:51:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5611425116a0 con 0x5611424857c0 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x56114259e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x56114259e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51258/0 (socket says 172.21.15.81:51258) 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 -- 172.21.15.81:0/1159464346 learned_addr learned my addr 172.21.15.81:0/1159464346 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7868e00700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7868400700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x56114259dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 -- 172.21.15.81:0/1159464346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 msgr2=0x5611425ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5611424857c0 0x5611425ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 -- 172.21.15.81:0/1159464346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 msgr2=0x56114259dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5611424876f0 0x56114259dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 -- 172.21.15.81:0/1159464346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561142393ca0 con 0x5611424f77a0 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7869800700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x56114259e400 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f786000aad0 tx=0x7f7860003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7865c00700 1 -- 172.21.15.81:0/1159464346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860010620 con 0x5611424f77a0 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7865c00700 1 -- 172.21.15.81:0/1159464346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7860010780 con 0x5611424f77a0 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f7865c00700 1 -- 172.21.15.81:0/1159464346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860010b30 con 0x5611424f77a0 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561142379b00 con 0x5611424f77a0 2024-09-13T18:51:48.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.089+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56114236cf40 con 0x5611424f77a0 2024-09-13T18:51:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.093+0000 7f7865c00700 1 -- 172.21.15.81:0/1159464346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7860017050 con 0x5611424f77a0 2024-09-13T18:51:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.093+0000 7f7865c00700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7848065090 0x7f7848067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.093+0000 7f7865c00700 1 -- 172.21.15.81:0/1159464346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7860084dd0 con 0x5611424f77a0 2024-09-13T18:51:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.093+0000 7f7868e00700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7848065090 0x7f7848067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f786bcb8140 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5611425a8940 0x5611425a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 9.5 9:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x5611425a9290 con 0x5611425a8940 2024-09-13T18:51:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f7868400700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5611425a8940 0x5611425a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f7868e00700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7848065090 0x7f7848067550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7858004170 tx=0x7f7858000bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f7868400700 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5611425a8940 0x5611425a8d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f7868400700 1 -- 172.21.15.81:0/1159464346 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v67'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f7854009a10 con 0x5611425a8940 2024-09-13T18:51:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5611425a8940 msgr2=0x5611425a8d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f786bcb8140 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5611425a8940 0x5611425a8d50 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7848065090 msgr2=0x7f7848067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.097+0000 7f786bcb8140 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7848065090 0x7f7848067550 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7858004170 tx=0x7f7858000bc0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 msgr2=0x56114259e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f786bcb8140 1 --2- 172.21.15.81:0/1159464346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5611424f77a0 0x56114259e400 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f786000aad0 tx=0x7f7860003330 comp rx=0 tx=0).stop 2024-09-13T18:51:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f7869800700 1 -- 172.21.15.81:0/1159464346 reap_dead start 2024-09-13T18:51:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 shutdown_connections 2024-09-13T18:51:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 >> 172.21.15.81:0/1159464346 conn(0x56114243ed90 msgr2=0x56114246ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 shutdown_connections 2024-09-13T18:51:48.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.101+0000 7f786bcb8140 1 -- 172.21.15.81:0/1159464346 wait complete. 2024-09-13T18:51:48.114 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-13T18:51:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 Processor -- start 2024-09-13T18:51:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 -- start start 2024-09-13T18:51:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373ccfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373cca220 0x560373df1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373d5dee0 0x560373df2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560373c20a00 con 0x560373c88920 2024-09-13T18:51:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560373c1c2f0 con 0x560373cca220 2024-09-13T18:51:48.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.173+0000 7fc0b892d140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560373bd88e0 con 0x560373d5dee0 2024-09-13T18:51:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373ccfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b6600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373d5dee0 0x560373df2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373ccfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51272/0 (socket says 172.21.15.81:51272) 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 -- 172.21.15.81:0/1257085327 learned_addr learned my addr 172.21.15.81:0/1257085327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5200700 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373cca220 0x560373df1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 -- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373d5dee0 msgr2=0x560373df2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373d5dee0 0x560373df2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 -- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373cca220 msgr2=0x560373df1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373cca220 0x560373df1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 -- 172.21.15.81:0/1257085327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b000a100 con 0x560373c88920 2024-09-13T18:51:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b5c00700 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373ccfa20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800b2f0 tx=0x7fc0a800b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34b5ce7c456061b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0af400700 1 -- 172.21.15.81:0/1257085327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8014070 con 0x560373c88920 2024-09-13T18:51:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0af400700 1 -- 172.21.15.81:0/1257085327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800be90 con 0x560373c88920 2024-09-13T18:51:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0af400700 1 -- 172.21.15.81:0/1257085327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800f610 con 0x560373c88920 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 -- 172.21.15.81:0/1257085327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 msgr2=0x560373ccfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373ccfa20 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fc0a800b2f0 tx=0x7fc0a800b600 comp rx=0 tx=0).stop 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 -- 172.21.15.81:0/1257085327 shutdown_connections 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373d5dee0 0x560373df2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373cca220 0x560373df1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 --2- 172.21.15.81:0/1257085327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373ccfa20 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 -- 172.21.15.81:0/1257085327 >> 172.21.15.81:0/1257085327 conn(0x560373cb8ed0 msgr2=0x560373c8aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 -- 172.21.15.81:0/1257085327 shutdown_connections 2024-09-13T18:51:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.177+0000 7fc0b892d140 1 -- 172.21.15.81:0/1257085327 wait complete. 2024-09-13T18:51:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 Processor -- start 2024-09-13T18:51:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 -- start start 2024-09-13T18:51:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373d597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373cca220 0x560373cafbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373d5dee0 0x560373cce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560373bd8580 con 0x560373c88920 2024-09-13T18:51:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560373bae8d0 con 0x560373d5dee0 2024-09-13T18:51:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.181+0000 7fc0b892d140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560373d59d30 con 0x560373cca220 2024-09-13T18:51:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373d597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373d597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51276/0 (socket says 172.21.15.81:51276) 2024-09-13T18:51:48.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 -- 172.21.15.81:0/478513393 learned_addr learned my addr 172.21.15.81:0/478513393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b6600700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373d5dee0 0x560373cce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5200700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373cca220 0x560373cafbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 -- 172.21.15.81:0/478513393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373cca220 msgr2=0x560373cafbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560373cca220 0x560373cafbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 -- 172.21.15.81:0/478513393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373d5dee0 msgr2=0x560373cce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560373d5dee0 0x560373cce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 -- 172.21.15.81:0/478513393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a8001b40 con 0x560373c88920 2024-09-13T18:51:48.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b5c00700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373d597f0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8000c00 tx=0x7fc0a8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0ae000700 1 -- 172.21.15.81:0/478513393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8014070 con 0x560373c88920 2024-09-13T18:51:48.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0ae000700 1 -- 172.21.15.81:0/478513393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a801c650 con 0x560373c88920 2024-09-13T18:51:48.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560373bb9f40 con 0x560373c88920 2024-09-13T18:51:48.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0ae000700 1 -- 172.21.15.81:0/478513393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a801c800 con 0x560373c88920 2024-09-13T18:51:48.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.185+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560373bb99a0 con 0x560373c88920 2024-09-13T18:51:48.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0ae000700 1 -- 172.21.15.81:0/478513393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc0a800d040 con 0x560373c88920 2024-09-13T18:51:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0ae000700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc098065090 0x7fc098067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0ae000700 1 -- 172.21.15.81:0/478513393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc0a800a040 con 0x560373c88920 2024-09-13T18:51:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0b5200700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc098065090 0x7fc098067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0b892d140 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x560373cb5800 0x560373cb18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 9.9 9:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x560373cb1e30 con 0x560373cb5800 2024-09-13T18:51:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0b6600700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x560373cb5800 0x560373cb18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0b5200700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc098065090 0x7fc098067550 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4010410 tx=0x7fc0a4001790 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.189+0000 7fc0b6600700 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x560373cb5800 0x560373cb18f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b6600700 1 -- 172.21.15.81:0/478513393 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v67'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc0b0017040 con 0x560373cb5800 2024-09-13T18:51:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x560373cb5800 msgr2=0x560373cb18f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x560373cb5800 0x560373cb18f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc098065090 msgr2=0x7fc098067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc098065090 0x7fc098067550 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4010410 tx=0x7fc0a4001790 comp rx=0 tx=0).stop 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 msgr2=0x560373d597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 --2- 172.21.15.81:0/478513393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560373c88920 0x560373d597f0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8000c00 tx=0x7fc0a8000ed0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b6600700 1 -- 172.21.15.81:0/478513393 reap_dead start 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 shutdown_connections 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 >> 172.21.15.81:0/478513393 conn(0x560373cb8ed0 msgr2=0x560373d5c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 shutdown_connections 2024-09-13T18:51:48.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.193+0000 7fc0b892d140 1 -- 172.21.15.81:0/478513393 wait complete. 2024-09-13T18:51:48.208 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-13T18:51:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 Processor -- start 2024-09-13T18:51:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 -- start start 2024-09-13T18:51:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2cc0030b0 0x564ce0581dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0569730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 0x564ce0569c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce04cea00 con 0x564ce05654a0 2024-09-13T18:51:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce04ca2f0 con 0x7fe2cc0030b0 2024-09-13T18:51:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e82b8140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ce04868e0 con 0x564ce060a460 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.261+0000 7fe2e5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 0x564ce0569c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 0x564ce0569c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51294/0 (socket says 172.21.15.81:51294) 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3319813011 learned_addr learned my addr 172.21.15.81:0/3319813011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5400700 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2cc0030b0 0x564ce0581dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2dca00700 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0569730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 msgr2=0x564ce0569730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0569730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2cc0030b0 msgr2=0x564ce0581dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2cc0030b0 0x564ce0581dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3319813011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ce0467f40 con 0x564ce05654a0 2024-09-13T18:51:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2dca00700 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0569730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:48.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e5e00700 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 0x564ce0569c70 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x564ce0564d20 tx=0x7fe2e0006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e42142f4f6ee764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2dfe00700 1 -- 172.21.15.81:0/3319813011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0002ce0 con 0x564ce05654a0 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2dfe00700 1 -- 172.21.15.81:0/3319813011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0002e40 con 0x564ce05654a0 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2dfe00700 1 -- 172.21.15.81:0/3319813011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0006260 con 0x564ce05654a0 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3319813011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 msgr2=0x564ce0569c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 0x564ce0569c70 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x564ce0564d20 tx=0x7fe2e0006ef0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3319813011 shutdown_connections 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564ce05654a0 0x564ce0569c70 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0569730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3319813011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2cc0030b0 0x564ce0581dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3319813011 >> 172.21.15.81:0/3319813011 conn(0x564ce05378c0 msgr2=0x564ce0564d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3319813011 shutdown_connections 2024-09-13T18:51:48.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3319813011 wait complete. 2024-09-13T18:51:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 Processor -- start 2024-09-13T18:51:48.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.265+0000 7fe2e82b8140 1 -- start start 2024-09-13T18:51:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ce05654a0 0x564ce057bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0563830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2cc0030b0 0x564ce06a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce0486580 con 0x7fe2cc0030b0 2024-09-13T18:51:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ce045c8d0 con 0x564ce05654a0 2024-09-13T18:51:48.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ce06a44e0 con 0x564ce060a460 2024-09-13T18:51:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2cc0030b0 0x564ce06a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2cc0030b0 0x564ce06a3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51302/0 (socket says 172.21.15.81:51302) 2024-09-13T18:51:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3681287836 learned_addr learned my addr 172.21.15.81:0/3681287836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2dca00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0563830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5400700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ce05654a0 0x564ce057bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3681287836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 msgr2=0x564ce0563830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ce060a460 0x564ce0563830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3681287836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ce05654a0 msgr2=0x564ce057bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ce05654a0 0x564ce057bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3681287836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e000e040 con 0x7fe2cc0030b0 2024-09-13T18:51:48.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e5e00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2cc0030b0 0x564ce06a3fa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0004020 tx=0x7fe2e0001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2dea00700 1 -- 172.21.15.81:0/3681287836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e0002ce0 con 0x7fe2cc0030b0 2024-09-13T18:51:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2dea00700 1 -- 172.21.15.81:0/3681287836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e0014d30 con 0x7fe2cc0030b0 2024-09-13T18:51:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ce04679a0 con 0x7fe2cc0030b0 2024-09-13T18:51:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2dea00700 1 -- 172.21.15.81:0/3681287836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e001c480 con 0x7fe2cc0030b0 2024-09-13T18:51:48.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.269+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ce05ff510 con 0x7fe2cc0030b0 2024-09-13T18:51:48.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.273+0000 7fe2dea00700 1 -- 172.21.15.81:0/3681287836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2e0005440 con 0x7fe2cc0030b0 2024-09-13T18:51:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.273+0000 7fe2dea00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2c4065060 0x7fe2c4067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2dea00700 1 -- 172.21.15.81:0/3681287836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2e0083460 con 0x7fe2cc0030b0 2024-09-13T18:51:48.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2e5400700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2c4065060 0x7fe2c4067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564ce0566860 0x564ce0600190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 9.5 9:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x564ce06006d0 con 0x564ce0566860 2024-09-13T18:51:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2dca00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564ce0566860 0x564ce0600190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2e5400700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2c4065060 0x7fe2c4067520 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009a40 tx=0x7fe2d800c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.277+0000 7fe2dca00700 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564ce0566860 0x564ce0600190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2dca00700 1 -- 172.21.15.81:0/3681287836 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v67'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe2d000bb70 con 0x564ce0566860 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564ce0566860 msgr2=0x564ce0600190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x564ce0566860 0x564ce0600190 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2c4065060 msgr2=0x7fe2c4067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2c4065060 0x7fe2c4067520 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe2d8009a40 tx=0x7fe2d800c040 comp rx=0 tx=0).stop 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2cc0030b0 msgr2=0x564ce06a3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 --2- 172.21.15.81:0/3681287836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2cc0030b0 0x564ce06a3fa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0004020 tx=0x7fe2e0001510 comp rx=0 tx=0).stop 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e5e00700 1 -- 172.21.15.81:0/3681287836 reap_dead start 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 shutdown_connections 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 >> 172.21.15.81:0/3681287836 conn(0x564ce05378c0 msgr2=0x564ce060cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 shutdown_connections 2024-09-13T18:51:48.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.281+0000 7fe2e82b8140 1 -- 172.21.15.81:0/3681287836 wait complete. 2024-09-13T18:51:48.295 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-13T18:51:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 Processor -- start 2024-09-13T18:51:48.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 -- start start 2024-09-13T18:51:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de14fa4350 0x55de1507cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 0x55de14fe5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15081340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de14f352f0 con 0x55de14fa4730 2024-09-13T18:51:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de14ef18e0 con 0x55de1505d760 2024-09-13T18:51:48.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50c05df140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de14ef1580 con 0x55de14fa4350 2024-09-13T18:51:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50b4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 0x55de14fe5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50b4e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 0x55de14fe5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51306/0 (socket says 172.21.15.81:51306) 2024-09-13T18:51:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.349+0000 7f50b4e00700 1 -- 172.21.15.81:0/1835302275 learned_addr learned my addr 172.21.15.81:0/1835302275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50be200700 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15081340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50bd800700 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de14fa4350 0x55de1507cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b4e00700 1 -- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de14fa4350 msgr2=0x55de1507cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de14fa4350 0x55de1507cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b4e00700 1 -- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 msgr2=0x55de15081340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15081340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b4e00700 1 -- 172.21.15.81:0/1835302275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0005d20 con 0x55de14fa4730 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 0x55de14fe5a10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f50a8001cd0 tx=0x7f50a800b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebda4292dd2c3b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b7e00700 1 -- 172.21.15.81:0/1835302275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800bd70 con 0x55de14fa4730 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b7e00700 1 -- 172.21.15.81:0/1835302275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a800e470 con 0x55de14fa4730 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50b7e00700 1 -- 172.21.15.81:0/1835302275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a800e800 con 0x55de14fa4730 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 -- 172.21.15.81:0/1835302275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 msgr2=0x55de14fe5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 0x55de14fe5a10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f50a8001cd0 tx=0x7f50a800b5d0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 -- 172.21.15.81:0/1835302275 shutdown_connections 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15081340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4730 0x55de14fe5a10 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 --2- 172.21.15.81:0/1835302275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de14fa4350 0x55de1507cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 -- 172.21.15.81:0/1835302275 >> 172.21.15.81:0/1835302275 conn(0x55de14fce0e0 msgr2=0x55de14fa1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 -- 172.21.15.81:0/1835302275 shutdown_connections 2024-09-13T18:51:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 -- 172.21.15.81:0/1835302275 wait complete. 2024-09-13T18:51:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 Processor -- start 2024-09-13T18:51:48.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.353+0000 7f50c05df140 1 -- start start 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4350 0x55de14fe6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15083790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de15083cd0 0x55de150598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de14ec78d0 con 0x55de14fa4350 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de14fe6960 con 0x55de1505d760 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55de1507f8e0 con 0x55de15083cd0 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4350 0x55de14fe6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4350 0x55de14fe6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51308/0 (socket says 172.21.15.81:51308) 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 -- 172.21.15.81:0/1723323016 learned_addr learned my addr 172.21.15.81:0/1723323016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15083790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 -- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de15083cd0 msgr2=0x55de150598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50be200700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de15083cd0 0x55de150598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de15083cd0 0x55de150598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 -- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 msgr2=0x55de15083790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15083790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 -- 172.21.15.81:0/1723323016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a4001e10 con 0x55de14fa4350 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55de1505d760 0x55de15083790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50be200700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55de15083cd0 0x55de150598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50bd800700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4350 0x55de14fe6420 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f50b0011000 tx=0x7f50b0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50b6a00700 1 -- 172.21.15.81:0/1723323016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b001d630 con 0x55de14fa4350 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50b6a00700 1 -- 172.21.15.81:0/1723323016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b001d7b0 con 0x55de14fa4350 2024-09-13T18:51:48.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55de14edfb00 con 0x55de14fa4350 2024-09-13T18:51:48.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50b6a00700 1 -- 172.21.15.81:0/1723323016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b001db60 con 0x55de14fa4350 2024-09-13T18:51:48.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.357+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de14ed2f40 con 0x55de14fa4350 2024-09-13T18:51:48.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50b6a00700 1 -- 172.21.15.81:0/1723323016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50b001dcc0 con 0x55de14fa4350 2024-09-13T18:51:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50b6a00700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f509c065060 0x7f509c067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50b6a00700 1 -- 172.21.15.81:0/1723323016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f50b000ae40 con 0x55de14fa4350 2024-09-13T18:51:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f509c065060 0x7f509c067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50c05df140 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55de15080800 0x55de14fe7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 9.1d 9:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v8 -- 0x55de14fe7590 con 0x55de15080800 2024-09-13T18:51:48.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.361+0000 7f50be200700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55de15080800 0x55de14fe7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50b4e00700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f509c065060 0x7f509c067520 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55de14fa32f0 tx=0x7f50a8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50be200700 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55de15080800 0x55de14fe7050 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50be200700 1 -- 172.21.15.81:0/1723323016 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v67'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f50b800f880 con 0x55de15080800 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55de15080800 msgr2=0x55de14fe7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x55de15080800 0x55de14fe7050 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f509c065060 msgr2=0x7f509c067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f509c065060 0x7f509c067520 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x55de14fa32f0 tx=0x7f50a8009000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4350 msgr2=0x55de14fe6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 --2- 172.21.15.81:0/1723323016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de14fa4350 0x55de14fe6420 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f50b0011000 tx=0x7f50b0002fb0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50be200700 1 -- 172.21.15.81:0/1723323016 reap_dead start 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 shutdown_connections 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 >> 172.21.15.81:0/1723323016 conn(0x55de14fce0e0 msgr2=0x55de14fd1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 shutdown_connections 2024-09-13T18:51:48.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.365+0000 7f50c05df140 1 -- 172.21.15.81:0/1723323016 wait complete. 2024-09-13T18:51:48.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /d1/d2/d3 recursive,force 2024-09-13T18:51:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.549+0000 7ff49c600700 1 Processor -- start 2024-09-13T18:51:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.549+0000 7ff49c600700 1 -- start start 2024-09-13T18:51:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49c600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff49415b460 0x7ff49415b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49c600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49c600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4940b52e0 con 0x7ff4940b4d70 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49c600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940d06e0 con 0x7ff49415b460 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49c600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940b55c0 con 0x7ff49415bd80 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff49415b460 0x7ff49415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49a600700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff4940b4d70 0x7ff49406f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:48650/0 (socket says 172.21.15.81:48650) 2024-09-13T18:51:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff49a600700 1 -- 172.21.15.81:0/3155582689 learned_addr learned my addr 172.21.15.81:0/3155582689 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff49415b460 0x7ff49415b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51316/0 (socket says 172.21.15.81:51316) 2024-09-13T18:51:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 -- 172.21.15.81:0/3155582689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 msgr2=0x7ff4940b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 --2- 172.21.15.81:0/3155582689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 -- 172.21.15.81:0/3155582689 >> v1:172.21.15.178:6789/0 conn(0x7ff4940b4d70 legacy=0x7ff49406f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 -- 172.21.15.81:0/3155582689 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940b58a0 con 0x7ff49415b460 2024-09-13T18:51:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff499c00700 1 --2- 172.21.15.81:0/3155582689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49415b460 0x7ff49415b840 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff488009850 tx=0x7ff488009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8b51dce9304a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff493e00700 1 -- 172.21.15.81:0/3155582689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488011830 con 0x7ff49415b460 2024-09-13T18:51:48.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff493e00700 1 -- 172.21.15.81:0/3155582689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488011990 con 0x7ff49415b460 2024-09-13T18:51:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.553+0000 7ff493e00700 1 -- 172.21.15.81:0/3155582689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488011d40 con 0x7ff49415b460 2024-09-13T18:51:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 -- 172.21.15.81:0/3155582689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49415b460 msgr2=0x7ff49415b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 --2- 172.21.15.81:0/3155582689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49415b460 0x7ff49415b840 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff488009850 tx=0x7ff488009b60 comp rx=0 tx=0).stop 2024-09-13T18:51:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 -- 172.21.15.81:0/3155582689 shutdown_connections 2024-09-13T18:51:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 --2- 172.21.15.81:0/3155582689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 --2- 172.21.15.81:0/3155582689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff49415b460 0x7ff49415b840 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 -- 172.21.15.81:0/3155582689 >> 172.21.15.81:0/3155582689 conn(0x7ff49406e660 msgr2=0x7ff49406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 -- 172.21.15.81:0/3155582689 shutdown_connections 2024-09-13T18:51:48.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.557+0000 7ff49c600700 1 -- 172.21.15.81:0/3155582689 wait complete. 2024-09-13T18:51:48.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 Processor -- start 2024-09-13T18:51:48.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 -- start start 2024-09-13T18:51:48.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 0x7ff49414f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49415b460 0x7ff49414c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940cace0 con 0x7ff4940b4d70 2024-09-13T18:51:48.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49414f780 con 0x7ff49415b460 2024-09-13T18:51:48.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49414c690 con 0x7ff49415bd80 2024-09-13T18:51:48.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 0x7ff49414f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 0x7ff49414f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51328/0 (socket says 172.21.15.81:51328) 2024-09-13T18:51:48.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 -- 172.21.15.81:0/2405006786 learned_addr learned my addr 172.21.15.81:0/2405006786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 -- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 msgr2=0x7ff4940c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 -- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49415b460 msgr2=0x7ff49414c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499200700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49415b460 0x7ff49414c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49415b460 0x7ff49414c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 -- 172.21.15.81:0/2405006786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880094b0 con 0x7ff4940b4d70 2024-09-13T18:51:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499200700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49415b460 0x7ff49414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff499c00700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 0x7ff49414f240 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff4880090b0 tx=0x7ff488004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff491600700 1 -- 172.21.15.81:0/2405006786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880038c0 con 0x7ff4940b4d70 2024-09-13T18:51:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff491600700 1 -- 172.21.15.81:0/2405006786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48801f070 con 0x7ff4940b4d70 2024-09-13T18:51:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4940c5d70 con 0x7ff4940b4d70 2024-09-13T18:51:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.561+0000 7ff491600700 1 -- 172.21.15.81:0/2405006786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488003c60 con 0x7ff4940b4d70 2024-09-13T18:51:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.565+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4940c6330 con 0x7ff4940b4d70 2024-09-13T18:51:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.565+0000 7ff491600700 1 -- 172.21.15.81:0/2405006786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff48801a430 con 0x7ff4940b4d70 2024-09-13T18:51:48.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.569+0000 7ff491600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff474066730 0x7ff474068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.569+0000 7ff491600700 1 -- 172.21.15.81:0/2405006786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff488021070 con 0x7ff4940b4d70 2024-09-13T18:51:48.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.569+0000 7ff499200700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff474066730 0x7ff474068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.569+0000 7ff49fa62740 1 Processor -- start 2024-09-13T18:51:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.569+0000 7ff499200700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff474066730 0x7ff474068bf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff49406d490 tx=0x7ff480008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.569+0000 7ff49fa62740 1 -- start start 2024-09-13T18:51:48.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e8eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e8f410 0x30e91800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x30db3530 con 0x30e475c0 2024-09-13T18:51:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x30db0cc0 con 0x30e8f410 2024-09-13T18:51:48.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x30dac5b0 con 0x30e471e0 2024-09-13T18:51:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e8eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e8eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51340/0 (socket says 172.21.15.81:51340) 2024-09-13T18:51:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 -- 172.21.15.81:0/45743995 learned_addr learned my addr 172.21.15.81:0/45743995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499c00700 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49a600700 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e8f410 0x30e91800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 -- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 msgr2=0x30e8c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 -- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e8f410 msgr2=0x30e91800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e8f410 0x30e91800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 -- 172.21.15.81:0/45743995 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x30c9ef10 con 0x30e475c0 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49a600700 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e8f410 0x30e91800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:48.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff499200700 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e8eed0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff480010930 tx=0x7ff480013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ac6bfb811a3430 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff486000700 1 -- 172.21.15.81:0/45743995 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480004230 con 0x30e475c0 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff486000700 1 -- 172.21.15.81:0/45743995 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48001a070 con 0x30e475c0 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff486000700 1 -- 172.21.15.81:0/45743995 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480004590 con 0x30e475c0 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- 172.21.15.81:0/45743995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 msgr2=0x30e8eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e8eed0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff480010930 tx=0x7ff480013000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- 172.21.15.81:0/45743995 shutdown_connections 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e8f410 0x30e91800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e8eed0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 --2- 172.21.15.81:0/45743995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- 172.21.15.81:0/45743995 >> 172.21.15.81:0/45743995 conn(0x30bd37b0 msgr2=0x30e6dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- 172.21.15.81:0/45743995 shutdown_connections 2024-09-13T18:51:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.573+0000 7ff49fa62740 1 -- 172.21.15.81:0/45743995 wait complete. 2024-09-13T18:51:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 -- start start 2024-09-13T18:51:48.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 Processor -- start 2024-09-13T18:51:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e6ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e45590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e45ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x30d6f950 con 0x30e8f410 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x30d6f5f0 con 0x30e475c0 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x30d41e40 con 0x30e471e0 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49fa62740 10 client.0 _ll_register_callbacks cb 0x30da5c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e45ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e45ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51348/0 (socket says 172.21.15.81:51348) 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 -- 172.21.15.81:0/601327830 learned_addr learned my addr 172.21.15.81:0/601327830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff499c00700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e6ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff499200700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e45590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 -- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 msgr2=0x30e6ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e6ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 -- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 msgr2=0x30e45590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e45590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 -- 172.21.15.81:0/601327830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48000e050 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff49a600700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e45ad0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00e7c0 tx=0x7ff48c00e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88717e85848f3a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.577+0000 7ff47aa00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff47aa00700 1 -- 172.21.15.81:0/601327830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c00ee60 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x30be04c0 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff47aa00700 1 -- 172.21.15.81:0/601327830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff48c0072e0 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff47aa00700 1 -- 172.21.15.81:0/601327830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff48c001c00 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 10 client.7173 fetch_fsmap learned FSMap version 60 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x30d72630 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff47aa00700 1 -- 172.21.15.81:0/601327830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x30be04c0 con 0x30e8f410 2024-09-13T18:51:48.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff47aa00700 1 -- 172.21.15.81:0/601327830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff48c0074a0 con 0x30e8f410 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 10 client.7173 fetch_fsmap finished waiting for FSMap version 60 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 10 client.7173 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 20 client.7173 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e429c0 0x30e42dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 4 client.7173 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x30c2a740 con 0x30e429c0 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff499c00700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e429c0 0x30e42dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff499c00700 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e429c0 0x30e42dd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d0f1604fea348ae server_cookie=ad1384f304af85f7 in_seq=0 out_seq=0 2024-09-13T18:51:48.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.581+0000 7ff47aa00700 10 client.7173 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff47aa00700 1 -- 172.21.15.81:0/601327830 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x30c2a740 con 0x30e429c0 2024-09-13T18:51:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff47aa00700 10 client.7173 handle_command_reply: tid=0 2024-09-13T18:51:48.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 client.7173 shutdown 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 msgr2=0x30e45ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e45ad0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00e7c0 tx=0x7ff48c00e7f0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 shutdown_connections 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e429c0 0x30e42dd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e45ad0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e45590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 --2- 172.21.15.81:0/601327830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e6ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 >> 172.21.15.81:0/601327830 conn(0x30bd37b0 msgr2=0x30e8d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff47aa00700 0 client.7173 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 shutdown_connections 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 1 -- 172.21.15.81:0/601327830 wait complete. 2024-09-13T18:51:48.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.585+0000 7ff49fa62740 20 client.7173 trim_cache size 0 max 16384 2024-09-13T18:51:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 Processor -- start 2024-09-13T18:51:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 -- start start 2024-09-13T18:51:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e471e0 0x30e725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e9be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e8f410 0x30e9c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x30d66040 con 0x30e475c0 2024-09-13T18:51:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x30d4a5d0 con 0x30e471e0 2024-09-13T18:51:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x30da7da0 con 0x30e8f410 2024-09-13T18:51:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e9be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e9be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51362/0 (socket says 172.21.15.81:51362) 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 -- 172.21.15.81:0/4196104787 learned_addr learned my addr 172.21.15.81:0/4196104787 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff49a600700 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e8f410 0x30e9c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499c00700 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e471e0 0x30e725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 -- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e8f410 msgr2=0x30e9c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e8f410 0x30e9c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 -- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e471e0 msgr2=0x30e725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e471e0 0x30e725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 -- 172.21.15.81:0/4196104787 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x30d58860 con 0x30e475c0 2024-09-13T18:51:48.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.605+0000 7ff499200700 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e9be50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff480024040 tx=0x7ff480017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f61a5fc4a2bfb65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff486a00700 1 -- 172.21.15.81:0/4196104787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480004230 con 0x30e475c0 2024-09-13T18:51:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff486a00700 1 -- 172.21.15.81:0/4196104787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4800043b0 con 0x30e475c0 2024-09-13T18:51:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff486a00700 1 -- 172.21.15.81:0/4196104787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480015780 con 0x30e475c0 2024-09-13T18:51:48.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- 172.21.15.81:0/4196104787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 msgr2=0x30e9be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e9be50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7ff480024040 tx=0x7ff480017000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- 172.21.15.81:0/4196104787 shutdown_connections 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e8f410 0x30e9c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e475c0 0x30e9be50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- 172.21.15.81:0/4196104787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e471e0 0x30e725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- 172.21.15.81:0/4196104787 >> 172.21.15.81:0/4196104787 conn(0x30bd37b0 msgr2=0x30e951c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- 172.21.15.81:0/4196104787 shutdown_connections 2024-09-13T18:51:48.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- 172.21.15.81:0/4196104787 wait complete. 2024-09-13T18:51:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- start start 2024-09-13T18:51:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 Processor -- start 2024-09-13T18:51:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e40570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e40ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x30e8b050 con 0x30e8f410 2024-09-13T18:51:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x30e41f90 con 0x30e475c0 2024-09-13T18:51:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x30e91cd0 con 0x30e471e0 2024-09-13T18:51:48.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.609+0000 7ff49fa62740 10 client.0 _ll_register_callbacks cb 0x30dab180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39540/0 (socket says 172.21.15.81:39540) 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 -- 172.21.15.81:0/2745429662 learned_addr learned my addr 172.21.15.81:0/2745429662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49a600700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e40ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499200700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e40570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 -- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 msgr2=0x30e40570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e40570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 -- 172.21.15.81:0/2745429662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 msgr2=0x30e40ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e40ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 -- 172.21.15.81:0/2745429662 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x30c9ef10 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff499c00700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8e5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff488083fe0 tx=0x7ff488083eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1a354b06d97c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff47aa00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff47aa00700 1 -- 172.21.15.81:0/2745429662 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff488004580 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff47aa00700 1 -- 172.21.15.81:0/2745429662 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff488054e80 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff48001a070 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff47aa00700 1 -- 172.21.15.81:0/2745429662 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff488055fd0 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 10 client.6257 fetch_fsmap learned FSMap version 60 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x30c1ec40 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff47aa00700 1 -- 172.21.15.81:0/2745429662 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48001a070 con 0x30e471e0 2024-09-13T18:51:48.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff47aa00700 1 -- 172.21.15.81:0/2745429662 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff48805ea40 con 0x30e471e0 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 10 client.6257 fetch_fsmap finished waiting for FSMap version 60 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 10 client.6257 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 20 client.6257 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e8eaf0 0x30e40ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 4 client.6257 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.613+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x30c51620 con 0x30e8eaf0 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff499200700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e8eaf0 0x30e40ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff499200700 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e8eaf0 0x30e40ff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8303d486d52a7d server_cookie=239a8b8a60172c4 in_seq=0 out_seq=0 2024-09-13T18:51:48.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff47aa00700 10 client.6257 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff47aa00700 1 -- 172.21.15.81:0/2745429662 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x30c51620 con 0x30e8eaf0 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff47aa00700 10 client.6257 handle_command_reply: tid=0 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 client.6257 shutdown 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 msgr2=0x30e8e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8e5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff488083fe0 tx=0x7ff488083eb0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 shutdown_connections 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x30e8eaf0 0x30e40ff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x30e8f410 0x30e40ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x30e475c0 0x30e40570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff47aa00700 0 client.6257 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 --2- 172.21.15.81:0/2745429662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x30e471e0 0x30e8e5b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 >> 172.21.15.81:0/2745429662 conn(0x30bd37b0 msgr2=0x30e949a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.626 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:51:48.620+0000 7f0762e00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1) n(v3 rc2024-09-13T18:51:31.261405+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6969 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55e96a2ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:31.261405+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:51:31.261405+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:51:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 shutdown_connections 2024-09-13T18:51:48.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 1 -- 172.21.15.81:0/2745429662 wait complete. 2024-09-13T18:51:48.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.617+0000 7ff49fa62740 20 client.6257 trim_cache size 0 max 16384 2024-09-13T18:51:48.627 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:51:48.617+0000 7f8002e00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1) n(v2 rc2024-09-13T18:51:31.261405+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6969 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55a9e2ae3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:31.261405+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:51:31.261405+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:51:48.627 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:48.627 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-13T18:51:48.627 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "c1bf03bc-c947-49d2-b153-6052ba8a3d28", 2024-09-13T18:51:48.627 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-13T18:51:48.628 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:48.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff474066730 msgr2=0x7ff474068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff474066730 0x7ff474068bf0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff49406d490 tx=0x7ff480008040 comp rx=0 tx=0).stop 2024-09-13T18:51:48.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 msgr2=0x7ff49414f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 0x7ff49414f240 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff4880090b0 tx=0x7ff488004770 comp rx=0 tx=0).stop 2024-09-13T18:51:48.629 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:51:48.621+0000 7f1c24800700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:51:30.989410+0000 1=0+1) n(v0 rc2024-09-13T18:51:30.989410+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6969 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55bb5ce50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.989410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:30.989410+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.989410+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:51:30.989410+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:51:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 shutdown_connections 2024-09-13T18:51:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff474066730 0x7ff474068bf0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49415bd80 0x7ff4940c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49415b460 0x7ff49414c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 --2- 172.21.15.81:0/2405006786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4940b4d70 0x7ff49414f240 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 >> 172.21.15.81:0/2405006786 conn(0x7ff49406e660 msgr2=0x7ff494159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.630 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:51:48.621+0000 7f1c24800700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/AsLsXsFsx@2},l=6969 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55bb5ddaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:51:48.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 shutdown_connections 2024-09-13T18:51:48.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.621+0000 7ff49c600700 1 -- 172.21.15.81:0/2405006786 wait complete. 2024-09-13T18:51:48.630 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:51:48.621+0000 7f800a600700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1) n(v1 rc2024-09-13T18:51:31.261405+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6969=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55a9e2ae2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:30.989410+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:51:31.261405+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:51:48.631 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:51:48.620+0000 7f076a600700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1) n(v4 rc2024-09-13T18:51:31.261405+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6969=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55e96a2aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:31.261405+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:51:31.261405+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:51:48.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-13T18:51:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.817+0000 7f8f7ba00700 1 Processor -- start 2024-09-13T18:51:48.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.821+0000 7f8f7ba00700 1 -- start start 2024-09-13T18:51:48.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.821+0000 7f8f7ba00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f7406cb00 0x7f8f7406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.821+0000 7f8f7ba00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f740cd7b0 con 0x7f8f740d0950 2024-09-13T18:51:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.821+0000 7f8f7ba00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f740d0e80 con 0x7f8f7415abb0 2024-09-13T18:51:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.821+0000 7f8f7ba00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f740d1a00 con 0x7f8f7406cb00 2024-09-13T18:51:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8f740d0950 0x7f8f740b4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55450/0 (socket says 172.21.15.81:55450) 2024-09-13T18:51:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 -- 172.21.15.81:0/1296799009 learned_addr learned my addr 172.21.15.81:0/1296799009 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:51:48.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f79a00700 1 --2- 172.21.15.81:0/1296799009 >> v2:172.21.15.178:3300/0 conn(0x7f8f7406cb00 0x7f8f7406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731746588 0 0) 0x7f8f740cd7b0 con 0x7f8f740d0950 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f5c0035d0 con 0x7f8f740d0950 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377668341 0 0) 0x7f8f5c0035d0 con 0x7f8f740d0950 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 >> v2:172.21.15.178:3300/0 conn(0x7f8f7406cb00 msgr2=0x7f8f7406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 --2- 172.21.15.81:0/1296799009 >> v2:172.21.15.178:3300/0 conn(0x7f8f7406cb00 0x7f8f7406cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 >> v1:172.21.15.178:6789/0 conn(0x7f8f7415abb0 legacy=0x7f8f740cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740d1160 con 0x7f8f740d0950 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f8f60001670 con 0x7f8f740d0950 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 >> v1:172.21.15.81:6789/0 conn(0x7f8f740d0950 legacy=0x7f8f740b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f5c003a20 0x7f8f5c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f5c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f5c0050f0 0x7f8f5c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740d1a00 con 0x7f8f5c004420 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c00c050 con 0x7f8f5c003a20 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c00c210 con 0x7f8f5c0050f0 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f5c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f79000700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f5c003a20 0x7f8f5c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f79a00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f5c0050f0 0x7f8f5c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 -- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f5c0050f0 msgr2=0x7f8f5c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f5c0050f0 0x7f8f5c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 -- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f5c003a20 msgr2=0x7f8f5c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f5c003a20 0x7f8f5c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 -- 172.21.15.81:0/1296799009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0035d0 con 0x7f8f5c004420 2024-09-13T18:51:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f79000700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f5c003a20 0x7f8f5c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:51:48.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f79a00700 1 -- 172.21.15.81:0/1296799009 reap_dead start 2024-09-13T18:51:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f5c0048f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c2f0 tx=0x7f8f5c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3edef14a435d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6000ce30 con 0x7f8f5c004420 2024-09-13T18:51:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f60005980 con 0x7f8f5c004420 2024-09-13T18:51:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.825+0000 7f8f73400700 1 -- 172.21.15.81:0/1296799009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60005d30 con 0x7f8f5c004420 2024-09-13T18:51:48.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1296799009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 msgr2=0x7f8f5c0048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f5c0048f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c2f0 tx=0x7f8f5c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1296799009 shutdown_connections 2024-09-13T18:51:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1296799009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f5c0048f0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1296799009 >> 172.21.15.81:0/1296799009 conn(0x7f8f7406e660 msgr2=0x7f8f7406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1296799009 shutdown_connections 2024-09-13T18:51:48.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.829+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1296799009 wait complete. 2024-09-13T18:51:48.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 Processor -- start 2024-09-13T18:51:48.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 -- start start 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f74147530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f74158440 0x7f8f7406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f741588c0 0x7f8f7406b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740c9f00 con 0x7f8f5c004420 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74159880 con 0x7f8f741588c0 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74159b60 con 0x7f8f74158440 2024-09-13T18:51:48.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f74147530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f74147530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51392/0 (socket says 172.21.15.81:51392) 2024-09-13T18:51:48.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 -- 172.21.15.81:0/1564243292 learned_addr learned my addr 172.21.15.81:0/1564243292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f74158440 0x7f8f7406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79a00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f741588c0 0x7f8f7406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 -- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f74158440 msgr2=0x7f8f7406aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f74158440 0x7f8f7406aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 -- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f741588c0 msgr2=0x7f8f7406b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f741588c0 0x7f8f7406b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 -- 172.21.15.81:0/1564243292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74159e40 con 0x7f8f5c004420 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f74158440 0x7f8f7406aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:48.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79a00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f741588c0 0x7f8f7406b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f79000700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f74147530 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800e5a0 tx=0x7f8f6800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f70c00700 1 -- 172.21.15.81:0/1564243292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680052e0 con 0x7f8f5c004420 2024-09-13T18:51:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f70c00700 1 -- 172.21.15.81:0/1564243292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f68005440 con 0x7f8f5c004420 2024-09-13T18:51:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f70c00700 1 -- 172.21.15.81:0/1564243292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f680038c0 con 0x7f8f5c004420 2024-09-13T18:51:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7415a120 con 0x7f8f5c004420 2024-09-13T18:51:48.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.833+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7406a4e0 con 0x7f8f5c004420 2024-09-13T18:51:48.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.837+0000 7f8f70c00700 1 -- 172.21.15.81:0/1564243292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f68003a20 con 0x7f8f5c004420 2024-09-13T18:51:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.841+0000 7f8f70c00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f54066730 0x7f8f54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.841+0000 7f8f70c00700 1 -- 172.21.15.81:0/1564243292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f68083a50 con 0x7f8f5c004420 2024-09-13T18:51:48.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.841+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f54066730 0x7f8f54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.841+0000 7f8f73e00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f54066730 0x7f8f54068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8f7414b000 tx=0x7f8f60007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.841+0000 7f8f7edc2740 1 Processor -- start 2024-09-13T18:51:48.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.841+0000 7f8f7edc2740 1 -- start start 2024-09-13T18:51:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229f7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x229f6d00 0x22a18d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x229cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22960010 con 0x22a19270 2024-09-13T18:51:48.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x228edf40 con 0x229f6d00 2024-09-13T18:51:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22940e30 con 0x22a18950 2024-09-13T18:51:48.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x229cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x229cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51406/0 (socket says 172.21.15.81:51406) 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 -- 172.21.15.81:0/2390160614 learned_addr learned my addr 172.21.15.81:0/2390160614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79000700 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f73e00700 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x229f6d00 0x22a18d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 -- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 msgr2=0x229f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 -- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x229f6d00 msgr2=0x22a18d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x229f6d00 0x22a18d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 -- 172.21.15.81:0/2390160614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x227aca40 con 0x22a19270 2024-09-13T18:51:48.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f79a00700 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x229cc5d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f8f740d08a0 tx=0x7f8f6c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983d2ecf50a61e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f65600700 1 -- 172.21.15.81:0/2390160614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c00e040 con 0x22a19270 2024-09-13T18:51:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f65600700 1 -- 172.21.15.81:0/2390160614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c016460 con 0x22a19270 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f65600700 1 -- 172.21.15.81:0/2390160614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c0167d0 con 0x22a19270 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- 172.21.15.81:0/2390160614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 msgr2=0x229cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x229cc5d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f8f740d08a0 tx=0x7f8f6c009750 comp rx=0 tx=0).stop 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- 172.21.15.81:0/2390160614 shutdown_connections 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x229cc5d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x229f6d00 0x22a18d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/2390160614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- 172.21.15.81:0/2390160614 >> 172.21.15.81:0/2390160614 conn(0x227615b0 msgr2=0x229d29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- 172.21.15.81:0/2390160614 shutdown_connections 2024-09-13T18:51:48.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.845+0000 7f8f7edc2740 1 -- 172.21.15.81:0/2390160614 wait complete. 2024-09-13T18:51:48.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 -- start start 2024-09-13T18:51:48.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 Processor -- start 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x229f6d00 0x229e1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 0x22a14620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229dfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2293c150 con 0x22a18950 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22939eb0 con 0x22a19270 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x228f78e0 con 0x229f6d00 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f7edc2740 10 client.0 _ll_register_callbacks cb 0x228d6670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 0x22a14620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 0x22a14620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51420/0 (socket says 172.21.15.81:51420) 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 -- 172.21.15.81:0/3328838437 learned_addr learned my addr 172.21.15.81:0/3328838437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f79a00700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229dfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f79000700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x229f6d00 0x229e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 -- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x229f6d00 msgr2=0x229e1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x229f6d00 0x229e1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 -- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 msgr2=0x229dfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229dfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f73e00700 1 -- 172.21.15.81:0/3328838437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c009d50 con 0x22a18950 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.849+0000 7f8f79000700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x229f6d00 0x229e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f73e00700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 0x22a14620 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8f60011000 tx=0x7f8f6000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d07aaa910c22a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 1 -- 172.21.15.81:0/3328838437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60004c70 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 1 -- 172.21.15.81:0/3328838437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f60004dd0 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2276e2c0 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 1 -- 172.21.15.81:0/3328838437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f600070d0 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 10 client.7191 fetch_fsmap learned FSMap version 60 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x22900290 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 1 -- 172.21.15.81:0/3328838437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2276e2c0 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 1 -- 172.21.15.81:0/3328838437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f8f60007230 con 0x22a18950 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 10 client.7191 fetch_fsmap finished waiting for FSMap version 60 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 10 client.7191 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 20 client.7191 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x229e2280 0x229f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 4 client.7191 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x227b8540 con 0x229e2280 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f79000700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x229e2280 0x229f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f5a000700 10 client.7191 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.853+0000 7f8f79000700 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x229e2280 0x229f7ca0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec0309e346f3c8d7 server_cookie=1e29c0cb15ba3deb in_seq=0 out_seq=0 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f5a000700 1 -- 172.21.15.81:0/3328838437 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x227b8540 con 0x229e2280 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f5a000700 10 client.7191 handle_command_reply: tid=0 2024-09-13T18:51:48.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 client.7191 shutdown 2024-09-13T18:51:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 msgr2=0x22a14620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 0x22a14620 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8f60011000 tx=0x7f8f6000f000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 shutdown_connections 2024-09-13T18:51:48.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x229e2280 0x229f7ca0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229dfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a18950 0x22a14620 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3328838437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x229f6d00 0x229e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f5a000700 0 client.7191 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 >> 172.21.15.81:0/3328838437 conn(0x227615b0 msgr2=0x229cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 shutdown_connections 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3328838437 wait complete. 2024-09-13T18:51:48.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.857+0000 7f8f7edc2740 20 client.7191 trim_cache size 0 max 16384 2024-09-13T18:51:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 Processor -- start 2024-09-13T18:51:48.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 -- start start 2024-09-13T18:51:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 0x22a320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229dd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229ddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x227e5b80 con 0x229f6d00 2024-09-13T18:51:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x229d3820 con 0x22a19270 2024-09-13T18:51:48.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x228d8620 con 0x22a18950 2024-09-13T18:51:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 0x22a320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 0x22a320d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51428/0 (socket says 172.21.15.81:51428) 2024-09-13T18:51:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 -- 172.21.15.81:0/3738477759 learned_addr learned my addr 172.21.15.81:0/3738477759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79a00700 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229ddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f73e00700 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229dd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 -- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 msgr2=0x229dd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229dd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 -- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 msgr2=0x229ddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229ddef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.877+0000 7f8f79000700 1 -- 172.21.15.81:0/3738477759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x228e64c0 con 0x229f6d00 2024-09-13T18:51:48.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f79000700 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 0x22a320d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8f68054970 tx=0x7f8f6800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f00852aba84cee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f66000700 1 -- 172.21.15.81:0/3738477759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6807f070 con 0x229f6d00 2024-09-13T18:51:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f66000700 1 -- 172.21.15.81:0/3738477759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6805cd20 con 0x229f6d00 2024-09-13T18:51:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f66000700 1 -- 172.21.15.81:0/3738477759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68052d80 con 0x229f6d00 2024-09-13T18:51:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3738477759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 msgr2=0x22a320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 0x22a320d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8f68054970 tx=0x7f8f6800ef90 comp rx=0 tx=0).stop 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3738477759 shutdown_connections 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a19270 0x229ddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x229dd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/3738477759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x229f6d00 0x22a320d0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3738477759 >> 172.21.15.81:0/3738477759 conn(0x227615b0 msgr2=0x22a17090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3738477759 shutdown_connections 2024-09-13T18:51:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- 172.21.15.81:0/3738477759 wait complete. 2024-09-13T18:51:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- start start 2024-09-13T18:51:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 Processor -- start 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x22a7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x22a2f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a7acf0 0x22a2f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22a147c0 con 0x22a19270 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x228ebc70 con 0x22a7acf0 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22938580 con 0x22a18950 2024-09-13T18:51:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.881+0000 7f8f7edc2740 10 client.0 _ll_register_callbacks cb 0x229098f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:51:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x22a2f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x22a2f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51444/0 (socket says 172.21.15.81:51444) 2024-09-13T18:51:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 -- 172.21.15.81:0/684883056 learned_addr learned my addr 172.21.15.81:0/684883056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f79a00700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a7acf0 0x22a2f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f79000700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x22a7a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 -- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 msgr2=0x22a7a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x22a7a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 -- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a7acf0 msgr2=0x22a2f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a7acf0 0x22a2f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 -- 172.21.15.81:0/684883056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7406a4e0 con 0x22a19270 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f73e00700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x22a2f280 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c1b0 tx=0x7f8f600079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f9f443ba41d959 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:51:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f5a000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f5a000700 1 -- 172.21.15.81:0/684883056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60041040 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f5a000700 1 -- 172.21.15.81:0/684883056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8f60031640 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f6c016460 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f5a000700 1 -- 172.21.15.81:0/684883056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f60031800 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 10 client.7197 fetch_fsmap learned FSMap version 60 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x228da790 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f5a000700 1 -- 172.21.15.81:0/684883056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c016460 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f5a000700 1 -- 172.21.15.81:0/684883056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f8f60031960 con 0x22a19270 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 10 client.7197 fetch_fsmap finished waiting for FSMap version 60 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 10 client.7197 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 20 client.7197 populate_metadata read hostname 'smithi081' 2024-09-13T18:51:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x22a30770 0x22a2ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:51:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 4 client.7197 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:51:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x227dd2c0 con 0x22a30770 2024-09-13T18:51:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.885+0000 7f8f79000700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x22a30770 0x22a2ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:51:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f5a000700 10 client.7197 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f79000700 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x22a30770 0x22a2ce80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a136e6c9b4dc4c server_cookie=78c15f1ddb935b3 in_seq=0 out_seq=0 2024-09-13T18:51:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f5a000700 1 -- 172.21.15.81:0/684883056 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x227dd2c0 con 0x22a30770 2024-09-13T18:51:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f5a000700 10 client.7197 handle_command_reply: tid=0 2024-09-13T18:51:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 client.7197 shutdown 2024-09-13T18:51:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 msgr2=0x22a2f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x22a2f280 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000c1b0 tx=0x7f8f600079a0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 shutdown_connections 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x22a30770 0x22a2ce80 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a7acf0 0x22a2f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22a19270 0x22a2f280 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f5a000700 0 client.7197 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 --2- 172.21.15.81:0/684883056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a18950 0x22a7a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 >> 172.21.15.81:0/684883056 conn(0x227615b0 msgr2=0x229f6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 shutdown_connections 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 1 -- 172.21.15.81:0/684883056 wait complete. 2024-09-13T18:51:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7edc2740 20 client.7197 trim_cache size 0 max 16384 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: "c1bf03bc-c947-49d2-b153-6052ba8a3d28": { 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "c1bf03bc-c947-49d2-b153-6052ba8a3d28", 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:51:48.898 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f54066730 msgr2=0x7f8f54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f54066730 0x7f8f54068bf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8f7414b000 tx=0x7f8f60007000 comp rx=0 tx=0).stop 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 msgr2=0x7f8f74147530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f74147530 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800e5a0 tx=0x7f8f6800e960 comp rx=0 tx=0).stop 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 shutdown_connections 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f54066730 0x7f8f54068bf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f741588c0 0x7f8f7406b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f74158440 0x7f8f7406aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 --2- 172.21.15.81:0/1564243292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f5c004420 0x7f8f74147530 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:51:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 >> 172.21.15.81:0/1564243292 conn(0x7f8f7406e660 msgr2=0x7f8f7406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:51:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 shutdown_connections 2024-09-13T18:51:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:51:48.889+0000 7f8f7ba00700 1 -- 172.21.15.81:0/1564243292 wait complete. 2024-09-13T18:51:48.920 INFO:tasks.cephfs.filesystem:scrub status for tag:c1bf03bc-c947-49d2-b153-6052ba8a3d28 - {'path': '/d1/d2/d3', 'tag': 'c1bf03bc-c947-49d2-b153-6052ba8a3d28', 'options': 'recursive,force'} 2024-09-13T18:51:54.219 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:51:54.212+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:52:00.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:52:00.428+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:52:13.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:13.275 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:18.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-13T18:52:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.088+0000 7fe3ab400700 1 Processor -- start 2024-09-13T18:52:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.088+0000 7fe3ab400700 1 -- start start 2024-09-13T18:52:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3ab400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 0x7fe3a406be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3ab400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3a40b3990 0x7fe3a40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3ab400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a406d000 con 0x7fe3a40cf0b0 2024-09-13T18:52:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3ab400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a40cf540 con 0x7fe3a40b3990 2024-09-13T18:52:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3ab400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a406c3f0 con 0x7fe3a4160fc0 2024-09-13T18:52:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 0x7fe3a406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3a40b3990 0x7fe3a40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 0x7fe3a406be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48464/0 (socket says 172.21.15.81:48464) 2024-09-13T18:52:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 -- 172.21.15.81:0/3410370468 learned_addr learned my addr 172.21.15.81:0/3410370468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a9400700 1 --1- 172.21.15.81:0/3410370468 >> v1:172.21.15.178:6789/0 conn(0x7fe3a40cf0b0 0x7fe3a406fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:46870/0 (socket says 172.21.15.81:46870) 2024-09-13T18:52:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 -- 172.21.15.81:0/3410370468 >> v2:172.21.15.178:3300/0 conn(0x7fe3a40b3990 msgr2=0x7fe3a40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/3410370468 >> v2:172.21.15.178:3300/0 conn(0x7fe3a40b3990 0x7fe3a40ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 -- 172.21.15.81:0/3410370468 >> v1:172.21.15.178:6789/0 conn(0x7fe3a40cf0b0 legacy=0x7fe3a406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 -- 172.21.15.81:0/3410370468 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a406c6d0 con 0x7fe3a4160fc0 2024-09-13T18:52:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.092+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/3410370468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 0x7fe3a406be10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe398009910 tx=0x7fe398009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a8b2bcb23a59145 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3a3400700 1 -- 172.21.15.81:0/3410370468 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011830 con 0x7fe3a4160fc0 2024-09-13T18:52:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3a3400700 1 -- 172.21.15.81:0/3410370468 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398011990 con 0x7fe3a4160fc0 2024-09-13T18:52:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3a3400700 1 -- 172.21.15.81:0/3410370468 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398011d40 con 0x7fe3a4160fc0 2024-09-13T18:52:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 -- 172.21.15.81:0/3410370468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 msgr2=0x7fe3a406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 --2- 172.21.15.81:0/3410370468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 0x7fe3a406be10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe398009910 tx=0x7fe398009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 -- 172.21.15.81:0/3410370468 shutdown_connections 2024-09-13T18:52:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 --2- 172.21.15.81:0/3410370468 >> v2:172.21.15.178:3300/0 conn(0x7fe3a40b3990 0x7fe3a40ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 --2- 172.21.15.81:0/3410370468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a4160fc0 0x7fe3a406be10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 -- 172.21.15.81:0/3410370468 >> 172.21.15.81:0/3410370468 conn(0x7fe3a406a570 msgr2=0x7fe3a406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 -- 172.21.15.81:0/3410370468 shutdown_connections 2024-09-13T18:52:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.096+0000 7fe3ab400700 1 -- 172.21.15.81:0/3410370468 wait complete. 2024-09-13T18:52:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 Processor -- start 2024-09-13T18:52:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 -- start start 2024-09-13T18:52:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 0x7fe3a4151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a40cf0b0 0x7fe3a41575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a4160fc0 0x7fe3a4161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a4151da0 con 0x7fe3a40b3990 2024-09-13T18:52:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a41562d0 con 0x7fe3a4160fc0 2024-09-13T18:52:19.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3ab400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a4157110 con 0x7fe3a40cf0b0 2024-09-13T18:52:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 0x7fe3a4151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 0x7fe3a4151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35330/0 (socket says 172.21.15.81:35330) 2024-09-13T18:52:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3a8a00700 1 -- 172.21.15.81:0/547919655 learned_addr learned my addr 172.21.15.81:0/547919655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a40cf0b0 0x7fe3a41575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.100+0000 7fe3a9400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a4160fc0 0x7fe3a4161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a8a00700 1 -- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a40cf0b0 msgr2=0x7fe3a41575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a40cf0b0 0x7fe3a41575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a8a00700 1 -- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a4160fc0 msgr2=0x7fe3a4161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a4160fc0 0x7fe3a4161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a8a00700 1 -- 172.21.15.81:0/547919655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398009570 con 0x7fe3a40b3990 2024-09-13T18:52:19.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a40cf0b0 0x7fe3a41575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 0x7fe3a4151860 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe398004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a0c00700 1 -- 172.21.15.81:0/547919655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398004510 con 0x7fe3a40b3990 2024-09-13T18:52:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a0c00700 1 -- 172.21.15.81:0/547919655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3980036c0 con 0x7fe3a40b3990 2024-09-13T18:52:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3a0c00700 1 -- 172.21.15.81:0/547919655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398003a70 con 0x7fe3a40b3990 2024-09-13T18:52:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a4156500 con 0x7fe3a40b3990 2024-09-13T18:52:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.104+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a4156ac0 con 0x7fe3a40b3990 2024-09-13T18:52:19.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.108+0000 7fe3a0c00700 1 -- 172.21.15.81:0/547919655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe398003bd0 con 0x7fe3a40b3990 2024-09-13T18:52:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.108+0000 7fe3a0c00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe384066730 0x7fe384068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.108+0000 7fe3a0c00700 1 -- 172.21.15.81:0/547919655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fe398021030 con 0x7fe3a40b3990 2024-09-13T18:52:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.108+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe384066730 0x7fe384068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.108+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe384066730 0x7fe384068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe3a41fa390 tx=0x7fe390009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 Processor -- start 2024-09-13T18:52:19.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 -- start start 2024-09-13T18:52:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11e8f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11eb0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb1270 0x11e645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x11df8010 con 0x11eb0950 2024-09-13T18:52:19.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d85f40 con 0x11eb1270 2024-09-13T18:52:19.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11dd8e30 con 0x11e8ed00 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11e8f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11e8f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35344/0 (socket says 172.21.15.81:35344) 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 -- 172.21.15.81:0/252537158 learned_addr learned my addr 172.21.15.81:0/252537158 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11eb0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 -- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 msgr2=0x11eb0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a9400700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb1270 0x11e645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11eb0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 -- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb1270 msgr2=0x11e645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb1270 0x11e645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 -- 172.21.15.81:0/252537158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11c44a40 con 0x11eb0950 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11eb0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a9400700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb1270 0x11e645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.112+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11e8f240 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe398083b60 tx=0x7fe3980092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa308b7b896b3ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe395200700 1 -- 172.21.15.81:0/252537158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39806e170 con 0x11eb0950 2024-09-13T18:52:19.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe395200700 1 -- 172.21.15.81:0/252537158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398056e20 con 0x11eb0950 2024-09-13T18:52:19.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe395200700 1 -- 172.21.15.81:0/252537158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398056720 con 0x11eb0950 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- 172.21.15.81:0/252537158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 msgr2=0x11e8f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11e8f240 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe398083b60 tx=0x7fe3980092e0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- 172.21.15.81:0/252537158 shutdown_connections 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb1270 0x11e645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11eb0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- 172.21.15.81:0/252537158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11e8f240 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- 172.21.15.81:0/252537158 >> 172.21.15.81:0/252537158 conn(0x11bf95b0 msgr2=0x11e6a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- 172.21.15.81:0/252537158 shutdown_connections 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- 172.21.15.81:0/252537158 wait complete. 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- start start 2024-09-13T18:52:19.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 Processor -- start 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11e8a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb0950 0x11eac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11e897f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dd4150 con 0x11eb1270 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dd1eb0 con 0x11e8ed00 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11d8f8e0 con 0x11eb0950 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3ae713740 10 client.0 _ll_register_callbacks cb 0x11d6e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3a9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11e897f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3a3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb0950 0x11eac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11e8a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3a9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11e897f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35356/0 (socket says 172.21.15.81:35356) 2024-09-13T18:52:19.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.116+0000 7fe3a9400700 1 -- 172.21.15.81:0/4039852027 learned_addr learned my addr 172.21.15.81:0/4039852027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a8a00700 1 -- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb0950 msgr2=0x11eac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb0950 0x11eac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a8a00700 1 -- 172.21.15.81:0/4039852027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 msgr2=0x11e897f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11e897f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a8a00700 1 -- 172.21.15.81:0/4039852027 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a4156ac0 con 0x11e8ed00 2024-09-13T18:52:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11e8a5c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe398052c20 tx=0x7fe398011e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28f84a49e5ca04b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe389600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe389600700 1 -- 172.21.15.81:0/4039852027 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39806e170 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe389600700 1 -- 172.21.15.81:0/4039852027 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fe39805a550 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11c062c0 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe389600700 1 -- 172.21.15.81:0/4039852027 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe398003e80 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 10 client.6916 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x11d98290 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe389600700 1 -- 172.21.15.81:0/4039852027 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11c062c0 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe389600700 1 -- 172.21.15.81:0/4039852027 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe39805e680 con 0x11e8ed00 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 10 client.6916 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 10 client.6916 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 20 client.6916 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11e8b690 0x11e680c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 4 client.6916 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11c50540 con 0x11e8b690 2024-09-13T18:52:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.120+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11e8b690 0x11e680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11e8b690 0x11e680c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e743c8948943d23 server_cookie=7a2f170c6a69d4b0 in_seq=0 out_seq=0 2024-09-13T18:52:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe389600700 10 client.6916 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe389600700 1 -- 172.21.15.81:0/4039852027 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x11c50540 con 0x11e8b690 2024-09-13T18:52:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe389600700 10 client.6916 handle_command_reply: tid=0 2024-09-13T18:52:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 client.6916 shutdown 2024-09-13T18:52:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 msgr2=0x11e8a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11e8a5c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe398052c20 tx=0x7fe398011e30 comp rx=0 tx=0).stop 2024-09-13T18:52:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 shutdown_connections 2024-09-13T18:52:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11e8b690 0x11e680c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11e897f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb0950 0x11eac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 --2- 172.21.15.81:0/4039852027 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11e8a5c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 >> 172.21.15.81:0/4039852027 conn(0x11bf95b0 msgr2=0x11e65dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe389600700 0 client.6916 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 shutdown_connections 2024-09-13T18:52:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 1 -- 172.21.15.81:0/4039852027 wait complete. 2024-09-13T18:52:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.124+0000 7fe3ae713740 20 client.6916 trim_cache size 0 max 16384 2024-09-13T18:52:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.144+0000 7fe3ae713740 1 Processor -- start 2024-09-13T18:52:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.144+0000 7fe3ae713740 1 -- start start 2024-09-13T18:52:19.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11eabd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11ec4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb1270 0x11ec4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x11c7db80 con 0x11eb0950 2024-09-13T18:52:19.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d5ba50 con 0x11e8ed00 2024-09-13T18:52:19.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11e89130 con 0x11eb1270 2024-09-13T18:52:19.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11ec4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11eabd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a9400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb1270 0x11ec4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11ec4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35370/0 (socket says 172.21.15.81:35370) 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 -- 172.21.15.81:0/3455287126 learned_addr learned my addr 172.21.15.81:0/3455287126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 -- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb1270 msgr2=0x11ec4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb1270 0x11ec4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 -- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 msgr2=0x11eabd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11eabd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 -- 172.21.15.81:0/3455287126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11d7e4c0 con 0x11eb0950 2024-09-13T18:52:19.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11eabd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11ec4a20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40cb240 tx=0x7fe390019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9043de89ee81516a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe395c00700 1 -- 172.21.15.81:0/3455287126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390028040 con 0x11eb0950 2024-09-13T18:52:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe395c00700 1 -- 172.21.15.81:0/3455287126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390014d20 con 0x11eb0950 2024-09-13T18:52:19.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe395c00700 1 -- 172.21.15.81:0/3455287126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39002ad90 con 0x11eb0950 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- 172.21.15.81:0/3455287126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 msgr2=0x11ec4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11ec4a20 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40cb240 tx=0x7fe390019000 comp rx=0 tx=0).stop 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- 172.21.15.81:0/3455287126 shutdown_connections 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11eb1270 0x11ec4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb0950 0x11ec4a20 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 --2- 172.21.15.81:0/3455287126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11e8ed00 0x11eabd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- 172.21.15.81:0/3455287126 >> 172.21.15.81:0/3455287126 conn(0x11bf95b0 msgr2=0x11eaf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- 172.21.15.81:0/3455287126 shutdown_connections 2024-09-13T18:52:19.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.148+0000 7fe3ae713740 1 -- 172.21.15.81:0/3455287126 wait complete. 2024-09-13T18:52:19.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 -- start start 2024-09-13T18:52:19.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 Processor -- start 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11ec7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb0950 0x11ec8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11eceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dcf6c0 con 0x11eb1270 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x11da2c00 con 0x11eb0950 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11eb0f50 con 0x11e8ed00 2024-09-13T18:52:19.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.152+0000 7fe3ae713740 10 client.0 _ll_register_callbacks cb 0x11da18f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11eceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11ec7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a8a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11ec7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48488/0 (socket says 172.21.15.81:48488) 2024-09-13T18:52:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a8a00700 1 -- 172.21.15.81:0/2303686879 learned_addr learned my addr 172.21.15.81:0/2303686879 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11eceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35384/0 (socket says 172.21.15.81:35384) 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb0950 0x11ec8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 -- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 msgr2=0x11ec7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11ec7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 -- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb0950 msgr2=0x11ec8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb0950 0x11ec8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 -- 172.21.15.81:0/2303686879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x11d98290 con 0x11eb1270 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11ec7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a3e00700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb0950 0x11ec8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a9400700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11eceb00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe39c007870 tx=0x7fe39c007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745fdc29b160e1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe389600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe389600700 1 -- 172.21.15.81:0/2303686879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c016aa0 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe389600700 1 -- 172.21.15.81:0/2303686879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fe39c016c00 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe398056e20 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe389600700 1 -- 172.21.15.81:0/2303686879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe39c016dc0 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 10 client.7212 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x11d72790 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe389600700 1 -- 172.21.15.81:0/2303686879 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398056e20 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe389600700 1 -- 172.21.15.81:0/2303686879 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe39c017430 con 0x11eb1270 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 10 client.7212 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 10 client.7212 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 20 client.7212 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11ecf040 0x11ecf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 4 client.7212 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:52:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x11c752c0 con 0x11ecf040 2024-09-13T18:52:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.156+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11ecf040 0x11ecf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3a8a00700 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11ecf040 0x11ecf450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1a4df0417ca3627 server_cookie=dc5ce809bd9ba36b in_seq=0 out_seq=0 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe389600700 10 client.7212 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe389600700 1 -- 172.21.15.81:0/2303686879 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x11c752c0 con 0x11ecf040 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe389600700 10 client.7212 handle_command_reply: tid=0 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 client.7212 shutdown 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 msgr2=0x11eceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11eceb00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe39c007870 tx=0x7fe39c007b80 comp rx=0 tx=0).stop 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 shutdown_connections 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x11ecf040 0x11ecf450 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x11eb1270 0x11eceb00 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11eb0950 0x11ec8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe389600700 0 client.7212 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 --2- 172.21.15.81:0/2303686879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11e8ed00 0x11ec7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 >> 172.21.15.81:0/2303686879 conn(0x11bf95b0 msgr2=0x11ec4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 shutdown_connections 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 1 -- 172.21.15.81:0/2303686879 wait complete. 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ae713740 20 client.7212 trim_cache size 0 max 16384 2024-09-13T18:52:19.169 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:52:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-09-13T18:52:19.170 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-09-13T18:52:19.170 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:52:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe384066730 msgr2=0x7fe384068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe384066730 0x7fe384068bf0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe3a41fa390 tx=0x7fe390009240 comp rx=0 tx=0).stop 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 msgr2=0x7fe3a4151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 0x7fe3a4151860 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe398004770 comp rx=0 tx=0).stop 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 shutdown_connections 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe384066730 0x7fe384068bf0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a4160fc0 0x7fe3a4161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a40cf0b0 0x7fe3a41575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 --2- 172.21.15.81:0/547919655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a40b3990 0x7fe3a4151860 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 >> 172.21.15.81:0/547919655 conn(0x7fe3a406a570 msgr2=0x7fe3a415ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 shutdown_connections 2024-09-13T18:52:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.160+0000 7fe3ab400700 1 -- 172.21.15.81:0/547919655 wait complete. 2024-09-13T18:52:19.190 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:52:19.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2024-09-13T18:52:19.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.356+0000 7f62d2000700 1 Processor -- start 2024-09-13T18:52:19.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.356+0000 7f62d2000700 1 -- start start 2024-09-13T18:52:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f62cc1465c0 0x7f62cc06a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f62cc15e1e0 0x7f62cc06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc1469a0 con 0x7f62cc06a8d0 2024-09-13T18:52:19.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc06b250 con 0x7f62cc1465c0 2024-09-13T18:52:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc15e5f0 con 0x7f62cc15e1e0 2024-09-13T18:52:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cbe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f62cc06a8d0 0x7f62cc06e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40642/0 (socket says 172.21.15.81:40642) 2024-09-13T18:52:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cbe00700 1 -- 172.21.15.81:0/365073007 learned_addr learned my addr 172.21.15.81:0/365073007 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d0c00700 1 --2- 172.21.15.81:0/365073007 >> v2:172.21.15.81:3300/0 conn(0x7f62cc1465c0 0x7f62cc06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d1600700 1 --2- 172.21.15.81:0/365073007 >> v2:172.21.15.178:3300/0 conn(0x7f62cc15e1e0 0x7f62cc06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cb400700 1 -- 172.21.15.81:0/365073007 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575484381 0 0) 0x7f62cc1469a0 con 0x7f62cc06a8d0 2024-09-13T18:52:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cb400700 1 -- 172.21.15.81:0/365073007 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b40035d0 con 0x7f62cc06a8d0 2024-09-13T18:52:19.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d0c00700 1 -- 172.21.15.81:0/365073007 >> v2:172.21.15.178:3300/0 conn(0x7f62cc15e1e0 msgr2=0x7f62cc06ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d0c00700 1 --2- 172.21.15.81:0/365073007 >> v2:172.21.15.178:3300/0 conn(0x7f62cc15e1e0 0x7f62cc06ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d0c00700 1 -- 172.21.15.81:0/365073007 >> v1:172.21.15.81:6789/0 conn(0x7f62cc06a8d0 legacy=0x7f62cc06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d0c00700 1 -- 172.21.15.81:0/365073007 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc06bd70 con 0x7f62cc1465c0 2024-09-13T18:52:19.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d0c00700 1 --2- 172.21.15.81:0/365073007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc1465c0 0x7f62cc06a390 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f62cc1606d0 tx=0x7f62c0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c895fa88bd4d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cb400700 1 -- 172.21.15.81:0/365073007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0011830 con 0x7f62cc1465c0 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cb400700 1 -- 172.21.15.81:0/365073007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c0011990 con 0x7f62cc1465c0 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62cb400700 1 -- 172.21.15.81:0/365073007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0011d00 con 0x7f62cc1465c0 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 -- 172.21.15.81:0/365073007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc1465c0 msgr2=0x7f62cc06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 --2- 172.21.15.81:0/365073007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc1465c0 0x7f62cc06a390 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f62cc1606d0 tx=0x7f62c0009b30 comp rx=0 tx=0).stop 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 -- 172.21.15.81:0/365073007 shutdown_connections 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 --2- 172.21.15.81:0/365073007 >> v2:172.21.15.178:3300/0 conn(0x7f62cc15e1e0 0x7f62cc06ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 --2- 172.21.15.81:0/365073007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc1465c0 0x7f62cc06a390 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.360+0000 7f62d2000700 1 -- 172.21.15.81:0/365073007 >> 172.21.15.81:0/365073007 conn(0x7f62cc0b2690 msgr2=0x7f62cc0b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.364+0000 7f62d2000700 1 -- 172.21.15.81:0/365073007 shutdown_connections 2024-09-13T18:52:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.364+0000 7f62d2000700 1 -- 172.21.15.81:0/365073007 wait complete. 2024-09-13T18:52:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.364+0000 7f62d2000700 1 Processor -- start 2024-09-13T18:52:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.364+0000 7f62d2000700 1 -- start start 2024-09-13T18:52:19.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.364+0000 7f62d2000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 0x7f62cc141a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc1465c0 0x7f62cc1402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc15e1e0 0x7f62cc13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc153680 con 0x7f62cc06a8d0 2024-09-13T18:52:19.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc1409a0 con 0x7f62cc1465c0 2024-09-13T18:52:19.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc140c80 con 0x7f62cc15e1e0 2024-09-13T18:52:19.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 0x7f62cc141a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 0x7f62cc141a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35398/0 (socket says 172.21.15.81:35398) 2024-09-13T18:52:19.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 -- 172.21.15.81:0/3843367307 learned_addr learned my addr 172.21.15.81:0/3843367307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc1465c0 0x7f62cc1402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d1600700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc15e1e0 0x7f62cc13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 -- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc15e1e0 msgr2=0x7f62cc13d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc15e1e0 0x7f62cc13d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 -- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc1465c0 msgr2=0x7f62cc1402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc1465c0 0x7f62cc1402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 -- 172.21.15.81:0/3843367307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00094b0 con 0x7f62cc06a8d0 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d1600700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc15e1e0 0x7f62cc13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 0x7f62cc141a40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009b70 tx=0x7f62c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62c8c00700 1 -- 172.21.15.81:0/3843367307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00045d0 con 0x7f62cc06a8d0 2024-09-13T18:52:19.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62c8c00700 1 -- 172.21.15.81:0/3843367307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c001f070 con 0x7f62cc06a8d0 2024-09-13T18:52:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc140f60 con 0x7f62cc06a8d0 2024-09-13T18:52:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62c8c00700 1 -- 172.21.15.81:0/3843367307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00038c0 con 0x7f62cc06a8d0 2024-09-13T18:52:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.368+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc141520 con 0x7f62cc06a8d0 2024-09-13T18:52:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.372+0000 7f62c8c00700 1 -- 172.21.15.81:0/3843367307 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62c0003a20 con 0x7f62cc06a8d0 2024-09-13T18:52:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.372+0000 7f62c8c00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62ac066730 0x7f62ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.372+0000 7f62c8c00700 1 -- 172.21.15.81:0/3843367307 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f62c0021070 con 0x7f62cc06a8d0 2024-09-13T18:52:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.372+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62ac066730 0x7f62ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.372+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62ac066730 0x7f62ac068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0cdfb0 tx=0x7f62b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 Processor -- start 2024-09-13T18:52:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 -- start start 2024-09-13T18:52:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9b9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 0x2b9e1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba03550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b94a010 con 0x2b9b8310 2024-09-13T18:52:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b8d7f40 con 0x2ba02d90 2024-09-13T18:52:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b92ae30 con 0x2ba03170 2024-09-13T18:52:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 0x2b9e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 0x2b9e1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35406/0 (socket says 172.21.15.81:35406) 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d0c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 -- 172.21.15.81:0/3901061205 learned_addr learned my addr 172.21.15.81:0/3901061205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d1600700 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba03550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 -- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 msgr2=0x2ba03550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba03550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 -- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 msgr2=0x2b9b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 -- 172.21.15.81:0/3901061205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b796a40 con 0x2b9b8310 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.376+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 0x2b9e1520 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f62b8001e70 tx=0x7f62b8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb0b6ecb8b18d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62bd200700 1 -- 172.21.15.81:0/3901061205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80073e0 con 0x2b9b8310 2024-09-13T18:52:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62bd200700 1 -- 172.21.15.81:0/3901061205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8007540 con 0x2b9b8310 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62bd200700 1 -- 172.21.15.81:0/3901061205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b800e620 con 0x2b9b8310 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3901061205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 msgr2=0x2b9e1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 0x2b9e1520 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f62b8001e70 tx=0x7f62b8011000 comp rx=0 tx=0).stop 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3901061205 shutdown_connections 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba03550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2b9b8310 0x2b9e1520 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3901061205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3901061205 >> 172.21.15.81:0/3901061205 conn(0x2b74b5b0 msgr2=0x2b9bcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3901061205 shutdown_connections 2024-09-13T18:52:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3901061205 wait complete. 2024-09-13T18:52:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 -- start start 2024-09-13T18:52:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.380+0000 7f62d6ab7740 1 Processor -- start 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b9b8310 0x2b9dfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2ba01570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba01ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b926150 con 0x2ba02d90 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b923eb0 con 0x2b9b8310 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b8e18e0 con 0x2ba03170 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 10 client.0 _ll_register_callbacks cb 0x2b8c0670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2ba01570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2ba01570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35408/0 (socket says 172.21.15.81:35408) 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 -- 172.21.15.81:0/3043697976 learned_addr learned my addr 172.21.15.81:0/3043697976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d1600700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba01ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b9b8310 0x2b9dfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 -- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 msgr2=0x2ba01ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba01ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 -- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b9b8310 msgr2=0x2b9dfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b9b8310 0x2b9dfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 -- 172.21.15.81:0/3043697976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc141520 con 0x2ba02d90 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d1600700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2ba01570 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x2b8f4fa0 tx=0x7f62b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7b7e67d96532a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62b1600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62b1600700 1 -- 172.21.15.81:0/3043697976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b8028040 con 0x2ba02d90 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62b1600700 1 -- 172.21.15.81:0/3043697976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f62b800e8b0 con 0x2ba02d90 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2b7582c0 con 0x2ba02d90 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62b1600700 1 -- 172.21.15.81:0/3043697976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62b800eab0 con 0x2ba02d90 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 10 client.7227 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x7f62b800f040 con 0x2ba02d90 2024-09-13T18:52:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62b1600700 1 -- 172.21.15.81:0/3043697976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2b7582c0 con 0x2ba02d90 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62b1600700 1 -- 172.21.15.81:0/3043697976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f62b800ec10 con 0x2ba02d90 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 10 client.7227 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 10 client.7227 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 20 client.7227 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2b9e3f00 0x2b9e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 4 client.7227 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.384+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2b7a2540 con 0x2b9e3f00 2024-09-13T18:52:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2b9e3f00 0x2b9e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2b9e3f00 0x2b9e1eb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736104517f42b2a7 server_cookie=1fe5ad28c0006b39 in_seq=0 out_seq=0 2024-09-13T18:52:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62b1600700 10 client.7227 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62b1600700 1 -- 172.21.15.81:0/3043697976 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2b7a2540 con 0x2b9e3f00 2024-09-13T18:52:19.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62b1600700 10 client.7227 handle_command_reply: tid=0 2024-09-13T18:52:19.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 client.7227 shutdown 2024-09-13T18:52:19.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 msgr2=0x2ba01570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2ba01570 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x2b8f4fa0 tx=0x7f62b8013000 comp rx=0 tx=0).stop 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 shutdown_connections 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2b9e3f00 0x2b9e1eb0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba03170 0x2ba01ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2ba01570 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3043697976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b9b8310 0x2b9dfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62b1600700 0 client.7227 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 >> 172.21.15.81:0/3043697976 conn(0x2b74b5b0 msgr2=0x2b9e14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 shutdown_connections 2024-09-13T18:52:19.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3043697976 wait complete. 2024-09-13T18:52:19.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.388+0000 7f62d6ab7740 20 client.7227 trim_cache size 0 max 16384 2024-09-13T18:52:19.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 Processor -- start 2024-09-13T18:52:19.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 -- start start 2024-09-13T18:52:19.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2b9e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2b9df350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba03170 0x2b9df890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b7cfb80 con 0x2ba02d90 2024-09-13T18:52:19.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b928f30 con 0x2ba03170 2024-09-13T18:52:19.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.408+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b8c8bd0 con 0x2b9b8310 2024-09-13T18:52:19.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62cbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2b9df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2b9e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba03170 0x2b9df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2b9e16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48534/0 (socket says 172.21.15.81:48534) 2024-09-13T18:52:19.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 -- 172.21.15.81:0/1568018164 learned_addr learned my addr 172.21.15.81:0/1568018164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 -- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba03170 msgr2=0x2b9df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba03170 0x2b9df890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 -- 172.21.15.81:0/1568018164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 msgr2=0x2b9df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2b9df350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 -- 172.21.15.81:0/1568018164 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b8ea290 con 0x2b9b8310 2024-09-13T18:52:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d1600700 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba03170 0x2b9df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d0c00700 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2b9e16a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62c00566e0 tx=0x7f62c0028040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64b6505167ce59f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62bdc00700 1 -- 172.21.15.81:0/1568018164 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00569e0 con 0x2b9b8310 2024-09-13T18:52:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62bdc00700 1 -- 172.21.15.81:0/1568018164 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c006e070 con 0x2b9b8310 2024-09-13T18:52:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62bdc00700 1 -- 172.21.15.81:0/1568018164 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c005a810 con 0x2b9b8310 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 -- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 msgr2=0x2b9e16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2b9e16a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f62c00566e0 tx=0x7f62c0028040 comp rx=0 tx=0).stop 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 -- 172.21.15.81:0/1568018164 shutdown_connections 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba03170 0x2b9df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba02d90 0x2b9df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/1568018164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2b9e16a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 -- 172.21.15.81:0/1568018164 >> 172.21.15.81:0/1568018164 conn(0x2b74b5b0 msgr2=0x2ba12f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 -- 172.21.15.81:0/1568018164 shutdown_connections 2024-09-13T18:52:19.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 -- 172.21.15.81:0/1568018164 wait complete. 2024-09-13T18:52:19.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.412+0000 7f62d6ab7740 1 -- start start 2024-09-13T18:52:19.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 Processor -- start 2024-09-13T18:52:19.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2ba1a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 0x2b9e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ba17f80 con 0x2ba03170 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ba18ea0 con 0x2ba02d90 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ba19100 con 0x2b9b8310 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d6ab7740 10 client.0 _ll_register_callbacks cb 0x2b922610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 0x2b9e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 0x2b9e2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35436/0 (socket says 172.21.15.81:35436) 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2ba1a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 -- 172.21.15.81:0/3758243463 learned_addr learned my addr 172.21.15.81:0/3758243463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62cbe00700 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 -- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 msgr2=0x2ba1a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2ba1a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 -- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 msgr2=0x2b9e28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9e28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.416+0000 7f62d1600700 1 -- 172.21.15.81:0/3758243463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4009e00 con 0x2ba03170 2024-09-13T18:52:19.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d1600700 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 0x2b9e2de0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f62c4015fa0 tx=0x7f62c40173b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a5b9b3bbf29617 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 1 -- 172.21.15.81:0/3758243463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4017d90 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 1 -- 172.21.15.81:0/3758243463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f62c401e070 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62b8007540 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 1 -- 172.21.15.81:0/3758243463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62c4023480 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 10 client.7233 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x7f62cc140f60 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 1 -- 172.21.15.81:0/3758243463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8007540 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 1 -- 172.21.15.81:0/3758243463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f62c40235e0 con 0x2ba03170 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 10 client.7233 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 10 client.7233 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 20 client.7233 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ba635a0 0x2ba16c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 4 client.7233 mds_command: new command op to 6822 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T18:52:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 --> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x2b7c72c0 con 0x2ba635a0 2024-09-13T18:52:19.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ba635a0 0x2ba16c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 10 client.7233 ms_handle_connect on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d0c00700 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ba635a0 0x2ba16c50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c6d655c32a05e0 server_cookie=cacc31769c595043 in_seq=0 out_seq=0 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 1 -- 172.21.15.81:0/3758243463 <== mds.0 v2:172.21.15.178:6834/3000844155 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+271 (crc 0 0 0) 0x2b7c72c0 con 0x2ba635a0 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62b1600700 10 client.7233 handle_command_reply: tid=0 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.420+0000 7f62d6ab7740 1 client.7233 shutdown 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 msgr2=0x2b9e2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 0x2b9e2de0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f62c4015fa0 tx=0x7f62c40173b0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 shutdown_connections 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:6834/3000844155,v1:172.21.15.178:6835/3000844155] conn(0x2ba635a0 0x2ba16c50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba03170 0x2b9e2de0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba02d90 0x2b9e28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 --2- 172.21.15.81:0/3758243463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b9b8310 0x2ba1a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62b1600700 0 client.7233 ms_handle_reset on v2:172.21.15.178:6834/3000844155 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 >> 172.21.15.81:0/3758243463 conn(0x2b74b5b0 msgr2=0x2ba00d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 shutdown_connections 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 1 -- 172.21.15.81:0/3758243463 wait complete. 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d6ab7740 20 client.7233 trim_cache size 0 max 16384 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:19.432 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 706503170, 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627779, 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3/d4" 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 3541452177, 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627778, 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3" 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:19.433 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:52:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62ac066730 msgr2=0x7f62ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62ac066730 0x7f62ac068bf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0cdfb0 tx=0x7f62b8009040 comp rx=0 tx=0).stop 2024-09-13T18:52:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 msgr2=0x7f62cc141a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 0x7f62cc141a40 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009b70 tx=0x7f62c0004770 comp rx=0 tx=0).stop 2024-09-13T18:52:19.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 shutdown_connections 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62ac066730 0x7f62ac068bf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62cc15e1e0 0x7f62cc13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62cc1465c0 0x7f62cc1402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 --2- 172.21.15.81:0/3843367307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62cc06a8d0 0x7f62cc141a40 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 >> 172.21.15.81:0/3843367307 conn(0x7f62cc0b2690 msgr2=0x7f62cc0cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 shutdown_connections 2024-09-13T18:52:19.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.424+0000 7f62d2000700 1 -- 172.21.15.81:0/3843367307 wait complete. 2024-09-13T18:52:19.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 damage ls 2024-09-13T18:52:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 Processor -- start 2024-09-13T18:52:19.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 -- start start 2024-09-13T18:52:19.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f43181464c0 0x7f4318071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f43180b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4318070da0 con 0x7f43180b1980 2024-09-13T18:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180b2440 con 0x7f43181464c0 2024-09-13T18:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f431ca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43180b2720 con 0x7f431806d070 2024-09-13T18:52:19.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f4315e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43180b1980 0x7f431806c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40658/0 (socket says 172.21.15.81:40658) 2024-09-13T18:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f4315e00700 1 -- 172.21.15.81:0/2259895481 learned_addr learned my addr 172.21.15.81:0/2259895481 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f4317200700 1 --2- 172.21.15.81:0/2259895481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f43180b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f4316800700 1 --2- 172.21.15.81:0/2259895481 >> v2:172.21.15.178:3300/0 conn(0x7f43181464c0 0x7f4318071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.632+0000 7f4315400700 1 -- 172.21.15.81:0/2259895481 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604884329 0 0) 0x7f4318070da0 con 0x7f43180b1980 2024-09-13T18:52:19.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4315400700 1 -- 172.21.15.81:0/2259895481 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42fc0035d0 con 0x7f43180b1980 2024-09-13T18:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4317200700 1 -- 172.21.15.81:0/2259895481 >> v2:172.21.15.178:3300/0 conn(0x7f43181464c0 msgr2=0x7f4318071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4317200700 1 --2- 172.21.15.81:0/2259895481 >> v2:172.21.15.178:3300/0 conn(0x7f43181464c0 0x7f4318071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4317200700 1 -- 172.21.15.81:0/2259895481 >> v1:172.21.15.81:6789/0 conn(0x7f43180b1980 legacy=0x7f431806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4317200700 1 -- 172.21.15.81:0/2259895481 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318071060 con 0x7f431806d070 2024-09-13T18:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4317200700 1 --2- 172.21.15.81:0/2259895481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f43180b1df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4310009d90 tx=0x7f431000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2833e1a32b764ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4315400700 1 -- 172.21.15.81:0/2259895481 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000e070 con 0x7f431806d070 2024-09-13T18:52:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4315400700 1 -- 172.21.15.81:0/2259895481 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000bb20 con 0x7f431806d070 2024-09-13T18:52:19.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f4315400700 1 -- 172.21.15.81:0/2259895481 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310012430 con 0x7f431806d070 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 -- 172.21.15.81:0/2259895481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 msgr2=0x7f43180b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 --2- 172.21.15.81:0/2259895481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f43180b1df0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4310009d90 tx=0x7f431000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 -- 172.21.15.81:0/2259895481 shutdown_connections 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 --2- 172.21.15.81:0/2259895481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f43180b1df0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 --2- 172.21.15.81:0/2259895481 >> v2:172.21.15.178:3300/0 conn(0x7f43181464c0 0x7f4318071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 -- 172.21.15.81:0/2259895481 >> 172.21.15.81:0/2259895481 conn(0x7f431806a390 msgr2=0x7f431806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 -- 172.21.15.81:0/2259895481 shutdown_connections 2024-09-13T18:52:19.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.636+0000 7f431ca00700 1 -- 172.21.15.81:0/2259895481 wait complete. 2024-09-13T18:52:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.640+0000 7f431ca00700 1 Processor -- start 2024-09-13T18:52:19.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.640+0000 7f431ca00700 1 -- start start 2024-09-13T18:52:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f4318143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43180b1980 0x7f43181f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 0x7f43181f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318143eb0 con 0x7f43181464c0 2024-09-13T18:52:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318144190 con 0x7f43180b1980 2024-09-13T18:52:19.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4318144470 con 0x7f431806d070 2024-09-13T18:52:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 0x7f43181f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4316800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f4318143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 0x7f43181f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35438/0 (socket says 172.21.15.81:35438) 2024-09-13T18:52:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 -- 172.21.15.81:0/2708206225 learned_addr learned my addr 172.21.15.81:0/2708206225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4315e00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43180b1980 0x7f43181f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 -- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 msgr2=0x7f4318143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f4318143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 -- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43180b1980 msgr2=0x7f43181f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43180b1980 0x7f43181f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 -- 172.21.15.81:0/2708206225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4310009a70 con 0x7f43181464c0 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4315e00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43180b1980 0x7f43181f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:19.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f4317200700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 0x7f43181f5b40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4310014040 tx=0x7f4310004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f430ea00700 1 -- 172.21.15.81:0/2708206225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310012430 con 0x7f43181464c0 2024-09-13T18:52:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f430ea00700 1 -- 172.21.15.81:0/2708206225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4310020070 con 0x7f43181464c0 2024-09-13T18:52:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4318144750 con 0x7f43181464c0 2024-09-13T18:52:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f430ea00700 1 -- 172.21.15.81:0/2708206225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310004280 con 0x7f43181464c0 2024-09-13T18:52:19.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.644+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4318143bc0 con 0x7f43181464c0 2024-09-13T18:52:19.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.648+0000 7f430ea00700 1 -- 172.21.15.81:0/2708206225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f43100043e0 con 0x7f43181464c0 2024-09-13T18:52:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.652+0000 7f430ea00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f42f8066730 0x7f42f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.652+0000 7f430ea00700 1 -- 172.21.15.81:0/2708206225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f4310022070 con 0x7f43181464c0 2024-09-13T18:52:19.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.652+0000 7f4316800700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f42f8066730 0x7f42f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.652+0000 7f4316800700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f42f8066730 0x7f42f8068bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4308009b50 tx=0x7f4308009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.652+0000 7f43206c5740 1 Processor -- start 2024-09-13T18:52:19.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.652+0000 7f43206c5740 1 -- start start 2024-09-13T18:52:19.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x296bd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x296e5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x29707550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2964e010 con 0x296bc310 2024-09-13T18:52:19.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x295dbf40 con 0x29707170 2024-09-13T18:52:19.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2962ee30 con 0x29706d90 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x296e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x296e5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35440/0 (socket says 172.21.15.81:35440) 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 -- 172.21.15.81:0/4139290839 learned_addr learned my addr 172.21.15.81:0/4139290839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4316800700 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x296bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4317200700 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x29707550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 -- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 msgr2=0x296bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x296bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 -- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 msgr2=0x29707550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x29707550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 -- 172.21.15.81:0/4139290839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2949aa40 con 0x296bc310 2024-09-13T18:52:19.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4315e00700 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x296e5520 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4304001670 tx=0x7f4304001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e242b5c60a509775 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4303000700 1 -- 172.21.15.81:0/4139290839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304005b70 con 0x296bc310 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4303000700 1 -- 172.21.15.81:0/4139290839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4304005cd0 con 0x296bc310 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f4303000700 1 -- 172.21.15.81:0/4139290839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43040072d0 con 0x296bc310 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- 172.21.15.81:0/4139290839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 msgr2=0x296e5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x296e5520 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f4304001670 tx=0x7f4304001980 comp rx=0 tx=0).stop 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- 172.21.15.81:0/4139290839 shutdown_connections 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x29707550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x296e5520 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 --2- 172.21.15.81:0/4139290839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x296bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- 172.21.15.81:0/4139290839 >> 172.21.15.81:0/4139290839 conn(0x2944f5b0 msgr2=0x296c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- 172.21.15.81:0/4139290839 shutdown_connections 2024-09-13T18:52:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.656+0000 7f43206c5740 1 -- 172.21.15.81:0/4139290839 wait complete. 2024-09-13T18:52:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 -- start start 2024-09-13T18:52:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 Processor -- start 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x296bc310 0x29707f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x296e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x296e3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2962a150 con 0x29706d90 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29627eb0 con 0x29707170 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x295e58e0 con 0x296bc310 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 10 client.0 _ll_register_callbacks cb 0x295c4670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x296e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x296e16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35454/0 (socket says 172.21.15.81:35454) 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 -- 172.21.15.81:0/599342316 learned_addr learned my addr 172.21.15.81:0/599342316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4316800700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x296bc310 0x29707f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4317200700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x296e3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 -- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x296bc310 msgr2=0x29707f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x296bc310 0x29707f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 -- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 msgr2=0x296e3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x296e3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 -- 172.21.15.81:0/599342316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430400f040 con 0x29706d90 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4316800700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x296bc310 0x29707f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f4315e00700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x296e16e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4304001d80 tx=0x7f4304000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93d0795e6895245 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f42f7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f42f7400700 1 -- 172.21.15.81:0/599342316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304005b70 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f42f7400700 1 -- 172.21.15.81:0/599342316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f4304005e40 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2945c2c0 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f42f7400700 1 -- 172.21.15.81:0/599342316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4304001350 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 10 client.7245 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.660+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x295ee290 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f42f7400700 1 -- 172.21.15.81:0/599342316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2945c2c0 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f42f7400700 1 -- 172.21.15.81:0/599342316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f4304014480 con 0x29706d90 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 10 client.7245 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 10 client.7245 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 20 client.7245 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x296e49f0 0x29719810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 4 client.7245 mds_command: new command op to 6816 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 --> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x294a6540 con 0x296e49f0 2024-09-13T18:52:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f4316800700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x296e49f0 0x29719810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f4316800700 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x296e49f0 0x29719810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d7b1e8386370cf server_cookie=547447b06a4d67bf in_seq=0 out_seq=0 2024-09-13T18:52:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f42f7400700 10 client.7245 ms_handle_connect on v2:172.21.15.81:6836/2228642132 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f42f7400700 1 -- 172.21.15.81:0/599342316 <== mds.1 v2:172.21.15.81:6836/2228642132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x294a6540 con 0x296e49f0 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f42f7400700 10 client.7245 handle_command_reply: tid=0 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 client.7245 shutdown 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 msgr2=0x296e16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x296e16e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4304001d80 tx=0x7f4304000ed0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 shutdown_connections 2024-09-13T18:52:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x296e49f0 0x29719810 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29707170 0x296e3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x296e16e0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f42f7400700 0 client.7245 ms_handle_reset on v2:172.21.15.81:6836/2228642132 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 --2- 172.21.15.81:0/599342316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x296bc310 0x29707f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.664+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 >> 172.21.15.81:0/599342316 conn(0x2944f5b0 msgr2=0x296e54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.668+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 shutdown_connections 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.668+0000 7f43206c5740 1 -- 172.21.15.81:0/599342316 wait complete. 2024-09-13T18:52:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.668+0000 7f43206c5740 20 client.7245 trim_cache size 0 max 16384 2024-09-13T18:52:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 Processor -- start 2024-09-13T18:52:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 -- start start 2024-09-13T18:52:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2944f5b0 0x297035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x29703ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x2970a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x294d3b80 con 0x296bc310 2024-09-13T18:52:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x296c0dd0 con 0x2944f5b0 2024-09-13T18:52:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x295e8a00 con 0x29706d90 2024-09-13T18:52:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f4315e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x29703ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f4315e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x29703ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35470/0 (socket says 172.21.15.81:35470) 2024-09-13T18:52:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f4315e00700 1 -- 172.21.15.81:0/2501015757 learned_addr learned my addr 172.21.15.81:0/2501015757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f4316800700 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2944f5b0 0x297035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.684+0000 7f4317200700 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x2970a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4315e00700 1 -- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 msgr2=0x2970a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4315e00700 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x2970a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4315e00700 1 -- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2944f5b0 msgr2=0x297035a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4315e00700 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2944f5b0 0x297035a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4315e00700 1 -- 172.21.15.81:0/2501015757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x295d44c0 con 0x296bc310 2024-09-13T18:52:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4316800700 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2944f5b0 0x297035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4315e00700 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x29703ae0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f43040015c0 tx=0x7f430401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdda0f8f7701bde9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4303a00700 1 -- 172.21.15.81:0/2501015757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304007820 con 0x296bc310 2024-09-13T18:52:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4303a00700 1 -- 172.21.15.81:0/2501015757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4304007460 con 0x296bc310 2024-09-13T18:52:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f4303a00700 1 -- 172.21.15.81:0/2501015757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4304014990 con 0x296bc310 2024-09-13T18:52:19.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 -- 172.21.15.81:0/2501015757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 msgr2=0x29703ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x29703ae0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f43040015c0 tx=0x7f430401d000 comp rx=0 tx=0).stop 2024-09-13T18:52:19.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 -- 172.21.15.81:0/2501015757 shutdown_connections 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29706d90 0x2970a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x296bc310 0x29703ae0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 --2- 172.21.15.81:0/2501015757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2944f5b0 0x297035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 -- 172.21.15.81:0/2501015757 >> 172.21.15.81:0/2501015757 conn(0x296c0f10 msgr2=0x296e0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 -- 172.21.15.81:0/2501015757 shutdown_connections 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 -- 172.21.15.81:0/2501015757 wait complete. 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 -- start start 2024-09-13T18:52:19.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.688+0000 7f43206c5740 1 Processor -- start 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2944f5b0 0x29767140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x296bc310 0x29767680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x297038d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29704da0 con 0x29706d90 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x297259f0 con 0x296bc310 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29708be0 con 0x2944f5b0 2024-09-13T18:52:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 10 client.0 _ll_register_callbacks cb 0x29626610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x297038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x297038d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35472/0 (socket says 172.21.15.81:35472) 2024-09-13T18:52:19.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 -- 172.21.15.81:0/3325936982 learned_addr learned my addr 172.21.15.81:0/3325936982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4315e00700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x296bc310 0x29767680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4316800700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2944f5b0 0x29767140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 -- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2944f5b0 msgr2=0x29767140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2944f5b0 0x29767140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 -- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x296bc310 msgr2=0x29767680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x296bc310 0x29767680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 -- 172.21.15.81:0/3325936982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4308004040 con 0x29706d90 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f4317200700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x297038d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4310056d20 tx=0x7f43100572d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7d6d04750ea6f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f42f7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f42f7400700 1 -- 172.21.15.81:0/3325936982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431006add0 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f42f7400700 1 -- 172.21.15.81:0/3325936982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f431007f070 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4304005cd0 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f42f7400700 1 -- 172.21.15.81:0/3325936982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4310057490 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 10 client.7251 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x295ee290 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f42f7400700 1 -- 172.21.15.81:0/3325936982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4304005cd0 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f42f7400700 1 -- 172.21.15.81:0/3325936982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f431005ecf0 con 0x29706d90 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 10 client.7251 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 10 client.7251 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.c 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 20 client.7251 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x29707170 0x29703e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 4 client.7251 mds_command: new command op to 6816 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.692+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 --> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x294cb2c0 con 0x29707170 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f4316800700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x29707170 0x29703e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f4316800700 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x29707170 0x29703e10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae7e5dfa9aa11a16 server_cookie=527615d0c34d9c99 in_seq=0 out_seq=0 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f42f7400700 10 client.7251 ms_handle_connect on v2:172.21.15.81:6836/2228642132 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f42f7400700 1 -- 172.21.15.81:0/3325936982 <== mds.1 v2:172.21.15.81:6836/2228642132 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x294cb2c0 con 0x29707170 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f42f7400700 10 client.7251 handle_command_reply: tid=0 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 client.7251 shutdown 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 msgr2=0x297038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x297038d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4310056d20 tx=0x7f43100572d0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 shutdown_connections 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:6836/2228642132,v1:172.21.15.81:6837/2228642132] conn(0x29707170 0x29703e10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29706d90 0x297038d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x296bc310 0x29767680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f42f7400700 0 client.7251 ms_handle_reset on v2:172.21.15.81:6836/2228642132 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 --2- 172.21.15.81:0/3325936982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2944f5b0 0x29767140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 >> 172.21.15.81:0/3325936982 conn(0x296c0f10 msgr2=0x29707550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 shutdown_connections 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 1 -- 172.21.15.81:0/3325936982 wait complete. 2024-09-13T18:52:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f43206c5740 20 client.7251 trim_cache size 0 max 16384 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 2171331842, 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627780, 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3/d4/d5" 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:19.707 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2024-09-13T18:52:19.708 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 3923318323, 2024-09-13T18:52:19.708 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627781, 2024-09-13T18:52:19.708 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3/d4/d5/d6" 2024-09-13T18:52:19.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:19.708 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f42f8066730 msgr2=0x7f42f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f42f8066730 0x7f42f8068bf0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4308009b50 tx=0x7f4308009240 comp rx=0 tx=0).stop 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 msgr2=0x7f43181f5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 0x7f43181f5b40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f4310014040 tx=0x7f4310004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 shutdown_connections 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f42f8066730 0x7f42f8068bf0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43181464c0 0x7f43181f5b40 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43180b1980 0x7f43181f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 --2- 172.21.15.81:0/2708206225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f431806d070 0x7f4318143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 >> 172.21.15.81:0/2708206225 conn(0x7f431806a390 msgr2=0x7f431806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 shutdown_connections 2024-09-13T18:52:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.696+0000 7f431ca00700 1 -- 172.21.15.81:0/2708206225 wait complete. 2024-09-13T18:52:19.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 damage ls 2024-09-13T18:52:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.900+0000 7f772b200700 1 Processor -- start 2024-09-13T18:52:19.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.900+0000 7f772b200700 1 -- start start 2024-09-13T18:52:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7724143b70 0x7f77240cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f772406d070 0x7f77240b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77240b1980 con 0x7f772406d620 2024-09-13T18:52:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240b2500 con 0x7f772406d070 2024-09-13T18:52:19.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77240b1bd0 con 0x7f7724143b70 2024-09-13T18:52:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f7729400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f772406d620 0x7f772406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40670/0 (socket says 172.21.15.81:40670) 2024-09-13T18:52:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f772406d070 0x7f77240b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f7729400700 1 -- 172.21.15.81:0/137095052 learned_addr learned my addr 172.21.15.81:0/137095052 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:19.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f7729e00700 1 --2- 172.21.15.81:0/137095052 >> v2:172.21.15.178:3300/0 conn(0x7f7724143b70 0x7f77240cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f7728a00700 1 -- 172.21.15.81:0/137095052 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412393929 0 0) 0x7f77240b1980 con 0x7f772406d620 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f7728a00700 1 -- 172.21.15.81:0/137095052 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f770c0035d0 con 0x7f772406d620 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f7728a00700 1 -- 172.21.15.81:0/137095052 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390534795 0 0) 0x7f770c0035d0 con 0x7f772406d620 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772a800700 1 -- 172.21.15.81:0/137095052 >> v2:172.21.15.178:3300/0 conn(0x7f7724143b70 msgr2=0x7f77240cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772a800700 1 --2- 172.21.15.81:0/137095052 >> v2:172.21.15.178:3300/0 conn(0x7f7724143b70 0x7f77240cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772a800700 1 -- 172.21.15.81:0/137095052 >> v1:172.21.15.81:6789/0 conn(0x7f772406d620 legacy=0x7f772406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.904+0000 7f772a800700 1 -- 172.21.15.81:0/137095052 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240b1eb0 con 0x7f772406d070 2024-09-13T18:52:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772a800700 1 --2- 172.21.15.81:0/137095052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77240b2990 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f77240725d0 tx=0x7f772000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccfc7a4e739e65f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f7728a00700 1 -- 172.21.15.81:0/137095052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000e070 con 0x7f772406d070 2024-09-13T18:52:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f7728a00700 1 -- 172.21.15.81:0/137095052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720003a40 con 0x7f772406d070 2024-09-13T18:52:19.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f7728a00700 1 -- 172.21.15.81:0/137095052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7714001670 con 0x7f772406d070 2024-09-13T18:52:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 -- 172.21.15.81:0/137095052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 msgr2=0x7f77240b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 --2- 172.21.15.81:0/137095052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77240b2990 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f77240725d0 tx=0x7f772000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 -- 172.21.15.81:0/137095052 shutdown_connections 2024-09-13T18:52:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 --2- 172.21.15.81:0/137095052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77240b2990 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 --2- 172.21.15.81:0/137095052 >> v2:172.21.15.178:3300/0 conn(0x7f7724143b70 0x7f77240cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 -- 172.21.15.81:0/137095052 >> 172.21.15.81:0/137095052 conn(0x7f772406a390 msgr2=0x7f772406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 -- 172.21.15.81:0/137095052 shutdown_connections 2024-09-13T18:52:19.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.908+0000 7f772b200700 1 -- 172.21.15.81:0/137095052 wait complete. 2024-09-13T18:52:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 Processor -- start 2024-09-13T18:52:19.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 -- start start 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77241381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f772406d620 0x7f772415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7724143b70 0x7f7724142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241f68e0 con 0x7f772406d070 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241f5a10 con 0x7f7724143b70 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f772b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77241f5c60 con 0x7f772406d620 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f7729e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77241381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f7729e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77241381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35502/0 (socket says 172.21.15.81:35502) 2024-09-13T18:52:19.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.912+0000 7f7729e00700 1 -- 172.21.15.81:0/2919139643 learned_addr learned my addr 172.21.15.81:0/2919139643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729400700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f772406d620 0x7f772415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f772a800700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7724143b70 0x7f7724142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729e00700 1 -- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f772406d620 msgr2=0x7f772415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729e00700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f772406d620 0x7f772415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729e00700 1 -- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7724143b70 msgr2=0x7f7724142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729e00700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7724143b70 0x7f7724142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729e00700 1 -- 172.21.15.81:0/2919139643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7720009a70 con 0x7f772406d070 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729400700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f772406d620 0x7f772415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f772a800700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7724143b70 0x7f7724142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f7729e00700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77241381d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f771800e840 tx=0x7f771800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f771e000700 1 -- 172.21.15.81:0/2919139643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180095a0 con 0x7f772406d070 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f771e000700 1 -- 172.21.15.81:0/2919139643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771800c690 con 0x7f772406d070 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f771e000700 1 -- 172.21.15.81:0/2919139643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800ca00 con 0x7f772406d070 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77241f5f40 con 0x7f772406d070 2024-09-13T18:52:19.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.916+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77241f6500 con 0x7f772406d070 2024-09-13T18:52:19.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.920+0000 7f771e000700 1 -- 172.21.15.81:0/2919139643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f771800cb60 con 0x7f772406d070 2024-09-13T18:52:19.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.920+0000 7f771e000700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7708066730 0x7f7708068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.920+0000 7f772fbd6740 1 Processor -- start 2024-09-13T18:52:19.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.920+0000 7f771e000700 1 -- 172.21.15.81:0/2919139643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f7718084350 con 0x7f772406d070 2024-09-13T18:52:19.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.920+0000 7f772fbd6740 1 -- start start 2024-09-13T18:52:19.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.920+0000 7f7729400700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7708066730 0x7f7708068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 0xf084810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0ac520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf015010 con 0xf0cdd90 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xefa2f40 con 0xf0ce170 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xeff5e30 con 0xf083310 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 0xf084810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 0xf084810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35508/0 (socket says 172.21.15.81:35508) 2024-09-13T18:52:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 -- 172.21.15.81:0/954457496 learned_addr learned my addr 172.21.15.81:0/954457496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729400700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7708066730 0x7f7708068bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f772413e710 tx=0x7f7714009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772a800700 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729400700 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 -- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 msgr2=0xf0ac520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0ac520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 -- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 msgr2=0xf0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 -- 172.21.15.81:0/954457496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xee61a40 con 0xf0cdd90 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7729e00700 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 0xf084810 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7718051610 tx=0x7f7718055110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a7eccae6b6aa85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7712600700 1 -- 172.21.15.81:0/954457496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771805d500 con 0xf0cdd90 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7712600700 1 -- 172.21.15.81:0/954457496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771800ce10 con 0xf0cdd90 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f7712600700 1 -- 172.21.15.81:0/954457496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77180534b0 con 0xf0cdd90 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- 172.21.15.81:0/954457496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 msgr2=0xf084810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 0xf084810 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7718051610 tx=0x7f7718055110 comp rx=0 tx=0).stop 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- 172.21.15.81:0/954457496 shutdown_connections 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0ac520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 --2- 172.21.15.81:0/954457496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0cdd90 0xf084810 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- 172.21.15.81:0/954457496 >> 172.21.15.81:0/954457496 conn(0xee165b0 msgr2=0xf087b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- 172.21.15.81:0/954457496 shutdown_connections 2024-09-13T18:52:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.924+0000 7f772fbd6740 1 -- 172.21.15.81:0/954457496 wait complete. 2024-09-13T18:52:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 -- start start 2024-09-13T18:52:19.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 Processor -- start 2024-09-13T18:52:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0cdd90 0xf0a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf0cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xeff1150 con 0xf0ce170 2024-09-13T18:52:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xefeeeb0 con 0xf0cdd90 2024-09-13T18:52:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xefac8e0 con 0xf083310 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 10 client.0 _ll_register_callbacks cb 0xef8b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf0cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf0cc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35518/0 (socket says 172.21.15.81:35518) 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 -- 172.21.15.81:0/1116108837 learned_addr learned my addr 172.21.15.81:0/1116108837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f7729400700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0cdd90 0xf0a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f7729e00700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 -- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 msgr2=0xf0aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 -- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0cdd90 msgr2=0xf0a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0cdd90 0xf0a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 -- 172.21.15.81:0/1116108837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77241f6500 con 0xf0ce170 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772a800700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf0cc0a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f77240742f0 tx=0x7f7720004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe9dd7725f203af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f7706a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f7706a00700 1 -- 172.21.15.81:0/1116108837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720004230 con 0xf0ce170 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f7706a00700 1 -- 172.21.15.81:0/1116108837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f7720004390 con 0xf0ce170 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.928+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xee232c0 con 0xf0ce170 2024-09-13T18:52:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 1 -- 172.21.15.81:0/1116108837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7720004550 con 0xf0ce170 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 10 client.7266 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0xefb5290 con 0xf0ce170 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 1 -- 172.21.15.81:0/1116108837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xee232c0 con 0xf0ce170 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 1 -- 172.21.15.81:0/1116108837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f772000b050 con 0xf0ce170 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 10 client.7266 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 10 client.7266 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 20 client.7266 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0a7cb0 0xf0a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 4 client.7266 mds_command: new command op to 6559 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 --> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xee6d540 con 0xf0a7cb0 2024-09-13T18:52:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7729e00700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0a7cb0 0xf0a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 10 client.7266 ms_handle_connect on v2:172.21.15.81:6834/3088682584 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7729e00700 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0a7cb0 0xf0a5d90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa848809bbf043ff server_cookie=643b62635c84c8ac in_seq=0 out_seq=0 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 1 -- 172.21.15.81:0/1116108837 <== mds.2 v2:172.21.15.81:6834/3088682584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xee6d540 con 0xf0a7cb0 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 10 client.7266 handle_command_reply: tid=0 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 client.7266 shutdown 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 msgr2=0xf0cc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf0cc0a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f77240742f0 tx=0x7f7720004b60 comp rx=0 tx=0).stop 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 shutdown_connections 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0a7cb0 0xf0a5d90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf0cc0a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0cdd90 0xf0a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f7706a00700 0 client.7266 ms_handle_reset on v2:172.21.15.81:6834/3088682584 2024-09-13T18:52:19.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1116108837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf083310 0xf0aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 >> 172.21.15.81:0/1116108837 conn(0xee165b0 msgr2=0xf0ac4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 shutdown_connections 2024-09-13T18:52:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 1 -- 172.21.15.81:0/1116108837 wait complete. 2024-09-13T18:52:19.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.932+0000 7f772fbd6740 20 client.7266 trim_cache size 0 max 16384 2024-09-13T18:52:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 Processor -- start 2024-09-13T18:52:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 -- start start 2024-09-13T18:52:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf083310 0xf129a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf129f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf089b30 con 0xf083310 2024-09-13T18:52:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xee9ab80 con 0xf0ce170 2024-09-13T18:52:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xefbfc00 con 0xf0cdd90 2024-09-13T18:52:19.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f7729e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf083310 0xf129a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f7729400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf129f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f7729e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf083310 0xf129a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35520/0 (socket says 172.21.15.81:35520) 2024-09-13T18:52:19.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f7729e00700 1 -- 172.21.15.81:0/111731417 learned_addr learned my addr 172.21.15.81:0/111731417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.948+0000 7f772a800700 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772a800700 1 -- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 msgr2=0xf129f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772a800700 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf129f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772a800700 1 -- 172.21.15.81:0/111731417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf083310 msgr2=0xf129a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772a800700 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf083310 0xf129a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772a800700 1 -- 172.21.15.81:0/111731417 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xef9b4c0 con 0xf0ce170 2024-09-13T18:52:19.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772a800700 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0a93a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7720009d10 tx=0x7f7720020070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f14eabf902d3192 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f7713000700 1 -- 172.21.15.81:0/111731417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77200047a0 con 0xf0ce170 2024-09-13T18:52:19.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f7713000700 1 -- 172.21.15.81:0/111731417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720022070 con 0xf0ce170 2024-09-13T18:52:19.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f7713000700 1 -- 172.21.15.81:0/111731417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720004200 con 0xf0ce170 2024-09-13T18:52:19.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 -- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 msgr2=0xf0a93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0a93a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7720009d10 tx=0x7f7720020070 comp rx=0 tx=0).stop 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 -- 172.21.15.81:0/111731417 shutdown_connections 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf0ce170 0xf0a93a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf129f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 --2- 172.21.15.81:0/111731417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf083310 0xf129a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 -- 172.21.15.81:0/111731417 >> 172.21.15.81:0/111731417 conn(0xee165b0 msgr2=0xf0a6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 -- 172.21.15.81:0/111731417 shutdown_connections 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.952+0000 7f772fbd6740 1 -- 172.21.15.81:0/111731417 wait complete. 2024-09-13T18:52:19.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 -- start start 2024-09-13T18:52:19.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 Processor -- start 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf083310 0xf0aa700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf132d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf133270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xefafa00 con 0xf0ce170 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xefec6c0 con 0xf083310 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xef78a50 con 0xf0cdd90 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772fbd6740 10 client.0 _ll_register_callbacks cb 0xefed610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf133270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf133270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35522/0 (socket says 172.21.15.81:35522) 2024-09-13T18:52:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f772a800700 1 -- 172.21.15.81:0/1113950077 learned_addr learned my addr 172.21.15.81:0/1113950077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f7729400700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.956+0000 7f7729e00700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf083310 0xf0aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772a800700 1 -- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 msgr2=0xf132d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772a800700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf132d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772a800700 1 -- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf083310 msgr2=0xf0aa700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772a800700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf083310 0xf0aa700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772a800700 1 -- 172.21.15.81:0/1113950077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xefb5290 con 0xf0ce170 2024-09-13T18:52:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772a800700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf133270 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f772000ce00 tx=0x7f7720009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9419fda81c52ae05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7706a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7706a00700 1 -- 172.21.15.81:0/1113950077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772000e040 con 0xf0ce170 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7706a00700 1 -- 172.21.15.81:0/1113950077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f772003a070 con 0xf0ce170 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f771800ce10 con 0xf0ce170 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7706a00700 1 -- 172.21.15.81:0/1113950077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7720027470 con 0xf0ce170 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 10 client.7272 fetch_fsmap learned FSMap version 63 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0xef8f790 con 0xf0ce170 2024-09-13T18:52:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7706a00700 1 -- 172.21.15.81:0/1113950077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771800ce10 con 0xf0ce170 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7706a00700 1 -- 172.21.15.81:0/1113950077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 63) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f77200275d0 con 0xf0ce170 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 10 client.7272 fetch_fsmap finished waiting for FSMap version 63 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 10 client.7272 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 20 client.7272 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0aac40 0xf1337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 4 client.7272 mds_command: new command op to 6559 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-13T18:52:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 --> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0xee922c0 con 0xf0aac40 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.960+0000 7f7729e00700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0aac40 0xf1337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f7729e00700 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0aac40 0xf1337b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fad8e8b881cd8246 server_cookie=9461f56904e80f19 in_seq=0 out_seq=0 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f7706a00700 10 client.7272 ms_handle_connect on v2:172.21.15.81:6834/3088682584 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f7706a00700 1 -- 172.21.15.81:0/1113950077 <== mds.2 v2:172.21.15.81:6834/3088682584 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+294 (crc 0 0 0) 0xee922c0 con 0xf0aac40 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f7706a00700 10 client.7272 handle_command_reply: tid=0 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 client.7272 shutdown 2024-09-13T18:52:19.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 msgr2=0xf133270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf133270 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f772000ce00 tx=0x7f7720009750 comp rx=0 tx=0).stop 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 shutdown_connections 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:6834/3088682584,v1:172.21.15.81:6835/3088682584] conn(0xf0aac40 0xf1337b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf0ce170 0xf133270 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f7706a00700 0 client.7272 ms_handle_reset on v2:172.21.15.81:6834/3088682584 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf0cdd90 0xf132d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 --2- 172.21.15.81:0/1113950077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf083310 0xf0aa700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 >> 172.21.15.81:0/1113950077 conn(0xee165b0 msgr2=0xf0dde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 shutdown_connections 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 1 -- 172.21.15.81:0/1113950077 wait complete. 2024-09-13T18:52:19.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772fbd6740 20 client.7272 trim_cache size 0 max 16384 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 152569390, 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627782, 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7" 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "damage_type": "backtrace", 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 494973278, 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "ino": 1099511627783, 2024-09-13T18:52:19.974 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7/d8" 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7708066730 msgr2=0x7f7708068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7708066730 0x7f7708068bf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f772413e710 tx=0x7f7714009040 comp rx=0 tx=0).stop 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 msgr2=0x7f77241381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77241381d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f771800e840 tx=0x7f771800ec00 comp rx=0 tx=0).stop 2024-09-13T18:52:19.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 shutdown_connections 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7708066730 0x7f7708068bf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7724143b70 0x7f7724142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f772406d620 0x7f772415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 --2- 172.21.15.81:0/2919139643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f772406d070 0x7f77241381d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 >> 172.21.15.81:0/2919139643 conn(0x7f772406a390 msgr2=0x7f77240ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 shutdown_connections 2024-09-13T18:52:19.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:19.964+0000 7f772b200700 1 -- 172.21.15.81:0/2919139643 wait complete. 2024-09-13T18:52:19.996 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:52:19.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:52:20.046 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:52:20.089 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:52:20.089 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:52:20.089 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:20.110 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:52:20.110 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:20.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.380+0000 7f8849600700 1 Processor -- start 2024-09-13T18:52:20.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.380+0000 7f8849600700 1 -- start start 2024-09-13T18:52:20.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8849600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88440ced20 0x7f88440cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8849600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88440b3000 0x7f88440b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8849600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88441607d0 0x7f8844160c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8849600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440b39b0 con 0x7f88440b3000 2024-09-13T18:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8849600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884415e1a0 con 0x7f88440ced20 2024-09-13T18:52:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8849600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440cf640 con 0x7f88441607d0 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88440b3000 0x7f88440b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f88440b3000 0x7f88440b3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35536/0 (socket says 172.21.15.81:35536) 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 -- 172.21.15.81:0/3931700084 learned_addr learned my addr 172.21.15.81:0/3931700084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842a00700 1 --2- 172.21.15.81:0/3931700084 >> v2:172.21.15.178:3300/0 conn(0x7f88440ced20 0x7f88440cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8843400700 1 --2- 172.21.15.81:0/3931700084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88441607d0 0x7f8844160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 -- 172.21.15.81:0/3931700084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88441607d0 msgr2=0x7f8844160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:20.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 --2- 172.21.15.81:0/3931700084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88441607d0 0x7f8844160c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 -- 172.21.15.81:0/3931700084 >> v2:172.21.15.178:3300/0 conn(0x7f88440ced20 msgr2=0x7f88440cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 --2- 172.21.15.81:0/3931700084 >> v2:172.21.15.178:3300/0 conn(0x7f88440ced20 0x7f88440cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 -- 172.21.15.81:0/3931700084 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440b1ef0 con 0x7f88440b3000 2024-09-13T18:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842a00700 1 --2- 172.21.15.81:0/3931700084 >> v2:172.21.15.178:3300/0 conn(0x7f88440ced20 0x7f88440cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.384+0000 7f8842000700 1 --2- 172.21.15.81:0/3931700084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440b3000 0x7f88440b3470 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f88440b4320 tx=0x7f8830009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1928ec6b36f8bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:20.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8841600700 1 -- 172.21.15.81:0/3931700084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000b8a0 con 0x7f88440b3000 2024-09-13T18:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8841600700 1 -- 172.21.15.81:0/3931700084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883000ba00 con 0x7f88440b3000 2024-09-13T18:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8841600700 1 -- 172.21.15.81:0/3931700084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883000bd90 con 0x7f88440b3000 2024-09-13T18:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 -- 172.21.15.81:0/3931700084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440b3000 msgr2=0x7f88440b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 --2- 172.21.15.81:0/3931700084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440b3000 0x7f88440b3470 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f88440b4320 tx=0x7f8830009bf0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 -- 172.21.15.81:0/3931700084 shutdown_connections 2024-09-13T18:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 --2- 172.21.15.81:0/3931700084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88441607d0 0x7f8844160c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 --2- 172.21.15.81:0/3931700084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440b3000 0x7f88440b3470 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 --2- 172.21.15.81:0/3931700084 >> v2:172.21.15.178:3300/0 conn(0x7f88440ced20 0x7f88440cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 -- 172.21.15.81:0/3931700084 >> 172.21.15.81:0/3931700084 conn(0x7f88440b0b50 msgr2=0x7f88440b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 -- 172.21.15.81:0/3931700084 shutdown_connections 2024-09-13T18:52:20.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 -- 172.21.15.81:0/3931700084 wait complete. 2024-09-13T18:52:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 Processor -- start 2024-09-13T18:52:20.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.388+0000 7f8849600700 1 -- start start 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88440b3000 0x7f884406c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 0x7f8844151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88441607d0 0x7f8844155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ac4e0 con 0x7f88440ced20 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ad620 con 0x7f88441607d0 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440ad900 con 0x7f88440b3000 2024-09-13T18:52:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 0x7f8844151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 0x7f8844151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35544/0 (socket says 172.21.15.81:35544) 2024-09-13T18:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 -- 172.21.15.81:0/3651187417 learned_addr learned my addr 172.21.15.81:0/3651187417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842a00700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88440b3000 0x7f884406c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8843400700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88441607d0 0x7f8844155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 -- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88440b3000 msgr2=0x7f884406c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88440b3000 0x7f884406c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 -- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88441607d0 msgr2=0x7f8844155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88441607d0 0x7f8844155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 -- 172.21.15.81:0/3651187417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830009570 con 0x7f88440ced20 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8842000700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 0x7f8844151050 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f884406b320 tx=0x7f8830004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300045a0 con 0x7f88440ced20 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883001f070 con 0x7f88440ced20 2024-09-13T18:52:20.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830003900 con 0x7f88440ced20 2024-09-13T18:52:20.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884406cbc0 con 0x7f88440ced20 2024-09-13T18:52:20.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.392+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8844151a80 con 0x7f88440ced20 2024-09-13T18:52:20.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.396+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88440b3bc0 con 0x7f88440ced20 2024-09-13T18:52:20.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.396+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8830021030 con 0x7f88440ced20 2024-09-13T18:52:20.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.396+0000 7f883aa00700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8824066730 0x7f8824068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.396+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f8830085890 con 0x7f88440ced20 2024-09-13T18:52:20.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.396+0000 7f8842a00700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8824066730 0x7f8824068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.400+0000 7f8842a00700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8824066730 0x7f8824068bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8844152130 tx=0x7f8834008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:20.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.404+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8830052a20 con 0x7f88440ced20 2024-09-13T18:52:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.592+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88440adac0 con 0x7f88440ced20 2024-09-13T18:52:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.596+0000 7f883aa00700 1 -- 172.21.15.81:0/3651187417 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16955 (secure 0 0 0) 0x7f8830056040 con 0x7f88440ced20 2024-09-13T18:52:20.605 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:20.605 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:00.266146+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.13","mappings":[{"from":1,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.38","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8824066730 msgr2=0x7f8824068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8824066730 0x7f8824068bf0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8844152130 tx=0x7f8834008040 comp rx=0 tx=0).stop 2024-09-13T18:52:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 msgr2=0x7f8844151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 0x7f8844151050 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f884406b320 tx=0x7f8830004770 comp rx=0 tx=0).stop 2024-09-13T18:52:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 shutdown_connections 2024-09-13T18:52:20.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8824066730 0x7f8824068bf0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88441607d0 0x7f8844155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88440ced20 0x7f8844151050 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 --2- 172.21.15.81:0/3651187417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88440b3000 0x7f884406c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 >> 172.21.15.81:0/3651187417 conn(0x7f88440b0b50 msgr2=0x7f88440ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 shutdown_connections 2024-09-13T18:52:20.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.600+0000 7f8849600700 1 -- 172.21.15.81:0/3651187417 wait complete. 2024-09-13T18:52:20.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:51:15.977135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:51:16.901677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:52:20.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:52:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.804+0000 7fb9cc800700 1 Processor -- start 2024-09-13T18:52:20.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.804+0000 7fb9cc800700 1 -- start start 2024-09-13T18:52:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9c406be10 0x7fb9c40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c41618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c406d000 con 0x7fb9c4160fc0 2024-09-13T18:52:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40cf520 con 0x7fb9c406be10 2024-09-13T18:52:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c406c3f0 con 0x7fb9c40cf0b0 2024-09-13T18:52:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9c406be10 0x7fb9c40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9c406be10 0x7fb9c40ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35554/0 (socket says 172.21.15.81:35554) 2024-09-13T18:52:20.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 -- 172.21.15.81:0/2167474491 learned_addr learned my addr 172.21.15.81:0/2167474491 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9ca800700 1 --2- 172.21.15.81:0/2167474491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c41618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 -- 172.21.15.81:0/2167474491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 msgr2=0x7fb9c41618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 --2- 172.21.15.81:0/2167474491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c41618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 -- 172.21.15.81:0/2167474491 >> v1:172.21.15.178:6789/0 conn(0x7fb9c4160fc0 legacy=0x7fb9c40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 -- 172.21.15.81:0/2167474491 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c406c6d0 con 0x7fb9c406be10 2024-09-13T18:52:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c9400700 1 --2- 172.21.15.81:0/2167474491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c40ceb70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009910 tx=0x7fb9b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf70d83d35491de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c8a00700 1 -- 172.21.15.81:0/2167474491 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4004230 con 0x7fb9c406be10 2024-09-13T18:52:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c8a00700 1 -- 172.21.15.81:0/2167474491 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4004390 con 0x7fb9c406be10 2024-09-13T18:52:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9c8a00700 1 -- 172.21.15.81:0/2167474491 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4009e60 con 0x7fb9c406be10 2024-09-13T18:52:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- 172.21.15.81:0/2167474491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 msgr2=0x7fb9c40ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 --2- 172.21.15.81:0/2167474491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c40ceb70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009910 tx=0x7fb9b4009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- 172.21.15.81:0/2167474491 shutdown_connections 2024-09-13T18:52:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 --2- 172.21.15.81:0/2167474491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c41618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 --2- 172.21.15.81:0/2167474491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c40ceb70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- 172.21.15.81:0/2167474491 >> 172.21.15.81:0/2167474491 conn(0x7fb9c406a570 msgr2=0x7fb9c406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- 172.21.15.81:0/2167474491 shutdown_connections 2024-09-13T18:52:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.808+0000 7fb9cc800700 1 -- 172.21.15.81:0/2167474491 wait complete. 2024-09-13T18:52:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.812+0000 7fb9cc800700 1 Processor -- start 2024-09-13T18:52:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.812+0000 7fb9cc800700 1 -- start start 2024-09-13T18:52:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c4157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c4154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c4160fc0 0x7fb9c414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41f6b30 con 0x7fb9c406be10 2024-09-13T18:52:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c40ce540 con 0x7fb9c4160fc0 2024-09-13T18:52:20.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41f6d80 con 0x7fb9c40cf0b0 2024-09-13T18:52:20.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c4157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c4157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35570/0 (socket says 172.21.15.81:35570) 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 -- 172.21.15.81:0/4017894728 learned_addr learned my addr 172.21.15.81:0/4017894728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9400700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c4154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9ca800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c4160fc0 0x7fb9c414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 -- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 msgr2=0x7fb9c4154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c4154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 -- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c4160fc0 msgr2=0x7fb9c414f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c4160fc0 0x7fb9c414f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:20.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 -- 172.21.15.81:0/4017894728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009570 con 0x7fb9c406be10 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9ca800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c4160fc0 0x7fb9c414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9c9e00700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c4157a10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800b4a0 tx=0x7fb9b800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8011830 con 0x7fb9c406be10 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b8011990 con 0x7fb9c406be10 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8011d40 con 0x7fb9c406be10 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c41f7060 con 0x7fb9c406be10 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.816+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c41f7620 con 0x7fb9c406be10 2024-09-13T18:52:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.820+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c40ceb70 con 0x7fb9c406be10 2024-09-13T18:52:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.820+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb9b801a400 con 0x7fb9c406be10 2024-09-13T18:52:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.820+0000 7fb9be000700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb9a8066730 0x7fb9a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:20.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.820+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fb9b8084210 con 0x7fb9c406be10 2024-09-13T18:52:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.820+0000 7fb9c9400700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb9a8066730 0x7fb9a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:20.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.824+0000 7fb9c9400700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb9a8066730 0x7fb9a8068bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009910 tx=0x7fb9b4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:20.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:20.828+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb9b8051290 con 0x7fb9c406be10 2024-09-13T18:52:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.008+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9c415dac0 con 0x7fb9c406be10 2024-09-13T18:52:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.008+0000 7fb9be000700 1 -- 172.21.15.81:0/4017894728 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9b80548b0 con 0x7fb9c406be10 2024-09-13T18:52:21.016 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb9a8066730 msgr2=0x7fb9a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb9a8066730 0x7fb9a8068bf0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009910 tx=0x7fb9b4008030 comp rx=0 tx=0).stop 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 msgr2=0x7fb9c4157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c4157a10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800b4a0 tx=0x7fb9b800b860 comp rx=0 tx=0).stop 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 shutdown_connections 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb9a8066730 0x7fb9a8068bf0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9c4160fc0 0x7fb9c414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9c40cf0b0 0x7fb9c4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 --2- 172.21.15.81:0/4017894728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c406be10 0x7fb9c4157a10 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 >> 172.21.15.81:0/4017894728 conn(0x7fb9c406a570 msgr2=0x7fb9c40b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 shutdown_connections 2024-09-13T18:52:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.012+0000 7fb9cc800700 1 -- 172.21.15.81:0/4017894728 wait complete. 2024-09-13T18:52:21.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:52:21.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.212+0000 7ff57ee00700 1 Processor -- start 2024-09-13T18:52:21.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.212+0000 7ff57ee00700 1 -- start start 2024-09-13T18:52:21.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff578146620 0x7ff5781608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff57806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff578161800 con 0x7ff57806b430 2024-09-13T18:52:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff578146a00 con 0x7ff578146620 2024-09-13T18:52:21.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff578160f60 con 0x7ff5780b41a0 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff578146620 0x7ff5781608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ce00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff57806b430 0x7ff57815d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40678/0 (socket says 172.21.15.81:40678) 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ce00700 1 -- 172.21.15.81:0/3436166866 learned_addr learned my addr 172.21.15.81:0/3436166866 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577400700 1 --2- 172.21.15.81:0/3436166866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff57806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577e00700 1 -- 172.21.15.81:0/3436166866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 msgr2=0x7ff57806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577e00700 1 --2- 172.21.15.81:0/3436166866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff57806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577e00700 1 -- 172.21.15.81:0/3436166866 >> v1:172.21.15.81:6789/0 conn(0x7ff57806b430 legacy=0x7ff57815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577e00700 1 -- 172.21.15.81:0/3436166866 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578161240 con 0x7ff578146620 2024-09-13T18:52:21.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff576a00700 1 -- 172.21.15.81:0/3436166866 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308367662 0 0) 0x7ff578161800 con 0x7ff57806b430 2024-09-13T18:52:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff577e00700 1 --2- 172.21.15.81:0/3436166866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5781608d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff568009850 tx=0x7ff568009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0e067c33610bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff576a00700 1 -- 172.21.15.81:0/3436166866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568011830 con 0x7ff578146620 2024-09-13T18:52:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff576a00700 1 -- 172.21.15.81:0/3436166866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff568011990 con 0x7ff578146620 2024-09-13T18:52:21.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff576a00700 1 -- 172.21.15.81:0/3436166866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff568011d40 con 0x7ff578146620 2024-09-13T18:52:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 -- 172.21.15.81:0/3436166866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 msgr2=0x7ff5781608d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.216+0000 7ff57ee00700 1 --2- 172.21.15.81:0/3436166866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5781608d0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7ff568009850 tx=0x7ff568009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:21.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 -- 172.21.15.81:0/3436166866 shutdown_connections 2024-09-13T18:52:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 --2- 172.21.15.81:0/3436166866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff57806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 --2- 172.21.15.81:0/3436166866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5781608d0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 -- 172.21.15.81:0/3436166866 >> 172.21.15.81:0/3436166866 conn(0x7ff5780b18f0 msgr2=0x7ff5780b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 -- 172.21.15.81:0/3436166866 shutdown_connections 2024-09-13T18:52:21.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 -- 172.21.15.81:0/3436166866 wait complete. 2024-09-13T18:52:21.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.220+0000 7ff57ee00700 1 Processor -- start 2024-09-13T18:52:21.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 -- start start 2024-09-13T18:52:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff57806b430 0x7ff578141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff5780ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5780c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780c6510 con 0x7ff578146620 2024-09-13T18:52:21.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff578142180 con 0x7ff57806b430 2024-09-13T18:52:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780c5920 con 0x7ff5780b41a0 2024-09-13T18:52:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5780c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5780c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35598/0 (socket says 172.21.15.81:35598) 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 -- 172.21.15.81:0/1263083355 learned_addr learned my addr 172.21.15.81:0/1263083355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff577400700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff5780ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff577e00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff57806b430 0x7ff578141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 -- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 msgr2=0x7ff5780ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff5780ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 -- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff57806b430 msgr2=0x7ff578141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff57806b430 0x7ff578141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 -- 172.21.15.81:0/1263083355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680094b0 con 0x7ff578146620 2024-09-13T18:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ce00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5780c7f20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff570002230 tx=0x7ff57000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57000aac0 con 0x7ff578146620 2024-09-13T18:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57000ac40 con 0x7ff578146620 2024-09-13T18:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5780c5be0 con 0x7ff578146620 2024-09-13T18:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700070d0 con 0x7ff578146620 2024-09-13T18:52:21.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.224+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5780c61a0 con 0x7ff578146620 2024-09-13T18:52:21.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.228+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5780c66c0 con 0x7ff578146620 2024-09-13T18:52:21.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.228+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff570007250 con 0x7ff578146620 2024-09-13T18:52:21.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.232+0000 7ff56fe00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff558066730 0x7ff558068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.232+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7ff570084080 con 0x7ff578146620 2024-09-13T18:52:21.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.232+0000 7ff577e00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff558066730 0x7ff558068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.232+0000 7ff577e00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff558066730 0x7ff558068bf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff5680090b0 tx=0x7ff56801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:21.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.236+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5700b5db0 con 0x7ff578146620 2024-09-13T18:52:21.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.420+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff578145b10 con 0x7ff578146620 2024-09-13T18:52:21.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.420+0000 7ff56fe00700 1 -- 172.21.15.81:0/1263083355 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff570018020 con 0x7ff578146620 2024-09-13T18:52:21.428 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:52:21.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.420+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff558066730 msgr2=0x7ff558068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.420+0000 7ff57ee00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff558066730 0x7ff558068bf0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff5680090b0 tx=0x7ff56801c040 comp rx=0 tx=0).stop 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 msgr2=0x7ff5780c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5780c7f20 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7ff570002230 tx=0x7ff57000cf50 comp rx=0 tx=0).stop 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 shutdown_connections 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff558066730 0x7ff558068bf0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff578146620 0x7ff5780c7f20 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5780b41a0 0x7ff5780ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 --2- 172.21.15.81:0/1263083355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff57806b430 0x7ff578141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 >> 172.21.15.81:0/1263083355 conn(0x7ff5780b18f0 msgr2=0x7ff5780b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 shutdown_connections 2024-09-13T18:52:21.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.424+0000 7ff57ee00700 1 -- 172.21.15.81:0/1263083355 wait complete. 2024-09-13T18:52:21.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:52:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.616+0000 7f0434200700 1 Processor -- start 2024-09-13T18:52:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.616+0000 7f0434200700 1 -- start start 2024-09-13T18:52:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0434200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f042c157470 0x7f042c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0434200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f042c06ed70 0x7f042c06f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0434200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c06f6e0 con 0x7f042c0725c0 2024-09-13T18:52:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0434200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c157850 con 0x7f042c157470 2024-09-13T18:52:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0434200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c15dd20 con 0x7f042c06ed70 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f042c157470 0x7f042c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f042c157470 0x7f042c15a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35600/0 (socket says 172.21.15.81:35600) 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 -- 172.21.15.81:0/997578132 learned_addr learned my addr 172.21.15.81:0/997578132 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0432200700 1 --2- 172.21.15.81:0/997578132 >> v2:172.21.15.178:3300/0 conn(0x7f042c06ed70 0x7f042c06f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 -- 172.21.15.81:0/997578132 >> v2:172.21.15.178:3300/0 conn(0x7f042c06ed70 msgr2=0x7f042c06f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 --2- 172.21.15.81:0/997578132 >> v2:172.21.15.178:3300/0 conn(0x7f042c06ed70 0x7f042c06f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 -- 172.21.15.81:0/997578132 >> v1:172.21.15.178:6789/0 conn(0x7f042c0725c0 legacy=0x7f042c15d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:21.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 -- 172.21.15.81:0/997578132 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c15e000 con 0x7f042c157470 2024-09-13T18:52:21.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f0431800700 1 --2- 172.21.15.81:0/997578132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c157470 0x7f042c15a7f0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f042c06f8d0 tx=0x7f0420009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9b5efb10848739 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f042be00700 1 -- 172.21.15.81:0/997578132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420011830 con 0x7f042c157470 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f042be00700 1 -- 172.21.15.81:0/997578132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420011990 con 0x7f042c157470 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.620+0000 7f042be00700 1 -- 172.21.15.81:0/997578132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420011d20 con 0x7f042c157470 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- 172.21.15.81:0/997578132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c157470 msgr2=0x7f042c15a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 --2- 172.21.15.81:0/997578132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c157470 0x7f042c15a7f0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f042c06f8d0 tx=0x7f0420009bf0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- 172.21.15.81:0/997578132 shutdown_connections 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 --2- 172.21.15.81:0/997578132 >> v2:172.21.15.178:3300/0 conn(0x7f042c06ed70 0x7f042c06f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 --2- 172.21.15.81:0/997578132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c157470 0x7f042c15a7f0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- 172.21.15.81:0/997578132 >> 172.21.15.81:0/997578132 conn(0x7f042c0b1e10 msgr2=0x7f042c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- 172.21.15.81:0/997578132 shutdown_connections 2024-09-13T18:52:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- 172.21.15.81:0/997578132 wait complete. 2024-09-13T18:52:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 Processor -- start 2024-09-13T18:52:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- start start 2024-09-13T18:52:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 0x7f042c153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f042c0725c0 0x7f042c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f042c157470 0x7f042c143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c154880 con 0x7f042c06ed70 2024-09-13T18:52:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0cb880 con 0x7f042c157470 2024-09-13T18:52:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.624+0000 7f0434200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c143890 con 0x7f042c0725c0 2024-09-13T18:52:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 0x7f042c153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 0x7f042c153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35604/0 (socket says 172.21.15.81:35604) 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 -- 172.21.15.81:0/619605223 learned_addr learned my addr 172.21.15.81:0/619605223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0430e00700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f042c0725c0 0x7f042c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0432200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f042c157470 0x7f042c143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 -- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f042c0725c0 msgr2=0x7f042c0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f042c0725c0 0x7f042c0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 -- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f042c157470 msgr2=0x7f042c143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f042c157470 0x7f042c143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 -- 172.21.15.81:0/619605223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0420009570 con 0x7f042c06ed70 2024-09-13T18:52:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0431800700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 0x7f042c153500 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0420000c00 tx=0x7f0420004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420004510 con 0x7f042c06ed70 2024-09-13T18:52:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042001e070 con 0x7f042c06ed70 2024-09-13T18:52:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003900 con 0x7f042c06ed70 2024-09-13T18:52:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c153c00 con 0x7f042c06ed70 2024-09-13T18:52:21.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.628+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c1541c0 con 0x7f042c06ed70 2024-09-13T18:52:21.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.632+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c06f1a0 con 0x7f042c06ed70 2024-09-13T18:52:21.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.632+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0420003a60 con 0x7f042c06ed70 2024-09-13T18:52:21.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.632+0000 7f0429600700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f040c066760 0x7f040c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:21.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.632+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f0420084e00 con 0x7f042c06ed70 2024-09-13T18:52:21.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.632+0000 7f0430e00700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f040c066760 0x7f040c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:21.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.636+0000 7f0430e00700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f040c066760 0x7f040c068c20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f042c15d0e0 tx=0x7f04180090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:21.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.640+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0420052030 con 0x7f042c06ed70 2024-09-13T18:52:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.824+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f042c06beb0 con 0x7f042c06ed70 2024-09-13T18:52:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.824+0000 7f0429600700 1 -- 172.21.15.81:0/619605223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04200150a0 con 0x7f042c06ed70 2024-09-13T18:52:21.833 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:52:21.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f040c066760 msgr2=0x7f040c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f040c066760 0x7f040c068c20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f042c15d0e0 tx=0x7f04180090e0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 msgr2=0x7f042c153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 0x7f042c153500 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f0420000c00 tx=0x7f0420004770 comp rx=0 tx=0).stop 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 shutdown_connections 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f040c066760 0x7f040c068c20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f042c157470 0x7f042c143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f042c0725c0 0x7f042c0cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 --2- 172.21.15.81:0/619605223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f042c06ed70 0x7f042c153500 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 >> 172.21.15.81:0/619605223 conn(0x7f042c0b1e10 msgr2=0x7f042c0cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 shutdown_connections 2024-09-13T18:52:21.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:21.828+0000 7f0434200700 1 -- 172.21.15.81:0/619605223 wait complete. 2024-09-13T18:52:21.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:52:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.024+0000 7f1143200700 1 Processor -- start 2024-09-13T18:52:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.024+0000 7f1143200700 1 -- start start 2024-09-13T18:52:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1143200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 0x7f11440b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1143200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11440d1800 con 0x7f114415e070 2024-09-13T18:52:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1143200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114415e450 con 0x7f11440b2a80 2024-09-13T18:52:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1143200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11440b2ef0 con 0x7f11440cd430 2024-09-13T18:52:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1141e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f114415e070 0x7f11440d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40688/0 (socket says 172.21.15.81:40688) 2024-09-13T18:52:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1141e00700 1 -- 172.21.15.81:0/3998627627 learned_addr learned my addr 172.21.15.81:0/3998627627 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1141400700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 0x7f11440b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421009959 0 0) 0x7f11440d1800 con 0x7f114415e070 2024-09-13T18:52:22.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11280035d0 con 0x7f114415e070 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205917094 0 0) 0x7f114415e450 con 0x7f11440b2a80 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11440d1800 con 0x7f11440b2a80 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3221803446 0 0) 0x7f11280035d0 con 0x7f114415e070 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 msgr2=0x7f11440b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 0x7f11440b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 >> v1:172.21.15.178:6789/0 conn(0x7f11440b2a80 legacy=0x7f11440b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440d0050 con 0x7f114415e070 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f1134001670 con 0x7f114415e070 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 >> v1:172.21.15.81:6789/0 conn(0x7f114415e070 legacy=0x7f11440d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 0x7f1128003c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11280041b0 0x7f1128004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004db0 0x7f1128005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440b2ef0 con 0x7f11280041b0 2024-09-13T18:52:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112800bb70 con 0x7f1128004db0 2024-09-13T18:52:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112800bd30 con 0x7f11440cd430 2024-09-13T18:52:22.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.028+0000 7f1141400700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11280041b0 0x7f1128004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1142800700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004db0 0x7f1128005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141e00700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 0x7f1128003c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141400700 1 -- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 msgr2=0x7f1128003c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141400700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11440cd430 0x7f1128003c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141400700 1 -- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004db0 msgr2=0x7f1128005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141400700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1128004db0 0x7f1128005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141400700 1 -- 172.21.15.81:0/3998627627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11280035d0 con 0x7f11280041b0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1141400700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11280041b0 0x7f1128004870 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1130009b70 tx=0x7f11280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33df333ab5bcb890 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000e6c0 con 0x7f11280041b0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000e820 con 0x7f11280041b0 2024-09-13T18:52:22.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1140a00700 1 -- 172.21.15.81:0/3998627627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000eb90 con 0x7f11280041b0 2024-09-13T18:52:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1143200700 1 -- 172.21.15.81:0/3998627627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11280041b0 msgr2=0x7f1128004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1143200700 1 --2- 172.21.15.81:0/3998627627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11280041b0 0x7f1128004870 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1130009b70 tx=0x7f11280058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1142800700 1 -- 172.21.15.81:0/3998627627 reap_dead start 2024-09-13T18:52:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1143200700 1 -- 172.21.15.81:0/3998627627 shutdown_connections 2024-09-13T18:52:22.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1143200700 1 -- 172.21.15.81:0/3998627627 >> 172.21.15.81:0/3998627627 conn(0x7f1144071f00 msgr2=0x7f11440722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:22.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1143200700 1 -- 172.21.15.81:0/3998627627 shutdown_connections 2024-09-13T18:52:22.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.032+0000 7f1143200700 1 -- 172.21.15.81:0/3998627627 wait complete. 2024-09-13T18:52:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 Processor -- start 2024-09-13T18:52:22.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 -- start start 2024-09-13T18:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11280041b0 0x7f11440b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 0x7f114414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440af0b0 0x7f11440ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440b3df0 con 0x7f1144156d70 2024-09-13T18:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1144150230 con 0x7f11440af0b0 2024-09-13T18:52:22.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.036+0000 7f1143200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114406a390 con 0x7f11280041b0 2024-09-13T18:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 0x7f114414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 0x7f114414fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35626/0 (socket says 172.21.15.81:35626) 2024-09-13T18:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 -- 172.21.15.81:0/1940604125 learned_addr learned my addr 172.21.15.81:0/1940604125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141e00700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11280041b0 0x7f11440b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1142800700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440af0b0 0x7f11440ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 -- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11280041b0 msgr2=0x7f11440b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11280041b0 0x7f11440b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 -- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440af0b0 msgr2=0x7f11440ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440af0b0 0x7f11440ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 -- 172.21.15.81:0/1940604125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114406a670 con 0x7f1144156d70 2024-09-13T18:52:22.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1141400700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 0x7f114414fcf0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f112800bb40 tx=0x7f11300047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000e6c0 con 0x7f1144156d70 2024-09-13T18:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1130004030 con 0x7f1144156d70 2024-09-13T18:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114406a950 con 0x7f1144156d70 2024-09-13T18:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130009ee0 con 0x7f1144156d70 2024-09-13T18:52:22.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.040+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114406af10 con 0x7f1144156d70 2024-09-13T18:52:22.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.044+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11440cd880 con 0x7f1144156d70 2024-09-13T18:52:22.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.044+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f11300043e0 con 0x7f1144156d70 2024-09-13T18:52:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.044+0000 7f113a000700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1124066760 0x7f1124068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.044+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f1130085320 con 0x7f1144156d70 2024-09-13T18:52:22.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.044+0000 7f1141e00700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1124066760 0x7f1124068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.048+0000 7f1141e00700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1124066760 0x7f1124068c20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1134001eb0 tx=0x7f1134009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:22.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.048+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11300524b0 con 0x7f1144156d70 2024-09-13T18:52:22.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.240+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f11440b3df0 con 0x7f1144156d70 2024-09-13T18:52:22.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.240+0000 7f113a000700 1 -- 172.21.15.81:0/1940604125 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1130055ad0 con 0x7f1144156d70 2024-09-13T18:52:22.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1124066760 msgr2=0x7f1124068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1124066760 0x7f1124068c20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1134001eb0 tx=0x7f1134009040 comp rx=0 tx=0).stop 2024-09-13T18:52:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 msgr2=0x7f114414fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 0x7f114414fcf0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f112800bb40 tx=0x7f11300047e0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 shutdown_connections 2024-09-13T18:52:22.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1124066760 0x7f1124068c20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11440af0b0 0x7f11440ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1144156d70 0x7f114414fcf0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 --2- 172.21.15.81:0/1940604125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11280041b0 0x7f11440b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 >> 172.21.15.81:0/1940604125 conn(0x7f1144071f00 msgr2=0x7f11440ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 shutdown_connections 2024-09-13T18:52:22.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.244+0000 7f1143200700 1 -- 172.21.15.81:0/1940604125 wait complete. 2024-09-13T18:52:22.254 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:52:22.272 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:52:22.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:22.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:52:22.314 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:52:22.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:22.314 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:52:22.382 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:52:22.383 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:22.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:52:22.398 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:52:22.398 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:22.442 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:52:22.442 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:52:22.442 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:22.459 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:52:22.459 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.656+0000 7fa62be00700 1 Processor -- start 2024-09-13T18:52:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.656+0000 7fa62be00700 1 -- start start 2024-09-13T18:52:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62be00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa62c0cb700 0x7fa62c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0707d0 con 0x7fa62c159bd0 2024-09-13T18:52:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62be00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa62c06b470 con 0x7fa62c0cb700 2024-09-13T18:52:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0720a0 con 0x7fa62c06afe0 2024-09-13T18:52:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa62c0cb700 0x7fa62c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62b400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa62c0cb700 0x7fa62c06aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:41904/0 (socket says 172.21.15.81:41904) 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 -- 172.21.15.81:0/3220343835 learned_addr learned my addr 172.21.15.81:0/3220343835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 -- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 msgr2=0x7fa62c1636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 --2- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 -- 172.21.15.81:0/3220343835 >> v1:172.21.15.178:6789/0 conn(0x7fa62c159bd0 legacy=0x7fa62c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 -- 172.21.15.81:0/3220343835 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c06fee0 con 0x7fa62c0cb700 2024-09-13T18:52:22.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa62a000700 1 --2- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c0cb700 0x7fa62c06aaa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa618009940 tx=0x7fa618009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104e24f7338166c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:22.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa629600700 1 -- 172.21.15.81:0/3220343835 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800f8a0 con 0x7fa62c0cb700 2024-09-13T18:52:22.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa629600700 1 -- 172.21.15.81:0/3220343835 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61800fa00 con 0x7fa62c0cb700 2024-09-13T18:52:22.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.660+0000 7fa629600700 1 -- 172.21.15.81:0/3220343835 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800fd90 con 0x7fa62c0cb700 2024-09-13T18:52:22.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 -- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c0cb700 msgr2=0x7fa62c06aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 --2- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c0cb700 0x7fa62c06aaa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa618009940 tx=0x7fa618009c50 comp rx=0 tx=0).stop 2024-09-13T18:52:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 -- 172.21.15.81:0/3220343835 shutdown_connections 2024-09-13T18:52:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 --2- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 --2- 172.21.15.81:0/3220343835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c0cb700 0x7fa62c06aaa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 -- 172.21.15.81:0/3220343835 >> 172.21.15.81:0/3220343835 conn(0x7fa62c0b0c40 msgr2=0x7fa62c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 -- 172.21.15.81:0/3220343835 shutdown_connections 2024-09-13T18:52:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.664+0000 7fa62be00700 1 -- 172.21.15.81:0/3220343835 wait complete. 2024-09-13T18:52:22.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 Processor -- start 2024-09-13T18:52:22.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 -- start start 2024-09-13T18:52:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c0cb700 0x7fa62c14e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c159bd0 0x7fa62c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0ace60 con 0x7fa62c0cb700 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0abf40 con 0x7fa62c159bd0 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c14eef0 con 0x7fa62c06afe0 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c0cb700 0x7fa62c14e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48758/0 (socket says 172.21.15.81:48758) 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62aa00700 1 -- 172.21.15.81:0/3312787 learned_addr learned my addr 172.21.15.81:0/3312787 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.668+0000 7fa62b400700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c159bd0 0x7fa62c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62aa00700 1 -- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c159bd0 msgr2=0x7fa62c0a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62aa00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c159bd0 0x7fa62c0a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62aa00700 1 -- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c0cb700 msgr2=0x7fa62c14e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62aa00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c0cb700 0x7fa62c14e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62aa00700 1 -- 172.21.15.81:0/3312787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618009570 con 0x7fa62c06afe0 2024-09-13T18:52:22.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62a000700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c0cb700 0x7fa62c14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:22.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62aa00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1542a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c530 tx=0x7fa61c00c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:22.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0052d0 con 0x7fa62c06afe0 2024-09-13T18:52:22.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c005430 con 0x7fa62c06afe0 2024-09-13T18:52:22.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c0ac1e0 con 0x7fa62c06afe0 2024-09-13T18:52:22.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0055a0 con 0x7fa62c06afe0 2024-09-13T18:52:22.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c0ac7a0 con 0x7fa62c06afe0 2024-09-13T18:52:22.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.672+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c06aaa0 con 0x7fa62c06afe0 2024-09-13T18:52:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.676+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa61c0038e0 con 0x7fa62c06afe0 2024-09-13T18:52:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.676+0000 7fa622a00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa60c066780 0x7fa60c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.676+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fa61c083b50 con 0x7fa62c06afe0 2024-09-13T18:52:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.676+0000 7fa62a000700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa60c066780 0x7fa60c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:22.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.676+0000 7fa62a000700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa60c066780 0x7fa60c068c40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa618009890 tx=0x7fa61801b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.684+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa61c050cd0 con 0x7fa62c06afe0 2024-09-13T18:52:22.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.924+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62c073660 con 0x7fa62c06afe0 2024-09-13T18:52:22.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa622a00700 1 -- 172.21.15.81:0/3312787 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4778 (secure 0 0 0) 0x7fa61c0542f0 con 0x7fa62c06afe0 2024-09-13T18:52:22.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:22.935 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:56.232873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6822,"mds_1":6816,"mds_2":6559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6559":{"gid":6559,"name":"a","rank":2,"incarnation":56,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa60c066780 msgr2=0x7fa60c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa60c066780 0x7fa60c068c40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa618009890 tx=0x7fa61801b040 comp rx=0 tx=0).stop 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 msgr2=0x7fa62c1542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1542a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c530 tx=0x7fa61c00c840 comp rx=0 tx=0).stop 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 shutdown_connections 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa60c066780 0x7fa60c068c40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa62c159bd0 0x7fa62c0a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa62c0cb700 0x7fa62c14e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 --2- 172.21.15.81:0/3312787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa62c06afe0 0x7fa62c1542a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:22.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 >> 172.21.15.81:0/3312787 conn(0x7fa62c0b0c40 msgr2=0x7fa62c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:22.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.928+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 shutdown_connections 2024-09-13T18:52:22.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:22.932+0000 7fa62be00700 1 -- 172.21.15.81:0/3312787 wait complete. 2024-09-13T18:52:22.940 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 63 2024-09-13T18:52:22.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:23.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6a00700 1 Processor -- start 2024-09-13T18:52:23.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6a00700 1 -- start start 2024-09-13T18:52:23.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc2a015d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a015e560 con 0x7fc2a015e9f0 2024-09-13T18:52:23.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a015d920 con 0x7fc2a00b3980 2024-09-13T18:52:23.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00adf90 con 0x7fc2a006aaa0 2024-09-13T18:52:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc2a015e9f0 0x7fc2a015eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40696/0 (socket says 172.21.15.81:40696) 2024-09-13T18:52:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.116+0000 7fc2a6000700 1 -- 172.21.15.81:0/2281934393 learned_addr learned my addr 172.21.15.81:0/2281934393 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a5600700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc2a015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398800966 0 0) 0x7fc2a015e560 con 0x7fc2a015e9f0 2024-09-13T18:52:23.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2880035d0 con 0x7fc2a015e9f0 2024-09-13T18:52:23.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437594564 0 0) 0x7fc2880035d0 con 0x7fc2a015e9f0 2024-09-13T18:52:23.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 msgr2=0x7fc2a015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc2a015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 >> v1:172.21.15.178:6789/0 conn(0x7fc2a00b3980 legacy=0x7fc2a006ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a015dc00 con 0x7fc2a015e9f0 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fc2980019f0 con 0x7fc2a015e9f0 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 >> v1:172.21.15.81:6789/0 conn(0x7fc2a015e9f0 legacy=0x7fc2a015eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc288003ac0 0x7fc288003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288004870 0x7fc288004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc288005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00adf90 con 0x7fc288004870 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28800bb30 con 0x7fc288003ac0 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28800bcf0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a4c00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288004870 0x7fc288004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc288005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a5600700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc288003ac0 0x7fc288003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 -- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc288003ac0 msgr2=0x7fc288003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc288003ac0 0x7fc288003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 -- 172.21.15.81:0/2281934393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288004870 msgr2=0x7fc288004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288004870 0x7fc288004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 -- 172.21.15.81:0/2281934393 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2880035d0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a5600700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc288003ac0 0x7fc288003ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a4c00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc288004870 0x7fc288004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc2a6000700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc288005230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc29800a830 tx=0x7fc2880058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c8551d997a1fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800a2f0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2980072f0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.120+0000 7fc29fe00700 1 -- 172.21.15.81:0/2281934393 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980076a0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 msgr2=0x7fc288005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2281934393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a006aaa0 0x7fc288005230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc29800a830 tx=0x7fc2880058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6000700 1 -- 172.21.15.81:0/2281934393 reap_dead start 2024-09-13T18:52:23.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2281934393 shutdown_connections 2024-09-13T18:52:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2281934393 >> 172.21.15.81:0/2281934393 conn(0x7fc2a00b0c40 msgr2=0x7fc2a006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2281934393 shutdown_connections 2024-09-13T18:52:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2281934393 wait complete. 2024-09-13T18:52:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 Processor -- start 2024-09-13T18:52:23.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.124+0000 7fc2a6a00700 1 -- start start 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 0x7fc2a006cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00cdf10 0x7fc2a013edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a00ce390 0x7fc2a013f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01f2c30 con 0x7fc2a006aaa0 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01f2ed0 con 0x7fc2a00ce390 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a01f31b0 con 0x7fc2a00cdf10 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 0x7fc2a006cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 0x7fc2a006cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35650/0 (socket says 172.21.15.81:35650) 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 -- 172.21.15.81:0/2016560228 learned_addr learned my addr 172.21.15.81:0/2016560228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:23.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a4c00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00cdf10 0x7fc2a013edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6000700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a00ce390 0x7fc2a013f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 -- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00cdf10 msgr2=0x7fc2a013edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00cdf10 0x7fc2a013edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 -- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a00ce390 msgr2=0x7fc2a013f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a00ce390 0x7fc2a013f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 -- 172.21.15.81:0/2016560228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a01f3490 con 0x7fc2a006aaa0 2024-09-13T18:52:23.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6000700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a00ce390 0x7fc2a013f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a5600700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 0x7fc2a006cd70 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc294011ca0 tx=0x7fc29400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294011e40 con 0x7fc2a006aaa0 2024-09-13T18:52:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29400fd40 con 0x7fc2a006aaa0 2024-09-13T18:52:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a01f3770 con 0x7fc2a006aaa0 2024-09-13T18:52:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294004260 con 0x7fc2a006aaa0 2024-09-13T18:52:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a006d2b0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.128+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a0140230 con 0x7fc2a006aaa0 2024-09-13T18:52:23.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.132+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2940043c0 con 0x7fc2a006aaa0 2024-09-13T18:52:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.132+0000 7fc29d600700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc280066730 0x7fc280068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.132+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fc294084b10 con 0x7fc2a006aaa0 2024-09-13T18:52:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.132+0000 7fc2a4c00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc280066730 0x7fc280068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.132+0000 7fc2a4c00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc280066730 0x7fc280068bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00cdea0 tx=0x7fc28c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.140+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc294051b90 con 0x7fc2a006aaa0 2024-09-13T18:52:23.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.328+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2a01f3920 con 0x7fc2a006aaa0 2024-09-13T18:52:23.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.328+0000 7fc29d600700 1 -- 172.21.15.81:0/2016560228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16955 (secure 0 0 0) 0x7fc2a01f3920 con 0x7fc2a006aaa0 2024-09-13T18:52:23.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:23.339 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:00.266146+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.13","mappings":[{"from":1,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.38","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc280066730 msgr2=0x7fc280068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc280066730 0x7fc280068bf0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00cdea0 tx=0x7fc28c009040 comp rx=0 tx=0).stop 2024-09-13T18:52:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 msgr2=0x7fc2a006cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 0x7fc2a006cd70 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fc294011ca0 tx=0x7fc29400f520 comp rx=0 tx=0).stop 2024-09-13T18:52:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 shutdown_connections 2024-09-13T18:52:23.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc280066730 0x7fc280068bf0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2a00ce390 0x7fc2a013f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2a00cdf10 0x7fc2a013edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 --2- 172.21.15.81:0/2016560228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2a006aaa0 0x7fc2a006cd70 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 >> 172.21.15.81:0/2016560228 conn(0x7fc2a00b0c40 msgr2=0x7fc2a0142540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 shutdown_connections 2024-09-13T18:52:23.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.332+0000 7fc2a6a00700 1 -- 172.21.15.81:0/2016560228 wait complete. 2024-09-13T18:52:23.364 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:51:15.977135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:51:16.901677+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:52:23.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:52:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.528+0000 7f7e6f200700 1 Processor -- start 2024-09-13T18:52:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.528+0000 7f7e6f200700 1 -- start start 2024-09-13T18:52:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70160d30 0x7f7e7006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7006d150 0x7f7e7006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6f200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700b0020 con 0x7f7e70161110 2024-09-13T18:52:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6f200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700d1770 con 0x7f7e7006d150 2024-09-13T18:52:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700d03f0 con 0x7f7e70160d30 2024-09-13T18:52:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7006d150 0x7f7e7006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7006d150 0x7f7e7006ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35660/0 (socket says 172.21.15.81:35660) 2024-09-13T18:52:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 -- 172.21.15.81:0/1750463445 learned_addr learned my addr 172.21.15.81:0/1750463445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6de00700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70160d30 0x7f7e7006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 -- 172.21.15.81:0/1750463445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70160d30 msgr2=0x7f7e7006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70160d30 0x7f7e7006cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 -- 172.21.15.81:0/1750463445 >> v1:172.21.15.178:6789/0 conn(0x7f7e70161110 legacy=0x7f7e70164a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 -- 172.21.15.81:0/1750463445 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700d06d0 con 0x7f7e7006d150 2024-09-13T18:52:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6ca00700 1 -- 172.21.15.81:0/1750463445 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344315344 0 0) 0x7f7e700b0020 con 0x7f7e70161110 2024-09-13T18:52:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6de00700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70160d30 0x7f7e7006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.532+0000 7f7e6d400700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7006d150 0x7f7e7006ac30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009910 tx=0x7f7e5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ac1a0f6118f101 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6ca00700 1 -- 172.21.15.81:0/1750463445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00ba60 con 0x7f7e7006d150 2024-09-13T18:52:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6ca00700 1 -- 172.21.15.81:0/1750463445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00bbc0 con 0x7f7e7006d150 2024-09-13T18:52:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6ca00700 1 -- 172.21.15.81:0/1750463445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c009e60 con 0x7f7e7006d150 2024-09-13T18:52:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 -- 172.21.15.81:0/1750463445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7006d150 msgr2=0x7f7e7006ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7006d150 0x7f7e7006ac30 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009910 tx=0x7f7e5c009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 -- 172.21.15.81:0/1750463445 shutdown_connections 2024-09-13T18:52:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7006d150 0x7f7e7006ac30 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 --2- 172.21.15.81:0/1750463445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70160d30 0x7f7e7006cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 -- 172.21.15.81:0/1750463445 >> 172.21.15.81:0/1750463445 conn(0x7f7e70071d20 msgr2=0x7f7e70072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 -- 172.21.15.81:0/1750463445 shutdown_connections 2024-09-13T18:52:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 -- 172.21.15.81:0/1750463445 wait complete. 2024-09-13T18:52:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 Processor -- start 2024-09-13T18:52:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.536+0000 7f7e6f200700 1 -- start start 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7006d150 0x7f7e70159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 0x7f7e70149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70161110 0x7f7e70149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700afce0 con 0x7f7e70160d30 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701477b0 con 0x7f7e7006d150 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70159ad0 con 0x7f7e70161110 2024-09-13T18:52:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 0x7f7e70149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 0x7f7e70149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35668/0 (socket says 172.21.15.81:35668) 2024-09-13T18:52:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 -- 172.21.15.81:0/82021599 learned_addr learned my addr 172.21.15.81:0/82021599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6de00700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7006d150 0x7f7e70159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6e800700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70161110 0x7f7e70149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 -- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70161110 msgr2=0x7f7e70149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70161110 0x7f7e70149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 -- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7006d150 msgr2=0x7f7e70159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7006d150 0x7f7e70159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 -- 172.21.15.81:0/82021599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c009570 con 0x7f7e70160d30 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6d400700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 0x7f7e70149800 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c000c00 tx=0x7f7e5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c01a840 con 0x7f7e70160d30 2024-09-13T18:52:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c01f070 con 0x7f7e70160d30 2024-09-13T18:52:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c01abe0 con 0x7f7e70160d30 2024-09-13T18:52:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70159db0 con 0x7f7e70160d30 2024-09-13T18:52:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.540+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e70147a50 con 0x7f7e70160d30 2024-09-13T18:52:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.544+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7006cc10 con 0x7f7e70160d30 2024-09-13T18:52:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.544+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e5c01ad40 con 0x7f7e70160d30 2024-09-13T18:52:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.544+0000 7f7e66000700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e50066730 0x7f7e50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.544+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f7e5c021070 con 0x7f7e70160d30 2024-09-13T18:52:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.544+0000 7f7e6de00700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e50066730 0x7f7e50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.548+0000 7f7e6de00700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e50066730 0x7f7e50068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e600044b0 tx=0x7f7e60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.552+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e5c052d10 con 0x7f7e70160d30 2024-09-13T18:52:23.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.724+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e7015d980 con 0x7f7e70160d30 2024-09-13T18:52:23.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e66000700 1 -- 172.21.15.81:0/82021599 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e5c02b0a0 con 0x7f7e70160d30 2024-09-13T18:52:23.735 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e50066730 msgr2=0x7f7e50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e50066730 0x7f7e50068bf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e600044b0 tx=0x7f7e60008040 comp rx=0 tx=0).stop 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 msgr2=0x7f7e70149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 0x7f7e70149800 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c000c00 tx=0x7f7e5c004770 comp rx=0 tx=0).stop 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 shutdown_connections 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e50066730 0x7f7e50068bf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e70161110 0x7f7e70149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e70160d30 0x7f7e70149800 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 --2- 172.21.15.81:0/82021599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7006d150 0x7f7e70159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.728+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 >> 172.21.15.81:0/82021599 conn(0x7f7e70071d20 msgr2=0x7f7e7015c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.732+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 shutdown_connections 2024-09-13T18:52:23.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.732+0000 7f7e6f200700 1 -- 172.21.15.81:0/82021599 wait complete. 2024-09-13T18:52:23.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:52:23.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.928+0000 7fc850e00700 1 Processor -- start 2024-09-13T18:52:23.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.928+0000 7fc850e00700 1 -- start start 2024-09-13T18:52:23.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc850e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc84c06f480 0x7fc84c16bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc850e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c161470 con 0x7fc84c161090 2024-09-13T18:52:23.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc850e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c0b34c0 con 0x7fc84c06b860 2024-09-13T18:52:23.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc850e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c0b32d0 con 0x7fc84c06f480 2024-09-13T18:52:23.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc849e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc84c161090 0x7fc84c0b2bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40708/0 (socket says 172.21.15.81:40708) 2024-09-13T18:52:23.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc849e00700 1 -- 172.21.15.81:0/1295826818 learned_addr learned my addr 172.21.15.81:0/1295826818 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:23.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc84a800700 1 --2- 172.21.15.81:0/1295826818 >> v2:172.21.15.81:3300/0 conn(0x7fc84c06f480 0x7fc84c16bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc848a00700 1 -- 172.21.15.81:0/1295826818 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206338534 0 0) 0x7fc84c161470 con 0x7fc84c161090 2024-09-13T18:52:23.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc848a00700 1 -- 172.21.15.81:0/1295826818 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8300035d0 con 0x7fc84c161090 2024-09-13T18:52:23.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc84a800700 1 -- 172.21.15.81:0/1295826818 >> v1:172.21.15.178:6789/0 conn(0x7fc84c06b860 legacy=0x7fc84c06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc84a800700 1 -- 172.21.15.81:0/1295826818 >> v1:172.21.15.81:6789/0 conn(0x7fc84c161090 legacy=0x7fc84c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.932+0000 7fc84a800700 1 -- 172.21.15.81:0/1295826818 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c0b37a0 con 0x7fc84c06f480 2024-09-13T18:52:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc84a800700 1 --2- 172.21.15.81:0/1295826818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06f480 0x7fc84c16bc10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc844009d90 tx=0x7fc84400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3507344a065e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc848a00700 1 -- 172.21.15.81:0/1295826818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400e070 con 0x7fc84c06f480 2024-09-13T18:52:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc848a00700 1 -- 172.21.15.81:0/1295826818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84400bb20 con 0x7fc84c06f480 2024-09-13T18:52:23.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc848a00700 1 -- 172.21.15.81:0/1295826818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400be90 con 0x7fc84c06f480 2024-09-13T18:52:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 -- 172.21.15.81:0/1295826818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06f480 msgr2=0x7fc84c16bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 --2- 172.21.15.81:0/1295826818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06f480 0x7fc84c16bc10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc844009d90 tx=0x7fc84400b330 comp rx=0 tx=0).stop 2024-09-13T18:52:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 -- 172.21.15.81:0/1295826818 shutdown_connections 2024-09-13T18:52:23.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 --2- 172.21.15.81:0/1295826818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06f480 0x7fc84c16bc10 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 -- 172.21.15.81:0/1295826818 >> 172.21.15.81:0/1295826818 conn(0x7fc84c06d530 msgr2=0x7fc84c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 -- 172.21.15.81:0/1295826818 shutdown_connections 2024-09-13T18:52:23.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 -- 172.21.15.81:0/1295826818 wait complete. 2024-09-13T18:52:23.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 Processor -- start 2024-09-13T18:52:23.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.936+0000 7fc850e00700 1 -- start start 2024-09-13T18:52:23.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 0x7fc84c155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc84c06f480 0x7fc84c14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc84c161090 0x7fc84c14e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1544e0 con 0x7fc84c06b860 2024-09-13T18:52:23.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c161780 con 0x7fc84c06f480 2024-09-13T18:52:23.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c161a60 con 0x7fc84c161090 2024-09-13T18:52:23.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 0x7fc84c155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 0x7fc84c155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35686/0 (socket says 172.21.15.81:35686) 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 -- 172.21.15.81:0/2269973368 learned_addr learned my addr 172.21.15.81:0/2269973368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849400700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc84c06f480 0x7fc84c14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc84a800700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc84c161090 0x7fc84c14e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 -- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc84c161090 msgr2=0x7fc84c14e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc84c161090 0x7fc84c14e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 -- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc84c06f480 msgr2=0x7fc84c14e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc84c06f480 0x7fc84c14e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 -- 172.21.15.81:0/2269973368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc844009a70 con 0x7fc84c06b860 2024-09-13T18:52:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc849e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 0x7fc84c155880 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c4d0 tx=0x7fc83c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c005d90 con 0x7fc84c06b860 2024-09-13T18:52:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c0070d0 con 0x7fc84c06b860 2024-09-13T18:52:23.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c007480 con 0x7fc84c06b860 2024-09-13T18:52:23.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c161d40 con 0x7fc84c06b860 2024-09-13T18:52:23.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.940+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c14ecb0 con 0x7fc84c06b860 2024-09-13T18:52:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.944+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c06ed70 con 0x7fc84c06b860 2024-09-13T18:52:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.944+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc83c0075e0 con 0x7fc84c06b860 2024-09-13T18:52:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.944+0000 7fc842000700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc82c066730 0x7fc82c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.948+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fc83c0838b0 con 0x7fc84c06b860 2024-09-13T18:52:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.948+0000 7fc849400700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc82c066730 0x7fc82c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:23.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.948+0000 7fc849400700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc82c066730 0x7fc82c068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc84c1546b0 tx=0x7fc838009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:23.952+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc83c050a40 con 0x7fc84c06b860 2024-09-13T18:52:24.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.136+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc84c160590 con 0x7fc84c06b860 2024-09-13T18:52:24.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.136+0000 7fc842000700 1 -- 172.21.15.81:0/2269973368 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc83c054060 con 0x7fc84c06b860 2024-09-13T18:52:24.145 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:52:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc82c066730 msgr2=0x7fc82c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc82c066730 0x7fc82c068bf0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc84c1546b0 tx=0x7fc838009040 comp rx=0 tx=0).stop 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 msgr2=0x7fc84c155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 0x7fc84c155880 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00c4d0 tx=0x7fc83c00c890 comp rx=0 tx=0).stop 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 shutdown_connections 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc82c066730 0x7fc82c068bf0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc84c161090 0x7fc84c14e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc84c06f480 0x7fc84c14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 --2- 172.21.15.81:0/2269973368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc84c06b860 0x7fc84c155880 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 >> 172.21.15.81:0/2269973368 conn(0x7fc84c06d530 msgr2=0x7fc84c0ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 shutdown_connections 2024-09-13T18:52:24.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.140+0000 7fc850e00700 1 -- 172.21.15.81:0/2269973368 wait complete. 2024-09-13T18:52:24.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:52:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.340+0000 7f12c7200700 1 Processor -- start 2024-09-13T18:52:24.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.340+0000 7f12c7200700 1 -- start start 2024-09-13T18:52:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c8143b70 0x7f12c80cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 0x7f12c80b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c80b1980 con 0x7f12c806d620 2024-09-13T18:52:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c7200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c80b2500 con 0x7f12c806d070 2024-09-13T18:52:24.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80b1bd0 con 0x7f12c8143b70 2024-09-13T18:52:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c6800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 0x7f12c80b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c6800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 0x7f12c80b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35696/0 (socket says 172.21.15.81:35696) 2024-09-13T18:52:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c6800700 1 -- 172.21.15.81:0/2131472002 learned_addr learned my addr 172.21.15.81:0/2131472002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:24.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c5e00700 1 --2- 172.21.15.81:0/2131472002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c8143b70 0x7f12c80cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c5e00700 1 -- 172.21.15.81:0/2131472002 >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 msgr2=0x7f12c80b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c5e00700 1 --2- 172.21.15.81:0/2131472002 >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 0x7f12c80b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c5e00700 1 -- 172.21.15.81:0/2131472002 >> v1:172.21.15.178:6789/0 conn(0x7f12c806d620 legacy=0x7f12c806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c5e00700 1 -- 172.21.15.81:0/2131472002 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80b1eb0 con 0x7f12c8143b70 2024-09-13T18:52:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c4a00700 1 -- 172.21.15.81:0/2131472002 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078079427 0 0) 0x7f12c80b1980 con 0x7f12c806d620 2024-09-13T18:52:24.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c6800700 1 --2- 172.21.15.81:0/2131472002 >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 0x7f12c80b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c5e00700 1 --2- 172.21.15.81:0/2131472002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c8143b70 0x7f12c80cde20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009850 tx=0x7f12b8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76cddac2ae74c77a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c4a00700 1 -- 172.21.15.81:0/2131472002 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8011830 con 0x7f12c8143b70 2024-09-13T18:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c4a00700 1 -- 172.21.15.81:0/2131472002 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8011990 con 0x7f12c8143b70 2024-09-13T18:52:24.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.344+0000 7f12c4a00700 1 -- 172.21.15.81:0/2131472002 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8011d40 con 0x7f12c8143b70 2024-09-13T18:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 -- 172.21.15.81:0/2131472002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c8143b70 msgr2=0x7f12c80cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 --2- 172.21.15.81:0/2131472002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c8143b70 0x7f12c80cde20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009850 tx=0x7f12b8009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 -- 172.21.15.81:0/2131472002 shutdown_connections 2024-09-13T18:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 --2- 172.21.15.81:0/2131472002 >> v2:172.21.15.81:3300/0 conn(0x7f12c806d070 0x7f12c80b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 --2- 172.21.15.81:0/2131472002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c8143b70 0x7f12c80cde20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 -- 172.21.15.81:0/2131472002 >> 172.21.15.81:0/2131472002 conn(0x7f12c806a390 msgr2=0x7f12c806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 -- 172.21.15.81:0/2131472002 shutdown_connections 2024-09-13T18:52:24.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.348+0000 7f12c7200700 1 -- 172.21.15.81:0/2131472002 wait complete. 2024-09-13T18:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 Processor -- start 2024-09-13T18:52:24.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 -- start start 2024-09-13T18:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 0x7f12c80c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c806d620 0x7f12c81f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c8143b70 0x7f12c815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81f5a20 con 0x7f12c806d070 2024-09-13T18:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81f2970 con 0x7f12c8143b70 2024-09-13T18:52:24.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c81f2c10 con 0x7f12c806d620 2024-09-13T18:52:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 0x7f12c80c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 0x7f12c80c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35710/0 (socket says 172.21.15.81:35710) 2024-09-13T18:52:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 -- 172.21.15.81:0/3289226088 learned_addr learned my addr 172.21.15.81:0/3289226088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:24.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5400700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c806d620 0x7f12c81f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c6800700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c8143b70 0x7f12c815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 -- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c806d620 msgr2=0x7f12c81f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c806d620 0x7f12c81f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 -- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c8143b70 msgr2=0x7f12c815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c8143b70 0x7f12c815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 -- 172.21.15.81:0/3289226088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c0009b30 con 0x7f12c806d070 2024-09-13T18:52:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.352+0000 7f12c5e00700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 0x7f12c80c6210 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f12b8014040 tx=0x7f12b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8019a00 con 0x7f12c806d070 2024-09-13T18:52:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b801e070 con 0x7f12c806d070 2024-09-13T18:52:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8019da0 con 0x7f12c806d070 2024-09-13T18:52:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b80094b0 con 0x7f12c806d070 2024-09-13T18:52:24.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c81f31d0 con 0x7f12c806d070 2024-09-13T18:52:24.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c80cde20 con 0x7f12c806d070 2024-09-13T18:52:24.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.356+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12b802d450 con 0x7f12c806d070 2024-09-13T18:52:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.360+0000 7f12be000700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12a8066730 0x7f12a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.360+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f12b8085340 con 0x7f12c806d070 2024-09-13T18:52:24.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.360+0000 7f12c5400700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12a8066730 0x7f12a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.360+0000 7f12c5400700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12a8066730 0x7f12a8068bf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f12c80c5030 tx=0x7f12b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:24.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.364+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12b80524d0 con 0x7f12c806d070 2024-09-13T18:52:24.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.540+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12c8071f60 con 0x7f12c806d070 2024-09-13T18:52:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12be000700 1 -- 172.21.15.81:0/3289226088 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12b8020020 con 0x7f12c806d070 2024-09-13T18:52:24.550 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:52:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12a8066730 msgr2=0x7f12a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12a8066730 0x7f12a8068bf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f12c80c5030 tx=0x7f12b4009040 comp rx=0 tx=0).stop 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 msgr2=0x7f12c80c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 0x7f12c80c6210 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f12b8014040 tx=0x7f12b8004770 comp rx=0 tx=0).stop 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 shutdown_connections 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12a8066730 0x7f12a8068bf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c8143b70 0x7f12c815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c806d620 0x7f12c81f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 --2- 172.21.15.81:0/3289226088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c806d070 0x7f12c80c6210 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 >> 172.21.15.81:0/3289226088 conn(0x7f12c806a390 msgr2=0x7f12c806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 shutdown_connections 2024-09-13T18:52:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.544+0000 7f12c7200700 1 -- 172.21.15.81:0/3289226088 wait complete. 2024-09-13T18:52:24.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:24.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.740+0000 7fddff000700 1 Processor -- start 2024-09-13T18:52:24.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.740+0000 7fddff000700 1 -- start start 2024-09-13T18:52:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddff000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fddf80cd430 0x7fddf80b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddff000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf80d1800 con 0x7fddf815e070 2024-09-13T18:52:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddff000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf815e450 con 0x7fddf80b2a80 2024-09-13T18:52:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddff000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80b2e60 con 0x7fddf80cd430 2024-09-13T18:52:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddfdc00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fddf815e070 0x7fddf80d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40710/0 (socket says 172.21.15.81:40710) 2024-09-13T18:52:24.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddfdc00700 1 -- 172.21.15.81:0/4236218760 learned_addr learned my addr 172.21.15.81:0/4236218760 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:24.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddfd200700 1 --2- 172.21.15.81:0/4236218760 >> v2:172.21.15.178:3300/0 conn(0x7fddf80cd430 0x7fddf80b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643694247 0 0) 0x7fddf80d1800 con 0x7fddf815e070 2024-09-13T18:52:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde00035d0 con 0x7fddf815e070 2024-09-13T18:52:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2497475706 0 0) 0x7fdde00035d0 con 0x7fddf815e070 2024-09-13T18:52:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 >> v2:172.21.15.178:3300/0 conn(0x7fddf80cd430 msgr2=0x7fddf80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 --2- 172.21.15.81:0/4236218760 >> v2:172.21.15.178:3300/0 conn(0x7fddf80cd430 0x7fddf80b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 >> v1:172.21.15.178:6789/0 conn(0x7fddf80b2a80 legacy=0x7fddf80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80d0050 con 0x7fddf815e070 2024-09-13T18:52:24.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fddec001670 con 0x7fddf815e070 2024-09-13T18:52:24.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddfd200700 1 --2- 172.21.15.81:0/4236218760 >> v2:172.21.15.178:3300/0 conn(0x7fddf80cd430 0x7fddf80b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:24.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 >> v1:172.21.15.81:6789/0 conn(0x7fddf815e070 legacy=0x7fddf80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdde0003a90 0x7fdde0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fdde0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0005230 0x7fdde000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80b2e60 con 0x7fdde0005230 2024-09-13T18:52:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde000c020 con 0x7fdde0004870 2024-09-13T18:52:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.744+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde000c1e0 con 0x7fdde0003a90 2024-09-13T18:52:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfe600700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0005230 0x7fdde000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fdde0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfdc00700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdde0003a90 0x7fdde0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 -- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdde0003a90 msgr2=0x7fdde0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdde0003a90 0x7fdde0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 -- 172.21.15.81:0/4236218760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0005230 msgr2=0x7fdde000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdde0005230 0x7fdde000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 -- 172.21.15.81:0/4236218760 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde00035d0 con 0x7fdde0004870 2024-09-13T18:52:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfe600700 1 -- 172.21.15.81:0/4236218760 reap_dead start 2024-09-13T18:52:24.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfdc00700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdde0003a90 0x7fdde0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:24.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddfd200700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fdde0004cf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009d40 tx=0x7fdde00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcfcc0faf7d40f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:24.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde4009e90 con 0x7fdde0004870 2024-09-13T18:52:24.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde400e970 con 0x7fdde0004870 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddf7e00700 1 -- 172.21.15.81:0/4236218760 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400ece0 con 0x7fdde0004870 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 -- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 msgr2=0x7fdde0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fdde0004cf0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009d40 tx=0x7fdde00058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 -- 172.21.15.81:0/4236218760 shutdown_connections 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 --2- 172.21.15.81:0/4236218760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fdde0004cf0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 -- 172.21.15.81:0/4236218760 >> 172.21.15.81:0/4236218760 conn(0x7fddf8071f00 msgr2=0x7fddf80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:24.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 -- 172.21.15.81:0/4236218760 shutdown_connections 2024-09-13T18:52:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.748+0000 7fddff000700 1 -- 172.21.15.81:0/4236218760 wait complete. 2024-09-13T18:52:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 Processor -- start 2024-09-13T18:52:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 -- start start 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fddf81f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddf80acc20 0x7fddf80af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 0x7fddf815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf815d5d0 con 0x7fddf815cbe0 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81f5b50 con 0x7fdde0004870 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddff000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81f5e20 con 0x7fddf80acc20 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddfe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 0x7fddf815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddfe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 0x7fddf815d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35726/0 (socket says 172.21.15.81:35726) 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.752+0000 7fddfe600700 1 -- 172.21.15.81:0/2085593749 learned_addr learned my addr 172.21.15.81:0/2085593749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfdc00700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fddf81f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfd200700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddf80acc20 0x7fddf80af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfe600700 1 -- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddf80acc20 msgr2=0x7fddf80af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfe600700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddf80acc20 0x7fddf80af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfe600700 1 -- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 msgr2=0x7fddf81f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfe600700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fddf81f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfe600700 1 -- 172.21.15.81:0/2085593749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf81f6100 con 0x7fddf815cbe0 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfd200700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddf80acc20 0x7fddf80af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:24.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfdc00700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fddf81f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:24.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddfe600700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 0x7fddf815d090 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fddf8072ab0 tx=0x7fddf000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:24.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0003c30 con 0x7fddf815cbe0 2024-09-13T18:52:24.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0003d90 con 0x7fddf815cbe0 2024-09-13T18:52:24.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf81f63e0 con 0x7fddf815cbe0 2024-09-13T18:52:24.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000db90 con 0x7fddf815cbe0 2024-09-13T18:52:24.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80c5c30 con 0x7fddf815cbe0 2024-09-13T18:52:24.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.756+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf80cd880 con 0x7fddf815cbe0 2024-09-13T18:52:24.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.760+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fddf000dcf0 con 0x7fddf815cbe0 2024-09-13T18:52:24.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.760+0000 7fddf5600700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fddd8066730 0x7fddd8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:24.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.760+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fddf0084760 con 0x7fddf815cbe0 2024-09-13T18:52:24.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.760+0000 7fddfdc00700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fddd8066730 0x7fddd8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:24.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.760+0000 7fddfdc00700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fddd8066730 0x7fddd8068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fddec000f60 tx=0x7fddec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:24.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.768+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fddf0051860 con 0x7fddf815cbe0 2024-09-13T18:52:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.992+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddf806aa40 con 0x7fddf815cbe0 2024-09-13T18:52:25.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.992+0000 7fddf5600700 1 -- 172.21.15.81:0/2085593749 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4778 (secure 0 0 0) 0x7fddf0054e80 con 0x7fddf815cbe0 2024-09-13T18:52:25.001 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:25.002 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:56.232873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6822,"mds_1":6816,"mds_2":6559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6559":{"gid":6559,"name":"a","rank":2,"incarnation":56,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fddd8066730 msgr2=0x7fddd8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fddd8066730 0x7fddd8068bf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fddec000f60 tx=0x7fddec009040 comp rx=0 tx=0).stop 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 msgr2=0x7fddf815d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 0x7fddf815d090 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fddf8072ab0 tx=0x7fddf000d430 comp rx=0 tx=0).stop 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 shutdown_connections 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fddd8066730 0x7fddd8068bf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddf815cbe0 0x7fddf815d090 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddf80acc20 0x7fddf80af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 --2- 172.21.15.81:0/2085593749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdde0004870 0x7fddf81f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 >> 172.21.15.81:0/2085593749 conn(0x7fddf8071f00 msgr2=0x7fddf80b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:24.996+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 shutdown_connections 2024-09-13T18:52:25.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.000+0000 7fddff000700 1 -- 172.21.15.81:0/2085593749 wait complete. 2024-09-13T18:52:25.008 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 63 2024-09-13T18:52:25.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:25.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 Processor -- start 2024-09-13T18:52:25.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 -- start start 2024-09-13T18:52:25.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f836c159bd0 0x7f836c0cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c071870 0x7f836c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f836c06afe0 0x7f836c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c06b490 con 0x7f836c06afe0 2024-09-13T18:52:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0720a0 con 0x7f836c159bd0 2024-09-13T18:52:25.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.192+0000 7f8372200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0707d0 con 0x7f836c071870 2024-09-13T18:52:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f836c06afe0 0x7f836c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f836c06afe0 0x7f836c0b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35736/0 (socket says 172.21.15.81:35736) 2024-09-13T18:52:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 -- 172.21.15.81:0/1573661262 learned_addr learned my addr 172.21.15.81:0/1573661262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f836be00700 1 --2- 172.21.15.81:0/1573661262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c071870 0x7f836c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8370e00700 1 --2- 172.21.15.81:0/1573661262 >> v2:172.21.15.178:3300/0 conn(0x7f836c159bd0 0x7f836c0cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 -- 172.21.15.81:0/1573661262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c071870 msgr2=0x7f836c06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 --2- 172.21.15.81:0/1573661262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c071870 0x7f836c06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 -- 172.21.15.81:0/1573661262 >> v2:172.21.15.178:3300/0 conn(0x7f836c159bd0 msgr2=0x7f836c0cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 --2- 172.21.15.81:0/1573661262 >> v2:172.21.15.178:3300/0 conn(0x7f836c159bd0 0x7f836c0cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 -- 172.21.15.81:0/1573661262 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c06fee0 con 0x7f836c06afe0 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8370e00700 1 --2- 172.21.15.81:0/1573661262 >> v2:172.21.15.178:3300/0 conn(0x7f836c159bd0 0x7f836c0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8371800700 1 --2- 172.21.15.81:0/1573661262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c06afe0 0x7f836c0b1ee0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f836c071150 tx=0x7f836400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c3ae15f4a7ed37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f836b400700 1 -- 172.21.15.81:0/1573661262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364010070 con 0x7f836c06afe0 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f836b400700 1 -- 172.21.15.81:0/1573661262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400dd80 con 0x7f836c06afe0 2024-09-13T18:52:25.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f836b400700 1 -- 172.21.15.81:0/1573661262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400b310 con 0x7f836c06afe0 2024-09-13T18:52:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 -- 172.21.15.81:0/1573661262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c06afe0 msgr2=0x7f836c0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 --2- 172.21.15.81:0/1573661262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c06afe0 0x7f836c0b1ee0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f836c071150 tx=0x7f836400d460 comp rx=0 tx=0).stop 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 -- 172.21.15.81:0/1573661262 shutdown_connections 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 --2- 172.21.15.81:0/1573661262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c06afe0 0x7f836c0b1ee0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 --2- 172.21.15.81:0/1573661262 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c071870 0x7f836c06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 --2- 172.21.15.81:0/1573661262 >> v2:172.21.15.178:3300/0 conn(0x7f836c159bd0 0x7f836c0cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 -- 172.21.15.81:0/1573661262 >> 172.21.15.81:0/1573661262 conn(0x7f836c0b0c40 msgr2=0x7f836c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 -- 172.21.15.81:0/1573661262 shutdown_connections 2024-09-13T18:52:25.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.196+0000 7f8372200700 1 -- 172.21.15.81:0/1573661262 wait complete. 2024-09-13T18:52:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 Processor -- start 2024-09-13T18:52:25.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 -- start start 2024-09-13T18:52:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c06afe0 0x7f836c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c071870 0x7f836c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c159bd0 0x7f836c152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c15ac50 con 0x7f836c159bd0 2024-09-13T18:52:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c15af30 con 0x7f836c071870 2024-09-13T18:52:25.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8372200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0aca30 con 0x7f836c06afe0 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8371800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c159bd0 0x7f836c152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8370e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c06afe0 0x7f836c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8370e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c06afe0 0x7f836c14f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48866/0 (socket says 172.21.15.81:48866) 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f8370e00700 1 -- 172.21.15.81:0/2311730529 learned_addr learned my addr 172.21.15.81:0/2311730529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.200+0000 7f836be00700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c071870 0x7f836c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8371800700 1 -- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c06afe0 msgr2=0x7f836c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8371800700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c06afe0 0x7f836c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8371800700 1 -- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c071870 msgr2=0x7f836c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8371800700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c071870 0x7f836c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8371800700 1 -- 172.21.15.81:0/2311730529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836400bd40 con 0x7f836c159bd0 2024-09-13T18:52:25.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8371800700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c159bd0 0x7f836c152020 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8364017000 tx=0x7f8364004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364009a10 con 0x7f836c159bd0 2024-09-13T18:52:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8364009b70 con 0x7f836c159bd0 2024-09-13T18:52:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364003e30 con 0x7f836c159bd0 2024-09-13T18:52:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c0acd10 con 0x7f836c159bd0 2024-09-13T18:52:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c15bab0 con 0x7f836c159bd0 2024-09-13T18:52:25.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.204+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c0ac890 con 0x7f836c159bd0 2024-09-13T18:52:25.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.208+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8364004040 con 0x7f836c159bd0 2024-09-13T18:52:25.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.208+0000 7f8368c00700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f834c066730 0x7f834c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.208+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f8364085800 con 0x7f836c159bd0 2024-09-13T18:52:25.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.208+0000 7f8370e00700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f834c066730 0x7f834c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.208+0000 7f8370e00700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f834c066730 0x7f834c068bf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8360006fd0 tx=0x7f8360008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:25.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.216+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f836c0ac890 con 0x7f836c159bd0 2024-09-13T18:52:25.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.408+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f836c0ac890 con 0x7f836c159bd0 2024-09-13T18:52:25.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.408+0000 7f8368c00700 1 -- 172.21.15.81:0/2311730529 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16955 (secure 0 0 0) 0x7f836c0ac890 con 0x7f836c159bd0 2024-09-13T18:52:25.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:25.418 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:00.266146+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.13","mappings":[{"from":1,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.38","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:25.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f834c066730 msgr2=0x7f834c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f834c066730 0x7f834c068bf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8360006fd0 tx=0x7f8360008040 comp rx=0 tx=0).stop 2024-09-13T18:52:25.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c159bd0 msgr2=0x7f836c152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c159bd0 0x7f836c152020 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8364017000 tx=0x7f8364004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 shutdown_connections 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f834c066730 0x7f834c068bf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f836c159bd0 0x7f836c152020 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c071870 0x7f836c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 --2- 172.21.15.81:0/2311730529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c06afe0 0x7f836c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 >> 172.21.15.81:0/2311730529 conn(0x7f836c0b0c40 msgr2=0x7f836c0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 shutdown_connections 2024-09-13T18:52:25.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.412+0000 7f8372200700 1 -- 172.21.15.81:0/2311730529 wait complete. 2024-09-13T18:52:25.445 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:52:25.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.604+0000 7f3e9a200700 1 Processor -- start 2024-09-13T18:52:25.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.604+0000 7f3e9a200700 1 -- start start 2024-09-13T18:52:25.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e9a200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3e941573b0 0x7f3e940cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e9a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 0x7f3e9406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e9a200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e940ad480 con 0x7f3e940ce2f0 2024-09-13T18:52:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e9a200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e94157790 con 0x7f3e941573b0 2024-09-13T18:52:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e9a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e940ad6d0 con 0x7f3e9406ace0 2024-09-13T18:52:25.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 0x7f3e9406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 0x7f3e9406ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:48880/0 (socket says 172.21.15.81:48880) 2024-09-13T18:52:25.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 -- 172.21.15.81:0/2445918798 learned_addr learned my addr 172.21.15.81:0/2445918798 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:25.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e8be00700 1 --1- 172.21.15.81:0/2445918798 >> v1:172.21.15.81:6789/0 conn(0x7f3e940ce2f0 0x7f3e9406a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40718/0 (socket says 172.21.15.81:40718) 2024-09-13T18:52:25.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93400700 1 --2- 172.21.15.81:0/2445918798 >> v2:172.21.15.178:3300/0 conn(0x7f3e941573b0 0x7f3e940cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 -- 172.21.15.81:0/2445918798 >> v2:172.21.15.178:3300/0 conn(0x7f3e941573b0 msgr2=0x7f3e940cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:25.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e92a00700 1 -- 172.21.15.81:0/2445918798 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495707928 0 0) 0x7f3e940ad480 con 0x7f3e940ce2f0 2024-09-13T18:52:25.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 --2- 172.21.15.81:0/2445918798 >> v2:172.21.15.178:3300/0 conn(0x7f3e941573b0 0x7f3e940cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 -- 172.21.15.81:0/2445918798 >> v1:172.21.15.81:6789/0 conn(0x7f3e940ce2f0 legacy=0x7f3e9406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.608+0000 7f3e93e00700 1 -- 172.21.15.81:0/2445918798 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940ad9b0 con 0x7f3e9406ace0 2024-09-13T18:52:25.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e93e00700 1 --2- 172.21.15.81:0/2445918798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 0x7f3e9406ff60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009e50 tx=0x7f3e8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e28f8a5af16392b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e92a00700 1 -- 172.21.15.81:0/2445918798 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00e070 con 0x7f3e9406ace0 2024-09-13T18:52:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e92a00700 1 -- 172.21.15.81:0/2445918798 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c00b910 con 0x7f3e9406ace0 2024-09-13T18:52:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e92a00700 1 -- 172.21.15.81:0/2445918798 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00bcc0 con 0x7f3e9406ace0 2024-09-13T18:52:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 -- 172.21.15.81:0/2445918798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 msgr2=0x7f3e9406ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 --2- 172.21.15.81:0/2445918798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 0x7f3e9406ff60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009e50 tx=0x7f3e8c00b330 comp rx=0 tx=0).stop 2024-09-13T18:52:25.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 -- 172.21.15.81:0/2445918798 shutdown_connections 2024-09-13T18:52:25.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 --2- 172.21.15.81:0/2445918798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9406ace0 0x7f3e9406ff60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 --2- 172.21.15.81:0/2445918798 >> v2:172.21.15.178:3300/0 conn(0x7f3e941573b0 0x7f3e940cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 -- 172.21.15.81:0/2445918798 >> 172.21.15.81:0/2445918798 conn(0x7f3e940b08d0 msgr2=0x7f3e940b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:25.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 -- 172.21.15.81:0/2445918798 shutdown_connections 2024-09-13T18:52:25.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.612+0000 7f3e9a200700 1 -- 172.21.15.81:0/2445918798 wait complete. 2024-09-13T18:52:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 Processor -- start 2024-09-13T18:52:25.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 -- start start 2024-09-13T18:52:25.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9406ace0 0x7f3e9414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 0x7f3e941e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e941573b0 0x7f3e941e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94151f30 con 0x7f3e940ce2f0 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94160170 con 0x7f3e9406ace0 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e9a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e94152160 con 0x7f3e941573b0 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e8be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 0x7f3e941e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e8be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 0x7f3e941e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35742/0 (socket says 172.21.15.81:35742) 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e8be00700 1 -- 172.21.15.81:0/769689348 learned_addr learned my addr 172.21.15.81:0/769689348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e93400700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9406ace0 0x7f3e9414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.616+0000 7f3e93e00700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e941573b0 0x7f3e941e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8be00700 1 -- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e941573b0 msgr2=0x7f3e941e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8be00700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e941573b0 0x7f3e941e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8be00700 1 -- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9406ace0 msgr2=0x7f3e9414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8be00700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9406ace0 0x7f3e9414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8be00700 1 -- 172.21.15.81:0/769689348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c009b30 con 0x7f3e940ce2f0 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8be00700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 0x7f3e941e66d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00c580 tx=0x7f3e7c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c004ca0 con 0x7f3e940ce2f0 2024-09-13T18:52:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c004e20 con 0x7f3e940ce2f0 2024-09-13T18:52:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c007310 con 0x7f3e940ce2f0 2024-09-13T18:52:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9415f8d0 con 0x7f3e940ce2f0 2024-09-13T18:52:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9415fe90 con 0x7f3e940ce2f0 2024-09-13T18:52:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.620+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9406ff60 con 0x7f3e940ce2f0 2024-09-13T18:52:25.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.624+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e7c007470 con 0x7f3e940ce2f0 2024-09-13T18:52:25.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.624+0000 7f3e8b400700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e70066730 0x7f3e70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.624+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f3e7c083fe0 con 0x7f3e940ce2f0 2024-09-13T18:52:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.624+0000 7f3e93400700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e70066730 0x7f3e70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:25.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.628+0000 7f3e93400700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e70066730 0x7f3e70068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3e940b0cd0 tx=0x7f3e84009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.632+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e7c051140 con 0x7f3e940ce2f0 2024-09-13T18:52:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.860+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e940cde10 con 0x7f3e940ce2f0 2024-09-13T18:52:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.860+0000 7f3e8b400700 1 -- 172.21.15.81:0/769689348 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4778 (secure 0 0 0) 0x7f3e7c007720 con 0x7f3e940ce2f0 2024-09-13T18:52:25.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:25.869 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:56.232873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6822,"mds_1":6816,"mds_2":6559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6559":{"gid":6559,"name":"a","rank":2,"incarnation":56,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:52:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e70066730 msgr2=0x7f3e70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e70066730 0x7f3e70068bf0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3e940b0cd0 tx=0x7f3e84009240 comp rx=0 tx=0).stop 2024-09-13T18:52:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 msgr2=0x7f3e941e66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 0x7f3e941e66d0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00c580 tx=0x7f3e7c00c890 comp rx=0 tx=0).stop 2024-09-13T18:52:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 shutdown_connections 2024-09-13T18:52:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3e70066730 0x7f3e70068bf0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e941573b0 0x7f3e941e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e940ce2f0 0x7f3e941e66d0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 --2- 172.21.15.81:0/769689348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9406ace0 0x7f3e9414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 >> 172.21.15.81:0/769689348 conn(0x7f3e940b08d0 msgr2=0x7f3e940708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 shutdown_connections 2024-09-13T18:52:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:25.864+0000 7f3e9a200700 1 -- 172.21.15.81:0/769689348 wait complete. 2024-09-13T18:52:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 63 2024-09-13T18:52:25.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 Processor -- start 2024-09-13T18:52:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 -- start start 2024-09-13T18:52:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbbe815b700 0x7fbbe815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbe806a5d0 0x7fbbe806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe80cdd90 con 0x7fbbe806c460 2024-09-13T18:52:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe806afa0 con 0x7fbbe806a5d0 2024-09-13T18:52:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbed600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe806ce10 con 0x7fbbe815b700 2024-09-13T18:52:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbe806a5d0 0x7fbbe806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbbe806a5d0 0x7fbbe806aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35748/0 (socket says 172.21.15.81:35748) 2024-09-13T18:52:26.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 -- 172.21.15.81:0/2578569863 learned_addr learned my addr 172.21.15.81:0/2578569863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe6a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbbe815b700 0x7fbbe815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 -- 172.21.15.81:0/2578569863 >> v2:172.21.15.178:3300/0 conn(0x7fbbe815b700 msgr2=0x7fbbe815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 --2- 172.21.15.81:0/2578569863 >> v2:172.21.15.178:3300/0 conn(0x7fbbe815b700 0x7fbbe815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 -- 172.21.15.81:0/2578569863 >> v1:172.21.15.178:6789/0 conn(0x7fbbe806c460 legacy=0x7fbbe806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.056+0000 7fbbe7400700 1 -- 172.21.15.81:0/2578569863 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe815c020 con 0x7fbbe806a5d0 2024-09-13T18:52:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbe7400700 1 --2- 172.21.15.81:0/2578569863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806a5d0 0x7fbbe806aa60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806def0 tx=0x7fbbe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b540ce688e76477 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbe6000700 1 -- 172.21.15.81:0/2578569863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000e070 con 0x7fbbe806a5d0 2024-09-13T18:52:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbe6000700 1 -- 172.21.15.81:0/2578569863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe000b910 con 0x7fbbe806a5d0 2024-09-13T18:52:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbe6000700 1 -- 172.21.15.81:0/2578569863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe000bcc0 con 0x7fbbe806a5d0 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 -- 172.21.15.81:0/2578569863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806a5d0 msgr2=0x7fbbe806aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 --2- 172.21.15.81:0/2578569863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806a5d0 0x7fbbe806aa60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806def0 tx=0x7fbbe000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 -- 172.21.15.81:0/2578569863 shutdown_connections 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 --2- 172.21.15.81:0/2578569863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806a5d0 0x7fbbe806aa60 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 --2- 172.21.15.81:0/2578569863 >> v2:172.21.15.178:3300/0 conn(0x7fbbe815b700 0x7fbbe815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 -- 172.21.15.81:0/2578569863 >> 172.21.15.81:0/2578569863 conn(0x7fbbe80b08d0 msgr2=0x7fbbe80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 -- 172.21.15.81:0/2578569863 shutdown_connections 2024-09-13T18:52:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.060+0000 7fbbed600700 1 -- 172.21.15.81:0/2578569863 wait complete. 2024-09-13T18:52:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 Processor -- start 2024-09-13T18:52:26.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 -- start start 2024-09-13T18:52:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbe806a5d0 0x7fbbe80ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 0x7fbbe80af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbe815b700 0x7fbbe80aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80ad9e0 con 0x7fbbe806c460 2024-09-13T18:52:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80acb30 con 0x7fbbe806a5d0 2024-09-13T18:52:26.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbed600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80acdd0 con 0x7fbbe815b700 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 0x7fbbe80af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 0x7fbbe80af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35752/0 (socket says 172.21.15.81:35752) 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 -- 172.21.15.81:0/4010858919 learned_addr learned my addr 172.21.15.81:0/4010858919 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbe6a00700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbe806a5d0 0x7fbbe80ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbe7400700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbe815b700 0x7fbbe80aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 -- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbe815b700 msgr2=0x7fbbe80aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbe815b700 0x7fbbe80aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 -- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbe806a5d0 msgr2=0x7fbbe80ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbe806a5d0 0x7fbbe80ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 -- 172.21.15.81:0/4010858919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe0009b30 con 0x7fbbe806c460 2024-09-13T18:52:26.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbe7400700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbe815b700 0x7fbbe80aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.064+0000 7fbbde000700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 0x7fbbe80af010 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c500 tx=0x7fbbd000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.068+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00052d0 con 0x7fbbe806c460 2024-09-13T18:52:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.068+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0005430 con 0x7fbbe806c460 2024-09-13T18:52:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.068+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe80ad0b0 con 0x7fbbe806c460 2024-09-13T18:52:26.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.068+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00055a0 con 0x7fbbe806c460 2024-09-13T18:52:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.068+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe80ad670 con 0x7fbbe806c460 2024-09-13T18:52:26.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.068+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe80adb50 con 0x7fbbe806c460 2024-09-13T18:52:26.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.072+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbbd00038e0 con 0x7fbbe806c460 2024-09-13T18:52:26.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.072+0000 7fbbdf400700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbbc4066730 0x7fbbc4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.072+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7fbbd0083820 con 0x7fbbe806c460 2024-09-13T18:52:26.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.072+0000 7fbbe6a00700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbbc4066730 0x7fbbc4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.072+0000 7fbbe6a00700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbbc4066730 0x7fbbc4068bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80ce720 tx=0x7fbbd8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.080+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbbd0050920 con 0x7fbbe806c460 2024-09-13T18:52:26.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.308+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbe806aa60 con 0x7fbbe806c460 2024-09-13T18:52:26.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.308+0000 7fbbdf400700 1 -- 172.21.15.81:0/4010858919 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4778 (secure 0 0 0) 0x7fbbd0053f40 con 0x7fbbe806c460 2024-09-13T18:52:26.317 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:26.317 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:51:17.898837+0000","modified":"2024-09-13T18:51:56.232873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6822,"mds_1":6816,"mds_2":6559},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6559":{"gid":6559,"name":"a","rank":2,"incarnation":56,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6835/3088682584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3088682584},{"type":"v1","addr":"172.21.15.81:6835","nonce":3088682584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6816":{"gid":6816,"name":"c","rank":1,"incarnation":54,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2228642132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2228642132},{"type":"v1","addr":"172.21.15.81:6837","nonce":2228642132}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_6822":{"gid":6822,"name":"d","rank":0,"incarnation":48,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/3000844155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000844155},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000844155}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:52:26.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbbc4066730 msgr2=0x7fbbc4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbbc4066730 0x7fbbc4068bf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbbe80ce720 tx=0x7fbbd8009240 comp rx=0 tx=0).stop 2024-09-13T18:52:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 msgr2=0x7fbbe80af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 0x7fbbe80af010 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c500 tx=0x7fbbd000c810 comp rx=0 tx=0).stop 2024-09-13T18:52:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 shutdown_connections 2024-09-13T18:52:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbbc4066730 0x7fbbc4068bf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbe815b700 0x7fbbe80aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbbe806c460 0x7fbbe80af010 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 --2- 172.21.15.81:0/4010858919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbe806a5d0 0x7fbbe80ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 >> 172.21.15.81:0/4010858919 conn(0x7fbbe80b08d0 msgr2=0x7fbbe81e7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 shutdown_connections 2024-09-13T18:52:26.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.312+0000 7fbbed600700 1 -- 172.21.15.81:0/4010858919 wait complete. 2024-09-13T18:52:26.322 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 63 2024-09-13T18:52:26.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:26.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.496+0000 7f93fea00700 1 Processor -- start 2024-09-13T18:52:26.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fea00700 1 -- start start 2024-09-13T18:52:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f93f806c460 0x7f93f806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93f806a5d0 0x7f93f806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fea00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f80cdd90 con 0x7f93f815b700 2024-09-13T18:52:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fea00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f806ce10 con 0x7f93f806a5d0 2024-09-13T18:52:26.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fea00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f806af50 con 0x7f93f806c460 2024-09-13T18:52:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93f806a5d0 0x7f93f806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.500+0000 7f93fca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f93f806a5d0 0x7f93f806aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35754/0 (socket says 172.21.15.81:35754) 2024-09-13T18:52:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fca00700 1 -- 172.21.15.81:0/165968185 learned_addr learned my addr 172.21.15.81:0/165968185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93f7400700 1 --2- 172.21.15.81:0/165968185 >> v2:172.21.15.178:3300/0 conn(0x7f93f806c460 0x7f93f806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fca00700 1 -- 172.21.15.81:0/165968185 >> v2:172.21.15.178:3300/0 conn(0x7f93f806c460 msgr2=0x7f93f806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fca00700 1 --2- 172.21.15.81:0/165968185 >> v2:172.21.15.178:3300/0 conn(0x7f93f806c460 0x7f93f806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fca00700 1 -- 172.21.15.81:0/165968185 >> v1:172.21.15.178:6789/0 conn(0x7f93f815b700 legacy=0x7f93f815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fca00700 1 -- 172.21.15.81:0/165968185 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f806d7e0 con 0x7f93f806a5d0 2024-09-13T18:52:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fca00700 1 --2- 172.21.15.81:0/165968185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806a5d0 0x7f93f806aa10 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f93f806dcd0 tx=0x7f93f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7a0adbdad77d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93f6a00700 1 -- 172.21.15.81:0/165968185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000e070 con 0x7f93f806a5d0 2024-09-13T18:52:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93f6a00700 1 -- 172.21.15.81:0/165968185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f000b910 con 0x7f93f806a5d0 2024-09-13T18:52:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93f6a00700 1 -- 172.21.15.81:0/165968185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f000bcc0 con 0x7f93f806a5d0 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 -- 172.21.15.81:0/165968185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806a5d0 msgr2=0x7f93f806aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 --2- 172.21.15.81:0/165968185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806a5d0 0x7f93f806aa10 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f93f806dcd0 tx=0x7f93f000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 -- 172.21.15.81:0/165968185 shutdown_connections 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 --2- 172.21.15.81:0/165968185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806a5d0 0x7f93f806aa10 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 --2- 172.21.15.81:0/165968185 >> v2:172.21.15.178:3300/0 conn(0x7f93f806c460 0x7f93f806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 -- 172.21.15.81:0/165968185 >> 172.21.15.81:0/165968185 conn(0x7f93f80b08d0 msgr2=0x7f93f80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 -- 172.21.15.81:0/165968185 shutdown_connections 2024-09-13T18:52:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.504+0000 7f93fea00700 1 -- 172.21.15.81:0/165968185 wait complete. 2024-09-13T18:52:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 Processor -- start 2024-09-13T18:52:26.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 -- start start 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f806a5d0 0x7f93f80ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 0x7f93f81503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93f815b700 0x7f93f815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8071970 con 0x7f93f806c460 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f8070df0 con 0x7f93f806a5d0 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f80710d0 con 0x7f93f815b700 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 0x7f93f81503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 0x7f93f81503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35768/0 (socket says 172.21.15.81:35768) 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 -- 172.21.15.81:0/2840208993 learned_addr learned my addr 172.21.15.81:0/2840208993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fca00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93f815b700 0x7f93f815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7e00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f806a5d0 0x7f93f80ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 -- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93f815b700 msgr2=0x7f93f815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93f815b700 0x7f93f815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 -- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f806a5d0 msgr2=0x7f93f80ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f806a5d0 0x7f93f80ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 -- 172.21.15.81:0/2840208993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0009b30 con 0x7f93f806c460 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7e00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f806a5d0 0x7f93f80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93f7400700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 0x7f93f81503d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f93e400e9d0 tx=0x7f93e400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4009720 con 0x7f93f806c460 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e400c850 con 0x7f93f806c460 2024-09-13T18:52:26.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.508+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f80713b0 con 0x7f93f806c460 2024-09-13T18:52:26.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.512+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e400cbc0 con 0x7f93f806c460 2024-09-13T18:52:26.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.512+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f80adf40 con 0x7f93f806c460 2024-09-13T18:52:26.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.512+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f80ae3d0 con 0x7f93f806c460 2024-09-13T18:52:26.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.512+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93e400cd20 con 0x7f93f806c460 2024-09-13T18:52:26.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.512+0000 7f93efe00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93d8066730 0x7f93d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.512+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f93e40845d0 con 0x7f93f806c460 2024-09-13T18:52:26.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.516+0000 7f93f7e00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93d8066730 0x7f93d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.516+0000 7f93f7e00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93d8066730 0x7f93d8068bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f93e8000f60 tx=0x7f93e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.520+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93e4051650 con 0x7f93f806c460 2024-09-13T18:52:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.708+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93f806aa10 con 0x7f93f806c460 2024-09-13T18:52:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.708+0000 7f93efe00700 1 -- 172.21.15.81:0/2840208993 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16955 (secure 0 0 0) 0x7f93e4054c70 con 0x7f93f806c460 2024-09-13T18:52:26.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:26.717 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:00.266146+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:51:15.977135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-09-13T18:51:16.901677+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.7","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.13","mappings":[{"from":1,"to":3}]},{"pgid":"10.2f","mappings":[{"from":4,"to":5}]},{"pgid":"10.38","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93d8066730 msgr2=0x7f93d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93d8066730 0x7f93d8068bf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f93e8000f60 tx=0x7f93e8009040 comp rx=0 tx=0).stop 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 msgr2=0x7f93f81503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 0x7f93f81503d0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f93e400e9d0 tx=0x7f93e400ed90 comp rx=0 tx=0).stop 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 shutdown_connections 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93d8066730 0x7f93d8068bf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93f815b700 0x7f93f815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93f806c460 0x7f93f81503d0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 --2- 172.21.15.81:0/2840208993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93f806a5d0 0x7f93f80ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 >> 172.21.15.81:0/2840208993 conn(0x7f93f80b08d0 msgr2=0x7f93f81514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 shutdown_connections 2024-09-13T18:52:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.712+0000 7f93fea00700 1 -- 172.21.15.81:0/2840208993 wait complete. 2024-09-13T18:52:26.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:52:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.892+0000 7f3d73e00700 1 Processor -- start 2024-09-13T18:52:26.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.892+0000 7f3d73e00700 1 -- start start 2024-09-13T18:52:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d740ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d7406bae0 0x7f3d740cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7406aa40 con 0x7f3d740b4df0 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7406ad20 con 0x7f3d7406bae0 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7406b000 con 0x7f3d741444f0 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d72000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d7406bae0 0x7f3d740cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3d740b4df0 0x7f3d74066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47250/0 (socket says 172.21.15.81:47250) 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d73400700 1 -- 172.21.15.81:0/3731557419 learned_addr learned my addr 172.21.15.81:0/3731557419 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d72a00700 1 --2- 172.21.15.81:0/3731557419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d740ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.896+0000 7f3d71600700 1 -- 172.21.15.81:0/3731557419 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402873625 0 0) 0x7f3d7406aa40 con 0x7f3d740b4df0 2024-09-13T18:52:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d71600700 1 -- 172.21.15.81:0/3731557419 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d580035d0 con 0x7f3d740b4df0 2024-09-13T18:52:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d72000700 1 -- 172.21.15.81:0/3731557419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 msgr2=0x7f3d740ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d72000700 1 --2- 172.21.15.81:0/3731557419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d740ceec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d72000700 1 -- 172.21.15.81:0/3731557419 >> v1:172.21.15.81:6789/0 conn(0x7f3d740b4df0 legacy=0x7f3d74066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d72000700 1 -- 172.21.15.81:0/3731557419 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7406b2e0 con 0x7f3d7406bae0 2024-09-13T18:52:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d72000700 1 --2- 172.21.15.81:0/3731557419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7406bae0 0x7f3d740cf400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009850 tx=0x7f3d60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf503ea35d4e216 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d71600700 1 -- 172.21.15.81:0/3731557419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60011830 con 0x7f3d7406bae0 2024-09-13T18:52:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d71600700 1 -- 172.21.15.81:0/3731557419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d60011990 con 0x7f3d7406bae0 2024-09-13T18:52:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d71600700 1 -- 172.21.15.81:0/3731557419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60011d40 con 0x7f3d7406bae0 2024-09-13T18:52:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 -- 172.21.15.81:0/3731557419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7406bae0 msgr2=0x7f3d740cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3731557419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7406bae0 0x7f3d740cf400 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3d60009850 tx=0x7f3d60009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 -- 172.21.15.81:0/3731557419 shutdown_connections 2024-09-13T18:52:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3731557419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d7406bae0 0x7f3d740cf400 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3731557419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d740ceec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 -- 172.21.15.81:0/3731557419 >> 172.21.15.81:0/3731557419 conn(0x7f3d74070d10 msgr2=0x7f3d740710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 -- 172.21.15.81:0/3731557419 shutdown_connections 2024-09-13T18:52:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.900+0000 7f3d73e00700 1 -- 172.21.15.81:0/3731557419 wait complete. 2024-09-13T18:52:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 Processor -- start 2024-09-13T18:52:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 -- start start 2024-09-13T18:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7406bae0 0x7f3d74141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 0x7f3d741e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d74142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741e41d0 con 0x7f3d740b4df0 2024-09-13T18:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741415b0 con 0x7f3d7406bae0 2024-09-13T18:52:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741e35c0 con 0x7f3d741444f0 2024-09-13T18:52:26.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 0x7f3d741e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 0x7f3d741e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51408/0 (socket says 172.21.15.81:51408) 2024-09-13T18:52:26.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 -- 172.21.15.81:0/3400592654 learned_addr learned my addr 172.21.15.81:0/3400592654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:26.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72a00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7406bae0 0x7f3d74141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73400700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d74142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 -- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 msgr2=0x7f3d74142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d74142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 -- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7406bae0 msgr2=0x7f3d74141070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7406bae0 0x7f3d74141070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 -- 172.21.15.81:0/3400592654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600094b0 con 0x7f3d740b4df0 2024-09-13T18:52:26.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d72000700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 0x7f3d741e4660 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3d600090b0 tx=0x7f3d60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60004480 con 0x7f3d740b4df0 2024-09-13T18:52:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6001f070 con 0x7f3d740b4df0 2024-09-13T18:52:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60003900 con 0x7f3d740b4df0 2024-09-13T18:52:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d741e38a0 con 0x7f3d740b4df0 2024-09-13T18:52:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.904+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d741e3e60 con 0x7f3d740b4df0 2024-09-13T18:52:26.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.908+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d741e4380 con 0x7f3d740b4df0 2024-09-13T18:52:26.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.908+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d60021030 con 0x7f3d740b4df0 2024-09-13T18:52:26.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.912+0000 7f3d6aa00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d54066760 0x7f3d54068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:26.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.912+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6174+0+0 (secure 0 0 0) 0x7f3d60085950 con 0x7f3d740b4df0 2024-09-13T18:52:26.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.912+0000 7f3d72a00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d54066760 0x7f3d54068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:26.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.912+0000 7f3d72a00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d54066760 0x7f3d54068c20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d741e34b0 tx=0x7f3d64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:26.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:26.916+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3d60052d80 con 0x7f3d740b4df0 2024-09-13T18:52:27.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.128+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3d740ceec0 con 0x7f3d740b4df0 2024-09-13T18:52:27.137 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:52:27.128+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:52:27.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.144+0000 7f3d6aa00700 1 -- 172.21.15.81:0/3400592654 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3d60006ce0 con 0x7f3d740b4df0 2024-09-13T18:52:27.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d54066760 msgr2=0x7f3d54068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:27.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d54066760 0x7f3d54068c20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d741e34b0 tx=0x7f3d64008040 comp rx=0 tx=0).stop 2024-09-13T18:52:27.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 msgr2=0x7f3d741e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 0x7f3d741e4660 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3d600090b0 tx=0x7f3d60004770 comp rx=0 tx=0).stop 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 shutdown_connections 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3d54066760 0x7f3d54068c20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d741444f0 0x7f3d74142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d740b4df0 0x7f3d741e4660 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 --2- 172.21.15.81:0/3400592654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7406bae0 0x7f3d74141070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 >> 172.21.15.81:0/3400592654 conn(0x7f3d74070d10 msgr2=0x7f3d740b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 shutdown_connections 2024-09-13T18:52:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.148+0000 7f3d73e00700 1 -- 172.21.15.81:0/3400592654 wait complete. 2024-09-13T18:52:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:52:27.166 INFO:tasks.ceph.mds.a.smithi081.stderr: -1364> 2024-09-13T18:51:48.621+0000 7f1c24800700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:51:30.989410+0000 1=0+1) n(v0 rc2024-09-13T18:51:30.989410+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6969 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55bb5ce50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.989410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:30.989410+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.989410+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:51:30.989410+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:52:27.166 INFO:tasks.ceph.mds.a.smithi081.stderr: -1339> 2024-09-13T18:51:48.621+0000 7f1c24800700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/AsLsXsFsx@2},l=6969 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55bb5ddaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:52:27.167 INFO:tasks.ceph.mds.c.smithi081.stderr: -1469> 2024-09-13T18:51:48.617+0000 7f8002e00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1) n(v2 rc2024-09-13T18:51:31.261405+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6969 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55a9e2ae3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:31.261405+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:51:31.261405+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:52:27.167 INFO:tasks.ceph.mds.c.smithi081.stderr: -1347> 2024-09-13T18:51:48.621+0000 7f800a600700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1) n(v1 rc2024-09-13T18:51:31.261405+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={6969=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55a9e2ae2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:30.989410+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.985410+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:51:31.261405+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:52:27.168 INFO:tasks.ceph.mds.d.smithi178.stderr: -7823> 2024-09-13T18:51:33.401+0000 7f0767400700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:52:27.174 INFO:tasks.ceph.mds.d.smithi178.stderr: -3438> 2024-09-13T18:51:48.620+0000 7f0762e00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1) n(v3 rc2024-09-13T18:51:31.261405+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={6969=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6969 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55e96a2ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:31.261405+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:51:31.261405+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:52:27.174 INFO:tasks.ceph.mds.d.smithi178.stderr: -3329> 2024-09-13T18:51:48.620+0000 7f076a600700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1) n(v4 rc2024-09-13T18:51:31.261405+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={6969=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55e96a2aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:51:31.261405+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:51:30.981410+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:51:31.261405+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:52:27.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:52:27.218 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:52:27.218 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:52:27.229 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:52:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.340+0000 7f790a000700 1 Processor -- start 2024-09-13T18:52:27.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.340+0000 7f790a000700 1 -- start start 2024-09-13T18:52:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f790a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7904143b70 0x7f79040cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f790a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f790406d070 0x7f79040b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f790a000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79040b1980 con 0x7f790406d620 2024-09-13T18:52:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f790a000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040b2500 con 0x7f7904143b70 2024-09-13T18:52:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f790a000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040b1bd0 con 0x7f790406d070 2024-09-13T18:52:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7908c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7904143b70 0x7f79040cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f790406d620 0x7f790406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:55258/0 (socket says 172.21.15.81:55258) 2024-09-13T18:52:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903e00700 1 -- 172.21.15.81:0/867036175 learned_addr learned my addr 172.21.15.81:0/867036175 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7909600700 1 --2- 172.21.15.81:0/867036175 >> v2:172.21.15.178:3300/0 conn(0x7f790406d070 0x7f79040b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903400700 1 -- 172.21.15.81:0/867036175 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448531482 0 0) 0x7f79040b1980 con 0x7f790406d620 2024-09-13T18:52:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903400700 1 -- 172.21.15.81:0/867036175 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ec0035d0 con 0x7f790406d620 2024-09-13T18:52:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7908c00700 1 -- 172.21.15.81:0/867036175 >> v2:172.21.15.178:3300/0 conn(0x7f790406d070 msgr2=0x7f79040b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7908c00700 1 --2- 172.21.15.81:0/867036175 >> v2:172.21.15.178:3300/0 conn(0x7f790406d070 0x7f79040b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7908c00700 1 -- 172.21.15.81:0/867036175 >> v1:172.21.15.178:6789/0 conn(0x7f790406d620 legacy=0x7f790406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7908c00700 1 -- 172.21.15.81:0/867036175 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040b1eb0 con 0x7f7904143b70 2024-09-13T18:52:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7908c00700 1 --2- 172.21.15.81:0/867036175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f79040cde20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f79040cb4d0 tx=0x7f78f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2c980dc0b37da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903400700 1 -- 172.21.15.81:0/867036175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8011830 con 0x7f7904143b70 2024-09-13T18:52:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903400700 1 -- 172.21.15.81:0/867036175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8011990 con 0x7f7904143b70 2024-09-13T18:52:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.344+0000 7f7903400700 1 -- 172.21.15.81:0/867036175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8011d00 con 0x7f7904143b70 2024-09-13T18:52:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 -- 172.21.15.81:0/867036175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 msgr2=0x7f79040cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 --2- 172.21.15.81:0/867036175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f79040cde20 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f79040cb4d0 tx=0x7f78f8009b30 comp rx=0 tx=0).stop 2024-09-13T18:52:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 -- 172.21.15.81:0/867036175 shutdown_connections 2024-09-13T18:52:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 --2- 172.21.15.81:0/867036175 >> v2:172.21.15.178:3300/0 conn(0x7f790406d070 0x7f79040b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 --2- 172.21.15.81:0/867036175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f79040cde20 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 -- 172.21.15.81:0/867036175 >> 172.21.15.81:0/867036175 conn(0x7f790406a390 msgr2=0x7f790406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 -- 172.21.15.81:0/867036175 shutdown_connections 2024-09-13T18:52:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.348+0000 7f790a000700 1 -- 172.21.15.81:0/867036175 wait complete. 2024-09-13T18:52:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 Processor -- start 2024-09-13T18:52:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 -- start start 2024-09-13T18:52:27.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f790406d070 0x7f790413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:27.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 0x7f790406c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:27.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f790406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:27.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790413fd50 con 0x7f7904143b70 2024-09-13T18:52:27.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041573c0 con 0x7f790406d070 2024-09-13T18:52:27.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f790a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7904142fe0 con 0x7f790406d620 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f7909600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f790406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f7908c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f790406d070 0x7f790413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f7903e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 0x7f790406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f7903e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 0x7f790406c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49334/0 (socket says 172.21.15.81:49334) 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.352+0000 7f7903e00700 1 -- 172.21.15.81:0/1834839177 learned_addr learned my addr 172.21.15.81:0/1834839177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7903e00700 1 -- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f790406d070 msgr2=0x7f790413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7903e00700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f790406d070 0x7f790413f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7903e00700 1 -- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 msgr2=0x7f790406c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:27.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7903e00700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f790406c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7903e00700 1 -- 172.21.15.81:0/1834839177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80094b0 con 0x7f790406d620 2024-09-13T18:52:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7909600700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f790406c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7903e00700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 0x7f790406c060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c520 tx=0x7f78f000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0005d90 con 0x7f790406d620 2024-09-13T18:52:27.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f00070d0 con 0x7f790406d620 2024-09-13T18:52:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7904157610 con 0x7f790406d620 2024-09-13T18:52:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0007440 con 0x7f790406d620 2024-09-13T18:52:27.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904157bd0 con 0x7f790406d620 2024-09-13T18:52:27.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.356+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79040cde20 con 0x7f790406d620 2024-09-13T18:52:27.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.360+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f78f00075a0 con 0x7f790406d620 2024-09-13T18:52:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.360+0000 7f7900c00700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f78e4066760 0x7f78e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.360+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6432+0+0 (secure 0 0 0) 0x7f78f0083670 con 0x7f790406d620 2024-09-13T18:52:27.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.360+0000 7f7908c00700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f78e4066760 0x7f78e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:27.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.360+0000 7f7908c00700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f78e4066760 0x7f78e4068c20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.368+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f78f0050850 con 0x7f790406d620 2024-09-13T18:52:27.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:27.596+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7904071f60 con 0x7f790406d620 2024-09-13T18:52:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.148+0000 7f7900c00700 1 -- 172.21.15.81:0/1834839177 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f78f0053e70 con 0x7f790406d620 2024-09-13T18:52:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f78e4066760 msgr2=0x7f78e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f78e4066760 0x7f78e4068c20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8008030 comp rx=0 tx=0).stop 2024-09-13T18:52:28.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 msgr2=0x7f790406c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 0x7f790406c060 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f78f000c520 tx=0x7f78f000c830 comp rx=0 tx=0).stop 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 shutdown_connections 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f78e4066760 0x7f78e4068c20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7904143b70 0x7f790406c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f790406d620 0x7f790406c060 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 --2- 172.21.15.81:0/1834839177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f790406d070 0x7f790413f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 >> 172.21.15.81:0/1834839177 conn(0x7f790406a390 msgr2=0x7f79040cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 shutdown_connections 2024-09-13T18:52:28.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.156+0000 7f790a000700 1 -- 172.21.15.81:0/1834839177 wait complete. 2024-09-13T18:52:28.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:52:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.400+0000 7efc1a200700 1 Processor -- start 2024-09-13T18:52:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.404+0000 7efc1a200700 1 -- start start 2024-09-13T18:52:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.404+0000 7efc1a200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc140b4df0 0x7efc14161400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.404+0000 7efc1a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc140b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc1a200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc14161aa0 con 0x7efc140b4a10 2024-09-13T18:52:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc1a200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc14161d80 con 0x7efc140b4df0 2024-09-13T18:52:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc1a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc14162060 con 0x7efc140b2a50 2024-09-13T18:52:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc19800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc140b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc18e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7efc140b4a10 0x7efc1406b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:55270/0 (socket says 172.21.15.81:55270) 2024-09-13T18:52:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc18e00700 1 -- 172.21.15.81:0/1276484248 learned_addr learned my addr 172.21.15.81:0/1276484248 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc13e00700 1 --2- 172.21.15.81:0/1276484248 >> v2:172.21.15.178:3300/0 conn(0x7efc140b4df0 0x7efc14161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc19800700 1 -- 172.21.15.81:0/1276484248 >> v2:172.21.15.178:3300/0 conn(0x7efc140b4df0 msgr2=0x7efc14161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc19800700 1 --2- 172.21.15.81:0/1276484248 >> v2:172.21.15.178:3300/0 conn(0x7efc140b4df0 0x7efc14161400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc19800700 1 -- 172.21.15.81:0/1276484248 >> v1:172.21.15.178:6789/0 conn(0x7efc140b4a10 legacy=0x7efc1406b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc19800700 1 -- 172.21.15.81:0/1276484248 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14162340 con 0x7efc140b2a50 2024-09-13T18:52:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.408+0000 7efc19800700 1 --2- 172.21.15.81:0/1276484248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc140b2ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009d90 tx=0x7efc0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27fb2f4697cd6a30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc13400700 1 -- 172.21.15.81:0/1276484248 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00e070 con 0x7efc140b2a50 2024-09-13T18:52:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc13400700 1 -- 172.21.15.81:0/1276484248 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c00bbd0 con 0x7efc140b2a50 2024-09-13T18:52:28.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc13400700 1 -- 172.21.15.81:0/1276484248 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c012430 con 0x7efc140b2a50 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc1a200700 1 -- 172.21.15.81:0/1276484248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 msgr2=0x7efc140b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc1a200700 1 --2- 172.21.15.81:0/1276484248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc140b2ee0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009d90 tx=0x7efc0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc1a200700 1 -- 172.21.15.81:0/1276484248 shutdown_connections 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc1a200700 1 --2- 172.21.15.81:0/1276484248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc140b2ee0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.412+0000 7efc1a200700 1 --2- 172.21.15.81:0/1276484248 >> v2:172.21.15.178:3300/0 conn(0x7efc140b4df0 0x7efc14161400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.416+0000 7efc1a200700 1 -- 172.21.15.81:0/1276484248 >> 172.21.15.81:0/1276484248 conn(0x7efc14070cd0 msgr2=0x7efc140710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.416+0000 7efc1a200700 1 -- 172.21.15.81:0/1276484248 shutdown_connections 2024-09-13T18:52:28.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.416+0000 7efc1a200700 1 -- 172.21.15.81:0/1276484248 wait complete. 2024-09-13T18:52:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.416+0000 7efc1a200700 1 Processor -- start 2024-09-13T18:52:28.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.416+0000 7efc1a200700 1 -- start start 2024-09-13T18:52:28.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc1a200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc141f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:28.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc1a200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 0x7efc140cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc1a200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc140b4df0 0x7efc14152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc1a200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14158570 con 0x7efc140b4a10 2024-09-13T18:52:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc1a200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14158850 con 0x7efc140b4df0 2024-09-13T18:52:28.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc1a200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc14158b30 con 0x7efc140b2a50 2024-09-13T18:52:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 0x7efc140cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 0x7efc140cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51452/0 (socket says 172.21.15.81:51452) 2024-09-13T18:52:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 -- 172.21.15.81:0/1950881936 learned_addr learned my addr 172.21.15.81:0/1950881936 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc18e00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc141f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc19800700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc140b4df0 0x7efc14152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:28.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 -- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 msgr2=0x7efc141f9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc141f9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 -- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc140b4df0 msgr2=0x7efc14152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc140b4df0 0x7efc14152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 -- 172.21.15.81:0/1950881936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009a70 con 0x7efc140b4a10 2024-09-13T18:52:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.420+0000 7efc13e00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 0x7efc140cef20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7efc0000d7d0 tx=0x7efc0000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:28.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.424+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000125f0 con 0x7efc140b4a10 2024-09-13T18:52:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.424+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc00012750 con 0x7efc140b4a10 2024-09-13T18:52:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.424+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00012ae0 con 0x7efc140b4a10 2024-09-13T18:52:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.424+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc14158e10 con 0x7efc140b4a10 2024-09-13T18:52:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.424+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc140cf460 con 0x7efc140b4a10 2024-09-13T18:52:28.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.424+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc141f6610 con 0x7efc140b4a10 2024-09-13T18:52:28.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.428+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc00012c40 con 0x7efc140b4a10 2024-09-13T18:52:28.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.428+0000 7efc10c00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efbf4066730 0x7efbf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:28.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.428+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6432+0+0 (secure 0 0 0) 0x7efc00084fd0 con 0x7efc140b4a10 2024-09-13T18:52:28.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.428+0000 7efc18e00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efbf4066730 0x7efbf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:28.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.432+0000 7efc18e00700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efbf4066730 0x7efbf4068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efc08005930 tx=0x7efc08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.432+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc00052070 con 0x7efc140b4a10 2024-09-13T18:52:28.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:28.616+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc141656d0 con 0x7efc140b4a10 2024-09-13T18:52:29.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.420+0000 7efc10c00700 1 -- 172.21.15.81:0/1950881936 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc00055690 con 0x7efc140b4a10 2024-09-13T18:52:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efbf4066730 msgr2=0x7efbf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efbf4066730 0x7efbf4068bf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7efc08005930 tx=0x7efc08009040 comp rx=0 tx=0).stop 2024-09-13T18:52:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 msgr2=0x7efc140cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 0x7efc140cef20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7efc0000d7d0 tx=0x7efc0000dae0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 shutdown_connections 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efbf4066730 0x7efbf4068bf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc140b4df0 0x7efc14152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140b4a10 0x7efc140cef20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 --2- 172.21.15.81:0/1950881936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc140b2a50 0x7efc141f9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.428+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 >> 172.21.15.81:0/1950881936 conn(0x7efc14070cd0 msgr2=0x7efc14163300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.432+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 shutdown_connections 2024-09-13T18:52:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.432+0000 7efc1a200700 1 -- 172.21.15.81:0/1950881936 wait complete. 2024-09-13T18:52:29.441 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:52:29.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.632+0000 7fd75e400700 1 Processor -- start 2024-09-13T18:52:29.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.632+0000 7fd75e400700 1 -- start start 2024-09-13T18:52:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7580b4670 0x7fd7580b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:29.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75e400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd7580b5430 0x7fd758070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75e400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580b4ab0 con 0x7fd75815a6e0 2024-09-13T18:52:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75e400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75815aac0 con 0x7fd7580b5430 2024-09-13T18:52:29.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580b58a0 con 0x7fd7580b4670 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75d000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd75815a6e0 0x7fd758066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47270/0 (socket says 172.21.15.81:47270) 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75d000700 1 -- 172.21.15.81:0/1766501705 learned_addr learned my addr 172.21.15.81:0/1766501705 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75da00700 1 --2- 172.21.15.81:0/1766501705 >> v2:172.21.15.178:3300/0 conn(0x7fd7580b5430 0x7fd758070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd757e00700 1 --2- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7580b4670 0x7fd7580b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd757400700 1 -- 172.21.15.81:0/1766501705 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614418399 0 0) 0x7fd7580b4ab0 con 0x7fd75815a6e0 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd757400700 1 -- 172.21.15.81:0/1766501705 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7400035d0 con 0x7fd75815a6e0 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75da00700 1 -- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7580b4670 msgr2=0x7fd7580b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75da00700 1 --2- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7580b4670 0x7fd7580b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75da00700 1 -- 172.21.15.81:0/1766501705 >> v1:172.21.15.81:6789/0 conn(0x7fd75815a6e0 legacy=0x7fd758066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:29.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.636+0000 7fd75da00700 1 -- 172.21.15.81:0/1766501705 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd758066be0 con 0x7fd7580b5430 2024-09-13T18:52:29.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75da00700 1 --2- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b5430 0x7fd758070ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd750009dc0 tx=0x7fd75000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405e335acf837048 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:29.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd757400700 1 -- 172.21.15.81:0/1766501705 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000e070 con 0x7fd7580b5430 2024-09-13T18:52:29.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd757400700 1 -- 172.21.15.81:0/1766501705 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75000bae0 con 0x7fd7580b5430 2024-09-13T18:52:29.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd757400700 1 -- 172.21.15.81:0/1766501705 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75000be90 con 0x7fd7580b5430 2024-09-13T18:52:29.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 -- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b5430 msgr2=0x7fd758070ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:29.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 --2- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b5430 0x7fd758070ca0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd750009dc0 tx=0x7fd75000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:29.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 -- 172.21.15.81:0/1766501705 shutdown_connections 2024-09-13T18:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 --2- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b5430 0x7fd758070ca0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 --2- 172.21.15.81:0/1766501705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7580b4670 0x7fd7580b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 -- 172.21.15.81:0/1766501705 >> 172.21.15.81:0/1766501705 conn(0x7fd75806d4b0 msgr2=0x7fd75806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 -- 172.21.15.81:0/1766501705 shutdown_connections 2024-09-13T18:52:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.640+0000 7fd75e400700 1 -- 172.21.15.81:0/1766501705 wait complete. 2024-09-13T18:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 Processor -- start 2024-09-13T18:52:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 -- start start 2024-09-13T18:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b4670 0x7fd7580ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 0x7fd7580ced40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75815a6e0 0x7fd75814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580ae240 con 0x7fd7580b5430 2024-09-13T18:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580cf280 con 0x7fd7580b4670 2024-09-13T18:52:29.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75814f8c0 con 0x7fd75815a6e0 2024-09-13T18:52:29.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 0x7fd7580ced40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 0x7fd7580ced40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51456/0 (socket says 172.21.15.81:51456) 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 -- 172.21.15.81:0/1713682061 learned_addr learned my addr 172.21.15.81:0/1713682061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75d000700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b4670 0x7fd7580ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75da00700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75815a6e0 0x7fd75814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 -- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75815a6e0 msgr2=0x7fd75814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75815a6e0 0x7fd75814f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 -- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b4670 msgr2=0x7fd7580ad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b4670 0x7fd7580ad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 -- 172.21.15.81:0/1713682061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009a70 con 0x7fd7580b5430 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75da00700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75815a6e0 0x7fd75814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75d000700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b4670 0x7fd7580ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd757e00700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 0x7fd7580ced40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd74400e840 tx=0x7fd74400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440095a0 con 0x7fd7580b5430 2024-09-13T18:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744013680 con 0x7fd7580b5430 2024-09-13T18:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744013a10 con 0x7fd7580b5430 2024-09-13T18:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7580ad9a0 con 0x7fd7580b5430 2024-09-13T18:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.644+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7580adf60 con 0x7fd7580b5430 2024-09-13T18:52:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.648+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75815df40 con 0x7fd7580b5430 2024-09-13T18:52:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.648+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd744013b70 con 0x7fd7580b5430 2024-09-13T18:52:29.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.648+0000 7fd754c00700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd738066730 0x7fd738068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:29.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.648+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5965+0+0 (secure 0 0 0) 0x7fd7440845b0 con 0x7fd7580b5430 2024-09-13T18:52:29.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.652+0000 7fd75d000700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd738066730 0x7fd738068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:29.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.652+0000 7fd75d000700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd738066730 0x7fd738068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0011e0 tx=0x7fd74c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:29.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.656+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd744051780 con 0x7fd7580b5430 2024-09-13T18:52:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:29.836+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd7581573b0 con 0x7fd7580b5430 2024-09-13T18:52:30.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.428+0000 7fd754c00700 1 -- 172.21.15.81:0/1713682061 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd744054da0 con 0x7fd7580b5430 2024-09-13T18:52:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd738066730 msgr2=0x7fd738068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd738066730 0x7fd738068bf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0011e0 tx=0x7fd74c009040 comp rx=0 tx=0).stop 2024-09-13T18:52:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 msgr2=0x7fd7580ced40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 0x7fd7580ced40 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd74400e840 tx=0x7fd74400ec00 comp rx=0 tx=0).stop 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 shutdown_connections 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd738066730 0x7fd738068bf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd75815a6e0 0x7fd75814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7580b5430 0x7fd7580ced40 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 --2- 172.21.15.81:0/1713682061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7580b4670 0x7fd7580ad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.436+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 >> 172.21.15.81:0/1713682061 conn(0x7fd75806d4b0 msgr2=0x7fd758066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:30.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.440+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 shutdown_connections 2024-09-13T18:52:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.440+0000 7fd75e400700 1 -- 172.21.15.81:0/1713682061 wait complete. 2024-09-13T18:52:30.449 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:52:30.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:52:30.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 Processor -- start 2024-09-13T18:52:30.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 -- start start 2024-09-13T18:52:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9d0146720 0x7fe9d015e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 0x7fe9d0071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d0070670 con 0x7fe9d006c4c0 2024-09-13T18:52:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d0070950 con 0x7fe9d0146720 2024-09-13T18:52:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9d7a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0070c30 con 0x7fe9d00cf280 2024-09-13T18:52:30.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9cfe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe9d006c4c0 0x7fe9d00ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47274/0 (socket says 172.21.15.81:47274) 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.648+0000 7fe9cfe00700 1 -- 172.21.15.81:0/3909858658 learned_addr learned my addr 172.21.15.81:0/3909858658 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5000700 1 --2- 172.21.15.81:0/3909858658 >> v2:172.21.15.178:3300/0 conn(0x7fe9d0146720 0x7fe9d015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 0x7fe9d0071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070721812 0 0) 0x7fe9d0070670 con 0x7fe9d006c4c0 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9b80035d0 con 0x7fe9d006c4c0 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2679097141 0 0) 0x7fe9b80035d0 con 0x7fe9d006c4c0 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 msgr2=0x7fe9d0071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 0x7fe9d0071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 >> v2:172.21.15.178:3300/0 conn(0x7fe9d0146720 msgr2=0x7fe9d015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 --2- 172.21.15.81:0/3909858658 >> v2:172.21.15.178:3300/0 conn(0x7fe9d0146720 0x7fe9d015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0070f10 con 0x7fe9d006c4c0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fe9bc001670 con 0x7fe9d006c4c0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 >> v1:172.21.15.81:6789/0 conn(0x7fe9d006c4c0 legacy=0x7fe9d00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 0x7fe9b8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b8003fa0 0x7fe9b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8004db0 0x7fe9b8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0070950 con 0x7fe9b8004db0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0070c30 con 0x7fe9b8003fa0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b800ba80 con 0x7fe9d00cf280 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8004db0 0x7fe9b8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cfe00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b8003fa0 0x7fe9b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5000700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 0x7fe9b8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 -- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 msgr2=0x7fe9b8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d00cf280 0x7fe9b8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 -- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b8003fa0 msgr2=0x7fe9b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9b8003fa0 0x7fe9b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 -- 172.21.15.81:0/3909858658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80035d0 con 0x7fe9b8004db0 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9d5a00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8004db0 0x7fe9b8005230 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ae370 tx=0x7fe9b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe13f07da60b609 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8007e20 con 0x7fe9b8004db0 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8014400 con 0x7fe9b8004db0 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.652+0000 7fe9cf400700 1 -- 172.21.15.81:0/3909858658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80147b0 con 0x7fe9b8004db0 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3909858658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8004db0 msgr2=0x7fe9b8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3909858658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b8004db0 0x7fe9b8005230 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00ae370 tx=0x7fe9b80058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d5a00700 1 -- 172.21.15.81:0/3909858658 reap_dead start 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3909858658 shutdown_connections 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3909858658 >> 172.21.15.81:0/3909858658 conn(0x7fe9d006a570 msgr2=0x7fe9d006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:30.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3909858658 shutdown_connections 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.656+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3909858658 wait complete. 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 Processor -- start 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 -- start start 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 0x7fe9d0159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d0142350 0x7fe9d015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9d00c4070 0x7fe9d00c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01f3370 con 0x7fe9d0141f70 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d01f2500 con 0x7fe9d00c4070 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d7a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d00c4a60 con 0x7fe9d0142350 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 0x7fe9d0159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 0x7fe9d0159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51472/0 (socket says 172.21.15.81:51472) 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 -- 172.21.15.81:0/3610028240 learned_addr learned my addr 172.21.15.81:0/3610028240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9cfe00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d0142350 0x7fe9d015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9d00c4070 0x7fe9d00c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 -- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d0142350 msgr2=0x7fe9d015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d0142350 0x7fe9d015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 -- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9d00c4070 msgr2=0x7fe9d00c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9d00c4070 0x7fe9d00c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 -- 172.21.15.81:0/3610028240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d01f26f0 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9d5000700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 0x7fe9d0159d60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4011ad0 tx=0x7fe9c4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400f9a0 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c400fb00 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.660+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400feb0 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.664+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d01f29d0 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.664+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d01f2f90 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.664+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d006c8c0 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.664+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9c4014440 con 0x7fe9d0141f70 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.668+0000 7fe9ccc00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe9b0066760 0x7fe9b0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:30.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.668+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe9c4084800 con 0x7fe9d0141f70 2024-09-13T18:52:30.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.668+0000 7fe9cfe00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe9b0066760 0x7fe9b0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:30.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.668+0000 7fe9cfe00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe9b0066760 0x7fe9b0068c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0142770 tx=0x7fe9bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:30.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.672+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9c4051c90 con 0x7fe9d0141f70 2024-09-13T18:52:30.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.860+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe9d00737f0 con 0x7fe9d0141f70 2024-09-13T18:52:30.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.868+0000 7fe9ccc00700 1 -- 172.21.15.81:0/3610028240 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe9c40552b0 con 0x7fe9d0141f70 2024-09-13T18:52:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe9b0066760 msgr2=0x7fe9b0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe9b0066760 0x7fe9b0068c20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0142770 tx=0x7fe9bc009040 comp rx=0 tx=0).stop 2024-09-13T18:52:30.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 msgr2=0x7fe9d0159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 0x7fe9d0159d60 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4011ad0 tx=0x7fe9c4011e90 comp rx=0 tx=0).stop 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 shutdown_connections 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe9b0066760 0x7fe9b0068c20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9d00c4070 0x7fe9d00c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9d0142350 0x7fe9d015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 --2- 172.21.15.81:0/3610028240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9d0141f70 0x7fe9d0159d60 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 >> 172.21.15.81:0/3610028240 conn(0x7fe9d006a570 msgr2=0x7fe9d00ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 shutdown_connections 2024-09-13T18:52:30.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:30.872+0000 7fe9d7a00700 1 -- 172.21.15.81:0/3610028240 wait complete. 2024-09-13T18:52:30.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2024-09-13T18:52:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.060+0000 7f5a3be00700 1 Processor -- start 2024-09-13T18:52:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.060+0000 7f5a3be00700 1 -- start start 2024-09-13T18:52:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c0cb020 0x7f5a3c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a3c06aaa0 0x7f5a3c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c0b2ad0 con 0x7f5a3c15c2a0 2024-09-13T18:52:31.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c06b450 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c15b960 con 0x7f5a3c0cb020 2024-09-13T18:52:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a3c06aaa0 0x7f5a3c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a32000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5a3c15c2a0 0x7f5a3c15b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47276/0 (socket says 172.21.15.81:47276) 2024-09-13T18:52:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a32000700 1 -- 172.21.15.81:0/2613686348 learned_addr learned my addr 172.21.15.81:0/2613686348 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3aa00700 1 --2- 172.21.15.81:0/2613686348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c0cb020 0x7f5a3c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3b400700 1 -- 172.21.15.81:0/2613686348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c0cb020 msgr2=0x7f5a3c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:31.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3b400700 1 --2- 172.21.15.81:0/2613686348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c0cb020 0x7f5a3c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3b400700 1 -- 172.21.15.81:0/2613686348 >> v1:172.21.15.81:6789/0 conn(0x7f5a3c15c2a0 legacy=0x7f5a3c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3b400700 1 -- 172.21.15.81:0/2613686348 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c15bc40 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3b400700 1 --2- 172.21.15.81:0/2613686348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c06af10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009d90 tx=0x7f5a3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e61b23606913f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3a000700 1 -- 172.21.15.81:0/2613686348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3400e070 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3a000700 1 -- 172.21.15.81:0/2613686348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3400bb20 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3a000700 1 -- 172.21.15.81:0/2613686348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34012430 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- 172.21.15.81:0/2613686348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 msgr2=0x7f5a3c06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 --2- 172.21.15.81:0/2613686348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c06af10 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f5a34009d90 tx=0x7f5a3400b330 comp rx=0 tx=0).stop 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- 172.21.15.81:0/2613686348 shutdown_connections 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 --2- 172.21.15.81:0/2613686348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c06af10 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 --2- 172.21.15.81:0/2613686348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c0cb020 0x7f5a3c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- 172.21.15.81:0/2613686348 >> 172.21.15.81:0/2613686348 conn(0x7f5a3c0b0c40 msgr2=0x7f5a3c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.064+0000 7f5a3be00700 1 -- 172.21.15.81:0/2613686348 shutdown_connections 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 -- 172.21.15.81:0/2613686348 wait complete. 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 Processor -- start 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 -- start start 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a3c0cb020 0x7f5a3c1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c15c2a0 0x7f5a3c1557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0c7d30 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0c9860 con 0x7f5a3c0cb020 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c1f2bf0 con 0x7f5a3c15c2a0 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c0c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51482/0 (socket says 172.21.15.81:51482) 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3aa00700 1 -- 172.21.15.81:0/1783450324 learned_addr learned my addr 172.21.15.81:0/1783450324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.068+0000 7f5a3b400700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c15c2a0 0x7f5a3c1557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a32000700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a3c0cb020 0x7f5a3c1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3aa00700 1 -- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c15c2a0 msgr2=0x7f5a3c1557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3aa00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c15c2a0 0x7f5a3c1557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3aa00700 1 -- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a3c0cb020 msgr2=0x7f5a3c1f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3aa00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a3c0cb020 0x7f5a3c1f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3aa00700 1 -- 172.21.15.81:0/1783450324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34009a70 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3aa00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c0c9bb0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00e9d0 tx=0x7f5a2c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c009720 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00c850 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3c1f2ed0 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00cbc0 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c1f3490 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.072+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c0c7f00 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.076+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a2c00cd20 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.076+0000 7f5a33400700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a18066730 0x7f5a18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.076+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f5a2c084220 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.076+0000 7f5a32000700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a18066730 0x7f5a18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.076+0000 7f5a32000700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a18066730 0x7f5a18068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b0570 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:31.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.084+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a3c0c7f00 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.328+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) v1 -- 0x7f5a3c06af10 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.440+0000 7f5a33400700 1 -- 172.21.15.81:0/1783450324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v278) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5a2c051600 con 0x7f5a3c06aaa0 2024-09-13T18:52:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a18066730 msgr2=0x7f5a18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a18066730 0x7f5a18068bf0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0b0570 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2024-09-13T18:52:31.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 msgr2=0x7f5a3c0c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c0c9bb0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00e9d0 tx=0x7f5a2c00ed90 comp rx=0 tx=0).stop 2024-09-13T18:52:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 shutdown_connections 2024-09-13T18:52:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a18066730 0x7f5a18068bf0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a3c15c2a0 0x7f5a3c1557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a3c0cb020 0x7f5a3c1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 --2- 172.21.15.81:0/1783450324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a3c06aaa0 0x7f5a3c0c9bb0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 >> 172.21.15.81:0/1783450324 conn(0x7f5a3c0b0c40 msgr2=0x7f5a3c159680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 shutdown_connections 2024-09-13T18:52:31.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.444+0000 7f5a3be00700 1 -- 172.21.15.81:0/1783450324 wait complete. 2024-09-13T18:52:31.479 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-13T18:52:31.479 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-13T18:52:31.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:31.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 Processor -- start 2024-09-13T18:52:31.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 -- start start 2024-09-13T18:52:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c06a5d0 0x7fad8c071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad8c0b19f0 0x7fad8c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c0ce140 con 0x7fad8c0cd610 2024-09-13T18:52:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c06aef0 con 0x7fad8c0b19f0 2024-09-13T18:52:31.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad91800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0b1e30 con 0x7fad8c06a5d0 2024-09-13T18:52:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad8aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c06a5d0 0x7fad8c071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad8a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad8c0b19f0 0x7fad8c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad8a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad8c0b19f0 0x7fad8c06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:36480/0 (socket says 172.21.15.81:36480) 2024-09-13T18:52:31.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.640+0000 7fad8a000700 1 -- 172.21.15.81:0/1844542434 learned_addr learned my addr 172.21.15.81:0/1844542434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad8a000700 1 -- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c06a5d0 msgr2=0x7fad8c071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad8a000700 1 --2- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c06a5d0 0x7fad8c071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad8a000700 1 -- 172.21.15.81:0/1844542434 >> v1:172.21.15.178:6789/0 conn(0x7fad8c0cd610 legacy=0x7fad8c06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad8a000700 1 -- 172.21.15.81:0/1844542434 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0cde60 con 0x7fad8c0b19f0 2024-09-13T18:52:31.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad8a000700 1 --2- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c0b19f0 0x7fad8c06a9b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fad78009910 tx=0x7fad78009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e018ad8367efe8de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad89600700 1 -- 172.21.15.81:0/1844542434 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78011830 con 0x7fad8c0b19f0 2024-09-13T18:52:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad89600700 1 -- 172.21.15.81:0/1844542434 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78011990 con 0x7fad8c0b19f0 2024-09-13T18:52:31.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad89600700 1 -- 172.21.15.81:0/1844542434 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78011d40 con 0x7fad8c0b19f0 2024-09-13T18:52:31.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 -- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c0b19f0 msgr2=0x7fad8c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 --2- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c0b19f0 0x7fad8c06a9b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fad78009910 tx=0x7fad78009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:31.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 -- 172.21.15.81:0/1844542434 shutdown_connections 2024-09-13T18:52:31.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 --2- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c0b19f0 0x7fad8c06a9b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 --2- 172.21.15.81:0/1844542434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c06a5d0 0x7fad8c071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 -- 172.21.15.81:0/1844542434 >> 172.21.15.81:0/1844542434 conn(0x7fad8c0b08d0 msgr2=0x7fad8c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 -- 172.21.15.81:0/1844542434 shutdown_connections 2024-09-13T18:52:31.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.644+0000 7fad91800700 1 -- 172.21.15.81:0/1844542434 wait complete. 2024-09-13T18:52:31.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 Processor -- start 2024-09-13T18:52:31.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 -- start start 2024-09-13T18:52:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c06a5d0 0x7fad8c13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c0b19f0 0x7fad8c0af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 0x7fad8c1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c1f7080 con 0x7fad8c0cd610 2024-09-13T18:52:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c1f7360 con 0x7fad8c06a5d0 2024-09-13T18:52:31.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad91800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c1f7640 con 0x7fad8c0b19f0 2024-09-13T18:52:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad8b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 0x7fad8c1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad8b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 0x7fad8c1411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51488/0 (socket says 172.21.15.81:51488) 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad8b400700 1 -- 172.21.15.81:0/1789545945 learned_addr learned my addr 172.21.15.81:0/1789545945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad8aa00700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c06a5d0 0x7fad8c13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.648+0000 7fad8a000700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c0b19f0 0x7fad8c0af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad8b400700 1 -- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c0b19f0 msgr2=0x7fad8c0af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad8b400700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c0b19f0 0x7fad8c0af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad8b400700 1 -- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c06a5d0 msgr2=0x7fad8c13f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad8b400700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c06a5d0 0x7fad8c13f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad8b400700 1 -- 172.21.15.81:0/1789545945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009570 con 0x7fad8c0cd610 2024-09-13T18:52:31.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad8b400700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 0x7fad8c1411c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fad8400cc50 tx=0x7fad8400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400ad80 con 0x7fad8c0cd610 2024-09-13T18:52:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8400ce50 con 0x7fad8c0cd610 2024-09-13T18:52:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c1f7920 con 0x7fad8c0cd610 2024-09-13T18:52:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad84003c60 con 0x7fad8c0cd610 2024-09-13T18:52:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c1f6ca0 con 0x7fad8c0cd610 2024-09-13T18:52:31.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.652+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c1f6e30 con 0x7fad8c0cd610 2024-09-13T18:52:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.656+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad840050d0 con 0x7fad8c0cd610 2024-09-13T18:52:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.656+0000 7fad82a00700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad6c066730 0x7fad6c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:31.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.656+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fad84084170 con 0x7fad8c0cd610 2024-09-13T18:52:31.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.656+0000 7fad8aa00700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad6c066730 0x7fad6c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.656+0000 7fad8aa00700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad6c066730 0x7fad6c068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009ae0 tx=0x7fad7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:31.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.660+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad840515e0 con 0x7fad8c0cd610 2024-09-13T18:52:31.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.848+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad8c1fa320 con 0x7fad8c0cd610 2024-09-13T18:52:31.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.848+0000 7fad82a00700 1 -- 172.21.15.81:0/1789545945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+13454 (secure 0 0 0) 0x7fad84054c00 con 0x7fad8c0cd610 2024-09-13T18:52:31.858 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:31.858 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:30.419987+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.178:6835/3000844155":"2024-09-14T18:52:27.131428+0000","172.21.15.81:6835/3088682584":"2024-09-14T18:52:27.131390+0000","172.21.15.81:6834/3088682584":"2024-09-14T18:52:27.131390+0000","172.21.15.178:6834/3000844155":"2024-09-14T18:52:27.131428+0000","172.21.15.81:6837/2228642132":"2024-09-14T18:52:27.131416+0000","172.21.15.81:6836/2228642132":"2024-09-14T18:52:27.131416+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:31.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad6c066730 msgr2=0x7fad6c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad6c066730 0x7fad6c068bf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009ae0 tx=0x7fad7c008040 comp rx=0 tx=0).stop 2024-09-13T18:52:31.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 msgr2=0x7fad8c1411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:31.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 0x7fad8c1411c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fad8400cc50 tx=0x7fad8400a340 comp rx=0 tx=0).stop 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 shutdown_connections 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fad6c066730 0x7fad6c068bf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad8c0cd610 0x7fad8c1411c0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8c0b19f0 0x7fad8c0af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 --2- 172.21.15.81:0/1789545945 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8c06a5d0 0x7fad8c13f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 >> 172.21.15.81:0/1789545945 conn(0x7fad8c0b08d0 msgr2=0x7fad8c161e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 shutdown_connections 2024-09-13T18:52:31.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:31.852+0000 7fad91800700 1 -- 172.21.15.81:0/1789545945 wait complete. 2024-09-13T18:52:31.882 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:52:31.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:52:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38fe00700 1 Processor -- start 2024-09-13T18:52:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38fe00700 1 -- start start 2024-09-13T18:52:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc39006ada0 0x7fc39006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39006b710 con 0x7fc39015ca20 2024-09-13T18:52:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38fe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc390160680 con 0x7fc39006cd80 2024-09-13T18:52:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3900b4a20 con 0x7fc39006ada0 2024-09-13T18:52:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc39006ada0 0x7fc39006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38ea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc39015ca20 0x7fc39015ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47286/0 (socket says 172.21.15.81:47286) 2024-09-13T18:52:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38ea00700 1 -- 172.21.15.81:0/1620847665 learned_addr learned my addr 172.21.15.81:0/1620847665 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38f400700 1 -- 172.21.15.81:0/1620847665 >> v1:172.21.15.178:6789/0 conn(0x7fc39006cd80 legacy=0x7fc3900b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38f400700 1 -- 172.21.15.81:0/1620847665 >> v1:172.21.15.81:6789/0 conn(0x7fc39015ca20 legacy=0x7fc39015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38f400700 1 -- 172.21.15.81:0/1620847665 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39015d670 con 0x7fc39006ada0 2024-09-13T18:52:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.052+0000 7fc38f400700 1 --2- 172.21.15.81:0/1620847665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006ada0 0x7fc39006b1d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc388009850 tx=0x7fc388009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aef34d8d131c603 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38e000700 1 -- 172.21.15.81:0/1620847665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011830 con 0x7fc39006ada0 2024-09-13T18:52:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38e000700 1 -- 172.21.15.81:0/1620847665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388011990 con 0x7fc39006ada0 2024-09-13T18:52:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38e000700 1 -- 172.21.15.81:0/1620847665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011d20 con 0x7fc39006ada0 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- 172.21.15.81:0/1620847665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006ada0 msgr2=0x7fc39006b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1620847665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006ada0 0x7fc39006b1d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc388009850 tx=0x7fc388009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- 172.21.15.81:0/1620847665 shutdown_connections 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1620847665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006ada0 0x7fc39006b1d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- 172.21.15.81:0/1620847665 >> 172.21.15.81:0/1620847665 conn(0x7fc390071d20 msgr2=0x7fc390072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- 172.21.15.81:0/1620847665 shutdown_connections 2024-09-13T18:52:32.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- 172.21.15.81:0/1620847665 wait complete. 2024-09-13T18:52:32.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 Processor -- start 2024-09-13T18:52:32.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- start start 2024-09-13T18:52:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc39006ada0 0x7fc3901547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 0x7fc390144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc39015ca20 0x7fc390151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3901543a0 con 0x7fc39006cd80 2024-09-13T18:52:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc390155ea0 con 0x7fc39006ada0 2024-09-13T18:52:32.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.056+0000 7fc38fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc390156140 con 0x7fc39015ca20 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 0x7fc390144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 0x7fc390144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51494/0 (socket says 172.21.15.81:51494) 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 -- 172.21.15.81:0/1465616035 learned_addr learned my addr 172.21.15.81:0/1465616035 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc38f400700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc39015ca20 0x7fc390151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc38ea00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc39006ada0 0x7fc3901547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 -- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc39015ca20 msgr2=0x7fc390151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc39015ca20 0x7fc390151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 -- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc39006ada0 msgr2=0x7fc3901547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc39006ada0 0x7fc3901547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 -- 172.21.15.81:0/1465616035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3880094b0 con 0x7fc39006cd80 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc386000700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 0x7fc390144720 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc378001ed0 tx=0x7fc3780021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc378003c20 con 0x7fc39006cd80 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc378003d80 con 0x7fc39006cd80 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc390156420 con 0x7fc39006cd80 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37800ab40 con 0x7fc39006cd80 2024-09-13T18:52:32.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc390154d00 con 0x7fc39006cd80 2024-09-13T18:52:32.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.060+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3901544e0 con 0x7fc39006cd80 2024-09-13T18:52:32.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.064+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc37800aca0 con 0x7fc39006cd80 2024-09-13T18:52:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.064+0000 7fc387400700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc36c066730 0x7fc36c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.064+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fc3780840d0 con 0x7fc39006cd80 2024-09-13T18:52:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.064+0000 7fc38ea00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc36c066730 0x7fc36c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.064+0000 7fc38ea00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc36c066730 0x7fc36c068bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc380005930 tx=0x7fc380009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.072+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3901544e0 con 0x7fc39006cd80 2024-09-13T18:52:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.248+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3901544e0 con 0x7fc39006cd80 2024-09-13T18:52:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.248+0000 7fc387400700 1 -- 172.21.15.81:0/1465616035 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3901544e0 con 0x7fc39006cd80 2024-09-13T18:52:32.258 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:52:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc36c066730 msgr2=0x7fc36c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc36c066730 0x7fc36c068bf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc380005930 tx=0x7fc380009040 comp rx=0 tx=0).stop 2024-09-13T18:52:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 msgr2=0x7fc390144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 0x7fc390144720 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc378001ed0 tx=0x7fc3780021e0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 shutdown_connections 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc36c066730 0x7fc36c068bf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc39015ca20 0x7fc390151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc39006cd80 0x7fc390144720 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 --2- 172.21.15.81:0/1465616035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc39006ada0 0x7fc3901547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 >> 172.21.15.81:0/1465616035 conn(0x7fc390071d20 msgr2=0x7fc39015ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 shutdown_connections 2024-09-13T18:52:32.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.252+0000 7fc38fe00700 1 -- 172.21.15.81:0/1465616035 wait complete. 2024-09-13T18:52:32.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2024-09-13T18:52:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.436+0000 7fb38c800700 1 Processor -- start 2024-09-13T18:52:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.436+0000 7fb38c800700 1 -- start start 2024-09-13T18:52:32.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb38c800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38406c460 0x7fb38406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb38c800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3840cdd90 con 0x7fb38406a5d0 2024-09-13T18:52:32.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb38c800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38406ce10 con 0x7fb38415b700 2024-09-13T18:52:32.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb38c800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38406d7e0 con 0x7fb38406c460 2024-09-13T18:52:32.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb38a800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb38406a5d0 0x7fb3840b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47290/0 (socket says 172.21.15.81:47290) 2024-09-13T18:52:32.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb38a800700 1 -- 172.21.15.81:0/2784424995 learned_addr learned my addr 172.21.15.81:0/2784424995 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:32.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb389400700 1 --2- 172.21.15.81:0/2784424995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38406c460 0x7fb38406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb388a00700 1 -- 172.21.15.81:0/2784424995 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922266620 0 0) 0x7fb3840cdd90 con 0x7fb38406a5d0 2024-09-13T18:52:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb388a00700 1 -- 172.21.15.81:0/2784424995 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb36c0035d0 con 0x7fb38406a5d0 2024-09-13T18:52:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb389400700 1 -- 172.21.15.81:0/2784424995 >> v1:172.21.15.178:6789/0 conn(0x7fb38415b700 legacy=0x7fb38415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb389400700 1 -- 172.21.15.81:0/2784424995 >> v1:172.21.15.81:6789/0 conn(0x7fb38406a5d0 legacy=0x7fb3840b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.440+0000 7fb389400700 1 -- 172.21.15.81:0/2784424995 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3840cd4f0 con 0x7fb38406c460 2024-09-13T18:52:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb389400700 1 --2- 172.21.15.81:0/2784424995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38406c460 0x7fb38406d2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb374009880 tx=0x7fb374009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf9b5e77644346c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:32.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb388a00700 1 -- 172.21.15.81:0/2784424995 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374011830 con 0x7fb38406c460 2024-09-13T18:52:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb388a00700 1 -- 172.21.15.81:0/2784424995 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374011990 con 0x7fb38406c460 2024-09-13T18:52:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb388a00700 1 -- 172.21.15.81:0/2784424995 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374011d20 con 0x7fb38406c460 2024-09-13T18:52:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 -- 172.21.15.81:0/2784424995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38406c460 msgr2=0x7fb38406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 --2- 172.21.15.81:0/2784424995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38406c460 0x7fb38406d2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb374009880 tx=0x7fb374009b90 comp rx=0 tx=0).stop 2024-09-13T18:52:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 -- 172.21.15.81:0/2784424995 shutdown_connections 2024-09-13T18:52:32.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 --2- 172.21.15.81:0/2784424995 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38406c460 0x7fb38406d2a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 -- 172.21.15.81:0/2784424995 >> 172.21.15.81:0/2784424995 conn(0x7fb3840b08d0 msgr2=0x7fb3840b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:32.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 -- 172.21.15.81:0/2784424995 shutdown_connections 2024-09-13T18:52:32.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.444+0000 7fb38c800700 1 -- 172.21.15.81:0/2784424995 wait complete. 2024-09-13T18:52:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 Processor -- start 2024-09-13T18:52:32.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 -- start start 2024-09-13T18:52:32.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38406a5d0 0x7fb384139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 0x7fb38414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38415b700 0x7fb3841369e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38414d700 con 0x7fb38406c460 2024-09-13T18:52:32.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38413a290 con 0x7fb38406a5d0 2024-09-13T18:52:32.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38414caf0 con 0x7fb38415b700 2024-09-13T18:52:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 0x7fb38414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 0x7fb38414db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51498/0 (socket says 172.21.15.81:51498) 2024-09-13T18:52:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 -- 172.21.15.81:0/2021312223 learned_addr learned my addr 172.21.15.81:0/2021312223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38a800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38415b700 0x7fb3841369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389e00700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38406a5d0 0x7fb384139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 -- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38415b700 msgr2=0x7fb3841369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38415b700 0x7fb3841369e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 -- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38406a5d0 msgr2=0x7fb384139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:32.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38406a5d0 0x7fb384139d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:32.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 -- 172.21.15.81:0/2021312223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740094b0 con 0x7fb38406c460 2024-09-13T18:52:32.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb389400700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 0x7fb38414db90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb374013040 tx=0x7fb374004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:32.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3740038c0 con 0x7fb38406c460 2024-09-13T18:52:32.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb374003a40 con 0x7fb38406c460 2024-09-13T18:52:32.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38414cdd0 con 0x7fb38406c460 2024-09-13T18:52:32.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374003df0 con 0x7fb38406c460 2024-09-13T18:52:32.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.448+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38414d390 con 0x7fb38406c460 2024-09-13T18:52:32.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.452+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb38414d8b0 con 0x7fb38406c460 2024-09-13T18:52:32.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.452+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb37401b400 con 0x7fb38406c460 2024-09-13T18:52:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.456+0000 7fb37e000700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb368066730 0x7fb368068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.456+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fb374085640 con 0x7fb38406c460 2024-09-13T18:52:32.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.456+0000 7fb389e00700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb368066730 0x7fb368068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:32.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.456+0000 7fb389e00700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb368066730 0x7fb368068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb378000f60 tx=0x7fb378009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:32.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.460+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb38414d8b0 con 0x7fb38406c460 2024-09-13T18:52:32.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:32.712+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) v1 -- 0x7fb38406adf0 con 0x7fb38406c460 2024-09-13T18:52:33.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.452+0000 7fb37e000700 1 -- 172.21.15.81:0/2021312223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v280) v1 ==== 144+0+0 (secure 0 0 0) 0x7fb374052bd0 con 0x7fb38406c460 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb368066730 msgr2=0x7fb368068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb368066730 0x7fb368068bf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb378000f60 tx=0x7fb378009040 comp rx=0 tx=0).stop 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 msgr2=0x7fb38414db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 0x7fb38414db90 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb374013040 tx=0x7fb374004770 comp rx=0 tx=0).stop 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 shutdown_connections 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb368066730 0x7fb368068bf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb38415b700 0x7fb3841369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38406c460 0x7fb38414db90 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 --2- 172.21.15.81:0/2021312223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb38406a5d0 0x7fb384139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 >> 172.21.15.81:0/2021312223 conn(0x7fb3840b08d0 msgr2=0x7fb3840b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 shutdown_connections 2024-09-13T18:52:33.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.456+0000 7fb38c800700 1 -- 172.21.15.81:0/2021312223 wait complete. 2024-09-13T18:52:33.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:52:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.668+0000 7f7bb7200700 1 Processor -- start 2024-09-13T18:52:33.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.668+0000 7f7bb7200700 1 -- start start 2024-09-13T18:52:33.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb815ca20 0x7f7bb815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bb806cd80 0x7f7bb80b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bb806ada0 0x7f7bb806b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb806b790 con 0x7f7bb806ada0 2024-09-13T18:52:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb8160680 con 0x7f7bb806cd80 2024-09-13T18:52:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb815d670 con 0x7f7bb815ca20 2024-09-13T18:52:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bb806ada0 0x7f7bb806b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7bb806ada0 0x7f7bb806b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51504/0 (socket says 172.21.15.81:51504) 2024-09-13T18:52:33.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 -- 172.21.15.81:0/1422280391 learned_addr learned my addr 172.21.15.81:0/1422280391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb5e00700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb815ca20 0x7f7bb815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb5400700 1 --2- 172.21.15.81:0/1422280391 >> v2:172.21.15.178:3300/0 conn(0x7f7bb806cd80 0x7f7bb80b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 -- 172.21.15.81:0/1422280391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb815ca20 msgr2=0x7f7bb815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb815ca20 0x7f7bb815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 -- 172.21.15.81:0/1422280391 >> v2:172.21.15.178:3300/0 conn(0x7f7bb806cd80 msgr2=0x7f7bb80b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 --2- 172.21.15.81:0/1422280391 >> v2:172.21.15.178:3300/0 conn(0x7f7bb806cd80 0x7f7bb80b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 -- 172.21.15.81:0/1422280391 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb815d950 con 0x7f7bb806ada0 2024-09-13T18:52:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb5e00700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb815ca20 0x7f7bb815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb5400700 1 --2- 172.21.15.81:0/1422280391 >> v2:172.21.15.178:3300/0 conn(0x7f7bb806cd80 0x7f7bb80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb6800700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb806b250 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80b6480 tx=0x7f7bb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f2f3f559128f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb4a00700 1 -- 172.21.15.81:0/1422280391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000e070 con 0x7f7bb806ada0 2024-09-13T18:52:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb4a00700 1 -- 172.21.15.81:0/1422280391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb000b9c0 con 0x7f7bb806ada0 2024-09-13T18:52:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb4a00700 1 -- 172.21.15.81:0/1422280391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000bd70 con 0x7f7bb806ada0 2024-09-13T18:52:33.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 -- 172.21.15.81:0/1422280391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 msgr2=0x7f7bb806b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.672+0000 7f7bb7200700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb806b250 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80b6480 tx=0x7f7bb000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 -- 172.21.15.81:0/1422280391 shutdown_connections 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 --2- 172.21.15.81:0/1422280391 >> v2:172.21.15.178:3300/0 conn(0x7f7bb806cd80 0x7f7bb80b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb806b250 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 --2- 172.21.15.81:0/1422280391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb815ca20 0x7f7bb815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 -- 172.21.15.81:0/1422280391 >> 172.21.15.81:0/1422280391 conn(0x7f7bb8071d20 msgr2=0x7f7bb8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 -- 172.21.15.81:0/1422280391 shutdown_connections 2024-09-13T18:52:33.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 -- 172.21.15.81:0/1422280391 wait complete. 2024-09-13T18:52:33.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 Processor -- start 2024-09-13T18:52:33.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 -- start start 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb81f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806cd80 0x7f7bb80d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.676+0000 7f7bb7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815ca20 0x7f7bb80cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb81f2330 con 0x7f7bb806ada0 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80ce250 con 0x7f7bb815ca20 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb80cd360 con 0x7f7bb806cd80 2024-09-13T18:52:33.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb81f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb81f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51512/0 (socket says 172.21.15.81:51512) 2024-09-13T18:52:33.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 -- 172.21.15.81:0/3922200365 learned_addr learned my addr 172.21.15.81:0/3922200365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5400700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806cd80 0x7f7bb80d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb6800700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815ca20 0x7f7bb80cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 -- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806cd80 msgr2=0x7f7bb80d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806cd80 0x7f7bb80d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 -- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815ca20 msgr2=0x7f7bb80cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815ca20 0x7f7bb80cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 -- 172.21.15.81:0/3922200365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0009b30 con 0x7f7bb806ada0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb6800700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815ca20 0x7f7bb80cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb5e00700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb81f1df0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e810 tx=0x7f7ba800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8013610 con 0x7f7bb806ada0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8013770 con 0x7f7bb806ada0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8013b00 con 0x7f7bb806ada0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb80cd640 con 0x7f7bb806ada0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb80cdc00 con 0x7f7bb806ada0 2024-09-13T18:52:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.680+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb806d1c0 con 0x7f7bb806ada0 2024-09-13T18:52:33.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.684+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ba8013c60 con 0x7f7bb806ada0 2024-09-13T18:52:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.684+0000 7f7bae000700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.684+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7ba8083b60 con 0x7f7bb806ada0 2024-09-13T18:52:33.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.684+0000 7f7bb5400700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:33.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.684+0000 7f7bb5400700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80b18a0 tx=0x7f7ba4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.692+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ba8050ff0 con 0x7f7bb806ada0 2024-09-13T18:52:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.876+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7bb806ab80 con 0x7f7bb806ada0 2024-09-13T18:52:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.884+0000 7f7bae000700 1 -- 172.21.15.81:0/3922200365 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7ba8054610 con 0x7f7bb806ada0 2024-09-13T18:52:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 msgr2=0x7f7b98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7bb80b18a0 tx=0x7f7ba4008040 comp rx=0 tx=0).stop 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 msgr2=0x7f7bb81f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb81f1df0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800e810 tx=0x7f7ba800ebd0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 shutdown_connections 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7b98066730 0x7f7b98068bf0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb815ca20 0x7f7bb80cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb806cd80 0x7f7bb80d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 --2- 172.21.15.81:0/3922200365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7bb806ada0 0x7f7bb81f1df0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 >> 172.21.15.81:0/3922200365 conn(0x7f7bb8071d20 msgr2=0x7f7bb8159880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 shutdown_connections 2024-09-13T18:52:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:33.888+0000 7f7bb7200700 1 -- 172.21.15.81:0/3922200365 wait complete. 2024-09-13T18:52:33.922 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:52:33.922 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:52:33.962 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:52:34.006 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:52:34.007 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:52:34.007 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:34.028 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:52:34.028 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:52:34.028 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:34.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:52:34.067 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:52:34.068 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:34.087 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:52:34.088 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:52:34.088 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:34.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:52:34.124 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:52:34.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:34.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.296+0000 7f286f000700 1 Processor -- start 2024-09-13T18:52:34.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.296+0000 7f286f000700 1 -- start start 2024-09-13T18:52:34.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286f000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286f000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28680cf480 0x7f286806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286f000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f286806ba10 0x7f286815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286f000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286806a430 con 0x7f28680cf480 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286f000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f286806a710 con 0x7f286806ba10 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286f000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286806a9f0 con 0x7f2868143d60 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28680cf480 0x7f286806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28680cf480 0x7f286806b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51520/0 (socket says 172.21.15.81:51520) 2024-09-13T18:52:34.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 -- 172.21.15.81:0/2993429534 learned_addr learned my addr 172.21.15.81:0/2993429534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:34.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286dc00700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286e600700 1 --2- 172.21.15.81:0/2993429534 >> v2:172.21.15.178:3300/0 conn(0x7f286806ba10 0x7f286815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 -- 172.21.15.81:0/2993429534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 msgr2=0x7f28680cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:34.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 -- 172.21.15.81:0/2993429534 >> v2:172.21.15.178:3300/0 conn(0x7f286806ba10 msgr2=0x7f286815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 --2- 172.21.15.81:0/2993429534 >> v2:172.21.15.178:3300/0 conn(0x7f286806ba10 0x7f286815b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 -- 172.21.15.81:0/2993429534 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286806acd0 con 0x7f28680cf480 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286dc00700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286e600700 1 --2- 172.21.15.81:0/2993429534 >> v2:172.21.15.178:3300/0 conn(0x7f286806ba10 0x7f286815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.300+0000 7f286d200700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f286806b4d0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2868067150 tx=0x7f2854009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0365f434279d5f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f2867e00700 1 -- 172.21.15.81:0/2993429534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400b8a0 con 0x7f28680cf480 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f2867e00700 1 -- 172.21.15.81:0/2993429534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285400ba00 con 0x7f28680cf480 2024-09-13T18:52:34.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f2867e00700 1 -- 172.21.15.81:0/2993429534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400bd90 con 0x7f28680cf480 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 -- 172.21.15.81:0/2993429534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 msgr2=0x7f286806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f286806b4d0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f2868067150 tx=0x7f2854009bf0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 -- 172.21.15.81:0/2993429534 shutdown_connections 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 --2- 172.21.15.81:0/2993429534 >> v2:172.21.15.178:3300/0 conn(0x7f286806ba10 0x7f286815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f286806b4d0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 --2- 172.21.15.81:0/2993429534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 -- 172.21.15.81:0/2993429534 >> 172.21.15.81:0/2993429534 conn(0x7f286806ca10 msgr2=0x7f286806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 -- 172.21.15.81:0/2993429534 shutdown_connections 2024-09-13T18:52:34.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 -- 172.21.15.81:0/2993429534 wait complete. 2024-09-13T18:52:34.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.304+0000 7f286f000700 1 Processor -- start 2024-09-13T18:52:34.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 -- start start 2024-09-13T18:52:34.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286806ba10 0x7f28680cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f28680acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286813db10 con 0x7f28680cf480 2024-09-13T18:52:34.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28680ae700 con 0x7f286806ba10 2024-09-13T18:52:34.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286f000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680adaf0 con 0x7f2868143d60 2024-09-13T18:52:34.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286806ba10 0x7f28680cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286e600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f28680acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286e600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49488/0 (socket says 172.21.15.81:49488) 2024-09-13T18:52:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286dc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286806ba10 0x7f28680cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:36544/0 (socket says 172.21.15.81:36544) 2024-09-13T18:52:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286e600700 1 -- 172.21.15.81:0/3090087902 learned_addr learned my addr 172.21.15.81:0/3090087902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 -- 172.21.15.81:0/3090087902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 msgr2=0x7f28680ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 -- 172.21.15.81:0/3090087902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286806ba10 msgr2=0x7f28680cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286806ba10 0x7f28680cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 -- 172.21.15.81:0/3090087902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2854009570 con 0x7f28680cf480 2024-09-13T18:52:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f286d200700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f28680acf50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2854016000 tx=0x7f2854004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.308+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285400bee0 con 0x7f28680cf480 2024-09-13T18:52:34.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.312+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285401f070 con 0x7f28680cf480 2024-09-13T18:52:34.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.312+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28680addd0 con 0x7f28680cf480 2024-09-13T18:52:34.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.312+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854003b20 con 0x7f28680cf480 2024-09-13T18:52:34.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.312+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28680ae390 con 0x7f28680cf480 2024-09-13T18:52:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.312+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286806b4d0 con 0x7f28680cf480 2024-09-13T18:52:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.312+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2854003c80 con 0x7f28680cf480 2024-09-13T18:52:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.316+0000 7f2865600700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2848066730 0x7f2848068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.316+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2854021070 con 0x7f28680cf480 2024-09-13T18:52:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.316+0000 7f286dc00700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2848066730 0x7f2848068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.316+0000 7f286dc00700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2848066730 0x7f2848068bf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f285c00ab60 tx=0x7f285c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.320+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2854052f40 con 0x7f28680cf480 2024-09-13T18:52:34.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.552+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28680ae840 con 0x7f28680cf480 2024-09-13T18:52:34.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.556+0000 7f2865600700 1 -- 172.21.15.81:0/3090087902 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f2854015de0 con 0x7f28680cf480 2024-09-13T18:52:34.563 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:34.563 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5990,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/1616281696","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1616281696},{"type":"v1","addr":"172.21.15.178:6833","nonce":1616281696}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6413,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2439494920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2439494920},{"type":"v1","addr":"172.21.15.178:6835","nonce":2439494920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7075,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3682389801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":3682389801},{"type":"v1","addr":"172.21.15.81:6837","nonce":3682389801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/3915903296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3915903296},{"type":"v1","addr":"172.21.15.81:6836","nonce":3915903296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2024-09-13T18:52:34.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2848066730 msgr2=0x7f2848068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2848066730 0x7f2848068bf0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f285c00ab60 tx=0x7f285c008040 comp rx=0 tx=0).stop 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 msgr2=0x7f28680acf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f28680acf50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f2854016000 tx=0x7f2854004770 comp rx=0 tx=0).stop 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 shutdown_connections 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2848066730 0x7f2848068bf0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868143d60 0x7f28680ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28680cf480 0x7f28680acf50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 --2- 172.21.15.81:0/3090087902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f286806ba10 0x7f28680cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 >> 172.21.15.81:0/3090087902 conn(0x7f286806ca10 msgr2=0x7f286806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 shutdown_connections 2024-09-13T18:52:34.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.560+0000 7f286f000700 1 -- 172.21.15.81:0/3090087902 wait complete. 2024-09-13T18:52:34.568 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 65 2024-09-13T18:52:34.588 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:52:34.588 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:52:34.589 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:52:34.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:34.589 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:52:34.589 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:52:34.589 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:52:34.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:34.589 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:52:34.589 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:52:34.590 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:52:34.590 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:34.590 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:52:34.590 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:52:34.590 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:52:34.590 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:52:34.613 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:52:34.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:52:34.615 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:52:34.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:52:34.615 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:52:34.615 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:52:34.617 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:52:34.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:52:34.661 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:52:34.662 DEBUG:teuthology.parallel:result is None 2024-09-13T18:52:34.662 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:52:34.663 DEBUG:teuthology.parallel:result is None 2024-09-13T18:52:34.666 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:52:34.666 DEBUG:teuthology.parallel:result is None 2024-09-13T18:52:34.667 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:52:34.667 DEBUG:teuthology.parallel:result is None 2024-09-13T18:52:34.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:52:34.778 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:52:34.788 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:52:34.792 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:52:34.796 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:52:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 Processor -- start 2024-09-13T18:52:34.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 -- start start 2024-09-13T18:52:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11300b2700 0x7f11300cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f11300b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11300b3a70 con 0x7f11300b5b30 2024-09-13T18:52:34.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11300cef50 con 0x7f11300b2700 2024-09-13T18:52:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1135400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300cf920 con 0x7f11300b2ae0 2024-09-13T18:52:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1134a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11300b5b30 0x7f11300cffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47324/0 (socket says 172.21.15.81:47324) 2024-09-13T18:52:34.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f1134a00700 1 -- 172.21.15.81:0/2808381306 learned_addr learned my addr 172.21.15.81:0/2808381306 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112f400700 1 --2- 172.21.15.81:0/2808381306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f11300b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112fe00700 1 --2- 172.21.15.81:0/2808381306 >> v2:172.21.15.178:3300/0 conn(0x7f11300b2700 0x7f11300cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112ea00700 1 -- 172.21.15.81:0/2808381306 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627370329 0 0) 0x7f11300b3a70 con 0x7f11300b5b30 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112ea00700 1 -- 172.21.15.81:0/2808381306 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11140035d0 con 0x7f11300b5b30 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112f400700 1 -- 172.21.15.81:0/2808381306 >> v2:172.21.15.178:3300/0 conn(0x7f11300b2700 msgr2=0x7f11300cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112f400700 1 --2- 172.21.15.81:0/2808381306 >> v2:172.21.15.178:3300/0 conn(0x7f11300b2700 0x7f11300cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112f400700 1 -- 172.21.15.81:0/2808381306 >> v1:172.21.15.81:6789/0 conn(0x7f11300b5b30 legacy=0x7f11300cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112f400700 1 -- 172.21.15.81:0/2808381306 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300b3cc0 con 0x7f11300b2ae0 2024-09-13T18:52:34.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.820+0000 7f112f400700 1 --2- 172.21.15.81:0/2808381306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f11300b55f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f111c009850 tx=0x7f111c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4e33dbff24ddd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f112ea00700 1 -- 172.21.15.81:0/2808381306 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011830 con 0x7f11300b2ae0 2024-09-13T18:52:34.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f112ea00700 1 -- 172.21.15.81:0/2808381306 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c011990 con 0x7f11300b2ae0 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f112ea00700 1 -- 172.21.15.81:0/2808381306 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011d40 con 0x7f11300b2ae0 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 -- 172.21.15.81:0/2808381306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 msgr2=0x7f11300b55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 --2- 172.21.15.81:0/2808381306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f11300b55f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f111c009850 tx=0x7f111c009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 -- 172.21.15.81:0/2808381306 shutdown_connections 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 --2- 172.21.15.81:0/2808381306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f11300b55f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 --2- 172.21.15.81:0/2808381306 >> v2:172.21.15.178:3300/0 conn(0x7f11300b2700 0x7f11300cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 -- 172.21.15.81:0/2808381306 >> 172.21.15.81:0/2808381306 conn(0x7f1130071d90 msgr2=0x7f1130072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:34.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 -- 172.21.15.81:0/2808381306 shutdown_connections 2024-09-13T18:52:34.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 -- 172.21.15.81:0/2808381306 wait complete. 2024-09-13T18:52:34.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.824+0000 7f1135400700 1 Processor -- start 2024-09-13T18:52:34.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 -- start start 2024-09-13T18:52:34.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11300b2700 0x7f113013d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f113013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 0x7f113006b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113013d860 con 0x7f11300b5b30 2024-09-13T18:52:34.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113013db40 con 0x7f11300b2700 2024-09-13T18:52:34.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113013de20 con 0x7f11300b2ae0 2024-09-13T18:52:34.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 0x7f113006b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 0x7f113006b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51590/0 (socket says 172.21.15.81:51590) 2024-09-13T18:52:34.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 -- 172.21.15.81:0/2695048305 learned_addr learned my addr 172.21.15.81:0/2695048305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:34.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f112f400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f113013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f112fe00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11300b2700 0x7f113013d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 -- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 msgr2=0x7f113013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f113013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 -- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11300b2700 msgr2=0x7f113013d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11300b2700 0x7f113013d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 -- 172.21.15.81:0/2695048305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c0094b0 con 0x7f11300b5b30 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1134a00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 0x7f113006b3e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f112800caa0 tx=0x7f112800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280074e0 con 0x7f11300b5b30 2024-09-13T18:52:34.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1128007640 con 0x7f11300b5b30 2024-09-13T18:52:34.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113013e100 con 0x7f11300b5b30 2024-09-13T18:52:34.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.828+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280079f0 con 0x7f11300b5b30 2024-09-13T18:52:34.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.832+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113013d570 con 0x7f11300b5b30 2024-09-13T18:52:34.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.832+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113013e620 con 0x7f11300b5b30 2024-09-13T18:52:34.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.832+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f112801b3b0 con 0x7f11300b5b30 2024-09-13T18:52:34.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.836+0000 7f1127e00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1110066730 0x7f1110068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:34.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.836+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f11280839e0 con 0x7f11300b5b30 2024-09-13T18:52:34.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.836+0000 7f112fe00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1110066730 0x7f1110068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:34.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.836+0000 7f112fe00700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1110066730 0x7f1110068bf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f113015c930 tx=0x7f1120009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:34.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:34.840+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1128050dc0 con 0x7f11300b5b30 2024-09-13T18:52:35.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.036+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1130146880 con 0x7f11300b5b30 2024-09-13T18:52:35.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.824+0000 7f1127e00700 1 -- 172.21.15.81:0/2695048305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1128017080 con 0x7f11300b5b30 2024-09-13T18:52:35.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1110066730 msgr2=0x7f1110068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:35.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1110066730 0x7f1110068bf0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f113015c930 tx=0x7f1120009240 comp rx=0 tx=0).stop 2024-09-13T18:52:35.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 msgr2=0x7f113006b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:35.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 0x7f113006b3e0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f112800caa0 tx=0x7f112800cad0 comp rx=0 tx=0).stop 2024-09-13T18:52:35.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 shutdown_connections 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1110066730 0x7f1110068bf0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11300b5b30 0x7f113006b3e0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11300b2ae0 0x7f113013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 --2- 172.21.15.81:0/2695048305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11300b2700 0x7f113013d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 >> 172.21.15.81:0/2695048305 conn(0x7f1130071d90 msgr2=0x7f113015fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 shutdown_connections 2024-09-13T18:52:35.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:35.828+0000 7f1135400700 1 -- 172.21.15.81:0/2695048305 wait complete. 2024-09-13T18:52:35.838 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-13T18:52:35.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:52:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.020+0000 7f8fc1600700 1 Processor -- start 2024-09-13T18:52:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.020+0000 7f8fc1600700 1 -- start start 2024-09-13T18:52:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc1600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8fbc1593f0 0x7f8fbc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc1600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fbc06cbb0 0x7f8fbc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc1600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fbc0cd190 con 0x7f8fbc06fd40 2024-09-13T18:52:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc1600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc1597d0 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc1600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fbc06d530 con 0x7f8fbc1593f0 2024-09-13T18:52:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fb3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8fbc06cbb0 0x7f8fbc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc0c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8fbc06fd40 0x7f8fbc070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47334/0 (socket says 172.21.15.81:47334) 2024-09-13T18:52:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.024+0000 7f8fc0c00700 1 -- 172.21.15.81:0/3576180385 learned_addr learned my addr 172.21.15.81:0/3576180385 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fbbe00700 1 --2- 172.21.15.81:0/3576180385 >> v2:172.21.15.178:3300/0 conn(0x7f8fbc1593f0 0x7f8fbc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fb3400700 1 -- 172.21.15.81:0/3576180385 >> v2:172.21.15.178:3300/0 conn(0x7f8fbc1593f0 msgr2=0x7f8fbc0718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fb3400700 1 --2- 172.21.15.81:0/3576180385 >> v2:172.21.15.178:3300/0 conn(0x7f8fbc1593f0 0x7f8fbc0718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fb3400700 1 -- 172.21.15.81:0/3576180385 >> v1:172.21.15.81:6789/0 conn(0x7f8fbc06fd40 legacy=0x7f8fbc070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fb3400700 1 -- 172.21.15.81:0/3576180385 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc0b19b0 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fb3400700 1 --2- 172.21.15.81:0/3576180385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc06cff0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc06b490 tx=0x7f8fa4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c885eb627e43a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fbb400700 1 -- 172.21.15.81:0/3576180385 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400d980 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fbb400700 1 -- 172.21.15.81:0/3576180385 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400dae0 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fbb400700 1 -- 172.21.15.81:0/3576180385 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400de70 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 -- 172.21.15.81:0/3576180385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 msgr2=0x7f8fbc06cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3576180385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc06cff0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc06b490 tx=0x7f8fa4009b30 comp rx=0 tx=0).stop 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 -- 172.21.15.81:0/3576180385 shutdown_connections 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3576180385 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc06cff0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3576180385 >> v2:172.21.15.178:3300/0 conn(0x7f8fbc1593f0 0x7f8fbc0718c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 -- 172.21.15.81:0/3576180385 >> 172.21.15.81:0/3576180385 conn(0x7f8fbc0b0c40 msgr2=0x7f8fbc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 -- 172.21.15.81:0/3576180385 shutdown_connections 2024-09-13T18:52:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.028+0000 7f8fc1600700 1 -- 172.21.15.81:0/3576180385 wait complete. 2024-09-13T18:52:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 Processor -- start 2024-09-13T18:52:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 -- start start 2024-09-13T18:52:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc1edf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fbc06fd40 0x7f8fbc15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fbc1593f0 0x7f8fbc1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc1ee480 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc1e3e00 con 0x7f8fbc06fd40 2024-09-13T18:52:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fc1600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fbc0a85b0 con 0x7f8fbc1593f0 2024-09-13T18:52:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fbbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc1edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fbbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc1edf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51612/0 (socket says 172.21.15.81:51612) 2024-09-13T18:52:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.032+0000 7f8fbbe00700 1 -- 172.21.15.81:0/3798183473 learned_addr learned my addr 172.21.15.81:0/3798183473 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fc0c00700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fbc1593f0 0x7f8fbc1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fb3400700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fbc06fd40 0x7f8fbc15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fbbe00700 1 -- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fbc1593f0 msgr2=0x7f8fbc1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fbbe00700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fbc1593f0 0x7f8fbc1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fbbe00700 1 -- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fbc06fd40 msgr2=0x7f8fbc15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fbbe00700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fbc06fd40 0x7f8fbc15bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fbbe00700 1 -- 172.21.15.81:0/3798183473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa40094b0 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fbbe00700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc1edf40 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00e9d0 tx=0x7f8fac00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac009720 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac00ee70 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00ca50 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fbc1e3840 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fbc0a8850 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.036+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fbc0ce440 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.040+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fac00cbb0 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.040+0000 7f8fb8c00700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f98066730 0x7f8f98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.040+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8fac083f30 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.040+0000 7f8fb3400700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f98066730 0x7f8f98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.044+0000 7f8fb3400700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f98066730 0x7f8f98068bf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa401b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.048+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fac0514a0 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.300+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8fbc073660 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.300+0000 7f8fb8c00700 1 -- 172.21.15.81:0/3798183473 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8fac00ce60 con 0x7f8fbc06cbb0 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw==", 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw==", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:52:36.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q==", 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:52:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g==", 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g==", 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw==", 2024-09-13T18:52:36.314 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA==", 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg==", 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw==", 2024-09-13T18:52:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw==", 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A==", 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-13T18:52:36.318 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q==", 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ==", 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg==", 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:52:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg==", 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-13T18:52:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng==", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB2iORm9hwhIRAASJc+x3PH9tdxfNlBIxr8ZA==", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:52:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA==", 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g==", 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T18:52:36.324 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:52:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f98066730 msgr2=0x7f8f98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f98066730 0x7f8f98068bf0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa401b040 comp rx=0 tx=0).stop 2024-09-13T18:52:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 msgr2=0x7f8fbc1edf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc1edf40 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f8fac00e9d0 tx=0x7f8fac00ece0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 shutdown_connections 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f98066730 0x7f8f98068bf0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fbc1593f0 0x7f8fbc1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fbc06fd40 0x7f8fbc15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 --2- 172.21.15.81:0/3798183473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fbc06cbb0 0x7f8fbc1edf40 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 >> 172.21.15.81:0/3798183473 conn(0x7f8fbc0b0c40 msgr2=0x7f8fbc0cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 shutdown_connections 2024-09-13T18:52:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.304+0000 7f8fc1600700 1 -- 172.21.15.81:0/3798183473 wait complete. 2024-09-13T18:52:36.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.496+0000 7fbd3aa00700 1 Processor -- start 2024-09-13T18:52:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3aa00700 1 -- start start 2024-09-13T18:52:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3aa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbd340ceab0 0x7fbd3406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3aa00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd340ccf60 0x7fbd3406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3aa00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd3415e3e0 con 0x7fbd340cdad0 2024-09-13T18:52:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3aa00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3406d010 con 0x7fbd340ccf60 2024-09-13T18:52:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3aa00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3415d7d0 con 0x7fbd340ceab0 2024-09-13T18:52:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd340ccf60 0x7fbd3406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd340ccf60 0x7fbd3406cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51618/0 (socket says 172.21.15.81:51618) 2024-09-13T18:52:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.500+0000 7fbd3a000700 1 -- 172.21.15.81:0/2076370787 learned_addr learned my addr 172.21.15.81:0/2076370787 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd38c00700 1 --2- 172.21.15.81:0/2076370787 >> v2:172.21.15.178:3300/0 conn(0x7fbd340ceab0 0x7fbd3406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3a000700 1 -- 172.21.15.81:0/2076370787 >> v2:172.21.15.178:3300/0 conn(0x7fbd340ceab0 msgr2=0x7fbd3406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3a000700 1 --2- 172.21.15.81:0/2076370787 >> v2:172.21.15.178:3300/0 conn(0x7fbd340ceab0 0x7fbd3406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3a000700 1 -- 172.21.15.81:0/2076370787 >> v1:172.21.15.178:6789/0 conn(0x7fbd340cdad0 legacy=0x7fbd340ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3a000700 1 -- 172.21.15.81:0/2076370787 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3415dab0 con 0x7fbd340ccf60 2024-09-13T18:52:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3a000700 1 --2- 172.21.15.81:0/2076370787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340ccf60 0x7fbd3406cad0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbd34067fa0 tx=0x7fbd2c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7589ec810de62119 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd33e00700 1 -- 172.21.15.81:0/2076370787 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c010070 con 0x7fbd340ccf60 2024-09-13T18:52:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd33e00700 1 -- 172.21.15.81:0/2076370787 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c00dd50 con 0x7fbd340ccf60 2024-09-13T18:52:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd33e00700 1 -- 172.21.15.81:0/2076370787 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c00b310 con 0x7fbd340ccf60 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2076370787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340ccf60 msgr2=0x7fbd3406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2076370787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340ccf60 0x7fbd3406cad0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fbd34067fa0 tx=0x7fbd2c00d430 comp rx=0 tx=0).stop 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2076370787 shutdown_connections 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2076370787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340ccf60 0x7fbd3406cad0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2076370787 >> v2:172.21.15.178:3300/0 conn(0x7fbd340ceab0 0x7fbd3406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2076370787 >> 172.21.15.81:0/2076370787 conn(0x7fbd3406a390 msgr2=0x7fbd3406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2076370787 shutdown_connections 2024-09-13T18:52:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.504+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2076370787 wait complete. 2024-09-13T18:52:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.508+0000 7fbd3aa00700 1 Processor -- start 2024-09-13T18:52:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.508+0000 7fbd3aa00700 1 -- start start 2024-09-13T18:52:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd340ccf60 0x7fbd340a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 0x7fbd34153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd340ceab0 0x7fbd340c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd341f39b0 con 0x7fbd340cdad0 2024-09-13T18:52:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340a8b70 con 0x7fbd340ceab0 2024-09-13T18:52:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd340a85b0 con 0x7fbd340ccf60 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 0x7fbd34153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 0x7fbd34153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51634/0 (socket says 172.21.15.81:51634) 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 -- 172.21.15.81:0/2043194313 learned_addr learned my addr 172.21.15.81:0/2043194313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd39600700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd340ccf60 0x7fbd340a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3a000700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd340ceab0 0x7fbd340c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 -- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd340ccf60 msgr2=0x7fbd340a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd340ccf60 0x7fbd340a8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 -- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd340ceab0 msgr2=0x7fbd340c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd340ceab0 0x7fbd340c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 -- 172.21.15.81:0/2043194313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c00bd40 con 0x7fbd340cdad0 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd38c00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 0x7fbd34153cb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000d800 tx=0x7fbd2000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200125f0 con 0x7fbd340cdad0 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20012750 con 0x7fbd340cdad0 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20012b00 con 0x7fbd340cdad0 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd340a8890 con 0x7fbd340cdad0 2024-09-13T18:52:36.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.512+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd340a93d0 con 0x7fbd340cdad0 2024-09-13T18:52:36.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.516+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd34072a10 con 0x7fbd340cdad0 2024-09-13T18:52:36.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.516+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd20012c60 con 0x7fbd340cdad0 2024-09-13T18:52:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.520+0000 7fbd31600700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd14066730 0x7fbd14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.520+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbd20084a20 con 0x7fbd340cdad0 2024-09-13T18:52:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.520+0000 7fbd39600700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd14066730 0x7fbd14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.520+0000 7fbd39600700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd14066730 0x7fbd14068bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbd340725c0 tx=0x7fbd28007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.524+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd20052110 con 0x7fbd340cdad0 2024-09-13T18:52:36.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.708+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd341f3af0 con 0x7fbd340cdad0 2024-09-13T18:52:36.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.708+0000 7fbd31600700 1 -- 172.21.15.81:0/2043194313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13063 (secure 0 0 0) 0x7fbd341f3af0 con 0x7fbd340cdad0 2024-09-13T18:52:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:36.717 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:35.815756+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:36.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd14066730 msgr2=0x7fbd14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd14066730 0x7fbd14068bf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbd340725c0 tx=0x7fbd28007ee0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 msgr2=0x7fbd34153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 0x7fbd34153cb0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000d800 tx=0x7fbd2000db10 comp rx=0 tx=0).stop 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 shutdown_connections 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd14066730 0x7fbd14068bf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd340ceab0 0x7fbd340c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd340cdad0 0x7fbd34153cb0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 --2- 172.21.15.81:0/2043194313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd340ccf60 0x7fbd340a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 >> 172.21.15.81:0/2043194313 conn(0x7fbd3406a390 msgr2=0x7fbd340cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 shutdown_connections 2024-09-13T18:52:36.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.712+0000 7fbd3aa00700 1 -- 172.21.15.81:0/2043194313 wait complete. 2024-09-13T18:52:36.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:52:36.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:52:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 Processor -- start 2024-09-13T18:52:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 -- start start 2024-09-13T18:52:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f449015ab60 0x7f44900cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f449015b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44900cdcc0 con 0x7f449006bbf0 2024-09-13T18:52:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449015af40 con 0x7f449015ab60 2024-09-13T18:52:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.912+0000 7f4496a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449006a990 con 0x7f44900667a0 2024-09-13T18:52:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4494a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f449015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f449015ab60 0x7f44900cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448f400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f449006bbf0 0x7f4490066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:39026/0 (socket says 172.21.15.81:39026) 2024-09-13T18:52:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448f400700 1 -- 172.21.15.81:0/1167413363 learned_addr learned my addr 172.21.15.81:0/1167413363 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448fe00700 1 -- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 msgr2=0x7f449015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448fe00700 1 --2- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f449015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448fe00700 1 -- 172.21.15.81:0/1167413363 >> v1:172.21.15.178:6789/0 conn(0x7f449006bbf0 legacy=0x7f4490066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448ea00700 1 -- 172.21.15.81:0/1167413363 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000415084 0 0) 0x7f44900cdcc0 con 0x7f449006bbf0 2024-09-13T18:52:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448fe00700 1 -- 172.21.15.81:0/1167413363 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449006ac70 con 0x7f449015ab60 2024-09-13T18:52:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4494a00700 1 --2- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f449015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448fe00700 1 --2- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900cf0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4480009850 tx=0x7f4480009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d7e733d7b868aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448ea00700 1 -- 172.21.15.81:0/1167413363 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480011830 con 0x7f449015ab60 2024-09-13T18:52:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448ea00700 1 -- 172.21.15.81:0/1167413363 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480011990 con 0x7f449015ab60 2024-09-13T18:52:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f448ea00700 1 -- 172.21.15.81:0/1167413363 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480011d40 con 0x7f449015ab60 2024-09-13T18:52:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4496a00700 1 -- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 msgr2=0x7f44900cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4496a00700 1 --2- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900cf0d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4480009850 tx=0x7f4480009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4496a00700 1 -- 172.21.15.81:0/1167413363 shutdown_connections 2024-09-13T18:52:36.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4496a00700 1 --2- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f449015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4496a00700 1 --2- 172.21.15.81:0/1167413363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900cf0d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.916+0000 7f4496a00700 1 -- 172.21.15.81:0/1167413363 >> 172.21.15.81:0/1167413363 conn(0x7f44900b18c0 msgr2=0x7f44900b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:36.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.920+0000 7f4496a00700 1 -- 172.21.15.81:0/1167413363 shutdown_connections 2024-09-13T18:52:36.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.920+0000 7f4496a00700 1 -- 172.21.15.81:0/1167413363 wait complete. 2024-09-13T18:52:36.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.920+0000 7f4496a00700 1 Processor -- start 2024-09-13T18:52:36.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.920+0000 7f4496a00700 1 -- start start 2024-09-13T18:52:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4496a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f44901f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4496a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 0x7f4490146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4496a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4496a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490150970 con 0x7f449006bbf0 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4496a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490146870 con 0x7f449015ab60 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4496a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4490150060 con 0x7f44900667a0 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 0x7f4490146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 0x7f4490146330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59890/0 (socket says 172.21.15.81:59890) 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 -- 172.21.15.81:0/4188285577 learned_addr learned my addr 172.21.15.81:0/4188285577 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448fe00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f44901f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4494a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 -- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 msgr2=0x7f44901f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f44901f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 -- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 msgr2=0x7f44900c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 -- 172.21.15.81:0/4188285577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488009a70 con 0x7f449006bbf0 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f448f400700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 0x7f4490146330 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c5b0 tx=0x7f447c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.924+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c004ca0 con 0x7f449006bbf0 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.928+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800094b0 con 0x7f449006bbf0 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.928+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c004e20 con 0x7f449006bbf0 2024-09-13T18:52:36.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.928+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c007310 con 0x7f449006bbf0 2024-09-13T18:52:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.928+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44901502b0 con 0x7f449006bbf0 2024-09-13T18:52:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.928+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4490150ab0 con 0x7f449006bbf0 2024-09-13T18:52:36.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.932+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f447c007470 con 0x7f449006bbf0 2024-09-13T18:52:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.932+0000 7f4487e00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4470066730 0x7f4470068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.932+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f447c083b80 con 0x7f449006bbf0 2024-09-13T18:52:36.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.932+0000 7f448fe00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4470066730 0x7f4470068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:36.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.932+0000 7f448fe00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4470066730 0x7f4470068bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f44800090b0 tx=0x7f448001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:36.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:36.940+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4490150ab0 con 0x7f449006bbf0 2024-09-13T18:52:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.120+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4490150ab0 con 0x7f449006bbf0 2024-09-13T18:52:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.120+0000 7f4487e00700 1 -- 172.21.15.81:0/4188285577 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4490150ab0 con 0x7f449006bbf0 2024-09-13T18:52:37.127 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:52:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4470066730 msgr2=0x7f4470068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4470066730 0x7f4470068bf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f44800090b0 tx=0x7f448001c040 comp rx=0 tx=0).stop 2024-09-13T18:52:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 msgr2=0x7f4490146330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 0x7f4490146330 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f447c00c5b0 tx=0x7f447c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 shutdown_connections 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4470066730 0x7f4470068bf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449015ab60 0x7f44900c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f449006bbf0 0x7f4490146330 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 --2- 172.21.15.81:0/4188285577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900667a0 0x7f44901f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 >> 172.21.15.81:0/4188285577 conn(0x7f44900b18c0 msgr2=0x7f449015c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 shutdown_connections 2024-09-13T18:52:37.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.124+0000 7f4496a00700 1 -- 172.21.15.81:0/4188285577 wait complete. 2024-09-13T18:52:37.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:52:37.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.308+0000 7fe8d3200700 1 Processor -- start 2024-09-13T18:52:37.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8d3200700 1 -- start start 2024-09-13T18:52:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8d3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4159bd0 0x7fe8d40cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8d3200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8d406b1b0 0x7fe8d41636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8d3200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40707d0 con 0x7fe8d4071870 2024-09-13T18:52:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8d3200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d40720a0 con 0x7fe8d406b1b0 2024-09-13T18:52:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8d3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d406fee0 con 0x7fe8d4159bd0 2024-09-13T18:52:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8c9400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe8d4071870 0x7fe8d406aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41888/0 (socket says 172.21.15.81:41888) 2024-09-13T18:52:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.312+0000 7fe8c9400700 1 -- 172.21.15.81:0/2426769556 learned_addr learned my addr 172.21.15.81:0/2426769556 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1e00700 1 --2- 172.21.15.81:0/2426769556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4159bd0 0x7fe8d40cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d2800700 1 --2- 172.21.15.81:0/2426769556 >> v2:172.21.15.178:3300/0 conn(0x7fe8d406b1b0 0x7fe8d41636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1400700 1 -- 172.21.15.81:0/2426769556 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228090169 0 0) 0x7fe8d40707d0 con 0x7fe8d4071870 2024-09-13T18:52:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1400700 1 -- 172.21.15.81:0/2426769556 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b80035d0 con 0x7fe8d4071870 2024-09-13T18:52:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1e00700 1 -- 172.21.15.81:0/2426769556 >> v2:172.21.15.178:3300/0 conn(0x7fe8d406b1b0 msgr2=0x7fe8d41636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1e00700 1 --2- 172.21.15.81:0/2426769556 >> v2:172.21.15.178:3300/0 conn(0x7fe8d406b1b0 0x7fe8d41636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1e00700 1 -- 172.21.15.81:0/2426769556 >> v1:172.21.15.81:6789/0 conn(0x7fe8d4071870 legacy=0x7fe8d406aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1e00700 1 -- 172.21.15.81:0/2426769556 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40b2ef0 con 0x7fe8d4159bd0 2024-09-13T18:52:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1e00700 1 --2- 172.21.15.81:0/2426769556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4159bd0 0x7fe8d40cb700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009d90 tx=0x7fe8c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfbd2b9b3a1df30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1400700 1 -- 172.21.15.81:0/2426769556 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c400e070 con 0x7fe8d4159bd0 2024-09-13T18:52:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1400700 1 -- 172.21.15.81:0/2426769556 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c400bb20 con 0x7fe8d4159bd0 2024-09-13T18:52:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d1400700 1 -- 172.21.15.81:0/2426769556 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4012430 con 0x7fe8d4159bd0 2024-09-13T18:52:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 -- 172.21.15.81:0/2426769556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4159bd0 msgr2=0x7fe8d40cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 --2- 172.21.15.81:0/2426769556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4159bd0 0x7fe8d40cb700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4009d90 tx=0x7fe8c400b330 comp rx=0 tx=0).stop 2024-09-13T18:52:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 -- 172.21.15.81:0/2426769556 shutdown_connections 2024-09-13T18:52:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 --2- 172.21.15.81:0/2426769556 >> v2:172.21.15.178:3300/0 conn(0x7fe8d406b1b0 0x7fe8d41636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 --2- 172.21.15.81:0/2426769556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4159bd0 0x7fe8d40cb700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 -- 172.21.15.81:0/2426769556 >> 172.21.15.81:0/2426769556 conn(0x7fe8d40b0c40 msgr2=0x7fe8d406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 -- 172.21.15.81:0/2426769556 shutdown_connections 2024-09-13T18:52:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.316+0000 7fe8d3200700 1 -- 172.21.15.81:0/2426769556 wait complete. 2024-09-13T18:52:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 Processor -- start 2024-09-13T18:52:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 -- start start 2024-09-13T18:52:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 0x7fe8d4142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4071870 0x7fe8d415c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d4159bd0 0x7fe8d414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d4143050 con 0x7fe8d406b1b0 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d415bd90 con 0x7fe8d4159bd0 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d415b180 con 0x7fe8d4071870 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 0x7fe8d4142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 0x7fe8d4142b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59896/0 (socket says 172.21.15.81:59896) 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 -- 172.21.15.81:0/1976539447 learned_addr learned my addr 172.21.15.81:0/1976539447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 -- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4071870 msgr2=0x7fe8d415c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4071870 0x7fe8d415c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d2800700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d4159bd0 0x7fe8d414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 -- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d4159bd0 msgr2=0x7fe8d414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d4159bd0 0x7fe8d414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d1e00700 1 -- 172.21.15.81:0/1976539447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4009a70 con 0x7fe8d406b1b0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.320+0000 7fe8d2800700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d4159bd0 0x7fe8d414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8d1e00700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 0x7fe8d4142b10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4014040 tx=0x7fe8c4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4012430 con 0x7fe8d406b1b0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4020070 con 0x7fe8d406b1b0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4004280 con 0x7fe8d406b1b0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d415b460 con 0x7fe8d406b1b0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d415ba20 con 0x7fe8d406b1b0 2024-09-13T18:52:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d415bbb0 con 0x7fe8d406b1b0 2024-09-13T18:52:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.324+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8c40043e0 con 0x7fe8d406b1b0 2024-09-13T18:52:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.328+0000 7fe8caa00700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe8b0066730 0x7fe8b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.328+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe8c4022070 con 0x7fe8d406b1b0 2024-09-13T18:52:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.328+0000 7fe8c9400700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe8b0066730 0x7fe8b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.328+0000 7fe8c9400700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe8b0066730 0x7fe8b0068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ad570 tx=0x7fe8bc0079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:37.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.332+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8c4053240 con 0x7fe8d406b1b0 2024-09-13T18:52:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.516+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe8d40cb700 con 0x7fe8d406b1b0 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.520+0000 7fe8caa00700 1 -- 172.21.15.81:0/1976539447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe8c402c060 con 0x7fe8d406b1b0 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:52:37.527 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:52:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.520+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe8b0066730 msgr2=0x7fe8b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.520+0000 7fe8d3200700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe8b0066730 0x7fe8b0068bf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe8d40ad570 tx=0x7fe8bc0079e0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.520+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 msgr2=0x7fe8d4142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.520+0000 7fe8d3200700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 0x7fe8d4142b10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe8c4014040 tx=0x7fe8c4004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 shutdown_connections 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe8b0066730 0x7fe8b0068bf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d4159bd0 0x7fe8d414fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d4071870 0x7fe8d415c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 --2- 172.21.15.81:0/1976539447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8d406b1b0 0x7fe8d4142b10 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 >> 172.21.15.81:0/1976539447 conn(0x7fe8d40b0c40 msgr2=0x7fe8d406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 shutdown_connections 2024-09-13T18:52:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.524+0000 7fe8d3200700 1 -- 172.21.15.81:0/1976539447 wait complete. 2024-09-13T18:52:37.551 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:52:37.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:52:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.716+0000 7fd18e200700 1 Processor -- start 2024-09-13T18:52:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.716+0000 7fd18e200700 1 -- start start 2024-09-13T18:52:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd18e200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880cf3b0 0x7fd18815a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd18e200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd18815a6b0 0x7fd188070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd18e200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18815df90 con 0x7fd1880ce280 2024-09-13T18:52:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd18e200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18815e420 con 0x7fd18815a6b0 2024-09-13T18:52:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd18e200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815aea0 con 0x7fd1880cf3b0 2024-09-13T18:52:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd187400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd1880ce280 0x7fd1880ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41904/0 (socket says 172.21.15.81:41904) 2024-09-13T18:52:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd187400700 1 -- 172.21.15.81:0/1621766719 learned_addr learned my addr 172.21.15.81:0/1621766719 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd17fe00700 1 --2- 172.21.15.81:0/1621766719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880cf3b0 0x7fd18815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd187e00700 1 --2- 172.21.15.81:0/1621766719 >> v2:172.21.15.178:3300/0 conn(0x7fd18815a6b0 0x7fd188070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd17fe00700 1 -- 172.21.15.81:0/1621766719 >> v2:172.21.15.178:3300/0 conn(0x7fd18815a6b0 msgr2=0x7fd188070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd17fe00700 1 --2- 172.21.15.81:0/1621766719 >> v2:172.21.15.178:3300/0 conn(0x7fd18815a6b0 0x7fd188070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd17fe00700 1 -- 172.21.15.81:0/1621766719 >> v1:172.21.15.81:6789/0 conn(0x7fd1880ce280 legacy=0x7fd1880ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd17fe00700 1 -- 172.21.15.81:0/1621766719 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18815d660 con 0x7fd1880cf3b0 2024-09-13T18:52:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd17fe00700 1 --2- 172.21.15.81:0/1621766719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880cf3b0 0x7fd18815a170 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd170009850 tx=0x7fd170009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5a7b835f5c4cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd186a00700 1 -- 172.21.15.81:0/1621766719 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170011830 con 0x7fd1880cf3b0 2024-09-13T18:52:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd186a00700 1 -- 172.21.15.81:0/1621766719 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd170011990 con 0x7fd1880cf3b0 2024-09-13T18:52:37.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.720+0000 7fd186a00700 1 -- 172.21.15.81:0/1621766719 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170011d20 con 0x7fd1880cf3b0 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 -- 172.21.15.81:0/1621766719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880cf3b0 msgr2=0x7fd18815a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 --2- 172.21.15.81:0/1621766719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880cf3b0 0x7fd18815a170 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd170009850 tx=0x7fd170009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 -- 172.21.15.81:0/1621766719 shutdown_connections 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 --2- 172.21.15.81:0/1621766719 >> v2:172.21.15.178:3300/0 conn(0x7fd18815a6b0 0x7fd188070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 --2- 172.21.15.81:0/1621766719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880cf3b0 0x7fd18815a170 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 -- 172.21.15.81:0/1621766719 >> 172.21.15.81:0/1621766719 conn(0x7fd18806a570 msgr2=0x7fd18806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:37.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 -- 172.21.15.81:0/1621766719 shutdown_connections 2024-09-13T18:52:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 -- 172.21.15.81:0/1621766719 wait complete. 2024-09-13T18:52:37.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.724+0000 7fd18e200700 1 Processor -- start 2024-09-13T18:52:37.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 -- start start 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880ce280 0x7fd188152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 0x7fd1880ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd18815a6b0 0x7fd1880cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1881541a0 con 0x7fd1880cf3b0 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd188153590 con 0x7fd18815a6b0 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd188153870 con 0x7fd1880ce280 2024-09-13T18:52:37.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 0x7fd1880ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 0x7fd1880ccfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59908/0 (socket says 172.21.15.81:59908) 2024-09-13T18:52:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 -- 172.21.15.81:0/4178873612 learned_addr learned my addr 172.21.15.81:0/4178873612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd187400700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880ce280 0x7fd188152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd187e00700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd18815a6b0 0x7fd1880cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 -- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880ce280 msgr2=0x7fd188152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880ce280 0x7fd188152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 -- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd18815a6b0 msgr2=0x7fd1880cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd18815a6b0 0x7fd1880cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 -- 172.21.15.81:0/4178873612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700094b0 con 0x7fd1880cf3b0 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17fe00700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 0x7fd1880ccfb0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd170000c00 tx=0x7fd170004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170004570 con 0x7fd1880cf3b0 2024-09-13T18:52:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17001f070 con 0x7fd1880cf3b0 2024-09-13T18:52:37.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd170003900 con 0x7fd1880cf3b0 2024-09-13T18:52:37.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.728+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd188153b50 con 0x7fd1880cf3b0 2024-09-13T18:52:37.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.732+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18814ba90 con 0x7fd1880cf3b0 2024-09-13T18:52:37.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.732+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18815aac0 con 0x7fd1880cf3b0 2024-09-13T18:52:37.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.732+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd170021030 con 0x7fd1880cf3b0 2024-09-13T18:52:37.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.732+0000 7fd17f400700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd164066730 0x7fd164068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:37.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.732+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd1700854b0 con 0x7fd1880cf3b0 2024-09-13T18:52:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.732+0000 7fd187400700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd164066730 0x7fd164068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:37.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.736+0000 7fd187400700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd164066730 0x7fd164068bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd178005930 tx=0x7fd178009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:37.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.744+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd170052a20 con 0x7fd1880cf3b0 2024-09-13T18:52:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:37.924+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd1880ae5f0 con 0x7fd1880cf3b0 2024-09-13T18:52:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.500+0000 7fd17f400700 1 -- 172.21.15.81:0/4178873612 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd170056040 con 0x7fd1880cf3b0 2024-09-13T18:52:38.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.504+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd164066730 msgr2=0x7fd164068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:38.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.504+0000 7fd18e200700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd164066730 0x7fd164068bf0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd178005930 tx=0x7fd178009040 comp rx=0 tx=0).stop 2024-09-13T18:52:38.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.504+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 msgr2=0x7fd1880ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:38.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.504+0000 7fd18e200700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 0x7fd1880ccfb0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd170000c00 tx=0x7fd170004770 comp rx=0 tx=0).stop 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 shutdown_connections 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd164066730 0x7fd164068bf0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd18815a6b0 0x7fd1880cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1880cf3b0 0x7fd1880ccfb0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 --2- 172.21.15.81:0/4178873612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1880ce280 0x7fd188152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 >> 172.21.15.81:0/4178873612 conn(0x7fd18806a570 msgr2=0x7fd18815b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 shutdown_connections 2024-09-13T18:52:38.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.508+0000 7fd18e200700 1 -- 172.21.15.81:0/4178873612 wait complete. 2024-09-13T18:52:38.519 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:52:38.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:52:38.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.704+0000 7fda1f200700 1 Processor -- start 2024-09-13T18:52:38.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.704+0000 7fda1f200700 1 -- start start 2024-09-13T18:52:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2015cbf0 0x7fda20072470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda200cfc20 0x7fda200d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1f200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200d05a0 con 0x7fda2015d560 2024-09-13T18:52:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1f200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda200729b0 con 0x7fda200cfc20 2024-09-13T18:52:38.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2015e0c0 con 0x7fda2015cbf0 2024-09-13T18:52:38.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda200cfc20 0x7fda200d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fda200cfc20 0x7fda200d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59918/0 (socket says 172.21.15.81:59918) 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1e800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fda2015d560 0x7fda2015d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41914/0 (socket says 172.21.15.81:41914) 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 -- 172.21.15.81:0/3698837340 learned_addr learned my addr 172.21.15.81:0/3698837340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1de00700 1 --2- 172.21.15.81:0/3698837340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2015cbf0 0x7fda20072470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1ca00700 1 -- 172.21.15.81:0/3698837340 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015935056 0 0) 0x7fda200d05a0 con 0x7fda2015d560 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1ca00700 1 -- 172.21.15.81:0/3698837340 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda040035d0 con 0x7fda2015d560 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 -- 172.21.15.81:0/3698837340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2015cbf0 msgr2=0x7fda20072470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 --2- 172.21.15.81:0/3698837340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2015cbf0 0x7fda20072470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 -- 172.21.15.81:0/3698837340 >> v1:172.21.15.81:6789/0 conn(0x7fda2015d560 legacy=0x7fda2015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 -- 172.21.15.81:0/3698837340 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200713d0 con 0x7fda200cfc20 2024-09-13T18:52:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1d400700 1 --2- 172.21.15.81:0/3698837340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda200cfc20 0x7fda200d0060 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009910 tx=0x7fda0c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3bd0c60323104b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1ca00700 1 -- 172.21.15.81:0/3698837340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c011830 con 0x7fda200cfc20 2024-09-13T18:52:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1ca00700 1 -- 172.21.15.81:0/3698837340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c011990 con 0x7fda200cfc20 2024-09-13T18:52:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.708+0000 7fda1ca00700 1 -- 172.21.15.81:0/3698837340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c011d40 con 0x7fda200cfc20 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 -- 172.21.15.81:0/3698837340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda200cfc20 msgr2=0x7fda200d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 --2- 172.21.15.81:0/3698837340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda200cfc20 0x7fda200d0060 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009910 tx=0x7fda0c009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 -- 172.21.15.81:0/3698837340 shutdown_connections 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 --2- 172.21.15.81:0/3698837340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda200cfc20 0x7fda200d0060 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 --2- 172.21.15.81:0/3698837340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2015cbf0 0x7fda20072470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 -- 172.21.15.81:0/3698837340 >> 172.21.15.81:0/3698837340 conn(0x7fda2006cbf0 msgr2=0x7fda2006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 -- 172.21.15.81:0/3698837340 shutdown_connections 2024-09-13T18:52:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 -- 172.21.15.81:0/3698837340 wait complete. 2024-09-13T18:52:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 Processor -- start 2024-09-13T18:52:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.712+0000 7fda1f200700 1 -- start start 2024-09-13T18:52:38.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda200cfc20 0x7fda200ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 0x7fda200ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2015d560 0x7fda2013e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200ad200 con 0x7fda2015cbf0 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda201504f0 con 0x7fda2015d560 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda20141080 con 0x7fda200cfc20 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 0x7fda200ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 0x7fda200ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59926/0 (socket says 172.21.15.81:59926) 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 -- 172.21.15.81:0/3305848842 learned_addr learned my addr 172.21.15.81:0/3305848842 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:38.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1de00700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda200cfc20 0x7fda200ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1e800700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2015d560 0x7fda2013e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 -- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda200cfc20 msgr2=0x7fda200ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda200cfc20 0x7fda200ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 -- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2015d560 msgr2=0x7fda2013e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2015d560 0x7fda2013e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 -- 172.21.15.81:0/3305848842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c009570 con 0x7fda2015cbf0 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1d400700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 0x7fda200ae690 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c004510 con 0x7fda2015cbf0 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0036c0 con 0x7fda2015cbf0 2024-09-13T18:52:38.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda201418d0 con 0x7fda2015cbf0 2024-09-13T18:52:38.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c003a70 con 0x7fda2015cbf0 2024-09-13T18:52:38.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.716+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda20141280 con 0x7fda2015cbf0 2024-09-13T18:52:38.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.720+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda20141a60 con 0x7fda2015cbf0 2024-09-13T18:52:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.724+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fda0c003bd0 con 0x7fda2015cbf0 2024-09-13T18:52:38.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.724+0000 7fda16000700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fda00066730 0x7fda00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.724+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fda0c021030 con 0x7fda2015cbf0 2024-09-13T18:52:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.724+0000 7fda1de00700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fda00066730 0x7fda00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.724+0000 7fda1de00700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fda00066730 0x7fda00068bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fda10009bf0 tx=0x7fda10009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:38.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.732+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda0c052ee0 con 0x7fda2015cbf0 2024-09-13T18:52:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:38.908+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fda2015cfd0 con 0x7fda2015cbf0 2024-09-13T18:52:39.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.520+0000 7fda16000700 1 -- 172.21.15.81:0/3305848842 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7fda0c02b0d0 con 0x7fda2015cbf0 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fda00066730 msgr2=0x7fda00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fda00066730 0x7fda00068bf0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fda10009bf0 tx=0x7fda10009240 comp rx=0 tx=0).stop 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 msgr2=0x7fda200ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 0x7fda200ae690 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c004770 comp rx=0 tx=0).stop 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 shutdown_connections 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fda00066730 0x7fda00068bf0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2015d560 0x7fda2013e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda2015cbf0 0x7fda200ae690 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 --2- 172.21.15.81:0/3305848842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda200cfc20 0x7fda200ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.528+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 >> 172.21.15.81:0/3305848842 conn(0x7fda2006cbf0 msgr2=0x7fda20156fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.532+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 shutdown_connections 2024-09-13T18:52:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.532+0000 7fda1f200700 1 -- 172.21.15.81:0/3305848842 wait complete. 2024-09-13T18:52:39.547 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:52:39.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:52:39.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 Processor -- start 2024-09-13T18:52:39.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 -- start start 2024-09-13T18:52:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946815aa90 0x7f94680b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94680cf830 0x7f94680cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680b4680 con 0x7f946806c5a0 2024-09-13T18:52:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946815aeb0 con 0x7f94680cf830 2024-09-13T18:52:39.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.736+0000 7f9467200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680b4960 con 0x7f946815aa90 2024-09-13T18:52:39.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94680cf830 0x7f94680cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:39.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94680cf830 0x7f94680cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:45274/0 (socket says 172.21.15.81:45274) 2024-09-13T18:52:39.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 -- 172.21.15.81:0/3988014393 learned_addr learned my addr 172.21.15.81:0/3988014393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:39.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9465400700 1 --2- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946815aa90 0x7f94680b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 -- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946815aa90 msgr2=0x7f94680b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 --2- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946815aa90 0x7f94680b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 -- 172.21.15.81:0/3988014393 >> v1:172.21.15.178:6789/0 conn(0x7f946806c5a0 legacy=0x7f946806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 -- 172.21.15.81:0/3988014393 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680cf030 con 0x7f94680cf830 2024-09-13T18:52:39.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9464a00700 1 -- 172.21.15.81:0/3988014393 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076721077 0 0) 0x7f94680b4680 con 0x7f946806c5a0 2024-09-13T18:52:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9466800700 1 --2- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680cf830 0x7f94680cfc80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9460009e50 tx=0x7f946000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb08398dc5fb429 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9464a00700 1 -- 172.21.15.81:0/3988014393 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946000e070 con 0x7f94680cf830 2024-09-13T18:52:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9464a00700 1 -- 172.21.15.81:0/3988014393 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946000b910 con 0x7f94680cf830 2024-09-13T18:52:39.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9464a00700 1 -- 172.21.15.81:0/3988014393 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946000bcc0 con 0x7f94680cf830 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9467200700 1 -- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680cf830 msgr2=0x7f94680cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9467200700 1 --2- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680cf830 0x7f94680cfc80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9460009e50 tx=0x7f946000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9467200700 1 -- 172.21.15.81:0/3988014393 shutdown_connections 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9467200700 1 --2- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680cf830 0x7f94680cfc80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9467200700 1 --2- 172.21.15.81:0/3988014393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946815aa90 0x7f94680b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.740+0000 7f9467200700 1 -- 172.21.15.81:0/3988014393 >> 172.21.15.81:0/3988014393 conn(0x7f9468071d20 msgr2=0x7f9468072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.744+0000 7f9467200700 1 -- 172.21.15.81:0/3988014393 shutdown_connections 2024-09-13T18:52:39.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.744+0000 7f9467200700 1 -- 172.21.15.81:0/3988014393 wait complete. 2024-09-13T18:52:39.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.744+0000 7f9467200700 1 Processor -- start 2024-09-13T18:52:39.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.744+0000 7f9467200700 1 -- start start 2024-09-13T18:52:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9467200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946806c5a0 0x7f946814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:39.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9467200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680cf830 0x7f94681434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9467200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 0x7f946814d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9467200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946814a8c0 con 0x7f946815aa90 2024-09-13T18:52:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9467200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946814b480 con 0x7f946806c5a0 2024-09-13T18:52:39.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9467200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946814b760 con 0x7f94680cf830 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9466800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 0x7f946814d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9466800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 0x7f946814d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59936/0 (socket says 172.21.15.81:59936) 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9466800700 1 -- 172.21.15.81:0/2259061770 learned_addr learned my addr 172.21.15.81:0/2259061770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946806c5a0 0x7f946814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465400700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680cf830 0x7f94681434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 -- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680cf830 msgr2=0x7f94681434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680cf830 0x7f94681434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 -- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 msgr2=0x7f946814d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:39.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 0x7f946814d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 -- 172.21.15.81:0/2259061770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460009b30 con 0x7f946806c5a0 2024-09-13T18:52:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9466800700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 0x7f946814d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.748+0000 7f9465e00700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946806c5a0 0x7f946814c520 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f945800c4b0 tx=0x7f945800c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94580054e0 con 0x7f946806c5a0 2024-09-13T18:52:39.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580036a0 con 0x7f946806c5a0 2024-09-13T18:52:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946814ba40 con 0x7f946806c5a0 2024-09-13T18:52:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458003a50 con 0x7f946806c5a0 2024-09-13T18:52:39.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946814c000 con 0x7f946806c5a0 2024-09-13T18:52:39.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946806c980 con 0x7f946806c5a0 2024-09-13T18:52:39.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.752+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9458003bb0 con 0x7f946806c5a0 2024-09-13T18:52:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.756+0000 7f945e000700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:39.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.756+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f94580836f0 con 0x7f946806c5a0 2024-09-13T18:52:39.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.756+0000 7f9465400700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:39.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.756+0000 7f9465400700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f94680ccae0 tx=0x7f9454009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.764+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9458050850 con 0x7f946806c5a0 2024-09-13T18:52:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:39.984+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9468157070 con 0x7f946806c5a0 2024-09-13T18:52:40.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.004+0000 7f945e000700 1 -- 172.21.15.81:0/2259061770 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9458003e60 con 0x7f946806c5a0 2024-09-13T18:52:40.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 msgr2=0x7f9448068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f94680ccae0 tx=0x7f9454009240 comp rx=0 tx=0).stop 2024-09-13T18:52:40.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946806c5a0 msgr2=0x7f946814c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946806c5a0 0x7f946814c520 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f945800c4b0 tx=0x7f945800c7c0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 shutdown_connections 2024-09-13T18:52:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946815aa90 0x7f946814d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680cf830 0x7f94681434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 --2- 172.21.15.81:0/2259061770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946806c5a0 0x7f946814c520 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.024+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 >> 172.21.15.81:0/2259061770 conn(0x7f9468071d20 msgr2=0x7f94680cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:40.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.028+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 shutdown_connections 2024-09-13T18:52:40.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.028+0000 7f9467200700 1 -- 172.21.15.81:0/2259061770 wait complete. 2024-09-13T18:52:40.042 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 11 and data pool 12 2024-09-13T18:52:40.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.212+0000 7f0dc5400700 1 Processor -- start 2024-09-13T18:52:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.212+0000 7f0dc5400700 1 -- start start 2024-09-13T18:52:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dc5400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0dc00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dc5400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00cd970 con 0x7f0dc00d10f0 2024-09-13T18:52:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dc5400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc015e450 con 0x7f0dc00b2c50 2024-09-13T18:52:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dc5400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00d0050 con 0x7f0dc015e070 2024-09-13T18:52:40.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbf400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0dc00d10f0 0x7f0dc00b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41916/0 (socket says 172.21.15.81:41916) 2024-09-13T18:52:40.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbf400700 1 -- 172.21.15.81:0/1489936794 learned_addr learned my addr 172.21.15.81:0/1489936794 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:40.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0dc00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806265432 0 0) 0x7f0dac001110 con 0x7f0dc00d10f0 2024-09-13T18:52:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da40035d0 con 0x7f0dc00d10f0 2024-09-13T18:52:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029833658 0 0) 0x7f0dc015e450 con 0x7f0dc00b2c50 2024-09-13T18:52:40.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dac001110 con 0x7f0dc00b2c50 2024-09-13T18:52:40.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3245764852 0 0) 0x7f0da40035d0 con 0x7f0dc00d10f0 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 msgr2=0x7f0dc00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0dc00cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 >> v1:172.21.15.178:6789/0 conn(0x7f0dc00b2c50 legacy=0x7f0dc00b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00d0330 con 0x7f0dc00d10f0 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f0dac001800 con 0x7f0dc00d10f0 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0dc00cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 >> v1:172.21.15.81:6789/0 conn(0x7f0dc00d10f0 legacy=0x7f0dc00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.216+0000 7f0dbea00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0da4003c50 0x7f0da4004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0da4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4004db0 0x7f0da4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00d0050 con 0x7f0da4004db0 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da400bae0 con 0x7f0da4003c50 2024-09-13T18:52:40.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da400bca0 con 0x7f0dc015e070 2024-09-13T18:52:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc4a00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4004db0 0x7f0da4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0da4003c50 0x7f0da4004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbf400700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0da4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 -- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 msgr2=0x7f0da4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dc015e070 0x7f0da4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 -- 172.21.15.81:0/1489936794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4004db0 msgr2=0x7f0da4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4004db0 0x7f0da4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 -- 172.21.15.81:0/1489936794 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db00094b0 con 0x7f0da4003c50 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc4a00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da4004db0 0x7f0da4005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0da4003c50 0x7f0da4004050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009d40 tx=0x7f0da40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fd58acbb9c24e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0009e90 con 0x7f0da4003c50 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db000e9a0 con 0x7f0da4003c50 2024-09-13T18:52:40.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dbea00700 1 -- 172.21.15.81:0/1489936794 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db000ed10 con 0x7f0da4003c50 2024-09-13T18:52:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc5400700 1 -- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0da4003c50 msgr2=0x7f0da4004050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1489936794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0da4003c50 0x7f0da4004050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009d40 tx=0x7f0da40058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc4a00700 1 -- 172.21.15.81:0/1489936794 reap_dead start 2024-09-13T18:52:40.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc5400700 1 -- 172.21.15.81:0/1489936794 shutdown_connections 2024-09-13T18:52:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc5400700 1 -- 172.21.15.81:0/1489936794 >> 172.21.15.81:0/1489936794 conn(0x7f0dc0071f00 msgr2=0x7f0dc00722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc5400700 1 -- 172.21.15.81:0/1489936794 shutdown_connections 2024-09-13T18:52:40.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.220+0000 7f0dc5400700 1 -- 172.21.15.81:0/1489936794 wait complete. 2024-09-13T18:52:40.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 Processor -- start 2024-09-13T18:52:40.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 -- start start 2024-09-13T18:52:40.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0da4003c50 0x7f0dc00c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 0x7f0dc015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dc00a8e80 0x7f0dc00a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00a9840 con 0x7f0dc01f0c00 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc01f13e0 con 0x7f0dc00a8e80 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc5400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc01f16c0 con 0x7f0da4003c50 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dbf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 0x7f0dc015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dbf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 0x7f0dc015b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59942/0 (socket says 172.21.15.81:59942) 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dbf400700 1 -- 172.21.15.81:0/1604112132 learned_addr learned my addr 172.21.15.81:0/1604112132 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dc4a00700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dc00a8e80 0x7f0dc00a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0da4003c50 0x7f0dc00c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dbf400700 1 -- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0da4003c50 msgr2=0x7f0dc00c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.224+0000 7f0dbf400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0da4003c50 0x7f0dc00c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dbf400700 1 -- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dc00a8e80 msgr2=0x7f0dc00a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dbf400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dc00a8e80 0x7f0dc00a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dbf400700 1 -- 172.21.15.81:0/1604112132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc01f19a0 con 0x7f0dc01f0c00 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dbf400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 0x7f0dc015b180 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0072f0 tx=0x7f0dac007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac007840 con 0x7f0dc01f0c00 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00f8d0 con 0x7f0dc01f0c00 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac001c80 con 0x7f0dc01f0c00 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc01f1c80 con 0x7f0dc01f0c00 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc01eddc0 con 0x7f0dc01f0c00 2024-09-13T18:52:40.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.228+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc01f21a0 con 0x7f0dc01f0c00 2024-09-13T18:52:40.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.232+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0dac00fc60 con 0x7f0dc01f0c00 2024-09-13T18:52:40.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.232+0000 7f0db7e00700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0da0066760 0x7f0da0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.232+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0dac084210 con 0x7f0dc01f0c00 2024-09-13T18:52:40.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.232+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0da0066760 0x7f0da0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.232+0000 7f0dbfe00700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0da0066760 0x7f0da0068c20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0db00090b0 tx=0x7f0db0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:40.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.240+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0dc01f21a0 con 0x7f0dc01f0c00 2024-09-13T18:52:40.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.428+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dc00cd970 con 0x7f0dc01f0c00 2024-09-13T18:52:40.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.432+0000 7f0db7e00700 1 -- 172.21.15.81:0/1604112132 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f0dc00cd970 con 0x7f0dc01f0c00 2024-09-13T18:52:40.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:40.439 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:39.989452+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0da0066760 msgr2=0x7f0da0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0da0066760 0x7f0da0068c20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0db00090b0 tx=0x7f0db0008030 comp rx=0 tx=0).stop 2024-09-13T18:52:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 msgr2=0x7f0dc015b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 0x7f0dc015b180 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0072f0 tx=0x7f0dac007600 comp rx=0 tx=0).stop 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 shutdown_connections 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0da0066760 0x7f0da0068c20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dc00a8e80 0x7f0dc00a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dc01f0c00 0x7f0dc015b180 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 --2- 172.21.15.81:0/1604112132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0da4003c50 0x7f0dc00c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 >> 172.21.15.81:0/1604112132 conn(0x7f0dc0071f00 msgr2=0x7f0dc00c8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 shutdown_connections 2024-09-13T18:52:40.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.436+0000 7f0dc5400700 1 -- 172.21.15.81:0/1604112132 wait complete. 2024-09-13T18:52:40.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:40.481 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:52:40.472+0000 7ff670e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:52:40.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.632+0000 7f0270a00700 1 Processor -- start 2024-09-13T18:52:40.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.632+0000 7f0270a00700 1 -- start start 2024-09-13T18:52:40.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0270a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0270a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f026c0cfcf0 0x7f026c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0270a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c0b4d10 con 0x7f026c0cc650 2024-09-13T18:52:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0270a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c144aa0 con 0x7f026c0cfcf0 2024-09-13T18:52:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0270a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0b4100 con 0x7f026c1446c0 2024-09-13T18:52:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f026a800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f026c0cc650 0x7f026c0d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41926/0 (socket says 172.21.15.81:41926) 2024-09-13T18:52:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f026a800700 1 -- 172.21.15.81:0/3476794967 learned_addr learned my addr 172.21.15.81:0/3476794967 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269e00700 1 --2- 172.21.15.81:0/3476794967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269400700 1 --2- 172.21.15.81:0/3476794967 >> v2:172.21.15.178:3300/0 conn(0x7f026c0cfcf0 0x7f026c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269e00700 1 -- 172.21.15.81:0/3476794967 >> v2:172.21.15.178:3300/0 conn(0x7f026c0cfcf0 msgr2=0x7f026c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269e00700 1 --2- 172.21.15.81:0/3476794967 >> v2:172.21.15.178:3300/0 conn(0x7f026c0cfcf0 0x7f026c0cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269e00700 1 -- 172.21.15.81:0/3476794967 >> v1:172.21.15.81:6789/0 conn(0x7f026c0cc650 legacy=0x7f026c0d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269e00700 1 -- 172.21.15.81:0/3476794967 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c0b43e0 con 0x7f026c1446c0 2024-09-13T18:52:40.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0268a00700 1 -- 172.21.15.81:0/3476794967 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988896564 0 0) 0x7f026c0b4d10 con 0x7f026c0cc650 2024-09-13T18:52:40.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0269e00700 1 --2- 172.21.15.81:0/3476794967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c0b3a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f025c009850 tx=0x7f025c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14c6c87e3a0f0708 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0268a00700 1 -- 172.21.15.81:0/3476794967 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c011830 con 0x7f026c1446c0 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0268a00700 1 -- 172.21.15.81:0/3476794967 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c011990 con 0x7f026c1446c0 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.636+0000 7f0268a00700 1 -- 172.21.15.81:0/3476794967 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c011d40 con 0x7f026c1446c0 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 -- 172.21.15.81:0/3476794967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 msgr2=0x7f026c0b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 --2- 172.21.15.81:0/3476794967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c0b3a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f025c009850 tx=0x7f025c009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 -- 172.21.15.81:0/3476794967 shutdown_connections 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 --2- 172.21.15.81:0/3476794967 >> v2:172.21.15.178:3300/0 conn(0x7f026c0cfcf0 0x7f026c0cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 --2- 172.21.15.81:0/3476794967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c0b3a70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 -- 172.21.15.81:0/3476794967 >> 172.21.15.81:0/3476794967 conn(0x7f026c0726d0 msgr2=0x7f026c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 -- 172.21.15.81:0/3476794967 shutdown_connections 2024-09-13T18:52:40.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 -- 172.21.15.81:0/3476794967 wait complete. 2024-09-13T18:52:40.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 Processor -- start 2024-09-13T18:52:40.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.640+0000 7f0270a00700 1 -- start start 2024-09-13T18:52:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 0x7f026c15de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f026c0cfcf0 0x7f026c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c142730 con 0x7f026c0cc650 2024-09-13T18:52:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c1429d0 con 0x7f026c0cfcf0 2024-09-13T18:52:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c142cb0 con 0x7f026c1446c0 2024-09-13T18:52:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 0x7f026c15de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 0x7f026c15de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59944/0 (socket says 172.21.15.81:59944) 2024-09-13T18:52:40.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 -- 172.21.15.81:0/2346873757 learned_addr learned my addr 172.21.15.81:0/2346873757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269400700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f026c0cfcf0 0x7f026c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f026a800700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 -- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 msgr2=0x7f026c141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 -- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f026c0cfcf0 msgr2=0x7f026c159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f026c0cfcf0 0x7f026c159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 -- 172.21.15.81:0/2346873757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0094b0 con 0x7f026c0cc650 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0269e00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 0x7f026c15de30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f025c014040 tx=0x7f025c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c019a00 con 0x7f026c0cc650 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c01e070 con 0x7f026c0cc650 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c019da0 con 0x7f026c0cc650 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c142f90 con 0x7f026c0cc650 2024-09-13T18:52:40.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.644+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c1404e0 con 0x7f026c0cc650 2024-09-13T18:52:40.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.648+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c1431b0 con 0x7f026c0cc650 2024-09-13T18:52:40.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.648+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f025c02d450 con 0x7f026c0cc650 2024-09-13T18:52:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.648+0000 7f0262000700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f024c066730 0x7f024c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.648+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f025c085340 con 0x7f026c0cc650 2024-09-13T18:52:40.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.648+0000 7f0269400700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f024c066730 0x7f024c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:40.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.652+0000 7f0269400700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f024c066730 0x7f024c068bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f026c15d570 tx=0x7f0258009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:40.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.656+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f025c0524d0 con 0x7f026c0cc650 2024-09-13T18:52:40.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.844+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f026c0cc110 con 0x7f026c0cc650 2024-09-13T18:52:40.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.848+0000 7f0262000700 1 -- 172.21.15.81:0/2346873757 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16790 (secure 0 0 0) 0x7f025c055af0 con 0x7f026c0cc650 2024-09-13T18:52:40.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:40.857 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:39.989452+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f024c066730 msgr2=0x7f024c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f024c066730 0x7f024c068bf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f026c15d570 tx=0x7f0258009240 comp rx=0 tx=0).stop 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 msgr2=0x7f026c15de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 0x7f026c15de30 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f025c014040 tx=0x7f025c004770 comp rx=0 tx=0).stop 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 shutdown_connections 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f024c066730 0x7f024c068bf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f026c1446c0 0x7f026c141a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f026c0cfcf0 0x7f026c159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 --2- 172.21.15.81:0/2346873757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f026c0cc650 0x7f026c15de30 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:40.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 >> 172.21.15.81:0/2346873757 conn(0x7f026c0726d0 msgr2=0x7f026c06f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:40.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 shutdown_connections 2024-09-13T18:52:40.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:40.852+0000 7f0270a00700 1 -- 172.21.15.81:0/2346873757 wait complete. 2024-09-13T18:52:40.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:52:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.100+0000 7f21cdc00700 1 Processor -- start 2024-09-13T18:52:41.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.100+0000 7f21cdc00700 1 -- start start 2024-09-13T18:52:41.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21cdc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21c80b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21cdc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c80ceb90 con 0x7f21c80cf360 2024-09-13T18:52:41.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21cdc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c8066eb0 con 0x7f21c815abc0 2024-09-13T18:52:41.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21cdc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c806b940 con 0x7f21c815a7e0 2024-09-13T18:52:41.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21cd200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f21c80cf360 0x7f21c80667a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41930/0 (socket says 172.21.15.81:41930) 2024-09-13T18:52:41.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21cd200700 1 -- 172.21.15.81:0/3537361253 learned_addr learned my addr 172.21.15.81:0/3537361253 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:41.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c7e00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21c80b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413782241 0 0) 0x7f21c80ceb90 con 0x7f21c80cf360 2024-09-13T18:52:41.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ac0035d0 con 0x7f21c80cf360 2024-09-13T18:52:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298826128 0 0) 0x7f21ac0035d0 con 0x7f21c80cf360 2024-09-13T18:52:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 msgr2=0x7f21c80b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21c80b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 >> v1:172.21.15.178:6789/0 conn(0x7f21c815abc0 legacy=0x7f21c8066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c815e6b0 con 0x7f21c80cf360 2024-09-13T18:52:41.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f21c00019f0 con 0x7f21c80cf360 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c7e00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21c80b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 >> v1:172.21.15.81:6789/0 conn(0x7f21c80cf360 legacy=0x7f21c80667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac003a50 0x7f21ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21ac004870 0x7f21ac004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21ac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c806b940 con 0x7f21ac004870 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac005550 con 0x7f21ac003a50 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.104+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac005710 con 0x7f21c815a7e0 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21ac004870 0x7f21ac004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cd200700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21ac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7e00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac003a50 0x7f21ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 -- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 msgr2=0x7f21ac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c815a7e0 0x7f21ac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 -- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac003a50 msgr2=0x7f21ac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac003a50 0x7f21ac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 -- 172.21.15.81:0/3537361253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0035d0 con 0x7f21ac004870 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c7400700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21ac004870 0x7f21ac004cf0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f21c815afe0 tx=0x7f21ac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0340e96f28fecd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40052d0 con 0x7f21ac004870 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b4005430 con 0x7f21ac004870 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21c6a00700 1 -- 172.21.15.81:0/3537361253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40055a0 con 0x7f21ac004870 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cdc00700 1 -- 172.21.15.81:0/3537361253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21ac004870 msgr2=0x7f21ac004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:41.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cdc00700 1 --2- 172.21.15.81:0/3537361253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21ac004870 0x7f21ac004cf0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f21c815afe0 tx=0x7f21ac0058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cd200700 1 -- 172.21.15.81:0/3537361253 reap_dead start 2024-09-13T18:52:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cdc00700 1 -- 172.21.15.81:0/3537361253 shutdown_connections 2024-09-13T18:52:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cdc00700 1 -- 172.21.15.81:0/3537361253 >> 172.21.15.81:0/3537361253 conn(0x7f21c806cb90 msgr2=0x7f21c806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cdc00700 1 -- 172.21.15.81:0/3537361253 shutdown_connections 2024-09-13T18:52:41.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.108+0000 7f21cdc00700 1 -- 172.21.15.81:0/3537361253 wait complete. 2024-09-13T18:52:41.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 Processor -- start 2024-09-13T18:52:41.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 -- start start 2024-09-13T18:52:41.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac004870 0x7f21c81f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8140d20 0x7f21c81f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 0x7f21c80b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81f6360 con 0x7f21c81f5eb0 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c815c100 con 0x7f21ac004870 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cdc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80b46b0 con 0x7f21c8140d20 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cd200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 0x7f21c80b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cd200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 0x7f21c80b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59958/0 (socket says 172.21.15.81:59958) 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21cd200700 1 -- 172.21.15.81:0/2136409871 learned_addr learned my addr 172.21.15.81:0/2136409871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21c7e00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac004870 0x7f21c81f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.112+0000 7f21c7400700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8140d20 0x7f21c81f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cd200700 1 -- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8140d20 msgr2=0x7f21c81f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cd200700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8140d20 0x7f21c81f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cd200700 1 -- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac004870 msgr2=0x7f21c81f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cd200700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac004870 0x7f21c81f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cd200700 1 -- 172.21.15.81:0/2136409871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c815c3a0 con 0x7f21c81f5eb0 2024-09-13T18:52:41.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cd200700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 0x7f21c80b3940 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f21c0001330 tx=0x7f21c0005c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00086b0 con 0x7f21c81f5eb0 2024-09-13T18:52:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c0008850 con 0x7f21c81f5eb0 2024-09-13T18:52:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c00143f0 con 0x7f21c81f5eb0 2024-09-13T18:52:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c815c680 con 0x7f21c81f5eb0 2024-09-13T18:52:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c80b3e80 con 0x7f21c81f5eb0 2024-09-13T18:52:41.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.116+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c80cc280 con 0x7f21c81f5eb0 2024-09-13T18:52:41.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.120+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21c0014550 con 0x7f21c81f5eb0 2024-09-13T18:52:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.120+0000 7f21bfe00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f21a8066730 0x7f21a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.120+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f21c0084800 con 0x7f21c81f5eb0 2024-09-13T18:52:41.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.120+0000 7f21c7e00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f21a8066730 0x7f21a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:41.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.120+0000 7f21c7e00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f21a8066730 0x7f21a8068bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f21c815dec0 tx=0x7f21b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.128+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21c0051990 con 0x7f21c81f5eb0 2024-09-13T18:52:41.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:41.344+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f21c8156240 con 0x7f21c81f5eb0 2024-09-13T18:52:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.008+0000 7f21bfe00700 1 -- 172.21.15.81:0/2136409871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f21c0054fb0 con 0x7f21c81f5eb0 2024-09-13T18:52:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f21a8066730 msgr2=0x7f21a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f21a8066730 0x7f21a8068bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f21c815dec0 tx=0x7f21b8008040 comp rx=0 tx=0).stop 2024-09-13T18:52:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 msgr2=0x7f21c80b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 0x7f21c80b3940 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f21c0001330 tx=0x7f21c0005c60 comp rx=0 tx=0).stop 2024-09-13T18:52:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 shutdown_connections 2024-09-13T18:52:42.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f21a8066730 0x7f21a8068bf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21c81f5eb0 0x7f21c80b3940 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c8140d20 0x7f21c81f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 --2- 172.21.15.81:0/2136409871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21ac004870 0x7f21c81f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 >> 172.21.15.81:0/2136409871 conn(0x7f21c806cb90 msgr2=0x7f21c80af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 shutdown_connections 2024-09-13T18:52:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.012+0000 7f21cdc00700 1 -- 172.21.15.81:0/2136409871 wait complete. 2024-09-13T18:52:42.042 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:52:42.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:52:42.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.216+0000 7fe863e00700 1 Processor -- start 2024-09-13T18:52:42.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.216+0000 7fe863e00700 1 -- start start 2024-09-13T18:52:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8641611b0 0x7fe8640ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8640ca080 0x7fe8640c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe864164b90 con 0x7fe86406db00 2024-09-13T18:52:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe864164e70 con 0x7fe8641611b0 2024-09-13T18:52:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe864165150 con 0x7fe8640ca080 2024-09-13T18:52:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8641611b0 0x7fe8640ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe86406db00 0x7fe86406a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41934/0 (socket says 172.21.15.81:41934) 2024-09-13T18:52:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe863400700 1 -- 172.21.15.81:0/4286168382 learned_addr learned my addr 172.21.15.81:0/4286168382 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862000700 1 --2- 172.21.15.81:0/4286168382 >> v2:172.21.15.178:3300/0 conn(0x7fe8640ca080 0x7fe8640c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862a00700 1 -- 172.21.15.81:0/4286168382 >> v2:172.21.15.178:3300/0 conn(0x7fe8640ca080 msgr2=0x7fe8640c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862a00700 1 --2- 172.21.15.81:0/4286168382 >> v2:172.21.15.178:3300/0 conn(0x7fe8640ca080 0x7fe8640c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862a00700 1 -- 172.21.15.81:0/4286168382 >> v1:172.21.15.81:6789/0 conn(0x7fe86406db00 legacy=0x7fe86406a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862a00700 1 -- 172.21.15.81:0/4286168382 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe864165430 con 0x7fe8641611b0 2024-09-13T18:52:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe861600700 1 -- 172.21.15.81:0/4286168382 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589767124 0 0) 0x7fe864164b90 con 0x7fe86406db00 2024-09-13T18:52:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.220+0000 7fe862a00700 1 --2- 172.21.15.81:0/4286168382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8641611b0 0x7fe8640ccb80 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe864070290 tx=0x7fe854009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bd52a29e045aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe861600700 1 -- 172.21.15.81:0/4286168382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011830 con 0x7fe8641611b0 2024-09-13T18:52:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe861600700 1 -- 172.21.15.81:0/4286168382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854011990 con 0x7fe8641611b0 2024-09-13T18:52:42.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe861600700 1 -- 172.21.15.81:0/4286168382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011d20 con 0x7fe8641611b0 2024-09-13T18:52:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 -- 172.21.15.81:0/4286168382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8641611b0 msgr2=0x7fe8640ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:42.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 --2- 172.21.15.81:0/4286168382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8641611b0 0x7fe8640ccb80 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fe864070290 tx=0x7fe854009b30 comp rx=0 tx=0).stop 2024-09-13T18:52:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 -- 172.21.15.81:0/4286168382 shutdown_connections 2024-09-13T18:52:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 --2- 172.21.15.81:0/4286168382 >> v2:172.21.15.178:3300/0 conn(0x7fe8640ca080 0x7fe8640c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 --2- 172.21.15.81:0/4286168382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8641611b0 0x7fe8640ccb80 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 -- 172.21.15.81:0/4286168382 >> 172.21.15.81:0/4286168382 conn(0x7fe8640cefb0 msgr2=0x7fe8640cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 -- 172.21.15.81:0/4286168382 shutdown_connections 2024-09-13T18:52:42.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.224+0000 7fe863e00700 1 -- 172.21.15.81:0/4286168382 wait complete. 2024-09-13T18:52:42.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 Processor -- start 2024-09-13T18:52:42.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 -- start start 2024-09-13T18:52:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 0x7fe8640c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8640ca080 0x7fe8640b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8641611b0 0x7fe8640cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640b3f40 con 0x7fe86406db00 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640c5760 con 0x7fe8641611b0 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe863e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640b4180 con 0x7fe8640ca080 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 0x7fe8640c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 0x7fe8640c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59968/0 (socket says 172.21.15.81:59968) 2024-09-13T18:52:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 -- 172.21.15.81:0/2664711470 learned_addr learned my addr 172.21.15.81:0/2664711470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 -- 172.21.15.81:0/2664711470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8640ca080 msgr2=0x7fe8640b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8640ca080 0x7fe8640b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 -- 172.21.15.81:0/2664711470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8641611b0 msgr2=0x7fe8640cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8641611b0 0x7fe8640cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 -- 172.21.15.81:0/2664711470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540094b0 con 0x7fe86406db00 2024-09-13T18:52:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe862a00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 0x7fe8640c5090 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe854014040 tx=0x7fe854004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.228+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540038c0 con 0x7fe86406db00 2024-09-13T18:52:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.232+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85401e070 con 0x7fe86406db00 2024-09-13T18:52:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.232+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854003c80 con 0x7fe86406db00 2024-09-13T18:52:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.232+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8640b4460 con 0x7fe86406db00 2024-09-13T18:52:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.232+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe864159970 con 0x7fe86406db00 2024-09-13T18:52:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.232+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8640ccb80 con 0x7fe86406db00 2024-09-13T18:52:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.232+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe85402d450 con 0x7fe86406db00 2024-09-13T18:52:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.236+0000 7fe85b400700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe844066760 0x7fe844068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.236+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe854085100 con 0x7fe86406db00 2024-09-13T18:52:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.236+0000 7fe862000700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe844066760 0x7fe844068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.236+0000 7fe862000700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe844066760 0x7fe844068c20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe850006b40 tx=0x7fe850006ad0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.240+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8540523c0 con 0x7fe86406db00 2024-09-13T18:52:42.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:42.452+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe8640c58a0 con 0x7fe86406db00 2024-09-13T18:52:43.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.012+0000 7fe85b400700 1 -- 172.21.15.81:0/2664711470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe8640c58a0 con 0x7fe86406db00 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe844066760 msgr2=0x7fe844068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe844066760 0x7fe844068c20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe850006b40 tx=0x7fe850006ad0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 msgr2=0x7fe8640c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 0x7fe8640c5090 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fe854014040 tx=0x7fe854004770 comp rx=0 tx=0).stop 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 shutdown_connections 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe844066760 0x7fe844068c20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8641611b0 0x7fe8640cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8640ca080 0x7fe8640b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 --2- 172.21.15.81:0/2664711470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe86406db00 0x7fe8640c5090 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 >> 172.21.15.81:0/2664711470 conn(0x7fe8640cefb0 msgr2=0x7fe864070350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:43.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 shutdown_connections 2024-09-13T18:52:43.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.016+0000 7fe863e00700 1 -- 172.21.15.81:0/2664711470 wait complete. 2024-09-13T18:52:43.049 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:52:43.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.220+0000 7f2f0b200700 1 Processor -- start 2024-09-13T18:52:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.220+0000 7f2f0b200700 1 -- start start 2024-09-13T18:52:43.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f0b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f0c15e070 0x7f2f0c0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f0b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f0c0d10f0 0x7f2f0c0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f0b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0cd970 con 0x7f2f0c0d1540 2024-09-13T18:52:43.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f0b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c15e450 con 0x7f2f0c15e070 2024-09-13T18:52:43.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f0b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0d0050 con 0x7f2f0c0d10f0 2024-09-13T18:52:43.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f0c15e070 0x7f2f0c0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f0c15e070 0x7f2f0c0cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59974/0 (socket says 172.21.15.81:59974) 2024-09-13T18:52:43.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 -- 172.21.15.81:0/1991952532 learned_addr learned my addr 172.21.15.81:0/1991952532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:43.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09400700 1 --2- 172.21.15.81:0/1991952532 >> v2:172.21.15.178:3300/0 conn(0x7f2f0c0d10f0 0x7f2f0c0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 -- 172.21.15.81:0/1991952532 >> v2:172.21.15.178:3300/0 conn(0x7f2f0c0d10f0 msgr2=0x7f2f0c0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:43.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 --2- 172.21.15.81:0/1991952532 >> v2:172.21.15.178:3300/0 conn(0x7f2f0c0d10f0 0x7f2f0c0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 -- 172.21.15.81:0/1991952532 >> v1:172.21.15.81:6789/0 conn(0x7f2f0c0d1540 legacy=0x7f2f0c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 -- 172.21.15.81:0/1991952532 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0d0330 con 0x7f2f0c15e070 2024-09-13T18:52:43.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f09e00700 1 --2- 172.21.15.81:0/1991952532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c0cd430 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0ce350 tx=0x7f2efc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808c3de46c37df4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:43.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f08a00700 1 -- 172.21.15.81:0/1991952532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00b8a0 con 0x7f2f0c15e070 2024-09-13T18:52:43.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f08a00700 1 -- 172.21.15.81:0/1991952532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00ba00 con 0x7f2f0c15e070 2024-09-13T18:52:43.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.224+0000 7f2f08a00700 1 -- 172.21.15.81:0/1991952532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00bd90 con 0x7f2f0c15e070 2024-09-13T18:52:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 -- 172.21.15.81:0/1991952532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 msgr2=0x7f2f0c0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 --2- 172.21.15.81:0/1991952532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c0cd430 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0ce350 tx=0x7f2efc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 -- 172.21.15.81:0/1991952532 shutdown_connections 2024-09-13T18:52:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 --2- 172.21.15.81:0/1991952532 >> v2:172.21.15.178:3300/0 conn(0x7f2f0c0d10f0 0x7f2f0c0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 --2- 172.21.15.81:0/1991952532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c0cd430 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 -- 172.21.15.81:0/1991952532 >> 172.21.15.81:0/1991952532 conn(0x7f2f0c071f00 msgr2=0x7f2f0c0722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 -- 172.21.15.81:0/1991952532 shutdown_connections 2024-09-13T18:52:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 -- 172.21.15.81:0/1991952532 wait complete. 2024-09-13T18:52:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.228+0000 7f2f0b200700 1 Processor -- start 2024-09-13T18:52:43.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 -- start start 2024-09-13T18:52:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0d10f0 0x7f2f0c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c0d1540 0x7f2f0c0b5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1f5870 con 0x7f2f0c15e070 2024-09-13T18:52:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b53b0 con 0x7f2f0c0d1540 2024-09-13T18:52:43.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0af940 con 0x7f2f0c0d10f0 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59980/0 (socket says 172.21.15.81:59980) 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 -- 172.21.15.81:0/966013264 learned_addr learned my addr 172.21.15.81:0/966013264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f09e00700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0d10f0 0x7f2f0c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f09400700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c0d1540 0x7f2f0c0b5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 -- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0d10f0 msgr2=0x7f2f0c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0d10f0 0x7f2f0c0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 -- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c0d1540 msgr2=0x7f2f0c0b5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c0d1540 0x7f2f0c0b5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 -- 172.21.15.81:0/966013264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009570 con 0x7f2f0c15e070 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f09400700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c0d1540 0x7f2f0c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f0a800700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c159170 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400cb50 tx=0x7f2f0400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.232+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04003c20 con 0x7f2f0c15e070 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.236+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f04003d80 con 0x7f2f0c15e070 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.236+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400ab70 con 0x7f2f0c15e070 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.236+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c159c70 con 0x7f2f0c15e070 2024-09-13T18:52:43.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.236+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c0b5650 con 0x7f2f0c15e070 2024-09-13T18:52:43.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.236+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0b5870 con 0x7f2f0c15e070 2024-09-13T18:52:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.236+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f0400acd0 con 0x7f2f0c15e070 2024-09-13T18:52:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.240+0000 7f2f02000700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2eec066730 0x7f2eec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.240+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f040840e0 con 0x7f2f0c15e070 2024-09-13T18:52:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.240+0000 7f2f09e00700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2eec066730 0x7f2eec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.240+0000 7f2f09e00700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2eec066730 0x7f2eec068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2efc000c00 tx=0x7f2efc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.244+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f040513a0 con 0x7f2f0c15e070 2024-09-13T18:52:43.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:43.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:52:43.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.464+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f0c0cd970 con 0x7f2f0c15e070 2024-09-13T18:52:43.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.464+0000 7f2f02000700 1 -- 172.21.15.81:0/966013264 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f2f0c0cd970 con 0x7f2f0c15e070 2024-09-13T18:52:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:43.474 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6479,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7467,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:52:43.007633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:52:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2eec066730 msgr2=0x7f2eec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2eec066730 0x7f2eec068bf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2efc000c00 tx=0x7f2efc008030 comp rx=0 tx=0).stop 2024-09-13T18:52:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 msgr2=0x7f2f0c159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c159170 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400cb50 tx=0x7f2f0400cf10 comp rx=0 tx=0).stop 2024-09-13T18:52:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 shutdown_connections 2024-09-13T18:52:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2eec066730 0x7f2eec068bf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f0c15e070 0x7f2f0c159170 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c0d1540 0x7f2f0c0b5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 --2- 172.21.15.81:0/966013264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0d10f0 0x7f2f0c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 >> 172.21.15.81:0/966013264 conn(0x7f2f0c071f00 msgr2=0x7f2f0c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 shutdown_connections 2024-09-13T18:52:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.468+0000 7f2f0b200700 1 -- 172.21.15.81:0/966013264 wait complete. 2024-09-13T18:52:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 70 2024-09-13T18:52:43.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:52:43.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.660+0000 7fb63e800700 1 Processor -- start 2024-09-13T18:52:43.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.660+0000 7fb63e800700 1 -- start start 2024-09-13T18:52:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815d310 0x7fb6380b3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb63815e9f0 0x7fb63815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63e800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63815e560 con 0x7fb63806aaa0 2024-09-13T18:52:43.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63e800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380b3ec0 con 0x7fb63815e9f0 2024-09-13T18:52:43.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380adf90 con 0x7fb63815d310 2024-09-13T18:52:43.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb63815e9f0 0x7fb63815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb63815e9f0 0x7fb63815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59984/0 (socket says 172.21.15.81:59984) 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 -- 172.21.15.81:0/3680590537 learned_addr learned my addr 172.21.15.81:0/3680590537 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63ca00700 1 --2- 172.21.15.81:0/3680590537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815d310 0x7fb6380b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 -- 172.21.15.81:0/3680590537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815d310 msgr2=0x7fb6380b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 --2- 172.21.15.81:0/3680590537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815d310 0x7fb6380b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 -- 172.21.15.81:0/3680590537 >> v1:172.21.15.178:6789/0 conn(0x7fb63806aaa0 legacy=0x7fb63806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 -- 172.21.15.81:0/3680590537 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63815d920 con 0x7fb63815e9f0 2024-09-13T18:52:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb63de00700 1 --2- 172.21.15.81:0/3680590537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63815e9f0 0x7fb63815eea0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fb630009e50 tx=0x7fb63000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cac099d52a7c5af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb637e00700 1 -- 172.21.15.81:0/3680590537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000e070 con 0x7fb63815e9f0 2024-09-13T18:52:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb637e00700 1 -- 172.21.15.81:0/3680590537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000b910 con 0x7fb63815e9f0 2024-09-13T18:52:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.664+0000 7fb637e00700 1 -- 172.21.15.81:0/3680590537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000bcc0 con 0x7fb63815e9f0 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- 172.21.15.81:0/3680590537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63815e9f0 msgr2=0x7fb63815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 --2- 172.21.15.81:0/3680590537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63815e9f0 0x7fb63815eea0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fb630009e50 tx=0x7fb63000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- 172.21.15.81:0/3680590537 shutdown_connections 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 --2- 172.21.15.81:0/3680590537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63815e9f0 0x7fb63815eea0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 --2- 172.21.15.81:0/3680590537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815d310 0x7fb6380b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- 172.21.15.81:0/3680590537 >> 172.21.15.81:0/3680590537 conn(0x7fb6380b0c40 msgr2=0x7fb63806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- 172.21.15.81:0/3680590537 shutdown_connections 2024-09-13T18:52:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- 172.21.15.81:0/3680590537 wait complete. 2024-09-13T18:52:43.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 Processor -- start 2024-09-13T18:52:43.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- start start 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 0x7fb638138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63815d310 0x7fb63813e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815e9f0 0x7fb63813b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6381438a0 con 0x7fb63806aaa0 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63813e8f0 con 0x7fb63815d310 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb638143b60 con 0x7fb63815e9f0 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 0x7fb638138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 0x7fb638138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59994/0 (socket says 172.21.15.81:59994) 2024-09-13T18:52:43.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.668+0000 7fb63d400700 1 -- 172.21.15.81:0/2194346343 learned_addr learned my addr 172.21.15.81:0/2194346343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:43.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63de00700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815e9f0 0x7fb63813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63ca00700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63815d310 0x7fb63813e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63d400700 1 -- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815e9f0 msgr2=0x7fb63813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63d400700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815e9f0 0x7fb63813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63d400700 1 -- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63815d310 msgr2=0x7fb63813e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63d400700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63815d310 0x7fb63813e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63d400700 1 -- 172.21.15.81:0/2194346343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009b30 con 0x7fb63806aaa0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63d400700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 0x7fb638138fd0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c500 tx=0x7fb62c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0052d0 con 0x7fb63806aaa0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62c005430 con 0x7fb63806aaa0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb638143e40 con 0x7fb63806aaa0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62c0055a0 con 0x7fb63806aaa0 2024-09-13T18:52:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63813e5e0 con 0x7fb63806aaa0 2024-09-13T18:52:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.672+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb638144300 con 0x7fb63806aaa0 2024-09-13T18:52:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.676+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb62c0038e0 con 0x7fb63806aaa0 2024-09-13T18:52:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.676+0000 7fb635600700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb618066730 0x7fb618068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.676+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb62c083670 con 0x7fb63806aaa0 2024-09-13T18:52:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.676+0000 7fb63ca00700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb618066730 0x7fb618068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.676+0000 7fb63ca00700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb618066730 0x7fb618068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb6381f5de0 tx=0x7fb624008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:43.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.684+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb62c050930 con 0x7fb63806aaa0 2024-09-13T18:52:43.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.876+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6380b3980 con 0x7fb63806aaa0 2024-09-13T18:52:43.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.876+0000 7fb635600700 1 -- 172.21.15.81:0/2194346343 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16777 (secure 0 0 0) 0x7fb62c053f50 con 0x7fb63806aaa0 2024-09-13T18:52:43.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:43.886 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:40.994239+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:52:43.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb618066730 msgr2=0x7fb618068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb618066730 0x7fb618068bf0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb6381f5de0 tx=0x7fb624008040 comp rx=0 tx=0).stop 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 msgr2=0x7fb638138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 0x7fb638138fd0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fb62c00c500 tx=0x7fb62c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 shutdown_connections 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb618066730 0x7fb618068bf0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63815e9f0 0x7fb63813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63815d310 0x7fb63813e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 --2- 172.21.15.81:0/2194346343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63806aaa0 0x7fb638138fd0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 >> 172.21.15.81:0/2194346343 conn(0x7fb6380b0c40 msgr2=0x7fb63815af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 shutdown_connections 2024-09-13T18:52:43.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:43.880+0000 7fb63e800700 1 -- 172.21.15.81:0/2194346343 wait complete. 2024-09-13T18:52:43.912 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:52:43.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:52:44.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.072+0000 7fe77b200700 1 Processor -- start 2024-09-13T18:52:44.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77b200700 1 -- start start 2024-09-13T18:52:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe77c0aedd0 0x7fe77c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe77c15ba90 0x7fe77c066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c070d80 con 0x7fe77c0665d0 2024-09-13T18:52:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c066a60 con 0x7fe77c15ba90 2024-09-13T18:52:44.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c0cf550 con 0x7fe77c0aedd0 2024-09-13T18:52:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe771400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe77c15ba90 0x7fe77c066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77a800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe77c0665d0 0x7fe77c15e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41958/0 (socket says 172.21.15.81:41958) 2024-09-13T18:52:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe77a800700 1 -- 172.21.15.81:0/1659585285 learned_addr learned my addr 172.21.15.81:0/1659585285 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:44.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.076+0000 7fe779e00700 1 --2- 172.21.15.81:0/1659585285 >> v2:172.21.15.178:3300/0 conn(0x7fe77c0aedd0 0x7fe77c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe771400700 1 -- 172.21.15.81:0/1659585285 >> v2:172.21.15.178:3300/0 conn(0x7fe77c0aedd0 msgr2=0x7fe77c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:44.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe771400700 1 --2- 172.21.15.81:0/1659585285 >> v2:172.21.15.178:3300/0 conn(0x7fe77c0aedd0 0x7fe77c0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe771400700 1 -- 172.21.15.81:0/1659585285 >> v1:172.21.15.81:6789/0 conn(0x7fe77c0665d0 legacy=0x7fe77c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe771400700 1 -- 172.21.15.81:0/1659585285 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c070fd0 con 0x7fe77c15ba90 2024-09-13T18:52:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe771400700 1 --2- 172.21.15.81:0/1659585285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c066090 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0af690 tx=0x7fe76400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b4b5fa9f5d1802 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe779400700 1 -- 172.21.15.81:0/1659585285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400e070 con 0x7fe77c15ba90 2024-09-13T18:52:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe779400700 1 -- 172.21.15.81:0/1659585285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76400bb20 con 0x7fe77c15ba90 2024-09-13T18:52:44.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe779400700 1 -- 172.21.15.81:0/1659585285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764012430 con 0x7fe77c15ba90 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 -- 172.21.15.81:0/1659585285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 msgr2=0x7fe77c066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 --2- 172.21.15.81:0/1659585285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c066090 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0af690 tx=0x7fe76400b330 comp rx=0 tx=0).stop 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 -- 172.21.15.81:0/1659585285 shutdown_connections 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 --2- 172.21.15.81:0/1659585285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c066090 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 --2- 172.21.15.81:0/1659585285 >> v2:172.21.15.178:3300/0 conn(0x7fe77c0aedd0 0x7fe77c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 -- 172.21.15.81:0/1659585285 >> 172.21.15.81:0/1659585285 conn(0x7fe77c06ca10 msgr2=0x7fe77c06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 -- 172.21.15.81:0/1659585285 shutdown_connections 2024-09-13T18:52:44.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.080+0000 7fe77b200700 1 -- 172.21.15.81:0/1659585285 wait complete. 2024-09-13T18:52:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 Processor -- start 2024-09-13T18:52:44.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 -- start start 2024-09-13T18:52:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c0665d0 0x7fe77c1f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c0aedd0 0x7fe77c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c1f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1526c0 con 0x7fe77c15ba90 2024-09-13T18:52:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c1492e0 con 0x7fe77c0665d0 2024-09-13T18:52:44.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c15c050 con 0x7fe77c0aedd0 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c1f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c1f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60012/0 (socket says 172.21.15.81:60012) 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 -- 172.21.15.81:0/3276557294 learned_addr learned my addr 172.21.15.81:0/3276557294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe771400700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c0aedd0 0x7fe77c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe779e00700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c0665d0 0x7fe77c1f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 -- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c0aedd0 msgr2=0x7fe77c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c0aedd0 0x7fe77c148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 -- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c0665d0 msgr2=0x7fe77c1f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c0665d0 0x7fe77c1f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 -- 172.21.15.81:0/3276557294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764009a70 con 0x7fe77c15ba90 2024-09-13T18:52:44.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe771400700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c0aedd0 0x7fe77c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe779e00700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c0665d0 0x7fe77c1f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.084+0000 7fe77a800700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c1f59d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fe77400c4d0 tx=0x7fe77400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774005d90 con 0x7fe77c15ba90 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7740070d0 con 0x7fe77c15ba90 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c152ae0 con 0x7fe77c15ba90 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774007440 con 0x7fe77c15ba90 2024-09-13T18:52:44.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c15c310 con 0x7fe77c15ba90 2024-09-13T18:52:44.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c152800 con 0x7fe77c15ba90 2024-09-13T18:52:44.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.088+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7740075a0 con 0x7fe77c15ba90 2024-09-13T18:52:44.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.091+0000 7fe772a00700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe758066730 0x7fe758068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.091+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe774083660 con 0x7fe77c15ba90 2024-09-13T18:52:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.091+0000 7fe779e00700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe758066730 0x7fe758068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.091+0000 7fe779e00700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe758066730 0x7fe758068bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009c40 tx=0x7fe76c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:44.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.099+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe77c152800 con 0x7fe77c15ba90 2024-09-13T18:52:44.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.279+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe77c15bed0 con 0x7fe758066730 2024-09-13T18:52:44.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.299+0000 7fe772a00700 1 -- 172.21.15.81:0/3276557294 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271908 (secure 0 0 0) 0x7fe76c004030 con 0x7fe758066730 2024-09-13T18:52:44.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe758066730 msgr2=0x7fe758068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe758066730 0x7fe758068bf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009c40 tx=0x7fe76c008040 comp rx=0 tx=0).stop 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 msgr2=0x7fe77c1f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c1f59d0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fe77400c4d0 tx=0x7fe77400c890 comp rx=0 tx=0).stop 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 shutdown_connections 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe758066730 0x7fe758068bf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c15ba90 0x7fe77c1f59d0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c0aedd0 0x7fe77c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 --2- 172.21.15.81:0/3276557294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c0665d0 0x7fe77c1f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 >> 172.21.15.81:0/3276557294 conn(0x7fe77c06ca10 msgr2=0x7fe77c0b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 shutdown_connections 2024-09-13T18:52:44.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.307+0000 7fe77b200700 1 -- 172.21.15.81:0/3276557294 wait complete. 2024-09-13T18:52:44.319 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:52:44.338 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-13T18:52:43.080407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":253364,"kb_used_data":8508,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754721356,"statfs":{"total":773094113280,"available":772834668544,"internally_reserved":0,"allocated":8712192,"data_stored":4598845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.579154"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-13T18:52:35.031642+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:52:35.031642+0000","last_peered":"2024-09-13T18:52:35.031642+0000","last_clean":"2024-09-13T18:52:35.031642+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:52:35.031642+0000","last_undegraded":"2024-09-13T18:52:35.031642+0000","last_fullsized":"2024-09-13T18:52:35.031642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":1018330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.76300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.498,"5min":1.72,"15min":1.72},"last":1.331},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0780000000000001,"15min":1.1259999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.409,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.524}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3520000000000001,"5min":1.619,"15min":1.619},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1499999999999999,"15min":1.216},"min":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4379999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2769999999999999,"15min":1.337},"min":{"1min":0.873,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6499999999999999,"5min":1.885,"15min":1.885},"last":1.121},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.94499999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4650000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.387}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4810000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3440000000000001,"15min":1.4319999999999999},"min":{"1min":1.0109999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.629,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.669}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1060000000000001,"15min":1.1140000000000001},"min":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.462,"5min":1.552,"15min":1.552},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.21,"15min":1.1859999999999999},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.46,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2509999999999999,"15min":1.3169999999999999},"min":{"1min":0.72999999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.579,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.224},"min":{"1min":0.88400000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.504}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.401},"min":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.625,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.385,"15min":1.417},"min":{"1min":1.036,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5860000000000001,"5min":1.845,"15min":1.845},"last":1.6279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32024,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":929792,"data_stored":422375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.139},"min":{"1min":0.79600000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5049999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1639999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2789999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.68700000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5589999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.385,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.2330000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.246,"15min":1.4239999999999999},"min":{"1min":0.77600000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.194},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.274,"15min":1.47},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5900000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3340000000000001,"15min":1.496},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5629999999999999,"5min":4.883,"15min":4.883},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3340000000000001,"15min":1.5129999999999999},"min":{"1min":1,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.591,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.099}]},{"osd":4,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2030000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5129999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.371},{"interface":"front","average":{"1min":1.165,"5min":1.2609999999999999,"15min":1.331},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6240000000000001,"5min":2.077,"15min":2.077},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3160000000000001,"15min":1.4099999999999999},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.5469999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.333},{"interface":"front","average":{"1min":1.325,"5min":1.4219999999999999,"15min":1.478},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.657,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.385,"15min":1.4590000000000001},"min":{"1min":0.876,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.4079999999999999,"15min":1.5209999999999999},"min":{"1min":1.0740000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5309999999999999,"5min":2.367,"15min":2.367},"last":1.631}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32040,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.135,"15min":1.159},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4450000000000001,"5min":2.278,"15min":2.278},"last":1.3580000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.91500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5649999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.532}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.212,"15min":1.2809999999999999},"min":{"1min":0.76300000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3999999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.173,"15min":1.252},"min":{"1min":0.81699999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4159999999999999,"5min":2.157,"15min":2.157},"last":1.484}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.284,"15min":1.369},"min":{"1min":0.85699999999999998,"5min":0.749,"15min":0.749},"max":{"1min":1.6160000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.4319999999999999},"min":{"1min":0.94199999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.569,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.042}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1319999999999999,"15min":1.21},"min":{"1min":0.74399999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.478,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2350000000000001,"15min":1.2749999999999999},"min":{"1min":0.872,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.613,"5min":1.974,"15min":1.974},"last":1.119}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2569999999999999,"15min":1.2989999999999999},"min":{"1min":0.98099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.494,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.27,"15min":1.3440000000000001},"min":{"1min":0.871,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.601,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.577}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.391,"15min":1.429},"min":{"1min":1.1879999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6120000000000001,"5min":2.169,"15min":2.169},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4350000000000001,"15min":1.5109999999999999},"min":{"1min":1.1990000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.659,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.641}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32040,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.109,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.502,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.1399999999999999},"min":{"1min":0.84199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":0.88600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6739999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5740000000000001,"5min":2.423,"15min":2.423},"last":1.373}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.99,"15min":1.99},"last":1.625},{"interface":"front","average":{"1min":1.302,"5min":1.329,"15min":1.381},"min":{"1min":0.99099999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6519999999999999,"5min":2.335,"15min":2.335},"last":1.7370000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.22,"15min":1.3049999999999999},"min":{"1min":0.78400000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.573,"5min":2.621,"15min":2.621},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.206,"15min":1.264},"min":{"1min":0.89400000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3779999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.2450000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1919999999999999,"15min":1.2969999999999999},"min":{"1min":0.80200000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":2.274,"15min":2.274},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2529999999999999,"15min":1.3140000000000001},"min":{"1min":0.91500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.831,"5min":2.266,"15min":2.266},"last":1.593}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.3480000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5449999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.498},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.458},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.6830000000000001,"5min":2.5,"15min":2.5},"last":1.1259999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3859999999999999,"15min":1.458},"min":{"1min":1.0029999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7969999999999999,"5min":2.395,"15min":2.395},"last":1.756},{"interface":"front","average":{"1min":1.369,"5min":1.375,"15min":1.4610000000000001},"min":{"1min":0.84199999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.655,"5min":2.415,"15min":2.415},"last":1.706}]}]},{"osd":3,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32040,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2969999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85799999999999998,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2889999999999999,"5min":1.444,"15min":1.444},"last":1.0509999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.72299999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.012},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98899999999999999,"15min":1.101},"min":{"1min":0.61299999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.63700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.145,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4430000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.196}]},{"osd":4,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.1950000000000001,"15min":1.2430000000000001},"min":{"1min":1.0369999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5329999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.234},"min":{"1min":0.89300000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.484,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.554}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2490000000000001,"15min":1.3149999999999999},"min":{"1min":0.998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5760000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3080000000000001,"15min":1.3740000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9870000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.286}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.351,"15min":1.427},"min":{"1min":1.1559999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9239999999999999,"5min":2.714,"15min":2.714},"last":1.367},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":0.94599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.72,"5min":2.52,"15min":2.52},"last":1.343}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.363,"15min":1.5089999999999999},"min":{"1min":0.96699999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6719999999999999,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.52},{"interface":"front","average":{"1min":1.349,"5min":1.335,"15min":1.431},"min":{"1min":1.097,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6339999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.4770000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.97699999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.242,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.874,"15min":1.0429999999999999},"min":{"1min":0.59799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.90800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.92600000000000005,"15min":1.127},"min":{"1min":0.65900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.7350000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.052},{"interface":"front","average":{"1min":1.085,"5min":1.125,"15min":1.23},"min":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.268,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.762}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.3160000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7749999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4730000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3300000000000001,"15min":1.6399999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.421,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3049999999999999,"15min":1.4490000000000001},"min":{"1min":0.95299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.569,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.383}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.353,"15min":1.508},"min":{"1min":0.99099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5469999999999999,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.306,"15min":1.482},"min":{"1min":0.89500000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5109999999999999,"5min":4.335,"15min":4.335},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3480000000000001,"15min":1.5349999999999999},"min":{"1min":1.04,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5980000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3899999999999999,"15min":1.744},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3999999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.272}]},{"osd":7,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.399,"15min":1.5589999999999999},"min":{"1min":1.069,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.4690000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.9399999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.429,"15min":1.6140000000000001},"min":{"1min":1.145,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.677}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32048,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81100000000000005,"15min":0.88300000000000001},"min":{"1min":0.58799999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88100000000000001,"15min":1.048},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66300000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5649999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.997,"15min":1.069},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3069999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1699999999999999,"15min":1.3149999999999999},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.363,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.411},"min":{"1min":0.71199999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4419999999999999,"5min":10.368,"15min":10.368},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2889999999999999,"15min":1.381},"min":{"1min":1.0429999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.609,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2789999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4690000000000001,"5min":2.911,"15min":2.911},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3560000000000001,"15min":1.7250000000000001},"min":{"1min":0.98399999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.494,"5min":10.214,"15min":10.214},"last":1.532},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.353,"15min":1.48},"min":{"1min":1.0860000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.651,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2430000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3640000000000001,"15min":1.5740000000000001},"min":{"1min":1.054,"5min":0.874,"15min":0.874},"max":{"1min":1.4790000000000001,"5min":6.032,"15min":6.032},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4159999999999999,"15min":1.772},"min":{"1min":1.0580000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6100000000000001,"5min":10.112,"15min":10.112},"last":1.4730000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4790000000000001,"15min":1.833},"min":{"1min":1.111,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5169999999999999,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.4199999999999999,"15min":1.5680000000000001},"min":{"1min":1.1519999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.552,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.353}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":1018330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.99099999999999999},"min":{"1min":0.52700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1339999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.879,"15min":1.002},"min":{"1min":0.625,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3740000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.163}]},{"osd":2,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":1.143},"min":{"1min":0.69399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.262,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.626},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.036,"15min":1.2110000000000001},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.056,"15min":1.194},"min":{"1min":0.52100000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3959999999999999,"5min":4.093,"15min":4.093},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.145,"5min":1.216,"15min":1.417},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.117}]},{"osd":4,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2729999999999999,"15min":1.444},"min":{"1min":0.82999999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.5049999999999999,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3069999999999999,"15min":1.456},"min":{"1min":0.94899999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.458,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3839999999999999,"15min":1.6120000000000001},"min":{"1min":0.92400000000000004,"5min":0.753,"15min":0.753},"max":{"1min":1.4950000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.288},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3400000000000001,"15min":1.54},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.044}]},{"osd":6,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.349,"15min":1.55},"min":{"1min":1.1100000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.528,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.423,"15min":1.6950000000000001},"min":{"1min":1.056,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.577,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.226}]},{"osd":7,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.409,"15min":1.595},"min":{"1min":0.99199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.756,"5min":3.056,"15min":3.056},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.387,"15min":1.617},"min":{"1min":1.095,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.546,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:52:44.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:52:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 Processor -- start 2024-09-13T18:52:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 -- start start 2024-09-13T18:52:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc1610b0 0x7ff1dc0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff1dc06aaa0 0x7ff1dc06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1dc0b3560 con 0x7ff1dc0b2670 2024-09-13T18:52:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1dc070b30 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e2800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc06b420 con 0x7ff1dc1610b0 2024-09-13T18:52:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e1e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff1dc0b2670 0x7ff1dc0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41974/0 (socket says 172.21.15.81:41974) 2024-09-13T18:52:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e1e00700 1 -- 172.21.15.81:0/144235923 learned_addr learned my addr 172.21.15.81:0/144235923 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e0a00700 1 --2- 172.21.15.81:0/144235923 >> v2:172.21.15.81:3300/0 conn(0x7ff1dc06aaa0 0x7ff1dc06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.571+0000 7ff1e1400700 1 --2- 172.21.15.81:0/144235923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc1610b0 0x7ff1dc0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e0a00700 1 -- 172.21.15.81:0/144235923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc1610b0 msgr2=0x7ff1dc0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e0a00700 1 --2- 172.21.15.81:0/144235923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc1610b0 0x7ff1dc0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e0a00700 1 -- 172.21.15.81:0/144235923 >> v1:172.21.15.81:6789/0 conn(0x7ff1dc0b2670 legacy=0x7ff1dc0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e0a00700 1 -- 172.21.15.81:0/144235923 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc0b3280 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1dbe00700 1 -- 172.21.15.81:0/144235923 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315223841 0 0) 0x7ff1dc0b3560 con 0x7ff1dc0b2670 2024-09-13T18:52:44.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e0a00700 1 --2- 172.21.15.81:0/144235923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc06aee0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009850 tx=0x7ff1c8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4f66383c42d279 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1dbe00700 1 -- 172.21.15.81:0/144235923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8011830 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1dbe00700 1 -- 172.21.15.81:0/144235923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c8011990 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1dbe00700 1 -- 172.21.15.81:0/144235923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c8011d40 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 -- 172.21.15.81:0/144235923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 msgr2=0x7ff1dc06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 --2- 172.21.15.81:0/144235923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc06aee0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009850 tx=0x7ff1c8009b60 comp rx=0 tx=0).stop 2024-09-13T18:52:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 -- 172.21.15.81:0/144235923 shutdown_connections 2024-09-13T18:52:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 --2- 172.21.15.81:0/144235923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc06aee0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 --2- 172.21.15.81:0/144235923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc1610b0 0x7ff1dc0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 -- 172.21.15.81:0/144235923 >> 172.21.15.81:0/144235923 conn(0x7ff1dc0b0c40 msgr2=0x7ff1dc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:44.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 -- 172.21.15.81:0/144235923 shutdown_connections 2024-09-13T18:52:44.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.575+0000 7ff1e2800700 1 -- 172.21.15.81:0/144235923 wait complete. 2024-09-13T18:52:44.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.579+0000 7ff1e2800700 1 Processor -- start 2024-09-13T18:52:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.579+0000 7ff1e2800700 1 -- start start 2024-09-13T18:52:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc0b2670 0x7ff1dc1f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1dc1610b0 0x7ff1dc14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc153a10 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc1f6720 con 0x7ff1dc1610b0 2024-09-13T18:52:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1dc14dc20 con 0x7ff1dc0b2670 2024-09-13T18:52:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc14d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60022/0 (socket says 172.21.15.81:60022) 2024-09-13T18:52:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 -- 172.21.15.81:0/3252277617 learned_addr learned my addr 172.21.15.81:0/3252277617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e0a00700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc0b2670 0x7ff1dc1f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1e00700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1dc1610b0 0x7ff1dc14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 -- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc0b2670 msgr2=0x7ff1dc1f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc0b2670 0x7ff1dc1f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 -- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1dc1610b0 msgr2=0x7ff1dc14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1dc1610b0 0x7ff1dc14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 -- 172.21.15.81:0/3252277617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80094b0 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1e00700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1dc1610b0 0x7ff1dc14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e1400700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc14d640 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000e840 tx=0x7ff1d000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d00095a0 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d000c690 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1dc14df00 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000ca00 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.583+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1dc14e4c0 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.587+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1dc161490 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.587+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff1d000cb60 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.591+0000 7ff1d9600700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff1bc066730 0x7ff1bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.591+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff1d0084690 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.591+0000 7ff1e0a00700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff1bc066730 0x7ff1bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:44.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.591+0000 7ff1e0a00700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff1bc066730 0x7ff1bc068bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009850 tx=0x7ff1c8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.595+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1d0051830 con 0x7ff1dc06aaa0 2024-09-13T18:52:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.783+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1dc0714a0 con 0x7ff1bc066730 2024-09-13T18:52:44.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.795+0000 7ff1d9600700 1 -- 172.21.15.81:0/3252277617 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271908 (secure 0 0 0) 0x7ff1c8011b80 con 0x7ff1bc066730 2024-09-13T18:52:44.806 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.799+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff1bc066730 msgr2=0x7ff1bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff1bc066730 0x7ff1bc068bf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009850 tx=0x7ff1c8008030 comp rx=0 tx=0).stop 2024-09-13T18:52:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 msgr2=0x7ff1dc14d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:44.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc14d640 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000e840 tx=0x7ff1d000ec00 comp rx=0 tx=0).stop 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 shutdown_connections 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff1bc066730 0x7ff1bc068bf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1dc1610b0 0x7ff1dc14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1dc0b2670 0x7ff1dc1f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 --2- 172.21.15.81:0/3252277617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1dc06aaa0 0x7ff1dc14d640 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 >> 172.21.15.81:0/3252277617 conn(0x7ff1dc0b0c40 msgr2=0x7ff1dc0b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 shutdown_connections 2024-09-13T18:52:44.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:44.803+0000 7ff1e2800700 1 -- 172.21.15.81:0/3252277617 wait complete. 2024-09-13T18:52:44.812 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:52:44.831 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-13T18:52:43.080407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":253364,"kb_used_data":8508,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754721356,"statfs":{"total":773094113280,"available":772834668544,"internally_reserved":0,"allocated":8712192,"data_stored":4598845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.579154"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:39.498759+0000","last_change":"2024-09-13T18:52:39.498759+0000","last_active":"2024-09-13T18:52:39.498759+0000","last_peered":"2024-09-13T18:52:39.498759+0000","last_clean":"2024-09-13T18:52:39.498759+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:39.498759+0000","last_undegraded":"2024-09-13T18:52:39.498759+0000","last_fullsized":"2024-09-13T18:52:39.498759+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:52:38.478917+0000","last_change":"2024-09-13T18:52:38.478917+0000","last_active":"2024-09-13T18:52:38.478917+0000","last_peered":"2024-09-13T18:52:38.478917+0000","last_clean":"2024-09-13T18:52:38.478917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:52:38.478917+0000","last_undegraded":"2024-09-13T18:52:38.478917+0000","last_fullsized":"2024-09-13T18:52:38.478917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":210,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-13T18:52:35.031642+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:52:35.031642+0000","last_peered":"2024-09-13T18:52:35.031642+0000","last_clean":"2024-09-13T18:52:35.031642+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:52:35.031642+0000","last_undegraded":"2024-09-13T18:52:35.031642+0000","last_fullsized":"2024-09-13T18:52:35.031642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":1018330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.76300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.498,"5min":1.72,"15min":1.72},"last":1.331},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0780000000000001,"15min":1.1259999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.409,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.524}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3520000000000001,"5min":1.619,"15min":1.619},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1499999999999999,"15min":1.216},"min":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4379999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2769999999999999,"15min":1.337},"min":{"1min":0.873,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6499999999999999,"5min":1.885,"15min":1.885},"last":1.121},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.94499999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4650000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.387}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4810000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3440000000000001,"15min":1.4319999999999999},"min":{"1min":1.0109999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.629,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.669}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1060000000000001,"15min":1.1140000000000001},"min":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.462,"5min":1.552,"15min":1.552},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.21,"15min":1.1859999999999999},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.46,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.2529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2509999999999999,"15min":1.3169999999999999},"min":{"1min":0.72999999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.579,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.224},"min":{"1min":0.88400000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.504}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.401},"min":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.625,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.385,"15min":1.417},"min":{"1min":1.036,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5860000000000001,"5min":1.845,"15min":1.845},"last":1.6279999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32024,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":929792,"data_stored":422375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.139},"min":{"1min":0.79600000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5049999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.752},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1639999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2789999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.83199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.68700000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5589999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.385,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.2330000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.246,"15min":1.4239999999999999},"min":{"1min":0.77600000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.194},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.274,"15min":1.47},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5900000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3340000000000001,"15min":1.496},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5629999999999999,"5min":4.883,"15min":4.883},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3340000000000001,"15min":1.5129999999999999},"min":{"1min":1,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.591,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.099}]},{"osd":4,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2030000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5129999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.371},{"interface":"front","average":{"1min":1.165,"5min":1.2609999999999999,"15min":1.331},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6240000000000001,"5min":2.077,"15min":2.077},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3160000000000001,"15min":1.4099999999999999},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.5469999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.333},{"interface":"front","average":{"1min":1.325,"5min":1.4219999999999999,"15min":1.478},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.657,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.385,"15min":1.4590000000000001},"min":{"1min":0.876,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.4079999999999999,"15min":1.5209999999999999},"min":{"1min":1.0740000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5309999999999999,"5min":2.367,"15min":2.367},"last":1.631}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32040,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.085,"5min":1.135,"15min":1.159},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4450000000000001,"5min":2.278,"15min":2.278},"last":1.3580000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.91500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5649999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.532}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.212,"15min":1.2809999999999999},"min":{"1min":0.76300000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3999999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.173,"15min":1.252},"min":{"1min":0.81699999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4159999999999999,"5min":2.157,"15min":2.157},"last":1.484}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.284,"15min":1.369},"min":{"1min":0.85699999999999998,"5min":0.749,"15min":0.749},"max":{"1min":1.6160000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.4319999999999999},"min":{"1min":0.94199999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.569,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.042}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1319999999999999,"15min":1.21},"min":{"1min":0.74399999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.478,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2350000000000001,"15min":1.2749999999999999},"min":{"1min":0.872,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.613,"5min":1.974,"15min":1.974},"last":1.119}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2569999999999999,"15min":1.2989999999999999},"min":{"1min":0.98099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.494,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.27,"15min":1.3440000000000001},"min":{"1min":0.871,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.601,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.577}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.391,"15min":1.429},"min":{"1min":1.1879999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6120000000000001,"5min":2.169,"15min":2.169},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4350000000000001,"15min":1.5109999999999999},"min":{"1min":1.1990000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.659,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.641}]}]},{"osd":4,"up_from":13,"seq":55834574920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32040,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.109,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.502,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.1399999999999999},"min":{"1min":0.84199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":0.88600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6739999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5740000000000001,"5min":2.423,"15min":2.423},"last":1.373}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.99,"15min":1.99},"last":1.625},{"interface":"front","average":{"1min":1.302,"5min":1.329,"15min":1.381},"min":{"1min":0.99099999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6519999999999999,"5min":2.335,"15min":2.335},"last":1.7370000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.22,"15min":1.3049999999999999},"min":{"1min":0.78400000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.573,"5min":2.621,"15min":2.621},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.206,"15min":1.264},"min":{"1min":0.89400000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3779999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.2450000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1919999999999999,"15min":1.2969999999999999},"min":{"1min":0.80200000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":2.274,"15min":2.274},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2529999999999999,"15min":1.3140000000000001},"min":{"1min":0.91500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.831,"5min":2.266,"15min":2.266},"last":1.593}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.3480000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5449999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.498},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.458},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.6830000000000001,"5min":2.5,"15min":2.5},"last":1.1259999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3859999999999999,"15min":1.458},"min":{"1min":1.0029999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7969999999999999,"5min":2.395,"15min":2.395},"last":1.756},{"interface":"front","average":{"1min":1.369,"5min":1.375,"15min":1.4610000000000001},"min":{"1min":0.84199999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.655,"5min":2.415,"15min":2.415},"last":1.706}]}]},{"osd":3,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32040,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2969999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85799999999999998,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2889999999999999,"5min":1.444,"15min":1.444},"last":1.0509999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.72299999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.012},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98899999999999999,"15min":1.101},"min":{"1min":0.61299999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.97699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.63700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.145,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4430000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.196}]},{"osd":4,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.1950000000000001,"15min":1.2430000000000001},"min":{"1min":1.0369999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5329999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.234},"min":{"1min":0.89300000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.484,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.554}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2490000000000001,"15min":1.3149999999999999},"min":{"1min":0.998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5760000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3080000000000001,"15min":1.3740000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9870000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.286}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.351,"15min":1.427},"min":{"1min":1.1559999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9239999999999999,"5min":2.714,"15min":2.714},"last":1.367},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":0.94599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.72,"5min":2.52,"15min":2.52},"last":1.343}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.363,"15min":1.5089999999999999},"min":{"1min":0.96699999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6719999999999999,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.52},{"interface":"front","average":{"1min":1.349,"5min":1.335,"15min":1.431},"min":{"1min":1.097,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6339999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.4770000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.97699999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.242,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.874,"15min":1.0429999999999999},"min":{"1min":0.59799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.90800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.92600000000000005,"15min":1.127},"min":{"1min":0.65900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.7350000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.052},{"interface":"front","average":{"1min":1.085,"5min":1.125,"15min":1.23},"min":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.268,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.762}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.3160000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7749999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4730000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.71899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3300000000000001,"15min":1.6399999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.421,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3049999999999999,"15min":1.4490000000000001},"min":{"1min":0.95299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.569,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.383}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.353,"15min":1.508},"min":{"1min":0.99099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5469999999999999,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.306,"15min":1.482},"min":{"1min":0.89500000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5109999999999999,"5min":4.335,"15min":4.335},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3480000000000001,"15min":1.5349999999999999},"min":{"1min":1.04,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5980000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3899999999999999,"15min":1.744},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3999999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.272}]},{"osd":7,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.399,"15min":1.5589999999999999},"min":{"1min":1.069,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.4690000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.9399999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.429,"15min":1.6140000000000001},"min":{"1min":1.145,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.677}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32048,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":942080,"data_stored":427962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81100000000000005,"15min":0.88300000000000001},"min":{"1min":0.58799999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88100000000000001,"15min":1.048},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.89500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66300000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5649999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.997,"15min":1.069},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3069999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.623}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1699999999999999,"15min":1.3149999999999999},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.363,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.411},"min":{"1min":0.71199999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4419999999999999,"5min":10.368,"15min":10.368},"last":0.83099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2889999999999999,"15min":1.381},"min":{"1min":1.0429999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.609,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2789999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4690000000000001,"5min":2.911,"15min":2.911},"last":0.94099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3560000000000001,"15min":1.7250000000000001},"min":{"1min":0.98399999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.494,"5min":10.214,"15min":10.214},"last":1.532},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.353,"15min":1.48},"min":{"1min":1.0860000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.651,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.2430000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3640000000000001,"15min":1.5740000000000001},"min":{"1min":1.054,"5min":0.874,"15min":0.874},"max":{"1min":1.4790000000000001,"5min":6.032,"15min":6.032},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4159999999999999,"15min":1.772},"min":{"1min":1.0580000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6100000000000001,"5min":10.112,"15min":10.112},"last":1.4730000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4790000000000001,"15min":1.833},"min":{"1min":1.111,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5169999999999999,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.4199999999999999,"15min":1.5680000000000001},"min":{"1min":1.1519999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.552,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.353}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":1018330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.99099999999999999},"min":{"1min":0.52700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1339999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.879,"15min":1.002},"min":{"1min":0.625,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3740000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.163}]},{"osd":2,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":1.143},"min":{"1min":0.69399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.262,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.626},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.036,"15min":1.2110000000000001},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.056,"15min":1.194},"min":{"1min":0.52100000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3959999999999999,"5min":4.093,"15min":4.093},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.145,"5min":1.216,"15min":1.417},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.117}]},{"osd":4,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2729999999999999,"15min":1.444},"min":{"1min":0.82999999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.5049999999999999,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3069999999999999,"15min":1.456},"min":{"1min":0.94899999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.458,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3839999999999999,"15min":1.6120000000000001},"min":{"1min":0.92400000000000004,"5min":0.753,"15min":0.753},"max":{"1min":1.4950000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.288},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3400000000000001,"15min":1.54},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.044}]},{"osd":6,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.349,"15min":1.55},"min":{"1min":1.1100000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.528,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.423,"15min":1.6950000000000001},"min":{"1min":1.056,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.577,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.226}]},{"osd":7,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.409,"15min":1.595},"min":{"1min":0.99199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.756,"5min":3.056,"15min":3.056},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.387,"15min":1.617},"min":{"1min":1.095,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.546,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.0920000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:52:44.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:52:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.039+0000 7f99b1400700 1 Processor -- start 2024-09-13T18:52:45.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99b1400700 1 -- start start 2024-09-13T18:52:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99b1400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac15cfd0 0x7f99ac0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99b1400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99ac0d1b20 0x7f99ac0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99b1400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ac0b2e40 con 0x7f99ac0d0cc0 2024-09-13T18:52:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99b1400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ac0cee50 con 0x7f99ac0d1b20 2024-09-13T18:52:45.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99b1400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0ceb70 con 0x7f99ac15cfd0 2024-09-13T18:52:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99ab200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99ac0d1b20 0x7f99ac0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99ab200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99ac0d1b20 0x7f99ac0b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60038/0 (socket says 172.21.15.81:60038) 2024-09-13T18:52:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.043+0000 7f99ab200700 1 -- 172.21.15.81:0/1984643182 learned_addr learned my addr 172.21.15.81:0/1984643182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:45.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99aa800700 1 --2- 172.21.15.81:0/1984643182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac15cfd0 0x7f99ac0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99ab200700 1 -- 172.21.15.81:0/1984643182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac15cfd0 msgr2=0x7f99ac0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99ab200700 1 --2- 172.21.15.81:0/1984643182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac15cfd0 0x7f99ac0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99ab200700 1 -- 172.21.15.81:0/1984643182 >> v1:172.21.15.178:6789/0 conn(0x7f99ac0d0cc0 legacy=0x7f99ac0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99ab200700 1 -- 172.21.15.81:0/1984643182 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0b27f0 con 0x7f99ac0d1b20 2024-09-13T18:52:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99ab200700 1 --2- 172.21.15.81:0/1984643182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0b32d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009e50 tx=0x7f99a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f718b393112139f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99a9400700 1 -- 172.21.15.81:0/1984643182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400e070 con 0x7f99ac0d1b20 2024-09-13T18:52:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99a9400700 1 -- 172.21.15.81:0/1984643182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400b910 con 0x7f99ac0d1b20 2024-09-13T18:52:45.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99a9400700 1 -- 172.21.15.81:0/1984643182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400bcc0 con 0x7f99ac0d1b20 2024-09-13T18:52:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 -- 172.21.15.81:0/1984643182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac0d1b20 msgr2=0x7f99ac0b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 --2- 172.21.15.81:0/1984643182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0b32d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009e50 tx=0x7f99a400b330 comp rx=0 tx=0).stop 2024-09-13T18:52:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 -- 172.21.15.81:0/1984643182 shutdown_connections 2024-09-13T18:52:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 --2- 172.21.15.81:0/1984643182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0b32d0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 --2- 172.21.15.81:0/1984643182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac15cfd0 0x7f99ac0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 -- 172.21.15.81:0/1984643182 >> 172.21.15.81:0/1984643182 conn(0x7f99ac09c0e0 msgr2=0x7f99ac0d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 -- 172.21.15.81:0/1984643182 shutdown_connections 2024-09-13T18:52:45.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.047+0000 7f99b1400700 1 -- 172.21.15.81:0/1984643182 wait complete. 2024-09-13T18:52:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 Processor -- start 2024-09-13T18:52:45.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 -- start start 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac0d0cc0 0x7f99ac15bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 0x7f99ac0cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0ca070 con 0x7f99ac15cfd0 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0b6c20 con 0x7f99ac0d1b20 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.051+0000 7f99b1400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ac0b6f00 con 0x7f99ac0d0cc0 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 0x7f99ac0cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 0x7f99ac0cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60054/0 (socket says 172.21.15.81:60054) 2024-09-13T18:52:45.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 -- 172.21.15.81:0/1525722712 learned_addr learned my addr 172.21.15.81:0/1525722712 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99a9e00700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99aa800700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac0d0cc0 0x7f99ac15bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 -- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac0d0cc0 msgr2=0x7f99ac15bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac0d0cc0 0x7f99ac15bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 -- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99ac0d1b20 msgr2=0x7f99ac0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 -- 172.21.15.81:0/1525722712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4009b30 con 0x7f99ac15cfd0 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99ab200700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 0x7f99ac0cc640 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f99a4012000 tx=0x7f99a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4004960 con 0x7f99ac15cfd0 2024-09-13T18:52:45.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40099b0 con 0x7f99ac15cfd0 2024-09-13T18:52:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac0d1260 con 0x7f99ac15cfd0 2024-09-13T18:52:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a401b670 con 0x7f99ac15cfd0 2024-09-13T18:52:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ac0b74c0 con 0x7f99ac15cfd0 2024-09-13T18:52:45.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.055+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ac0ca270 con 0x7f99ac15cfd0 2024-09-13T18:52:45.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.059+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99a401b7d0 con 0x7f99ac15cfd0 2024-09-13T18:52:45.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.059+0000 7f99a2a00700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.059+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99a40858b0 con 0x7f99ac15cfd0 2024-09-13T18:52:45.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.059+0000 7f99aa800700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.059+0000 7f99aa800700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f998c066730 0x7f998c068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f999c009b80 tx=0x7f999c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.063+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99a4052b70 con 0x7f99ac15cfd0 2024-09-13T18:52:45.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.259+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99ac0d10e0 con 0x7f998c066730 2024-09-13T18:52:45.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.275+0000 7f99a2a00700 1 -- 172.21.15.81:0/1525722712 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286831 (secure 0 0 0) 0x7f999c0117b0 con 0x7f998c066730 2024-09-13T18:52:45.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:45.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f998c066730 msgr2=0x7f998c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f998c066730 0x7f998c068bf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f999c009b80 tx=0x7f999c008040 comp rx=0 tx=0).stop 2024-09-13T18:52:45.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 msgr2=0x7f99ac0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 0x7f99ac0cc640 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f99a4012000 tx=0x7f99a4004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 shutdown_connections 2024-09-13T18:52:45.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f998c066730 0x7f998c068bf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99ac15cfd0 0x7f99ac0cc640 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99ac0d1b20 0x7f99ac0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 --2- 172.21.15.81:0/1525722712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99ac0d0cc0 0x7f99ac15bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.279+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 >> 172.21.15.81:0/1525722712 conn(0x7f99ac09c0e0 msgr2=0x7f99ac0d13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.283+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 shutdown_connections 2024-09-13T18:52:45.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.283+0000 7f99b1400700 1 -- 172.21.15.81:0/1525722712 wait complete. 2024-09-13T18:52:45.292 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:52:45.313 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-13T18:52:45.080929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253800,"kb_used_data":8920,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754720920,"statfs":{"total":773094113280,"available":772834222080,"internally_reserved":0,"allocated":9134080,"data_stored":4794252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001419"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.033709+0000","last_change":"2024-09-13T18:52:40.029730+0000","last_active":"2024-09-13T18:52:40.033709+0000","last_peered":"2024-09-13T18:52:40.033709+0000","last_clean":"2024-09-13T18:52:40.033709+0000","last_became_active":"2024-09-13T18:52:40.029484+0000","last_became_peered":"2024-09-13T18:52:40.029484+0000","last_unstale":"2024-09-13T18:52:40.033709+0000","last_undegraded":"2024-09-13T18:52:40.033709+0000","last_fullsized":"2024-09-13T18:52:40.033709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:05.838347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005020+0000","last_change":"2024-09-13T18:52:40.032994+0000","last_active":"2024-09-13T18:52:41.005020+0000","last_peered":"2024-09-13T18:52:41.005020+0000","last_clean":"2024-09-13T18:52:41.005020+0000","last_became_active":"2024-09-13T18:52:40.027610+0000","last_became_peered":"2024-09-13T18:52:40.027610+0000","last_unstale":"2024-09-13T18:52:41.005020+0000","last_undegraded":"2024-09-13T18:52:41.005020+0000","last_fullsized":"2024-09-13T18:52:41.005020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:28.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.031667+0000","last_change":"2024-09-13T18:52:40.018034+0000","last_active":"2024-09-13T18:52:40.031667+0000","last_peered":"2024-09-13T18:52:40.031667+0000","last_clean":"2024-09-13T18:52:40.031667+0000","last_became_active":"2024-09-13T18:52:40.017770+0000","last_became_peered":"2024-09-13T18:52:40.017770+0000","last_unstale":"2024-09-13T18:52:40.031667+0000","last_undegraded":"2024-09-13T18:52:40.031667+0000","last_fullsized":"2024-09-13T18:52:40.031667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037913+0000","last_change":"2024-09-13T18:52:40.022083+0000","last_active":"2024-09-13T18:52:41.037913+0000","last_peered":"2024-09-13T18:52:41.037913+0000","last_clean":"2024-09-13T18:52:41.037913+0000","last_became_active":"2024-09-13T18:52:40.021751+0000","last_became_peered":"2024-09-13T18:52:40.021751+0000","last_unstale":"2024-09-13T18:52:41.037913+0000","last_undegraded":"2024-09-13T18:52:41.037913+0000","last_fullsized":"2024-09-13T18:52:41.037913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.451244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003132+0000","last_change":"2024-09-13T18:52:40.021848+0000","last_active":"2024-09-13T18:52:41.003132+0000","last_peered":"2024-09-13T18:52:41.003132+0000","last_clean":"2024-09-13T18:52:41.003132+0000","last_became_active":"2024-09-13T18:52:40.021518+0000","last_became_peered":"2024-09-13T18:52:40.021518+0000","last_unstale":"2024-09-13T18:52:41.003132+0000","last_undegraded":"2024-09-13T18:52:41.003132+0000","last_fullsized":"2024-09-13T18:52:41.003132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:37.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004846+0000","last_change":"2024-09-13T18:52:40.022619+0000","last_active":"2024-09-13T18:52:41.004846+0000","last_peered":"2024-09-13T18:52:41.004846+0000","last_clean":"2024-09-13T18:52:41.004846+0000","last_became_active":"2024-09-13T18:52:40.021024+0000","last_became_peered":"2024-09-13T18:52:40.021024+0000","last_unstale":"2024-09-13T18:52:41.004846+0000","last_undegraded":"2024-09-13T18:52:41.004846+0000","last_fullsized":"2024-09-13T18:52:41.004846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:18.392542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030178+0000","last_change":"2024-09-13T18:52:40.021133+0000","last_active":"2024-09-13T18:52:40.030178+0000","last_peered":"2024-09-13T18:52:40.030178+0000","last_clean":"2024-09-13T18:52:40.030178+0000","last_became_active":"2024-09-13T18:52:40.020869+0000","last_became_peered":"2024-09-13T18:52:40.020869+0000","last_unstale":"2024-09-13T18:52:40.030178+0000","last_undegraded":"2024-09-13T18:52:40.030178+0000","last_fullsized":"2024-09-13T18:52:40.030178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:45.206606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.002976+0000","last_change":"2024-09-13T18:52:40.022054+0000","last_active":"2024-09-13T18:52:41.002976+0000","last_peered":"2024-09-13T18:52:41.002976+0000","last_clean":"2024-09-13T18:52:41.002976+0000","last_became_active":"2024-09-13T18:52:40.021712+0000","last_became_peered":"2024-09-13T18:52:40.021712+0000","last_unstale":"2024-09-13T18:52:41.002976+0000","last_undegraded":"2024-09-13T18:52:41.002976+0000","last_fullsized":"2024-09-13T18:52:41.002976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:56.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.033368+0000","last_change":"2024-09-13T18:52:40.029657+0000","last_active":"2024-09-13T18:52:40.033368+0000","last_peered":"2024-09-13T18:52:40.033368+0000","last_clean":"2024-09-13T18:52:40.033368+0000","last_became_active":"2024-09-13T18:52:40.029365+0000","last_became_peered":"2024-09-13T18:52:40.029365+0000","last_unstale":"2024-09-13T18:52:40.033368+0000","last_undegraded":"2024-09-13T18:52:40.033368+0000","last_fullsized":"2024-09-13T18:52:40.033368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:49.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038039+0000","last_change":"2024-09-13T18:52:40.022820+0000","last_active":"2024-09-13T18:52:41.038039+0000","last_peered":"2024-09-13T18:52:41.038039+0000","last_clean":"2024-09-13T18:52:41.038039+0000","last_became_active":"2024-09-13T18:52:40.022523+0000","last_became_peered":"2024-09-13T18:52:40.022523+0000","last_unstale":"2024-09-13T18:52:41.038039+0000","last_undegraded":"2024-09-13T18:52:41.038039+0000","last_fullsized":"2024-09-13T18:52:41.038039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:55.771407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004756+0000","last_change":"2024-09-13T18:52:40.027341+0000","last_active":"2024-09-13T18:52:41.004756+0000","last_peered":"2024-09-13T18:52:41.004756+0000","last_clean":"2024-09-13T18:52:41.004756+0000","last_became_active":"2024-09-13T18:52:40.027105+0000","last_became_peered":"2024-09-13T18:52:40.027105+0000","last_unstale":"2024-09-13T18:52:41.004756+0000","last_undegraded":"2024-09-13T18:52:41.004756+0000","last_fullsized":"2024-09-13T18:52:41.004756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:44.732130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037925+0000","last_change":"2024-09-13T18:52:40.021363+0000","last_active":"2024-09-13T18:52:41.037925+0000","last_peered":"2024-09-13T18:52:41.037925+0000","last_clean":"2024-09-13T18:52:41.037925+0000","last_became_active":"2024-09-13T18:52:40.019817+0000","last_became_peered":"2024-09-13T18:52:40.019817+0000","last_unstale":"2024-09-13T18:52:41.037925+0000","last_undegraded":"2024-09-13T18:52:41.037925+0000","last_fullsized":"2024-09-13T18:52:41.037925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003464+0000","last_change":"2024-09-13T18:52:40.026377+0000","last_active":"2024-09-13T18:52:41.003464+0000","last_peered":"2024-09-13T18:52:41.003464+0000","last_clean":"2024-09-13T18:52:41.003464+0000","last_became_active":"2024-09-13T18:52:40.026109+0000","last_became_peered":"2024-09-13T18:52:40.026109+0000","last_unstale":"2024-09-13T18:52:41.003464+0000","last_undegraded":"2024-09-13T18:52:41.003464+0000","last_fullsized":"2024-09-13T18:52:41.003464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.014272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004958+0000","last_change":"2024-09-13T18:52:40.019135+0000","last_active":"2024-09-13T18:52:41.004958+0000","last_peered":"2024-09-13T18:52:41.004958+0000","last_clean":"2024-09-13T18:52:41.004958+0000","last_became_active":"2024-09-13T18:52:40.018751+0000","last_became_peered":"2024-09-13T18:52:40.018751+0000","last_unstale":"2024-09-13T18:52:41.004958+0000","last_undegraded":"2024-09-13T18:52:41.004958+0000","last_fullsized":"2024-09-13T18:52:41.004958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:40.178964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004367+0000","last_change":"2024-09-13T18:52:40.017029+0000","last_active":"2024-09-13T18:52:41.004367+0000","last_peered":"2024-09-13T18:52:41.004367+0000","last_clean":"2024-09-13T18:52:41.004367+0000","last_became_active":"2024-09-13T18:52:40.016050+0000","last_became_peered":"2024-09-13T18:52:40.016050+0000","last_unstale":"2024-09-13T18:52:41.004367+0000","last_undegraded":"2024-09-13T18:52:41.004367+0000","last_fullsized":"2024-09-13T18:52:41.004367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:18.392542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.037267+0000","last_change":"2024-09-13T18:52:40.036388+0000","last_active":"2024-09-13T18:52:40.037267+0000","last_peered":"2024-09-13T18:52:40.037267+0000","last_clean":"2024-09-13T18:52:40.037267+0000","last_became_active":"2024-09-13T18:52:40.036023+0000","last_became_peered":"2024-09-13T18:52:40.036023+0000","last_unstale":"2024-09-13T18:52:40.037267+0000","last_undegraded":"2024-09-13T18:52:40.037267+0000","last_fullsized":"2024-09-13T18:52:40.037267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:00.157204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004116+0000","last_change":"2024-09-13T18:52:40.024542+0000","last_active":"2024-09-13T18:52:41.004116+0000","last_peered":"2024-09-13T18:52:41.004116+0000","last_clean":"2024-09-13T18:52:41.004116+0000","last_became_active":"2024-09-13T18:52:40.024304+0000","last_became_peered":"2024-09-13T18:52:40.024304+0000","last_unstale":"2024-09-13T18:52:41.004116+0000","last_undegraded":"2024-09-13T18:52:41.004116+0000","last_fullsized":"2024-09-13T18:52:41.004116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:56.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034810+0000","last_change":"2024-09-13T18:52:40.022797+0000","last_active":"2024-09-13T18:52:40.034810+0000","last_peered":"2024-09-13T18:52:40.034810+0000","last_clean":"2024-09-13T18:52:40.034810+0000","last_became_active":"2024-09-13T18:52:40.022578+0000","last_became_peered":"2024-09-13T18:52:40.022578+0000","last_unstale":"2024-09-13T18:52:40.034810+0000","last_undegraded":"2024-09-13T18:52:40.034810+0000","last_fullsized":"2024-09-13T18:52:40.034810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:55.771407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005380+0000","last_change":"2024-09-13T18:52:40.026751+0000","last_active":"2024-09-13T18:52:41.005380+0000","last_peered":"2024-09-13T18:52:41.005380+0000","last_clean":"2024-09-13T18:52:41.005380+0000","last_became_active":"2024-09-13T18:52:40.026525+0000","last_became_peered":"2024-09-13T18:52:40.026525+0000","last_unstale":"2024-09-13T18:52:41.005380+0000","last_undegraded":"2024-09-13T18:52:41.005380+0000","last_fullsized":"2024-09-13T18:52:41.005380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:12.433472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003444+0000","last_change":"2024-09-13T18:52:40.026350+0000","last_active":"2024-09-13T18:52:41.003444+0000","last_peered":"2024-09-13T18:52:41.003444+0000","last_clean":"2024-09-13T18:52:41.003444+0000","last_became_active":"2024-09-13T18:52:40.026061+0000","last_became_peered":"2024-09-13T18:52:40.026061+0000","last_unstale":"2024-09-13T18:52:41.003444+0000","last_undegraded":"2024-09-13T18:52:41.003444+0000","last_fullsized":"2024-09-13T18:52:41.003444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:37.233263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.032515+0000","last_change":"2024-09-13T18:52:40.027813+0000","last_active":"2024-09-13T18:52:40.032515+0000","last_peered":"2024-09-13T18:52:40.032515+0000","last_clean":"2024-09-13T18:52:40.032515+0000","last_became_active":"2024-09-13T18:52:40.027086+0000","last_became_peered":"2024-09-13T18:52:40.027086+0000","last_unstale":"2024-09-13T18:52:40.032515+0000","last_undegraded":"2024-09-13T18:52:40.032515+0000","last_fullsized":"2024-09-13T18:52:40.032515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:28.250958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005473+0000","last_change":"2024-09-13T18:52:40.025114+0000","last_active":"2024-09-13T18:52:41.005473+0000","last_peered":"2024-09-13T18:52:41.005473+0000","last_clean":"2024-09-13T18:52:41.005473+0000","last_became_active":"2024-09-13T18:52:40.024858+0000","last_became_peered":"2024-09-13T18:52:40.024858+0000","last_unstale":"2024-09-13T18:52:41.005473+0000","last_undegraded":"2024-09-13T18:52:41.005473+0000","last_fullsized":"2024-09-13T18:52:41.005473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:56.110356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034208+0000","last_change":"2024-09-13T18:52:40.031138+0000","last_active":"2024-09-13T18:52:40.034208+0000","last_peered":"2024-09-13T18:52:40.034208+0000","last_clean":"2024-09-13T18:52:40.034208+0000","last_became_active":"2024-09-13T18:52:40.030869+0000","last_became_peered":"2024-09-13T18:52:40.030869+0000","last_unstale":"2024-09-13T18:52:40.034208+0000","last_undegraded":"2024-09-13T18:52:40.034208+0000","last_fullsized":"2024-09-13T18:52:40.034208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:56.244802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003112+0000","last_change":"2024-09-13T18:52:40.015588+0000","last_active":"2024-09-13T18:52:41.003112+0000","last_peered":"2024-09-13T18:52:41.003112+0000","last_clean":"2024-09-13T18:52:41.003112+0000","last_became_active":"2024-09-13T18:52:40.015284+0000","last_became_peered":"2024-09-13T18:52:40.015284+0000","last_unstale":"2024-09-13T18:52:41.003112+0000","last_undegraded":"2024-09-13T18:52:41.003112+0000","last_fullsized":"2024-09-13T18:52:41.003112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:53.113817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004527+0000","last_change":"2024-09-13T18:52:40.021142+0000","last_active":"2024-09-13T18:52:41.004527+0000","last_peered":"2024-09-13T18:52:41.004527+0000","last_clean":"2024-09-13T18:52:41.004527+0000","last_became_active":"2024-09-13T18:52:40.020915+0000","last_became_peered":"2024-09-13T18:52:40.020915+0000","last_unstale":"2024-09-13T18:52:41.004527+0000","last_undegraded":"2024-09-13T18:52:41.004527+0000","last_fullsized":"2024-09-13T18:52:41.004527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:01.129486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038052+0000","last_change":"2024-09-13T18:52:40.030936+0000","last_active":"2024-09-13T18:52:41.038052+0000","last_peered":"2024-09-13T18:52:41.038052+0000","last_clean":"2024-09-13T18:52:41.038052+0000","last_became_active":"2024-09-13T18:52:40.030628+0000","last_became_peered":"2024-09-13T18:52:40.030628+0000","last_unstale":"2024-09-13T18:52:41.038052+0000","last_undegraded":"2024-09-13T18:52:41.038052+0000","last_fullsized":"2024-09-13T18:52:41.038052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.038006+0000","last_change":"2024-09-13T18:52:40.037356+0000","last_active":"2024-09-13T18:52:40.038006+0000","last_peered":"2024-09-13T18:52:40.038006+0000","last_clean":"2024-09-13T18:52:40.038006+0000","last_became_active":"2024-09-13T18:52:40.034877+0000","last_became_peered":"2024-09-13T18:52:40.034877+0000","last_unstale":"2024-09-13T18:52:40.038006+0000","last_undegraded":"2024-09-13T18:52:40.038006+0000","last_fullsized":"2024-09-13T18:52:40.038006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:02.070096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003558+0000","last_change":"2024-09-13T18:52:40.033899+0000","last_active":"2024-09-13T18:52:41.003558+0000","last_peered":"2024-09-13T18:52:41.003558+0000","last_clean":"2024-09-13T18:52:41.003558+0000","last_became_active":"2024-09-13T18:52:40.033659+0000","last_became_peered":"2024-09-13T18:52:40.033659+0000","last_unstale":"2024-09-13T18:52:41.003558+0000","last_undegraded":"2024-09-13T18:52:41.003558+0000","last_fullsized":"2024-09-13T18:52:41.003558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:31.358441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003640+0000","last_change":"2024-09-13T18:52:40.018681+0000","last_active":"2024-09-13T18:52:41.003640+0000","last_peered":"2024-09-13T18:52:41.003640+0000","last_clean":"2024-09-13T18:52:41.003640+0000","last_became_active":"2024-09-13T18:52:40.018435+0000","last_became_peered":"2024-09-13T18:52:40.018435+0000","last_unstale":"2024-09-13T18:52:41.003640+0000","last_undegraded":"2024-09-13T18:52:41.003640+0000","last_fullsized":"2024-09-13T18:52:41.003640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:48.487871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.020812+0000","last_change":"2024-09-13T18:52:40.020252+0000","last_active":"2024-09-13T18:52:40.020812+0000","last_peered":"2024-09-13T18:52:40.020812+0000","last_clean":"2024-09-13T18:52:40.020812+0000","last_became_active":"2024-09-13T18:52:40.018799+0000","last_became_peered":"2024-09-13T18:52:40.018799+0000","last_unstale":"2024-09-13T18:52:40.020812+0000","last_undegraded":"2024-09-13T18:52:40.020812+0000","last_fullsized":"2024-09-13T18:52:40.020812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:40.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.020982+0000","last_change":"2024-09-13T18:52:40.012698+0000","last_active":"2024-09-13T18:52:40.020982+0000","last_peered":"2024-09-13T18:52:40.020982+0000","last_clean":"2024-09-13T18:52:40.020982+0000","last_became_active":"2024-09-13T18:52:40.012408+0000","last_became_peered":"2024-09-13T18:52:40.012408+0000","last_unstale":"2024-09-13T18:52:40.020982+0000","last_undegraded":"2024-09-13T18:52:40.020982+0000","last_fullsized":"2024-09-13T18:52:40.020982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.035828+0000","last_change":"2024-09-13T18:52:40.032890+0000","last_active":"2024-09-13T18:52:40.035828+0000","last_peered":"2024-09-13T18:52:40.035828+0000","last_clean":"2024-09-13T18:52:40.035828+0000","last_became_active":"2024-09-13T18:52:40.029120+0000","last_became_peered":"2024-09-13T18:52:40.029120+0000","last_unstale":"2024-09-13T18:52:40.035828+0000","last_undegraded":"2024-09-13T18:52:40.035828+0000","last_fullsized":"2024-09-13T18:52:40.035828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.033291+0000","last_change":"2024-09-13T18:52:40.020591+0000","last_active":"2024-09-13T18:52:40.033291+0000","last_peered":"2024-09-13T18:52:40.033291+0000","last_clean":"2024-09-13T18:52:40.033291+0000","last_became_active":"2024-09-13T18:52:40.020197+0000","last_became_peered":"2024-09-13T18:52:40.020197+0000","last_unstale":"2024-09-13T18:52:40.033291+0000","last_undegraded":"2024-09-13T18:52:40.033291+0000","last_fullsized":"2024-09-13T18:52:40.033291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004223+0000","last_change":"2024-09-13T18:52:39.541307+0000","last_active":"2024-09-13T18:52:41.004223+0000","last_peered":"2024-09-13T18:52:41.004223+0000","last_clean":"2024-09-13T18:52:41.004223+0000","last_became_active":"2024-09-13T18:52:39.541022+0000","last_became_peered":"2024-09-13T18:52:39.541022+0000","last_unstale":"2024-09-13T18:52:41.004223+0000","last_undegraded":"2024-09-13T18:52:41.004223+0000","last_fullsized":"2024-09-13T18:52:41.004223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:33.093013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004587+0000","last_change":"2024-09-13T18:52:40.028565+0000","last_active":"2024-09-13T18:52:41.004587+0000","last_peered":"2024-09-13T18:52:41.004587+0000","last_clean":"2024-09-13T18:52:41.004587+0000","last_became_active":"2024-09-13T18:52:40.028201+0000","last_became_peered":"2024-09-13T18:52:40.028201+0000","last_unstale":"2024-09-13T18:52:41.004587+0000","last_undegraded":"2024-09-13T18:52:41.004587+0000","last_fullsized":"2024-09-13T18:52:41.004587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:11.059208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.032160+0000","last_change":"2024-09-13T18:52:39.546080+0000","last_active":"2024-09-13T18:52:40.032160+0000","last_peered":"2024-09-13T18:52:40.032160+0000","last_clean":"2024-09-13T18:52:40.032160+0000","last_became_active":"2024-09-13T18:52:39.545824+0000","last_became_peered":"2024-09-13T18:52:39.545824+0000","last_unstale":"2024-09-13T18:52:40.032160+0000","last_undegraded":"2024-09-13T18:52:40.032160+0000","last_fullsized":"2024-09-13T18:52:40.032160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:13.249946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034179+0000","last_change":"2024-09-13T18:52:40.031046+0000","last_active":"2024-09-13T18:52:40.034179+0000","last_peered":"2024-09-13T18:52:40.034179+0000","last_clean":"2024-09-13T18:52:40.034179+0000","last_became_active":"2024-09-13T18:52:40.030512+0000","last_became_peered":"2024-09-13T18:52:40.030512+0000","last_unstale":"2024-09-13T18:52:40.034179+0000","last_undegraded":"2024-09-13T18:52:40.034179+0000","last_fullsized":"2024-09-13T18:52:40.034179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:22.267278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.041041+0000","last_change":"2024-09-13T18:52:39.545287+0000","last_active":"2024-09-13T18:52:40.041041+0000","last_peered":"2024-09-13T18:52:40.041041+0000","last_clean":"2024-09-13T18:52:40.041041+0000","last_became_active":"2024-09-13T18:52:39.545044+0000","last_became_peered":"2024-09-13T18:52:39.545044+0000","last_unstale":"2024-09-13T18:52:40.041041+0000","last_undegraded":"2024-09-13T18:52:40.041041+0000","last_fullsized":"2024-09-13T18:52:40.041041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:45.701782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.032360+0000","last_change":"2024-09-13T18:52:40.027538+0000","last_active":"2024-09-13T18:52:40.032360+0000","last_peered":"2024-09-13T18:52:40.032360+0000","last_clean":"2024-09-13T18:52:40.032360+0000","last_became_active":"2024-09-13T18:52:40.026726+0000","last_became_peered":"2024-09-13T18:52:40.026726+0000","last_unstale":"2024-09-13T18:52:40.032360+0000","last_undegraded":"2024-09-13T18:52:40.032360+0000","last_fullsized":"2024-09-13T18:52:40.032360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:26.857144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034596+0000","last_change":"2024-09-13T18:52:39.543860+0000","last_active":"2024-09-13T18:52:40.034596+0000","last_peered":"2024-09-13T18:52:40.034596+0000","last_clean":"2024-09-13T18:52:40.034596+0000","last_became_active":"2024-09-13T18:52:39.541773+0000","last_became_peered":"2024-09-13T18:52:39.541773+0000","last_unstale":"2024-09-13T18:52:40.034596+0000","last_undegraded":"2024-09-13T18:52:40.034596+0000","last_fullsized":"2024-09-13T18:52:40.034596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:21.247436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003971+0000","last_change":"2024-09-13T18:52:40.022779+0000","last_active":"2024-09-13T18:52:41.003971+0000","last_peered":"2024-09-13T18:52:41.003971+0000","last_clean":"2024-09-13T18:52:41.003971+0000","last_became_active":"2024-09-13T18:52:40.022487+0000","last_became_peered":"2024-09-13T18:52:40.022487+0000","last_unstale":"2024-09-13T18:52:41.003971+0000","last_undegraded":"2024-09-13T18:52:41.003971+0000","last_fullsized":"2024-09-13T18:52:41.003971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:28.706099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.035199+0000","last_change":"2024-09-13T18:52:39.544408+0000","last_active":"2024-09-13T18:52:40.035199+0000","last_peered":"2024-09-13T18:52:40.035199+0000","last_clean":"2024-09-13T18:52:40.035199+0000","last_became_active":"2024-09-13T18:52:39.544087+0000","last_became_peered":"2024-09-13T18:52:39.544087+0000","last_unstale":"2024-09-13T18:52:40.035199+0000","last_undegraded":"2024-09-13T18:52:40.035199+0000","last_fullsized":"2024-09-13T18:52:40.035199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:10.930248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004876+0000","last_change":"2024-09-13T18:52:40.027106+0000","last_active":"2024-09-13T18:52:41.004876+0000","last_peered":"2024-09-13T18:52:41.004876+0000","last_clean":"2024-09-13T18:52:41.004876+0000","last_became_active":"2024-09-13T18:52:40.026853+0000","last_became_peered":"2024-09-13T18:52:40.026853+0000","last_unstale":"2024-09-13T18:52:41.004876+0000","last_undegraded":"2024-09-13T18:52:41.004876+0000","last_fullsized":"2024-09-13T18:52:41.004876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:40.178964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037616+0000","last_change":"2024-09-13T18:52:39.532353+0000","last_active":"2024-09-13T18:52:41.037616+0000","last_peered":"2024-09-13T18:52:41.037616+0000","last_clean":"2024-09-13T18:52:41.037616+0000","last_became_active":"2024-09-13T18:52:39.532063+0000","last_became_peered":"2024-09-13T18:52:39.532063+0000","last_unstale":"2024-09-13T18:52:41.037616+0000","last_undegraded":"2024-09-13T18:52:41.037616+0000","last_fullsized":"2024-09-13T18:52:41.037616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:27.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.039381+0000","last_change":"2024-09-13T18:52:40.036086+0000","last_active":"2024-09-13T18:52:40.039381+0000","last_peered":"2024-09-13T18:52:40.039381+0000","last_clean":"2024-09-13T18:52:40.039381+0000","last_became_active":"2024-09-13T18:52:40.035775+0000","last_became_peered":"2024-09-13T18:52:40.035775+0000","last_unstale":"2024-09-13T18:52:40.039381+0000","last_undegraded":"2024-09-13T18:52:40.039381+0000","last_fullsized":"2024-09-13T18:52:40.039381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:49.521172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004778+0000","last_change":"2024-09-13T18:52:39.535896+0000","last_active":"2024-09-13T18:52:41.004778+0000","last_peered":"2024-09-13T18:52:41.004778+0000","last_clean":"2024-09-13T18:52:41.004778+0000","last_became_active":"2024-09-13T18:52:39.535644+0000","last_became_peered":"2024-09-13T18:52:39.535644+0000","last_unstale":"2024-09-13T18:52:41.004778+0000","last_undegraded":"2024-09-13T18:52:41.004778+0000","last_fullsized":"2024-09-13T18:52:41.004778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:00.037544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.037474+0000","last_change":"2024-09-13T18:52:40.033847+0000","last_active":"2024-09-13T18:52:40.037474+0000","last_peered":"2024-09-13T18:52:40.037474+0000","last_clean":"2024-09-13T18:52:40.037474+0000","last_became_active":"2024-09-13T18:52:40.032945+0000","last_became_peered":"2024-09-13T18:52:40.032945+0000","last_unstale":"2024-09-13T18:52:40.037474+0000","last_undegraded":"2024-09-13T18:52:40.037474+0000","last_fullsized":"2024-09-13T18:52:40.037474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:24.210675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.002899+0000","last_change":"2024-09-13T18:52:39.532901+0000","last_active":"2024-09-13T18:52:41.002899+0000","last_peered":"2024-09-13T18:52:41.002899+0000","last_clean":"2024-09-13T18:52:41.002899+0000","last_became_active":"2024-09-13T18:52:39.532359+0000","last_became_peered":"2024-09-13T18:52:39.532359+0000","last_unstale":"2024-09-13T18:52:41.002899+0000","last_undegraded":"2024-09-13T18:52:41.002899+0000","last_fullsized":"2024-09-13T18:52:41.002899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:01.520449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003112+0000","last_change":"2024-09-13T18:52:40.032203+0000","last_active":"2024-09-13T18:52:41.003112+0000","last_peered":"2024-09-13T18:52:41.003112+0000","last_clean":"2024-09-13T18:52:41.003112+0000","last_became_active":"2024-09-13T18:52:40.030193+0000","last_became_peered":"2024-09-13T18:52:40.030193+0000","last_unstale":"2024-09-13T18:52:41.003112+0000","last_undegraded":"2024-09-13T18:52:41.003112+0000","last_fullsized":"2024-09-13T18:52:41.003112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:19.520520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.010417+0000","last_change":"2024-09-13T18:52:39.546410+0000","last_active":"2024-09-13T18:52:40.010417+0000","last_peered":"2024-09-13T18:52:40.010417+0000","last_clean":"2024-09-13T18:52:40.010417+0000","last_became_active":"2024-09-13T18:52:39.546068+0000","last_became_peered":"2024-09-13T18:52:39.546068+0000","last_unstale":"2024-09-13T18:52:40.010417+0000","last_undegraded":"2024-09-13T18:52:40.010417+0000","last_fullsized":"2024-09-13T18:52:40.010417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:48.820175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037765+0000","last_change":"2024-09-13T18:52:40.023116+0000","last_active":"2024-09-13T18:52:41.037765+0000","last_peered":"2024-09-13T18:52:41.037765+0000","last_clean":"2024-09-13T18:52:41.037765+0000","last_became_active":"2024-09-13T18:52:40.019937+0000","last_became_peered":"2024-09-13T18:52:40.019937+0000","last_unstale":"2024-09-13T18:52:41.037765+0000","last_undegraded":"2024-09-13T18:52:41.037765+0000","last_fullsized":"2024-09-13T18:52:41.037765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:54.129432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038228+0000","last_change":"2024-09-13T18:52:39.538805+0000","last_active":"2024-09-13T18:52:41.038228+0000","last_peered":"2024-09-13T18:52:41.038228+0000","last_clean":"2024-09-13T18:52:41.038228+0000","last_became_active":"2024-09-13T18:52:39.538559+0000","last_became_peered":"2024-09-13T18:52:39.538559+0000","last_unstale":"2024-09-13T18:52:41.038228+0000","last_undegraded":"2024-09-13T18:52:41.038228+0000","last_fullsized":"2024-09-13T18:52:41.038228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:32.427374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005124+0000","last_change":"2024-09-13T18:52:40.017406+0000","last_active":"2024-09-13T18:52:41.005124+0000","last_peered":"2024-09-13T18:52:41.005124+0000","last_clean":"2024-09-13T18:52:41.005124+0000","last_became_active":"2024-09-13T18:52:40.017141+0000","last_became_peered":"2024-09-13T18:52:40.017141+0000","last_unstale":"2024-09-13T18:52:41.005124+0000","last_undegraded":"2024-09-13T18:52:41.005124+0000","last_fullsized":"2024-09-13T18:52:41.005124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:28.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003963+0000","last_change":"2024-09-13T18:52:39.542990+0000","last_active":"2024-09-13T18:52:41.003963+0000","last_peered":"2024-09-13T18:52:41.003963+0000","last_clean":"2024-09-13T18:52:41.003963+0000","last_became_active":"2024-09-13T18:52:39.542713+0000","last_became_peered":"2024-09-13T18:52:39.542713+0000","last_unstale":"2024-09-13T18:52:41.003963+0000","last_undegraded":"2024-09-13T18:52:41.003963+0000","last_fullsized":"2024-09-13T18:52:41.003963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:49.356635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030942+0000","last_change":"2024-09-13T18:52:40.016130+0000","last_active":"2024-09-13T18:52:40.030942+0000","last_peered":"2024-09-13T18:52:40.030942+0000","last_clean":"2024-09-13T18:52:40.030942+0000","last_became_active":"2024-09-13T18:52:40.015890+0000","last_became_peered":"2024-09-13T18:52:40.015890+0000","last_unstale":"2024-09-13T18:52:40.030942+0000","last_undegraded":"2024-09-13T18:52:40.030942+0000","last_fullsized":"2024-09-13T18:52:40.030942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.041909+0000","last_change":"2024-09-13T18:52:39.545495+0000","last_active":"2024-09-13T18:52:40.041909+0000","last_peered":"2024-09-13T18:52:40.041909+0000","last_clean":"2024-09-13T18:52:40.041909+0000","last_became_active":"2024-09-13T18:52:39.544651+0000","last_became_peered":"2024-09-13T18:52:39.544651+0000","last_unstale":"2024-09-13T18:52:40.041909+0000","last_undegraded":"2024-09-13T18:52:40.041909+0000","last_fullsized":"2024-09-13T18:52:40.041909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:48.501330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038158+0000","last_change":"2024-09-13T18:52:40.021201+0000","last_active":"2024-09-13T18:52:41.038158+0000","last_peered":"2024-09-13T18:52:41.038158+0000","last_clean":"2024-09-13T18:52:41.038158+0000","last_became_active":"2024-09-13T18:52:40.019481+0000","last_became_peered":"2024-09-13T18:52:40.019481+0000","last_unstale":"2024-09-13T18:52:41.038158+0000","last_undegraded":"2024-09-13T18:52:41.038158+0000","last_fullsized":"2024-09-13T18:52:41.038158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037637+0000","last_change":"2024-09-13T18:52:39.542541+0000","last_active":"2024-09-13T18:52:41.037637+0000","last_peered":"2024-09-13T18:52:41.037637+0000","last_clean":"2024-09-13T18:52:41.037637+0000","last_became_active":"2024-09-13T18:52:39.542210+0000","last_became_peered":"2024-09-13T18:52:39.542210+0000","last_unstale":"2024-09-13T18:52:41.037637+0000","last_undegraded":"2024-09-13T18:52:41.037637+0000","last_fullsized":"2024-09-13T18:52:41.037637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:55.224960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.031377+0000","last_change":"2024-09-13T18:52:40.020712+0000","last_active":"2024-09-13T18:52:40.031377+0000","last_peered":"2024-09-13T18:52:40.031377+0000","last_clean":"2024-09-13T18:52:40.031377+0000","last_became_active":"2024-09-13T18:52:40.020425+0000","last_became_peered":"2024-09-13T18:52:40.020425+0000","last_unstale":"2024-09-13T18:52:40.031377+0000","last_undegraded":"2024-09-13T18:52:40.031377+0000","last_fullsized":"2024-09-13T18:52:40.031377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.451244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.009833+0000","last_change":"2024-09-13T18:52:39.548526+0000","last_active":"2024-09-13T18:52:40.009833+0000","last_peered":"2024-09-13T18:52:40.009833+0000","last_clean":"2024-09-13T18:52:40.009833+0000","last_became_active":"2024-09-13T18:52:39.548234+0000","last_became_peered":"2024-09-13T18:52:39.548234+0000","last_unstale":"2024-09-13T18:52:40.009833+0000","last_undegraded":"2024-09-13T18:52:40.009833+0000","last_fullsized":"2024-09-13T18:52:40.009833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:48.501330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034319+0000","last_change":"2024-09-13T18:52:40.030393+0000","last_active":"2024-09-13T18:52:40.034319+0000","last_peered":"2024-09-13T18:52:40.034319+0000","last_clean":"2024-09-13T18:52:40.034319+0000","last_became_active":"2024-09-13T18:52:40.030085+0000","last_became_peered":"2024-09-13T18:52:40.030085+0000","last_unstale":"2024-09-13T18:52:40.034319+0000","last_undegraded":"2024-09-13T18:52:40.034319+0000","last_fullsized":"2024-09-13T18:52:40.034319+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003121+0000","last_change":"2024-09-13T18:52:39.539365+0000","last_active":"2024-09-13T18:52:41.003121+0000","last_peered":"2024-09-13T18:52:41.003121+0000","last_clean":"2024-09-13T18:52:41.003121+0000","last_became_active":"2024-09-13T18:52:39.539007+0000","last_became_peered":"2024-09-13T18:52:39.539007+0000","last_unstale":"2024-09-13T18:52:41.003121+0000","last_undegraded":"2024-09-13T18:52:41.003121+0000","last_fullsized":"2024-09-13T18:52:41.003121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:31.623095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030279+0000","last_change":"2024-09-13T18:52:40.024066+0000","last_active":"2024-09-13T18:52:40.030279+0000","last_peered":"2024-09-13T18:52:40.030279+0000","last_clean":"2024-09-13T18:52:40.030279+0000","last_became_active":"2024-09-13T18:52:40.023836+0000","last_became_peered":"2024-09-13T18:52:40.023836+0000","last_unstale":"2024-09-13T18:52:40.030279+0000","last_undegraded":"2024-09-13T18:52:40.030279+0000","last_fullsized":"2024-09-13T18:52:40.030279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003900+0000","last_change":"2024-09-13T18:52:39.539929+0000","last_active":"2024-09-13T18:52:41.003900+0000","last_peered":"2024-09-13T18:52:41.003900+0000","last_clean":"2024-09-13T18:52:41.003900+0000","last_became_active":"2024-09-13T18:52:39.539691+0000","last_became_peered":"2024-09-13T18:52:39.539691+0000","last_unstale":"2024-09-13T18:52:41.003900+0000","last_undegraded":"2024-09-13T18:52:41.003900+0000","last_fullsized":"2024-09-13T18:52:41.003900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:45.703277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004701+0000","last_change":"2024-09-13T18:52:40.020096+0000","last_active":"2024-09-13T18:52:41.004701+0000","last_peered":"2024-09-13T18:52:41.004701+0000","last_clean":"2024-09-13T18:52:41.004701+0000","last_became_active":"2024-09-13T18:52:40.019628+0000","last_became_peered":"2024-09-13T18:52:40.019628+0000","last_unstale":"2024-09-13T18:52:41.004701+0000","last_undegraded":"2024-09-13T18:52:41.004701+0000","last_fullsized":"2024-09-13T18:52:41.004701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:19.520520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.041416+0000","last_change":"2024-09-13T18:52:39.543154+0000","last_active":"2024-09-13T18:52:40.041416+0000","last_peered":"2024-09-13T18:52:40.041416+0000","last_clean":"2024-09-13T18:52:40.041416+0000","last_became_active":"2024-09-13T18:52:39.542135+0000","last_became_peered":"2024-09-13T18:52:39.542135+0000","last_unstale":"2024-09-13T18:52:40.041416+0000","last_undegraded":"2024-09-13T18:52:40.041416+0000","last_fullsized":"2024-09-13T18:52:40.041416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:06.294664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003353+0000","last_change":"2024-09-13T18:52:40.023125+0000","last_active":"2024-09-13T18:52:41.003353+0000","last_peered":"2024-09-13T18:52:41.003353+0000","last_clean":"2024-09-13T18:52:41.003353+0000","last_became_active":"2024-09-13T18:52:40.022932+0000","last_became_peered":"2024-09-13T18:52:40.022932+0000","last_unstale":"2024-09-13T18:52:41.003353+0000","last_undegraded":"2024-09-13T18:52:41.003353+0000","last_fullsized":"2024-09-13T18:52:41.003353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:14.531571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.039846+0000","last_change":"2024-09-13T18:52:39.544006+0000","last_active":"2024-09-13T18:52:40.039846+0000","last_peered":"2024-09-13T18:52:40.039846+0000","last_clean":"2024-09-13T18:52:40.039846+0000","last_became_active":"2024-09-13T18:52:39.543757+0000","last_became_peered":"2024-09-13T18:52:39.543757+0000","last_unstale":"2024-09-13T18:52:40.039846+0000","last_undegraded":"2024-09-13T18:52:40.039846+0000","last_fullsized":"2024-09-13T18:52:40.039846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:36.962384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003524+0000","last_change":"2024-09-13T18:52:40.029086+0000","last_active":"2024-09-13T18:52:41.003524+0000","last_peered":"2024-09-13T18:52:41.003524+0000","last_clean":"2024-09-13T18:52:41.003524+0000","last_became_active":"2024-09-13T18:52:40.028814+0000","last_became_peered":"2024-09-13T18:52:40.028814+0000","last_unstale":"2024-09-13T18:52:41.003524+0000","last_undegraded":"2024-09-13T18:52:41.003524+0000","last_fullsized":"2024-09-13T18:52:41.003524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:47.030493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004076+0000","last_change":"2024-09-13T18:52:39.538782+0000","last_active":"2024-09-13T18:52:41.004076+0000","last_peered":"2024-09-13T18:52:41.004076+0000","last_clean":"2024-09-13T18:52:41.004076+0000","last_became_active":"2024-09-13T18:52:39.538507+0000","last_became_peered":"2024-09-13T18:52:39.538507+0000","last_unstale":"2024-09-13T18:52:41.004076+0000","last_undegraded":"2024-09-13T18:52:41.004076+0000","last_fullsized":"2024-09-13T18:52:41.004076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:47.153558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005529+0000","last_change":"2024-09-13T18:52:40.019749+0000","last_active":"2024-09-13T18:52:41.005529+0000","last_peered":"2024-09-13T18:52:41.005529+0000","last_clean":"2024-09-13T18:52:41.005529+0000","last_became_active":"2024-09-13T18:52:40.019423+0000","last_became_peered":"2024-09-13T18:52:40.019423+0000","last_unstale":"2024-09-13T18:52:41.005529+0000","last_undegraded":"2024-09-13T18:52:41.005529+0000","last_fullsized":"2024-09-13T18:52:41.005529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:11.059208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.001059+0000","last_change":"2024-09-13T18:52:39.540750+0000","last_active":"2024-09-13T18:52:40.001059+0000","last_peered":"2024-09-13T18:52:40.001059+0000","last_clean":"2024-09-13T18:52:40.001059+0000","last_became_active":"2024-09-13T18:52:39.540488+0000","last_became_peered":"2024-09-13T18:52:39.540488+0000","last_unstale":"2024-09-13T18:52:40.001059+0000","last_undegraded":"2024-09-13T18:52:40.001059+0000","last_fullsized":"2024-09-13T18:52:40.001059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:21.247436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004079+0000","last_change":"2024-09-13T18:52:40.030728+0000","last_active":"2024-09-13T18:52:41.004079+0000","last_peered":"2024-09-13T18:52:41.004079+0000","last_clean":"2024-09-13T18:52:41.004079+0000","last_became_active":"2024-09-13T18:52:40.030171+0000","last_became_peered":"2024-09-13T18:52:40.030171+0000","last_unstale":"2024-09-13T18:52:41.004079+0000","last_undegraded":"2024-09-13T18:52:41.004079+0000","last_fullsized":"2024-09-13T18:52:41.004079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:12.433472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005638+0000","last_change":"2024-09-13T18:52:39.527966+0000","last_active":"2024-09-13T18:52:41.005638+0000","last_peered":"2024-09-13T18:52:41.005638+0000","last_clean":"2024-09-13T18:52:41.005638+0000","last_became_active":"2024-09-13T18:52:39.527700+0000","last_became_peered":"2024-09-13T18:52:39.527700+0000","last_unstale":"2024-09-13T18:52:41.005638+0000","last_undegraded":"2024-09-13T18:52:41.005638+0000","last_fullsized":"2024-09-13T18:52:41.005638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:25.777609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005106+0000","last_change":"2024-09-13T18:52:40.031203+0000","last_active":"2024-09-13T18:52:41.005106+0000","last_peered":"2024-09-13T18:52:41.005106+0000","last_clean":"2024-09-13T18:52:41.005106+0000","last_became_active":"2024-09-13T18:52:40.030981+0000","last_became_peered":"2024-09-13T18:52:40.030981+0000","last_unstale":"2024-09-13T18:52:41.005106+0000","last_undegraded":"2024-09-13T18:52:41.005106+0000","last_fullsized":"2024-09-13T18:52:41.005106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:45.859207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004891+0000","last_change":"2024-09-13T18:52:39.544025+0000","last_active":"2024-09-13T18:52:41.004891+0000","last_peered":"2024-09-13T18:52:41.004891+0000","last_clean":"2024-09-13T18:52:41.004891+0000","last_became_active":"2024-09-13T18:52:39.541730+0000","last_became_peered":"2024-09-13T18:52:39.541730+0000","last_unstale":"2024-09-13T18:52:41.004891+0000","last_undegraded":"2024-09-13T18:52:41.004891+0000","last_fullsized":"2024-09-13T18:52:41.004891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:41.752738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.037492+0000","last_change":"2024-09-13T18:52:40.034013+0000","last_active":"2024-09-13T18:52:40.037492+0000","last_peered":"2024-09-13T18:52:40.037492+0000","last_clean":"2024-09-13T18:52:40.037492+0000","last_became_active":"2024-09-13T18:52:40.033548+0000","last_became_peered":"2024-09-13T18:52:40.033548+0000","last_unstale":"2024-09-13T18:52:40.037492+0000","last_undegraded":"2024-09-13T18:52:40.037492+0000","last_fullsized":"2024-09-13T18:52:40.037492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004902+0000","last_change":"2024-09-13T18:52:39.542608+0000","last_active":"2024-09-13T18:52:41.004902+0000","last_peered":"2024-09-13T18:52:41.004902+0000","last_clean":"2024-09-13T18:52:41.004902+0000","last_became_active":"2024-09-13T18:52:39.542415+0000","last_became_peered":"2024-09-13T18:52:39.542415+0000","last_unstale":"2024-09-13T18:52:41.004902+0000","last_undegraded":"2024-09-13T18:52:41.004902+0000","last_fullsized":"2024-09-13T18:52:41.004902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:16.120961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.029324+0000","last_change":"2024-09-13T18:52:40.022705+0000","last_active":"2024-09-13T18:52:40.029324+0000","last_peered":"2024-09-13T18:52:40.029324+0000","last_clean":"2024-09-13T18:52:40.029324+0000","last_became_active":"2024-09-13T18:52:40.022449+0000","last_became_peered":"2024-09-13T18:52:40.022449+0000","last_unstale":"2024-09-13T18:52:40.029324+0000","last_undegraded":"2024-09-13T18:52:40.029324+0000","last_fullsized":"2024-09-13T18:52:40.029324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:29.841888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038131+0000","last_change":"2024-09-13T18:52:39.537099+0000","last_active":"2024-09-13T18:52:41.038131+0000","last_peered":"2024-09-13T18:52:41.038131+0000","last_clean":"2024-09-13T18:52:41.038131+0000","last_became_active":"2024-09-13T18:52:39.536543+0000","last_became_peered":"2024-09-13T18:52:39.536543+0000","last_unstale":"2024-09-13T18:52:41.038131+0000","last_undegraded":"2024-09-13T18:52:41.038131+0000","last_fullsized":"2024-09-13T18:52:41.038131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:25.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030198+0000","last_change":"2024-09-13T18:52:40.021255+0000","last_active":"2024-09-13T18:52:40.030198+0000","last_peered":"2024-09-13T18:52:40.030198+0000","last_clean":"2024-09-13T18:52:40.030198+0000","last_became_active":"2024-09-13T18:52:40.020958+0000","last_became_peered":"2024-09-13T18:52:40.020958+0000","last_unstale":"2024-09-13T18:52:40.030198+0000","last_undegraded":"2024-09-13T18:52:40.030198+0000","last_fullsized":"2024-09-13T18:52:40.030198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:54.129432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005115+0000","last_change":"2024-09-13T18:52:39.537992+0000","last_active":"2024-09-13T18:52:41.005115+0000","last_peered":"2024-09-13T18:52:41.005115+0000","last_clean":"2024-09-13T18:52:41.005115+0000","last_became_active":"2024-09-13T18:52:39.537737+0000","last_became_peered":"2024-09-13T18:52:39.537737+0000","last_unstale":"2024-09-13T18:52:41.005115+0000","last_undegraded":"2024-09-13T18:52:41.005115+0000","last_fullsized":"2024-09-13T18:52:41.005115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:20.658239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034025+0000","last_change":"2024-09-13T18:52:40.030833+0000","last_active":"2024-09-13T18:52:40.034025+0000","last_peered":"2024-09-13T18:52:40.034025+0000","last_clean":"2024-09-13T18:52:40.034025+0000","last_became_active":"2024-09-13T18:52:40.030125+0000","last_became_peered":"2024-09-13T18:52:40.030125+0000","last_unstale":"2024-09-13T18:52:40.034025+0000","last_undegraded":"2024-09-13T18:52:40.034025+0000","last_fullsized":"2024-09-13T18:52:40.034025+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:40.718943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.009191+0000","last_change":"2024-09-13T18:52:39.540675+0000","last_active":"2024-09-13T18:52:40.009191+0000","last_peered":"2024-09-13T18:52:40.009191+0000","last_clean":"2024-09-13T18:52:40.009191+0000","last_became_active":"2024-09-13T18:52:39.539673+0000","last_became_peered":"2024-09-13T18:52:39.539673+0000","last_unstale":"2024-09-13T18:52:40.009191+0000","last_undegraded":"2024-09-13T18:52:40.009191+0000","last_fullsized":"2024-09-13T18:52:40.009191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:39.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003749+0000","last_change":"2024-09-13T18:52:40.017262+0000","last_active":"2024-09-13T18:52:41.003749+0000","last_peered":"2024-09-13T18:52:41.003749+0000","last_clean":"2024-09-13T18:52:41.003749+0000","last_became_active":"2024-09-13T18:52:40.017000+0000","last_became_peered":"2024-09-13T18:52:40.017000+0000","last_unstale":"2024-09-13T18:52:41.003749+0000","last_undegraded":"2024-09-13T18:52:41.003749+0000","last_fullsized":"2024-09-13T18:52:41.003749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:36.819884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.010068+0000","last_change":"2024-09-13T18:52:39.547187+0000","last_active":"2024-09-13T18:52:40.010068+0000","last_peered":"2024-09-13T18:52:40.010068+0000","last_clean":"2024-09-13T18:52:40.010068+0000","last_became_active":"2024-09-13T18:52:39.546931+0000","last_became_peered":"2024-09-13T18:52:39.546931+0000","last_unstale":"2024-09-13T18:52:40.010068+0000","last_undegraded":"2024-09-13T18:52:40.010068+0000","last_fullsized":"2024-09-13T18:52:40.010068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:52.764864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030288+0000","last_change":"2024-09-13T18:52:40.021631+0000","last_active":"2024-09-13T18:52:40.030288+0000","last_peered":"2024-09-13T18:52:40.030288+0000","last_clean":"2024-09-13T18:52:40.030288+0000","last_became_active":"2024-09-13T18:52:40.021398+0000","last_became_peered":"2024-09-13T18:52:40.021398+0000","last_unstale":"2024-09-13T18:52:40.030288+0000","last_undegraded":"2024-09-13T18:52:40.030288+0000","last_fullsized":"2024-09-13T18:52:40.030288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.009238+0000","last_change":"2024-09-13T18:52:39.541321+0000","last_active":"2024-09-13T18:52:40.009238+0000","last_peered":"2024-09-13T18:52:40.009238+0000","last_clean":"2024-09-13T18:52:40.009238+0000","last_became_active":"2024-09-13T18:52:39.540219+0000","last_became_peered":"2024-09-13T18:52:39.540219+0000","last_unstale":"2024-09-13T18:52:40.009238+0000","last_undegraded":"2024-09-13T18:52:40.009238+0000","last_fullsized":"2024-09-13T18:52:40.009238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:39.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.036830+0000","last_change":"2024-09-13T18:52:40.032849+0000","last_active":"2024-09-13T18:52:40.036830+0000","last_peered":"2024-09-13T18:52:40.036830+0000","last_clean":"2024-09-13T18:52:40.036830+0000","last_became_active":"2024-09-13T18:52:40.032552+0000","last_became_peered":"2024-09-13T18:52:40.032552+0000","last_unstale":"2024-09-13T18:52:40.036830+0000","last_undegraded":"2024-09-13T18:52:40.036830+0000","last_fullsized":"2024-09-13T18:52:40.036830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:53.136644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003769+0000","last_change":"2024-09-13T18:52:39.539575+0000","last_active":"2024-09-13T18:52:41.003769+0000","last_peered":"2024-09-13T18:52:41.003769+0000","last_clean":"2024-09-13T18:52:41.003769+0000","last_became_active":"2024-09-13T18:52:39.539262+0000","last_became_peered":"2024-09-13T18:52:39.539262+0000","last_unstale":"2024-09-13T18:52:41.003769+0000","last_undegraded":"2024-09-13T18:52:41.003769+0000","last_fullsized":"2024-09-13T18:52:41.003769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:52.358601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.038790+0000","last_change":"2024-09-13T18:52:40.034086+0000","last_active":"2024-09-13T18:52:40.038790+0000","last_peered":"2024-09-13T18:52:40.038790+0000","last_clean":"2024-09-13T18:52:40.038790+0000","last_became_active":"2024-09-13T18:52:40.033070+0000","last_became_peered":"2024-09-13T18:52:40.033070+0000","last_unstale":"2024-09-13T18:52:40.038790+0000","last_undegraded":"2024-09-13T18:52:40.038790+0000","last_fullsized":"2024-09-13T18:52:40.038790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:05.838347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.008954+0000","last_change":"2024-09-13T18:52:39.541633+0000","last_active":"2024-09-13T18:52:40.008954+0000","last_peered":"2024-09-13T18:52:40.008954+0000","last_clean":"2024-09-13T18:52:40.008954+0000","last_became_active":"2024-09-13T18:52:39.541337+0000","last_became_peered":"2024-09-13T18:52:39.541337+0000","last_unstale":"2024-09-13T18:52:40.008954+0000","last_undegraded":"2024-09-13T18:52:40.008954+0000","last_fullsized":"2024-09-13T18:52:40.008954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.020905+0000","last_change":"2024-09-13T18:52:40.015710+0000","last_active":"2024-09-13T18:52:40.020905+0000","last_peered":"2024-09-13T18:52:40.020905+0000","last_clean":"2024-09-13T18:52:40.020905+0000","last_became_active":"2024-09-13T18:52:40.015468+0000","last_became_peered":"2024-09-13T18:52:40.015468+0000","last_unstale":"2024-09-13T18:52:40.020905+0000","last_undegraded":"2024-09-13T18:52:40.020905+0000","last_fullsized":"2024-09-13T18:52:40.020905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.000774+0000","last_change":"2024-09-13T18:52:39.529014+0000","last_active":"2024-09-13T18:52:40.000774+0000","last_peered":"2024-09-13T18:52:40.000774+0000","last_clean":"2024-09-13T18:52:40.000774+0000","last_became_active":"2024-09-13T18:52:39.528776+0000","last_became_peered":"2024-09-13T18:52:39.528776+0000","last_unstale":"2024-09-13T18:52:40.000774+0000","last_undegraded":"2024-09-13T18:52:40.000774+0000","last_fullsized":"2024-09-13T18:52:40.000774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.027656+0000","last_change":"2024-09-13T18:52:40.023475+0000","last_active":"2024-09-13T18:52:40.027656+0000","last_peered":"2024-09-13T18:52:40.027656+0000","last_clean":"2024-09-13T18:52:40.027656+0000","last_became_active":"2024-09-13T18:52:40.023229+0000","last_became_peered":"2024-09-13T18:52:40.023229+0000","last_unstale":"2024-09-13T18:52:40.027656+0000","last_undegraded":"2024-09-13T18:52:40.027656+0000","last_fullsized":"2024-09-13T18:52:40.027656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005304+0000","last_change":"2024-09-13T18:52:39.539885+0000","last_active":"2024-09-13T18:52:41.005304+0000","last_peered":"2024-09-13T18:52:41.005304+0000","last_clean":"2024-09-13T18:52:41.005304+0000","last_became_active":"2024-09-13T18:52:39.539653+0000","last_became_peered":"2024-09-13T18:52:39.539653+0000","last_unstale":"2024-09-13T18:52:41.005304+0000","last_undegraded":"2024-09-13T18:52:41.005304+0000","last_fullsized":"2024-09-13T18:52:41.005304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-13T18:52:39.530849+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:52:39.530849+0000","last_peered":"2024-09-13T18:52:39.530849+0000","last_clean":"2024-09-13T18:52:39.530849+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:52:39.530849+0000","last_undegraded":"2024-09-13T18:52:39.530849+0000","last_fullsized":"2024-09-13T18:52:39.530849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1576960,"data_stored":1038179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.76300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.498,"5min":1.72,"15min":1.72},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0780000000000001,"15min":1.1259999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.409,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3520000000000001,"5min":1.619,"15min":1.619},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1499999999999999,"15min":1.216},"min":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4379999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.089}]},{"osd":2,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2769999999999999,"15min":1.337},"min":{"1min":0.873,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6499999999999999,"5min":1.885,"15min":1.885},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.94499999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4650000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1930000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4810000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3440000000000001,"15min":1.4319999999999999},"min":{"1min":1.0109999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.629,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.2929999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1060000000000001,"15min":1.1140000000000001},"min":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.462,"5min":1.552,"15min":1.552},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.21,"15min":1.1859999999999999},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.46,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2509999999999999,"15min":1.3169999999999999},"min":{"1min":0.72999999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.579,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.224},"min":{"1min":0.88400000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.0169999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.401},"min":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.625,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.343},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.385,"15min":1.417},"min":{"1min":1.036,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5860000000000001,"5min":1.845,"15min":1.845},"last":1.0569999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":991232,"data_stored":449353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.139},"min":{"1min":0.79600000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5049999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1639999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2789999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2809999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.68700000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5589999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.206},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.385,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.014}]},{"osd":2,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.246,"15min":1.4239999999999999},"min":{"1min":0.77600000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.274,"15min":1.47},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5900000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.048}]},{"osd":3,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3340000000000001,"15min":1.496},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5629999999999999,"5min":4.883,"15min":4.883},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3340000000000001,"15min":1.5129999999999999},"min":{"1min":1,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.591,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2030000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5129999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.2609999999999999,"15min":1.331},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6240000000000001,"5min":2.077,"15min":2.077},"last":1.141}]},{"osd":5,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3160000000000001,"15min":1.4099999999999999},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.5469999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.4219999999999999,"15min":1.478},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.657,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.3420000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.385,"15min":1.4590000000000001},"min":{"1min":0.876,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4079999999999999,"15min":1.5209999999999999},"min":{"1min":1.0740000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5309999999999999,"5min":2.367,"15min":2.367},"last":1.363}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":454443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.135,"15min":1.159},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4450000000000001,"5min":2.278,"15min":2.278},"last":1.2330000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.91500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5649999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.212,"15min":1.2809999999999999},"min":{"1min":0.76300000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3999999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.173,"15min":1.252},"min":{"1min":0.81699999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4159999999999999,"5min":2.157,"15min":2.157},"last":0.97299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.284,"15min":1.369},"min":{"1min":0.85699999999999998,"5min":0.749,"15min":0.749},"max":{"1min":1.6160000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.4319999999999999},"min":{"1min":0.94199999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.569,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.0900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1319999999999999,"15min":1.21},"min":{"1min":0.74399999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.478,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.492},{"interface":"front","average":{"1min":1.202,"5min":1.2350000000000001,"15min":1.2749999999999999},"min":{"1min":0.872,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.613,"5min":1.974,"15min":1.974},"last":1.409}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2569999999999999,"15min":1.2989999999999999},"min":{"1min":0.98099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.494,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.27,"15min":1.3440000000000001},"min":{"1min":0.871,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.601,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.5620000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.391,"15min":1.429},"min":{"1min":1.1879999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6120000000000001,"5min":2.169,"15min":2.169},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4350000000000001,"15min":1.5109999999999999},"min":{"1min":1.1990000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.659,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.47}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":999424,"data_stored":449457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.109,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.502,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.1399999999999999},"min":{"1min":0.84199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":0.88600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6739999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.002},{"interface":"front","average":{"1min":1.26,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5740000000000001,"5min":2.423,"15min":2.423},"last":1.4390000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.99,"15min":1.99},"last":1.284},{"interface":"front","average":{"1min":1.302,"5min":1.329,"15min":1.381},"min":{"1min":0.99099999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6519999999999999,"5min":2.335,"15min":2.335},"last":1.3100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.22,"15min":1.3049999999999999},"min":{"1min":0.78400000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.573,"5min":2.621,"15min":2.621},"last":1.099},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.206,"15min":1.264},"min":{"1min":0.89400000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3779999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.1779999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1919999999999999,"15min":1.2969999999999999},"min":{"1min":0.80200000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":2.274,"15min":2.274},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2529999999999999,"15min":1.3140000000000001},"min":{"1min":0.91500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.831,"5min":2.266,"15min":2.266},"last":1.4119999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.3480000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5449999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.458},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.6830000000000001,"5min":2.5,"15min":2.5},"last":1.3799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3859999999999999,"15min":1.458},"min":{"1min":1.0029999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7969999999999999,"5min":2.395,"15min":2.395},"last":1.337},{"interface":"front","average":{"1min":1.369,"5min":1.375,"15min":1.4610000000000001},"min":{"1min":0.84199999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.655,"5min":2.415,"15min":2.415},"last":1.3620000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":454991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2969999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85799999999999998,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2889999999999999,"5min":1.444,"15min":1.444},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.72299999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98899999999999999,"15min":1.101},"min":{"1min":0.61299999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.81699999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.63700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.145,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4430000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.1950000000000001,"15min":1.2430000000000001},"min":{"1min":1.0369999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5329999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.234},"min":{"1min":0.89300000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.484,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2490000000000001,"15min":1.3149999999999999},"min":{"1min":0.998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5760000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.089},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3080000000000001,"15min":1.3740000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9870000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.351,"15min":1.427},"min":{"1min":1.1559999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9239999999999999,"5min":2.714,"15min":2.714},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":0.94599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.72,"5min":2.52,"15min":2.52},"last":1.139}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.363,"15min":1.5089999999999999},"min":{"1min":0.96699999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6719999999999999,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.109},{"interface":"front","average":{"1min":1.349,"5min":1.335,"15min":1.431},"min":{"1min":1.097,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6339999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1003520,"data_stored":455151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.97699999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.242,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.071},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.874,"15min":1.0429999999999999},"min":{"1min":0.59799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.83399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.92600000000000005,"15min":1.127},"min":{"1min":0.65900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.7350000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.125,"15min":1.23},"min":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.268,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.02}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.3160000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7749999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4730000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.171}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3300000000000001,"15min":1.6399999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.421,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3049999999999999,"15min":1.4490000000000001},"min":{"1min":0.95299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.569,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.353,"15min":1.508},"min":{"1min":0.99099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5469999999999999,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.306,"15min":1.482},"min":{"1min":0.89500000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5109999999999999,"5min":4.335,"15min":4.335},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3480000000000001,"15min":1.5349999999999999},"min":{"1min":1.04,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5980000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.3899999999999999,"15min":1.744},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3999999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.232}]},{"osd":7,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.399,"15min":1.5589999999999999},"min":{"1min":1.069,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.4690000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.429,"15min":1.6140000000000001},"min":{"1min":1.145,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.5429999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":987136,"data_stored":447901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81100000000000005,"15min":0.88300000000000001},"min":{"1min":0.58799999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88100000000000001,"15min":1.048},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.875}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66300000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5649999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.997,"15min":1.069},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3069999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1699999999999999,"15min":1.3149999999999999},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.363,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.25},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.411},"min":{"1min":0.71199999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4419999999999999,"5min":10.368,"15min":10.368},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2889999999999999,"15min":1.381},"min":{"1min":1.0429999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.609,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2789999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4690000000000001,"5min":2.911,"15min":2.911},"last":1.155}]},{"osd":5,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3560000000000001,"15min":1.7250000000000001},"min":{"1min":0.98399999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.494,"5min":10.214,"15min":10.214},"last":1.288},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.353,"15min":1.48},"min":{"1min":1.0860000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.651,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3640000000000001,"15min":1.5740000000000001},"min":{"1min":1.054,"5min":0.874,"15min":0.874},"max":{"1min":1.4790000000000001,"5min":6.032,"15min":6.032},"last":1.373},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4159999999999999,"15min":1.772},"min":{"1min":1.0580000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6100000000000001,"5min":10.112,"15min":10.112},"last":1.4330000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4790000000000001,"15min":1.833},"min":{"1min":1.111,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5169999999999999,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4199999999999999,"15min":1.5680000000000001},"min":{"1min":1.1519999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.552,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3280000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1585152,"data_stored":1044777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.99099999999999999},"min":{"1min":0.52700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1339999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.879,"15min":1.002},"min":{"1min":0.625,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3740000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.155}]},{"osd":2,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":1.143},"min":{"1min":0.69399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.262,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.111},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.036,"15min":1.2110000000000001},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.056,"15min":1.194},"min":{"1min":0.52100000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3959999999999999,"5min":4.093,"15min":4.093},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.145,"5min":1.216,"15min":1.417},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.2170000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2729999999999999,"15min":1.444},"min":{"1min":0.82999999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.5049999999999999,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3069999999999999,"15min":1.456},"min":{"1min":0.94899999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.458,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.4399999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3839999999999999,"15min":1.6120000000000001},"min":{"1min":0.92400000000000004,"5min":0.753,"15min":0.753},"max":{"1min":1.4950000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3400000000000001,"15min":1.54},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.401}]},{"osd":6,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.349,"15min":1.55},"min":{"1min":1.1100000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.528,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.423,"15min":1.6950000000000001},"min":{"1min":1.056,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.577,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.2989999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.409,"15min":1.595},"min":{"1min":0.99199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.756,"5min":3.056,"15min":3.056},"last":1.339},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.387,"15min":1.617},"min":{"1min":1.095,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.546,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.2789999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:52:45.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:52:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.515+0000 7ff2c9c00700 1 Processor -- start 2024-09-13T18:52:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.515+0000 7ff2c9c00700 1 -- start start 2024-09-13T18:52:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c9c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c40ccd20 0x7ff2c415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c9c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2c40cf380 0x7ff2c40cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c9c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c415c260 0x7ff2c406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c9c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406aaf0 con 0x7ff2c40ccd20 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c9c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406cdc0 con 0x7ff2c40cf380 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c9c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c415c060 con 0x7ff2c415c260 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c40ccd20 0x7ff2c415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2c40ccd20 0x7ff2c415bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60066/0 (socket says 172.21.15.81:60066) 2024-09-13T18:52:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 -- 172.21.15.81:0/58204177 learned_addr learned my addr 172.21.15.81:0/58204177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2ba000700 1 --2- 172.21.15.81:0/58204177 >> v2:172.21.15.178:3300/0 conn(0x7ff2c40cf380 0x7ff2c40cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c3400700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c415c260 0x7ff2c406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 -- 172.21.15.81:0/58204177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c415c260 msgr2=0x7ff2c406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c415c260 0x7ff2c406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 -- 172.21.15.81:0/58204177 >> v2:172.21.15.178:3300/0 conn(0x7ff2c40cf380 msgr2=0x7ff2c40cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/58204177 >> v2:172.21.15.178:3300/0 conn(0x7ff2c40cf380 0x7ff2c40cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 -- 172.21.15.81:0/58204177 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c40cd640 con 0x7ff2c40ccd20 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2ba000700 1 --2- 172.21.15.81:0/58204177 >> v2:172.21.15.178:3300/0 conn(0x7ff2c40cf380 0x7ff2c40cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c3400700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c415c260 0x7ff2c406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40ccd20 0x7ff2c415bb20 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff2c406d750 tx=0x7ff2b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bb15ab2e2e20d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2000700 1 -- 172.21.15.81:0/58204177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400e070 con 0x7ff2c40ccd20 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2000700 1 -- 172.21.15.81:0/58204177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b400b9c0 con 0x7ff2c40ccd20 2024-09-13T18:52:45.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.519+0000 7ff2c2000700 1 -- 172.21.15.81:0/58204177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b400bd70 con 0x7ff2c40ccd20 2024-09-13T18:52:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 -- 172.21.15.81:0/58204177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40ccd20 msgr2=0x7ff2c415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40ccd20 0x7ff2c415bb20 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ff2c406d750 tx=0x7ff2b400b330 comp rx=0 tx=0).stop 2024-09-13T18:52:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 -- 172.21.15.81:0/58204177 shutdown_connections 2024-09-13T18:52:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/58204177 >> v2:172.21.15.178:3300/0 conn(0x7ff2c40cf380 0x7ff2c40cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c415c260 0x7ff2c406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/58204177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c40ccd20 0x7ff2c415bb20 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 -- 172.21.15.81:0/58204177 >> 172.21.15.81:0/58204177 conn(0x7ff2c40b20b0 msgr2=0x7ff2c40cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 -- 172.21.15.81:0/58204177 shutdown_connections 2024-09-13T18:52:45.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.523+0000 7ff2c9c00700 1 -- 172.21.15.81:0/58204177 wait complete. 2024-09-13T18:52:45.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 Processor -- start 2024-09-13T18:52:45.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 -- start start 2024-09-13T18:52:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2c40ccd20 0x7ff2c40ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c40cf380 0x7ff2c40aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 0x7ff2c4152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41526d0 con 0x7ff2c415c260 2024-09-13T18:52:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c40ac920 con 0x7ff2c40ccd20 2024-09-13T18:52:45.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c9c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41519f0 con 0x7ff2c40cf380 2024-09-13T18:52:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 0x7ff2c4152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2ba000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c40cf380 0x7ff2c40aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 0x7ff2c4152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60074/0 (socket says 172.21.15.81:60074) 2024-09-13T18:52:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c3400700 1 -- 172.21.15.81:0/867521341 learned_addr learned my addr 172.21.15.81:0/867521341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:45.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.527+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2c40ccd20 0x7ff2c40ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c3400700 1 -- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c40cf380 msgr2=0x7ff2c40aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c3400700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c40cf380 0x7ff2c40aa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c3400700 1 -- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2c40ccd20 msgr2=0x7ff2c40ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c3400700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2c40ccd20 0x7ff2c40ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c3400700 1 -- 172.21.15.81:0/867521341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4009b30 con 0x7ff2c415c260 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2ba000700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c40cf380 0x7ff2c40aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2c40ccd20 0x7ff2c40ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:45.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c3400700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 0x7ff2c4152af0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c7f0 tx=0x7ff2bc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc011800 con 0x7ff2c415c260 2024-09-13T18:52:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc011960 con 0x7ff2c415c260 2024-09-13T18:52:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c40aac20 con 0x7ff2c415c260 2024-09-13T18:52:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc011d10 con 0x7ff2c415c260 2024-09-13T18:52:45.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c41522f0 con 0x7ff2c415c260 2024-09-13T18:52:45.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.531+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c4152810 con 0x7ff2c415c260 2024-09-13T18:52:45.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.535+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2bc021350 con 0x7ff2c415c260 2024-09-13T18:52:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.535+0000 7ff2bb400700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2a0066730 0x7ff2a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.535+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff2bc0840b0 con 0x7ff2c415c260 2024-09-13T18:52:45.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.535+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2a0066730 0x7ff2a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.535+0000 7ff2c2a00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2a0066730 0x7ff2a0068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b370 tx=0x7ff2b4009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.543+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2c4152810 con 0x7ff2c415c260 2024-09-13T18:52:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.787+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff2c4152810 con 0x7ff2c415c260 2024-09-13T18:52:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.787+0000 7ff2bb400700 1 -- 172.21.15.81:0/867521341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1442 (secure 0 0 0) 0x7ff2c4152810 con 0x7ff2c415c260 2024-09-13T18:52:45.796 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:45.796 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":355,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":96},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":259444736,"bytes_avail":772834668544,"bytes_total":773094113280,"unknown_pgs_ratio":0.98969072103500366},"fsmap":{"epoch":70,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":7476}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-13T18:52:15.072130+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:52:45.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2a0066730 msgr2=0x7ff2a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2a0066730 0x7ff2a0068bf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff2b400b370 tx=0x7ff2b4009000 comp rx=0 tx=0).stop 2024-09-13T18:52:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 msgr2=0x7ff2c4152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 0x7ff2c4152af0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00c7f0 tx=0x7ff2bc00cb00 comp rx=0 tx=0).stop 2024-09-13T18:52:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 shutdown_connections 2024-09-13T18:52:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2a0066730 0x7ff2a0068bf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c415c260 0x7ff2c4152af0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2c40cf380 0x7ff2c40aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 --2- 172.21.15.81:0/867521341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2c40ccd20 0x7ff2c40ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 >> 172.21.15.81:0/867521341 conn(0x7ff2c40b20b0 msgr2=0x7ff2c4070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 shutdown_connections 2024-09-13T18:52:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.791+0000 7ff2c9c00700 1 -- 172.21.15.81:0/867521341 wait complete. 2024-09-13T18:52:45.820 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:52:45.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:52:45.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 Processor -- start 2024-09-13T18:52:45.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 -- start start 2024-09-13T18:52:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f47841446c0 0x7f47840b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47840cfcf0 0x7f47840cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47840b4d10 con 0x7f47840cc650 2024-09-13T18:52:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4784144aa0 con 0x7f47841446c0 2024-09-13T18:52:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4789600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47840b4100 con 0x7f47840cfcf0 2024-09-13T18:52:45.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4783400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f47840cc650 0x7f47840d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41986/0 (socket says 172.21.15.81:41986) 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4783400700 1 -- 172.21.15.81:0/1049150026 learned_addr learned my addr 172.21.15.81:0/1049150026 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.983+0000 7f4782a00700 1 --2- 172.21.15.81:0/1049150026 >> v2:172.21.15.81:3300/0 conn(0x7f47841446c0 0x7f47840b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782000700 1 --2- 172.21.15.81:0/1049150026 >> v2:172.21.15.178:3300/0 conn(0x7f47840cfcf0 0x7f47840cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4781600700 1 -- 172.21.15.81:0/1049150026 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211478550 0 0) 0x7f47840b4d10 con 0x7f47840cc650 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4781600700 1 -- 172.21.15.81:0/1049150026 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47680035d0 con 0x7f47840cc650 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782a00700 1 -- 172.21.15.81:0/1049150026 >> v2:172.21.15.178:3300/0 conn(0x7f47840cfcf0 msgr2=0x7f47840cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782a00700 1 --2- 172.21.15.81:0/1049150026 >> v2:172.21.15.178:3300/0 conn(0x7f47840cfcf0 0x7f47840cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782a00700 1 -- 172.21.15.81:0/1049150026 >> v1:172.21.15.81:6789/0 conn(0x7f47840cc650 legacy=0x7f47840d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782a00700 1 -- 172.21.15.81:0/1049150026 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47840b43e0 con 0x7f47841446c0 2024-09-13T18:52:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782000700 1 --2- 172.21.15.81:0/1049150026 >> v2:172.21.15.178:3300/0 conn(0x7f47840cfcf0 0x7f47840cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4782a00700 1 --2- 172.21.15.81:0/1049150026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47841446c0 0x7f47840b3a70 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f478415e7d0 tx=0x7f4774009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf207f158099ee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4781600700 1 -- 172.21.15.81:0/1049150026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774011830 con 0x7f47841446c0 2024-09-13T18:52:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4781600700 1 -- 172.21.15.81:0/1049150026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774011990 con 0x7f47841446c0 2024-09-13T18:52:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4781600700 1 -- 172.21.15.81:0/1049150026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774011d20 con 0x7f47841446c0 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 -- 172.21.15.81:0/1049150026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47841446c0 msgr2=0x7f47840b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 --2- 172.21.15.81:0/1049150026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47841446c0 0x7f47840b3a70 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f478415e7d0 tx=0x7f4774009b30 comp rx=0 tx=0).stop 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 -- 172.21.15.81:0/1049150026 shutdown_connections 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 --2- 172.21.15.81:0/1049150026 >> v2:172.21.15.178:3300/0 conn(0x7f47840cfcf0 0x7f47840cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 --2- 172.21.15.81:0/1049150026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47841446c0 0x7f47840b3a70 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 -- 172.21.15.81:0/1049150026 >> 172.21.15.81:0/1049150026 conn(0x7f47840726d0 msgr2=0x7f478406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 -- 172.21.15.81:0/1049150026 shutdown_connections 2024-09-13T18:52:45.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.987+0000 7f4789600700 1 -- 172.21.15.81:0/1049150026 wait complete. 2024-09-13T18:52:45.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 Processor -- start 2024-09-13T18:52:45.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 -- start start 2024-09-13T18:52:46.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840cc650 0x7f47841400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:46.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 0x7f478415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47841446c0 0x7f47840ca4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478415e5a0 con 0x7f47840cfcf0 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784140770 con 0x7f47840cc650 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4789600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784140a50 con 0x7f47841446c0 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 0x7f478415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 0x7f478415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60092/0 (socket says 172.21.15.81:60092) 2024-09-13T18:52:46.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 -- 172.21.15.81:0/3540407858 learned_addr learned my addr 172.21.15.81:0/3540407858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782a00700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840cc650 0x7f47841400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4783400700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47841446c0 0x7f47840ca4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 -- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47841446c0 msgr2=0x7f47840ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47841446c0 0x7f47840ca4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 -- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840cc650 msgr2=0x7f47841400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840cc650 0x7f47841400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782000700 1 -- 172.21.15.81:0/3540407858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700094b0 con 0x7f47840cfcf0 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4782a00700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840cc650 0x7f47841400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.991+0000 7f4783400700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47841446c0 0x7f47840ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f4782000700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 0x7f478415e060 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f477000ebe0 tx=0x7f4770009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000c910 con 0x7f47840cfcf0 2024-09-13T18:52:46.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000ca70 con 0x7f47840cfcf0 2024-09-13T18:52:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47740094b0 con 0x7f47840cfcf0 2024-09-13T18:52:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000ce00 con 0x7f47840cfcf0 2024-09-13T18:52:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784141010 con 0x7f47840cfcf0 2024-09-13T18:52:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47840cc110 con 0x7f47840cfcf0 2024-09-13T18:52:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.995+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4770013470 con 0x7f47840cfcf0 2024-09-13T18:52:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.999+0000 7f477aa00700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4764066730 0x7f4764068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.999+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4770084520 con 0x7f47840cfcf0 2024-09-13T18:52:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.999+0000 7f4782a00700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4764066730 0x7f4764068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:45.999+0000 7f4782a00700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4764066730 0x7f4764068bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4774000c00 tx=0x7f4774008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:46.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.003+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f47700516b0 con 0x7f47840cfcf0 2024-09-13T18:52:46.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.187+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47840b49a0 con 0x7f4764066730 2024-09-13T18:52:46.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.203+0000 7f477aa00700 1 -- 172.21.15.81:0/3540407858 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286831 (secure 0 0 0) 0x7f4774011c00 con 0x7f4764066730 2024-09-13T18:52:46.217 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.211+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4764066730 msgr2=0x7f4764068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.211+0000 7f4789600700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4764066730 0x7f4764068bf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4774000c00 tx=0x7f4774008030 comp rx=0 tx=0).stop 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.211+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 msgr2=0x7f478415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.211+0000 7f4789600700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 0x7f478415e060 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f477000ebe0 tx=0x7f4770009ed0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 shutdown_connections 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4764066730 0x7f4764068bf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47841446c0 0x7f47840ca4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47840cfcf0 0x7f478415e060 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 --2- 172.21.15.81:0/3540407858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840cc650 0x7f47841400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 >> 172.21.15.81:0/3540407858 conn(0x7f47840726d0 msgr2=0x7f47840ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:46.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 shutdown_connections 2024-09-13T18:52:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:46.215+0000 7f4789600700 1 -- 172.21.15.81:0/3540407858 wait complete. 2024-09-13T18:52:46.224 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:52:46.244 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-13T18:52:45.080929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253800,"kb_used_data":8920,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754720920,"statfs":{"total":773094113280,"available":772834222080,"internally_reserved":0,"allocated":9134080,"data_stored":4794252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001419"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.033709+0000","last_change":"2024-09-13T18:52:40.029730+0000","last_active":"2024-09-13T18:52:40.033709+0000","last_peered":"2024-09-13T18:52:40.033709+0000","last_clean":"2024-09-13T18:52:40.033709+0000","last_became_active":"2024-09-13T18:52:40.029484+0000","last_became_peered":"2024-09-13T18:52:40.029484+0000","last_unstale":"2024-09-13T18:52:40.033709+0000","last_undegraded":"2024-09-13T18:52:40.033709+0000","last_fullsized":"2024-09-13T18:52:40.033709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:05.838347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005020+0000","last_change":"2024-09-13T18:52:40.032994+0000","last_active":"2024-09-13T18:52:41.005020+0000","last_peered":"2024-09-13T18:52:41.005020+0000","last_clean":"2024-09-13T18:52:41.005020+0000","last_became_active":"2024-09-13T18:52:40.027610+0000","last_became_peered":"2024-09-13T18:52:40.027610+0000","last_unstale":"2024-09-13T18:52:41.005020+0000","last_undegraded":"2024-09-13T18:52:41.005020+0000","last_fullsized":"2024-09-13T18:52:41.005020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:28.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.031667+0000","last_change":"2024-09-13T18:52:40.018034+0000","last_active":"2024-09-13T18:52:40.031667+0000","last_peered":"2024-09-13T18:52:40.031667+0000","last_clean":"2024-09-13T18:52:40.031667+0000","last_became_active":"2024-09-13T18:52:40.017770+0000","last_became_peered":"2024-09-13T18:52:40.017770+0000","last_unstale":"2024-09-13T18:52:40.031667+0000","last_undegraded":"2024-09-13T18:52:40.031667+0000","last_fullsized":"2024-09-13T18:52:40.031667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037913+0000","last_change":"2024-09-13T18:52:40.022083+0000","last_active":"2024-09-13T18:52:41.037913+0000","last_peered":"2024-09-13T18:52:41.037913+0000","last_clean":"2024-09-13T18:52:41.037913+0000","last_became_active":"2024-09-13T18:52:40.021751+0000","last_became_peered":"2024-09-13T18:52:40.021751+0000","last_unstale":"2024-09-13T18:52:41.037913+0000","last_undegraded":"2024-09-13T18:52:41.037913+0000","last_fullsized":"2024-09-13T18:52:41.037913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.451244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003132+0000","last_change":"2024-09-13T18:52:40.021848+0000","last_active":"2024-09-13T18:52:41.003132+0000","last_peered":"2024-09-13T18:52:41.003132+0000","last_clean":"2024-09-13T18:52:41.003132+0000","last_became_active":"2024-09-13T18:52:40.021518+0000","last_became_peered":"2024-09-13T18:52:40.021518+0000","last_unstale":"2024-09-13T18:52:41.003132+0000","last_undegraded":"2024-09-13T18:52:41.003132+0000","last_fullsized":"2024-09-13T18:52:41.003132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:37.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004846+0000","last_change":"2024-09-13T18:52:40.022619+0000","last_active":"2024-09-13T18:52:41.004846+0000","last_peered":"2024-09-13T18:52:41.004846+0000","last_clean":"2024-09-13T18:52:41.004846+0000","last_became_active":"2024-09-13T18:52:40.021024+0000","last_became_peered":"2024-09-13T18:52:40.021024+0000","last_unstale":"2024-09-13T18:52:41.004846+0000","last_undegraded":"2024-09-13T18:52:41.004846+0000","last_fullsized":"2024-09-13T18:52:41.004846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:18.392542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030178+0000","last_change":"2024-09-13T18:52:40.021133+0000","last_active":"2024-09-13T18:52:40.030178+0000","last_peered":"2024-09-13T18:52:40.030178+0000","last_clean":"2024-09-13T18:52:40.030178+0000","last_became_active":"2024-09-13T18:52:40.020869+0000","last_became_peered":"2024-09-13T18:52:40.020869+0000","last_unstale":"2024-09-13T18:52:40.030178+0000","last_undegraded":"2024-09-13T18:52:40.030178+0000","last_fullsized":"2024-09-13T18:52:40.030178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:45.206606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.002976+0000","last_change":"2024-09-13T18:52:40.022054+0000","last_active":"2024-09-13T18:52:41.002976+0000","last_peered":"2024-09-13T18:52:41.002976+0000","last_clean":"2024-09-13T18:52:41.002976+0000","last_became_active":"2024-09-13T18:52:40.021712+0000","last_became_peered":"2024-09-13T18:52:40.021712+0000","last_unstale":"2024-09-13T18:52:41.002976+0000","last_undegraded":"2024-09-13T18:52:41.002976+0000","last_fullsized":"2024-09-13T18:52:41.002976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:56.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.033368+0000","last_change":"2024-09-13T18:52:40.029657+0000","last_active":"2024-09-13T18:52:40.033368+0000","last_peered":"2024-09-13T18:52:40.033368+0000","last_clean":"2024-09-13T18:52:40.033368+0000","last_became_active":"2024-09-13T18:52:40.029365+0000","last_became_peered":"2024-09-13T18:52:40.029365+0000","last_unstale":"2024-09-13T18:52:40.033368+0000","last_undegraded":"2024-09-13T18:52:40.033368+0000","last_fullsized":"2024-09-13T18:52:40.033368+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:49.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038039+0000","last_change":"2024-09-13T18:52:40.022820+0000","last_active":"2024-09-13T18:52:41.038039+0000","last_peered":"2024-09-13T18:52:41.038039+0000","last_clean":"2024-09-13T18:52:41.038039+0000","last_became_active":"2024-09-13T18:52:40.022523+0000","last_became_peered":"2024-09-13T18:52:40.022523+0000","last_unstale":"2024-09-13T18:52:41.038039+0000","last_undegraded":"2024-09-13T18:52:41.038039+0000","last_fullsized":"2024-09-13T18:52:41.038039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:55.771407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004756+0000","last_change":"2024-09-13T18:52:40.027341+0000","last_active":"2024-09-13T18:52:41.004756+0000","last_peered":"2024-09-13T18:52:41.004756+0000","last_clean":"2024-09-13T18:52:41.004756+0000","last_became_active":"2024-09-13T18:52:40.027105+0000","last_became_peered":"2024-09-13T18:52:40.027105+0000","last_unstale":"2024-09-13T18:52:41.004756+0000","last_undegraded":"2024-09-13T18:52:41.004756+0000","last_fullsized":"2024-09-13T18:52:41.004756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:44.732130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037925+0000","last_change":"2024-09-13T18:52:40.021363+0000","last_active":"2024-09-13T18:52:41.037925+0000","last_peered":"2024-09-13T18:52:41.037925+0000","last_clean":"2024-09-13T18:52:41.037925+0000","last_became_active":"2024-09-13T18:52:40.019817+0000","last_became_peered":"2024-09-13T18:52:40.019817+0000","last_unstale":"2024-09-13T18:52:41.037925+0000","last_undegraded":"2024-09-13T18:52:41.037925+0000","last_fullsized":"2024-09-13T18:52:41.037925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003464+0000","last_change":"2024-09-13T18:52:40.026377+0000","last_active":"2024-09-13T18:52:41.003464+0000","last_peered":"2024-09-13T18:52:41.003464+0000","last_clean":"2024-09-13T18:52:41.003464+0000","last_became_active":"2024-09-13T18:52:40.026109+0000","last_became_peered":"2024-09-13T18:52:40.026109+0000","last_unstale":"2024-09-13T18:52:41.003464+0000","last_undegraded":"2024-09-13T18:52:41.003464+0000","last_fullsized":"2024-09-13T18:52:41.003464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.014272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004958+0000","last_change":"2024-09-13T18:52:40.019135+0000","last_active":"2024-09-13T18:52:41.004958+0000","last_peered":"2024-09-13T18:52:41.004958+0000","last_clean":"2024-09-13T18:52:41.004958+0000","last_became_active":"2024-09-13T18:52:40.018751+0000","last_became_peered":"2024-09-13T18:52:40.018751+0000","last_unstale":"2024-09-13T18:52:41.004958+0000","last_undegraded":"2024-09-13T18:52:41.004958+0000","last_fullsized":"2024-09-13T18:52:41.004958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:40.178964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004367+0000","last_change":"2024-09-13T18:52:40.017029+0000","last_active":"2024-09-13T18:52:41.004367+0000","last_peered":"2024-09-13T18:52:41.004367+0000","last_clean":"2024-09-13T18:52:41.004367+0000","last_became_active":"2024-09-13T18:52:40.016050+0000","last_became_peered":"2024-09-13T18:52:40.016050+0000","last_unstale":"2024-09-13T18:52:41.004367+0000","last_undegraded":"2024-09-13T18:52:41.004367+0000","last_fullsized":"2024-09-13T18:52:41.004367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:18.392542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.037267+0000","last_change":"2024-09-13T18:52:40.036388+0000","last_active":"2024-09-13T18:52:40.037267+0000","last_peered":"2024-09-13T18:52:40.037267+0000","last_clean":"2024-09-13T18:52:40.037267+0000","last_became_active":"2024-09-13T18:52:40.036023+0000","last_became_peered":"2024-09-13T18:52:40.036023+0000","last_unstale":"2024-09-13T18:52:40.037267+0000","last_undegraded":"2024-09-13T18:52:40.037267+0000","last_fullsized":"2024-09-13T18:52:40.037267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:00.157204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004116+0000","last_change":"2024-09-13T18:52:40.024542+0000","last_active":"2024-09-13T18:52:41.004116+0000","last_peered":"2024-09-13T18:52:41.004116+0000","last_clean":"2024-09-13T18:52:41.004116+0000","last_became_active":"2024-09-13T18:52:40.024304+0000","last_became_peered":"2024-09-13T18:52:40.024304+0000","last_unstale":"2024-09-13T18:52:41.004116+0000","last_undegraded":"2024-09-13T18:52:41.004116+0000","last_fullsized":"2024-09-13T18:52:41.004116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:56.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034810+0000","last_change":"2024-09-13T18:52:40.022797+0000","last_active":"2024-09-13T18:52:40.034810+0000","last_peered":"2024-09-13T18:52:40.034810+0000","last_clean":"2024-09-13T18:52:40.034810+0000","last_became_active":"2024-09-13T18:52:40.022578+0000","last_became_peered":"2024-09-13T18:52:40.022578+0000","last_unstale":"2024-09-13T18:52:40.034810+0000","last_undegraded":"2024-09-13T18:52:40.034810+0000","last_fullsized":"2024-09-13T18:52:40.034810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:55.771407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005380+0000","last_change":"2024-09-13T18:52:40.026751+0000","last_active":"2024-09-13T18:52:41.005380+0000","last_peered":"2024-09-13T18:52:41.005380+0000","last_clean":"2024-09-13T18:52:41.005380+0000","last_became_active":"2024-09-13T18:52:40.026525+0000","last_became_peered":"2024-09-13T18:52:40.026525+0000","last_unstale":"2024-09-13T18:52:41.005380+0000","last_undegraded":"2024-09-13T18:52:41.005380+0000","last_fullsized":"2024-09-13T18:52:41.005380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:12.433472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003444+0000","last_change":"2024-09-13T18:52:40.026350+0000","last_active":"2024-09-13T18:52:41.003444+0000","last_peered":"2024-09-13T18:52:41.003444+0000","last_clean":"2024-09-13T18:52:41.003444+0000","last_became_active":"2024-09-13T18:52:40.026061+0000","last_became_peered":"2024-09-13T18:52:40.026061+0000","last_unstale":"2024-09-13T18:52:41.003444+0000","last_undegraded":"2024-09-13T18:52:41.003444+0000","last_fullsized":"2024-09-13T18:52:41.003444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:37.233263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.032515+0000","last_change":"2024-09-13T18:52:40.027813+0000","last_active":"2024-09-13T18:52:40.032515+0000","last_peered":"2024-09-13T18:52:40.032515+0000","last_clean":"2024-09-13T18:52:40.032515+0000","last_became_active":"2024-09-13T18:52:40.027086+0000","last_became_peered":"2024-09-13T18:52:40.027086+0000","last_unstale":"2024-09-13T18:52:40.032515+0000","last_undegraded":"2024-09-13T18:52:40.032515+0000","last_fullsized":"2024-09-13T18:52:40.032515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:28.250958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005473+0000","last_change":"2024-09-13T18:52:40.025114+0000","last_active":"2024-09-13T18:52:41.005473+0000","last_peered":"2024-09-13T18:52:41.005473+0000","last_clean":"2024-09-13T18:52:41.005473+0000","last_became_active":"2024-09-13T18:52:40.024858+0000","last_became_peered":"2024-09-13T18:52:40.024858+0000","last_unstale":"2024-09-13T18:52:41.005473+0000","last_undegraded":"2024-09-13T18:52:41.005473+0000","last_fullsized":"2024-09-13T18:52:41.005473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:56.110356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034208+0000","last_change":"2024-09-13T18:52:40.031138+0000","last_active":"2024-09-13T18:52:40.034208+0000","last_peered":"2024-09-13T18:52:40.034208+0000","last_clean":"2024-09-13T18:52:40.034208+0000","last_became_active":"2024-09-13T18:52:40.030869+0000","last_became_peered":"2024-09-13T18:52:40.030869+0000","last_unstale":"2024-09-13T18:52:40.034208+0000","last_undegraded":"2024-09-13T18:52:40.034208+0000","last_fullsized":"2024-09-13T18:52:40.034208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:56.244802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003112+0000","last_change":"2024-09-13T18:52:40.015588+0000","last_active":"2024-09-13T18:52:41.003112+0000","last_peered":"2024-09-13T18:52:41.003112+0000","last_clean":"2024-09-13T18:52:41.003112+0000","last_became_active":"2024-09-13T18:52:40.015284+0000","last_became_peered":"2024-09-13T18:52:40.015284+0000","last_unstale":"2024-09-13T18:52:41.003112+0000","last_undegraded":"2024-09-13T18:52:41.003112+0000","last_fullsized":"2024-09-13T18:52:41.003112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:53.113817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004527+0000","last_change":"2024-09-13T18:52:40.021142+0000","last_active":"2024-09-13T18:52:41.004527+0000","last_peered":"2024-09-13T18:52:41.004527+0000","last_clean":"2024-09-13T18:52:41.004527+0000","last_became_active":"2024-09-13T18:52:40.020915+0000","last_became_peered":"2024-09-13T18:52:40.020915+0000","last_unstale":"2024-09-13T18:52:41.004527+0000","last_undegraded":"2024-09-13T18:52:41.004527+0000","last_fullsized":"2024-09-13T18:52:41.004527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:01.129486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038052+0000","last_change":"2024-09-13T18:52:40.030936+0000","last_active":"2024-09-13T18:52:41.038052+0000","last_peered":"2024-09-13T18:52:41.038052+0000","last_clean":"2024-09-13T18:52:41.038052+0000","last_became_active":"2024-09-13T18:52:40.030628+0000","last_became_peered":"2024-09-13T18:52:40.030628+0000","last_unstale":"2024-09-13T18:52:41.038052+0000","last_undegraded":"2024-09-13T18:52:41.038052+0000","last_fullsized":"2024-09-13T18:52:41.038052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.038006+0000","last_change":"2024-09-13T18:52:40.037356+0000","last_active":"2024-09-13T18:52:40.038006+0000","last_peered":"2024-09-13T18:52:40.038006+0000","last_clean":"2024-09-13T18:52:40.038006+0000","last_became_active":"2024-09-13T18:52:40.034877+0000","last_became_peered":"2024-09-13T18:52:40.034877+0000","last_unstale":"2024-09-13T18:52:40.038006+0000","last_undegraded":"2024-09-13T18:52:40.038006+0000","last_fullsized":"2024-09-13T18:52:40.038006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:02.070096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003558+0000","last_change":"2024-09-13T18:52:40.033899+0000","last_active":"2024-09-13T18:52:41.003558+0000","last_peered":"2024-09-13T18:52:41.003558+0000","last_clean":"2024-09-13T18:52:41.003558+0000","last_became_active":"2024-09-13T18:52:40.033659+0000","last_became_peered":"2024-09-13T18:52:40.033659+0000","last_unstale":"2024-09-13T18:52:41.003558+0000","last_undegraded":"2024-09-13T18:52:41.003558+0000","last_fullsized":"2024-09-13T18:52:41.003558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:31.358441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003640+0000","last_change":"2024-09-13T18:52:40.018681+0000","last_active":"2024-09-13T18:52:41.003640+0000","last_peered":"2024-09-13T18:52:41.003640+0000","last_clean":"2024-09-13T18:52:41.003640+0000","last_became_active":"2024-09-13T18:52:40.018435+0000","last_became_peered":"2024-09-13T18:52:40.018435+0000","last_unstale":"2024-09-13T18:52:41.003640+0000","last_undegraded":"2024-09-13T18:52:41.003640+0000","last_fullsized":"2024-09-13T18:52:41.003640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:48.487871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.020812+0000","last_change":"2024-09-13T18:52:40.020252+0000","last_active":"2024-09-13T18:52:40.020812+0000","last_peered":"2024-09-13T18:52:40.020812+0000","last_clean":"2024-09-13T18:52:40.020812+0000","last_became_active":"2024-09-13T18:52:40.018799+0000","last_became_peered":"2024-09-13T18:52:40.018799+0000","last_unstale":"2024-09-13T18:52:40.020812+0000","last_undegraded":"2024-09-13T18:52:40.020812+0000","last_fullsized":"2024-09-13T18:52:40.020812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:40.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.020982+0000","last_change":"2024-09-13T18:52:40.012698+0000","last_active":"2024-09-13T18:52:40.020982+0000","last_peered":"2024-09-13T18:52:40.020982+0000","last_clean":"2024-09-13T18:52:40.020982+0000","last_became_active":"2024-09-13T18:52:40.012408+0000","last_became_peered":"2024-09-13T18:52:40.012408+0000","last_unstale":"2024-09-13T18:52:40.020982+0000","last_undegraded":"2024-09-13T18:52:40.020982+0000","last_fullsized":"2024-09-13T18:52:40.020982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.035828+0000","last_change":"2024-09-13T18:52:40.032890+0000","last_active":"2024-09-13T18:52:40.035828+0000","last_peered":"2024-09-13T18:52:40.035828+0000","last_clean":"2024-09-13T18:52:40.035828+0000","last_became_active":"2024-09-13T18:52:40.029120+0000","last_became_peered":"2024-09-13T18:52:40.029120+0000","last_unstale":"2024-09-13T18:52:40.035828+0000","last_undegraded":"2024-09-13T18:52:40.035828+0000","last_fullsized":"2024-09-13T18:52:40.035828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.033291+0000","last_change":"2024-09-13T18:52:40.020591+0000","last_active":"2024-09-13T18:52:40.033291+0000","last_peered":"2024-09-13T18:52:40.033291+0000","last_clean":"2024-09-13T18:52:40.033291+0000","last_became_active":"2024-09-13T18:52:40.020197+0000","last_became_peered":"2024-09-13T18:52:40.020197+0000","last_unstale":"2024-09-13T18:52:40.033291+0000","last_undegraded":"2024-09-13T18:52:40.033291+0000","last_fullsized":"2024-09-13T18:52:40.033291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004223+0000","last_change":"2024-09-13T18:52:39.541307+0000","last_active":"2024-09-13T18:52:41.004223+0000","last_peered":"2024-09-13T18:52:41.004223+0000","last_clean":"2024-09-13T18:52:41.004223+0000","last_became_active":"2024-09-13T18:52:39.541022+0000","last_became_peered":"2024-09-13T18:52:39.541022+0000","last_unstale":"2024-09-13T18:52:41.004223+0000","last_undegraded":"2024-09-13T18:52:41.004223+0000","last_fullsized":"2024-09-13T18:52:41.004223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:33.093013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004587+0000","last_change":"2024-09-13T18:52:40.028565+0000","last_active":"2024-09-13T18:52:41.004587+0000","last_peered":"2024-09-13T18:52:41.004587+0000","last_clean":"2024-09-13T18:52:41.004587+0000","last_became_active":"2024-09-13T18:52:40.028201+0000","last_became_peered":"2024-09-13T18:52:40.028201+0000","last_unstale":"2024-09-13T18:52:41.004587+0000","last_undegraded":"2024-09-13T18:52:41.004587+0000","last_fullsized":"2024-09-13T18:52:41.004587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:11.059208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.032160+0000","last_change":"2024-09-13T18:52:39.546080+0000","last_active":"2024-09-13T18:52:40.032160+0000","last_peered":"2024-09-13T18:52:40.032160+0000","last_clean":"2024-09-13T18:52:40.032160+0000","last_became_active":"2024-09-13T18:52:39.545824+0000","last_became_peered":"2024-09-13T18:52:39.545824+0000","last_unstale":"2024-09-13T18:52:40.032160+0000","last_undegraded":"2024-09-13T18:52:40.032160+0000","last_fullsized":"2024-09-13T18:52:40.032160+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:13.249946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034179+0000","last_change":"2024-09-13T18:52:40.031046+0000","last_active":"2024-09-13T18:52:40.034179+0000","last_peered":"2024-09-13T18:52:40.034179+0000","last_clean":"2024-09-13T18:52:40.034179+0000","last_became_active":"2024-09-13T18:52:40.030512+0000","last_became_peered":"2024-09-13T18:52:40.030512+0000","last_unstale":"2024-09-13T18:52:40.034179+0000","last_undegraded":"2024-09-13T18:52:40.034179+0000","last_fullsized":"2024-09-13T18:52:40.034179+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:22.267278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.041041+0000","last_change":"2024-09-13T18:52:39.545287+0000","last_active":"2024-09-13T18:52:40.041041+0000","last_peered":"2024-09-13T18:52:40.041041+0000","last_clean":"2024-09-13T18:52:40.041041+0000","last_became_active":"2024-09-13T18:52:39.545044+0000","last_became_peered":"2024-09-13T18:52:39.545044+0000","last_unstale":"2024-09-13T18:52:40.041041+0000","last_undegraded":"2024-09-13T18:52:40.041041+0000","last_fullsized":"2024-09-13T18:52:40.041041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:45.701782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.032360+0000","last_change":"2024-09-13T18:52:40.027538+0000","last_active":"2024-09-13T18:52:40.032360+0000","last_peered":"2024-09-13T18:52:40.032360+0000","last_clean":"2024-09-13T18:52:40.032360+0000","last_became_active":"2024-09-13T18:52:40.026726+0000","last_became_peered":"2024-09-13T18:52:40.026726+0000","last_unstale":"2024-09-13T18:52:40.032360+0000","last_undegraded":"2024-09-13T18:52:40.032360+0000","last_fullsized":"2024-09-13T18:52:40.032360+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:26.857144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034596+0000","last_change":"2024-09-13T18:52:39.543860+0000","last_active":"2024-09-13T18:52:40.034596+0000","last_peered":"2024-09-13T18:52:40.034596+0000","last_clean":"2024-09-13T18:52:40.034596+0000","last_became_active":"2024-09-13T18:52:39.541773+0000","last_became_peered":"2024-09-13T18:52:39.541773+0000","last_unstale":"2024-09-13T18:52:40.034596+0000","last_undegraded":"2024-09-13T18:52:40.034596+0000","last_fullsized":"2024-09-13T18:52:40.034596+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:21.247436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003971+0000","last_change":"2024-09-13T18:52:40.022779+0000","last_active":"2024-09-13T18:52:41.003971+0000","last_peered":"2024-09-13T18:52:41.003971+0000","last_clean":"2024-09-13T18:52:41.003971+0000","last_became_active":"2024-09-13T18:52:40.022487+0000","last_became_peered":"2024-09-13T18:52:40.022487+0000","last_unstale":"2024-09-13T18:52:41.003971+0000","last_undegraded":"2024-09-13T18:52:41.003971+0000","last_fullsized":"2024-09-13T18:52:41.003971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:28.706099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.035199+0000","last_change":"2024-09-13T18:52:39.544408+0000","last_active":"2024-09-13T18:52:40.035199+0000","last_peered":"2024-09-13T18:52:40.035199+0000","last_clean":"2024-09-13T18:52:40.035199+0000","last_became_active":"2024-09-13T18:52:39.544087+0000","last_became_peered":"2024-09-13T18:52:39.544087+0000","last_unstale":"2024-09-13T18:52:40.035199+0000","last_undegraded":"2024-09-13T18:52:40.035199+0000","last_fullsized":"2024-09-13T18:52:40.035199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:10.930248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004876+0000","last_change":"2024-09-13T18:52:40.027106+0000","last_active":"2024-09-13T18:52:41.004876+0000","last_peered":"2024-09-13T18:52:41.004876+0000","last_clean":"2024-09-13T18:52:41.004876+0000","last_became_active":"2024-09-13T18:52:40.026853+0000","last_became_peered":"2024-09-13T18:52:40.026853+0000","last_unstale":"2024-09-13T18:52:41.004876+0000","last_undegraded":"2024-09-13T18:52:41.004876+0000","last_fullsized":"2024-09-13T18:52:41.004876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:40.178964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037616+0000","last_change":"2024-09-13T18:52:39.532353+0000","last_active":"2024-09-13T18:52:41.037616+0000","last_peered":"2024-09-13T18:52:41.037616+0000","last_clean":"2024-09-13T18:52:41.037616+0000","last_became_active":"2024-09-13T18:52:39.532063+0000","last_became_peered":"2024-09-13T18:52:39.532063+0000","last_unstale":"2024-09-13T18:52:41.037616+0000","last_undegraded":"2024-09-13T18:52:41.037616+0000","last_fullsized":"2024-09-13T18:52:41.037616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:27.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.039381+0000","last_change":"2024-09-13T18:52:40.036086+0000","last_active":"2024-09-13T18:52:40.039381+0000","last_peered":"2024-09-13T18:52:40.039381+0000","last_clean":"2024-09-13T18:52:40.039381+0000","last_became_active":"2024-09-13T18:52:40.035775+0000","last_became_peered":"2024-09-13T18:52:40.035775+0000","last_unstale":"2024-09-13T18:52:40.039381+0000","last_undegraded":"2024-09-13T18:52:40.039381+0000","last_fullsized":"2024-09-13T18:52:40.039381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:49.521172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004778+0000","last_change":"2024-09-13T18:52:39.535896+0000","last_active":"2024-09-13T18:52:41.004778+0000","last_peered":"2024-09-13T18:52:41.004778+0000","last_clean":"2024-09-13T18:52:41.004778+0000","last_became_active":"2024-09-13T18:52:39.535644+0000","last_became_peered":"2024-09-13T18:52:39.535644+0000","last_unstale":"2024-09-13T18:52:41.004778+0000","last_undegraded":"2024-09-13T18:52:41.004778+0000","last_fullsized":"2024-09-13T18:52:41.004778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:00.037544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.037474+0000","last_change":"2024-09-13T18:52:40.033847+0000","last_active":"2024-09-13T18:52:40.037474+0000","last_peered":"2024-09-13T18:52:40.037474+0000","last_clean":"2024-09-13T18:52:40.037474+0000","last_became_active":"2024-09-13T18:52:40.032945+0000","last_became_peered":"2024-09-13T18:52:40.032945+0000","last_unstale":"2024-09-13T18:52:40.037474+0000","last_undegraded":"2024-09-13T18:52:40.037474+0000","last_fullsized":"2024-09-13T18:52:40.037474+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:24.210675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.002899+0000","last_change":"2024-09-13T18:52:39.532901+0000","last_active":"2024-09-13T18:52:41.002899+0000","last_peered":"2024-09-13T18:52:41.002899+0000","last_clean":"2024-09-13T18:52:41.002899+0000","last_became_active":"2024-09-13T18:52:39.532359+0000","last_became_peered":"2024-09-13T18:52:39.532359+0000","last_unstale":"2024-09-13T18:52:41.002899+0000","last_undegraded":"2024-09-13T18:52:41.002899+0000","last_fullsized":"2024-09-13T18:52:41.002899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:01.520449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003112+0000","last_change":"2024-09-13T18:52:40.032203+0000","last_active":"2024-09-13T18:52:41.003112+0000","last_peered":"2024-09-13T18:52:41.003112+0000","last_clean":"2024-09-13T18:52:41.003112+0000","last_became_active":"2024-09-13T18:52:40.030193+0000","last_became_peered":"2024-09-13T18:52:40.030193+0000","last_unstale":"2024-09-13T18:52:41.003112+0000","last_undegraded":"2024-09-13T18:52:41.003112+0000","last_fullsized":"2024-09-13T18:52:41.003112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:19.520520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.010417+0000","last_change":"2024-09-13T18:52:39.546410+0000","last_active":"2024-09-13T18:52:40.010417+0000","last_peered":"2024-09-13T18:52:40.010417+0000","last_clean":"2024-09-13T18:52:40.010417+0000","last_became_active":"2024-09-13T18:52:39.546068+0000","last_became_peered":"2024-09-13T18:52:39.546068+0000","last_unstale":"2024-09-13T18:52:40.010417+0000","last_undegraded":"2024-09-13T18:52:40.010417+0000","last_fullsized":"2024-09-13T18:52:40.010417+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:48.820175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037765+0000","last_change":"2024-09-13T18:52:40.023116+0000","last_active":"2024-09-13T18:52:41.037765+0000","last_peered":"2024-09-13T18:52:41.037765+0000","last_clean":"2024-09-13T18:52:41.037765+0000","last_became_active":"2024-09-13T18:52:40.019937+0000","last_became_peered":"2024-09-13T18:52:40.019937+0000","last_unstale":"2024-09-13T18:52:41.037765+0000","last_undegraded":"2024-09-13T18:52:41.037765+0000","last_fullsized":"2024-09-13T18:52:41.037765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:54.129432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038228+0000","last_change":"2024-09-13T18:52:39.538805+0000","last_active":"2024-09-13T18:52:41.038228+0000","last_peered":"2024-09-13T18:52:41.038228+0000","last_clean":"2024-09-13T18:52:41.038228+0000","last_became_active":"2024-09-13T18:52:39.538559+0000","last_became_peered":"2024-09-13T18:52:39.538559+0000","last_unstale":"2024-09-13T18:52:41.038228+0000","last_undegraded":"2024-09-13T18:52:41.038228+0000","last_fullsized":"2024-09-13T18:52:41.038228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:32.427374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005124+0000","last_change":"2024-09-13T18:52:40.017406+0000","last_active":"2024-09-13T18:52:41.005124+0000","last_peered":"2024-09-13T18:52:41.005124+0000","last_clean":"2024-09-13T18:52:41.005124+0000","last_became_active":"2024-09-13T18:52:40.017141+0000","last_became_peered":"2024-09-13T18:52:40.017141+0000","last_unstale":"2024-09-13T18:52:41.005124+0000","last_undegraded":"2024-09-13T18:52:41.005124+0000","last_fullsized":"2024-09-13T18:52:41.005124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:28.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003963+0000","last_change":"2024-09-13T18:52:39.542990+0000","last_active":"2024-09-13T18:52:41.003963+0000","last_peered":"2024-09-13T18:52:41.003963+0000","last_clean":"2024-09-13T18:52:41.003963+0000","last_became_active":"2024-09-13T18:52:39.542713+0000","last_became_peered":"2024-09-13T18:52:39.542713+0000","last_unstale":"2024-09-13T18:52:41.003963+0000","last_undegraded":"2024-09-13T18:52:41.003963+0000","last_fullsized":"2024-09-13T18:52:41.003963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:49.356635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030942+0000","last_change":"2024-09-13T18:52:40.016130+0000","last_active":"2024-09-13T18:52:40.030942+0000","last_peered":"2024-09-13T18:52:40.030942+0000","last_clean":"2024-09-13T18:52:40.030942+0000","last_became_active":"2024-09-13T18:52:40.015890+0000","last_became_peered":"2024-09-13T18:52:40.015890+0000","last_unstale":"2024-09-13T18:52:40.030942+0000","last_undegraded":"2024-09-13T18:52:40.030942+0000","last_fullsized":"2024-09-13T18:52:40.030942+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.041909+0000","last_change":"2024-09-13T18:52:39.545495+0000","last_active":"2024-09-13T18:52:40.041909+0000","last_peered":"2024-09-13T18:52:40.041909+0000","last_clean":"2024-09-13T18:52:40.041909+0000","last_became_active":"2024-09-13T18:52:39.544651+0000","last_became_peered":"2024-09-13T18:52:39.544651+0000","last_unstale":"2024-09-13T18:52:40.041909+0000","last_undegraded":"2024-09-13T18:52:40.041909+0000","last_fullsized":"2024-09-13T18:52:40.041909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:48.501330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038158+0000","last_change":"2024-09-13T18:52:40.021201+0000","last_active":"2024-09-13T18:52:41.038158+0000","last_peered":"2024-09-13T18:52:41.038158+0000","last_clean":"2024-09-13T18:52:41.038158+0000","last_became_active":"2024-09-13T18:52:40.019481+0000","last_became_peered":"2024-09-13T18:52:40.019481+0000","last_unstale":"2024-09-13T18:52:41.038158+0000","last_undegraded":"2024-09-13T18:52:41.038158+0000","last_fullsized":"2024-09-13T18:52:41.038158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037637+0000","last_change":"2024-09-13T18:52:39.542541+0000","last_active":"2024-09-13T18:52:41.037637+0000","last_peered":"2024-09-13T18:52:41.037637+0000","last_clean":"2024-09-13T18:52:41.037637+0000","last_became_active":"2024-09-13T18:52:39.542210+0000","last_became_peered":"2024-09-13T18:52:39.542210+0000","last_unstale":"2024-09-13T18:52:41.037637+0000","last_undegraded":"2024-09-13T18:52:41.037637+0000","last_fullsized":"2024-09-13T18:52:41.037637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:55.224960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.031377+0000","last_change":"2024-09-13T18:52:40.020712+0000","last_active":"2024-09-13T18:52:40.031377+0000","last_peered":"2024-09-13T18:52:40.031377+0000","last_clean":"2024-09-13T18:52:40.031377+0000","last_became_active":"2024-09-13T18:52:40.020425+0000","last_became_peered":"2024-09-13T18:52:40.020425+0000","last_unstale":"2024-09-13T18:52:40.031377+0000","last_undegraded":"2024-09-13T18:52:40.031377+0000","last_fullsized":"2024-09-13T18:52:40.031377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.451244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.009833+0000","last_change":"2024-09-13T18:52:39.548526+0000","last_active":"2024-09-13T18:52:40.009833+0000","last_peered":"2024-09-13T18:52:40.009833+0000","last_clean":"2024-09-13T18:52:40.009833+0000","last_became_active":"2024-09-13T18:52:39.548234+0000","last_became_peered":"2024-09-13T18:52:39.548234+0000","last_unstale":"2024-09-13T18:52:40.009833+0000","last_undegraded":"2024-09-13T18:52:40.009833+0000","last_fullsized":"2024-09-13T18:52:40.009833+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:48.501330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034319+0000","last_change":"2024-09-13T18:52:40.030393+0000","last_active":"2024-09-13T18:52:40.034319+0000","last_peered":"2024-09-13T18:52:40.034319+0000","last_clean":"2024-09-13T18:52:40.034319+0000","last_became_active":"2024-09-13T18:52:40.030085+0000","last_became_peered":"2024-09-13T18:52:40.030085+0000","last_unstale":"2024-09-13T18:52:40.034319+0000","last_undegraded":"2024-09-13T18:52:40.034319+0000","last_fullsized":"2024-09-13T18:52:40.034319+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003121+0000","last_change":"2024-09-13T18:52:39.539365+0000","last_active":"2024-09-13T18:52:41.003121+0000","last_peered":"2024-09-13T18:52:41.003121+0000","last_clean":"2024-09-13T18:52:41.003121+0000","last_became_active":"2024-09-13T18:52:39.539007+0000","last_became_peered":"2024-09-13T18:52:39.539007+0000","last_unstale":"2024-09-13T18:52:41.003121+0000","last_undegraded":"2024-09-13T18:52:41.003121+0000","last_fullsized":"2024-09-13T18:52:41.003121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:31.623095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030279+0000","last_change":"2024-09-13T18:52:40.024066+0000","last_active":"2024-09-13T18:52:40.030279+0000","last_peered":"2024-09-13T18:52:40.030279+0000","last_clean":"2024-09-13T18:52:40.030279+0000","last_became_active":"2024-09-13T18:52:40.023836+0000","last_became_peered":"2024-09-13T18:52:40.023836+0000","last_unstale":"2024-09-13T18:52:40.030279+0000","last_undegraded":"2024-09-13T18:52:40.030279+0000","last_fullsized":"2024-09-13T18:52:40.030279+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003900+0000","last_change":"2024-09-13T18:52:39.539929+0000","last_active":"2024-09-13T18:52:41.003900+0000","last_peered":"2024-09-13T18:52:41.003900+0000","last_clean":"2024-09-13T18:52:41.003900+0000","last_became_active":"2024-09-13T18:52:39.539691+0000","last_became_peered":"2024-09-13T18:52:39.539691+0000","last_unstale":"2024-09-13T18:52:41.003900+0000","last_undegraded":"2024-09-13T18:52:41.003900+0000","last_fullsized":"2024-09-13T18:52:41.003900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:45.703277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004701+0000","last_change":"2024-09-13T18:52:40.020096+0000","last_active":"2024-09-13T18:52:41.004701+0000","last_peered":"2024-09-13T18:52:41.004701+0000","last_clean":"2024-09-13T18:52:41.004701+0000","last_became_active":"2024-09-13T18:52:40.019628+0000","last_became_peered":"2024-09-13T18:52:40.019628+0000","last_unstale":"2024-09-13T18:52:41.004701+0000","last_undegraded":"2024-09-13T18:52:41.004701+0000","last_fullsized":"2024-09-13T18:52:41.004701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:19.520520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.041416+0000","last_change":"2024-09-13T18:52:39.543154+0000","last_active":"2024-09-13T18:52:40.041416+0000","last_peered":"2024-09-13T18:52:40.041416+0000","last_clean":"2024-09-13T18:52:40.041416+0000","last_became_active":"2024-09-13T18:52:39.542135+0000","last_became_peered":"2024-09-13T18:52:39.542135+0000","last_unstale":"2024-09-13T18:52:40.041416+0000","last_undegraded":"2024-09-13T18:52:40.041416+0000","last_fullsized":"2024-09-13T18:52:40.041416+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:06.294664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003353+0000","last_change":"2024-09-13T18:52:40.023125+0000","last_active":"2024-09-13T18:52:41.003353+0000","last_peered":"2024-09-13T18:52:41.003353+0000","last_clean":"2024-09-13T18:52:41.003353+0000","last_became_active":"2024-09-13T18:52:40.022932+0000","last_became_peered":"2024-09-13T18:52:40.022932+0000","last_unstale":"2024-09-13T18:52:41.003353+0000","last_undegraded":"2024-09-13T18:52:41.003353+0000","last_fullsized":"2024-09-13T18:52:41.003353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:14.531571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.039846+0000","last_change":"2024-09-13T18:52:39.544006+0000","last_active":"2024-09-13T18:52:40.039846+0000","last_peered":"2024-09-13T18:52:40.039846+0000","last_clean":"2024-09-13T18:52:40.039846+0000","last_became_active":"2024-09-13T18:52:39.543757+0000","last_became_peered":"2024-09-13T18:52:39.543757+0000","last_unstale":"2024-09-13T18:52:40.039846+0000","last_undegraded":"2024-09-13T18:52:40.039846+0000","last_fullsized":"2024-09-13T18:52:40.039846+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:36.962384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003524+0000","last_change":"2024-09-13T18:52:40.029086+0000","last_active":"2024-09-13T18:52:41.003524+0000","last_peered":"2024-09-13T18:52:41.003524+0000","last_clean":"2024-09-13T18:52:41.003524+0000","last_became_active":"2024-09-13T18:52:40.028814+0000","last_became_peered":"2024-09-13T18:52:40.028814+0000","last_unstale":"2024-09-13T18:52:41.003524+0000","last_undegraded":"2024-09-13T18:52:41.003524+0000","last_fullsized":"2024-09-13T18:52:41.003524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:47.030493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004076+0000","last_change":"2024-09-13T18:52:39.538782+0000","last_active":"2024-09-13T18:52:41.004076+0000","last_peered":"2024-09-13T18:52:41.004076+0000","last_clean":"2024-09-13T18:52:41.004076+0000","last_became_active":"2024-09-13T18:52:39.538507+0000","last_became_peered":"2024-09-13T18:52:39.538507+0000","last_unstale":"2024-09-13T18:52:41.004076+0000","last_undegraded":"2024-09-13T18:52:41.004076+0000","last_fullsized":"2024-09-13T18:52:41.004076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:47.153558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005529+0000","last_change":"2024-09-13T18:52:40.019749+0000","last_active":"2024-09-13T18:52:41.005529+0000","last_peered":"2024-09-13T18:52:41.005529+0000","last_clean":"2024-09-13T18:52:41.005529+0000","last_became_active":"2024-09-13T18:52:40.019423+0000","last_became_peered":"2024-09-13T18:52:40.019423+0000","last_unstale":"2024-09-13T18:52:41.005529+0000","last_undegraded":"2024-09-13T18:52:41.005529+0000","last_fullsized":"2024-09-13T18:52:41.005529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:11.059208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.001059+0000","last_change":"2024-09-13T18:52:39.540750+0000","last_active":"2024-09-13T18:52:40.001059+0000","last_peered":"2024-09-13T18:52:40.001059+0000","last_clean":"2024-09-13T18:52:40.001059+0000","last_became_active":"2024-09-13T18:52:39.540488+0000","last_became_peered":"2024-09-13T18:52:39.540488+0000","last_unstale":"2024-09-13T18:52:40.001059+0000","last_undegraded":"2024-09-13T18:52:40.001059+0000","last_fullsized":"2024-09-13T18:52:40.001059+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:21.247436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004079+0000","last_change":"2024-09-13T18:52:40.030728+0000","last_active":"2024-09-13T18:52:41.004079+0000","last_peered":"2024-09-13T18:52:41.004079+0000","last_clean":"2024-09-13T18:52:41.004079+0000","last_became_active":"2024-09-13T18:52:40.030171+0000","last_became_peered":"2024-09-13T18:52:40.030171+0000","last_unstale":"2024-09-13T18:52:41.004079+0000","last_undegraded":"2024-09-13T18:52:41.004079+0000","last_fullsized":"2024-09-13T18:52:41.004079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:12.433472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005638+0000","last_change":"2024-09-13T18:52:39.527966+0000","last_active":"2024-09-13T18:52:41.005638+0000","last_peered":"2024-09-13T18:52:41.005638+0000","last_clean":"2024-09-13T18:52:41.005638+0000","last_became_active":"2024-09-13T18:52:39.527700+0000","last_became_peered":"2024-09-13T18:52:39.527700+0000","last_unstale":"2024-09-13T18:52:41.005638+0000","last_undegraded":"2024-09-13T18:52:41.005638+0000","last_fullsized":"2024-09-13T18:52:41.005638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:25.777609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005106+0000","last_change":"2024-09-13T18:52:40.031203+0000","last_active":"2024-09-13T18:52:41.005106+0000","last_peered":"2024-09-13T18:52:41.005106+0000","last_clean":"2024-09-13T18:52:41.005106+0000","last_became_active":"2024-09-13T18:52:40.030981+0000","last_became_peered":"2024-09-13T18:52:40.030981+0000","last_unstale":"2024-09-13T18:52:41.005106+0000","last_undegraded":"2024-09-13T18:52:41.005106+0000","last_fullsized":"2024-09-13T18:52:41.005106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:45.859207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004891+0000","last_change":"2024-09-13T18:52:39.544025+0000","last_active":"2024-09-13T18:52:41.004891+0000","last_peered":"2024-09-13T18:52:41.004891+0000","last_clean":"2024-09-13T18:52:41.004891+0000","last_became_active":"2024-09-13T18:52:39.541730+0000","last_became_peered":"2024-09-13T18:52:39.541730+0000","last_unstale":"2024-09-13T18:52:41.004891+0000","last_undegraded":"2024-09-13T18:52:41.004891+0000","last_fullsized":"2024-09-13T18:52:41.004891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:41.752738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.037492+0000","last_change":"2024-09-13T18:52:40.034013+0000","last_active":"2024-09-13T18:52:40.037492+0000","last_peered":"2024-09-13T18:52:40.037492+0000","last_clean":"2024-09-13T18:52:40.037492+0000","last_became_active":"2024-09-13T18:52:40.033548+0000","last_became_peered":"2024-09-13T18:52:40.033548+0000","last_unstale":"2024-09-13T18:52:40.037492+0000","last_undegraded":"2024-09-13T18:52:40.037492+0000","last_fullsized":"2024-09-13T18:52:40.037492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004902+0000","last_change":"2024-09-13T18:52:39.542608+0000","last_active":"2024-09-13T18:52:41.004902+0000","last_peered":"2024-09-13T18:52:41.004902+0000","last_clean":"2024-09-13T18:52:41.004902+0000","last_became_active":"2024-09-13T18:52:39.542415+0000","last_became_peered":"2024-09-13T18:52:39.542415+0000","last_unstale":"2024-09-13T18:52:41.004902+0000","last_undegraded":"2024-09-13T18:52:41.004902+0000","last_fullsized":"2024-09-13T18:52:41.004902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:16.120961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.029324+0000","last_change":"2024-09-13T18:52:40.022705+0000","last_active":"2024-09-13T18:52:40.029324+0000","last_peered":"2024-09-13T18:52:40.029324+0000","last_clean":"2024-09-13T18:52:40.029324+0000","last_became_active":"2024-09-13T18:52:40.022449+0000","last_became_peered":"2024-09-13T18:52:40.022449+0000","last_unstale":"2024-09-13T18:52:40.029324+0000","last_undegraded":"2024-09-13T18:52:40.029324+0000","last_fullsized":"2024-09-13T18:52:40.029324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:29.841888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038131+0000","last_change":"2024-09-13T18:52:39.537099+0000","last_active":"2024-09-13T18:52:41.038131+0000","last_peered":"2024-09-13T18:52:41.038131+0000","last_clean":"2024-09-13T18:52:41.038131+0000","last_became_active":"2024-09-13T18:52:39.536543+0000","last_became_peered":"2024-09-13T18:52:39.536543+0000","last_unstale":"2024-09-13T18:52:41.038131+0000","last_undegraded":"2024-09-13T18:52:41.038131+0000","last_fullsized":"2024-09-13T18:52:41.038131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:25.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030198+0000","last_change":"2024-09-13T18:52:40.021255+0000","last_active":"2024-09-13T18:52:40.030198+0000","last_peered":"2024-09-13T18:52:40.030198+0000","last_clean":"2024-09-13T18:52:40.030198+0000","last_became_active":"2024-09-13T18:52:40.020958+0000","last_became_peered":"2024-09-13T18:52:40.020958+0000","last_unstale":"2024-09-13T18:52:40.030198+0000","last_undegraded":"2024-09-13T18:52:40.030198+0000","last_fullsized":"2024-09-13T18:52:40.030198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:54.129432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005115+0000","last_change":"2024-09-13T18:52:39.537992+0000","last_active":"2024-09-13T18:52:41.005115+0000","last_peered":"2024-09-13T18:52:41.005115+0000","last_clean":"2024-09-13T18:52:41.005115+0000","last_became_active":"2024-09-13T18:52:39.537737+0000","last_became_peered":"2024-09-13T18:52:39.537737+0000","last_unstale":"2024-09-13T18:52:41.005115+0000","last_undegraded":"2024-09-13T18:52:41.005115+0000","last_fullsized":"2024-09-13T18:52:41.005115+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:20.658239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.034025+0000","last_change":"2024-09-13T18:52:40.030833+0000","last_active":"2024-09-13T18:52:40.034025+0000","last_peered":"2024-09-13T18:52:40.034025+0000","last_clean":"2024-09-13T18:52:40.034025+0000","last_became_active":"2024-09-13T18:52:40.030125+0000","last_became_peered":"2024-09-13T18:52:40.030125+0000","last_unstale":"2024-09-13T18:52:40.034025+0000","last_undegraded":"2024-09-13T18:52:40.034025+0000","last_fullsized":"2024-09-13T18:52:40.034025+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:40.718943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.009191+0000","last_change":"2024-09-13T18:52:39.540675+0000","last_active":"2024-09-13T18:52:40.009191+0000","last_peered":"2024-09-13T18:52:40.009191+0000","last_clean":"2024-09-13T18:52:40.009191+0000","last_became_active":"2024-09-13T18:52:39.539673+0000","last_became_peered":"2024-09-13T18:52:39.539673+0000","last_unstale":"2024-09-13T18:52:40.009191+0000","last_undegraded":"2024-09-13T18:52:40.009191+0000","last_fullsized":"2024-09-13T18:52:40.009191+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:39.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003749+0000","last_change":"2024-09-13T18:52:40.017262+0000","last_active":"2024-09-13T18:52:41.003749+0000","last_peered":"2024-09-13T18:52:41.003749+0000","last_clean":"2024-09-13T18:52:41.003749+0000","last_became_active":"2024-09-13T18:52:40.017000+0000","last_became_peered":"2024-09-13T18:52:40.017000+0000","last_unstale":"2024-09-13T18:52:41.003749+0000","last_undegraded":"2024-09-13T18:52:41.003749+0000","last_fullsized":"2024-09-13T18:52:41.003749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:36.819884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.010068+0000","last_change":"2024-09-13T18:52:39.547187+0000","last_active":"2024-09-13T18:52:40.010068+0000","last_peered":"2024-09-13T18:52:40.010068+0000","last_clean":"2024-09-13T18:52:40.010068+0000","last_became_active":"2024-09-13T18:52:39.546931+0000","last_became_peered":"2024-09-13T18:52:39.546931+0000","last_unstale":"2024-09-13T18:52:40.010068+0000","last_undegraded":"2024-09-13T18:52:40.010068+0000","last_fullsized":"2024-09-13T18:52:40.010068+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:52.764864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.030288+0000","last_change":"2024-09-13T18:52:40.021631+0000","last_active":"2024-09-13T18:52:40.030288+0000","last_peered":"2024-09-13T18:52:40.030288+0000","last_clean":"2024-09-13T18:52:40.030288+0000","last_became_active":"2024-09-13T18:52:40.021398+0000","last_became_peered":"2024-09-13T18:52:40.021398+0000","last_unstale":"2024-09-13T18:52:40.030288+0000","last_undegraded":"2024-09-13T18:52:40.030288+0000","last_fullsized":"2024-09-13T18:52:40.030288+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.009238+0000","last_change":"2024-09-13T18:52:39.541321+0000","last_active":"2024-09-13T18:52:40.009238+0000","last_peered":"2024-09-13T18:52:40.009238+0000","last_clean":"2024-09-13T18:52:40.009238+0000","last_became_active":"2024-09-13T18:52:39.540219+0000","last_became_peered":"2024-09-13T18:52:39.540219+0000","last_unstale":"2024-09-13T18:52:40.009238+0000","last_undegraded":"2024-09-13T18:52:40.009238+0000","last_fullsized":"2024-09-13T18:52:40.009238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:39.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.036830+0000","last_change":"2024-09-13T18:52:40.032849+0000","last_active":"2024-09-13T18:52:40.036830+0000","last_peered":"2024-09-13T18:52:40.036830+0000","last_clean":"2024-09-13T18:52:40.036830+0000","last_became_active":"2024-09-13T18:52:40.032552+0000","last_became_peered":"2024-09-13T18:52:40.032552+0000","last_unstale":"2024-09-13T18:52:40.036830+0000","last_undegraded":"2024-09-13T18:52:40.036830+0000","last_fullsized":"2024-09-13T18:52:40.036830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:53.136644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003769+0000","last_change":"2024-09-13T18:52:39.539575+0000","last_active":"2024-09-13T18:52:41.003769+0000","last_peered":"2024-09-13T18:52:41.003769+0000","last_clean":"2024-09-13T18:52:41.003769+0000","last_became_active":"2024-09-13T18:52:39.539262+0000","last_became_peered":"2024-09-13T18:52:39.539262+0000","last_unstale":"2024-09-13T18:52:41.003769+0000","last_undegraded":"2024-09-13T18:52:41.003769+0000","last_fullsized":"2024-09-13T18:52:41.003769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:52.358601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.038790+0000","last_change":"2024-09-13T18:52:40.034086+0000","last_active":"2024-09-13T18:52:40.038790+0000","last_peered":"2024-09-13T18:52:40.038790+0000","last_clean":"2024-09-13T18:52:40.038790+0000","last_became_active":"2024-09-13T18:52:40.033070+0000","last_became_peered":"2024-09-13T18:52:40.033070+0000","last_unstale":"2024-09-13T18:52:40.038790+0000","last_undegraded":"2024-09-13T18:52:40.038790+0000","last_fullsized":"2024-09-13T18:52:40.038790+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:05.838347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.008954+0000","last_change":"2024-09-13T18:52:39.541633+0000","last_active":"2024-09-13T18:52:40.008954+0000","last_peered":"2024-09-13T18:52:40.008954+0000","last_clean":"2024-09-13T18:52:40.008954+0000","last_became_active":"2024-09-13T18:52:39.541337+0000","last_became_peered":"2024-09-13T18:52:39.541337+0000","last_unstale":"2024-09-13T18:52:40.008954+0000","last_undegraded":"2024-09-13T18:52:40.008954+0000","last_fullsized":"2024-09-13T18:52:40.008954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.020905+0000","last_change":"2024-09-13T18:52:40.015710+0000","last_active":"2024-09-13T18:52:40.020905+0000","last_peered":"2024-09-13T18:52:40.020905+0000","last_clean":"2024-09-13T18:52:40.020905+0000","last_became_active":"2024-09-13T18:52:40.015468+0000","last_became_peered":"2024-09-13T18:52:40.015468+0000","last_unstale":"2024-09-13T18:52:40.020905+0000","last_undegraded":"2024-09-13T18:52:40.020905+0000","last_fullsized":"2024-09-13T18:52:40.020905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.000774+0000","last_change":"2024-09-13T18:52:39.529014+0000","last_active":"2024-09-13T18:52:40.000774+0000","last_peered":"2024-09-13T18:52:40.000774+0000","last_clean":"2024-09-13T18:52:40.000774+0000","last_became_active":"2024-09-13T18:52:39.528776+0000","last_became_peered":"2024-09-13T18:52:39.528776+0000","last_unstale":"2024-09-13T18:52:40.000774+0000","last_undegraded":"2024-09-13T18:52:40.000774+0000","last_fullsized":"2024-09-13T18:52:40.000774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.027656+0000","last_change":"2024-09-13T18:52:40.023475+0000","last_active":"2024-09-13T18:52:40.027656+0000","last_peered":"2024-09-13T18:52:40.027656+0000","last_clean":"2024-09-13T18:52:40.027656+0000","last_became_active":"2024-09-13T18:52:40.023229+0000","last_became_peered":"2024-09-13T18:52:40.023229+0000","last_unstale":"2024-09-13T18:52:40.027656+0000","last_undegraded":"2024-09-13T18:52:40.027656+0000","last_fullsized":"2024-09-13T18:52:40.027656+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005304+0000","last_change":"2024-09-13T18:52:39.539885+0000","last_active":"2024-09-13T18:52:41.005304+0000","last_peered":"2024-09-13T18:52:41.005304+0000","last_clean":"2024-09-13T18:52:41.005304+0000","last_became_active":"2024-09-13T18:52:39.539653+0000","last_became_peered":"2024-09-13T18:52:39.539653+0000","last_unstale":"2024-09-13T18:52:41.005304+0000","last_undegraded":"2024-09-13T18:52:41.005304+0000","last_fullsized":"2024-09-13T18:52:41.005304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-13T18:52:39.530849+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:52:39.530849+0000","last_peered":"2024-09-13T18:52:39.530849+0000","last_clean":"2024-09-13T18:52:39.530849+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:52:39.530849+0000","last_undegraded":"2024-09-13T18:52:39.530849+0000","last_fullsized":"2024-09-13T18:52:39.530849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1576960,"data_stored":1038179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.76300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.498,"5min":1.72,"15min":1.72},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0780000000000001,"15min":1.1259999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.409,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3520000000000001,"5min":1.619,"15min":1.619},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.1499999999999999,"15min":1.216},"min":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4379999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.089}]},{"osd":2,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2769999999999999,"15min":1.337},"min":{"1min":0.873,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6499999999999999,"5min":1.885,"15min":1.885},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.94499999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4650000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1930000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4810000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3440000000000001,"15min":1.4319999999999999},"min":{"1min":1.0109999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.629,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.2929999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1060000000000001,"15min":1.1140000000000001},"min":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.462,"5min":1.552,"15min":1.552},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.21,"15min":1.1859999999999999},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.46,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.1319999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2509999999999999,"15min":1.3169999999999999},"min":{"1min":0.72999999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.579,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.224},"min":{"1min":0.88400000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.0169999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.401},"min":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.625,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.343},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.385,"15min":1.417},"min":{"1min":1.036,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5860000000000001,"5min":1.845,"15min":1.845},"last":1.0569999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574919,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":991232,"data_stored":449353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.139},"min":{"1min":0.79600000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5049999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1639999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2789999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.2809999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.68700000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5589999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.206},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.385,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.014}]},{"osd":2,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.246,"15min":1.4239999999999999},"min":{"1min":0.77600000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.274,"15min":1.47},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5900000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":1.048}]},{"osd":3,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3340000000000001,"15min":1.496},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5629999999999999,"5min":4.883,"15min":4.883},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3340000000000001,"15min":1.5129999999999999},"min":{"1min":1,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.591,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2030000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5129999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.165,"5min":1.2609999999999999,"15min":1.331},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6240000000000001,"5min":2.077,"15min":2.077},"last":1.141}]},{"osd":5,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3160000000000001,"15min":1.4099999999999999},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.5469999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.4219999999999999,"15min":1.478},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.657,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.3420000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.385,"15min":1.4590000000000001},"min":{"1min":0.876,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4079999999999999,"15min":1.5209999999999999},"min":{"1min":1.0740000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5309999999999999,"5min":2.367,"15min":2.367},"last":1.363}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":454443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.135,"15min":1.159},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4450000000000001,"5min":2.278,"15min":2.278},"last":1.2330000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.91500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5649999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.93899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.212,"15min":1.2809999999999999},"min":{"1min":0.76300000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3999999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.173,"15min":1.252},"min":{"1min":0.81699999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4159999999999999,"5min":2.157,"15min":2.157},"last":0.97299999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.284,"15min":1.369},"min":{"1min":0.85699999999999998,"5min":0.749,"15min":0.749},"max":{"1min":1.6160000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.4319999999999999},"min":{"1min":0.94199999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.569,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.0900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1319999999999999,"15min":1.21},"min":{"1min":0.74399999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.478,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.492},{"interface":"front","average":{"1min":1.202,"5min":1.2350000000000001,"15min":1.2749999999999999},"min":{"1min":0.872,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.613,"5min":1.974,"15min":1.974},"last":1.409}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2569999999999999,"15min":1.2989999999999999},"min":{"1min":0.98099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.494,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.27,"15min":1.3440000000000001},"min":{"1min":0.871,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.601,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.5620000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.391,"15min":1.429},"min":{"1min":1.1879999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6120000000000001,"5min":2.169,"15min":2.169},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4350000000000001,"15min":1.5109999999999999},"min":{"1min":1.1990000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.659,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.47}]}]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":999424,"data_stored":449457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.109,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.502,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.1399999999999999},"min":{"1min":0.84199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2250000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":0.88600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6739999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.002},{"interface":"front","average":{"1min":1.26,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5740000000000001,"5min":2.423,"15min":2.423},"last":1.4390000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.99,"15min":1.99},"last":1.284},{"interface":"front","average":{"1min":1.302,"5min":1.329,"15min":1.381},"min":{"1min":0.99099999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6519999999999999,"5min":2.335,"15min":2.335},"last":1.3100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.22,"15min":1.3049999999999999},"min":{"1min":0.78400000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.573,"5min":2.621,"15min":2.621},"last":1.099},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.206,"15min":1.264},"min":{"1min":0.89400000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3779999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.1779999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1919999999999999,"15min":1.2969999999999999},"min":{"1min":0.80200000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":2.274,"15min":2.274},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2529999999999999,"15min":1.3140000000000001},"min":{"1min":0.91500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.831,"5min":2.266,"15min":2.266},"last":1.4119999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.3480000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5449999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.458},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.6830000000000001,"5min":2.5,"15min":2.5},"last":1.3799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3859999999999999,"15min":1.458},"min":{"1min":1.0029999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7969999999999999,"5min":2.395,"15min":2.395},"last":1.337},{"interface":"front","average":{"1min":1.369,"5min":1.375,"15min":1.4610000000000001},"min":{"1min":0.84199999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.655,"5min":2.415,"15min":2.415},"last":1.3620000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":454991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2969999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85799999999999998,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2889999999999999,"5min":1.444,"15min":1.444},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.72299999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98899999999999999,"15min":1.101},"min":{"1min":0.61299999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":0.81699999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.63700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.145,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4430000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.1950000000000001,"15min":1.2430000000000001},"min":{"1min":1.0369999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5329999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.234},"min":{"1min":0.89300000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.484,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2490000000000001,"15min":1.3149999999999999},"min":{"1min":0.998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5760000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.089},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3080000000000001,"15min":1.3740000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9870000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.2749999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.351,"15min":1.427},"min":{"1min":1.1559999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9239999999999999,"5min":2.714,"15min":2.714},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":0.94599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.72,"5min":2.52,"15min":2.52},"last":1.139}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.363,"15min":1.5089999999999999},"min":{"1min":0.96699999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6719999999999999,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.109},{"interface":"front","average":{"1min":1.349,"5min":1.335,"15min":1.431},"min":{"1min":1.097,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6339999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.3}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1003520,"data_stored":455151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.97699999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.242,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.071},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.874,"15min":1.0429999999999999},"min":{"1min":0.59799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.83399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.92600000000000005,"15min":1.127},"min":{"1min":0.65900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.7350000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.125,"15min":1.23},"min":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.268,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.02}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.3160000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7749999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4730000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":1.171}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3300000000000001,"15min":1.6399999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.421,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3049999999999999,"15min":1.4490000000000001},"min":{"1min":0.95299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.569,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.353,"15min":1.508},"min":{"1min":0.99099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5469999999999999,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.306,"15min":1.482},"min":{"1min":0.89500000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5109999999999999,"5min":4.335,"15min":4.335},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3480000000000001,"15min":1.5349999999999999},"min":{"1min":1.04,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5980000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.3899999999999999,"15min":1.744},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3999999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.232}]},{"osd":7,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.399,"15min":1.5589999999999999},"min":{"1min":1.069,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.4690000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.429,"15min":1.6140000000000001},"min":{"1min":1.145,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.5429999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":987136,"data_stored":447901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81100000000000005,"15min":0.88300000000000001},"min":{"1min":0.58799999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88100000000000001,"15min":1.048},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.875}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66300000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5649999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.997,"15min":1.069},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3069999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1699999999999999,"15min":1.3149999999999999},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.363,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.25},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.411},"min":{"1min":0.71199999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4419999999999999,"5min":10.368,"15min":10.368},"last":1.4970000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2889999999999999,"15min":1.381},"min":{"1min":1.0429999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.609,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2789999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4690000000000001,"5min":2.911,"15min":2.911},"last":1.155}]},{"osd":5,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3560000000000001,"15min":1.7250000000000001},"min":{"1min":0.98399999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.494,"5min":10.214,"15min":10.214},"last":1.288},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.353,"15min":1.48},"min":{"1min":1.0860000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.651,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3640000000000001,"15min":1.5740000000000001},"min":{"1min":1.054,"5min":0.874,"15min":0.874},"max":{"1min":1.4790000000000001,"5min":6.032,"15min":6.032},"last":1.373},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4159999999999999,"15min":1.772},"min":{"1min":1.0580000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6100000000000001,"5min":10.112,"15min":10.112},"last":1.4330000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4790000000000001,"15min":1.833},"min":{"1min":1.111,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5169999999999999,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.5449999999999999},{"interface":"front","average":{"1min":1.345,"5min":1.4199999999999999,"15min":1.5680000000000001},"min":{"1min":1.1519999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.552,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3280000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1585152,"data_stored":1044777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.99099999999999999},"min":{"1min":0.52700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1339999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.879,"15min":1.002},"min":{"1min":0.625,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3740000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":1.155}]},{"osd":2,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":1.143},"min":{"1min":0.69399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.262,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":1.111},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.036,"15min":1.2110000000000001},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.056,"15min":1.194},"min":{"1min":0.52100000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3959999999999999,"5min":4.093,"15min":4.093},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.145,"5min":1.216,"15min":1.417},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":1.2170000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2729999999999999,"15min":1.444},"min":{"1min":0.82999999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.5049999999999999,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3069999999999999,"15min":1.456},"min":{"1min":0.94899999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.458,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":1.4399999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3839999999999999,"15min":1.6120000000000001},"min":{"1min":0.92400000000000004,"5min":0.753,"15min":0.753},"max":{"1min":1.4950000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3400000000000001,"15min":1.54},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.401}]},{"osd":6,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.349,"15min":1.55},"min":{"1min":1.1100000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.528,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.423,"15min":1.6950000000000001},"min":{"1min":1.056,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.577,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.2989999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.409,"15min":1.595},"min":{"1min":0.99199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.756,"5min":3.056,"15min":3.056},"last":1.339},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.387,"15min":1.617},"min":{"1min":1.095,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.546,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.2789999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:52:49.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:52:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.419+0000 7f479e000700 1 Processor -- start 2024-09-13T18:52:49.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.419+0000 7f479e000700 1 -- start start 2024-09-13T18:52:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f479e000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f47980cb020 0x7f47980cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f479e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 0x7f479815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f479e000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47980b2ad0 con 0x7f479806aaa0 2024-09-13T18:52:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f479e000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479815b960 con 0x7f47980cb020 2024-09-13T18:52:49.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f479e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479815bc40 con 0x7f479815c2a0 2024-09-13T18:52:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f4797e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 0x7f479815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f4797e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 0x7f479815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:32802/0 (socket says 172.21.15.81:32802) 2024-09-13T18:52:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f4797e00700 1 -- 172.21.15.81:0/3849660273 learned_addr learned my addr 172.21.15.81:0/3849660273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:49.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f479cc00700 1 --2- 172.21.15.81:0/3849660273 >> v2:172.21.15.178:3300/0 conn(0x7f47980cb020 0x7f47980cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.423+0000 7f4797e00700 1 -- 172.21.15.81:0/3849660273 >> v2:172.21.15.178:3300/0 conn(0x7f47980cb020 msgr2=0x7f47980cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797e00700 1 --2- 172.21.15.81:0/3849660273 >> v2:172.21.15.178:3300/0 conn(0x7f47980cb020 0x7f47980cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797e00700 1 -- 172.21.15.81:0/3849660273 >> v1:172.21.15.178:6789/0 conn(0x7f479806aaa0 legacy=0x7f47980b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797e00700 1 -- 172.21.15.81:0/3849660273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479815bf20 con 0x7f479815c2a0 2024-09-13T18:52:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797e00700 1 --2- 172.21.15.81:0/3849660273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 0x7f479815b0e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4784009910 tx=0x7f4784009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be067e30c0765d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797400700 1 -- 172.21.15.81:0/3849660273 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784011830 con 0x7f479815c2a0 2024-09-13T18:52:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797400700 1 -- 172.21.15.81:0/3849660273 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784011990 con 0x7f479815c2a0 2024-09-13T18:52:49.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f4797400700 1 -- 172.21.15.81:0/3849660273 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784011d40 con 0x7f479815c2a0 2024-09-13T18:52:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 -- 172.21.15.81:0/3849660273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 msgr2=0x7f479815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 --2- 172.21.15.81:0/3849660273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 0x7f479815b0e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4784009910 tx=0x7f4784009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 -- 172.21.15.81:0/3849660273 shutdown_connections 2024-09-13T18:52:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 --2- 172.21.15.81:0/3849660273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479815c2a0 0x7f479815b0e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 --2- 172.21.15.81:0/3849660273 >> v2:172.21.15.178:3300/0 conn(0x7f47980cb020 0x7f47980cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 -- 172.21.15.81:0/3849660273 >> 172.21.15.81:0/3849660273 conn(0x7f47980b0c40 msgr2=0x7f479806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 -- 172.21.15.81:0/3849660273 shutdown_connections 2024-09-13T18:52:49.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.427+0000 7f479e000700 1 -- 172.21.15.81:0/3849660273 wait complete. 2024-09-13T18:52:49.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 Processor -- start 2024-09-13T18:52:49.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 -- start start 2024-09-13T18:52:49.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479806aaa0 0x7f4798070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980cb020 0x7f47981571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 0x7f47981e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798156d10 con 0x7f479815c2a0 2024-09-13T18:52:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4798156440 con 0x7f47980cb020 2024-09-13T18:52:49.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4798071530 con 0x7f479806aaa0 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 0x7f47981e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 0x7f47981e43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47748/0 (socket says 172.21.15.81:47748) 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479d600700 1 -- 172.21.15.81:0/50005156 learned_addr learned my addr 172.21.15.81:0/50005156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479cc00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479806aaa0 0x7f4798070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f4797e00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980cb020 0x7f47981571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479d600700 1 -- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479806aaa0 msgr2=0x7f4798070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479d600700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479806aaa0 0x7f4798070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.431+0000 7f479d600700 1 -- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980cb020 msgr2=0x7f47981571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479d600700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980cb020 0x7f47981571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479d600700 1 -- 172.21.15.81:0/50005156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009570 con 0x7f479815c2a0 2024-09-13T18:52:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479cc00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479806aaa0 0x7f4798070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f4797e00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980cb020 0x7f47981571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479d600700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 0x7f47981e43c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f479000cc80 tx=0x7f479000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790003c20 con 0x7f479815c2a0 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4790003d80 con 0x7f479815c2a0 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000aaa0 con 0x7f479815c2a0 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4798071c20 con 0x7f479815c2a0 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47981566c0 con 0x7f479815c2a0 2024-09-13T18:52:49.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.435+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4798156ec0 con 0x7f479815c2a0 2024-09-13T18:52:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.439+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f479000ac00 con 0x7f479815c2a0 2024-09-13T18:52:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.439+0000 7f4794c00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4778066730 0x7f4778068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.439+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4790084260 con 0x7f479815c2a0 2024-09-13T18:52:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.439+0000 7f479cc00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4778066730 0x7f4778068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.439+0000 7f479cc00700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4778066730 0x7f4778068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f478c0112c0 tx=0x7f478c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:49.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.443+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4798156ec0 con 0x7f479815c2a0 2024-09-13T18:52:49.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.627+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47980cb400 con 0x7f4778066730 2024-09-13T18:52:49.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.643+0000 7f4794c00700 1 -- 172.21.15.81:0/50005156 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286869 (secure 0 0 0) 0x7f478c011c80 con 0x7f4778066730 2024-09-13T18:52:49.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4778066730 msgr2=0x7f4778068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4778066730 0x7f4778068bf0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f478c0112c0 tx=0x7f478c009240 comp rx=0 tx=0).stop 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 msgr2=0x7f47981e43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 0x7f47981e43c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f479000cc80 tx=0x7f479000cf90 comp rx=0 tx=0).stop 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 shutdown_connections 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4778066730 0x7f4778068bf0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f479815c2a0 0x7f47981e43c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47980cb020 0x7f47981571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 --2- 172.21.15.81:0/50005156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f479806aaa0 0x7f4798070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 >> 172.21.15.81:0/50005156 conn(0x7f47980b0c40 msgr2=0x7f479815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 shutdown_connections 2024-09-13T18:52:49.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.651+0000 7f479e000700 1 -- 172.21.15.81:0/50005156 wait complete. 2024-09-13T18:52:49.661 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:52:49.682 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":247,"stamp":"2024-09-13T18:52:49.082280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253816,"kb_used_data":8968,"kb_used_omap":12,"kb_used_meta":244723,"kb_avail":754720904,"statfs":{"total":773094113280,"available":772834205696,"internally_reserved":0,"allocated":9183232,"data_stored":4820732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":250596923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.086174"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114875+0000","last_change":"2024-09-13T18:52:40.029730+0000","last_active":"2024-09-13T18:52:43.114875+0000","last_peered":"2024-09-13T18:52:43.114875+0000","last_clean":"2024-09-13T18:52:43.114875+0000","last_became_active":"2024-09-13T18:52:40.029484+0000","last_became_peered":"2024-09-13T18:52:40.029484+0000","last_unstale":"2024-09-13T18:52:43.114875+0000","last_undegraded":"2024-09-13T18:52:43.114875+0000","last_fullsized":"2024-09-13T18:52:43.114875+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:05.838347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005020+0000","last_change":"2024-09-13T18:52:40.032994+0000","last_active":"2024-09-13T18:52:41.005020+0000","last_peered":"2024-09-13T18:52:41.005020+0000","last_clean":"2024-09-13T18:52:41.005020+0000","last_became_active":"2024-09-13T18:52:40.027610+0000","last_became_peered":"2024-09-13T18:52:40.027610+0000","last_unstale":"2024-09-13T18:52:41.005020+0000","last_undegraded":"2024-09-13T18:52:41.005020+0000","last_fullsized":"2024-09-13T18:52:41.005020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:28.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101407+0000","last_change":"2024-09-13T18:52:40.018034+0000","last_active":"2024-09-13T18:52:43.101407+0000","last_peered":"2024-09-13T18:52:43.101407+0000","last_clean":"2024-09-13T18:52:43.101407+0000","last_became_active":"2024-09-13T18:52:40.017770+0000","last_became_peered":"2024-09-13T18:52:40.017770+0000","last_unstale":"2024-09-13T18:52:43.101407+0000","last_undegraded":"2024-09-13T18:52:43.101407+0000","last_fullsized":"2024-09-13T18:52:43.101407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037913+0000","last_change":"2024-09-13T18:52:40.022083+0000","last_active":"2024-09-13T18:52:41.037913+0000","last_peered":"2024-09-13T18:52:41.037913+0000","last_clean":"2024-09-13T18:52:41.037913+0000","last_became_active":"2024-09-13T18:52:40.021751+0000","last_became_peered":"2024-09-13T18:52:40.021751+0000","last_unstale":"2024-09-13T18:52:41.037913+0000","last_undegraded":"2024-09-13T18:52:41.037913+0000","last_fullsized":"2024-09-13T18:52:41.037913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.451244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003132+0000","last_change":"2024-09-13T18:52:40.021848+0000","last_active":"2024-09-13T18:52:41.003132+0000","last_peered":"2024-09-13T18:52:41.003132+0000","last_clean":"2024-09-13T18:52:41.003132+0000","last_became_active":"2024-09-13T18:52:40.021518+0000","last_became_peered":"2024-09-13T18:52:40.021518+0000","last_unstale":"2024-09-13T18:52:41.003132+0000","last_undegraded":"2024-09-13T18:52:41.003132+0000","last_fullsized":"2024-09-13T18:52:41.003132+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:48:37.128671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004846+0000","last_change":"2024-09-13T18:52:40.022619+0000","last_active":"2024-09-13T18:52:41.004846+0000","last_peered":"2024-09-13T18:52:41.004846+0000","last_clean":"2024-09-13T18:52:41.004846+0000","last_became_active":"2024-09-13T18:52:40.021024+0000","last_became_peered":"2024-09-13T18:52:40.021024+0000","last_unstale":"2024-09-13T18:52:41.004846+0000","last_undegraded":"2024-09-13T18:52:41.004846+0000","last_fullsized":"2024-09-13T18:52:41.004846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:18.392542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111692+0000","last_change":"2024-09-13T18:52:40.021133+0000","last_active":"2024-09-13T18:52:43.111692+0000","last_peered":"2024-09-13T18:52:43.111692+0000","last_clean":"2024-09-13T18:52:43.111692+0000","last_became_active":"2024-09-13T18:52:40.020869+0000","last_became_peered":"2024-09-13T18:52:40.020869+0000","last_unstale":"2024-09-13T18:52:43.111692+0000","last_undegraded":"2024-09-13T18:52:43.111692+0000","last_fullsized":"2024-09-13T18:52:43.111692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:45.206606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.002976+0000","last_change":"2024-09-13T18:52:40.022054+0000","last_active":"2024-09-13T18:52:41.002976+0000","last_peered":"2024-09-13T18:52:41.002976+0000","last_clean":"2024-09-13T18:52:41.002976+0000","last_became_active":"2024-09-13T18:52:40.021712+0000","last_became_peered":"2024-09-13T18:52:40.021712+0000","last_unstale":"2024-09-13T18:52:41.002976+0000","last_undegraded":"2024-09-13T18:52:41.002976+0000","last_fullsized":"2024-09-13T18:52:41.002976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:31:56.790323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108781+0000","last_change":"2024-09-13T18:52:40.029657+0000","last_active":"2024-09-13T18:52:43.108781+0000","last_peered":"2024-09-13T18:52:43.108781+0000","last_clean":"2024-09-13T18:52:43.108781+0000","last_became_active":"2024-09-13T18:52:40.029365+0000","last_became_peered":"2024-09-13T18:52:40.029365+0000","last_unstale":"2024-09-13T18:52:43.108781+0000","last_undegraded":"2024-09-13T18:52:43.108781+0000","last_fullsized":"2024-09-13T18:52:43.108781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:49.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038039+0000","last_change":"2024-09-13T18:52:40.022820+0000","last_active":"2024-09-13T18:52:41.038039+0000","last_peered":"2024-09-13T18:52:41.038039+0000","last_clean":"2024-09-13T18:52:41.038039+0000","last_became_active":"2024-09-13T18:52:40.022523+0000","last_became_peered":"2024-09-13T18:52:40.022523+0000","last_unstale":"2024-09-13T18:52:41.038039+0000","last_undegraded":"2024-09-13T18:52:41.038039+0000","last_fullsized":"2024-09-13T18:52:41.038039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:55.771407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004756+0000","last_change":"2024-09-13T18:52:40.027341+0000","last_active":"2024-09-13T18:52:41.004756+0000","last_peered":"2024-09-13T18:52:41.004756+0000","last_clean":"2024-09-13T18:52:41.004756+0000","last_became_active":"2024-09-13T18:52:40.027105+0000","last_became_peered":"2024-09-13T18:52:40.027105+0000","last_unstale":"2024-09-13T18:52:41.004756+0000","last_undegraded":"2024-09-13T18:52:41.004756+0000","last_fullsized":"2024-09-13T18:52:41.004756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:44.732130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037925+0000","last_change":"2024-09-13T18:52:40.021363+0000","last_active":"2024-09-13T18:52:41.037925+0000","last_peered":"2024-09-13T18:52:41.037925+0000","last_clean":"2024-09-13T18:52:41.037925+0000","last_became_active":"2024-09-13T18:52:40.019817+0000","last_became_peered":"2024-09-13T18:52:40.019817+0000","last_unstale":"2024-09-13T18:52:41.037925+0000","last_undegraded":"2024-09-13T18:52:41.037925+0000","last_fullsized":"2024-09-13T18:52:41.037925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003464+0000","last_change":"2024-09-13T18:52:40.026377+0000","last_active":"2024-09-13T18:52:41.003464+0000","last_peered":"2024-09-13T18:52:41.003464+0000","last_clean":"2024-09-13T18:52:41.003464+0000","last_became_active":"2024-09-13T18:52:40.026109+0000","last_became_peered":"2024-09-13T18:52:40.026109+0000","last_unstale":"2024-09-13T18:52:41.003464+0000","last_undegraded":"2024-09-13T18:52:41.003464+0000","last_fullsized":"2024-09-13T18:52:41.003464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.014272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004958+0000","last_change":"2024-09-13T18:52:40.019135+0000","last_active":"2024-09-13T18:52:41.004958+0000","last_peered":"2024-09-13T18:52:41.004958+0000","last_clean":"2024-09-13T18:52:41.004958+0000","last_became_active":"2024-09-13T18:52:40.018751+0000","last_became_peered":"2024-09-13T18:52:40.018751+0000","last_unstale":"2024-09-13T18:52:41.004958+0000","last_undegraded":"2024-09-13T18:52:41.004958+0000","last_fullsized":"2024-09-13T18:52:41.004958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:40.178964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004367+0000","last_change":"2024-09-13T18:52:40.017029+0000","last_active":"2024-09-13T18:52:41.004367+0000","last_peered":"2024-09-13T18:52:41.004367+0000","last_clean":"2024-09-13T18:52:41.004367+0000","last_became_active":"2024-09-13T18:52:40.016050+0000","last_became_peered":"2024-09-13T18:52:40.016050+0000","last_unstale":"2024-09-13T18:52:41.004367+0000","last_undegraded":"2024-09-13T18:52:41.004367+0000","last_fullsized":"2024-09-13T18:52:41.004367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:18.392542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114634+0000","last_change":"2024-09-13T18:52:40.036388+0000","last_active":"2024-09-13T18:52:43.114634+0000","last_peered":"2024-09-13T18:52:43.114634+0000","last_clean":"2024-09-13T18:52:43.114634+0000","last_became_active":"2024-09-13T18:52:40.036023+0000","last_became_peered":"2024-09-13T18:52:40.036023+0000","last_unstale":"2024-09-13T18:52:43.114634+0000","last_undegraded":"2024-09-13T18:52:43.114634+0000","last_fullsized":"2024-09-13T18:52:43.114634+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:00.157204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004116+0000","last_change":"2024-09-13T18:52:40.024542+0000","last_active":"2024-09-13T18:52:41.004116+0000","last_peered":"2024-09-13T18:52:41.004116+0000","last_clean":"2024-09-13T18:52:41.004116+0000","last_became_active":"2024-09-13T18:52:40.024304+0000","last_became_peered":"2024-09-13T18:52:40.024304+0000","last_unstale":"2024-09-13T18:52:41.004116+0000","last_undegraded":"2024-09-13T18:52:41.004116+0000","last_fullsized":"2024-09-13T18:52:41.004116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:56.378475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101450+0000","last_change":"2024-09-13T18:52:40.022797+0000","last_active":"2024-09-13T18:52:43.101450+0000","last_peered":"2024-09-13T18:52:43.101450+0000","last_clean":"2024-09-13T18:52:43.101450+0000","last_became_active":"2024-09-13T18:52:40.022578+0000","last_became_peered":"2024-09-13T18:52:40.022578+0000","last_unstale":"2024-09-13T18:52:43.101450+0000","last_undegraded":"2024-09-13T18:52:43.101450+0000","last_fullsized":"2024-09-13T18:52:43.101450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:55.771407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005380+0000","last_change":"2024-09-13T18:52:40.026751+0000","last_active":"2024-09-13T18:52:41.005380+0000","last_peered":"2024-09-13T18:52:41.005380+0000","last_clean":"2024-09-13T18:52:41.005380+0000","last_became_active":"2024-09-13T18:52:40.026525+0000","last_became_peered":"2024-09-13T18:52:40.026525+0000","last_unstale":"2024-09-13T18:52:41.005380+0000","last_undegraded":"2024-09-13T18:52:41.005380+0000","last_fullsized":"2024-09-13T18:52:41.005380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:12.433472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003444+0000","last_change":"2024-09-13T18:52:40.026350+0000","last_active":"2024-09-13T18:52:41.003444+0000","last_peered":"2024-09-13T18:52:41.003444+0000","last_clean":"2024-09-13T18:52:41.003444+0000","last_became_active":"2024-09-13T18:52:40.026061+0000","last_became_peered":"2024-09-13T18:52:40.026061+0000","last_unstale":"2024-09-13T18:52:41.003444+0000","last_undegraded":"2024-09-13T18:52:41.003444+0000","last_fullsized":"2024-09-13T18:52:41.003444+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:37.233263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108533+0000","last_change":"2024-09-13T18:52:40.027813+0000","last_active":"2024-09-13T18:52:43.108533+0000","last_peered":"2024-09-13T18:52:43.108533+0000","last_clean":"2024-09-13T18:52:43.108533+0000","last_became_active":"2024-09-13T18:52:40.027086+0000","last_became_peered":"2024-09-13T18:52:40.027086+0000","last_unstale":"2024-09-13T18:52:43.108533+0000","last_undegraded":"2024-09-13T18:52:43.108533+0000","last_fullsized":"2024-09-13T18:52:43.108533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:28.250958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005473+0000","last_change":"2024-09-13T18:52:40.025114+0000","last_active":"2024-09-13T18:52:41.005473+0000","last_peered":"2024-09-13T18:52:41.005473+0000","last_clean":"2024-09-13T18:52:41.005473+0000","last_became_active":"2024-09-13T18:52:40.024858+0000","last_became_peered":"2024-09-13T18:52:40.024858+0000","last_unstale":"2024-09-13T18:52:41.005473+0000","last_undegraded":"2024-09-13T18:52:41.005473+0000","last_fullsized":"2024-09-13T18:52:41.005473+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:56.110356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108408+0000","last_change":"2024-09-13T18:52:40.031138+0000","last_active":"2024-09-13T18:52:43.108408+0000","last_peered":"2024-09-13T18:52:43.108408+0000","last_clean":"2024-09-13T18:52:43.108408+0000","last_became_active":"2024-09-13T18:52:40.030869+0000","last_became_peered":"2024-09-13T18:52:40.030869+0000","last_unstale":"2024-09-13T18:52:43.108408+0000","last_undegraded":"2024-09-13T18:52:43.108408+0000","last_fullsized":"2024-09-13T18:52:43.108408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:56.244802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003112+0000","last_change":"2024-09-13T18:52:40.015588+0000","last_active":"2024-09-13T18:52:41.003112+0000","last_peered":"2024-09-13T18:52:41.003112+0000","last_clean":"2024-09-13T18:52:41.003112+0000","last_became_active":"2024-09-13T18:52:40.015284+0000","last_became_peered":"2024-09-13T18:52:40.015284+0000","last_unstale":"2024-09-13T18:52:41.003112+0000","last_undegraded":"2024-09-13T18:52:41.003112+0000","last_fullsized":"2024-09-13T18:52:41.003112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:53.113817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004527+0000","last_change":"2024-09-13T18:52:40.021142+0000","last_active":"2024-09-13T18:52:41.004527+0000","last_peered":"2024-09-13T18:52:41.004527+0000","last_clean":"2024-09-13T18:52:41.004527+0000","last_became_active":"2024-09-13T18:52:40.020915+0000","last_became_peered":"2024-09-13T18:52:40.020915+0000","last_unstale":"2024-09-13T18:52:41.004527+0000","last_undegraded":"2024-09-13T18:52:41.004527+0000","last_fullsized":"2024-09-13T18:52:41.004527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:01.129486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038052+0000","last_change":"2024-09-13T18:52:40.030936+0000","last_active":"2024-09-13T18:52:41.038052+0000","last_peered":"2024-09-13T18:52:41.038052+0000","last_clean":"2024-09-13T18:52:41.038052+0000","last_became_active":"2024-09-13T18:52:40.030628+0000","last_became_peered":"2024-09-13T18:52:40.030628+0000","last_unstale":"2024-09-13T18:52:41.038052+0000","last_undegraded":"2024-09-13T18:52:41.038052+0000","last_fullsized":"2024-09-13T18:52:41.038052+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114764+0000","last_change":"2024-09-13T18:52:40.037356+0000","last_active":"2024-09-13T18:52:43.114764+0000","last_peered":"2024-09-13T18:52:43.114764+0000","last_clean":"2024-09-13T18:52:43.114764+0000","last_became_active":"2024-09-13T18:52:40.034877+0000","last_became_peered":"2024-09-13T18:52:40.034877+0000","last_unstale":"2024-09-13T18:52:43.114764+0000","last_undegraded":"2024-09-13T18:52:43.114764+0000","last_fullsized":"2024-09-13T18:52:43.114764+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:02.070096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003558+0000","last_change":"2024-09-13T18:52:40.033899+0000","last_active":"2024-09-13T18:52:41.003558+0000","last_peered":"2024-09-13T18:52:41.003558+0000","last_clean":"2024-09-13T18:52:41.003558+0000","last_became_active":"2024-09-13T18:52:40.033659+0000","last_became_peered":"2024-09-13T18:52:40.033659+0000","last_unstale":"2024-09-13T18:52:41.003558+0000","last_undegraded":"2024-09-13T18:52:41.003558+0000","last_fullsized":"2024-09-13T18:52:41.003558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:31.358441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003640+0000","last_change":"2024-09-13T18:52:40.018681+0000","last_active":"2024-09-13T18:52:41.003640+0000","last_peered":"2024-09-13T18:52:41.003640+0000","last_clean":"2024-09-13T18:52:41.003640+0000","last_became_active":"2024-09-13T18:52:40.018435+0000","last_became_peered":"2024-09-13T18:52:40.018435+0000","last_unstale":"2024-09-13T18:52:41.003640+0000","last_undegraded":"2024-09-13T18:52:41.003640+0000","last_fullsized":"2024-09-13T18:52:41.003640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:53:48.487871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114698+0000","last_change":"2024-09-13T18:52:40.020252+0000","last_active":"2024-09-13T18:52:43.114698+0000","last_peered":"2024-09-13T18:52:43.114698+0000","last_clean":"2024-09-13T18:52:43.114698+0000","last_became_active":"2024-09-13T18:52:40.018799+0000","last_became_peered":"2024-09-13T18:52:40.018799+0000","last_unstale":"2024-09-13T18:52:43.114698+0000","last_undegraded":"2024-09-13T18:52:43.114698+0000","last_fullsized":"2024-09-13T18:52:43.114698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:40.873044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101235+0000","last_change":"2024-09-13T18:52:40.012698+0000","last_active":"2024-09-13T18:52:43.101235+0000","last_peered":"2024-09-13T18:52:43.101235+0000","last_clean":"2024-09-13T18:52:43.101235+0000","last_became_active":"2024-09-13T18:52:40.012408+0000","last_became_peered":"2024-09-13T18:52:40.012408+0000","last_unstale":"2024-09-13T18:52:43.101235+0000","last_undegraded":"2024-09-13T18:52:43.101235+0000","last_fullsized":"2024-09-13T18:52:43.101235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114663+0000","last_change":"2024-09-13T18:52:40.032890+0000","last_active":"2024-09-13T18:52:43.114663+0000","last_peered":"2024-09-13T18:52:43.114663+0000","last_clean":"2024-09-13T18:52:43.114663+0000","last_became_active":"2024-09-13T18:52:40.029120+0000","last_became_peered":"2024-09-13T18:52:40.029120+0000","last_unstale":"2024-09-13T18:52:43.114663+0000","last_undegraded":"2024-09-13T18:52:43.114663+0000","last_fullsized":"2024-09-13T18:52:43.114663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101135+0000","last_change":"2024-09-13T18:52:40.020591+0000","last_active":"2024-09-13T18:52:43.101135+0000","last_peered":"2024-09-13T18:52:43.101135+0000","last_clean":"2024-09-13T18:52:43.101135+0000","last_became_active":"2024-09-13T18:52:40.020197+0000","last_became_peered":"2024-09-13T18:52:40.020197+0000","last_unstale":"2024-09-13T18:52:43.101135+0000","last_undegraded":"2024-09-13T18:52:43.101135+0000","last_fullsized":"2024-09-13T18:52:43.101135+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004223+0000","last_change":"2024-09-13T18:52:39.541307+0000","last_active":"2024-09-13T18:52:41.004223+0000","last_peered":"2024-09-13T18:52:41.004223+0000","last_clean":"2024-09-13T18:52:41.004223+0000","last_became_active":"2024-09-13T18:52:39.541022+0000","last_became_peered":"2024-09-13T18:52:39.541022+0000","last_unstale":"2024-09-13T18:52:41.004223+0000","last_undegraded":"2024-09-13T18:52:41.004223+0000","last_fullsized":"2024-09-13T18:52:41.004223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:33.093013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004587+0000","last_change":"2024-09-13T18:52:40.028565+0000","last_active":"2024-09-13T18:52:41.004587+0000","last_peered":"2024-09-13T18:52:41.004587+0000","last_clean":"2024-09-13T18:52:41.004587+0000","last_became_active":"2024-09-13T18:52:40.028201+0000","last_became_peered":"2024-09-13T18:52:40.028201+0000","last_unstale":"2024-09-13T18:52:41.004587+0000","last_undegraded":"2024-09-13T18:52:41.004587+0000","last_fullsized":"2024-09-13T18:52:41.004587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:11.059208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114852+0000","last_change":"2024-09-13T18:52:39.546080+0000","last_active":"2024-09-13T18:52:43.114852+0000","last_peered":"2024-09-13T18:52:43.114852+0000","last_clean":"2024-09-13T18:52:43.114852+0000","last_became_active":"2024-09-13T18:52:39.545824+0000","last_became_peered":"2024-09-13T18:52:39.545824+0000","last_unstale":"2024-09-13T18:52:43.114852+0000","last_undegraded":"2024-09-13T18:52:43.114852+0000","last_fullsized":"2024-09-13T18:52:43.114852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:13.249946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108452+0000","last_change":"2024-09-13T18:52:40.031046+0000","last_active":"2024-09-13T18:52:43.108452+0000","last_peered":"2024-09-13T18:52:43.108452+0000","last_clean":"2024-09-13T18:52:43.108452+0000","last_became_active":"2024-09-13T18:52:40.030512+0000","last_became_peered":"2024-09-13T18:52:40.030512+0000","last_unstale":"2024-09-13T18:52:43.108452+0000","last_undegraded":"2024-09-13T18:52:43.108452+0000","last_fullsized":"2024-09-13T18:52:43.108452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:22.267278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114786+0000","last_change":"2024-09-13T18:52:39.545287+0000","last_active":"2024-09-13T18:52:43.114786+0000","last_peered":"2024-09-13T18:52:43.114786+0000","last_clean":"2024-09-13T18:52:43.114786+0000","last_became_active":"2024-09-13T18:52:39.545044+0000","last_became_peered":"2024-09-13T18:52:39.545044+0000","last_unstale":"2024-09-13T18:52:43.114786+0000","last_undegraded":"2024-09-13T18:52:43.114786+0000","last_fullsized":"2024-09-13T18:52:43.114786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:29:45.701782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108574+0000","last_change":"2024-09-13T18:52:40.027538+0000","last_active":"2024-09-13T18:52:43.108574+0000","last_peered":"2024-09-13T18:52:43.108574+0000","last_clean":"2024-09-13T18:52:43.108574+0000","last_became_active":"2024-09-13T18:52:40.026726+0000","last_became_peered":"2024-09-13T18:52:40.026726+0000","last_unstale":"2024-09-13T18:52:43.108574+0000","last_undegraded":"2024-09-13T18:52:43.108574+0000","last_fullsized":"2024-09-13T18:52:43.108574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:26.857144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111916+0000","last_change":"2024-09-13T18:52:39.543860+0000","last_active":"2024-09-13T18:52:43.111916+0000","last_peered":"2024-09-13T18:52:43.111916+0000","last_clean":"2024-09-13T18:52:43.111916+0000","last_became_active":"2024-09-13T18:52:39.541773+0000","last_became_peered":"2024-09-13T18:52:39.541773+0000","last_unstale":"2024-09-13T18:52:43.111916+0000","last_undegraded":"2024-09-13T18:52:43.111916+0000","last_fullsized":"2024-09-13T18:52:43.111916+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:21.247436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003971+0000","last_change":"2024-09-13T18:52:40.022779+0000","last_active":"2024-09-13T18:52:41.003971+0000","last_peered":"2024-09-13T18:52:41.003971+0000","last_clean":"2024-09-13T18:52:41.003971+0000","last_became_active":"2024-09-13T18:52:40.022487+0000","last_became_peered":"2024-09-13T18:52:40.022487+0000","last_unstale":"2024-09-13T18:52:41.003971+0000","last_undegraded":"2024-09-13T18:52:41.003971+0000","last_fullsized":"2024-09-13T18:52:41.003971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:28.706099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108643+0000","last_change":"2024-09-13T18:52:39.544408+0000","last_active":"2024-09-13T18:52:43.108643+0000","last_peered":"2024-09-13T18:52:43.108643+0000","last_clean":"2024-09-13T18:52:43.108643+0000","last_became_active":"2024-09-13T18:52:39.544087+0000","last_became_peered":"2024-09-13T18:52:39.544087+0000","last_unstale":"2024-09-13T18:52:43.108643+0000","last_undegraded":"2024-09-13T18:52:43.108643+0000","last_fullsized":"2024-09-13T18:52:43.108643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:10.930248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004876+0000","last_change":"2024-09-13T18:52:40.027106+0000","last_active":"2024-09-13T18:52:41.004876+0000","last_peered":"2024-09-13T18:52:41.004876+0000","last_clean":"2024-09-13T18:52:41.004876+0000","last_became_active":"2024-09-13T18:52:40.026853+0000","last_became_peered":"2024-09-13T18:52:40.026853+0000","last_unstale":"2024-09-13T18:52:41.004876+0000","last_undegraded":"2024-09-13T18:52:41.004876+0000","last_fullsized":"2024-09-13T18:52:41.004876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:40.178964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037616+0000","last_change":"2024-09-13T18:52:39.532353+0000","last_active":"2024-09-13T18:52:41.037616+0000","last_peered":"2024-09-13T18:52:41.037616+0000","last_clean":"2024-09-13T18:52:41.037616+0000","last_became_active":"2024-09-13T18:52:39.532063+0000","last_became_peered":"2024-09-13T18:52:39.532063+0000","last_unstale":"2024-09-13T18:52:41.037616+0000","last_undegraded":"2024-09-13T18:52:41.037616+0000","last_fullsized":"2024-09-13T18:52:41.037616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:32:27.231116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108691+0000","last_change":"2024-09-13T18:52:40.036086+0000","last_active":"2024-09-13T18:52:43.108691+0000","last_peered":"2024-09-13T18:52:43.108691+0000","last_clean":"2024-09-13T18:52:43.108691+0000","last_became_active":"2024-09-13T18:52:40.035775+0000","last_became_peered":"2024-09-13T18:52:40.035775+0000","last_unstale":"2024-09-13T18:52:43.108691+0000","last_undegraded":"2024-09-13T18:52:43.108691+0000","last_fullsized":"2024-09-13T18:52:43.108691+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:49.521172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004778+0000","last_change":"2024-09-13T18:52:39.535896+0000","last_active":"2024-09-13T18:52:41.004778+0000","last_peered":"2024-09-13T18:52:41.004778+0000","last_clean":"2024-09-13T18:52:41.004778+0000","last_became_active":"2024-09-13T18:52:39.535644+0000","last_became_peered":"2024-09-13T18:52:39.535644+0000","last_unstale":"2024-09-13T18:52:41.004778+0000","last_undegraded":"2024-09-13T18:52:41.004778+0000","last_fullsized":"2024-09-13T18:52:41.004778+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:00.037544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.112127+0000","last_change":"2024-09-13T18:52:40.033847+0000","last_active":"2024-09-13T18:52:43.112127+0000","last_peered":"2024-09-13T18:52:43.112127+0000","last_clean":"2024-09-13T18:52:43.112127+0000","last_became_active":"2024-09-13T18:52:40.032945+0000","last_became_peered":"2024-09-13T18:52:40.032945+0000","last_unstale":"2024-09-13T18:52:43.112127+0000","last_undegraded":"2024-09-13T18:52:43.112127+0000","last_fullsized":"2024-09-13T18:52:43.112127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:24.210675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.002899+0000","last_change":"2024-09-13T18:52:39.532901+0000","last_active":"2024-09-13T18:52:41.002899+0000","last_peered":"2024-09-13T18:52:41.002899+0000","last_clean":"2024-09-13T18:52:41.002899+0000","last_became_active":"2024-09-13T18:52:39.532359+0000","last_became_peered":"2024-09-13T18:52:39.532359+0000","last_unstale":"2024-09-13T18:52:41.002899+0000","last_undegraded":"2024-09-13T18:52:41.002899+0000","last_fullsized":"2024-09-13T18:52:41.002899+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:01.520449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003112+0000","last_change":"2024-09-13T18:52:40.032203+0000","last_active":"2024-09-13T18:52:41.003112+0000","last_peered":"2024-09-13T18:52:41.003112+0000","last_clean":"2024-09-13T18:52:41.003112+0000","last_became_active":"2024-09-13T18:52:40.030193+0000","last_became_peered":"2024-09-13T18:52:40.030193+0000","last_unstale":"2024-09-13T18:52:41.003112+0000","last_undegraded":"2024-09-13T18:52:41.003112+0000","last_fullsized":"2024-09-13T18:52:41.003112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:19.520520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114897+0000","last_change":"2024-09-13T18:52:39.546410+0000","last_active":"2024-09-13T18:52:43.114897+0000","last_peered":"2024-09-13T18:52:43.114897+0000","last_clean":"2024-09-13T18:52:43.114897+0000","last_became_active":"2024-09-13T18:52:39.546068+0000","last_became_peered":"2024-09-13T18:52:39.546068+0000","last_unstale":"2024-09-13T18:52:43.114897+0000","last_undegraded":"2024-09-13T18:52:43.114897+0000","last_fullsized":"2024-09-13T18:52:43.114897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:57:48.820175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037765+0000","last_change":"2024-09-13T18:52:40.023116+0000","last_active":"2024-09-13T18:52:41.037765+0000","last_peered":"2024-09-13T18:52:41.037765+0000","last_clean":"2024-09-13T18:52:41.037765+0000","last_became_active":"2024-09-13T18:52:40.019937+0000","last_became_peered":"2024-09-13T18:52:40.019937+0000","last_unstale":"2024-09-13T18:52:41.037765+0000","last_undegraded":"2024-09-13T18:52:41.037765+0000","last_fullsized":"2024-09-13T18:52:41.037765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:54.129432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038228+0000","last_change":"2024-09-13T18:52:39.538805+0000","last_active":"2024-09-13T18:52:41.038228+0000","last_peered":"2024-09-13T18:52:41.038228+0000","last_clean":"2024-09-13T18:52:41.038228+0000","last_became_active":"2024-09-13T18:52:39.538559+0000","last_became_peered":"2024-09-13T18:52:39.538559+0000","last_unstale":"2024-09-13T18:52:41.038228+0000","last_undegraded":"2024-09-13T18:52:41.038228+0000","last_fullsized":"2024-09-13T18:52:41.038228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:32.427374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005124+0000","last_change":"2024-09-13T18:52:40.017406+0000","last_active":"2024-09-13T18:52:41.005124+0000","last_peered":"2024-09-13T18:52:41.005124+0000","last_clean":"2024-09-13T18:52:41.005124+0000","last_became_active":"2024-09-13T18:52:40.017141+0000","last_became_peered":"2024-09-13T18:52:40.017141+0000","last_unstale":"2024-09-13T18:52:41.005124+0000","last_undegraded":"2024-09-13T18:52:41.005124+0000","last_fullsized":"2024-09-13T18:52:41.005124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:28.733295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003963+0000","last_change":"2024-09-13T18:52:39.542990+0000","last_active":"2024-09-13T18:52:41.003963+0000","last_peered":"2024-09-13T18:52:41.003963+0000","last_clean":"2024-09-13T18:52:41.003963+0000","last_became_active":"2024-09-13T18:52:39.542713+0000","last_became_peered":"2024-09-13T18:52:39.542713+0000","last_unstale":"2024-09-13T18:52:41.003963+0000","last_undegraded":"2024-09-13T18:52:41.003963+0000","last_fullsized":"2024-09-13T18:52:41.003963+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:49.356635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101276+0000","last_change":"2024-09-13T18:52:40.016130+0000","last_active":"2024-09-13T18:52:43.101276+0000","last_peered":"2024-09-13T18:52:43.101276+0000","last_clean":"2024-09-13T18:52:43.101276+0000","last_became_active":"2024-09-13T18:52:40.015890+0000","last_became_peered":"2024-09-13T18:52:40.015890+0000","last_unstale":"2024-09-13T18:52:43.101276+0000","last_undegraded":"2024-09-13T18:52:43.101276+0000","last_fullsized":"2024-09-13T18:52:43.101276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111965+0000","last_change":"2024-09-13T18:52:39.545495+0000","last_active":"2024-09-13T18:52:43.111965+0000","last_peered":"2024-09-13T18:52:43.111965+0000","last_clean":"2024-09-13T18:52:43.111965+0000","last_became_active":"2024-09-13T18:52:39.544651+0000","last_became_peered":"2024-09-13T18:52:39.544651+0000","last_unstale":"2024-09-13T18:52:43.111965+0000","last_undegraded":"2024-09-13T18:52:43.111965+0000","last_fullsized":"2024-09-13T18:52:43.111965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:48.501330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038158+0000","last_change":"2024-09-13T18:52:40.021201+0000","last_active":"2024-09-13T18:52:41.038158+0000","last_peered":"2024-09-13T18:52:41.038158+0000","last_clean":"2024-09-13T18:52:41.038158+0000","last_became_active":"2024-09-13T18:52:40.019481+0000","last_became_peered":"2024-09-13T18:52:40.019481+0000","last_unstale":"2024-09-13T18:52:41.038158+0000","last_undegraded":"2024-09-13T18:52:41.038158+0000","last_fullsized":"2024-09-13T18:52:41.038158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.037637+0000","last_change":"2024-09-13T18:52:39.542541+0000","last_active":"2024-09-13T18:52:41.037637+0000","last_peered":"2024-09-13T18:52:41.037637+0000","last_clean":"2024-09-13T18:52:41.037637+0000","last_became_active":"2024-09-13T18:52:39.542210+0000","last_became_peered":"2024-09-13T18:52:39.542210+0000","last_unstale":"2024-09-13T18:52:41.037637+0000","last_undegraded":"2024-09-13T18:52:41.037637+0000","last_fullsized":"2024-09-13T18:52:41.037637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:21:55.224960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.112014+0000","last_change":"2024-09-13T18:52:40.020712+0000","last_active":"2024-09-13T18:52:43.112014+0000","last_peered":"2024-09-13T18:52:43.112014+0000","last_clean":"2024-09-13T18:52:43.112014+0000","last_became_active":"2024-09-13T18:52:40.020425+0000","last_became_peered":"2024-09-13T18:52:40.020425+0000","last_unstale":"2024-09-13T18:52:43.112014+0000","last_undegraded":"2024-09-13T18:52:43.112014+0000","last_fullsized":"2024-09-13T18:52:43.112014+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:44:18.451244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114719+0000","last_change":"2024-09-13T18:52:39.548526+0000","last_active":"2024-09-13T18:52:43.114719+0000","last_peered":"2024-09-13T18:52:43.114719+0000","last_clean":"2024-09-13T18:52:43.114719+0000","last_became_active":"2024-09-13T18:52:39.548234+0000","last_became_peered":"2024-09-13T18:52:39.548234+0000","last_unstale":"2024-09-13T18:52:43.114719+0000","last_undegraded":"2024-09-13T18:52:43.114719+0000","last_fullsized":"2024-09-13T18:52:43.114719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:48.501330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.112088+0000","last_change":"2024-09-13T18:52:40.030393+0000","last_active":"2024-09-13T18:52:43.112088+0000","last_peered":"2024-09-13T18:52:43.112088+0000","last_clean":"2024-09-13T18:52:43.112088+0000","last_became_active":"2024-09-13T18:52:40.030085+0000","last_became_peered":"2024-09-13T18:52:40.030085+0000","last_unstale":"2024-09-13T18:52:43.112088+0000","last_undegraded":"2024-09-13T18:52:43.112088+0000","last_fullsized":"2024-09-13T18:52:43.112088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:45.179022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003121+0000","last_change":"2024-09-13T18:52:39.539365+0000","last_active":"2024-09-13T18:52:41.003121+0000","last_peered":"2024-09-13T18:52:41.003121+0000","last_clean":"2024-09-13T18:52:41.003121+0000","last_became_active":"2024-09-13T18:52:39.539007+0000","last_became_peered":"2024-09-13T18:52:39.539007+0000","last_unstale":"2024-09-13T18:52:41.003121+0000","last_undegraded":"2024-09-13T18:52:41.003121+0000","last_fullsized":"2024-09-13T18:52:41.003121+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:31.623095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.112164+0000","last_change":"2024-09-13T18:52:40.024066+0000","last_active":"2024-09-13T18:52:43.112164+0000","last_peered":"2024-09-13T18:52:43.112164+0000","last_clean":"2024-09-13T18:52:43.112164+0000","last_became_active":"2024-09-13T18:52:40.023836+0000","last_became_peered":"2024-09-13T18:52:40.023836+0000","last_unstale":"2024-09-13T18:52:43.112164+0000","last_undegraded":"2024-09-13T18:52:43.112164+0000","last_fullsized":"2024-09-13T18:52:43.112164+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:21.678081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003900+0000","last_change":"2024-09-13T18:52:39.539929+0000","last_active":"2024-09-13T18:52:41.003900+0000","last_peered":"2024-09-13T18:52:41.003900+0000","last_clean":"2024-09-13T18:52:41.003900+0000","last_became_active":"2024-09-13T18:52:39.539691+0000","last_became_peered":"2024-09-13T18:52:39.539691+0000","last_unstale":"2024-09-13T18:52:41.003900+0000","last_undegraded":"2024-09-13T18:52:41.003900+0000","last_fullsized":"2024-09-13T18:52:41.003900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:45.703277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004701+0000","last_change":"2024-09-13T18:52:40.020096+0000","last_active":"2024-09-13T18:52:41.004701+0000","last_peered":"2024-09-13T18:52:41.004701+0000","last_clean":"2024-09-13T18:52:41.004701+0000","last_became_active":"2024-09-13T18:52:40.019628+0000","last_became_peered":"2024-09-13T18:52:40.019628+0000","last_unstale":"2024-09-13T18:52:41.004701+0000","last_undegraded":"2024-09-13T18:52:41.004701+0000","last_fullsized":"2024-09-13T18:52:41.004701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:27:19.520520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114918+0000","last_change":"2024-09-13T18:52:39.543154+0000","last_active":"2024-09-13T18:52:43.114918+0000","last_peered":"2024-09-13T18:52:43.114918+0000","last_clean":"2024-09-13T18:52:43.114918+0000","last_became_active":"2024-09-13T18:52:39.542135+0000","last_became_peered":"2024-09-13T18:52:39.542135+0000","last_unstale":"2024-09-13T18:52:43.114918+0000","last_undegraded":"2024-09-13T18:52:43.114918+0000","last_fullsized":"2024-09-13T18:52:43.114918+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:06.294664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003353+0000","last_change":"2024-09-13T18:52:40.023125+0000","last_active":"2024-09-13T18:52:41.003353+0000","last_peered":"2024-09-13T18:52:41.003353+0000","last_clean":"2024-09-13T18:52:41.003353+0000","last_became_active":"2024-09-13T18:52:40.022932+0000","last_became_peered":"2024-09-13T18:52:40.022932+0000","last_unstale":"2024-09-13T18:52:41.003353+0000","last_undegraded":"2024-09-13T18:52:41.003353+0000","last_fullsized":"2024-09-13T18:52:41.003353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:14.531571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108735+0000","last_change":"2024-09-13T18:52:39.544006+0000","last_active":"2024-09-13T18:52:43.108735+0000","last_peered":"2024-09-13T18:52:43.108735+0000","last_clean":"2024-09-13T18:52:43.108735+0000","last_became_active":"2024-09-13T18:52:39.543757+0000","last_became_peered":"2024-09-13T18:52:39.543757+0000","last_unstale":"2024-09-13T18:52:43.108735+0000","last_undegraded":"2024-09-13T18:52:43.108735+0000","last_fullsized":"2024-09-13T18:52:43.108735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:36.962384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003524+0000","last_change":"2024-09-13T18:52:40.029086+0000","last_active":"2024-09-13T18:52:41.003524+0000","last_peered":"2024-09-13T18:52:41.003524+0000","last_clean":"2024-09-13T18:52:41.003524+0000","last_became_active":"2024-09-13T18:52:40.028814+0000","last_became_peered":"2024-09-13T18:52:40.028814+0000","last_unstale":"2024-09-13T18:52:41.003524+0000","last_undegraded":"2024-09-13T18:52:41.003524+0000","last_fullsized":"2024-09-13T18:52:41.003524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:47.030493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004076+0000","last_change":"2024-09-13T18:52:39.538782+0000","last_active":"2024-09-13T18:52:41.004076+0000","last_peered":"2024-09-13T18:52:41.004076+0000","last_clean":"2024-09-13T18:52:41.004076+0000","last_became_active":"2024-09-13T18:52:39.538507+0000","last_became_peered":"2024-09-13T18:52:39.538507+0000","last_unstale":"2024-09-13T18:52:41.004076+0000","last_undegraded":"2024-09-13T18:52:41.004076+0000","last_fullsized":"2024-09-13T18:52:41.004076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:47.153558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005529+0000","last_change":"2024-09-13T18:52:40.019749+0000","last_active":"2024-09-13T18:52:41.005529+0000","last_peered":"2024-09-13T18:52:41.005529+0000","last_clean":"2024-09-13T18:52:41.005529+0000","last_became_active":"2024-09-13T18:52:40.019423+0000","last_became_peered":"2024-09-13T18:52:40.019423+0000","last_unstale":"2024-09-13T18:52:41.005529+0000","last_undegraded":"2024-09-13T18:52:41.005529+0000","last_fullsized":"2024-09-13T18:52:41.005529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:11.059208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101318+0000","last_change":"2024-09-13T18:52:39.540750+0000","last_active":"2024-09-13T18:52:43.101318+0000","last_peered":"2024-09-13T18:52:43.101318+0000","last_clean":"2024-09-13T18:52:43.101318+0000","last_became_active":"2024-09-13T18:52:39.540488+0000","last_became_peered":"2024-09-13T18:52:39.540488+0000","last_unstale":"2024-09-13T18:52:43.101318+0000","last_undegraded":"2024-09-13T18:52:43.101318+0000","last_fullsized":"2024-09-13T18:52:43.101318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:21.247436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004079+0000","last_change":"2024-09-13T18:52:40.030728+0000","last_active":"2024-09-13T18:52:41.004079+0000","last_peered":"2024-09-13T18:52:41.004079+0000","last_clean":"2024-09-13T18:52:41.004079+0000","last_became_active":"2024-09-13T18:52:40.030171+0000","last_became_peered":"2024-09-13T18:52:40.030171+0000","last_unstale":"2024-09-13T18:52:41.004079+0000","last_undegraded":"2024-09-13T18:52:41.004079+0000","last_fullsized":"2024-09-13T18:52:41.004079+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:12.433472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005638+0000","last_change":"2024-09-13T18:52:39.527966+0000","last_active":"2024-09-13T18:52:41.005638+0000","last_peered":"2024-09-13T18:52:41.005638+0000","last_clean":"2024-09-13T18:52:41.005638+0000","last_became_active":"2024-09-13T18:52:39.527700+0000","last_became_peered":"2024-09-13T18:52:39.527700+0000","last_unstale":"2024-09-13T18:52:41.005638+0000","last_undegraded":"2024-09-13T18:52:41.005638+0000","last_fullsized":"2024-09-13T18:52:41.005638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:25.777609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005106+0000","last_change":"2024-09-13T18:52:40.031203+0000","last_active":"2024-09-13T18:52:41.005106+0000","last_peered":"2024-09-13T18:52:41.005106+0000","last_clean":"2024-09-13T18:52:41.005106+0000","last_became_active":"2024-09-13T18:52:40.030981+0000","last_became_peered":"2024-09-13T18:52:40.030981+0000","last_unstale":"2024-09-13T18:52:41.005106+0000","last_undegraded":"2024-09-13T18:52:41.005106+0000","last_fullsized":"2024-09-13T18:52:41.005106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:45.859207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004891+0000","last_change":"2024-09-13T18:52:39.544025+0000","last_active":"2024-09-13T18:52:41.004891+0000","last_peered":"2024-09-13T18:52:41.004891+0000","last_clean":"2024-09-13T18:52:41.004891+0000","last_became_active":"2024-09-13T18:52:39.541730+0000","last_became_peered":"2024-09-13T18:52:39.541730+0000","last_unstale":"2024-09-13T18:52:41.004891+0000","last_undegraded":"2024-09-13T18:52:41.004891+0000","last_fullsized":"2024-09-13T18:52:41.004891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:41.752738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.112202+0000","last_change":"2024-09-13T18:52:40.034013+0000","last_active":"2024-09-13T18:52:43.112202+0000","last_peered":"2024-09-13T18:52:43.112202+0000","last_clean":"2024-09-13T18:52:43.112202+0000","last_became_active":"2024-09-13T18:52:40.033548+0000","last_became_peered":"2024-09-13T18:52:40.033548+0000","last_unstale":"2024-09-13T18:52:43.112202+0000","last_undegraded":"2024-09-13T18:52:43.112202+0000","last_fullsized":"2024-09-13T18:52:43.112202+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.004902+0000","last_change":"2024-09-13T18:52:39.542608+0000","last_active":"2024-09-13T18:52:41.004902+0000","last_peered":"2024-09-13T18:52:41.004902+0000","last_clean":"2024-09-13T18:52:41.004902+0000","last_became_active":"2024-09-13T18:52:39.542415+0000","last_became_peered":"2024-09-13T18:52:39.542415+0000","last_unstale":"2024-09-13T18:52:41.004902+0000","last_undegraded":"2024-09-13T18:52:41.004902+0000","last_fullsized":"2024-09-13T18:52:41.004902+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:16.120961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108351+0000","last_change":"2024-09-13T18:52:40.022705+0000","last_active":"2024-09-13T18:52:43.108351+0000","last_peered":"2024-09-13T18:52:43.108351+0000","last_clean":"2024-09-13T18:52:43.108351+0000","last_became_active":"2024-09-13T18:52:40.022449+0000","last_became_peered":"2024-09-13T18:52:40.022449+0000","last_unstale":"2024-09-13T18:52:43.108351+0000","last_undegraded":"2024-09-13T18:52:43.108351+0000","last_fullsized":"2024-09-13T18:52:43.108351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:29.841888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.038131+0000","last_change":"2024-09-13T18:52:39.537099+0000","last_active":"2024-09-13T18:52:41.038131+0000","last_peered":"2024-09-13T18:52:41.038131+0000","last_clean":"2024-09-13T18:52:41.038131+0000","last_became_active":"2024-09-13T18:52:39.536543+0000","last_became_peered":"2024-09-13T18:52:39.536543+0000","last_unstale":"2024-09-13T18:52:41.038131+0000","last_undegraded":"2024-09-13T18:52:41.038131+0000","last_fullsized":"2024-09-13T18:52:41.038131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:25.837302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111744+0000","last_change":"2024-09-13T18:52:40.021255+0000","last_active":"2024-09-13T18:52:43.111744+0000","last_peered":"2024-09-13T18:52:43.111744+0000","last_clean":"2024-09-13T18:52:43.111744+0000","last_became_active":"2024-09-13T18:52:40.020958+0000","last_became_peered":"2024-09-13T18:52:40.020958+0000","last_unstale":"2024-09-13T18:52:43.111744+0000","last_undegraded":"2024-09-13T18:52:43.111744+0000","last_fullsized":"2024-09-13T18:52:43.111744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:54.129432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.103505+0000","last_change":"2024-09-13T18:52:39.537992+0000","last_active":"2024-09-13T18:52:43.103505+0000","last_peered":"2024-09-13T18:52:43.103505+0000","last_clean":"2024-09-13T18:52:43.103505+0000","last_became_active":"2024-09-13T18:52:39.537737+0000","last_became_peered":"2024-09-13T18:52:39.537737+0000","last_unstale":"2024-09-13T18:52:43.103505+0000","last_undegraded":"2024-09-13T18:52:43.103505+0000","last_fullsized":"2024-09-13T18:52:43.103505+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:20.658239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.108492+0000","last_change":"2024-09-13T18:52:40.030833+0000","last_active":"2024-09-13T18:52:43.108492+0000","last_peered":"2024-09-13T18:52:43.108492+0000","last_clean":"2024-09-13T18:52:43.108492+0000","last_became_active":"2024-09-13T18:52:40.030125+0000","last_became_peered":"2024-09-13T18:52:40.030125+0000","last_unstale":"2024-09-13T18:52:43.108492+0000","last_undegraded":"2024-09-13T18:52:43.108492+0000","last_fullsized":"2024-09-13T18:52:43.108492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:40.718943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114830+0000","last_change":"2024-09-13T18:52:39.540675+0000","last_active":"2024-09-13T18:52:43.114830+0000","last_peered":"2024-09-13T18:52:43.114830+0000","last_clean":"2024-09-13T18:52:43.114830+0000","last_became_active":"2024-09-13T18:52:39.539673+0000","last_became_peered":"2024-09-13T18:52:39.539673+0000","last_unstale":"2024-09-13T18:52:43.114830+0000","last_undegraded":"2024-09-13T18:52:43.114830+0000","last_fullsized":"2024-09-13T18:52:43.114830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:39.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003749+0000","last_change":"2024-09-13T18:52:40.017262+0000","last_active":"2024-09-13T18:52:41.003749+0000","last_peered":"2024-09-13T18:52:41.003749+0000","last_clean":"2024-09-13T18:52:41.003749+0000","last_became_active":"2024-09-13T18:52:40.017000+0000","last_became_peered":"2024-09-13T18:52:40.017000+0000","last_unstale":"2024-09-13T18:52:41.003749+0000","last_undegraded":"2024-09-13T18:52:41.003749+0000","last_fullsized":"2024-09-13T18:52:41.003749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:36.819884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114743+0000","last_change":"2024-09-13T18:52:39.547187+0000","last_active":"2024-09-13T18:52:43.114743+0000","last_peered":"2024-09-13T18:52:43.114743+0000","last_clean":"2024-09-13T18:52:43.114743+0000","last_became_active":"2024-09-13T18:52:39.546931+0000","last_became_peered":"2024-09-13T18:52:39.546931+0000","last_unstale":"2024-09-13T18:52:43.114743+0000","last_undegraded":"2024-09-13T18:52:43.114743+0000","last_fullsized":"2024-09-13T18:52:43.114743+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:34:52.764864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111868+0000","last_change":"2024-09-13T18:52:40.021631+0000","last_active":"2024-09-13T18:52:43.111868+0000","last_peered":"2024-09-13T18:52:43.111868+0000","last_clean":"2024-09-13T18:52:43.111868+0000","last_became_active":"2024-09-13T18:52:40.021398+0000","last_became_peered":"2024-09-13T18:52:40.021398+0000","last_unstale":"2024-09-13T18:52:43.111868+0000","last_undegraded":"2024-09-13T18:52:43.111868+0000","last_fullsized":"2024-09-13T18:52:43.111868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:46.723119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111826+0000","last_change":"2024-09-13T18:52:39.541321+0000","last_active":"2024-09-13T18:52:43.111826+0000","last_peered":"2024-09-13T18:52:43.111826+0000","last_clean":"2024-09-13T18:52:43.111826+0000","last_became_active":"2024-09-13T18:52:39.540219+0000","last_became_peered":"2024-09-13T18:52:39.540219+0000","last_unstale":"2024-09-13T18:52:43.111826+0000","last_undegraded":"2024-09-13T18:52:43.111826+0000","last_fullsized":"2024-09-13T18:52:43.111826+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:39.699101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.112050+0000","last_change":"2024-09-13T18:52:40.032849+0000","last_active":"2024-09-13T18:52:43.112050+0000","last_peered":"2024-09-13T18:52:43.112050+0000","last_clean":"2024-09-13T18:52:43.112050+0000","last_became_active":"2024-09-13T18:52:40.032552+0000","last_became_peered":"2024-09-13T18:52:40.032552+0000","last_unstale":"2024-09-13T18:52:43.112050+0000","last_undegraded":"2024-09-13T18:52:43.112050+0000","last_fullsized":"2024-09-13T18:52:43.112050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:53.136644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.003769+0000","last_change":"2024-09-13T18:52:39.539575+0000","last_active":"2024-09-13T18:52:41.003769+0000","last_peered":"2024-09-13T18:52:41.003769+0000","last_clean":"2024-09-13T18:52:41.003769+0000","last_became_active":"2024-09-13T18:52:39.539262+0000","last_became_peered":"2024-09-13T18:52:39.539262+0000","last_unstale":"2024-09-13T18:52:41.003769+0000","last_undegraded":"2024-09-13T18:52:41.003769+0000","last_fullsized":"2024-09-13T18:52:41.003769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:52.358601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101488+0000","last_change":"2024-09-13T18:52:40.034086+0000","last_active":"2024-09-13T18:52:43.101488+0000","last_peered":"2024-09-13T18:52:43.101488+0000","last_clean":"2024-09-13T18:52:43.101488+0000","last_became_active":"2024-09-13T18:52:40.033070+0000","last_became_peered":"2024-09-13T18:52:40.033070+0000","last_unstale":"2024-09-13T18:52:43.101488+0000","last_undegraded":"2024-09-13T18:52:43.101488+0000","last_fullsized":"2024-09-13T18:52:43.101488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:05.838347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.111788+0000","last_change":"2024-09-13T18:52:39.541633+0000","last_active":"2024-09-13T18:52:43.111788+0000","last_peered":"2024-09-13T18:52:43.111788+0000","last_clean":"2024-09-13T18:52:43.111788+0000","last_became_active":"2024-09-13T18:52:39.541337+0000","last_became_peered":"2024-09-13T18:52:39.541337+0000","last_unstale":"2024-09-13T18:52:43.111788+0000","last_undegraded":"2024-09-13T18:52:43.111788+0000","last_fullsized":"2024-09-13T18:52:43.111788+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101527+0000","last_change":"2024-09-13T18:52:40.015710+0000","last_active":"2024-09-13T18:52:43.101527+0000","last_peered":"2024-09-13T18:52:43.101527+0000","last_clean":"2024-09-13T18:52:43.101527+0000","last_became_active":"2024-09-13T18:52:40.015468+0000","last_became_peered":"2024-09-13T18:52:40.015468+0000","last_unstale":"2024-09-13T18:52:43.101527+0000","last_undegraded":"2024-09-13T18:52:43.101527+0000","last_fullsized":"2024-09-13T18:52:43.101527+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:01.057386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.101187+0000","last_change":"2024-09-13T18:52:39.529014+0000","last_active":"2024-09-13T18:52:43.101187+0000","last_peered":"2024-09-13T18:52:43.101187+0000","last_clean":"2024-09-13T18:52:43.101187+0000","last_became_active":"2024-09-13T18:52:39.528776+0000","last_became_peered":"2024-09-13T18:52:39.528776+0000","last_unstale":"2024-09-13T18:52:43.101187+0000","last_undegraded":"2024-09-13T18:52:43.101187+0000","last_fullsized":"2024-09-13T18:52:43.101187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.082726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":10,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:43.114809+0000","last_change":"2024-09-13T18:52:40.023475+0000","last_active":"2024-09-13T18:52:43.114809+0000","last_peered":"2024-09-13T18:52:43.114809+0000","last_clean":"2024-09-13T18:52:43.114809+0000","last_became_active":"2024-09-13T18:52:40.023229+0000","last_became_peered":"2024-09-13T18:52:40.023229+0000","last_unstale":"2024-09-13T18:52:43.114809+0000","last_undegraded":"2024-09-13T18:52:43.114809+0000","last_fullsized":"2024-09-13T18:52:43.114809+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:39.498759+0000","last_clean_scrub_stamp":"2024-09-13T18:52:39.498759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:29.158027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-13T18:52:41.005304+0000","last_change":"2024-09-13T18:52:39.539885+0000","last_active":"2024-09-13T18:52:41.005304+0000","last_peered":"2024-09-13T18:52:41.005304+0000","last_clean":"2024-09-13T18:52:41.005304+0000","last_became_active":"2024-09-13T18:52:39.539653+0000","last_became_peered":"2024-09-13T18:52:39.539653+0000","last_unstale":"2024-09-13T18:52:41.005304+0000","last_undegraded":"2024-09-13T18:52:41.005304+0000","last_fullsized":"2024-09-13T18:52:41.005304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:52:38.478917+0000","last_clean_scrub_stamp":"2024-09-13T18:52:38.478917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.093975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-13T18:52:40.013967+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:52:40.013967+0000","last_peered":"2024-09-13T18:52:40.013967+0000","last_clean":"2024-09-13T18:52:40.013967+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:52:40.013967+0000","last_undegraded":"2024-09-13T18:52:40.013967+0000","last_fullsized":"2024-09-13T18:52:40.013967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1589248,"data_stored":1044799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.093,"15min":1.0980000000000001},"min":{"1min":0.76300000000000001,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.498,"5min":1.72,"15min":1.72},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0780000000000001,"15min":1.1259999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.409,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2629999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1100000000000001,"15min":1.1339999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.3520000000000001,"5min":1.619,"15min":1.619},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.101,"5min":1.1499999999999999,"15min":1.216},"min":{"1min":0.71999999999999997,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4379999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.999}]},{"osd":2,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2769999999999999,"15min":1.337},"min":{"1min":0.873,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6499999999999999,"5min":1.885,"15min":1.885},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1910000000000001,"15min":1.2070000000000001},"min":{"1min":0.94499999999999995,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4650000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1439999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2609999999999999,"15min":1.2729999999999999},"min":{"1min":0.80600000000000005,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4810000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.3440000000000001,"15min":1.4319999999999999},"min":{"1min":1.0109999999999999,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.629,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1060000000000001,"15min":1.1140000000000001},"min":{"1min":0.751,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.462,"5min":1.552,"15min":1.552},"last":1.236},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.21,"15min":1.1859999999999999},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.46,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":1.054}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2509999999999999,"15min":1.3169999999999999},"min":{"1min":0.72999999999999998,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.579,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.2110000000000001,"15min":1.224},"min":{"1min":0.88400000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6919999999999999,"5min":1.714,"15min":1.714},"last":1.448}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.381,"15min":1.401},"min":{"1min":0.90300000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.625,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.323},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.385,"15min":1.417},"min":{"1min":1.036,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.5860000000000001,"5min":1.845,"15min":1.845},"last":1.1890000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574920,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":1003520,"data_stored":455973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.099,"15min":1.139},"min":{"1min":0.79600000000000004,"5min":0.371,"15min":0.371},"max":{"1min":1.5049999999999999,"5min":3.0369999999999999,"15min":3.0369999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1100000000000001,"15min":1.1639999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2789999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.109,"15min":1.113},"min":{"1min":0.68700000000000006,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.5589999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.159,"15min":1.1930000000000001},"min":{"1min":0.72199999999999998,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.385,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.2649999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.246,"15min":1.4239999999999999},"min":{"1min":0.77600000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":3.7480000000000002,"15min":3.7480000000000002},"last":1.23},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.274,"15min":1.47},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5900000000000001,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.85899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.3340000000000001,"15min":1.496},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5629999999999999,"5min":4.883,"15min":4.883},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.3340000000000001,"15min":1.5129999999999999},"min":{"1min":1,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.591,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":1.4570000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.2030000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.5129999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.165,"5min":1.2609999999999999,"15min":1.331},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6240000000000001,"5min":2.077,"15min":2.077},"last":1.3620000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3160000000000001,"15min":1.4099999999999999},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":1.5469999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.4219999999999999,"15min":1.478},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.657,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":0.97299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:52:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.385,"15min":1.4590000000000001},"min":{"1min":0.876,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.4079999999999999,"15min":1.5209999999999999},"min":{"1min":1.0740000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.5309999999999999,"5min":2.367,"15min":2.367},"last":1.5600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574919,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":454443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.077,"15min":1.1839999999999999},"min":{"1min":0.65700000000000003,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.28,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.377},{"interface":"front","average":{"1min":1.085,"5min":1.135,"15min":1.159},"min":{"1min":0.78300000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4450000000000001,"5min":2.278,"15min":2.278},"last":1.2889999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2030000000000001,"15min":1.2689999999999999},"min":{"1min":0.91500000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5589999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.127},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1419999999999999,"15min":1.1879999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.5649999999999999,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.212,"15min":1.2809999999999999},"min":{"1min":0.76300000000000001,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3999999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.173,"15min":1.252},"min":{"1min":0.81699999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4159999999999999,"5min":2.157,"15min":2.157},"last":0.90200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.284,"15min":1.369},"min":{"1min":0.85699999999999998,"5min":0.749,"15min":0.749},"max":{"1min":1.6160000000000001,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.329,"15min":1.4319999999999999},"min":{"1min":0.94199999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.569,"5min":2.9470000000000001,"15min":2.9470000000000001},"last":1.3400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.1319999999999999,"15min":1.21},"min":{"1min":0.74399999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.478,"5min":1.8500000000000001,"15min":1.8500000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2350000000000001,"15min":1.2749999999999999},"min":{"1min":0.872,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.613,"5min":1.974,"15min":1.974},"last":1.425}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2569999999999999,"15min":1.2989999999999999},"min":{"1min":0.98099999999999998,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.494,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.27,"15min":1.3440000000000001},"min":{"1min":0.871,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.601,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.6040000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.391,"15min":1.429},"min":{"1min":1.1879999999999999,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6120000000000001,"5min":2.169,"15min":2.169},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4350000000000001,"15min":1.5109999999999999},"min":{"1min":1.1990000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.659,"5min":2.8140000000000001,"15min":2.8140000000000001},"last":1.5449999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":1011712,"data_stored":456077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.109,"15min":1.129},"min":{"1min":0.86499999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.502,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1379999999999999,"15min":1.1399999999999999},"min":{"1min":0.84199999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.575,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.877}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":0.88600000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6739999999999999,"5min":2.6930000000000001,"15min":2.6930000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.2749999999999999,"15min":1.3240000000000001},"min":{"1min":0.75,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5740000000000001,"5min":2.423,"15min":2.423},"last":1.3120000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.2310000000000001,"15min":1.284},"min":{"1min":0.999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.476,"5min":1.99,"15min":1.99},"last":1.079},{"interface":"front","average":{"1min":1.302,"5min":1.329,"15min":1.381},"min":{"1min":0.99099999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6519999999999999,"5min":2.335,"15min":2.335},"last":1.3660000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.22,"15min":1.3049999999999999},"min":{"1min":0.78400000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.573,"5min":2.621,"15min":2.621},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.206,"15min":1.264},"min":{"1min":0.89400000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3779999999999999,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.2549999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.1919999999999999,"15min":1.2969999999999999},"min":{"1min":0.80200000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.2969999999999999,"5min":2.274,"15min":2.274},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.2529999999999999,"15min":1.3140000000000001},"min":{"1min":0.91500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.831,"5min":2.266,"15min":2.266},"last":1.109}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.252,"15min":1.3480000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.5449999999999999,"5min":2.4710000000000001,"15min":2.4710000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3879999999999999,"15min":1.458},"min":{"1min":0.95299999999999996,"5min":0.751,"15min":0.751},"max":{"1min":1.6830000000000001,"5min":2.5,"15min":2.5},"last":1.228}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3859999999999999,"15min":1.458},"min":{"1min":1.0029999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7969999999999999,"5min":2.395,"15min":2.395},"last":1.331},{"interface":"front","average":{"1min":1.369,"5min":1.375,"15min":1.4610000000000001},"min":{"1min":0.84199999999999997,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.655,"5min":2.415,"15min":2.415},"last":1.161}]}]},{"osd":3,"up_from":13,"seq":55834574920,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32088,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339752,"statfs":{"total":96636764160,"available":96603906048,"internally_reserved":0,"allocated":995328,"data_stored":454991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.85199999999999998,"15min":0.89500000000000002},"min":{"1min":0.64600000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2969999999999999,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.85799999999999998,"15min":0.88700000000000001},"min":{"1min":0.65000000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.2889999999999999,"5min":1.444,"15min":1.444},"last":0.72499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.85799999999999998,"15min":0.874},"min":{"1min":0.72299999999999998,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98899999999999999,"15min":1.101},"min":{"1min":0.61299999999999999,"5min":0.505,"15min":0.505},"max":{"1min":1.3120000000000001,"5min":4.0149999999999997,"15min":4.0149999999999997},"last":1.147}]},{"osd":2,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.63700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.77200000000000002},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.145,"15min":1.167},"min":{"1min":0.76500000000000001,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4430000000000001,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.232}]},{"osd":4,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.1950000000000001,"15min":1.2430000000000001},"min":{"1min":1.0369999999999999,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.5329999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.135},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1759999999999999,"15min":1.234},"min":{"1min":0.89300000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.484,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.1950000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.2490000000000001,"15min":1.3149999999999999},"min":{"1min":0.998,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5760000000000001,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.115},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3080000000000001,"15min":1.3740000000000001},"min":{"1min":1.0629999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.9870000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.286}]},{"osd":6,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.351,"15min":1.427},"min":{"1min":1.1559999999999999,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.9239999999999999,"5min":2.714,"15min":2.714},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3280000000000001,"15min":1.421},"min":{"1min":0.94599999999999995,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":1.72,"5min":2.52,"15min":2.52},"last":1.024}]},{"osd":7,"last update":"Fri Sep 13 18:52:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.363,"15min":1.5089999999999999},"min":{"1min":0.96699999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6719999999999999,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.349,"5min":1.335,"15min":1.431},"min":{"1min":1.097,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.6339999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.272}]}]},{"osd":2,"up_from":13,"seq":55834574919,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1003520,"data_stored":455151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.83499999999999996,"15min":0.97699999999999998},"min":{"1min":0.55900000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.242,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.874,"15min":1.0429999999999999},"min":{"1min":0.59799999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.2669999999999999,"5min":4.6349999999999998,"15min":4.6349999999999998},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.92600000000000005,"15min":1.127},"min":{"1min":0.65900000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.7350000000000001,"5min":4.1479999999999997,"15min":4.1479999999999997},"last":0.60499999999999998},{"interface":"front","average":{"1min":1.085,"5min":1.125,"15min":1.23},"min":{"1min":0.68100000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.268,"5min":4.7009999999999996,"15min":4.7009999999999996},"last":1.1080000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1830000000000001,"15min":1.3160000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.7749999999999999,"5min":4.1920000000000002,"15min":4.1920000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0720000000000001,"15min":1.224},"min":{"1min":0.77600000000000002,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4730000000000001,"5min":3.4590000000000001,"15min":3.4590000000000001},"last":0.86099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.3300000000000001,"15min":1.6399999999999999},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.421,"5min":8.6989999999999998,"15min":8.6989999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3049999999999999,"15min":1.4490000000000001},"min":{"1min":0.95299999999999996,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.569,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.1930000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.353,"15min":1.508},"min":{"1min":0.99099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":1.5469999999999999,"5min":4.7590000000000003,"15min":4.7590000000000003},"last":1.296},{"interface":"front","average":{"1min":1.238,"5min":1.306,"15min":1.482},"min":{"1min":0.89500000000000002,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5109999999999999,"5min":4.335,"15min":4.335},"last":1.2270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.3480000000000001,"15min":1.5349999999999999},"min":{"1min":1.04,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5980000000000001,"5min":4.3730000000000002,"15min":4.3730000000000002},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.224,"5min":1.3899999999999999,"15min":1.744},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.3999999999999999,"5min":8.6300000000000008,"15min":8.6300000000000008},"last":1.1659999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:15 2024","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.399,"15min":1.5589999999999999},"min":{"1min":1.069,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.4690000000000001,"5min":4.6699999999999999,"15min":4.6699999999999999},"last":1.359},{"interface":"front","average":{"1min":1.385,"5min":1.429,"15min":1.6140000000000001},"min":{"1min":1.145,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.6699999999999999,"5min":4.4050000000000002,"15min":4.4050000000000002},"last":1.1439999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":999424,"data_stored":454521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81100000000000005,"15min":0.88300000000000001},"min":{"1min":0.58799999999999997,"5min":0.376,"15min":0.376},"max":{"1min":1.264,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.88100000000000001,"15min":1.048},"min":{"1min":0.54000000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":6.1760000000000002,"15min":6.1760000000000002},"last":0.88}]},{"osd":2,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.083,"15min":1.1870000000000001},"min":{"1min":0.66300000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5649999999999999,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.997,"15min":1.069},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.3069999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1699999999999999,"15min":1.3149999999999999},"min":{"1min":0.69099999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.363,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.411},"min":{"1min":0.71199999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4419999999999999,"5min":10.368,"15min":10.368},"last":1.4159999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.2889999999999999,"15min":1.381},"min":{"1min":1.0429999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.609,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.179},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2789999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4690000000000001,"5min":2.911,"15min":2.911},"last":1.5109999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.3560000000000001,"15min":1.7250000000000001},"min":{"1min":0.98399999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.494,"5min":10.214,"15min":10.214},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.353,"15min":1.48},"min":{"1min":1.0860000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.651,"5min":2.8849999999999998,"15min":2.8849999999999998},"last":1.3109999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3640000000000001,"15min":1.5740000000000001},"min":{"1min":1.054,"5min":0.874,"15min":0.874},"max":{"1min":1.4790000000000001,"5min":6.032,"15min":6.032},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4159999999999999,"15min":1.772},"min":{"1min":1.0580000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6100000000000001,"5min":10.112,"15min":10.112},"last":1.3600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:52:16 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4790000000000001,"15min":1.833},"min":{"1min":1.111,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.5169999999999999,"5min":10.172000000000001,"15min":10.172000000000001},"last":1.276},{"interface":"front","average":{"1min":1.345,"5min":1.4199999999999999,"15min":1.5680000000000001},"min":{"1min":1.1519999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.552,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":1.3979999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574919,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1585152,"data_stored":1044777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81499999999999995,"15min":0.99099999999999999},"min":{"1min":0.52700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.1339999999999999,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.879,"15min":1.002},"min":{"1min":0.625,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3740000000000001,"5min":2.7450000000000001,"15min":2.7450000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":1.143},"min":{"1min":0.69399999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.262,"5min":3.7349999999999999,"15min":3.7349999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.036,"15min":1.2110000000000001},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":0.97899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.056,"15min":1.194},"min":{"1min":0.52100000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3959999999999999,"5min":4.093,"15min":4.093},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.216,"15min":1.417},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4930000000000001,"5min":4.7439999999999998,"15min":4.7439999999999998},"last":0.84099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2729999999999999,"15min":1.444},"min":{"1min":0.82999999999999996,"5min":0.745,"15min":0.745},"max":{"1min":1.5049999999999999,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3069999999999999,"15min":1.456},"min":{"1min":0.94899999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.458,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":0.92400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3839999999999999,"15min":1.6120000000000001},"min":{"1min":0.92400000000000004,"5min":0.753,"15min":0.753},"max":{"1min":1.4950000000000001,"5min":4.9390000000000001,"15min":4.9390000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.3400000000000001,"15min":1.54},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":1.675,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.0660000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.349,"15min":1.55},"min":{"1min":1.1100000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.528,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":1.087},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.423,"15min":1.6950000000000001},"min":{"1min":1.056,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.577,"5min":4.8570000000000002,"15min":4.8570000000000002},"last":1.1679999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:52:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.409,"15min":1.595},"min":{"1min":0.99199999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.756,"5min":3.056,"15min":3.056},"last":1.117},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.387,"15min":1.617},"min":{"1min":1.095,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.546,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":1.0209999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:52:49.687 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:52:49.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:52:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.895+0000 7fd3dac00700 1 Processor -- start 2024-09-13T18:52:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.895+0000 7fd3dac00700 1 -- start start 2024-09-13T18:52:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3dac00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3d41611e0 0x7fd3d406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3dac00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3d40b25b0 0x7fd3d40b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3dac00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d4165710 con 0x7fd3d4160e00 2024-09-13T18:52:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3dac00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d406d320 con 0x7fd3d40b25b0 2024-09-13T18:52:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3dac00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40b2f20 con 0x7fd3d41611e0 2024-09-13T18:52:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3da200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3d40b25b0 0x7fd3d40b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3da200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3d40b25b0 0x7fd3d40b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47760/0 (socket says 172.21.15.81:47760) 2024-09-13T18:52:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.899+0000 7fd3da200700 1 -- 172.21.15.81:0/408302342 learned_addr learned my addr 172.21.15.81:0/408302342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3d8e00700 1 --2- 172.21.15.81:0/408302342 >> v2:172.21.15.178:3300/0 conn(0x7fd3d41611e0 0x7fd3d406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3da200700 1 -- 172.21.15.81:0/408302342 >> v2:172.21.15.178:3300/0 conn(0x7fd3d41611e0 msgr2=0x7fd3d406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3da200700 1 --2- 172.21.15.81:0/408302342 >> v2:172.21.15.178:3300/0 conn(0x7fd3d41611e0 0x7fd3d406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3da200700 1 -- 172.21.15.81:0/408302342 >> v1:172.21.15.81:6789/0 conn(0x7fd3d4160e00 legacy=0x7fd3d406cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3da200700 1 -- 172.21.15.81:0/408302342 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4164b00 con 0x7fd3d40b25b0 2024-09-13T18:52:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3d8e00700 1 --2- 172.21.15.81:0/408302342 >> v2:172.21.15.178:3300/0 conn(0x7fd3d41611e0 0x7fd3d406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:49.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3da200700 1 --2- 172.21.15.81:0/408302342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d40b25b0 0x7fd3d40b29e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd3d406aae0 tx=0x7fd3cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7527a26b26f493 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:49.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3d3e00700 1 -- 172.21.15.81:0/408302342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00e070 con 0x7fd3d40b25b0 2024-09-13T18:52:49.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3d3e00700 1 -- 172.21.15.81:0/408302342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00b9c0 con 0x7fd3d40b25b0 2024-09-13T18:52:49.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3d3e00700 1 -- 172.21.15.81:0/408302342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00bd70 con 0x7fd3d40b25b0 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 -- 172.21.15.81:0/408302342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d40b25b0 msgr2=0x7fd3d40b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 --2- 172.21.15.81:0/408302342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d40b25b0 0x7fd3d40b29e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd3d406aae0 tx=0x7fd3cc00b330 comp rx=0 tx=0).stop 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 -- 172.21.15.81:0/408302342 shutdown_connections 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 --2- 172.21.15.81:0/408302342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d40b25b0 0x7fd3d40b29e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 --2- 172.21.15.81:0/408302342 >> v2:172.21.15.178:3300/0 conn(0x7fd3d41611e0 0x7fd3d406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 -- 172.21.15.81:0/408302342 >> 172.21.15.81:0/408302342 conn(0x7fd3d4066270 msgr2=0x7fd3d4071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 -- 172.21.15.81:0/408302342 shutdown_connections 2024-09-13T18:52:49.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.903+0000 7fd3dac00700 1 -- 172.21.15.81:0/408302342 wait complete. 2024-09-13T18:52:49.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.907+0000 7fd3dac00700 1 Processor -- start 2024-09-13T18:52:49.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.907+0000 7fd3dac00700 1 -- start start 2024-09-13T18:52:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.907+0000 7fd3dac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d40b25b0 0x7fd3d414da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 0x7fd3d4164000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d41611e0 0x7fd3d415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41ebb80 con 0x7fd3d4160e00 2024-09-13T18:52:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4161fc0 con 0x7fd3d41611e0 2024-09-13T18:52:49.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4162260 con 0x7fd3d40b25b0 2024-09-13T18:52:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 0x7fd3d4164000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 0x7fd3d4164000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47776/0 (socket says 172.21.15.81:47776) 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 -- 172.21.15.81:0/265951741 learned_addr learned my addr 172.21.15.81:0/265951741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d9800700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d40b25b0 0x7fd3d414da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3da200700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d41611e0 0x7fd3d415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 -- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d40b25b0 msgr2=0x7fd3d414da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d40b25b0 0x7fd3d414da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 -- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d41611e0 msgr2=0x7fd3d415e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d41611e0 0x7fd3d415e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 -- 172.21.15.81:0/265951741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc009b30 con 0x7fd3d4160e00 2024-09-13T18:52:49.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3da200700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d41611e0 0x7fd3d415e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d8e00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 0x7fd3d4164000 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e810 tx=0x7fd3c000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0013610 con 0x7fd3d4160e00 2024-09-13T18:52:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0013770 con 0x7fd3d4160e00 2024-09-13T18:52:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d4162540 con 0x7fd3d4160e00 2024-09-13T18:52:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0013b00 con 0x7fd3d4160e00 2024-09-13T18:52:49.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d414dfc0 con 0x7fd3d4160e00 2024-09-13T18:52:49.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.911+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d41ebd30 con 0x7fd3d4160e00 2024-09-13T18:52:49.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.915+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3c0013c60 con 0x7fd3d4160e00 2024-09-13T18:52:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.915+0000 7fd3d1600700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:49.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.915+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd3c0083e30 con 0x7fd3d4160e00 2024-09-13T18:52:49.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.915+0000 7fd3d9800700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:49.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.919+0000 7fd3d9800700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8000f60 tx=0x7fd3c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:49.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:49.923+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3d41ebd30 con 0x7fd3d4160e00 2024-09-13T18:52:50.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.171+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd3d40b29e0 con 0x7fd3d4160e00 2024-09-13T18:52:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.179+0000 7fd3d1600700 1 -- 172.21.15.81:0/265951741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd3c00210e0 con 0x7fd3d4160e00 2024-09-13T18:52:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 msgr2=0x7fd3b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8000f60 tx=0x7fd3c8009040 comp rx=0 tx=0).stop 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 msgr2=0x7fd3d4164000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 0x7fd3d4164000 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000e810 tx=0x7fd3c000eb20 comp rx=0 tx=0).stop 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 shutdown_connections 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d41611e0 0x7fd3d415e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4160e00 0x7fd3d4164000 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 --2- 172.21.15.81:0/265951741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d40b25b0 0x7fd3d414da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 >> 172.21.15.81:0/265951741 conn(0x7fd3d4066270 msgr2=0x7fd3d40b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 shutdown_connections 2024-09-13T18:52:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.183+0000 7fd3dac00700 1 -- 172.21.15.81:0/265951741 wait complete. 2024-09-13T18:52:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-13T18:52:50.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.379+0000 7f11a1a00700 1 Processor -- start 2024-09-13T18:52:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.379+0000 7f11a1a00700 1 -- start start 2024-09-13T18:52:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f11a1a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f119c13ebc0 0x7f119c06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f11a1a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f119c06ab10 0x7f119c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f11a1a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c13fcc0 con 0x7f119c0703d0 2024-09-13T18:52:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f11a1a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c06af50 con 0x7f119c06ab10 2024-09-13T18:52:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f11a1a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c13f0f0 con 0x7f119c13ebc0 2024-09-13T18:52:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f1192000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f119c06ab10 0x7f119c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f119aa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f119c13ebc0 0x7f119c06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f119b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f119c0703d0 0x7f119c15d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51012/0 (socket says 172.21.15.81:51012) 2024-09-13T18:52:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.383+0000 7f119b400700 1 -- 172.21.15.81:0/795535762 learned_addr learned my addr 172.21.15.81:0/795535762 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119a000700 1 -- 172.21.15.81:0/795535762 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384750891 0 0) 0x7f119c13fcc0 con 0x7f119c0703d0 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119a000700 1 -- 172.21.15.81:0/795535762 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11800035d0 con 0x7f119c0703d0 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119aa00700 1 -- 172.21.15.81:0/795535762 >> v2:172.21.15.81:3300/0 conn(0x7f119c06ab10 msgr2=0x7f119c06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119aa00700 1 --2- 172.21.15.81:0/795535762 >> v2:172.21.15.81:3300/0 conn(0x7f119c06ab10 0x7f119c06fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119aa00700 1 -- 172.21.15.81:0/795535762 >> v1:172.21.15.81:6789/0 conn(0x7f119c0703d0 legacy=0x7f119c15d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119aa00700 1 -- 172.21.15.81:0/795535762 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c13f390 con 0x7f119c13ebc0 2024-09-13T18:52:50.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f1192000700 1 --2- 172.21.15.81:0/795535762 >> v2:172.21.15.81:3300/0 conn(0x7f119c06ab10 0x7f119c06fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:50.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119aa00700 1 --2- 172.21.15.81:0/795535762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c06a5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f119c0cc5b0 tx=0x7f118c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bd9fe9d3a4ea0a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:50.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119a000700 1 -- 172.21.15.81:0/795535762 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00e070 con 0x7f119c13ebc0 2024-09-13T18:52:50.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119a000700 1 -- 172.21.15.81:0/795535762 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c00bb20 con 0x7f119c13ebc0 2024-09-13T18:52:50.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f119a000700 1 -- 172.21.15.81:0/795535762 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c00be90 con 0x7f119c13ebc0 2024-09-13T18:52:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 -- 172.21.15.81:0/795535762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 msgr2=0x7f119c06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 --2- 172.21.15.81:0/795535762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c06a5d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f119c0cc5b0 tx=0x7f118c00b330 comp rx=0 tx=0).stop 2024-09-13T18:52:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 -- 172.21.15.81:0/795535762 shutdown_connections 2024-09-13T18:52:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 --2- 172.21.15.81:0/795535762 >> v2:172.21.15.81:3300/0 conn(0x7f119c06ab10 0x7f119c06fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 --2- 172.21.15.81:0/795535762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c06a5d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 -- 172.21.15.81:0/795535762 >> 172.21.15.81:0/795535762 conn(0x7f119c0b08d0 msgr2=0x7f119c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 -- 172.21.15.81:0/795535762 shutdown_connections 2024-09-13T18:52:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.387+0000 7f11a1a00700 1 -- 172.21.15.81:0/795535762 wait complete. 2024-09-13T18:52:50.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.391+0000 7f11a1a00700 1 Processor -- start 2024-09-13T18:52:50.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.391+0000 7f11a1a00700 1 -- start start 2024-09-13T18:52:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 0x7f119c0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119c0703d0 0x7f119c1278f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:50.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c127e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c154720 con 0x7f119c06ab10 2024-09-13T18:52:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c154a00 con 0x7f119c13ebc0 2024-09-13T18:52:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c156e50 con 0x7f119c0703d0 2024-09-13T18:52:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 0x7f119c0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 0x7f119c0cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47788/0 (socket says 172.21.15.81:47788) 2024-09-13T18:52:50.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 -- 172.21.15.81:0/3070045716 learned_addr learned my addr 172.21.15.81:0/3070045716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119b400700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c127e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f1192000700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119c0703d0 0x7f119c1278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 -- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119c0703d0 msgr2=0x7f119c1278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119c0703d0 0x7f119c1278f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 -- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 msgr2=0x7f119c127e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c127e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 -- 172.21.15.81:0/3070045716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11840094b0 con 0x7f119c06ab10 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119b400700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c127e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:50.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f119aa00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 0x7f119c0cf280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b370 tx=0x7f118c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:50.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c007000 con 0x7f119c06ab10 2024-09-13T18:52:50.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c012630 con 0x7f119c06ab10 2024-09-13T18:52:50.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0129e0 con 0x7f119c06ab10 2024-09-13T18:52:50.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c009a70 con 0x7f119c06ab10 2024-09-13T18:52:50.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.395+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c12e250 con 0x7f119c06ab10 2024-09-13T18:52:50.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.399+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c070860 con 0x7f119c06ab10 2024-09-13T18:52:50.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.399+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f118c012b40 con 0x7f119c06ab10 2024-09-13T18:52:50.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.399+0000 7f1193400700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1178066760 0x7f1178068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.399+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f118c085f30 con 0x7f119c06ab10 2024-09-13T18:52:50.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.399+0000 7f1192000700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1178066760 0x7f1178068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:50.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.403+0000 7f1192000700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1178066760 0x7f1178068c20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f119c1f5840 tx=0x7f1184009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:50.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.407+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f118c0532a0 con 0x7f119c06ab10 2024-09-13T18:52:50.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.631+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f119c06d530 con 0x7f119c06ab10 2024-09-13T18:52:50.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.631+0000 7f1193400700 1 -- 172.21.15.81:0/3070045716 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f118c0568c0 con 0x7f119c06ab10 2024-09-13T18:52:50.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:50.642 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":70,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6479,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7467,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:52:43.007633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:52:50.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1178066760 msgr2=0x7f1178068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1178066760 0x7f1178068c20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f119c1f5840 tx=0x7f1184009240 comp rx=0 tx=0).stop 2024-09-13T18:52:50.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 msgr2=0x7f119c0cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 0x7f119c0cf280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f118c00b370 tx=0x7f118c004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 shutdown_connections 2024-09-13T18:52:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1178066760 0x7f1178068c20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119c13ebc0 0x7f119c127e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119c0703d0 0x7f119c1278f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 --2- 172.21.15.81:0/3070045716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f119c06ab10 0x7f119c0cf280 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:50.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 >> 172.21.15.81:0/3070045716 conn(0x7f119c0b08d0 msgr2=0x7f119c0b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:50.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 shutdown_connections 2024-09-13T18:52:50.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:50.635+0000 7f11a1a00700 1 -- 172.21.15.81:0/3070045716 wait complete. 2024-09-13T18:52:50.648 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 70 2024-09-13T18:52:51.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:52:39.990227+0000', 'modified': '2024-09-13T18:52:43.007633+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7476': {'gid': 7476, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3243728894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3243728894}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3243728894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:52:51.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:52:51.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:52:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.243+0000 7f4d7d200700 1 Processor -- start 2024-09-13T18:52:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.243+0000 7f4d7d200700 1 -- start start 2024-09-13T18:52:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d7d200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d781610b0 0x7f4d780719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d7d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4d7806aaa0 0x7f4d7806af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d7d200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d780b3560 con 0x7f4d780b2670 2024-09-13T18:52:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d7d200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d78070b30 con 0x7f4d7806aaa0 2024-09-13T18:52:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d7d200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7806b450 con 0x7f4d781610b0 2024-09-13T18:52:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d77e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4d780b2670 0x7f4d780b2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51022/0 (socket says 172.21.15.81:51022) 2024-09-13T18:52:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d77e00700 1 -- 172.21.15.81:0/518707862 learned_addr learned my addr 172.21.15.81:0/518707862 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76a00700 1 --2- 172.21.15.81:0/518707862 >> v2:172.21.15.81:3300/0 conn(0x7f4d7806aaa0 0x7f4d7806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d77400700 1 --2- 172.21.15.81:0/518707862 >> v2:172.21.15.178:3300/0 conn(0x7f4d781610b0 0x7f4d780719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76000700 1 -- 172.21.15.81:0/518707862 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236382347 0 0) 0x7f4d780b3560 con 0x7f4d780b2670 2024-09-13T18:52:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76a00700 1 -- 172.21.15.81:0/518707862 >> v2:172.21.15.178:3300/0 conn(0x7f4d781610b0 msgr2=0x7f4d780719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76a00700 1 --2- 172.21.15.81:0/518707862 >> v2:172.21.15.178:3300/0 conn(0x7f4d781610b0 0x7f4d780719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76a00700 1 -- 172.21.15.81:0/518707862 >> v1:172.21.15.81:6789/0 conn(0x7f4d780b2670 legacy=0x7f4d780b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76a00700 1 -- 172.21.15.81:0/518707862 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d780b3280 con 0x7f4d7806aaa0 2024-09-13T18:52:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76a00700 1 --2- 172.21.15.81:0/518707862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d7806af10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009880 tx=0x7f4d64009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1207f1414a63f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76000700 1 -- 172.21.15.81:0/518707862 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011830 con 0x7f4d7806aaa0 2024-09-13T18:52:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76000700 1 -- 172.21.15.81:0/518707862 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64011990 con 0x7f4d7806aaa0 2024-09-13T18:52:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.247+0000 7f4d76000700 1 -- 172.21.15.81:0/518707862 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011d20 con 0x7f4d7806aaa0 2024-09-13T18:52:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 -- 172.21.15.81:0/518707862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 msgr2=0x7f4d7806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 --2- 172.21.15.81:0/518707862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d7806af10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009880 tx=0x7f4d64009b90 comp rx=0 tx=0).stop 2024-09-13T18:52:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 -- 172.21.15.81:0/518707862 shutdown_connections 2024-09-13T18:52:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 --2- 172.21.15.81:0/518707862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d7806af10 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 --2- 172.21.15.81:0/518707862 >> v2:172.21.15.178:3300/0 conn(0x7f4d781610b0 0x7f4d780719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 -- 172.21.15.81:0/518707862 >> 172.21.15.81:0/518707862 conn(0x7f4d780b0c40 msgr2=0x7f4d7806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 -- 172.21.15.81:0/518707862 shutdown_connections 2024-09-13T18:52:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 -- 172.21.15.81:0/518707862 wait complete. 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 Processor -- start 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.251+0000 7f4d7d200700 1 -- start start 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d781f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780b2670 0x7f4d780a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d781610b0 0x7f4d780ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d781626f0 con 0x7f4d7806aaa0 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78162940 con 0x7f4d780b2670 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78162c20 con 0x7f4d781610b0 2024-09-13T18:52:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d781f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d781f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47808/0 (socket says 172.21.15.81:47808) 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 -- 172.21.15.81:0/3512324644 learned_addr learned my addr 172.21.15.81:0/3512324644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77e00700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d781610b0 0x7f4d780ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d76a00700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780b2670 0x7f4d780a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 -- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d781610b0 msgr2=0x7f4d780ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d781610b0 0x7f4d780ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 -- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780b2670 msgr2=0x7f4d780a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780b2670 0x7f4d780a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 -- 172.21.15.81:0/3512324644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640094b0 con 0x7f4d7806aaa0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d77400700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d781f7400 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e840 tx=0x7f4d6800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d6f400700 1 -- 172.21.15.81:0/3512324644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680095a0 con 0x7f4d7806aaa0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d6f400700 1 -- 172.21.15.81:0/3512324644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d68013680 con 0x7f4d7806aaa0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d78162f00 con 0x7f4d7806aaa0 2024-09-13T18:52:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d6f400700 1 -- 172.21.15.81:0/3512324644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680139f0 con 0x7f4d7806aaa0 2024-09-13T18:52:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.255+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d781634c0 con 0x7f4d7806aaa0 2024-09-13T18:52:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.259+0000 7f4d6f400700 1 -- 172.21.15.81:0/3512324644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4d68013b50 con 0x7f4d7806aaa0 2024-09-13T18:52:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.259+0000 7f4d6f400700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d58066730 0x7f4d58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d6f400700 1 -- 172.21.15.81:0/3512324644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d68084180 con 0x7f4d7806aaa0 2024-09-13T18:52:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d76a00700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d58066730 0x7f4d58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d76a00700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d58066730 0x7f4d58068bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4d640090b0 tx=0x7f4d64010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 Processor -- start 2024-09-13T18:52:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 -- start start 2024-09-13T18:52:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3356c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3354ad00 0x33534890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3356c6c0 0x33534dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x33493d80 con 0x3356bda0 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x33491510 con 0x3354ad00 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.263+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3348ce00 con 0x3356c6c0 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3356c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3356c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47812/0 (socket says 172.21.15.81:47812) 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 -- 172.21.15.81:0/3079239605 learned_addr learned my addr 172.21.15.81:0/3079239605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d76a00700 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3354ad00 0x33534890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77e00700 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3356c6c0 0x33534dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 -- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3356c6c0 msgr2=0x33534dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3356c6c0 0x33534dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 -- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3354ad00 msgr2=0x33534890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3354ad00 0x33534890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 -- 172.21.15.81:0/3079239605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x332ff960 con 0x3356bda0 2024-09-13T18:52:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d77400700 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3356c180 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f4d6805ce90 tx=0x7f4d68054fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b1a4df4ab8c48f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d63e00700 1 -- 172.21.15.81:0/3079239605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6805b0f0 con 0x3356bda0 2024-09-13T18:52:51.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d63e00700 1 -- 172.21.15.81:0/3079239605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6805d3c0 con 0x3356bda0 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d63e00700 1 -- 172.21.15.81:0/3079239605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68053370 con 0x3356bda0 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 -- 172.21.15.81:0/3079239605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 msgr2=0x3356c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3356c180 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f4d6805ce90 tx=0x7f4d68054fd0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 -- 172.21.15.81:0/3079239605 shutdown_connections 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3356c6c0 0x33534dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3354ad00 0x33534890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/3079239605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3356c180 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 -- 172.21.15.81:0/3079239605 >> 172.21.15.81:0/3079239605 conn(0x332b44d0 msgr2=0x3354dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 -- 172.21.15.81:0/3079239605 shutdown_connections 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 -- 172.21.15.81:0/3079239605 wait complete. 2024-09-13T18:52:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 -- start start 2024-09-13T18:52:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.267+0000 7f4d81b2d740 1 Processor -- start 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x33525540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x3354bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3344a730 con 0x3356bda0 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x334505b0 con 0x3356c6c0 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x33338aa0 con 0x3354ad00 2024-09-13T18:52:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 10 client.0 _ll_register_callbacks cb 0x33486610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x33525540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x33525540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47828/0 (socket says 172.21.15.81:47828) 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 -- 172.21.15.81:0/2734299311 learned_addr learned my addr 172.21.15.81:0/2734299311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d77400700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d77e00700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x3354bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 -- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 msgr2=0x33524470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 -- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 msgr2=0x3354bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x3354bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 -- 172.21.15.81:0/2734299311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d781634c0 con 0x3356bda0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d76a00700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x33525540 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4d64011960 tx=0x7f4d640047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da345c1b5e4822c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d60c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d60c00700 1 -- 172.21.15.81:0/2734299311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64032440 con 0x3356bda0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d60c00700 1 -- 172.21.15.81:0/2734299311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d64033d90 con 0x3356bda0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x332c11e0 con 0x3356bda0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d60c00700 1 -- 172.21.15.81:0/2734299311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d6401c410 con 0x3356bda0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 10 client.7647 fetch_fsmap learned FSMap version 70 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x33453220 con 0x3356bda0 2024-09-13T18:52:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.271+0000 7f4d60c00700 1 -- 172.21.15.81:0/2734299311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x332c11e0 con 0x3356bda0 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d60c00700 1 -- 172.21.15.81:0/2734299311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4d640325a0 con 0x3356bda0 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 10 client.7647 fetch_fsmap finished waiting for FSMap version 70 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 10 client.7647 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 20 client.7647 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33522200 0x335225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 4 client.7647 mds_command: new command op to 7476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 --> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3330b460 con 0x33522200 2024-09-13T18:52:51.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d77400700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33522200 0x335225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d77400700 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33522200 0x335225e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48dce1ad975655fd server_cookie=f61bdbb2657da7ae in_seq=0 out_seq=0 2024-09-13T18:52:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d60c00700 10 client.7647 ms_handle_connect on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d60c00700 1 -- 172.21.15.81:0/2734299311 <== mds.0 v2:172.21.15.81:6836/3243728894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3330b460 con 0x33522200 2024-09-13T18:52:51.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d60c00700 10 client.7647 handle_command_reply: tid=0 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 client.7647 shutdown 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 msgr2=0x33525540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x33525540 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f4d64011960 tx=0x7f4d640047e0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 shutdown_connections 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33522200 0x335225e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x3354bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x33525540 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/2734299311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d60c00700 0 client.7647 ms_handle_reset on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 >> 172.21.15.81:0/2734299311 conn(0x332b44d0 msgr2=0x33547860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 shutdown_connections 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.275+0000 7f4d81b2d740 1 -- 172.21.15.81:0/2734299311 wait complete. 2024-09-13T18:52:51.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.279+0000 7f4d81b2d740 20 client.7647 trim_cache size 0 max 16384 2024-09-13T18:52:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 Processor -- start 2024-09-13T18:52:51.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 -- start start 2024-09-13T18:52:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x335250c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x334bbec0 con 0x3356bda0 2024-09-13T18:52:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3357cd40 con 0x3356c6c0 2024-09-13T18:52:51.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x33433950 con 0x3354ad00 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x335250c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x335250c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47842/0 (socket says 172.21.15.81:47842) 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 -- 172.21.15.81:0/761501396 learned_addr learned my addr 172.21.15.81:0/761501396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d77400700 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d77e00700 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 -- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 msgr2=0x33524b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 -- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 msgr2=0x335676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 -- 172.21.15.81:0/761501396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x33439450 con 0x3356bda0 2024-09-13T18:52:51.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d77e00700 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d76a00700 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x335250c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4d64003a20 tx=0x7f4d6402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f64ad59d7cfee57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d6cc00700 1 -- 172.21.15.81:0/761501396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64032b00 con 0x3356bda0 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d6cc00700 1 -- 172.21.15.81:0/761501396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64003d30 con 0x3356bda0 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.299+0000 7f4d6cc00700 1 -- 172.21.15.81:0/761501396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64032440 con 0x3356bda0 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 -- 172.21.15.81:0/761501396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 msgr2=0x335250c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x335250c0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f4d64003a20 tx=0x7f4d6402c000 comp rx=0 tx=0).stop 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 -- 172.21.15.81:0/761501396 shutdown_connections 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x335250c0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/761501396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33524b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 -- 172.21.15.81:0/761501396 >> 172.21.15.81:0/761501396 conn(0x332b44d0 msgr2=0x33524470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 -- 172.21.15.81:0/761501396 shutdown_connections 2024-09-13T18:52:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 -- 172.21.15.81:0/761501396 wait complete. 2024-09-13T18:52:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 -- start start 2024-09-13T18:52:51.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.303+0000 7f4d81b2d740 1 Processor -- start 2024-09-13T18:52:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33584b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3358c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3356b620 con 0x3356bda0 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3356b850 con 0x3356c6c0 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x33527550 con 0x3354ad00 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 10 client.0 _ll_register_callbacks cb 0x334e3710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3358c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3358c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47856/0 (socket says 172.21.15.81:47856) 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 -- 172.21.15.81:0/4028893401 learned_addr learned my addr 172.21.15.81:0/4028893401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 -- 172.21.15.81:0/4028893401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 msgr2=0x33584b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33584b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 -- 172.21.15.81:0/4028893401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 msgr2=0x335d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 -- 172.21.15.81:0/4028893401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x33453220 con 0x3356bda0 2024-09-13T18:52:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d76a00700 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3358c940 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f4d64011960 tx=0x7f4d6401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=944a5811e8910edb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 1 -- 172.21.15.81:0/4028893401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6403b620 con 0x3356bda0 2024-09-13T18:52:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 1 -- 172.21.15.81:0/4028893401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4d6403b780 con 0x3356bda0 2024-09-13T18:52:51.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d6805d3c0 con 0x3356bda0 2024-09-13T18:52:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 1 -- 172.21.15.81:0/4028893401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d6403b940 con 0x3356bda0 2024-09-13T18:52:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 10 client.7653 fetch_fsmap learned FSMap version 70 2024-09-13T18:52:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x3342d720 con 0x3356bda0 2024-09-13T18:52:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 1 -- 172.21.15.81:0/4028893401 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6805d3c0 con 0x3356bda0 2024-09-13T18:52:51.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 1 -- 172.21.15.81:0/4028893401 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4d6403baa0 con 0x3356bda0 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 10 client.7653 fetch_fsmap finished waiting for FSMap version 70 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 10 client.7653 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 20 client.7653 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33584000 0x335d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 4 client.7653 mds_command: new command op to 7476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 --> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] -- command(tid 0: {"prefix": "status"}) v1 -- 0x333301e0 con 0x33584000 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d77400700 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33584000 0x335d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 10 client.7653 ms_handle_connect on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d77400700 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33584000 0x335d0a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90d0fc5a4d8da1c0 server_cookie=1fbaebed52c31d5a in_seq=0 out_seq=0 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 1 -- 172.21.15.81:0/4028893401 <== mds.0 v2:172.21.15.81:6836/3243728894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x333301e0 con 0x33584000 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d60c00700 10 client.7653 handle_command_reply: tid=0 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.307+0000 7f4d81b2d740 1 client.7653 shutdown 2024-09-13T18:52:51.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 msgr2=0x3358c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3358c940 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f4d64011960 tx=0x7f4d6401e040 comp rx=0 tx=0).stop 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 shutdown_connections 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x33584000 0x335d0a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3356c6c0 0x335d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3356bda0 0x3358c940 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d60c00700 0 client.7653 ms_handle_reset on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 --2- 172.21.15.81:0/4028893401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3354ad00 0x33584b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 >> 172.21.15.81:0/4028893401 conn(0x332b44d0 msgr2=0x33524c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 shutdown_connections 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 1 -- 172.21.15.81:0/4028893401 wait complete. 2024-09-13T18:52:51.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d81b2d740 20 client.7653 trim_cache size 0 max 16384 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7476, 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 11.317578119, 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 70, 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 81, 2024-09-13T18:52:51.322 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.523564152999999 2024-09-13T18:52:51.323 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:52:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d58066730 msgr2=0x7f4d58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d58066730 0x7f4d58068bf0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4d640090b0 tx=0x7f4d64010000 comp rx=0 tx=0).stop 2024-09-13T18:52:51.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 msgr2=0x7f4d781f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d781f7400 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800e840 tx=0x7f4d6800eb50 comp rx=0 tx=0).stop 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 shutdown_connections 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4d58066730 0x7f4d58068bf0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d781610b0 0x7f4d780ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d780b2670 0x7f4d780a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 --2- 172.21.15.81:0/3512324644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d7806aaa0 0x7f4d781f7400 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 >> 172.21.15.81:0/3512324644 conn(0x7f4d780b0c40 msgr2=0x7f4d7806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 shutdown_connections 2024-09-13T18:52:51.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.311+0000 7f4d7d200700 1 -- 172.21.15.81:0/3512324644 wait complete. 2024-09-13T18:52:51.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:52:51.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 Processor -- start 2024-09-13T18:52:51.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 -- start start 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4280cb020 0x7fa4280cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 0x7fa42806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42806b430 con 0x7fa42815c2a0 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4280b2ad0 con 0x7fa4280cb020 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.515+0000 7fa427e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42815b960 con 0x7fa42806aaa0 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 0x7fa42806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa426a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4280cb020 0x7fa4280cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 0x7fa42806aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:32910/0 (socket says 172.21.15.81:32910) 2024-09-13T18:52:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 -- 172.21.15.81:0/2672525197 learned_addr learned my addr 172.21.15.81:0/2672525197 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 -- 172.21.15.81:0/2672525197 >> v2:172.21.15.178:3300/0 conn(0x7fa4280cb020 msgr2=0x7fa4280cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 --2- 172.21.15.81:0/2672525197 >> v2:172.21.15.178:3300/0 conn(0x7fa4280cb020 0x7fa4280cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 -- 172.21.15.81:0/2672525197 >> v1:172.21.15.178:6789/0 conn(0x7fa42815c2a0 legacy=0x7fa42815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 -- 172.21.15.81:0/2672525197 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42815bc40 con 0x7fa42806aaa0 2024-09-13T18:52:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427400700 1 --2- 172.21.15.81:0/2672525197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 0x7fa42806aef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa420009e50 tx=0x7fa42000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9360a66c8f1c0394 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa425600700 1 -- 172.21.15.81:0/2672525197 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000e070 con 0x7fa42806aaa0 2024-09-13T18:52:51.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa425600700 1 -- 172.21.15.81:0/2672525197 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000b910 con 0x7fa42806aaa0 2024-09-13T18:52:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa425600700 1 -- 172.21.15.81:0/2672525197 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42000bcc0 con 0x7fa42806aaa0 2024-09-13T18:52:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 -- 172.21.15.81:0/2672525197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 msgr2=0x7fa42806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 --2- 172.21.15.81:0/2672525197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 0x7fa42806aef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa420009e50 tx=0x7fa42000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 -- 172.21.15.81:0/2672525197 shutdown_connections 2024-09-13T18:52:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 --2- 172.21.15.81:0/2672525197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42806aaa0 0x7fa42806aef0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 --2- 172.21.15.81:0/2672525197 >> v2:172.21.15.178:3300/0 conn(0x7fa4280cb020 0x7fa4280cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 -- 172.21.15.81:0/2672525197 >> 172.21.15.81:0/2672525197 conn(0x7fa4280b0c40 msgr2=0x7fa42806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 -- 172.21.15.81:0/2672525197 shutdown_connections 2024-09-13T18:52:51.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.519+0000 7fa427e00700 1 -- 172.21.15.81:0/2672525197 wait complete. 2024-09-13T18:52:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 Processor -- start 2024-09-13T18:52:51.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 -- start start 2024-09-13T18:52:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42806aaa0 0x7fa4281e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4280cb020 0x7fa4281f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 0x7fa4281f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281f3550 con 0x7fa42815c2a0 2024-09-13T18:52:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281e9150 con 0x7fa42806aaa0 2024-09-13T18:52:51.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.523+0000 7fa427e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281f2ec0 con 0x7fa4280cb020 2024-09-13T18:52:51.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 0x7fa4281f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 0x7fa4281f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47858/0 (socket says 172.21.15.81:47858) 2024-09-13T18:52:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 -- 172.21.15.81:0/1983200926 learned_addr learned my addr 172.21.15.81:0/1983200926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa426a00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42806aaa0 0x7fa4281e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa426000700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4280cb020 0x7fa4281f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 -- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4280cb020 msgr2=0x7fa4281f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4280cb020 0x7fa4281f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 -- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42806aaa0 msgr2=0x7fa4281e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42806aaa0 0x7fa4281e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 -- 172.21.15.81:0/1983200926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009b30 con 0x7fa42815c2a0 2024-09-13T18:52:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa426000700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4280cb020 0x7fa4281f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:51.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427400700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 0x7fa4281f2880 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa42815baa0 tx=0x7fa420004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200048b0 con 0x7fa42815c2a0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4200099b0 con 0x7fa42815c2a0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4281f31a0 con 0x7fa42815c2a0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42001c680 con 0x7fa42815c2a0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4281f3a40 con 0x7fa42815c2a0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.527+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42806aef0 con 0x7fa42815c2a0 2024-09-13T18:52:51.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.531+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa42001c7e0 con 0x7fa42815c2a0 2024-09-13T18:52:51.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.531+0000 7fa41ea00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa408066730 0x7fa408068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:51.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.531+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa420085f20 con 0x7fa42815c2a0 2024-09-13T18:52:51.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.531+0000 7fa426a00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa408066730 0x7fa408068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:51.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.531+0000 7fa426a00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa408066730 0x7fa408068bf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa428071f20 tx=0x7fa418009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:51.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.539+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa420053140 con 0x7fa42815c2a0 2024-09-13T18:52:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.779+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa4280ce2a0 con 0x7fa42815c2a0 2024-09-13T18:52:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.779+0000 7fa41ea00700 1 -- 172.21.15.81:0/1983200926 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa420056760 con 0x7fa42815c2a0 2024-09-13T18:52:51.787 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa408066730 msgr2=0x7fa408068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa408066730 0x7fa408068bf0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa428071f20 tx=0x7fa418009240 comp rx=0 tx=0).stop 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 msgr2=0x7fa4281f2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 0x7fa4281f2880 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa42815baa0 tx=0x7fa420004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 shutdown_connections 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa408066730 0x7fa408068bf0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa42815c2a0 0x7fa4281f2880 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4280cb020 0x7fa4281f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 --2- 172.21.15.81:0/1983200926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42806aaa0 0x7fa4281e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:51.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 >> 172.21.15.81:0/1983200926 conn(0x7fa4280b0c40 msgr2=0x7fa42815d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:51.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 shutdown_connections 2024-09-13T18:52:51.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:51.783+0000 7fa427e00700 1 -- 172.21.15.81:0/1983200926 wait complete. 2024-09-13T18:52:51.811 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:52:51.811 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:52:51.811 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:52:51.811 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:52:51.811 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:52:51.812 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:52:51.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:52:51.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:52:51.812 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:52:51.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:51.813 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:52:51.829 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:52:51.830 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:52:51.830 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:52:51.830 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.830 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:52:51.830 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.831 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:52:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:52:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:52:51.831 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:52:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:52:51.831 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42120sec preferred_lft 42120sec 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:52:51.832 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:52:51.833 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:52:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:52:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.834 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:52:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:52:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::3069:26ff:fefd:eadb/64 scope link 2024-09-13T18:52:51.834 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:52:51.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:51.835 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:52:51.913 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:52:51.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:51.916 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:52:51.976 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:52:51.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:51.978 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:52:51.978 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:52:51.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:52:51.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:52:51.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:52:51.978 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:52:52.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:52.108 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:52:52.128 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:52:52.128 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:52:52.130 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:52:52.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:52.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:52:52.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:52:52.202 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:52:52.268 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:52:52.268 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:52:52.268 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:52:52.328 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:52:52.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:52.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:52:52.458 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:52:52.458 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:52:52.483 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:52:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:52:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:52:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:52:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:52:52.491 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:52:52.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:52.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:52:52.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:52.524 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:52:52.604 INFO:teuthology.orchestra.run.smithi081.stdout:client7303 2024-09-13T18:52:52.605 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:52:52.605 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:52:52.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:52:52.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 Processor -- start 2024-09-13T18:52:52.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 -- start start 2024-09-13T18:52:52.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29340b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:52.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29340cf830 0x7f29340cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:52.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29340b4680 con 0x7f293406c5a0 2024-09-13T18:52:52.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293415aeb0 con 0x7f29340cf830 2024-09-13T18:52:52.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29340b4960 con 0x7f293415aa90 2024-09-13T18:52:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29340cf830 0x7f29340cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29340cf830 0x7f29340cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47870/0 (socket says 172.21.15.81:47870) 2024-09-13T18:52:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2939200700 1 -- 172.21.15.81:0/464534691 learned_addr learned my addr 172.21.15.81:0/464534691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.879+0000 7f2933400700 1 --2- 172.21.15.81:0/464534691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29340b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939200700 1 -- 172.21.15.81:0/464534691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 msgr2=0x7f29340b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939200700 1 --2- 172.21.15.81:0/464534691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29340b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939200700 1 -- 172.21.15.81:0/464534691 >> v1:172.21.15.178:6789/0 conn(0x7f293406c5a0 legacy=0x7f293406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939200700 1 -- 172.21.15.81:0/464534691 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340cf030 con 0x7f29340cf830 2024-09-13T18:52:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939200700 1 --2- 172.21.15.81:0/464534691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29340cf830 0x7f29340cfc80 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f292c009e50 tx=0x7f292c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90368c7999e2151 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2932a00700 1 -- 172.21.15.81:0/464534691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00e070 con 0x7f29340cf830 2024-09-13T18:52:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2932a00700 1 -- 172.21.15.81:0/464534691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00b910 con 0x7f29340cf830 2024-09-13T18:52:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2932a00700 1 -- 172.21.15.81:0/464534691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00bcc0 con 0x7f29340cf830 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 -- 172.21.15.81:0/464534691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29340cf830 msgr2=0x7f29340cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 --2- 172.21.15.81:0/464534691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29340cf830 0x7f29340cfc80 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f292c009e50 tx=0x7f292c00b330 comp rx=0 tx=0).stop 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 -- 172.21.15.81:0/464534691 shutdown_connections 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 --2- 172.21.15.81:0/464534691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29340cf830 0x7f29340cfc80 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 --2- 172.21.15.81:0/464534691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29340b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 -- 172.21.15.81:0/464534691 >> 172.21.15.81:0/464534691 conn(0x7f2934071d20 msgr2=0x7f2934072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 -- 172.21.15.81:0/464534691 shutdown_connections 2024-09-13T18:52:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.883+0000 7f2939c00700 1 -- 172.21.15.81:0/464534691 wait complete. 2024-09-13T18:52:52.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.887+0000 7f2939c00700 1 Processor -- start 2024-09-13T18:52:52.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.887+0000 7f2939c00700 1 -- start start 2024-09-13T18:52:52.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 0x7f293415db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:52.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340cf830 0x7f29341f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29341536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934154bc0 con 0x7f293406c5a0 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340cc9e0 con 0x7f29340cf830 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2934153f40 con 0x7f293415aa90 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 0x7f293415db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 0x7f293415db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47884/0 (socket says 172.21.15.81:47884) 2024-09-13T18:52:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 -- 172.21.15.81:0/1738564635 learned_addr learned my addr 172.21.15.81:0/1738564635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933400700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340cf830 0x7f29341f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939200700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29341536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 -- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 msgr2=0x7f29341536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29341536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 -- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340cf830 msgr2=0x7f29341f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340cf830 0x7f29341f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 -- 172.21.15.81:0/1738564635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c009b30 con 0x7f293406c5a0 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933400700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340cf830 0x7f29341f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2933e00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 0x7f293415db20 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f292400c500 tx=0x7f292400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240052d0 con 0x7f293406c5a0 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924005430 con 0x7f293406c5a0 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2934154220 con 0x7f293406c5a0 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240055a0 con 0x7f293406c5a0 2024-09-13T18:52:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.891+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29341547e0 con 0x7f293406c5a0 2024-09-13T18:52:52.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.895+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293406cda0 con 0x7f293406c5a0 2024-09-13T18:52:52.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.895+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29240038e0 con 0x7f293406c5a0 2024-09-13T18:52:52.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.895+0000 7f292be00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2914066730 0x7f2914068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.895+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f29240837b0 con 0x7f293406c5a0 2024-09-13T18:52:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.899+0000 7f2933400700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2914066730 0x7f2914068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:52.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.899+0000 7f2933400700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2914066730 0x7f2914068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2934156700 tx=0x7f2920008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:52.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:52.903+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29240509d0 con 0x7f293406c5a0 2024-09-13T18:52:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.123+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f2934154d00 con 0x7f293406c5a0 2024-09-13T18:52:53.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.195+0000 7f292be00700 1 -- 172.21.15.81:0/1738564635 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v71) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2924053ff0 con 0x7f293406c5a0 2024-09-13T18:52:53.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2914066730 msgr2=0x7f2914068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2914066730 0x7f2914068bf0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2934156700 tx=0x7f2920008040 comp rx=0 tx=0).stop 2024-09-13T18:52:53.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 msgr2=0x7f293415db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 0x7f293415db20 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f292400c500 tx=0x7f292400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 shutdown_connections 2024-09-13T18:52:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2914066730 0x7f2914068bf0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f293415aa90 0x7f29341536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29340cf830 0x7f29341f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 --2- 172.21.15.81:0/1738564635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f293406c5a0 0x7f293415db20 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 >> 172.21.15.81:0/1738564635 conn(0x7f2934071d20 msgr2=0x7f29340cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 shutdown_connections 2024-09-13T18:52:53.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.199+0000 7f2939c00700 1 -- 172.21.15.81:0/1738564635 wait complete. 2024-09-13T18:52:53.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:53.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 Processor -- start 2024-09-13T18:52:53.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 -- start start 2024-09-13T18:52:53.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fd80cc6f0 0x7f6fd815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:53.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd806aaa0 0x7f6fd806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:53.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80ccb40 con 0x7f6fd80cb020 2024-09-13T18:52:53.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd806b430 con 0x7f6fd80cc6f0 2024-09-13T18:52:53.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80b2ad0 con 0x7f6fd806aaa0 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fd80cc6f0 0x7f6fd815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6fd80cc6f0 0x7f6fd815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47886/0 (socket says 172.21.15.81:47886) 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6fd80cb020 0x7f6fd815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51030/0 (socket says 172.21.15.81:51030) 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 -- 172.21.15.81:0/1731825240 learned_addr learned my addr 172.21.15.81:0/1731825240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd6800700 1 --2- 172.21.15.81:0/1731825240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd806aaa0 0x7f6fd806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 -- 172.21.15.81:0/1731825240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd806aaa0 msgr2=0x7f6fd806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 --2- 172.21.15.81:0/1731825240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd806aaa0 0x7f6fd806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 -- 172.21.15.81:0/1731825240 >> v1:172.21.15.81:6789/0 conn(0x7f6fd80cb020 legacy=0x7f6fd815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd5400700 1 -- 172.21.15.81:0/1731825240 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd815b960 con 0x7f6fd80cc6f0 2024-09-13T18:52:53.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.391+0000 7f6fd4a00700 1 -- 172.21.15.81:0/1731825240 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100137491 0 0) 0x7f6fd80ccb40 con 0x7f6fd80cb020 2024-09-13T18:52:53.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd5400700 1 --2- 172.21.15.81:0/1731825240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd815b0e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009910 tx=0x7f6fc4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f55a2e06134c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:53.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd4a00700 1 -- 172.21.15.81:0/1731825240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ba60 con 0x7f6fd80cc6f0 2024-09-13T18:52:53.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd4a00700 1 -- 172.21.15.81:0/1731825240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400bbc0 con 0x7f6fd80cc6f0 2024-09-13T18:52:53.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd4a00700 1 -- 172.21.15.81:0/1731825240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4009e60 con 0x7f6fd80cc6f0 2024-09-13T18:52:53.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 -- 172.21.15.81:0/1731825240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd80cc6f0 msgr2=0x7f6fd815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 --2- 172.21.15.81:0/1731825240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd815b0e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009910 tx=0x7f6fc4009c20 comp rx=0 tx=0).stop 2024-09-13T18:52:53.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 -- 172.21.15.81:0/1731825240 shutdown_connections 2024-09-13T18:52:53.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 --2- 172.21.15.81:0/1731825240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd806aaa0 0x7f6fd806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 --2- 172.21.15.81:0/1731825240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd815b0e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 -- 172.21.15.81:0/1731825240 >> 172.21.15.81:0/1731825240 conn(0x7f6fd80b0c40 msgr2=0x7f6fd806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:53.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 -- 172.21.15.81:0/1731825240 shutdown_connections 2024-09-13T18:52:53.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.395+0000 7f6fd7200700 1 -- 172.21.15.81:0/1731825240 wait complete. 2024-09-13T18:52:53.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 Processor -- start 2024-09-13T18:52:53.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 -- start start 2024-09-13T18:52:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 0x7f6fd8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:53.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd80cb020 0x7f6fd80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd8151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80ca690 con 0x7f6fd806aaa0 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80c8f30 con 0x7f6fd80cc6f0 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81522c0 con 0x7f6fd80cb020 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 0x7f6fd8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 0x7f6fd8156790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47890/0 (socket says 172.21.15.81:47890) 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 -- 172.21.15.81:0/3602756309 learned_addr learned my addr 172.21.15.81:0/3602756309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 -- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd80cb020 msgr2=0x7f6fd80c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd6800700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd8151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd80cb020 0x7f6fd80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 -- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd80cc6f0 msgr2=0x7f6fd8151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd8151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 -- 172.21.15.81:0/3602756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4009570 con 0x7f6fd806aaa0 2024-09-13T18:52:53.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd6800700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fd5e00700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 0x7f6fd8156790 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c580 tx=0x7f6fc800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.399+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8004ca0 con 0x7f6fd806aaa0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.403+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8004e20 con 0x7f6fd806aaa0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.403+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd80c8320 con 0x7f6fd806aaa0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.403+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8007310 con 0x7f6fd806aaa0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.403+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80c88e0 con 0x7f6fd806aaa0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.403+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd80cb400 con 0x7f6fd806aaa0 2024-09-13T18:52:53.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.403+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6fc8007470 con 0x7f6fd806aaa0 2024-09-13T18:52:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.407+0000 7f6fce000700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6fb8066730 0x7f6fb8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:53.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.407+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6fc8084120 con 0x7f6fd806aaa0 2024-09-13T18:52:53.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.407+0000 7f6fd5400700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6fb8066730 0x7f6fb8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:53.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.407+0000 7f6fd5400700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6fb8066730 0x7f6fb8068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6fd806ce20 tx=0x7f6fc4010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:53.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.411+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6fc80512c0 con 0x7f6fd806aaa0 2024-09-13T18:52:53.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.635+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fd806c7b0 con 0x7f6fd806aaa0 2024-09-13T18:52:53.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.635+0000 7f6fce000700 1 -- 172.21.15.81:0/3602756309 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4758 (secure 0 0 0) 0x7f6fc8007720 con 0x7f6fd806aaa0 2024-09-13T18:52:53.644 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:53.645 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":6479,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:52:53.198791+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":7476,"mds_1":7467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:creating","state_seq":1,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:52:53.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6fb8066730 msgr2=0x7f6fb8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6fb8066730 0x7f6fb8068bf0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6fd806ce20 tx=0x7f6fc4010000 comp rx=0 tx=0).stop 2024-09-13T18:52:53.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 msgr2=0x7f6fd8156790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:53.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 0x7f6fd8156790 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6fc800c580 tx=0x7f6fc800c940 comp rx=0 tx=0).stop 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 shutdown_connections 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6fb8066730 0x7f6fb8068bf0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd80cc6f0 0x7f6fd8151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd80cb020 0x7f6fd80c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 --2- 172.21.15.81:0/3602756309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6fd806aaa0 0x7f6fd8156790 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 >> 172.21.15.81:0/3602756309 conn(0x7f6fd80b0c40 msgr2=0x7f6fd80b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 shutdown_connections 2024-09-13T18:52:53.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:53.639+0000 7f6fd7200700 1 -- 172.21.15.81:0/3602756309 wait complete. 2024-09-13T18:52:53.649 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 72 2024-09-13T18:52:54.075 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:52:39.990227+0000', 'modified': '2024-09-13T18:52:53.198791+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 7476, 'mds_1': 7467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7467': {'gid': 7467, 'name': 'c', 'rank': 1, 'incarnation': 72, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.81:6835/3178710454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 3178710454}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 3178710454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7476': {'gid': 7476, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3243728894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3243728894}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3243728894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:52:54.075 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7467:up:creating 2024-09-13T18:52:55.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:55.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.251+0000 7f35efe00700 1 Processor -- start 2024-09-13T18:52:55.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.251+0000 7f35efe00700 1 -- start start 2024-09-13T18:52:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e80ce4c0 0x7f35e806a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35e806ab10 0x7f35e806ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e80ad480 con 0x7f35e81573b0 2024-09-13T18:52:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e8157790 con 0x7f35e806ab10 2024-09-13T18:52:55.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806af30 con 0x7f35e80ce4c0 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ede00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35e806ab10 0x7f35e806ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ed400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35e81573b0 0x7f35e80cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51032/0 (socket says 172.21.15.81:51032) 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ed400700 1 -- 172.21.15.81:0/1337966140 learned_addr learned my addr 172.21.15.81:0/1337966140 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35eca00700 1 --2- 172.21.15.81:0/1337966140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e80ce4c0 0x7f35e806a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ede00700 1 -- 172.21.15.81:0/1337966140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e80ce4c0 msgr2=0x7f35e806a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ede00700 1 --2- 172.21.15.81:0/1337966140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e80ce4c0 0x7f35e806a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ede00700 1 -- 172.21.15.81:0/1337966140 >> v1:172.21.15.81:6789/0 conn(0x7f35e81573b0 legacy=0x7f35e80cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ede00700 1 -- 172.21.15.81:0/1337966140 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e80ad6d0 con 0x7f35e806ab10 2024-09-13T18:52:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35e7e00700 1 -- 172.21.15.81:0/1337966140 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675896649 0 0) 0x7f35e80ad480 con 0x7f35e81573b0 2024-09-13T18:52:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35ede00700 1 --2- 172.21.15.81:0/1337966140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e806ab10 0x7f35e806ff60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009d90 tx=0x7f35e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81c596f39f9b95e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35e7e00700 1 -- 172.21.15.81:0/1337966140 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000e070 con 0x7f35e806ab10 2024-09-13T18:52:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35e7e00700 1 -- 172.21.15.81:0/1337966140 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e000bbd0 con 0x7f35e806ab10 2024-09-13T18:52:55.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35e7e00700 1 -- 172.21.15.81:0/1337966140 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0012430 con 0x7f35e806ab10 2024-09-13T18:52:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 -- 172.21.15.81:0/1337966140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e806ab10 msgr2=0x7f35e806ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.255+0000 7f35efe00700 1 --2- 172.21.15.81:0/1337966140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e806ab10 0x7f35e806ff60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009d90 tx=0x7f35e000b330 comp rx=0 tx=0).stop 2024-09-13T18:52:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 -- 172.21.15.81:0/1337966140 shutdown_connections 2024-09-13T18:52:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 --2- 172.21.15.81:0/1337966140 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e806ab10 0x7f35e806ff60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 --2- 172.21.15.81:0/1337966140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e80ce4c0 0x7f35e806a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 -- 172.21.15.81:0/1337966140 >> 172.21.15.81:0/1337966140 conn(0x7f35e80b08d0 msgr2=0x7f35e80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 -- 172.21.15.81:0/1337966140 shutdown_connections 2024-09-13T18:52:55.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 -- 172.21.15.81:0/1337966140 wait complete. 2024-09-13T18:52:55.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 Processor -- start 2024-09-13T18:52:55.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.259+0000 7f35efe00700 1 -- start start 2024-09-13T18:52:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35efe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e806ab10 0x7f35e81402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35efe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35e80ce4c0 0x7f35e80b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35efe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81573b0 0x7f35e80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35efe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81e6800 con 0x7f35e81573b0 2024-09-13T18:52:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35efe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81e6ae0 con 0x7f35e80ce4c0 2024-09-13T18:52:55.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35efe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e81e6dc0 con 0x7f35e806ab10 2024-09-13T18:52:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ed400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e806ab10 0x7f35e81402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81573b0 0x7f35e80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ed400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e806ab10 0x7f35e81402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:32962/0 (socket says 172.21.15.81:32962) 2024-09-13T18:52:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ed400700 1 -- 172.21.15.81:0/3932367403 learned_addr learned my addr 172.21.15.81:0/3932367403 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35eca00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35e80ce4c0 0x7f35e80b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:55.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 -- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e806ab10 msgr2=0x7f35e81402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e806ab10 0x7f35e81402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 -- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35e80ce4c0 msgr2=0x7f35e80b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35e80ce4c0 0x7f35e80b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 -- 172.21.15.81:0/3932367403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009a70 con 0x7f35e81573b0 2024-09-13T18:52:55.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.263+0000 7f35ede00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81573b0 0x7f35e80b27e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f35e0016000 tx=0x7f35e0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:55.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0012430 con 0x7f35e81573b0 2024-09-13T18:52:55.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e0020070 con 0x7f35e81573b0 2024-09-13T18:52:55.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e81e70a0 con 0x7f35e81573b0 2024-09-13T18:52:55.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0004280 con 0x7f35e81573b0 2024-09-13T18:52:55.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e8140810 con 0x7f35e81573b0 2024-09-13T18:52:55.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e81e75c0 con 0x7f35e81573b0 2024-09-13T18:52:55.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.267+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35e00043e0 con 0x7f35e81573b0 2024-09-13T18:52:55.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.271+0000 7f35e5600700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35c8066730 0x7f35c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:55.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.271+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f35e0022070 con 0x7f35e81573b0 2024-09-13T18:52:55.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.271+0000 7f35ed400700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35c8066730 0x7f35c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:55.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.271+0000 7f35ed400700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35c8066730 0x7f35c8068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f60 tx=0x7f35dc007f50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.275+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35e81e75c0 con 0x7f35e81573b0 2024-09-13T18:52:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.499+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35e81e75c0 con 0x7f35e81573b0 2024-09-13T18:52:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.499+0000 7f35e5600700 1 -- 172.21.15.81:0/3932367403 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4770 (secure 0 0 0) 0x7f35e81e75c0 con 0x7f35e81573b0 2024-09-13T18:52:55.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:55.510 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:52:55.212970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35c8066730 msgr2=0x7f35c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35c8066730 0x7f35c8068bf0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f35dc000f60 tx=0x7f35dc007f50 comp rx=0 tx=0).stop 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81573b0 msgr2=0x7f35e80b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81573b0 0x7f35e80b27e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f35e0016000 tx=0x7f35e0004af0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 shutdown_connections 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35c8066730 0x7f35c8068bf0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35e81573b0 0x7f35e80b27e0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35e80ce4c0 0x7f35e80b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 --2- 172.21.15.81:0/3932367403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35e806ab10 0x7f35e81402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 >> 172.21.15.81:0/3932367403 conn(0x7f35e80b08d0 msgr2=0x7f35e80ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 shutdown_connections 2024-09-13T18:52:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:55.503+0000 7f35efe00700 1 -- 172.21.15.81:0/3932367403 wait complete. 2024-09-13T18:52:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2024-09-13T18:52:55.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:52:39.990227+0000', 'modified': '2024-09-13T18:52:55.212970+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 7476, 'mds_1': 7467, 'mds_2': 6479}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6479': {'gid': 6479, 'name': 'd', 'rank': 2, 'incarnation': 74, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.178:6835/3142422230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3142422230}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 3142422230}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7467': {'gid': 7467, 'name': 'c', 'rank': 1, 'incarnation': 72, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.81:6835/3178710454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 3178710454}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 3178710454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_7476': {'gid': 7476, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/3243728894', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6836', 'nonce': 3243728894}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 3243728894}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:52:55.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:52:55.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:52:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccca000700 1 Processor -- start 2024-09-13T18:52:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccca000700 1 -- start start 2024-09-13T18:52:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccca000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 0x7fccc415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccca000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40b2ad0 con 0x7fccc406aaa0 2024-09-13T18:52:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccca000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40ccb10 con 0x7fccc40cb020 2024-09-13T18:52:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccca000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc415b960 con 0x7fccc40cc6f0 2024-09-13T18:52:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccc9600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fccc406aaa0 0x7fccc40b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51034/0 (socket says 172.21.15.81:51034) 2024-09-13T18:52:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccc9600700 1 -- 172.21.15.81:0/4264899349 learned_addr learned my addr 172.21.15.81:0/4264899349 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccc3e00700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 0x7fccc415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042580138 0 0) 0x7fccc40b2ad0 con 0x7fccc406aaa0 2024-09-13T18:52:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.123+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac0035d0 con 0x7fccc406aaa0 2024-09-13T18:52:56.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396090714 0 0) 0x7fccc40ccb10 con 0x7fccc40cb020 2024-09-13T18:52:56.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc40b2ad0 con 0x7fccc40cb020 2024-09-13T18:52:56.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3891606205 0 0) 0x7fccac0035d0 con 0x7fccc406aaa0 2024-09-13T18:52:56.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 msgr2=0x7fccc415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 0x7fccc415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 >> v1:172.21.15.178:6789/0 conn(0x7fccc40cb020 legacy=0x7fccc415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc415bc40 con 0x7fccc406aaa0 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fccbc0019f0 con 0x7fccc406aaa0 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 >> v1:172.21.15.81:6789/0 conn(0x7fccc406aaa0 legacy=0x7fccc40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac003c50 0x7fccac004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 0x7fccac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc415b960 con 0x7fccac003c50 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00bb40 con 0x7fccac004db0 2024-09-13T18:52:56.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00bd00 con 0x7fccc40cc6f0 2024-09-13T18:52:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc8c00700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac003c50 0x7fccac004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3e00700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 0x7fccac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 -- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 msgr2=0x7fccac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc40cc6f0 0x7fccac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 -- 172.21.15.81:0/4264899349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac003c50 msgr2=0x7fccac004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac003c50 0x7fccac004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 -- 172.21.15.81:0/4264899349 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0035d0 con 0x7fccac004db0 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc8c00700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccac003c50 0x7fccac004050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc9600700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccac005230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fccbc002230 tx=0x7fccac0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf3066aba8b0877 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0072d0 con 0x7fccac004db0 2024-09-13T18:52:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc007430 con 0x7fccac004db0 2024-09-13T18:52:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.127+0000 7fccc3400700 1 -- 172.21.15.81:0/4264899349 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0077c0 con 0x7fccac004db0 2024-09-13T18:52:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 -- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 msgr2=0x7fccac005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 --2- 172.21.15.81:0/4264899349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccac005230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fccbc002230 tx=0x7fccac0058a0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccc9600700 1 -- 172.21.15.81:0/4264899349 reap_dead start 2024-09-13T18:52:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 -- 172.21.15.81:0/4264899349 shutdown_connections 2024-09-13T18:52:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 -- 172.21.15.81:0/4264899349 >> 172.21.15.81:0/4264899349 conn(0x7fccc40b0c40 msgr2=0x7fccc406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 -- 172.21.15.81:0/4264899349 shutdown_connections 2024-09-13T18:52:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 -- 172.21.15.81:0/4264899349 wait complete. 2024-09-13T18:52:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 Processor -- start 2024-09-13T18:52:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.131+0000 7fccca000700 1 -- start start 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccc4154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 0x7fccc4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc414e960 0x7fccc414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4153cc0 con 0x7fccc414e500 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4153fa0 con 0x7fccac004db0 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc4154280 con 0x7fccc414e960 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 0x7fccc4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 0x7fccc4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47920/0 (socket says 172.21.15.81:47920) 2024-09-13T18:52:56.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 -- 172.21.15.81:0/947674245 learned_addr learned my addr 172.21.15.81:0/947674245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc8c00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccc4154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc9600700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc414e960 0x7fccc414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 -- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc414e960 msgr2=0x7fccc414d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc414e960 0x7fccc414d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 -- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 msgr2=0x7fccc4154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccc4154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 -- 172.21.15.81:0/947674245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc4154560 con 0x7fccc414e500 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc3e00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 0x7fccc4155fe0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fccb00119c0 tx=0x7fccb0011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc0c00700 1 -- 172.21.15.81:0/947674245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb000f940 con 0x7fccc414e500 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc0c00700 1 -- 172.21.15.81:0/947674245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb000faa0 con 0x7fccc414e500 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc4154840 con 0x7fccc414e500 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccc0c00700 1 -- 172.21.15.81:0/947674245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb000fe50 con 0x7fccc414e500 2024-09-13T18:52:56.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.135+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc4156700 con 0x7fccc414e500 2024-09-13T18:52:56.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.139+0000 7fccc0c00700 1 -- 172.21.15.81:0/947674245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fccb0014440 con 0x7fccc414e500 2024-09-13T18:52:56.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.139+0000 7fccc0c00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcca4066730 0x7fcca4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.139+0000 7fccc0c00700 1 -- 172.21.15.81:0/947674245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fccb00849c0 con 0x7fccc414e500 2024-09-13T18:52:56.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccc8c00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcca4066730 0x7fcca4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccc8c00700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcca4066730 0x7fcca4068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c00 tx=0x7fccb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 Processor -- start 2024-09-13T18:52:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 -- start start 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e5da0 0x1c4e6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4c4d00 0x1c4ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 0x1c4aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c40dd80 con 0x1c4e66c0 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c40b510 con 0x1c4c4d00 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c406e00 con 0x1c4e5da0 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccc9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 0x1c4aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccc9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 0x1c4aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47932/0 (socket says 172.21.15.81:47932) 2024-09-13T18:52:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.143+0000 7fccc9600700 1 -- 172.21.15.81:0/3496308070 learned_addr learned my addr 172.21.15.81:0/3496308070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc3e00700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4c4d00 0x1c4ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc8c00700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e5da0 0x1c4e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc9600700 1 -- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e5da0 msgr2=0x1c4e6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc9600700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e5da0 0x1c4e6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc9600700 1 -- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4c4d00 msgr2=0x1c4ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc9600700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4c4d00 0x1c4ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc9600700 1 -- 172.21.15.81:0/3496308070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c279960 con 0x1c4e66c0 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc3e00700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4c4d00 0x1c4ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc8c00700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e5da0 0x1c4e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccc9600700 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 0x1c4aedd0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fccbc016040 tx=0x7fccbc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704bb060b12418d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccb5200700 1 -- 172.21.15.81:0/3496308070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00a210 con 0x1c4e66c0 2024-09-13T18:52:56.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccb5200700 1 -- 172.21.15.81:0/3496308070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc023070 con 0x1c4e66c0 2024-09-13T18:52:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccb5200700 1 -- 172.21.15.81:0/3496308070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc007270 con 0x1c4e66c0 2024-09-13T18:52:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 -- 172.21.15.81:0/3496308070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 msgr2=0x1c4aedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 0x1c4aedd0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fccbc016040 tx=0x7fccbc006000 comp rx=0 tx=0).stop 2024-09-13T18:52:56.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 -- 172.21.15.81:0/3496308070 shutdown_connections 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e66c0 0x1c4aedd0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4c4d00 0x1c4ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3496308070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e5da0 0x1c4e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 -- 172.21.15.81:0/3496308070 >> 172.21.15.81:0/3496308070 conn(0x1c22e4d0 msgr2=0x1c4c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 -- 172.21.15.81:0/3496308070 shutdown_connections 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.147+0000 7fccce9b9740 1 -- 172.21.15.81:0/3496308070 wait complete. 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 -- start start 2024-09-13T18:52:56.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 Processor -- start 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 0x1c4a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e5da0 0x1c4c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e66c0 0x1c4c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c3c4730 con 0x1c4c4d00 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c3ca5b0 con 0x1c4e5da0 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c2b2aa0 con 0x1c4e66c0 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccce9b9740 10 client.0 _ll_register_callbacks cb 0x1c400610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 0x1c4a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 0x1c4a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47946/0 (socket says 172.21.15.81:47946) 2024-09-13T18:52:56.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 -- 172.21.15.81:0/2987933487 learned_addr learned my addr 172.21.15.81:0/2987933487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc9600700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e66c0 0x1c4c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc3e00700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e5da0 0x1c4c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 -- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e66c0 msgr2=0x1c4c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e66c0 0x1c4c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 -- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e5da0 msgr2=0x1c4c0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e5da0 0x1c4c0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 -- 172.21.15.81:0/2987933487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac0035d0 con 0x1c4c4d00 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc9600700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e66c0 0x1c4c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fccc8c00700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 0x1c4a06c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fccb8015770 tx=0x7fccb8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796719b7d9f85bf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.151+0000 7fcca9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fcca9600700 1 -- 172.21.15.81:0/2987933487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8028070 con 0x1c4c4d00 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fcca9600700 1 -- 172.21.15.81:0/2987933487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fccb801d070 con 0x1c4c4d00 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c23b1e0 con 0x1c4c4d00 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fcca9600700 1 -- 172.21.15.81:0/2987933487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb8003ed0 con 0x1c4c4d00 2024-09-13T18:52:56.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 10 client.7692 fetch_fsmap learned FSMap version 75 2024-09-13T18:52:56.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x1c3cd220 con 0x1c4c4d00 2024-09-13T18:52:56.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fcca9600700 1 -- 172.21.15.81:0/2987933487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c23b1e0 con 0x1c4c4d00 2024-09-13T18:52:56.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fcca9600700 1 -- 172.21.15.81:0/2987933487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fccb80145e0 con 0x1c4c4d00 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 10 client.7692 fetch_fsmap finished waiting for FSMap version 75 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 10 client.7692 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 20 client.7692 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4c6180 0x1c4c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 4 client.7692 mds_command: new command op to 6479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 --> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c285460 con 0x1c4c6180 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccc3e00700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4c6180 0x1c4c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fcca9600700 10 client.7692 ms_handle_connect on v2:172.21.15.178:6834/3142422230 2024-09-13T18:52:56.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.155+0000 7fccc3e00700 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4c6180 0x1c4c6560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba6b20fd34dc0e30 server_cookie=3fab3eec88b43c1e in_seq=0 out_seq=0 2024-09-13T18:52:56.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fcca9600700 1 -- 172.21.15.81:0/2987933487 <== mds.2 v2:172.21.15.178:6834/3142422230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1c285460 con 0x1c4c6180 2024-09-13T18:52:56.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fcca9600700 10 client.7692 handle_command_reply: tid=0 2024-09-13T18:52:56.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 client.7692 shutdown 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 msgr2=0x1c4a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 0x1c4a06c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fccb8015770 tx=0x7fccb8007d70 comp rx=0 tx=0).stop 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 shutdown_connections 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4c6180 0x1c4c6560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4e66c0 0x1c4c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fcca9600700 0 client.7692 ms_handle_reset on v2:172.21.15.178:6834/3142422230 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e5da0 0x1c4c0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 --2- 172.21.15.81:0/2987933487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4c4d00 0x1c4a06c0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 >> 172.21.15.81:0/2987933487 conn(0x1c22e4d0 msgr2=0x1c4c1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 shutdown_connections 2024-09-13T18:52:56.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 1 -- 172.21.15.81:0/2987933487 wait complete. 2024-09-13T18:52:56.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.159+0000 7fccce9b9740 20 client.7692 trim_cache size 0 max 16384 2024-09-13T18:52:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 Processor -- start 2024-09-13T18:52:56.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 -- start start 2024-09-13T18:52:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c49bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 0x1c501fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c4eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c3b6d70 con 0x1c4e5da0 2024-09-13T18:52:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c435ec0 con 0x1c4e66c0 2024-09-13T18:52:56.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c40a670 con 0x1c4c4d00 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 0x1c501fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 0x1c501fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47954/0 (socket says 172.21.15.81:47954) 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 -- 172.21.15.81:0/3955660432 learned_addr learned my addr 172.21.15.81:0/3955660432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc8c00700 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c49bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc9600700 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c4eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 -- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 msgr2=0x1c49bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c49bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 -- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 msgr2=0x1c4eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c4eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 -- 172.21.15.81:0/3955660432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c4c6830 con 0x1c4e5da0 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccc3e00700 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 0x1c501fd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fccb0082c80 tx=0x7fccb0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a77b068060abed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccb5c00700 1 -- 172.21.15.81:0/3955660432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0072170 con 0x1c4e5da0 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccb5c00700 1 -- 172.21.15.81:0/3955660432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb006d1d0 con 0x1c4e5da0 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.183+0000 7fccb5c00700 1 -- 172.21.15.81:0/3955660432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb005db80 con 0x1c4e5da0 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- 172.21.15.81:0/3955660432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 msgr2=0x1c501fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 0x1c501fd0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fccb0082c80 tx=0x7fccb0004770 comp rx=0 tx=0).stop 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- 172.21.15.81:0/3955660432 shutdown_connections 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c4eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c4e5da0 0x1c501fd0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- 172.21.15.81:0/3955660432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c49bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- 172.21.15.81:0/3955660432 >> 172.21.15.81:0/3955660432 conn(0x1c22e4d0 msgr2=0x1c4e4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- 172.21.15.81:0/3955660432 shutdown_connections 2024-09-13T18:52:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- 172.21.15.81:0/3955660432 wait complete. 2024-09-13T18:52:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- start start 2024-09-13T18:52:56.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 Processor -- start 2024-09-13T18:52:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c54b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c54bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c54ba90 0x1c54c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c501ef0 con 0x1c54ba90 2024-09-13T18:52:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c49bf70 con 0x1c4e66c0 2024-09-13T18:52:56.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c5013e0 con 0x1c4c4d00 2024-09-13T18:52:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccce9b9740 10 client.0 _ll_register_callbacks cb 0x1c45d710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccc9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c54ba90 0x1c54c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccc8c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c54b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccc8c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c54b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:33012/0 (socket says 172.21.15.81:33012) 2024-09-13T18:52:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccc8c00700 1 -- 172.21.15.81:0/1368011112 learned_addr learned my addr 172.21.15.81:0/1368011112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.187+0000 7fccc3e00700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c54bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc8c00700 1 -- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 msgr2=0x1c54bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc8c00700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c54bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc8c00700 1 -- 172.21.15.81:0/1368011112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c54ba90 msgr2=0x1c54c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc8c00700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c54ba90 0x1c54c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc8c00700 1 -- 172.21.15.81:0/1368011112 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc4154840 con 0x1c4c4d00 2024-09-13T18:52:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc9600700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c54ba90 0x1c54c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:52:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc8c00700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c54b550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fccb802fb20 tx=0x7fccb8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5934652518e88dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fcca9600700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2024-09-13T18:52:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fcca9600700 1 -- 172.21.15.81:0/1368011112 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8028040 con 0x1c4c4d00 2024-09-13T18:52:56.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccbc023070 con 0x1c4c4d00 2024-09-13T18:52:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fcca9600700 1 -- 172.21.15.81:0/1368011112 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fccb80013d0 con 0x1c4c4d00 2024-09-13T18:52:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fcca9600700 1 -- 172.21.15.81:0/1368011112 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccb8014d80 con 0x1c4c4d00 2024-09-13T18:52:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 10 client.6626 fetch_fsmap learned FSMap version 75 2024-09-13T18:52:56.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x1c3b3450 con 0x1c4c4d00 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fcca9600700 1 -- 172.21.15.81:0/1368011112 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc023070 con 0x1c4c4d00 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fcca9600700 1 -- 172.21.15.81:0/1368011112 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 75) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fccb802b050 con 0x1c4c4d00 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 10 client.6626 fetch_fsmap finished waiting for FSMap version 75 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 10 client.6626 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 20 client.6626 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4ff540 0x1c4ff920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 4 client.6626 mds_command: new command op to 6479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 --> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1c2aa1e0 con 0x1c4ff540 2024-09-13T18:52:56.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.191+0000 7fccc3e00700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4ff540 0x1c4ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccc3e00700 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4ff540 0x1c4ff920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c1dc7c24dd45e764 server_cookie=246bcb1f301a3c9e in_seq=0 out_seq=0 2024-09-13T18:52:56.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fcca9600700 10 client.6626 ms_handle_connect on v2:172.21.15.178:6834/3142422230 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fcca9600700 1 -- 172.21.15.81:0/1368011112 <== mds.2 v2:172.21.15.178:6834/3142422230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1c2aa1e0 con 0x1c4ff540 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fcca9600700 10 client.6626 handle_command_reply: tid=0 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 client.6626 shutdown 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 msgr2=0x1c54b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c54b550 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fccb802fb20 tx=0x7fccb8016000 comp rx=0 tx=0).stop 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 shutdown_connections 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0x1c4ff540 0x1c4ff920 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c54ba90 0x1c54c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c4e66c0 0x1c54bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 --2- 172.21.15.81:0/1368011112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4c4d00 0x1c54b550 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fcca9600700 0 client.6626 ms_handle_reset on v2:172.21.15.178:6834/3142422230 2024-09-13T18:52:56.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 >> 172.21.15.81:0/1368011112 conn(0x1c22e4d0 msgr2=0x1c49a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 shutdown_connections 2024-09-13T18:52:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 1 -- 172.21.15.81:0/1368011112 wait complete. 2024-09-13T18:52:56.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccce9b9740 20 client.6626 trim_cache size 0 max 16384 2024-09-13T18:52:56.205 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:52:56.205 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6479, 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 1.9878874740000001, 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 75, 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 81, 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 21.400611546 2024-09-13T18:52:56.206 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcca4066730 msgr2=0x7fcca4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcca4066730 0x7fcca4068bf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fccb8000c00 tx=0x7fccb8009040 comp rx=0 tx=0).stop 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 msgr2=0x7fccc4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 0x7fccc4155fe0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fccb00119c0 tx=0x7fccb0011d80 comp rx=0 tx=0).stop 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 shutdown_connections 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcca4066730 0x7fcca4068bf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccc414e960 0x7fccc414d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccc414e500 0x7fccc4155fe0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 --2- 172.21.15.81:0/947674245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccac004db0 0x7fccc4154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 >> 172.21.15.81:0/947674245 conn(0x7fccc40b0c40 msgr2=0x7fccc4159840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 shutdown_connections 2024-09-13T18:52:56.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.195+0000 7fccca000700 1 -- 172.21.15.81:0/947674245 wait complete. 2024-09-13T18:52:56.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:52:56.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.399+0000 7fe2cf200700 1 Processor -- start 2024-09-13T18:52:56.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.399+0000 7fe2cf200700 1 -- start start 2024-09-13T18:52:56.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cf200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d00cd4c0 0x7fe2d006a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cf200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d006ad10 con 0x7fe2d006a390 2024-09-13T18:52:56.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cf200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00cb1a0 con 0x7fe2d0161150 2024-09-13T18:52:56.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cf200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00cb440 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cd400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe2d006a390 0x7fe2d00ccdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51050/0 (socket says 172.21.15.81:51050) 2024-09-13T18:52:56.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cd400700 1 -- 172.21.15.81:0/3885164221 learned_addr learned my addr 172.21.15.81:0/3885164221 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:52:56.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2ce800700 1 --2- 172.21.15.81:0/3885164221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d00cd4c0 0x7fe2d006a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982411506 0 0) 0x7fe2d006ad10 con 0x7fe2d006a390 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b40035d0 con 0x7fe2d006a390 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892828294 0 0) 0x7fe2d00cb1a0 con 0x7fe2d0161150 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d006ad10 con 0x7fe2d0161150 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2ce800700 1 -- 172.21.15.81:0/3885164221 >> v1:172.21.15.178:6789/0 conn(0x7fe2d0161150 legacy=0x7fe2d00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2ce800700 1 -- 172.21.15.81:0/3885164221 >> v1:172.21.15.81:6789/0 conn(0x7fe2d006a390 legacy=0x7fe2d00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2ce800700 1 -- 172.21.15.81:0/3885164221 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00cb720 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2ce800700 1 --2- 172.21.15.81:0/3885164221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d00cd4c0 0x7fe2d006a7d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009dc0 tx=0x7fe2c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=504d0feca56df8d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800e070 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c800bb20 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cca00700 1 -- 172.21.15.81:0/3885164221 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8012430 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cf200700 1 -- 172.21.15.81:0/3885164221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d00cd4c0 msgr2=0x7fe2d006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.403+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3885164221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d00cd4c0 0x7fe2d006a7d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8009dc0 tx=0x7fe2c800b330 comp rx=0 tx=0).stop 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- 172.21.15.81:0/3885164221 shutdown_connections 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3885164221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d00cd4c0 0x7fe2d006a7d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- 172.21.15.81:0/3885164221 >> 172.21.15.81:0/3885164221 conn(0x7fe2d0071f00 msgr2=0x7fe2d00722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- 172.21.15.81:0/3885164221 shutdown_connections 2024-09-13T18:52:56.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- 172.21.15.81:0/3885164221 wait complete. 2024-09-13T18:52:56.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 Processor -- start 2024-09-13T18:52:56.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- start start 2024-09-13T18:52:56.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d006a390 0x7fe2d01f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 0x7fe2d00c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2d0161150 0x7fe2d00c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00b49a0 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00c8810 con 0x7fe2d0161150 2024-09-13T18:52:56.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cf200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01f6840 con 0x7fe2d006a390 2024-09-13T18:52:56.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 0x7fe2d00c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.407+0000 7fe2cd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 0x7fe2d00c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47964/0 (socket says 172.21.15.81:47964) 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 -- 172.21.15.81:0/3126066931 learned_addr learned my addr 172.21.15.81:0/3126066931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2ce800700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2d0161150 0x7fe2d00c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cde00700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d006a390 0x7fe2d01f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 -- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d006a390 msgr2=0x7fe2d01f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d006a390 0x7fe2d01f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 -- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2d0161150 msgr2=0x7fe2d00c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2d0161150 0x7fe2d00c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 -- 172.21.15.81:0/3126066931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009a70 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2ce800700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2d0161150 0x7fe2d00c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 0x7fe2d00c6720 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c4d0 tx=0x7fe2bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2c6000700 1 -- 172.21.15.81:0/3126066931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc005d90 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2c6000700 1 -- 172.21.15.81:0/3126066931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0070d0 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d00c71e0 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2c6000700 1 -- 172.21.15.81:0/3126066931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc007460 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.411+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d00b4c10 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.415+0000 7fe2c6000700 1 -- 172.21.15.81:0/3126066931 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2bc0075c0 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.415+0000 7fe2c6000700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2b0066730 0x7fe2b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.415+0000 7fe2c6000700 1 -- 172.21.15.81:0/3126066931 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2bc083760 con 0x7fe2d00cd4c0 2024-09-13T18:52:56.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.415+0000 7fe2cde00700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2b0066730 0x7fe2b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.415+0000 7fe2cde00700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2b0066730 0x7fe2b0068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0007fd0 tx=0x7fe2c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 Processor -- start 2024-09-13T18:52:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 -- start start 2024-09-13T18:52:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7230 0x2ada7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2ad6f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 0x2ad6fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2acced80 con 0x2ada7b50 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2accc510 con 0x2ada7230 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2acc7e00 con 0x2ad85e90 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 0x2ad6fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 0x2ad6fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47966/0 (socket says 172.21.15.81:47966) 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 -- 172.21.15.81:0/280578169 learned_addr learned my addr 172.21.15.81:0/280578169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2cde00700 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7230 0x2ada7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2cd400700 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2ad6f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 -- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 msgr2=0x2ad6f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2ad6f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 -- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7230 msgr2=0x2ada7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.419+0000 7fe2ce800700 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7230 0x2ada7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2ce800700 1 -- 172.21.15.81:0/280578169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ab3a960 con 0x2ada7b50 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2cde00700 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7230 0x2ada7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2ce800700 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 0x2ad6fdd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800b370 tx=0x7fe2c8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f1b3a6c8cfdc8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2baa00700 1 -- 172.21.15.81:0/280578169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80125e0 con 0x2ada7b50 2024-09-13T18:52:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2baa00700 1 -- 172.21.15.81:0/280578169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8012740 con 0x2ada7b50 2024-09-13T18:52:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2baa00700 1 -- 172.21.15.81:0/280578169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8012ad0 con 0x2ada7b50 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 -- 172.21.15.81:0/280578169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 msgr2=0x2ad6fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 0x2ad6fdd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800b370 tx=0x7fe2c8011000 comp rx=0 tx=0).stop 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 -- 172.21.15.81:0/280578169 shutdown_connections 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7b50 0x2ad6fdd0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2ad6f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/280578169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7230 0x2ada7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 -- 172.21.15.81:0/280578169 >> 172.21.15.81:0/280578169 conn(0x2aaef4d0 msgr2=0x2ad88e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 -- 172.21.15.81:0/280578169 shutdown_connections 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 -- 172.21.15.81:0/280578169 wait complete. 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 -- start start 2024-09-13T18:52:56.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.423+0000 7fe2d86ad740 1 Processor -- start 2024-09-13T18:52:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2adb03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 0x2ad878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ad87e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac85730 con 0x2ada7230 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac8b5b0 con 0x2ada7b50 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ab73aa0 con 0x2ad85e90 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 10 client.0 _ll_register_callbacks cb 0x2acc1610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 0x2ad878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 0x2ad878f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47972/0 (socket says 172.21.15.81:47972) 2024-09-13T18:52:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 -- 172.21.15.81:0/594695864 learned_addr learned my addr 172.21.15.81:0/594695864 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cde00700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2adb03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2ce800700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ad87e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 -- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 msgr2=0x2adb03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2adb03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 -- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 msgr2=0x2ad87e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ad87e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 -- 172.21.15.81:0/594695864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d00cb720 con 0x2ada7230 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cde00700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2adb03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2ce800700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ad87e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cd400700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 0x2ad878f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c4a0 tx=0x7fe2bc054c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc3477cb40861bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2af400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2af400700 1 -- 172.21.15.81:0/594695864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0546e0 con 0x2ada7230 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2af400700 1 -- 172.21.15.81:0/594695864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2bc058510 con 0x2ada7230 2024-09-13T18:52:56.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2aafc1e0 con 0x2ada7230 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2af400700 1 -- 172.21.15.81:0/594695864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2bc05cad0 con 0x2ada7230 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 10 client.7710 fetch_fsmap learned FSMap version 75 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x2ac8e220 con 0x2ada7230 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2af400700 1 -- 172.21.15.81:0/594695864 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2aafc1e0 con 0x2ada7230 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2af400700 1 -- 172.21.15.81:0/594695864 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fe2bc05c640 con 0x2ada7230 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 10 client.7710 fetch_fsmap finished waiting for FSMap version 75 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 10 client.7710 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 20 client.7710 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ad60790 0x2adbad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 4 client.7710 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2ab46460 con 0x2ad60790 2024-09-13T18:52:56.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.427+0000 7fe2cde00700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ad60790 0x2adbad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2cde00700 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ad60790 0x2adbad00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53383505d162c1c server_cookie=9793f6af0803429c in_seq=0 out_seq=0 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2af400700 10 client.7710 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2af400700 1 -- 172.21.15.81:0/594695864 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2ab46460 con 0x2ad60790 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2af400700 10 client.7710 handle_command_reply: tid=0 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 client.7710 shutdown 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 msgr2=0x2ad878f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 0x2ad878f0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c4a0 tx=0x7fe2bc054c20 comp rx=0 tx=0).stop 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 shutdown_connections 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ad60790 0x2adbad00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ad87e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2af400700 0 client.7710 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:52:56.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ada7230 0x2ad878f0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/594695864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ad85e90 0x2adb03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 >> 172.21.15.81:0/594695864 conn(0x2aaef4d0 msgr2=0x2ad5b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 shutdown_connections 2024-09-13T18:52:56.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 1 -- 172.21.15.81:0/594695864 wait complete. 2024-09-13T18:52:56.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.431+0000 7fe2d86ad740 20 client.7710 trim_cache size 0 max 16384 2024-09-13T18:52:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 Processor -- start 2024-09-13T18:52:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 -- start start 2024-09-13T18:52:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2ad865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2ad86b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ada7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ada6750 con 0x2ad85e90 2024-09-13T18:52:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ad61b90 con 0x2ada7b50 2024-09-13T18:52:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.451+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ac86e70 con 0x2ada7230 2024-09-13T18:52:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2ad865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2ad865e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47988/0 (socket says 172.21.15.81:47988) 2024-09-13T18:52:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 -- 172.21.15.81:0/2464768033 learned_addr learned my addr 172.21.15.81:0/2464768033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2ce800700 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ada7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cd400700 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2ad86b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 -- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 msgr2=0x2ad86b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2ad86b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 -- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 msgr2=0x2ada7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ada7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 -- 172.21.15.81:0/2464768033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ac74450 con 0x2ad85e90 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2ce800700 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ada7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2cde00700 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2ad865e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0001eb0 tx=0x7fe2c0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4489221200226d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2bb400700 1 -- 172.21.15.81:0/2464768033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0003b00 con 0x2ad85e90 2024-09-13T18:52:56.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2bb400700 1 -- 172.21.15.81:0/2464768033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c0003c60 con 0x2ad85e90 2024-09-13T18:52:56.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2bb400700 1 -- 172.21.15.81:0/2464768033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0003df0 con 0x2ad85e90 2024-09-13T18:52:56.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 -- 172.21.15.81:0/2464768033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 msgr2=0x2ad865e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2ad865e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0001eb0 tx=0x7fe2c0012000 comp rx=0 tx=0).stop 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 -- 172.21.15.81:0/2464768033 shutdown_connections 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ada7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2ad86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/2464768033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2ad865e0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 -- 172.21.15.81:0/2464768033 >> 172.21.15.81:0/2464768033 conn(0x2aaef4d0 msgr2=0x2ad87c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 -- 172.21.15.81:0/2464768033 shutdown_connections 2024-09-13T18:52:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.455+0000 7fe2d86ad740 1 -- 172.21.15.81:0/2464768033 wait complete. 2024-09-13T18:52:56.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 -- start start 2024-09-13T18:52:56.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 Processor -- start 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2adac400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2adac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ae07370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ad62830 con 0x2ad85e90 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ad62590 con 0x2ada7b50 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2adc4900 con 0x2ada7230 2024-09-13T18:52:56.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2d86ad740 10 client.0 _ll_register_callbacks cb 0x2ac79ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2adac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2adac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47992/0 (socket says 172.21.15.81:47992) 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2cde00700 1 -- 172.21.15.81:0/3005027020 learned_addr learned my addr 172.21.15.81:0/3005027020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2ce800700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ae07370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.459+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2adac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cde00700 1 -- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 msgr2=0x2adac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cde00700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2adac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cde00700 1 -- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 msgr2=0x2ae07370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cde00700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ae07370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cde00700 1 -- 172.21.15.81:0/3005027020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c000f040 con 0x2ad85e90 2024-09-13T18:52:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2adac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cde00700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2adac400 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00054e0 tx=0x7fe2c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f3d3112b7d08f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 1 -- 172.21.15.81:0/3005027020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00246b0 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2ada6890 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 1 -- 172.21.15.81:0/3005027020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe2c0024810 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 1 -- 172.21.15.81:0/3005027020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2c002e440 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 10 client.7716 fetch_fsmap learned FSMap version 75 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x2ac68720 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 1 -- 172.21.15.81:0/3005027020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2ada6890 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 1 -- 172.21.15.81:0/3005027020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fe2c0020070 con 0x2ad85e90 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 10 client.7716 fetch_fsmap finished waiting for FSMap version 75 2024-09-13T18:52:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 10 client.7716 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 20 client.7716 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2adaa230 0x2adaa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 4 client.7716 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe2c8012740 con 0x2adaa230 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2adaa230 0x2adaa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2cd400700 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2adaa230 0x2adaa610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4ca7949be9b6890 server_cookie=e24e0688d7e97739 in_seq=0 out_seq=0 2024-09-13T18:52:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.463+0000 7fe2af400700 10 client.7716 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2af400700 1 -- 172.21.15.81:0/3005027020 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7fe2c8012740 con 0x2adaa230 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2af400700 10 client.7716 handle_command_reply: tid=0 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 client.7716 shutdown 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 msgr2=0x2adac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2adac400 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00054e0 tx=0x7fe2c0000ed0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 shutdown_connections 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2adaa230 0x2adaa610 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ada7b50 0x2ae07370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ada7230 0x2adac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2af400700 0 client.7716 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:52:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 --2- 172.21.15.81:0/3005027020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ad85e90 0x2adac400 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 >> 172.21.15.81:0/3005027020 conn(0x2aaef4d0 msgr2=0x2adbf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 shutdown_connections 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 1 -- 172.21.15.81:0/3005027020 wait complete. 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2d86ad740 20 client.7716 trim_cache size 0 max 16384 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7467, 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:52:56.478 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 3.266454671, 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 75, 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 81, 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 21.690904246999999 2024-09-13T18:52:56.480 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2b0066730 msgr2=0x7fe2b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2b0066730 0x7fe2b0068bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0007fd0 tx=0x7fe2c0009040 comp rx=0 tx=0).stop 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 msgr2=0x7fe2d00c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 0x7fe2d00c6720 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00c4d0 tx=0x7fe2bc00c890 comp rx=0 tx=0).stop 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 shutdown_connections 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe2b0066730 0x7fe2b0068bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2d0161150 0x7fe2d00c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d00cd4c0 0x7fe2d00c6720 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 --2- 172.21.15.81:0/3126066931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2d006a390 0x7fe2d01f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 >> 172.21.15.81:0/3126066931 conn(0x7fe2d0071f00 msgr2=0x7fe2d00722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 shutdown_connections 2024-09-13T18:52:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.467+0000 7fe2cf200700 1 -- 172.21.15.81:0/3126066931 wait complete. 2024-09-13T18:52:56.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:52:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.679+0000 7f090b600700 1 Processor -- start 2024-09-13T18:52:56.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.679+0000 7f090b600700 1 -- start start 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f090b600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f090b600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09040b19f0 0x7f090406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f090b600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09040cd610 0x7f090406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f090b600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09040ce140 con 0x7f09040cd610 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f090b600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090406aef0 con 0x7f09040b19f0 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f090b600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09040b1e30 con 0x7f090406a5d0 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09040cd610 0x7f090406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09040cd610 0x7f090406ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40538/0 (socket says 172.21.15.81:40538) 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 -- 172.21.15.81:0/627879281 learned_addr learned my addr 172.21.15.81:0/627879281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0908c00700 1 --2- 172.21.15.81:0/627879281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0903e00700 1 --2- 172.21.15.81:0/627879281 >> v2:172.21.15.178:3300/0 conn(0x7f09040b19f0 0x7f090406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 -- 172.21.15.81:0/627879281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 msgr2=0x7f0904071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 --2- 172.21.15.81:0/627879281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 -- 172.21.15.81:0/627879281 >> v2:172.21.15.178:3300/0 conn(0x7f09040b19f0 msgr2=0x7f090406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 --2- 172.21.15.81:0/627879281 >> v2:172.21.15.178:3300/0 conn(0x7f09040b19f0 0x7f090406a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.683+0000 7f0909600700 1 -- 172.21.15.81:0/627879281 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040cde60 con 0x7f09040cd610 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f0909600700 1 --2- 172.21.15.81:0/627879281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040cd610 0x7f090406ce90 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f090406dea0 tx=0x7f08fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac35d269523ed52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f0903400700 1 -- 172.21.15.81:0/627879281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00e070 con 0x7f09040cd610 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f0903400700 1 -- 172.21.15.81:0/627879281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc00b910 con 0x7f09040cd610 2024-09-13T18:52:56.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f0903400700 1 -- 172.21.15.81:0/627879281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00bcc0 con 0x7f09040cd610 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 -- 172.21.15.81:0/627879281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040cd610 msgr2=0x7f090406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 --2- 172.21.15.81:0/627879281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040cd610 0x7f090406ce90 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f090406dea0 tx=0x7f08fc00b330 comp rx=0 tx=0).stop 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 -- 172.21.15.81:0/627879281 shutdown_connections 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 --2- 172.21.15.81:0/627879281 >> v2:172.21.15.178:3300/0 conn(0x7f09040b19f0 0x7f090406a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 --2- 172.21.15.81:0/627879281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040cd610 0x7f090406ce90 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 --2- 172.21.15.81:0/627879281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 -- 172.21.15.81:0/627879281 >> 172.21.15.81:0/627879281 conn(0x7f09040b08d0 msgr2=0x7f09040b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 -- 172.21.15.81:0/627879281 shutdown_connections 2024-09-13T18:52:56.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.687+0000 7f090b600700 1 -- 172.21.15.81:0/627879281 wait complete. 2024-09-13T18:52:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 Processor -- start 2024-09-13T18:52:56.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 -- start start 2024-09-13T18:52:56.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 0x7f0904145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040cd610 0x7f09041507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0904146660 con 0x7f09040b19f0 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0904146940 con 0x7f09040cd610 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f090b600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0904146c20 con 0x7f090406a5d0 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 0x7f0904145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 0x7f0904145d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40542/0 (socket says 172.21.15.81:40542) 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 -- 172.21.15.81:0/3953767136 learned_addr learned my addr 172.21.15.81:0/3953767136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0908c00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0909600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040cd610 0x7f09041507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 -- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 msgr2=0x7f0904160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904160600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 -- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040cd610 msgr2=0x7f09041507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040cd610 0x7f09041507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 -- 172.21.15.81:0/3953767136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc009b30 con 0x7f09040b19f0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.691+0000 7f0903e00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 0x7f0904145d80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009fd0 tx=0x7f08f000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.695+0000 7f0900c00700 1 -- 172.21.15.81:0/3953767136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00095a0 con 0x7f09040b19f0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.695+0000 7f0900c00700 1 -- 172.21.15.81:0/3953767136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0013680 con 0x7f09040b19f0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.695+0000 7f0900c00700 1 -- 172.21.15.81:0/3953767136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0013a10 con 0x7f09040b19f0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.695+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0904146f00 con 0x7f09040b19f0 2024-09-13T18:52:56.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.695+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0904160b40 con 0x7f09040b19f0 2024-09-13T18:52:56.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f0900c00700 1 -- 172.21.15.81:0/3953767136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f08f0013b70 con 0x7f09040b19f0 2024-09-13T18:52:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f0900c00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08e4066730 0x7f08e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f0900c00700 1 -- 172.21.15.81:0/3953767136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f08f00840c0 con 0x7f09040b19f0 2024-09-13T18:52:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 Processor -- start 2024-09-13T18:52:56.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f0908c00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08e4066730 0x7f08e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 -- start start 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f0908c00700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08e4066730 0x7f08e4068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f09040b3890 tx=0x7f08f8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fbb1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fb79890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb79dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fad8d80 con 0x1fb8fd00 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fad6510 con 0x1fbb0da0 2024-09-13T18:52:56.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.699+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fad1e00 con 0x1fbb16c0 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fb79890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fb79890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40554/0 (socket says 172.21.15.81:40554) 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 -- 172.21.15.81:0/614896826 learned_addr learned my addr 172.21.15.81:0/614896826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0908c00700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fbb1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0909600700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb79dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 -- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 msgr2=0x1fb79dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb79dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 -- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 msgr2=0x1fbb1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fbb1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 -- 172.21.15.81:0/614896826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f944960 con 0x1fb8fd00 2024-09-13T18:52:56.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0908c00700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fbb1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0909600700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb79dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f0903e00700 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fb79890 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f08f005cdd0 tx=0x7f08f0055740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409a03647c426fc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f08f5200700 1 -- 172.21.15.81:0/614896826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f005b070 con 0x1fb8fd00 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f08f5200700 1 -- 172.21.15.81:0/614896826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f005d300 con 0x1fb8fd00 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f08f5200700 1 -- 172.21.15.81:0/614896826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0055170 con 0x1fb8fd00 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 -- 172.21.15.81:0/614896826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 msgr2=0x1fb79890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fb79890 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f08f005cdd0 tx=0x7f08f0055740 comp rx=0 tx=0).stop 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 -- 172.21.15.81:0/614896826 shutdown_connections 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb79dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fb79890 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 --2- 172.21.15.81:0/614896826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fbb1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 -- 172.21.15.81:0/614896826 >> 172.21.15.81:0/614896826 conn(0x1f8f94d0 msgr2=0x1fb92c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 -- 172.21.15.81:0/614896826 shutdown_connections 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 -- 172.21.15.81:0/614896826 wait complete. 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 -- start start 2024-09-13T18:52:56.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.703+0000 7f090ea42740 1 Processor -- start 2024-09-13T18:52:56.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fbacd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 0x1fb8bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb69d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa8f730 con 0x1fbb0da0 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa955b0 con 0x1fb8fd00 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f97daa0 con 0x1fbb16c0 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 10 client.0 _ll_register_callbacks cb 0x1facb610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 0x1fb8bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 0x1fb8bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40560/0 (socket says 172.21.15.81:40560) 2024-09-13T18:52:56.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 -- 172.21.15.81:0/1081395667 learned_addr learned my addr 172.21.15.81:0/1081395667 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0908c00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fbacd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0909600700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb69d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 -- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 msgr2=0x1fb69d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb69d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 -- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 msgr2=0x1fbacd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fbacd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 -- 172.21.15.81:0/1081395667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0904160b40 con 0x1fbb0da0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0908c00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fbacd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0903e00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 0x1fb8bd30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f08f0054c10 tx=0x7f08f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd07080a3d298837 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f08e9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f08e9600700 1 -- 172.21.15.81:0/1081395667 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0051250 con 0x1fbb0da0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f08e9600700 1 -- 172.21.15.81:0/1081395667 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f08f0055170 con 0x1fbb0da0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f9061e0 con 0x1fbb0da0 2024-09-13T18:52:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f08e9600700 1 -- 172.21.15.81:0/1081395667 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f0055350 con 0x1fbb0da0 2024-09-13T18:52:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 10 client.7728 fetch_fsmap learned FSMap version 75 2024-09-13T18:52:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x1fa98220 con 0x1fbb0da0 2024-09-13T18:52:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f08e9600700 1 -- 172.21.15.81:0/1081395667 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f9061e0 con 0x1fbb0da0 2024-09-13T18:52:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f08e9600700 1 -- 172.21.15.81:0/1081395667 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f08f005ce70 con 0x1fbb0da0 2024-09-13T18:52:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 10 client.7728 fetch_fsmap finished waiting for FSMap version 75 2024-09-13T18:52:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 10 client.7728 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:52:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 20 client.7728 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fb6a910 0x1fb67d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 4 client.7728 mds_command: new command op to 7476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 --> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f950460 con 0x1fb6a910 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.707+0000 7f0908c00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fb6a910 0x1fb67d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f0908c00700 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fb6a910 0x1fb67d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3e8c7655f69396 server_cookie=62e3f4673bf70874 in_seq=0 out_seq=0 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f08e9600700 10 client.7728 ms_handle_connect on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f08e9600700 1 -- 172.21.15.81:0/1081395667 <== mds.0 v2:172.21.15.81:6836/3243728894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1f950460 con 0x1fb6a910 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f08e9600700 10 client.7728 handle_command_reply: tid=0 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 client.7728 shutdown 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 msgr2=0x1fb8bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 0x1fb8bd30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f08f0054c10 tx=0x7f08f0000bc0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 shutdown_connections 2024-09-13T18:52:56.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fb6a910 0x1fb67d30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fb69d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb0da0 0x1fb8bd30 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 --2- 172.21.15.81:0/1081395667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fbacd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f08e9600700 0 client.7728 ms_handle_reset on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 >> 172.21.15.81:0/1081395667 conn(0x1f8f94d0 msgr2=0x1fb8c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 shutdown_connections 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 1 -- 172.21.15.81:0/1081395667 wait complete. 2024-09-13T18:52:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.711+0000 7f090ea42740 20 client.7728 trim_cache size 0 max 16384 2024-09-13T18:52:56.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.731+0000 7f090ea42740 1 Processor -- start 2024-09-13T18:52:56.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.731+0000 7f090ea42740 1 -- start start 2024-09-13T18:52:56.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fb65700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb0da0 0x1fb65c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 0x1fb8e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa8f730 con 0x1fbb16c0 2024-09-13T18:52:56.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa8e700 con 0x1fb8fd00 2024-09-13T18:52:56.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fbb7370 con 0x1fbb0da0 2024-09-13T18:52:56.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 0x1fb8e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 0x1fb8e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40572/0 (socket says 172.21.15.81:40572) 2024-09-13T18:52:56.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 -- 172.21.15.81:0/3973308459 learned_addr learned my addr 172.21.15.81:0/3973308459 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0908c00700 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fb65700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0903e00700 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb0da0 0x1fb65c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 -- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb0da0 msgr2=0x1fb65c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb0da0 0x1fb65c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 -- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 msgr2=0x1fb65700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fb65700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 -- 172.21.15.81:0/3973308459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fa7e450 con 0x1fbb16c0 2024-09-13T18:52:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f0909600700 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 0x1fb8e690 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f08fc012000 tx=0x7f08fc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc927349f37e3c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f08f5c00700 1 -- 172.21.15.81:0/3973308459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00bd40 con 0x1fbb16c0 2024-09-13T18:52:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f08f5c00700 1 -- 172.21.15.81:0/3973308459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc003a40 con 0x1fbb16c0 2024-09-13T18:52:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f08f5c00700 1 -- 172.21.15.81:0/3973308459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00bea0 con 0x1fbb16c0 2024-09-13T18:52:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- 172.21.15.81:0/3973308459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 msgr2=0x1fb8e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 0x1fb8e690 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f08fc012000 tx=0x7f08fc010000 comp rx=0 tx=0).stop 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- 172.21.15.81:0/3973308459 shutdown_connections 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fbb16c0 0x1fb8e690 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb0da0 0x1fb65c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 --2- 172.21.15.81:0/3973308459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fb8fd00 0x1fb65700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- 172.21.15.81:0/3973308459 >> 172.21.15.81:0/3973308459 conn(0x1f8f94d0 msgr2=0x1fb8b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- 172.21.15.81:0/3973308459 shutdown_connections 2024-09-13T18:52:56.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.735+0000 7f090ea42740 1 -- 172.21.15.81:0/3973308459 wait complete. 2024-09-13T18:52:56.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 -- start start 2024-09-13T18:52:56.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 Processor -- start 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fbb6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fc11860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fbcf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa955b0 con 0x1fb8fd00 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fbd0180 con 0x1fbb0da0 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fb68650 con 0x1fbb16c0 2024-09-13T18:52:56.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f090ea42740 10 client.0 _ll_register_callbacks cb 0x1fb28710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:52:56.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f0908c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fbb6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f0908c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fbb6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40578/0 (socket says 172.21.15.81:40578) 2024-09-13T18:52:56.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f0908c00700 1 -- 172.21.15.81:0/67189239 learned_addr learned my addr 172.21.15.81:0/67189239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f0903e00700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fc11860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.739+0000 7f0909600700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fbcf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0908c00700 1 -- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 msgr2=0x1fbcf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0908c00700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fbcf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0908c00700 1 -- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 msgr2=0x1fc11860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0908c00700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fc11860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0908c00700 1 -- 172.21.15.81:0/67189239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09040cde60 con 0x1fb8fd00 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0908c00700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fbb6710 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x1fb69a50 tx=0x7f08f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f64b03d994d1af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 1 -- 172.21.15.81:0/67189239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8029dd0 con 0x1fb8fd00 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 1 -- 172.21.15.81:0/67189239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f08f801c040 con 0x1fb8fd00 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08f005d300 con 0x1fb8fd00 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 1 -- 172.21.15.81:0/67189239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f8014440 con 0x1fb8fd00 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 10 client.7734 fetch_fsmap learned FSMap version 75 2024-09-13T18:52:56.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x1fa72720 con 0x1fb8fd00 2024-09-13T18:52:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 1 -- 172.21.15.81:0/67189239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f005d300 con 0x1fb8fd00 2024-09-13T18:52:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 1 -- 172.21.15.81:0/67189239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 75) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f08f80145a0 con 0x1fb8fd00 2024-09-13T18:52:56.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 10 client.7734 fetch_fsmap finished waiting for FSMap version 75 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 10 client.7734 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 20 client.7734 populate_metadata read hostname 'smithi081' 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fc13020 0x1fbcdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 4 client.7734 mds_command: new command op to 7476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 --> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1f9751e0 con 0x1fc13020 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0903e00700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fc13020 0x1fbcdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f0903e00700 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fc13020 0x1fbcdec0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5223031128b1f0c3 server_cookie=cd946e27e149b2ed in_seq=0 out_seq=0 2024-09-13T18:52:56.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 10 client.7734 ms_handle_connect on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 1 -- 172.21.15.81:0/67189239 <== mds.0 v2:172.21.15.81:6836/3243728894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1f9751e0 con 0x1fc13020 2024-09-13T18:52:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f08e9600700 10 client.7734 handle_command_reply: tid=0 2024-09-13T18:52:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.743+0000 7f090ea42740 1 client.7734 shutdown 2024-09-13T18:52:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 msgr2=0x1fbb6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fbb6710 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x1fb69a50 tx=0x7f08f8014000 comp rx=0 tx=0).stop 2024-09-13T18:52:56.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 shutdown_connections 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x1fc13020 0x1fbcdec0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fbb16c0 0x1fbcf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fbb0da0 0x1fc11860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f08e9600700 0 client.7734 ms_handle_reset on v2:172.21.15.81:6836/3243728894 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 --2- 172.21.15.81:0/67189239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fb8fd00 0x1fbb6710 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 >> 172.21.15.81:0/67189239 conn(0x1f8f94d0 msgr2=0x1fb8b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 shutdown_connections 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 1 -- 172.21.15.81:0/67189239 wait complete. 2024-09-13T18:52:56.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090ea42740 20 client.7734 trim_cache size 0 max 16384 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7476, 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 16.753555931000001, 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 75, 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 81, 2024-09-13T18:52:56.757 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 21.95954188 2024-09-13T18:52:56.758 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:52:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08e4066730 msgr2=0x7f08e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08e4066730 0x7f08e4068bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f09040b3890 tx=0x7f08f8009240 comp rx=0 tx=0).stop 2024-09-13T18:52:56.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 msgr2=0x7f0904145d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 0x7f0904145d80 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009fd0 tx=0x7f08f000eb20 comp rx=0 tx=0).stop 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 shutdown_connections 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f08e4066730 0x7f08e4068bf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09040cd610 0x7f09041507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09040b19f0 0x7f0904145d80 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 --2- 172.21.15.81:0/3953767136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f090406a5d0 0x7f0904160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 >> 172.21.15.81:0/3953767136 conn(0x7f09040b08d0 msgr2=0x7f09040680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 shutdown_connections 2024-09-13T18:52:56.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.747+0000 7f090b600700 1 -- 172.21.15.81:0/3953767136 wait complete. 2024-09-13T18:52:56.776 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:52:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.931+0000 7f44fb200700 1 Processor -- start 2024-09-13T18:52:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.931+0000 7f44fb200700 1 -- start start 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fb200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44fc1610b0 0x7f44fc0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fb200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44fc06aaa0 0x7f44fc06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc0b2670 0x7f44fc0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fb200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc070b30 con 0x7f44fc06aaa0 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fb200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc06b450 con 0x7f44fc1610b0 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0b3040 con 0x7f44fc0b2670 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44fc06aaa0 0x7f44fc06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f44fc06aaa0 0x7f44fc06af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40586/0 (socket says 172.21.15.81:40586) 2024-09-13T18:52:56.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 -- 172.21.15.81:0/921130324 learned_addr learned my addr 172.21.15.81:0/921130324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f9e00700 1 --2- 172.21.15.81:0/921130324 >> v2:172.21.15.178:3300/0 conn(0x7f44fc1610b0 0x7f44fc0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44fa800700 1 --2- 172.21.15.81:0/921130324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc0b2670 0x7f44fc0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 -- 172.21.15.81:0/921130324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc0b2670 msgr2=0x7f44fc0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 --2- 172.21.15.81:0/921130324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc0b2670 0x7f44fc0b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 -- 172.21.15.81:0/921130324 >> v2:172.21.15.178:3300/0 conn(0x7f44fc1610b0 msgr2=0x7f44fc0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 --2- 172.21.15.81:0/921130324 >> v2:172.21.15.178:3300/0 conn(0x7f44fc1610b0 0x7f44fc0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f3e00700 1 -- 172.21.15.81:0/921130324 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc0b3560 con 0x7f44fc06aaa0 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.935+0000 7f44f9e00700 1 --2- 172.21.15.81:0/921130324 >> v2:172.21.15.178:3300/0 conn(0x7f44fc1610b0 0x7f44fc0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44f3e00700 1 --2- 172.21.15.81:0/921130324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc06aaa0 0x7f44fc06af10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009940 tx=0x7f44e4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc1a3671c97908b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44f9400700 1 -- 172.21.15.81:0/921130324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400b9e0 con 0x7f44fc06aaa0 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44f9400700 1 -- 172.21.15.81:0/921130324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4009e90 con 0x7f44fc06aaa0 2024-09-13T18:52:56.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44f9400700 1 -- 172.21.15.81:0/921130324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400bd60 con 0x7f44fc06aaa0 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 -- 172.21.15.81:0/921130324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc06aaa0 msgr2=0x7f44fc06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 --2- 172.21.15.81:0/921130324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc06aaa0 0x7f44fc06af10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f44e4009940 tx=0x7f44e4009c50 comp rx=0 tx=0).stop 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 -- 172.21.15.81:0/921130324 shutdown_connections 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 --2- 172.21.15.81:0/921130324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc0b2670 0x7f44fc0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 --2- 172.21.15.81:0/921130324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc06aaa0 0x7f44fc06af10 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 --2- 172.21.15.81:0/921130324 >> v2:172.21.15.178:3300/0 conn(0x7f44fc1610b0 0x7f44fc0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 -- 172.21.15.81:0/921130324 >> 172.21.15.81:0/921130324 conn(0x7f44fc0b0c40 msgr2=0x7f44fc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:56.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 -- 172.21.15.81:0/921130324 shutdown_connections 2024-09-13T18:52:56.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.939+0000 7f44fb200700 1 -- 172.21.15.81:0/921130324 wait complete. 2024-09-13T18:52:56.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 Processor -- start 2024-09-13T18:52:56.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 -- start start 2024-09-13T18:52:56.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc06aaa0 0x7f44fc1f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 0x7f44fc0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44fc1610b0 0x7f44fc14e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1f66a0 con 0x7f44fc0b2670 2024-09-13T18:52:56.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc0a8e90 con 0x7f44fc1610b0 2024-09-13T18:52:56.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc14e290 con 0x7f44fc06aaa0 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 0x7f44fc0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 0x7f44fc0a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40588/0 (socket says 172.21.15.81:40588) 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 -- 172.21.15.81:0/1012772063 learned_addr learned my addr 172.21.15.81:0/1012772063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f9e00700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc06aaa0 0x7f44fc1f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44fa800700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44fc1610b0 0x7f44fc14e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 -- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc06aaa0 msgr2=0x7f44fc1f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc06aaa0 0x7f44fc1f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 -- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44fc1610b0 msgr2=0x7f44fc14e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:56.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44fc1610b0 0x7f44fc14e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 -- 172.21.15.81:0/1012772063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4009570 con 0x7f44fc0b2670 2024-09-13T18:52:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f3e00700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 0x7f44fc0a9b80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f44e4000c00 tx=0x7f44e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e400bd30 con 0x7f44fc0b2670 2024-09-13T18:52:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e401e070 con 0x7f44fc0b2670 2024-09-13T18:52:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.943+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4003900 con 0x7f44fc0b2670 2024-09-13T18:52:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.947+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc0ad650 con 0x7f44fc0b2670 2024-09-13T18:52:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.947+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc0a9380 con 0x7f44fc0b2670 2024-09-13T18:52:56.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.947+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc070500 con 0x7f44fc0b2670 2024-09-13T18:52:56.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.947+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44e4003a60 con 0x7f44fc0b2670 2024-09-13T18:52:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.951+0000 7f44f2000700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f44d8066730 0x7f44d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:52:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.951+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44e4020070 con 0x7f44fc0b2670 2024-09-13T18:52:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.951+0000 7f44f9e00700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f44d8066730 0x7f44d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:52:56.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.951+0000 7f44f9e00700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f44d8066730 0x7f44d8068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f44ec004430 tx=0x7f44ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:52:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:56.955+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f44e4052920 con 0x7f44fc0b2670 2024-09-13T18:52:57.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.179+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44fc071f90 con 0x7f44fc0b2670 2024-09-13T18:52:57.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44f2000700 1 -- 172.21.15.81:0/1012772063 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4770 (secure 0 0 0) 0x7f44e4055f40 con 0x7f44fc0b2670 2024-09-13T18:52:57.191 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:52:57.191 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:52:55.212970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:52:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f44d8066730 msgr2=0x7f44d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f44d8066730 0x7f44d8068bf0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f44ec004430 tx=0x7f44ec008040 comp rx=0 tx=0).stop 2024-09-13T18:52:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 msgr2=0x7f44fc0a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:52:57.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 0x7f44fc0a9b80 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f44e4000c00 tx=0x7f44e4004770 comp rx=0 tx=0).stop 2024-09-13T18:52:57.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 shutdown_connections 2024-09-13T18:52:57.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f44d8066730 0x7f44d8068bf0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:57.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44fc1610b0 0x7f44fc14e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:57.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44fc0b2670 0x7f44fc0a9b80 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 --2- 172.21.15.81:0/1012772063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44fc06aaa0 0x7f44fc1f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:52:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 >> 172.21.15.81:0/1012772063 conn(0x7f44fc0b0c40 msgr2=0x7f44fc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:52:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.183+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 shutdown_connections 2024-09-13T18:52:57.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:52:57.187+0000 7f44fb200700 1 -- 172.21.15.81:0/1012772063 wait complete. 2024-09-13T18:52:57.196 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 75 2024-09-13T18:52:57.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:57.215 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:52:57.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:57.251 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:52:57.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:57.327 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-13T18:52:57.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:57.388 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-13T18:52:57.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:52:57.450 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-13T18:52:57.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:52:57.742 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:52:57.743 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:52:57.743 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:52:59.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:52:59.924 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:52:59.925 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:52:59.925 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:01.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:02.110 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:53:02.110 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:02.111 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:04.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:04.300 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:53:04.301 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:04.301 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:06.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:06.560 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-13T18:53:06.560 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:53:06.561 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:06.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:53:06.748 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:53:06.749 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:53:06.749 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:53:08.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:53:08.937 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:53:08.937 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:53:08.938 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:53:10.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:53:11.121 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-13T18:53:11.122 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:53:11.122 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:53:11.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:53:11.313 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:53:11.313 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:11.313 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:53:11.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-09-13T18:53:11.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.479+0000 7f01b3200700 1 Processor -- start 2024-09-13T18:53:11.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.479+0000 7f01b3200700 1 -- start start 2024-09-13T18:53:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b3200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01b406d620 0x7f01b406c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b3200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01b406cea0 0x7f01b40b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b3200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b40b1980 con 0x7f01b4143b70 2024-09-13T18:53:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b3200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b40b2500 con 0x7f01b406cea0 2024-09-13T18:53:11.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b3200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b406d2f0 con 0x7f01b406d620 2024-09-13T18:53:11.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f01b4143b70 0x7f01b40cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59748/0 (socket says 172.21.15.81:59748) 2024-09-13T18:53:11.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1e00700 1 -- 172.21.15.81:0/3729451149 learned_addr learned my addr 172.21.15.81:0/3729451149 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b2800700 1 --2- 172.21.15.81:0/3729451149 >> v2:172.21.15.81:3300/0 conn(0x7f01b406cea0 0x7f01b40b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1400700 1 --2- 172.21.15.81:0/3729451149 >> v2:172.21.15.178:3300/0 conn(0x7f01b406d620 0x7f01b406c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b0a00700 1 -- 172.21.15.81:0/3729451149 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077656902 0 0) 0x7f01b40b1980 con 0x7f01b4143b70 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b0a00700 1 -- 172.21.15.81:0/3729451149 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01980035d0 con 0x7f01b4143b70 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1400700 1 -- 172.21.15.81:0/3729451149 >> v2:172.21.15.81:3300/0 conn(0x7f01b406cea0 msgr2=0x7f01b40b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1400700 1 --2- 172.21.15.81:0/3729451149 >> v2:172.21.15.81:3300/0 conn(0x7f01b406cea0 0x7f01b40b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1400700 1 -- 172.21.15.81:0/3729451149 >> v1:172.21.15.81:6789/0 conn(0x7f01b4143b70 legacy=0x7f01b40cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.483+0000 7f01b1400700 1 -- 172.21.15.81:0/3729451149 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40b1bd0 con 0x7f01b406d620 2024-09-13T18:53:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b1400700 1 --2- 172.21.15.81:0/3729451149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b406d620 0x7f01b406c960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01b40ce860 tx=0x7f01a0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65aa80d72338f3ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b0a00700 1 -- 172.21.15.81:0/3729451149 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0011830 con 0x7f01b406d620 2024-09-13T18:53:11.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b0a00700 1 -- 172.21.15.81:0/3729451149 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a0011990 con 0x7f01b406d620 2024-09-13T18:53:11.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b0a00700 1 -- 172.21.15.81:0/3729451149 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0011d20 con 0x7f01b406d620 2024-09-13T18:53:11.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 -- 172.21.15.81:0/3729451149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b406d620 msgr2=0x7f01b406c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 --2- 172.21.15.81:0/3729451149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b406d620 0x7f01b406c960 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f01b40ce860 tx=0x7f01a0009b30 comp rx=0 tx=0).stop 2024-09-13T18:53:11.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 -- 172.21.15.81:0/3729451149 shutdown_connections 2024-09-13T18:53:11.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 --2- 172.21.15.81:0/3729451149 >> v2:172.21.15.81:3300/0 conn(0x7f01b406cea0 0x7f01b40b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 --2- 172.21.15.81:0/3729451149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b406d620 0x7f01b406c960 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 -- 172.21.15.81:0/3729451149 >> 172.21.15.81:0/3729451149 conn(0x7f01b406a390 msgr2=0x7f01b406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 -- 172.21.15.81:0/3729451149 shutdown_connections 2024-09-13T18:53:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.487+0000 7f01b3200700 1 -- 172.21.15.81:0/3729451149 wait complete. 2024-09-13T18:53:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 Processor -- start 2024-09-13T18:53:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 -- start start 2024-09-13T18:53:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 0x7f01b4070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01b406d620 0x7f01b414ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b4143b70 0x7f01b414b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b406fd40 con 0x7f01b406cea0 2024-09-13T18:53:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b4070020 con 0x7f01b4143b70 2024-09-13T18:53:11.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b4070300 con 0x7f01b406d620 2024-09-13T18:53:11.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 0x7f01b4070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 0x7f01b4070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48714/0 (socket says 172.21.15.81:48714) 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b1e00700 1 -- 172.21.15.81:0/1014272348 learned_addr learned my addr 172.21.15.81:0/1014272348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b1400700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01b406d620 0x7f01b414ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.491+0000 7f01b2800700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b4143b70 0x7f01b414b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b1e00700 1 -- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01b406d620 msgr2=0x7f01b414ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b1e00700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01b406d620 0x7f01b414ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b1e00700 1 -- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b4143b70 msgr2=0x7f01b414b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b1e00700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b4143b70 0x7f01b414b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b1e00700 1 -- 172.21.15.81:0/1014272348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a00094b0 con 0x7f01b406cea0 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b2800700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b4143b70 0x7f01b414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:11.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b1e00700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 0x7f01b4070de0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f01a400cbc0 tx=0x7f01a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01aa000700 1 -- 172.21.15.81:0/1014272348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400a820 con 0x7f01b406cea0 2024-09-13T18:53:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01aa000700 1 -- 172.21.15.81:0/1014272348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a400a980 con 0x7f01b406cea0 2024-09-13T18:53:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01aa000700 1 -- 172.21.15.81:0/1014272348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a400ad10 con 0x7f01b406cea0 2024-09-13T18:53:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b40705e0 con 0x7f01b406cea0 2024-09-13T18:53:11.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.495+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b415d3f0 con 0x7f01b406cea0 2024-09-13T18:53:11.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01aa000700 1 -- 172.21.15.81:0/1014272348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f01a401b3b0 con 0x7f01b406cea0 2024-09-13T18:53:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 Processor -- start 2024-09-13T18:53:11.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 -- start start 2024-09-13T18:53:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01aa000700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0194066730 0x7f0194068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01aa000700 1 -- 172.21.15.81:0/1014272348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f01a4083dc0 con 0x7f01b406cea0 2024-09-13T18:53:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01b2800700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0194066730 0x7f0194068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398dad90 0x39891810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398b9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 0x398db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x39822010 con 0x398db170 2024-09-13T18:53:11.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x397aff40 con 0x398dad90 2024-09-13T18:53:11.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x39802e30 con 0x39890310 2024-09-13T18:53:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.499+0000 7f01b2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 0x398db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 0x398db550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48718/0 (socket says 172.21.15.81:48718) 2024-09-13T18:53:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 -- 172.21.15.81:0/3903321790 learned_addr learned my addr 172.21.15.81:0/3903321790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b1400700 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b1e00700 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398dad90 0x39891810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 -- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 msgr2=0x398b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398b9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 -- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398dad90 msgr2=0x39891810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398dad90 0x39891810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 -- 172.21.15.81:0/3903321790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3966ea40 con 0x398db170 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0194066730 0x7f0194068bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009fd0 tx=0x7f01ac018770 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01b2800700 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 0x398db550 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f01ac018b70 tx=0x7f01ac01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab74694e21affe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f019e600700 1 -- 172.21.15.81:0/3903321790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac019b70 con 0x398db170 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f019e600700 1 -- 172.21.15.81:0/3903321790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac019cd0 con 0x398db170 2024-09-13T18:53:11.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f019e600700 1 -- 172.21.15.81:0/3903321790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac023680 con 0x398db170 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3903321790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 msgr2=0x398db550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 0x398db550 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f01ac018b70 tx=0x7f01ac01f000 comp rx=0 tx=0).stop 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3903321790 shutdown_connections 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398db170 0x398db550 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3903321790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398dad90 0x39891810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3903321790 >> 172.21.15.81:0/3903321790 conn(0x396235b0 msgr2=0x39894b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3903321790 shutdown_connections 2024-09-13T18:53:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3903321790 wait complete. 2024-09-13T18:53:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 -- start start 2024-09-13T18:53:11.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.503+0000 7f01bbdcf740 1 Processor -- start 2024-09-13T18:53:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398bcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x398e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x397fe150 con 0x398dad90 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x397fbeb0 con 0x398db170 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x397b98e0 con 0x39890310 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 10 client.0 _ll_register_callbacks cb 0x39798670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x398e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x398e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48730/0 (socket says 172.21.15.81:48730) 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 -- 172.21.15.81:0/3595228378 learned_addr learned my addr 172.21.15.81:0/3595228378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1e00700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398bcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b2800700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 -- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 msgr2=0x398bcb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398bcb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 -- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 msgr2=0x398e5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 -- 172.21.15.81:0/3595228378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac018de0 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1400700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x398e4b40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f01a0013000 tx=0x7f01a000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22059b0ab3f5d6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f0192a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f0192a00700 1 -- 172.21.15.81:0/3595228378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0020040 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f0192a00700 1 -- 172.21.15.81:0/3595228378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f01a0004450 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x396302c0 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f0192a00700 1 -- 172.21.15.81:0/3595228378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a0004610 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 10 client.7755 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x397c2290 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f0192a00700 1 -- 172.21.15.81:0/3595228378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x396302c0 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f0192a00700 1 -- 172.21.15.81:0/3595228378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f01a0023030 con 0x398dad90 2024-09-13T18:53:11.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 10 client.7755 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 10 client.7755 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 20 client.7755 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x398bb030 0x398bb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 4 client.7755 mds_command: new command op to 7476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 --> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3967a540 con 0x398bb030 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.507+0000 7f01b1e00700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x398bb030 0x398bb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f0192a00700 10 client.7755 ms_handle_connect on v2:172.21.15.81:6836/3243728894 2024-09-13T18:53:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01b1e00700 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x398bb030 0x398bb440 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ba470d803498138 server_cookie=fa58f291e1daa722 in_seq=0 out_seq=0 2024-09-13T18:53:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f0192a00700 1 -- 172.21.15.81:0/3595228378 <== mds.0 v2:172.21.15.81:6836/3243728894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3967a540 con 0x398bb030 2024-09-13T18:53:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f0192a00700 10 client.7755 handle_command_reply: tid=0 2024-09-13T18:53:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 client.7755 shutdown 2024-09-13T18:53:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 msgr2=0x398e4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x398e4b40 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f01a0013000 tx=0x7f01a000e000 comp rx=0 tx=0).stop 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 shutdown_connections 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x398bb030 0x398bb440 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x398e4b40 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f0192a00700 0 client.7755 ms_handle_reset on v2:172.21.15.81:6836/3243728894 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3595228378 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x398bcb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 >> 172.21.15.81:0/3595228378 conn(0x396235b0 msgr2=0x398b94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 shutdown_connections 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3595228378 wait complete. 2024-09-13T18:53:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.511+0000 7f01bbdcf740 20 client.7755 trim_cache size 0 max 16384 2024-09-13T18:53:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 Processor -- start 2024-09-13T18:53:11.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 -- start start 2024-09-13T18:53:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x39937050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x39937590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x396a7b80 con 0x398dad90 2024-09-13T18:53:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3979a620 con 0x398db170 2024-09-13T18:53:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x397ccc00 con 0x39890310 2024-09-13T18:53:11.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x39937590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x39937590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48742/0 (socket says 172.21.15.81:48742) 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 -- 172.21.15.81:0/3461224313 learned_addr learned my addr 172.21.15.81:0/3461224313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1e00700 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x39937050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b2800700 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 -- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 msgr2=0x39937050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x39937050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 -- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 msgr2=0x398b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398b5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.531+0000 7f01b1400700 1 -- 172.21.15.81:0/3461224313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x397a84c0 con 0x398dad90 2024-09-13T18:53:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01b1400700 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x39937590 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f01a0011e60 tx=0x7f01a0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4620f84e2498ff14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f019f000700 1 -- 172.21.15.81:0/3461224313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0004450 con 0x398dad90 2024-09-13T18:53:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f019f000700 1 -- 172.21.15.81:0/3461224313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a00045d0 con 0x398dad90 2024-09-13T18:53:11.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f019f000700 1 -- 172.21.15.81:0/3461224313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a0003a40 con 0x398dad90 2024-09-13T18:53:11.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3461224313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 msgr2=0x39937590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x39937590 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f01a0011e60 tx=0x7f01a0011000 comp rx=0 tx=0).stop 2024-09-13T18:53:11.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3461224313 shutdown_connections 2024-09-13T18:53:11.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398b5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x398dad90 0x39937590 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/3461224313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x39890310 0x39937050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3461224313 >> 172.21.15.81:0/3461224313 conn(0x396235b0 msgr2=0x398b7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3461224313 shutdown_connections 2024-09-13T18:53:11.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.535+0000 7f01bbdcf740 1 -- 172.21.15.81:0/3461224313 wait complete. 2024-09-13T18:53:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 -- start start 2024-09-13T18:53:11.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 Processor -- start 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 0x398e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x398dad90 0x39936240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x398f35c0 con 0x39890310 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x397f96c0 con 0x398db170 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x39933150 con 0x398dad90 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01bbdcf740 10 client.0 _ll_register_callbacks cb 0x397fa610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 0x398e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 0x398e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48758/0 (socket says 172.21.15.81:48758) 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 -- 172.21.15.81:0/945759752 learned_addr learned my addr 172.21.15.81:0/945759752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1400700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x398dad90 0x39936240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b2800700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 -- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x398dad90 msgr2=0x39936240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x398dad90 0x39936240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 -- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 msgr2=0x398e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 -- 172.21.15.81:0/945759752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x397c2290 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f01b1e00700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 0x398e9ff0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f01a400cb90 tx=0x7f01a40014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f81f7eefd9e2a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.539+0000 7f0192a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f0192a00700 1 -- 172.21.15.81:0/945759752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a4054190 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01ac019cd0 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f0192a00700 1 -- 172.21.15.81:0/945759752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f01a40542f0 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f0192a00700 1 -- 172.21.15.81:0/945759752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a405cc00 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 10 client.7761 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x3979c790 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f0192a00700 1 -- 172.21.15.81:0/945759752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac019cd0 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f0192a00700 1 -- 172.21.15.81:0/945759752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f01a4081b60 con 0x39890310 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 10 client.7761 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:11.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 10 client.7761 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 20 client.7761 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x39936780 0x398e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 4 client.7761 mds_command: new command op to 7476 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 --> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x3969f2c0 con 0x39936780 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01b1400700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x39936780 0x398e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f0192a00700 10 client.7761 ms_handle_connect on v2:172.21.15.81:6836/3243728894 2024-09-13T18:53:11.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.543+0000 7f01b1400700 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x39936780 0x398e70b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be7116356b109c80 server_cookie=28f57b45750adfe7 in_seq=0 out_seq=0 2024-09-13T18:53:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f0192a00700 1 -- 172.21.15.81:0/945759752 <== mds.0 v2:172.21.15.81:6836/3243728894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x3969f2c0 con 0x39936780 2024-09-13T18:53:11.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f0192a00700 10 client.7761 handle_command_reply: tid=0 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 client.7761 shutdown 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 msgr2=0x398e9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 0x398e9ff0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f01a400cb90 tx=0x7f01a40014d0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 shutdown_connections 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:6836/3243728894,v1:172.21.15.81:6837/3243728894] conn(0x39936780 0x398e70b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x398db170 0x398e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x398dad90 0x39936240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f0192a00700 0 client.7761 ms_handle_reset on v2:172.21.15.81:6836/3243728894 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 --2- 172.21.15.81:0/945759752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x39890310 0x398e9ff0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 >> 172.21.15.81:0/945759752 conn(0x396235b0 msgr2=0x398e4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 shutdown_connections 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 1 -- 172.21.15.81:0/945759752 wait complete. 2024-09-13T18:53:11.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.559+0000 7f01bbdcf740 20 client.7761 trim_cache size 0 max 16384 2024-09-13T18:53:11.571 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:53:11.571 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:53:11.571 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0194066730 msgr2=0x7f0194068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0194066730 0x7f0194068bf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f01ac009fd0 tx=0x7f01ac018770 comp rx=0 tx=0).stop 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 msgr2=0x7f01b4070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 0x7f01b4070de0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f01a400cbc0 tx=0x7f01a400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 shutdown_connections 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0194066730 0x7f0194068bf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01b4143b70 0x7f01b414b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01b406d620 0x7f01b414ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 --2- 172.21.15.81:0/1014272348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01b406cea0 0x7f01b4070de0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 >> 172.21.15.81:0/1014272348 conn(0x7f01b406a390 msgr2=0x7f01b40af770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 shutdown_connections 2024-09-13T18:53:11.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.563+0000 7f01b3200700 1 -- 172.21.15.81:0/1014272348 wait complete. 2024-09-13T18:53:11.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:1 flush journal 2024-09-13T18:53:11.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.751+0000 7efe06e00700 1 Processor -- start 2024-09-13T18:53:11.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.751+0000 7efe06e00700 1 -- start start 2024-09-13T18:53:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe00159920 0x7efe000b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000cd2a0 con 0x7efe0006d070 2024-09-13T18:53:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000ccc90 con 0x7efe000b30d0 2024-09-13T18:53:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b3580 con 0x7efe00159920 2024-09-13T18:53:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efe0006d070 0x7efe000cd730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59764/0 (socket says 172.21.15.81:59764) 2024-09-13T18:53:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06400700 1 -- 172.21.15.81:0/318376681 learned_addr learned my addr 172.21.15.81:0/318376681 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe05a00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe00159920 0x7efe000b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271428267 0 0) 0x7efe000cd2a0 con 0x7efe0006d070 2024-09-13T18:53:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde80035d0 con 0x7efe0006d070 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 749314999 0 0) 0x7efde80035d0 con 0x7efe0006d070 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe00159920 msgr2=0x7efe000b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe00159920 0x7efe000b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 >> v1:172.21.15.178:6789/0 conn(0x7efe000b30d0 legacy=0x7efe0006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000b3860 con 0x7efe0006d070 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7efdf80019f0 con 0x7efe0006d070 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 >> v1:172.21.15.81:6789/0 conn(0x7efe0006d070 legacy=0x7efe000cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efde8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde8004400 0x7efde8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde8004ff0 0x7efde800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b3580 con 0x7efde8004ff0 2024-09-13T18:53:11.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8005710 con 0x7efde8003a50 2024-09-13T18:53:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde800e1d0 con 0x7efde8004400 2024-09-13T18:53:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe06400700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde8004ff0 0x7efde800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe05a00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efde8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe05000700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde8004400 0x7efde8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe05a00700 1 -- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde8004400 msgr2=0x7efde8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe05a00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde8004400 0x7efde8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.755+0000 7efe05a00700 1 -- 172.21.15.81:0/318376681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde8004ff0 msgr2=0x7efde800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe05a00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde8004ff0 0x7efde800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe05a00700 1 -- 172.21.15.81:0/318376681 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80035d0 con 0x7efde8003a50 2024-09-13T18:53:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06400700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde8004ff0 0x7efde800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:11.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe05a00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efde8003e30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009b70 tx=0x7efde80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=318f72f43b4b0e50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400e6c0 con 0x7efde8003a50 2024-09-13T18:53:11.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf400e820 con 0x7efde8003a50 2024-09-13T18:53:11.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efdffe00700 1 -- 172.21.15.81:0/318376681 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf400eb90 con 0x7efde8003a50 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06e00700 1 -- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 msgr2=0x7efde8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06e00700 1 --2- 172.21.15.81:0/318376681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efde8003e30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009b70 tx=0x7efde80058a0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06400700 1 -- 172.21.15.81:0/318376681 reap_dead start 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06e00700 1 -- 172.21.15.81:0/318376681 shutdown_connections 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06e00700 1 -- 172.21.15.81:0/318376681 >> 172.21.15.81:0/318376681 conn(0x7efe0006a390 msgr2=0x7efe0006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06e00700 1 -- 172.21.15.81:0/318376681 shutdown_connections 2024-09-13T18:53:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.759+0000 7efe06e00700 1 -- 172.21.15.81:0/318376681 wait complete. 2024-09-13T18:53:11.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 Processor -- start 2024-09-13T18:53:11.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 -- start start 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efe001f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 0x7efe000c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe001f1b90 0x7efe001f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe001f2550 con 0x7efe00151980 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c9850 con 0x7efde8003a50 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c8c40 con 0x7efe001f1b90 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe05000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 0x7efe000c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe05000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 0x7efe000c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48766/0 (socket says 172.21.15.81:48766) 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe05000700 1 -- 172.21.15.81:0/998908663 learned_addr learned my addr 172.21.15.81:0/998908663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe05a00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efe001f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.763+0000 7efe06400700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe001f1b90 0x7efe001f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe05000700 1 -- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe001f1b90 msgr2=0x7efe001f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe05000700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe001f1b90 0x7efe001f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe05000700 1 -- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 msgr2=0x7efe001f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe05000700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efe001f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe05000700 1 -- 172.21.15.81:0/998908663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000c8f20 con 0x7efe00151980 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe05000700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 0x7efe000c8360 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7efdec00f840 tx=0x7efdec00fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efdfd600700 1 -- 172.21.15.81:0/998908663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec005320 con 0x7efe00151980 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efdfd600700 1 -- 172.21.15.81:0/998908663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec005480 con 0x7efe00151980 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efdfd600700 1 -- 172.21.15.81:0/998908663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec006ac0 con 0x7efe00151980 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe000c9200 con 0x7efe00151980 2024-09-13T18:53:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000c88a0 con 0x7efe00151980 2024-09-13T18:53:11.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.767+0000 7efdfd600700 1 -- 172.21.15.81:0/998908663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efdec006c20 con 0x7efe00151980 2024-09-13T18:53:11.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.771+0000 7efdfd600700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efde0066760 0x7efde0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.771+0000 7efdfd600700 1 -- 172.21.15.81:0/998908663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdec083720 con 0x7efe00151980 2024-09-13T18:53:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.771+0000 7efe05a00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efde0066760 0x7efde0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.771+0000 7efe05a00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efde0066760 0x7efde0068c20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efdf40090b0 tx=0x7efdf401f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 Processor -- start 2024-09-13T18:53:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 -- start start 2024-09-13T18:53:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300d7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3003c010 con 0x300d3420 2024-09-13T18:53:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ffc9f40 con 0x300f66c0 2024-09-13T18:53:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3001ce30 con 0x300d3800 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48772/0 (socket says 172.21.15.81:48772) 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 -- 172.21.15.81:0/704210685 learned_addr learned my addr 172.21.15.81:0/704210685 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05000700 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300d7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe06400700 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 -- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 msgr2=0x300ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 -- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 msgr2=0x300d7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300d7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 -- 172.21.15.81:0/704210685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2fe88a40 con 0x300d3420 2024-09-13T18:53:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05000700 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300d7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efe05a00700 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300f6180 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7efdf400e4b0 tx=0x7efdf4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85932980eafc5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efdf2000700 1 -- 172.21.15.81:0/704210685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4022040 con 0x300d3420 2024-09-13T18:53:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efdf2000700 1 -- 172.21.15.81:0/704210685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf402e040 con 0x300d3420 2024-09-13T18:53:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.775+0000 7efdf2000700 1 -- 172.21.15.81:0/704210685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4004450 con 0x300d3420 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 -- 172.21.15.81:0/704210685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 msgr2=0x300f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300f6180 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7efdf400e4b0 tx=0x7efdf4013000 comp rx=0 tx=0).stop 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 -- 172.21.15.81:0/704210685 shutdown_connections 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300d7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 --2- 172.21.15.81:0/704210685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300f6180 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 -- 172.21.15.81:0/704210685 >> 172.21.15.81:0/704210685 conn(0x2fe3d5b0 msgr2=0x300aeb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 -- 172.21.15.81:0/704210685 shutdown_connections 2024-09-13T18:53:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 -- 172.21.15.81:0/704210685 wait complete. 2024-09-13T18:53:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 -- start start 2024-09-13T18:53:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 Processor -- start 2024-09-13T18:53:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.779+0000 7efe0b885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x30102ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x30103420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x30018150 con 0x300d3420 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x30015eb0 con 0x300f66c0 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ffd38e0 con 0x300d3800 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 10 client.0 _ll_register_callbacks cb 0x2ffb2670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300cfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48784/0 (socket says 172.21.15.81:48784) 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 -- 172.21.15.81:0/1018359630 learned_addr learned my addr 172.21.15.81:0/1018359630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe06400700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x30103420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05000700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x30102ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 -- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 msgr2=0x30102ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x30102ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 -- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 msgr2=0x30103420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x30103420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 -- 172.21.15.81:0/1018359630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde80035d0 con 0x300d3420 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe06400700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x30103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05000700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x30102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05a00700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300cfc90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x2ffe6fa0 tx=0x7efdf4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42557a57ea516e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 1 -- 172.21.15.81:0/1018359630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4022040 con 0x300d3420 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 1 -- 172.21.15.81:0/1018359630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdf4003b90 con 0x300d3420 2024-09-13T18:53:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2fe4a2c0 con 0x300d3420 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 1 -- 172.21.15.81:0/1018359630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdf4003d50 con 0x300d3420 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 10 client.7773 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x2ffdc290 con 0x300d3420 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 1 -- 172.21.15.81:0/1018359630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2fe4a2c0 con 0x300d3420 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 1 -- 172.21.15.81:0/1018359630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7efdf4031070 con 0x300d3420 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 10 client.7773 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 10 client.7773 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.c 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 20 client.7773 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x300f8050 0x30103960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 4 client.7773 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2fe94540 con 0x300f8050 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05000700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x300f8050 0x30103960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efde6a00700 10 client.7773 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.783+0000 7efe05000700 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x300f8050 0x30103960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b45d1681c596c86 server_cookie=864231a4ae8bdc4f in_seq=0 out_seq=0 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efde6a00700 1 -- 172.21.15.81:0/1018359630 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2fe94540 con 0x300f8050 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efde6a00700 10 client.7773 handle_command_reply: tid=0 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 client.7773 shutdown 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 msgr2=0x300cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300cfc90 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x2ffe6fa0 tx=0x7efdf4011000 comp rx=0 tx=0).stop 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 shutdown_connections 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x300f8050 0x30103960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x30103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x30102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 --2- 172.21.15.81:0/1018359630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300cfc90 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efde6a00700 0 client.7773 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 >> 172.21.15.81:0/1018359630 conn(0x2fe3d5b0 msgr2=0x300f5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 shutdown_connections 2024-09-13T18:53:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 1 -- 172.21.15.81:0/1018359630 wait complete. 2024-09-13T18:53:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.787+0000 7efe0b885740 20 client.7773 trim_cache size 0 max 16384 2024-09-13T18:53:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.803+0000 7efe0b885740 1 Processor -- start 2024-09-13T18:53:11.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.803+0000 7efe0b885740 1 -- start start 2024-09-13T18:53:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2fec1b80 con 0x300d3420 2024-09-13T18:53:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x300136c0 con 0x300f66c0 2024-09-13T18:53:11.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3003c010 con 0x300d3800 2024-09-13T18:53:11.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48798/0 (socket says 172.21.15.81:48798) 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 -- 172.21.15.81:0/4235425457 learned_addr learned my addr 172.21.15.81:0/4235425457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05000700 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe06400700 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 -- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 msgr2=0x300c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 -- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 msgr2=0x300cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 -- 172.21.15.81:0/4235425457 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ffc24c0 con 0x300d3420 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe06400700 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe05a00700 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300c96d0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efdf4006d80 tx=0x7efdf402a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82342a97d4e22764 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efdf2a00700 1 -- 172.21.15.81:0/4235425457 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403d650 con 0x300d3420 2024-09-13T18:53:11.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efdf2a00700 1 -- 172.21.15.81:0/4235425457 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf403d7b0 con 0x300d3420 2024-09-13T18:53:11.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efdf2a00700 1 -- 172.21.15.81:0/4235425457 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4003b90 con 0x300d3420 2024-09-13T18:53:11.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- 172.21.15.81:0/4235425457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 msgr2=0x300c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300c96d0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7efdf4006d80 tx=0x7efdf402a070 comp rx=0 tx=0).stop 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- 172.21.15.81:0/4235425457 shutdown_connections 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x300cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3800 0x300c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 --2- 172.21.15.81:0/4235425457 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3420 0x300c96d0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- 172.21.15.81:0/4235425457 >> 172.21.15.81:0/4235425457 conn(0x2fe3d5b0 msgr2=0x300cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- 172.21.15.81:0/4235425457 shutdown_connections 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.807+0000 7efe0b885740 1 -- 172.21.15.81:0/4235425457 wait complete. 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 -- start start 2024-09-13T18:53:11.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 Processor -- start 2024-09-13T18:53:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3420 0x300cd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 0x300cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x3015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ffb4620 con 0x300d3800 2024-09-13T18:53:11.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3001e290 con 0x300f66c0 2024-09-13T18:53:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x300ca7d0 con 0x300d3420 2024-09-13T18:53:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe0b885740 10 client.0 _ll_register_callbacks cb 0x30014610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 0x300cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 0x300cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48804/0 (socket says 172.21.15.81:48804) 2024-09-13T18:53:11.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 -- 172.21.15.81:0/1675667739 learned_addr learned my addr 172.21.15.81:0/1675667739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05a00700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3420 0x300cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe06400700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x3015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 -- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3420 msgr2=0x300cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3420 0x300cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 -- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 msgr2=0x3015ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x3015ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe05000700 1 -- 172.21.15.81:0/1675667739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2ffdc290 con 0x300d3800 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.811+0000 7efe06400700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x3015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe05000700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 0x300cd8a0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efdec00ff50 tx=0x7efdec0546f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d692ad651549283 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:11.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 1 -- 172.21.15.81:0/1675667739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec0580b0 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 1 -- 172.21.15.81:0/1675667739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdec0547d0 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efdf402e040 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 1 -- 172.21.15.81:0/1675667739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdec054990 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 10 client.7779 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x2ffb6790 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 1 -- 172.21.15.81:0/1675667739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf402e040 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 1 -- 172.21.15.81:0/1675667739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7efdec053a60 con 0x300d3800 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 10 client.7779 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 10 client.7779 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.c 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 20 client.7779 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x3015d370 0x3015d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:11.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 4 client.7779 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:53:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x2feb92c0 con 0x3015d370 2024-09-13T18:53:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe05a00700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x3015d370 0x3015d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efde6a00700 10 client.7779 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.815+0000 7efe05a00700 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x3015d370 0x3015d780 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=220737be879d3ec5 server_cookie=27cb9f82b37c8f57 in_seq=0 out_seq=0 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efde6a00700 1 -- 172.21.15.81:0/1675667739 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x2feb92c0 con 0x3015d370 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efde6a00700 10 client.7779 handle_command_reply: tid=0 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 client.7779 shutdown 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 msgr2=0x300cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 0x300cd8a0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7efdec00ff50 tx=0x7efdec0546f0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 shutdown_connections 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x3015d370 0x3015d780 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x300f66c0 0x3015ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efde6a00700 0 client.7779 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x300d3800 0x300cd8a0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 --2- 172.21.15.81:0/1675667739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x300d3420 0x300cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 >> 172.21.15.81:0/1675667739 conn(0x2fe3d5b0 msgr2=0x30102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 shutdown_connections 2024-09-13T18:53:11.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 1 -- 172.21.15.81:0/1675667739 wait complete. 2024-09-13T18:53:11.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe0b885740 20 client.7779 trim_cache size 0 max 16384 2024-09-13T18:53:11.842 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:53:11.842 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:53:11.842 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efde0066760 msgr2=0x7efde0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efde0066760 0x7efde0068c20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efdf40090b0 tx=0x7efdf401f040 comp rx=0 tx=0).stop 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 msgr2=0x7efe000c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 0x7efe000c8360 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7efdec00f840 tx=0x7efdec00fb50 comp rx=0 tx=0).stop 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 shutdown_connections 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efde0066760 0x7efde0068c20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe001f1b90 0x7efe001f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe00151980 0x7efe000c8360 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 --2- 172.21.15.81:0/998908663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde8003a50 0x7efe001f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 >> 172.21.15.81:0/998908663 conn(0x7efe0006a390 msgr2=0x7efe000b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:11.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 shutdown_connections 2024-09-13T18:53:11.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:11.831+0000 7efe06e00700 1 -- 172.21.15.81:0/998908663 wait complete. 2024-09-13T18:53:11.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:2 flush journal 2024-09-13T18:53:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.035+0000 7f99bfe00700 1 Processor -- start 2024-09-13T18:53:12.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.035+0000 7f99bfe00700 1 -- start start 2024-09-13T18:53:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bfe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c0154df0 0x7f99c00b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99c00cd6f0 0x7f99c00b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bfe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99c015e4e0 con 0x7f99c006a390 2024-09-13T18:53:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bfe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99c015e7c0 con 0x7f99c00cd6f0 2024-09-13T18:53:12.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bfe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c015eaa0 con 0x7f99c0154df0 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c0154df0 0x7f99c00b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99c00cd6f0 0x7f99c00b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f99c00cd6f0 0x7f99c00b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48806/0 (socket says 172.21.15.81:48806) 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c0154df0 0x7f99c00b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:56320/0 (socket says 172.21.15.81:56320) 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99be000700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f99c006a390 0x7f99c00ccfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:52952/0 (socket says 172.21.15.81:52952) 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 -- 172.21.15.81:0/2938388063 learned_addr learned my addr 172.21.15.81:0/2938388063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 -- 172.21.15.81:0/2938388063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c0154df0 msgr2=0x7f99c00b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 --2- 172.21.15.81:0/2938388063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c0154df0 0x7f99c00b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 -- 172.21.15.81:0/2938388063 >> v1:172.21.15.178:6789/0 conn(0x7f99c006a390 legacy=0x7f99c00ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 -- 172.21.15.81:0/2938388063 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c015ed80 con 0x7f99c00cd6f0 2024-09-13T18:53:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bf400700 1 --2- 172.21.15.81:0/2938388063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c00b5330 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009910 tx=0x7f99b8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b864185d05696c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bd600700 1 -- 172.21.15.81:0/2938388063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8011830 con 0x7f99c00cd6f0 2024-09-13T18:53:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bd600700 1 -- 172.21.15.81:0/2938388063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b8011990 con 0x7f99c00cd6f0 2024-09-13T18:53:12.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.039+0000 7f99bd600700 1 -- 172.21.15.81:0/2938388063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b8011d40 con 0x7f99c00cd6f0 2024-09-13T18:53:12.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 -- 172.21.15.81:0/2938388063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 msgr2=0x7f99c00b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 --2- 172.21.15.81:0/2938388063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c00b5330 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009910 tx=0x7f99b8009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:12.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 -- 172.21.15.81:0/2938388063 shutdown_connections 2024-09-13T18:53:12.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 --2- 172.21.15.81:0/2938388063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c00b5330 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 --2- 172.21.15.81:0/2938388063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c0154df0 0x7f99c00b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 -- 172.21.15.81:0/2938388063 >> 172.21.15.81:0/2938388063 conn(0x7f99c0070d10 msgr2=0x7f99c00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 -- 172.21.15.81:0/2938388063 shutdown_connections 2024-09-13T18:53:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 -- 172.21.15.81:0/2938388063 wait complete. 2024-09-13T18:53:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.043+0000 7f99bfe00700 1 Processor -- start 2024-09-13T18:53:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 -- start start 2024-09-13T18:53:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c006a390 0x7f99c015a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c0155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99c0154df0 0x7f99c01595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c00b3440 con 0x7f99c00cd6f0 2024-09-13T18:53:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0150780 con 0x7f99c0154df0 2024-09-13T18:53:12.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bfe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0159cb0 con 0x7f99c006a390 2024-09-13T18:53:12.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c0155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c0155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48816/0 (socket says 172.21.15.81:48816) 2024-09-13T18:53:12.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 -- 172.21.15.81:0/3266540334 learned_addr learned my addr 172.21.15.81:0/3266540334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bf400700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99c0154df0 0x7f99c01595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99bea00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c006a390 0x7f99c015a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 -- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c006a390 msgr2=0x7f99c015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c006a390 0x7f99c015a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 -- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99c0154df0 msgr2=0x7f99c01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99c0154df0 0x7f99c01595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.047+0000 7f99be000700 1 -- 172.21.15.81:0/3266540334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8009570 con 0x7f99c00cd6f0 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.051+0000 7f99be000700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c0155350 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c500 tx=0x7f99ac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.051+0000 7f99b6a00700 1 -- 172.21.15.81:0/3266540334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac005cd0 con 0x7f99c00cd6f0 2024-09-13T18:53:12.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.051+0000 7f99b6a00700 1 -- 172.21.15.81:0/3266540334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac005e30 con 0x7f99c00cd6f0 2024-09-13T18:53:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.051+0000 7f99b6a00700 1 -- 172.21.15.81:0/3266540334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0072f0 con 0x7f99c00cd6f0 2024-09-13T18:53:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.051+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c00b2d80 con 0x7f99c00cd6f0 2024-09-13T18:53:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.051+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c014fc10 con 0x7f99c00cd6f0 2024-09-13T18:53:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.055+0000 7f99b6a00700 1 -- 172.21.15.81:0/3266540334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99ac007450 con 0x7f99c00cd6f0 2024-09-13T18:53:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.055+0000 7f99b6a00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f99a0066730 0x7f99a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.055+0000 7f99b6a00700 1 -- 172.21.15.81:0/3266540334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99ac083670 con 0x7f99c00cd6f0 2024-09-13T18:53:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.055+0000 7f99bea00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f99a0066730 0x7f99a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.055+0000 7f99bea00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f99a0066730 0x7f99a0068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f99b0011340 tx=0x7f99b000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 Processor -- start 2024-09-13T18:53:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 -- start start 2024-09-13T18:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 0x9ff6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9ff5310 0xa01e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa040550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x9f87010 con 0xa03fd90 2024-09-13T18:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9f14f40 con 0x9ff5310 2024-09-13T18:53:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x9f67e30 con 0xa040170 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 0x9ff6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 0x9ff6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48822/0 (socket says 172.21.15.81:48822) 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 -- 172.21.15.81:0/237567688 learned_addr learned my addr 172.21.15.81:0/237567688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bf400700 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa040550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99be000700 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9ff5310 0xa01e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 -- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 msgr2=0xa040550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa040550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 -- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9ff5310 msgr2=0xa01e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9ff5310 0xa01e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 -- 172.21.15.81:0/237567688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x9dd3a40 con 0xa03fd90 2024-09-13T18:53:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99bea00700 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 0x9ff6810 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f99b00175d0 tx=0x7f99b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b523d99fb64da2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99ab400700 1 -- 172.21.15.81:0/237567688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b001c040 con 0xa03fd90 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99ab400700 1 -- 172.21.15.81:0/237567688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000f040 con 0xa03fd90 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.059+0000 7f99ab400700 1 -- 172.21.15.81:0/237567688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e040 con 0xa03fd90 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 -- 172.21.15.81:0/237567688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 msgr2=0x9ff6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 0x9ff6810 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f99b00175d0 tx=0x7f99b0014000 comp rx=0 tx=0).stop 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 -- 172.21.15.81:0/237567688 shutdown_connections 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa040550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x9ff5310 0xa01e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/237567688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xa03fd90 0x9ff6810 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 -- 172.21.15.81:0/237567688 >> 172.21.15.81:0/237567688 conn(0x9d885b0 msgr2=0x9ff9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 -- 172.21.15.81:0/237567688 shutdown_connections 2024-09-13T18:53:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 -- 172.21.15.81:0/237567688 wait complete. 2024-09-13T18:53:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 -- start start 2024-09-13T18:53:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 Processor -- start 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0195a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa03fd90 0xa01cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.063+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa0499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x9f63150 con 0x9ff5310 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9f60eb0 con 0xa03fd90 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x9f1e8e0 con 0xa040170 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 10 client.0 _ll_register_callbacks cb 0x9efd670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48832/0 (socket says 172.21.15.81:48832) 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 -- 172.21.15.81:0/4081802048 learned_addr learned my addr 172.21.15.81:0/4081802048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bf400700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa0499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99be000700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa03fd90 0xa01cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 -- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 msgr2=0xa0499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa0499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 -- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa03fd90 msgr2=0xa01cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa03fd90 0xa01cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 -- 172.21.15.81:0/4081802048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b0011e50 con 0x9ff5310 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bf400700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa0499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99bea00700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0195a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x9f31fa0 tx=0x7f99b0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d9c989d11632d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f999fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f999fe00700 1 -- 172.21.15.81:0/4081802048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e040 con 0x9ff5310 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x9d952c0 con 0x9ff5310 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f999fe00700 1 -- 172.21.15.81:0/4081802048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99b0011c80 con 0x9ff5310 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f999fe00700 1 -- 172.21.15.81:0/4081802048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b0022e80 con 0x9ff5310 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 10 client.7791 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x9f27290 con 0x9ff5310 2024-09-13T18:53:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f999fe00700 1 -- 172.21.15.81:0/4081802048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x9d952c0 con 0x9ff5310 2024-09-13T18:53:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f999fe00700 1 -- 172.21.15.81:0/4081802048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f99b0036470 con 0x9ff5310 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 10 client.7791 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 10 client.7791 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 20 client.7791 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa01d320 0xa04a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 4 client.7791 mds_command: new command op to 6479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.067+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 --> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x9ddf540 con 0xa01d320 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99be000700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa01d320 0xa04a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99be000700 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa01d320 0xa04a400 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7b03b7507617c8d server_cookie=6066ffa8929d5be in_seq=0 out_seq=0 2024-09-13T18:53:12.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f999fe00700 10 client.7791 ms_handle_connect on v2:172.21.15.178:6834/3142422230 2024-09-13T18:53:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f999fe00700 1 -- 172.21.15.81:0/4081802048 <== mds.2 v2:172.21.15.178:6834/3142422230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x9ddf540 con 0xa01d320 2024-09-13T18:53:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f999fe00700 10 client.7791 handle_command_reply: tid=0 2024-09-13T18:53:12.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 client.7791 shutdown 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 msgr2=0xa0195a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0195a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x9f31fa0 tx=0x7f99b0004af0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 shutdown_connections 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa01d320 0xa04a400 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa040170 0xa0499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa03fd90 0xa01cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/4081802048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0195a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f999fe00700 0 client.7791 ms_handle_reset on v2:172.21.15.178:6834/3142422230 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 >> 172.21.15.81:0/4081802048 conn(0x9d885b0 msgr2=0xa01e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 shutdown_connections 2024-09-13T18:53:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.071+0000 7f99c8f4b740 1 -- 172.21.15.81:0/4081802048 wait complete. 2024-09-13T18:53:12.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.075+0000 7f99c8f4b740 20 client.7791 trim_cache size 0 max 16384 2024-09-13T18:53:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 Processor -- start 2024-09-13T18:53:12.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 -- start start 2024-09-13T18:53:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa018fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa017f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0184b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x9e0cb80 con 0x9ff5310 2024-09-13T18:53:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9f31c00 con 0xa040170 2024-09-13T18:53:12.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x9f5e6c0 con 0xa03fd90 2024-09-13T18:53:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa018fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa018fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48834/0 (socket says 172.21.15.81:48834) 2024-09-13T18:53:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 -- 172.21.15.81:0/748549492 learned_addr learned my addr 172.21.15.81:0/748549492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bf400700 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0184b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99be000700 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa017f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 -- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 msgr2=0xa017f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa017f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 -- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 msgr2=0xa0184b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0184b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 -- 172.21.15.81:0/748549492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x9f0d4c0 con 0x9ff5310 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99bea00700 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa018fb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009980 tx=0x7f99b002f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b4f048df44e012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99abe00700 1 -- 172.21.15.81:0/748549492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e040 con 0x9ff5310 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99abe00700 1 -- 172.21.15.81:0/748549492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b0031070 con 0x9ff5310 2024-09-13T18:53:12.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.091+0000 7f99abe00700 1 -- 172.21.15.81:0/748549492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b0036e00 con 0x9ff5310 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 -- 172.21.15.81:0/748549492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 msgr2=0xa018fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa018fb0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009980 tx=0x7f99b002f070 comp rx=0 tx=0).stop 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 -- 172.21.15.81:0/748549492 shutdown_connections 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0184b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa017f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/748549492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa018fb0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 -- 172.21.15.81:0/748549492 >> 172.21.15.81:0/748549492 conn(0x9d885b0 msgr2=0x9ff6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 -- 172.21.15.81:0/748549492 shutdown_connections 2024-09-13T18:53:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 -- 172.21.15.81:0/748549492 wait complete. 2024-09-13T18:53:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 -- start start 2024-09-13T18:53:12.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.095+0000 7f99c8f4b740 1 Processor -- start 2024-09-13T18:53:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0a0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa0a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x9eeaa50 con 0x9ff5310 2024-09-13T18:53:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x9eff620 con 0xa040170 2024-09-13T18:53:12.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x9eeb6a0 con 0xa03fd90 2024-09-13T18:53:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 10 client.0 _ll_register_callbacks cb 0x9f5f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48844/0 (socket says 172.21.15.81:48844) 2024-09-13T18:53:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 -- 172.21.15.81:0/3276061952 learned_addr learned my addr 172.21.15.81:0/3276061952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99be000700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa0a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bf400700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 -- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 msgr2=0xa0a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa0a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 -- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 msgr2=0xa0a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 -- 172.21.15.81:0/3276061952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x9f27290 con 0x9ff5310 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bf400700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99bea00700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0a0880 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009ef0 tx=0x7f99b0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b08ac0ca0b4f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f999fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:12.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f999fe00700 1 -- 172.21.15.81:0/3276061952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b000e070 con 0x9ff5310 2024-09-13T18:53:12.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f999fe00700 1 -- 172.21.15.81:0/3276061952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f99b0036980 con 0x9ff5310 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99b000f040 con 0x9ff5310 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f999fe00700 1 -- 172.21.15.81:0/3276061952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b002d610 con 0x9ff5310 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 10 client.7797 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.099+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x9f01790 con 0x9ff5310 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f999fe00700 1 -- 172.21.15.81:0/3276061952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b000f040 con 0x9ff5310 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f999fe00700 1 -- 172.21.15.81:0/3276061952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f99b0049070 con 0x9ff5310 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99c8f4b740 10 client.7797 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99c8f4b740 10 client.7797 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99c8f4b740 20 client.7797 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa0a1c80 0xa0a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99c8f4b740 4 client.7797 mds_command: new command op to 6479 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:53:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 --> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x9e042c0 con 0xa0a1c80 2024-09-13T18:53:12.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99be000700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa0a1c80 0xa0a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f99be000700 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa0a1c80 0xa0a2090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e388103765a4906c server_cookie=dfac090f306102e7 in_seq=0 out_seq=0 2024-09-13T18:53:12.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.103+0000 7f999fe00700 10 client.7797 ms_handle_connect on v2:172.21.15.178:6834/3142422230 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f999fe00700 1 -- 172.21.15.81:0/3276061952 <== mds.2 v2:172.21.15.178:6834/3142422230 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x9e042c0 con 0xa0a1c80 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f999fe00700 10 client.7797 handle_command_reply: tid=0 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 client.7797 shutdown 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 msgr2=0xa0a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0a0880 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009ef0 tx=0x7f99b0018000 comp rx=0 tx=0).stop 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 shutdown_connections 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:6834/3142422230,v1:172.21.15.178:6835/3142422230] conn(0xa0a1c80 0xa0a2090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xa040170 0xa0a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xa03fd90 0xa0a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 --2- 172.21.15.81:0/3276061952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x9ff5310 0xa0a0880 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f999fe00700 0 client.7797 ms_handle_reset on v2:172.21.15.178:6834/3142422230 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 >> 172.21.15.81:0/3276061952 conn(0x9d885b0 msgr2=0x9ff6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 shutdown_connections 2024-09-13T18:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 1 -- 172.21.15.81:0/3276061952 wait complete. 2024-09-13T18:53:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99c8f4b740 20 client.7797 trim_cache size 0 max 16384 2024-09-13T18:53:12.129 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:12.129 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:53:12.129 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:53:12.130 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f99a0066730 msgr2=0x7f99a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f99a0066730 0x7f99a0068bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f99b0011340 tx=0x7f99b000b040 comp rx=0 tx=0).stop 2024-09-13T18:53:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 msgr2=0x7f99c0155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c0155350 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c500 tx=0x7f99ac00c810 comp rx=0 tx=0).stop 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 shutdown_connections 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f99a0066730 0x7f99a0068bf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99c0154df0 0x7f99c01595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00cd6f0 0x7f99c0155350 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 --2- 172.21.15.81:0/3266540334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99c006a390 0x7f99c015a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 >> 172.21.15.81:0/3266540334 conn(0x7f99c0070d10 msgr2=0x7f99c0153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 shutdown_connections 2024-09-13T18:53:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.119+0000 7f99bfe00700 1 -- 172.21.15.81:0/3266540334 wait complete. 2024-09-13T18:53:12.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:12.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.327+0000 7f58d7c00700 1 Processor -- start 2024-09-13T18:53:12.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.327+0000 7f58d7c00700 1 -- start start 2024-09-13T18:53:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d0071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58d006cc40 0x7f58d006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d01627d0 con 0x7f58d00b2ac0 2024-09-13T18:53:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d0071bd0 con 0x7f58d006cc40 2024-09-13T18:53:12.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0161610 con 0x7f58d0070e10 2024-09-13T18:53:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58d006cc40 0x7f58d006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f58d00b2ac0 0x7f58d00b2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59772/0 (socket says 172.21.15.81:59772) 2024-09-13T18:53:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5200700 1 -- 172.21.15.81:0/2613162358 learned_addr learned my addr 172.21.15.81:0/2613162358 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:12.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58cfe00700 1 --2- 172.21.15.81:0/2613162358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d0071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58cf400700 1 -- 172.21.15.81:0/2613162358 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380100054 0 0) 0x7f58d01627d0 con 0x7f58d00b2ac0 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58cf400700 1 -- 172.21.15.81:0/2613162358 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b80035d0 con 0x7f58d00b2ac0 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5c00700 1 -- 172.21.15.81:0/2613162358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 msgr2=0x7f58d0071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5c00700 1 --2- 172.21.15.81:0/2613162358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d0071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5c00700 1 -- 172.21.15.81:0/2613162358 >> v1:172.21.15.81:6789/0 conn(0x7f58d00b2ac0 legacy=0x7f58d00b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5c00700 1 -- 172.21.15.81:0/2613162358 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d01625e0 con 0x7f58d006cc40 2024-09-13T18:53:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d5c00700 1 --2- 172.21.15.81:0/2613162358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d006d0f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009d90 tx=0x7f58c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3960dc8f26ddee23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58cf400700 1 -- 172.21.15.81:0/2613162358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800e070 con 0x7f58d006cc40 2024-09-13T18:53:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58cf400700 1 -- 172.21.15.81:0/2613162358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c800bb20 con 0x7f58d006cc40 2024-09-13T18:53:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58cf400700 1 -- 172.21.15.81:0/2613162358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800be90 con 0x7f58d006cc40 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 -- 172.21.15.81:0/2613162358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 msgr2=0x7f58d006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.331+0000 7f58d7c00700 1 --2- 172.21.15.81:0/2613162358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d006d0f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009d90 tx=0x7f58c800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- 172.21.15.81:0/2613162358 shutdown_connections 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 --2- 172.21.15.81:0/2613162358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d006d0f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 --2- 172.21.15.81:0/2613162358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d0071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- 172.21.15.81:0/2613162358 >> 172.21.15.81:0/2613162358 conn(0x7f58d00cfa90 msgr2=0x7f58d00cfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- 172.21.15.81:0/2613162358 shutdown_connections 2024-09-13T18:53:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- 172.21.15.81:0/2613162358 wait complete. 2024-09-13T18:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 Processor -- start 2024-09-13T18:53:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- start start 2024-09-13T18:53:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d01f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d01e98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00b2ac0 0x7f58d01e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0141dd0 con 0x7f58d006cc40 2024-09-13T18:53:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01550d0 con 0x7f58d00b2ac0 2024-09-13T18:53:12.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.335+0000 7f58d7c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0141730 con 0x7f58d0070e10 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d01f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d01f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48856/0 (socket says 172.21.15.81:48856) 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 -- 172.21.15.81:0/4098407135 learned_addr learned my addr 172.21.15.81:0/4098407135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58cfe00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d01e98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00b2ac0 0x7f58d01e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 -- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 msgr2=0x7f58d01e98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d01e98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 -- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00b2ac0 msgr2=0x7f58d01e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00b2ac0 0x7f58d01e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 -- 172.21.15.81:0/4098407135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8009a70 con 0x7f58d006cc40 2024-09-13T18:53:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d5200700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d01f61d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c4d0 tx=0x7f58c400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4005d90 con 0x7f58d006cc40 2024-09-13T18:53:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d015e620 con 0x7f58d006cc40 2024-09-13T18:53:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c40070d0 con 0x7f58d006cc40 2024-09-13T18:53:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4007440 con 0x7f58d006cc40 2024-09-13T18:53:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d01419f0 con 0x7f58d006cc40 2024-09-13T18:53:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.339+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d0073050 con 0x7f58d006cc40 2024-09-13T18:53:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.343+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f58c40075a0 con 0x7f58d006cc40 2024-09-13T18:53:12.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.343+0000 7f58ccc00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f58b0066730 0x7f58b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.343+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f58c40834e0 con 0x7f58d006cc40 2024-09-13T18:53:12.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.343+0000 7f58cfe00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f58b0066730 0x7f58b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.343+0000 7f58cfe00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f58b0066730 0x7f58b0068bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f58d01f9f20 tx=0x7f58bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.351+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f58c40507d0 con 0x7f58d006cc40 2024-09-13T18:53:12.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.579+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58d015b9b0 con 0x7f58d006cc40 2024-09-13T18:53:12.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.579+0000 7f58ccc00700 1 -- 172.21.15.81:0/4098407135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4774 (secure 0 0 0) 0x7f58c4053df0 con 0x7f58d006cc40 2024-09-13T18:53:12.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:12.589 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:53:10.270787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:53:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f58b0066730 msgr2=0x7f58b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f58b0066730 0x7f58b0068bf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f58d01f9f20 tx=0x7f58bc008040 comp rx=0 tx=0).stop 2024-09-13T18:53:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 msgr2=0x7f58d01f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d01f61d0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c4d0 tx=0x7f58c400c7e0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 shutdown_connections 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f58b0066730 0x7f58b0068bf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d00b2ac0 0x7f58d01e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d0070e10 0x7f58d01e98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 --2- 172.21.15.81:0/4098407135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58d006cc40 0x7f58d01f61d0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 >> 172.21.15.81:0/4098407135 conn(0x7f58d00cfa90 msgr2=0x7f58d015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 shutdown_connections 2024-09-13T18:53:12.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.583+0000 7f58d7c00700 1 -- 172.21.15.81:0/4098407135 wait complete. 2024-09-13T18:53:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-13T18:53:12.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /d1/d2/d3 2024-09-13T18:53:12.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.779+0000 7fbc54200700 1 Processor -- start 2024-09-13T18:53:12.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.779+0000 7fbc54200700 1 -- start start 2024-09-13T18:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc54200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc4c144330 0x7fbc4c0cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc54200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc4c06d760 0x7fbc4c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc54200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4c06bcf0 con 0x7fbc4c144710 2024-09-13T18:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc54200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c0cce10 con 0x7fbc4c144330 2024-09-13T18:53:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc54200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c06cb50 con 0x7fbc4c06d760 2024-09-13T18:53:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc4c144330 0x7fbc4c0cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbc4c144330 0x7fbc4c0cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48868/0 (socket says 172.21.15.81:48868) 2024-09-13T18:53:12.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 -- 172.21.15.81:0/2899911932 learned_addr learned my addr 172.21.15.81:0/2899911932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc50e00700 1 --2- 172.21.15.81:0/2899911932 >> v2:172.21.15.178:3300/0 conn(0x7fbc4c06d760 0x7fbc4c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 -- 172.21.15.81:0/2899911932 >> v2:172.21.15.178:3300/0 conn(0x7fbc4c06d760 msgr2=0x7fbc4c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 --2- 172.21.15.81:0/2899911932 >> v2:172.21.15.178:3300/0 conn(0x7fbc4c06d760 0x7fbc4c0b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 -- 172.21.15.81:0/2899911932 >> v1:172.21.15.178:6789/0 conn(0x7fbc4c144710 legacy=0x7fbc4c15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc4be00700 1 -- 172.21.15.81:0/2899911932 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933610627 0 0) 0x7fbc4c06bcf0 con 0x7fbc4c144710 2024-09-13T18:53:12.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.783+0000 7fbc51800700 1 -- 172.21.15.81:0/2899911932 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c0cf4b0 con 0x7fbc4c144330 2024-09-13T18:53:12.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc51800700 1 --2- 172.21.15.81:0/2899911932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c144330 0x7fbc4c0cef70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0ce900 tx=0x7fbc40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d93b77063cd140 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc4be00700 1 -- 172.21.15.81:0/2899911932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40011830 con 0x7fbc4c144330 2024-09-13T18:53:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc4be00700 1 -- 172.21.15.81:0/2899911932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40011990 con 0x7fbc4c144330 2024-09-13T18:53:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc4be00700 1 -- 172.21.15.81:0/2899911932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40011d20 con 0x7fbc4c144330 2024-09-13T18:53:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 -- 172.21.15.81:0/2899911932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c144330 msgr2=0x7fbc4c0cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 --2- 172.21.15.81:0/2899911932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c144330 0x7fbc4c0cef70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0ce900 tx=0x7fbc40009bf0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 -- 172.21.15.81:0/2899911932 shutdown_connections 2024-09-13T18:53:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 --2- 172.21.15.81:0/2899911932 >> v2:172.21.15.178:3300/0 conn(0x7fbc4c06d760 0x7fbc4c0b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 --2- 172.21.15.81:0/2899911932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c144330 0x7fbc4c0cef70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 -- 172.21.15.81:0/2899911932 >> 172.21.15.81:0/2899911932 conn(0x7fbc4c06a570 msgr2=0x7fbc4c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 -- 172.21.15.81:0/2899911932 shutdown_connections 2024-09-13T18:53:12.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.787+0000 7fbc54200700 1 -- 172.21.15.81:0/2899911932 wait complete. 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 Processor -- start 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 -- start start 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c06d760 0x7fbc4c143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc4c144330 0x7fbc4c1366c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc4c155230 0x7fbc4c1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c071ad0 con 0x7fbc4c06d760 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c143b40 con 0x7fbc4c144330 2024-09-13T18:53:12.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc54200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c1f30b0 con 0x7fbc4c155230 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c06d760 0x7fbc4c143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c06d760 0x7fbc4c143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48874/0 (socket says 172.21.15.81:48874) 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 -- 172.21.15.81:0/391807008 learned_addr learned my addr 172.21.15.81:0/391807008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc52200700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc4c155230 0x7fbc4c1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc50e00700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc4c144330 0x7fbc4c1366c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 -- 172.21.15.81:0/391807008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc4c155230 msgr2=0x7fbc4c1f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc4c155230 0x7fbc4c1f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 -- 172.21.15.81:0/391807008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc4c144330 msgr2=0x7fbc4c1366c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc4c144330 0x7fbc4c1366c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.791+0000 7fbc51800700 1 -- 172.21.15.81:0/391807008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40009570 con 0x7fbc4c06d760 2024-09-13T18:53:12.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.795+0000 7fbc51800700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc4c06d760 0x7fbc4c143600 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbc40009c30 tx=0x7fbc40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.795+0000 7fbc49600700 1 -- 172.21.15.81:0/391807008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc400036c0 con 0x7fbc4c06d760 2024-09-13T18:53:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.795+0000 7fbc49600700 1 -- 172.21.15.81:0/391807008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4001f070 con 0x7fbc4c06d760 2024-09-13T18:53:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.795+0000 7fbc54200700 1 -- 172.21.15.81:0/391807008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4c1f3390 con 0x7fbc4c06d760 2024-09-13T18:53:12.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.795+0000 7fbc49600700 1 -- 172.21.15.81:0/391807008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40003a60 con 0x7fbc4c06d760 2024-09-13T18:53:12.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.795+0000 7fbc54200700 1 -- 172.21.15.81:0/391807008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c134e40 con 0x7fbc4c06d760 2024-09-13T18:53:12.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.799+0000 7fbc49600700 1 -- 172.21.15.81:0/391807008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbc40003bc0 con 0x7fbc4c06d760 2024-09-13T18:53:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.799+0000 7fbc49600700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbc2c066730 0x7fbc2c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.799+0000 7fbc49600700 1 -- 172.21.15.81:0/391807008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc40021070 con 0x7fbc4c06d760 2024-09-13T18:53:12.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.799+0000 7fbc50e00700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbc2c066730 0x7fbc2c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc50e00700 1 --2- 172.21.15.81:0/391807008 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbc2c066730 0x7fbc2c068bf0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0b2ff0 tx=0x7fbc38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 Processor -- start 2024-09-13T18:53:12.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 -- start start 2024-09-13T18:53:12.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba9f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9fe90 0x2ba9bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9c270 0x2ba9c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b9c77a0 con 0x2ba9f570 2024-09-13T18:53:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b9c4f30 con 0x2ba9fe90 2024-09-13T18:53:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b9c0820 con 0x2ba9c270 2024-09-13T18:53:12.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba9f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba9f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48878/0 (socket says 172.21.15.81:48878) 2024-09-13T18:53:12.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 -- 172.21.15.81:0/3104226266 learned_addr learned my addr 172.21.15.81:0/3104226266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc52200700 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9c270 0x2ba9c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 -- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9c270 msgr2=0x2ba9c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9c270 0x2ba9c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 -- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9fe90 msgr2=0x2ba9bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc50e00700 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9fe90 0x2ba9bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9fe90 0x2ba9bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 -- 172.21.15.81:0/3104226266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b832aa0 con 0x2ba9f570 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc50e00700 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9fe90 0x2ba9bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc51800700 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba9f950 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a010 tx=0x7fbc400092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bac39358127529 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc3e000700 1 -- 172.21.15.81:0/3104226266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40057220 con 0x2ba9f570 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc3e000700 1 -- 172.21.15.81:0/3104226266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40056b20 con 0x2ba9f570 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.803+0000 7fbc3e000700 1 -- 172.21.15.81:0/3104226266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4005a950 con 0x2ba9f570 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- 172.21.15.81:0/3104226266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 msgr2=0x2ba9f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba9f950 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000a010 tx=0x7fbc400092e0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- 172.21.15.81:0/3104226266 shutdown_connections 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9c270 0x2ba9c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9fe90 0x2ba9bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- 172.21.15.81:0/3104226266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba9f950 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- 172.21.15.81:0/3104226266 >> 172.21.15.81:0/3104226266 conn(0x2b7e7610 msgr2=0x2ba81a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- 172.21.15.81:0/3104226266 shutdown_connections 2024-09-13T18:53:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- 172.21.15.81:0/3104226266 wait complete. 2024-09-13T18:53:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- start start 2024-09-13T18:53:12.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 Processor -- start 2024-09-13T18:53:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9c270 0x2ba59b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba5a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2ba83730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b983c50 con 0x2ba9f570 2024-09-13T18:53:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b9838f0 con 0x2ba9c270 2024-09-13T18:53:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.807+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b8b3670 con 0x2ba9fe90 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 10 client.0 _ll_register_callbacks cb 0x2b9b9e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba5a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba5a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48884/0 (socket says 172.21.15.81:48884) 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 -- 172.21.15.81:0/1332296614 learned_addr learned my addr 172.21.15.81:0/1332296614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc51800700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9c270 0x2ba59b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc52200700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2ba83730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 -- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 msgr2=0x2ba83730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2ba83730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 -- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9c270 msgr2=0x2ba59b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9c270 0x2ba59b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 -- 172.21.15.81:0/1332296614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c134e40 con 0x2ba9f570 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc50e00700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba5a8f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbc38015470 tx=0x7fbc38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83001886ea963c4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc32a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc32a00700 1 -- 172.21.15.81:0/1332296614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38021410 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc32a00700 1 -- 172.21.15.81:0/1332296614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc38021570 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2b7f4320 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc32a00700 1 -- 172.21.15.81:0/1332296614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc38021730 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 10 client.7818 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x2b9868a0 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc32a00700 1 -- 172.21.15.81:0/1332296614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2b7f4320 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc32a00700 1 -- 172.21.15.81:0/1332296614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fbc38021890 con 0x2ba9f570 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 10 client.7818 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 10 client.7818 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 20 client.7818 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ba5ae30 0x2baa9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 4 client.7818 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2b83e5a0 con 0x2ba5ae30 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.811+0000 7fbc51800700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ba5ae30 0x2baa9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc32a00700 10 client.7818 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc51800700 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ba5ae30 0x2baa9550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70b916d6cc325b05 server_cookie=ffd8e2edf0d53b5e in_seq=0 out_seq=0 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc32a00700 1 -- 172.21.15.81:0/1332296614 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2b83e5a0 con 0x2ba5ae30 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc32a00700 10 client.7818 handle_command_reply: tid=0 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 client.7818 shutdown 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 msgr2=0x2ba5a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba5a8f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbc38015470 tx=0x7fbc38004770 comp rx=0 tx=0).stop 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 shutdown_connections 2024-09-13T18:53:12.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2ba5ae30 0x2baa9550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2ba83730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9f570 0x2ba5a8f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc32a00700 0 client.7818 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1332296614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9c270 0x2ba59b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 >> 172.21.15.81:0/1332296614 conn(0x2b7e7610 msgr2=0x2ba9e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 shutdown_connections 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 1 -- 172.21.15.81:0/1332296614 wait complete. 2024-09-13T18:53:12.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.815+0000 7fbc576a1740 20 client.7818 trim_cache size 0 max 16384 2024-09-13T18:53:12.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 Processor -- start 2024-09-13T18:53:12.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 -- start start 2024-09-13T18:53:12.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bafc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bafcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bafd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b9bdc20 con 0x2ba9c270 2024-09-13T18:53:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b9bc010 con 0x2ba9f570 2024-09-13T18:53:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.835+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b9c4820 con 0x2ba9fe90 2024-09-13T18:53:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bafc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bafc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48886/0 (socket says 172.21.15.81:48886) 2024-09-13T18:53:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 -- 172.21.15.81:0/1556428719 learned_addr learned my addr 172.21.15.81:0/1556428719 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc50e00700 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bafcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc52200700 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bafd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 -- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 msgr2=0x2bafd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bafd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 -- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 msgr2=0x2bafcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bafcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 -- 172.21.15.81:0/1556428719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2b96cad0 con 0x2ba9c270 2024-09-13T18:53:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc51800700 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bafc650 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053020 tx=0x7fbc40015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d6973d476fa037 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc3ea00700 1 -- 172.21.15.81:0/1556428719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc40057220 con 0x2ba9c270 2024-09-13T18:53:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc3ea00700 1 -- 172.21.15.81:0/1556428719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4005ef10 con 0x2ba9c270 2024-09-13T18:53:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc3ea00700 1 -- 172.21.15.81:0/1556428719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4005a950 con 0x2ba9c270 2024-09-13T18:53:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 -- 172.21.15.81:0/1556428719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 msgr2=0x2bafc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bafc650 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053020 tx=0x7fbc40015000 comp rx=0 tx=0).stop 2024-09-13T18:53:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 -- 172.21.15.81:0/1556428719 shutdown_connections 2024-09-13T18:53:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bafd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bafcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 --2- 172.21.15.81:0/1556428719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bafc650 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 -- 172.21.15.81:0/1556428719 >> 172.21.15.81:0/1556428719 conn(0x2b7e7610 msgr2=0x2ba9af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 -- 172.21.15.81:0/1556428719 shutdown_connections 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.839+0000 7fbc576a1740 1 -- 172.21.15.81:0/1556428719 wait complete. 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 -- start start 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 Processor -- start 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bb01380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bb018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bb01e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ba35f80 con 0x2ba9c270 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ba823b0 con 0x2ba9f570 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2bab87d0 con 0x2ba9fe90 2024-09-13T18:53:12.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 10 client.0 _ll_register_callbacks cb 0x2b97a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bb01380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bb01380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48896/0 (socket says 172.21.15.81:48896) 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 -- 172.21.15.81:0/2919542682 learned_addr learned my addr 172.21.15.81:0/2919542682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc50e00700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bb018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc52200700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bb01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 -- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 msgr2=0x2bb01e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bb01e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 -- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 msgr2=0x2bb018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bb018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 -- 172.21.15.81:0/2919542682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2b832aa0 con 0x2ba9c270 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc51800700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bb01380 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053020 tx=0x7fbc40004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db6686c8e2b6da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:12.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc32a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc32a00700 1 -- 172.21.15.81:0/2919542682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc4005a950 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc32a00700 1 -- 172.21.15.81:0/2919542682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc40054ec0 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc40056b20 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.843+0000 7fbc32a00700 1 -- 172.21.15.81:0/2919542682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc40056010 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 10 client.7824 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x2b960bb0 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc32a00700 1 -- 172.21.15.81:0/2919542682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc40056b20 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc32a00700 1 -- 172.21.15.81:0/2919542682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fbc4005ea80 con 0x2ba9c270 2024-09-13T18:53:12.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 10 client.7824 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 10 client.7824 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 20 client.7824 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2bb02340 0x2bab5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 4 client.7824 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3"}] 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3"}) v1 -- 0x2b863320 con 0x2bb02340 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc50e00700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2bb02340 0x2bab5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc32a00700 10 client.7824 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc50e00700 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2bb02340 0x2bab5ea0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6355abcc0daebb1b server_cookie=64b6462e629b82d8 in_seq=0 out_seq=0 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc32a00700 1 -- 172.21.15.81:0/2919542682 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x2b863320 con 0x2bb02340 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc32a00700 10 client.7824 handle_command_reply: tid=0 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 client.7824 shutdown 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 msgr2=0x2bb01380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:12.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bb01380 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbc40053020 tx=0x7fbc40004700 comp rx=0 tx=0).stop 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 shutdown_connections 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x2bb02340 0x2bab5ea0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ba9fe90 0x2bb01e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ba9f570 0x2bb018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc32a00700 0 client.7824 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 --2- 172.21.15.81:0/2919542682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2ba9c270 0x2bb01380 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 >> 172.21.15.81:0/2919542682 conn(0x2b7e7610 msgr2=0x2bab8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 shutdown_connections 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 1 -- 172.21.15.81:0/2919542682 wait complete. 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:12.847+0000 7fbc576a1740 20 client.7824 trim_cache size 0 max 16384 2024-09-13T18:53:12.860 INFO:teuthology.orchestra.run.smithi081.stderr:Error EXDEV: Not rank 0 2024-09-13T18:53:12.867 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-13T18:53:12.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-13T18:53:13.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.031+0000 7f079b200700 1 Processor -- start 2024-09-13T18:53:13.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.031+0000 7f079b200700 1 -- start start 2024-09-13T18:53:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f079c073a00 0x7f079c0b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c160570 0x7f079c160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079c0b3af0 con 0x7f079c15a6b0 2024-09-13T18:53:13.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079c160f40 con 0x7f079c073a00 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0b3d90 con 0x7f079c160570 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f079c073a00 0x7f079c0b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f079c073a00 0x7f079c0b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48912/0 (socket says 172.21.15.81:48912) 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 -- 172.21.15.81:0/3587342000 learned_addr learned my addr 172.21.15.81:0/3587342000 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799e00700 1 --1- 172.21.15.81:0/3587342000 >> v1:172.21.15.81:6789/0 conn(0x7f079c15a6b0 0x7f079c0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59776/0 (socket says 172.21.15.81:59776) 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079a800700 1 --2- 172.21.15.81:0/3587342000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c160570 0x7f079c160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 -- 172.21.15.81:0/3587342000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c160570 msgr2=0x7f079c160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 --2- 172.21.15.81:0/3587342000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c160570 0x7f079c160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 -- 172.21.15.81:0/3587342000 >> v1:172.21.15.81:6789/0 conn(0x7f079c15a6b0 legacy=0x7f079c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 -- 172.21.15.81:0/3587342000 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0b4070 con 0x7f079c073a00 2024-09-13T18:53:13.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0799400700 1 --2- 172.21.15.81:0/3587342000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0b26c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0788009910 tx=0x7f0788009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91b41a7747d8293 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0798a00700 1 -- 172.21.15.81:0/3587342000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078800ba60 con 0x7f079c073a00 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0798a00700 1 -- 172.21.15.81:0/3587342000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078800bbc0 con 0x7f079c073a00 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f0798a00700 1 -- 172.21.15.81:0/3587342000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788009e60 con 0x7f079c073a00 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- 172.21.15.81:0/3587342000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 msgr2=0x7f079c0b26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 --2- 172.21.15.81:0/3587342000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0b26c0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0788009910 tx=0x7f0788009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- 172.21.15.81:0/3587342000 shutdown_connections 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 --2- 172.21.15.81:0/3587342000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c160570 0x7f079c160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 --2- 172.21.15.81:0/3587342000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0b26c0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- 172.21.15.81:0/3587342000 >> 172.21.15.81:0/3587342000 conn(0x7f079c0b0bc0 msgr2=0x7f079c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- 172.21.15.81:0/3587342000 shutdown_connections 2024-09-13T18:53:13.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.035+0000 7f079b200700 1 -- 172.21.15.81:0/3587342000 wait complete. 2024-09-13T18:53:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.039+0000 7f079b200700 1 Processor -- start 2024-09-13T18:53:13.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.039+0000 7f079b200700 1 -- start start 2024-09-13T18:53:13.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c15a6b0 0x7f079c06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c160570 0x7f079c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c155710 con 0x7f079c073a00 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0cc570 con 0x7f079c160570 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c0cdd60 con 0x7f079c15a6b0 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48920/0 (socket says 172.21.15.81:48920) 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 -- 172.21.15.81:0/906487947 learned_addr learned my addr 172.21.15.81:0/906487947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079a800700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c160570 0x7f079c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799400700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c15a6b0 0x7f079c06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 -- 172.21.15.81:0/906487947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c15a6b0 msgr2=0x7f079c06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079c15a6b0 0x7f079c06c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 -- 172.21.15.81:0/906487947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c160570 msgr2=0x7f079c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079c160570 0x7f079c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 -- 172.21.15.81:0/906487947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788009570 con 0x7f079c073a00 2024-09-13T18:53:13.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0799e00700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f079c073a00 0x7f079c0cc030 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f078c00c700 tx=0x7f078c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0792000700 1 -- 172.21.15.81:0/906487947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c005cd0 con 0x7f079c073a00 2024-09-13T18:53:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 -- 172.21.15.81:0/906487947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079c0ce040 con 0x7f079c073a00 2024-09-13T18:53:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0792000700 1 -- 172.21.15.81:0/906487947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c005e30 con 0x7f079c073a00 2024-09-13T18:53:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f0792000700 1 -- 172.21.15.81:0/906487947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c0072d0 con 0x7f079c073a00 2024-09-13T18:53:13.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.043+0000 7f079b200700 1 -- 172.21.15.81:0/906487947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079c0ce600 con 0x7f079c073a00 2024-09-13T18:53:13.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.051+0000 7f0792000700 1 -- 172.21.15.81:0/906487947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f078c007430 con 0x7f079c073a00 2024-09-13T18:53:13.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.051+0000 7f0792000700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f077c066730 0x7f077c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.051+0000 7f0792000700 1 -- 172.21.15.81:0/906487947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f078c0835f0 con 0x7f079c073a00 2024-09-13T18:53:13.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.051+0000 7f0799400700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f077c066730 0x7f077c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.051+0000 7f0799400700 1 --2- 172.21.15.81:0/906487947 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f077c066730 0x7f077c068bf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c00 tx=0x7f0788008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 Processor -- start 2024-09-13T18:53:13.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 -- start start 2024-09-13T18:53:13.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdf4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdf76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdfa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd1c020 con 0x1bdf7c10 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd197b0 con 0x1bdf52e0 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bd150a0 con 0x1bdefe20 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdfa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdfa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48932/0 (socket says 172.21.15.81:48932) 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 -- 172.21.15.81:0/2021153008 learned_addr learned my addr 172.21.15.81:0/2021153008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f0799e00700 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdf4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f0799400700 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdf76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 -- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 msgr2=0x1bdf4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdf4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 -- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 msgr2=0x1bdf76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdf76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 -- 172.21.15.81:0/2021153008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bb879c0 con 0x1bdf7c10 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f079a800700 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdfa000 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f0794009f10 tx=0x7f0794003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b254236d9a760a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f0786a00700 1 -- 172.21.15.81:0/2021153008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794003e40 con 0x1bdf7c10 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f0786a00700 1 -- 172.21.15.81:0/2021153008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0794004740 con 0x1bdf7c10 2024-09-13T18:53:13.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.055+0000 7f0786a00700 1 -- 172.21.15.81:0/2021153008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794015420 con 0x1bdf7c10 2024-09-13T18:53:13.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- 172.21.15.81:0/2021153008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 msgr2=0x1bdfa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdfa000 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f0794009f10 tx=0x7f0794003d20 comp rx=0 tx=0).stop 2024-09-13T18:53:13.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- 172.21.15.81:0/2021153008 shutdown_connections 2024-09-13T18:53:13.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdfa000 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdf76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- 172.21.15.81:0/2021153008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdf4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- 172.21.15.81:0/2021153008 >> 172.21.15.81:0/2021153008 conn(0x1bb3c530 msgr2=0x1bdd6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- 172.21.15.81:0/2021153008 shutdown_connections 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- 172.21.15.81:0/2021153008 wait complete. 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- start start 2024-09-13T18:53:13.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 Processor -- start 2024-09-13T18:53:13.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 0x1bdf3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf7c10 0x1bdf3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bcd28b0 con 0x1bdf52e0 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bcd8720 con 0x1bdf7c10 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bbc0b00 con 0x1bdefe20 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.059+0000 7f07a4402740 10 client.0 _ll_register_callbacks cb 0x1bd0e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 0x1bdf3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 0x1bdf3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48944/0 (socket says 172.21.15.81:48944) 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 -- 172.21.15.81:0/1177861730 learned_addr learned my addr 172.21.15.81:0/1177861730 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f079a800700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf7c10 0x1bdf3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799e00700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 -- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 msgr2=0x1bdac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 -- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf7c10 msgr2=0x1bdf3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf7c10 0x1bdf3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 -- 172.21.15.81:0/1177861730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0794011040 con 0x1bdf52e0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799400700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 0x1bdf3640 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f078800b3c0 tx=0x7f07880047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919f891cbb49da4d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f077b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f077b400700 1 -- 172.21.15.81:0/1177861730 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078802e070 con 0x1bdf52e0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f077b400700 1 -- 172.21.15.81:0/1177861730 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0788034c10 con 0x1bdf52e0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bb49240 con 0x1bdf52e0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f077b400700 1 -- 172.21.15.81:0/1177861730 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0788020070 con 0x1bdf52e0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 10 client.7839 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x1bcdb440 con 0x1bdf52e0 2024-09-13T18:53:13.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f077b400700 1 -- 172.21.15.81:0/1177861730 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bb49240 con 0x1bdf52e0 2024-09-13T18:53:13.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f077b400700 1 -- 172.21.15.81:0/1177861730 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0788003990 con 0x1bdf52e0 2024-09-13T18:53:13.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 10 client.7839 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:13.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 10 client.7839 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 20 client.7839 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1bda8e50 0x1bda9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 4 client.7839 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bb934c0 con 0x1bda8e50 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.063+0000 7f0799e00700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1bda8e50 0x1bda9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f077b400700 10 client.7839 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f0799e00700 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1bda8e50 0x1bda9230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e53fabb9d95c3a4 server_cookie=be6ece53bf9f70cf in_seq=0 out_seq=0 2024-09-13T18:53:13.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f077b400700 1 -- 172.21.15.81:0/1177861730 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1bb934c0 con 0x1bda8e50 2024-09-13T18:53:13.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f077b400700 10 client.7839 handle_command_reply: tid=0 2024-09-13T18:53:13.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 client.7839 shutdown 2024-09-13T18:53:13.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 msgr2=0x1bdf3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 0x1bdf3640 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f078800b3c0 tx=0x7f07880047e0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 shutdown_connections 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1bda8e50 0x1bda9230 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf7c10 0x1bdf3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf52e0 0x1bdf3640 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f077b400700 0 client.7839 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 --2- 172.21.15.81:0/1177861730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 >> 172.21.15.81:0/1177861730 conn(0x1bb3c530 msgr2=0x1bdd6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 shutdown_connections 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 1 -- 172.21.15.81:0/1177861730 wait complete. 2024-09-13T18:53:13.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.067+0000 7f07a4402740 20 client.7839 trim_cache size 0 max 16384 2024-09-13T18:53:13.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 Processor -- start 2024-09-13T18:53:13.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 -- start start 2024-09-13T18:53:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdd37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdd3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd1d2b0 con 0x1bdf7c10 2024-09-13T18:53:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd124a0 con 0x1bdf52e0 2024-09-13T18:53:13.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bccf410 con 0x1bdefe20 2024-09-13T18:53:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f079a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f0799e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdd37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f0799400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdd3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f0799400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdd3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:42978/0 (socket says 172.21.15.81:42978) 2024-09-13T18:53:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f0799e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdd37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:56508/0 (socket says 172.21.15.81:56508) 2024-09-13T18:53:13.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.087+0000 7f0799400700 1 -- 172.21.15.81:0/900600372 learned_addr learned my addr 172.21.15.81:0/900600372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0799400700 1 -- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 msgr2=0x1bdd37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0799400700 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdd37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0799400700 1 -- 172.21.15.81:0/900600372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 msgr2=0x1bdee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0799400700 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0799400700 1 -- 172.21.15.81:0/900600372 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bcc1470 con 0x1bdf52e0 2024-09-13T18:53:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0799400700 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdd3d00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0788004860 tx=0x7f078802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=500a75a87d3c94e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0787400700 1 -- 172.21.15.81:0/900600372 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788004600 con 0x1bdf52e0 2024-09-13T18:53:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0787400700 1 -- 172.21.15.81:0/900600372 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078800b860 con 0x1bdf52e0 2024-09-13T18:53:13.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f0787400700 1 -- 172.21.15.81:0/900600372 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078803d470 con 0x1bdf52e0 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 -- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 msgr2=0x1bdd3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdd3d00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0788004860 tx=0x7f078802e000 comp rx=0 tx=0).stop 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 -- 172.21.15.81:0/900600372 shutdown_connections 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1bdee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdf52e0 0x1bdd3d00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 --2- 172.21.15.81:0/900600372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdefe20 0x1bdd37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 -- 172.21.15.81:0/900600372 >> 172.21.15.81:0/900600372 conn(0x1bb3c530 msgr2=0x1bda9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 -- 172.21.15.81:0/900600372 shutdown_connections 2024-09-13T18:53:13.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 -- 172.21.15.81:0/900600372 wait complete. 2024-09-13T18:53:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 -- start start 2024-09-13T18:53:13.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.091+0000 7f07a4402740 1 Processor -- start 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdefe20 0x1be0b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdf52e0 0x1be0c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1be09690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bdd40e0 con 0x1bdf7c10 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bdf3bd0 con 0x1bdefe20 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1be04f80 con 0x1bdf52e0 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 10 client.0 _ll_register_callbacks cb 0x1bcd66d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1be09690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1be09690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48972/0 (socket says 172.21.15.81:48972) 2024-09-13T18:53:13.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 -- 172.21.15.81:0/2023720393 learned_addr learned my addr 172.21.15.81:0/2023720393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f0799e00700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdefe20 0x1be0b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f0799400700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdf52e0 0x1be0c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 -- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdf52e0 msgr2=0x1be0c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdf52e0 0x1be0c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 -- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdefe20 msgr2=0x1be0b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdefe20 0x1be0b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 -- 172.21.15.81:0/2023720393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1bcdb440 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f079a800700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1be09690 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x1bd43be0 tx=0x7f0794004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a5ad1e077d1eda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f077b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f077b400700 1 -- 172.21.15.81:0/2023720393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794025070 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f077b400700 1 -- 172.21.15.81:0/2023720393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f07940156f0 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0794004740 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f077b400700 1 -- 172.21.15.81:0/2023720393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07940158b0 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 10 client.7845 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x1bcb5740 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f077b400700 1 -- 172.21.15.81:0/2023720393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0794004740 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f077b400700 1 -- 172.21.15.81:0/2023720393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0794015a10 con 0x1bdf7c10 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 10 client.7845 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:13.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 10 client.7845 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 20 client.7845 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1be0a180 0x1be58d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 4 client.7845 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-13T18:53:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x1bbb8240 con 0x1be0a180 2024-09-13T18:53:13.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.095+0000 7f0799e00700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1be0a180 0x1be58d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f077b400700 10 client.7845 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f0799e00700 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1be0a180 0x1be58d40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60b8d3b389c3b7d8 server_cookie=ae1285b8cbcb1239 in_seq=0 out_seq=0 2024-09-13T18:53:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f077b400700 1 -- 172.21.15.81:0/2023720393 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0x1bbb8240 con 0x1be0a180 2024-09-13T18:53:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f077b400700 10 client.7845 handle_command_reply: tid=0 2024-09-13T18:53:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 client.7845 shutdown 2024-09-13T18:53:13.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 msgr2=0x1be09690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1be09690 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x1bd43be0 tx=0x7f0794004b60 comp rx=0 tx=0).stop 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 shutdown_connections 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0x1be0a180 0x1be58d40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1bdf7c10 0x1be09690 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bdf52e0 0x1be0c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 --2- 172.21.15.81:0/2023720393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bdefe20 0x1be0b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f077b400700 0 client.7845 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 >> 172.21.15.81:0/2023720393 conn(0x1bb3c530 msgr2=0x1be04870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 shutdown_connections 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 1 -- 172.21.15.81:0/2023720393 wait complete. 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.099+0000 7f07a4402740 20 client.7845 trim_cache size 0 max 16384 2024-09-13T18:53:13.109 INFO:teuthology.orchestra.run.smithi081.stderr:Error EXDEV: Not rank 0 2024-09-13T18:53:13.117 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-13T18:53:13.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-13T18:53:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7783200700 1 Processor -- start 2024-09-13T18:53:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7783200700 1 -- start start 2024-09-13T18:53:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7783200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f777c06cd80 0x7f777c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7783200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c160680 con 0x7f777c15ca20 2024-09-13T18:53:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7783200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c15d670 con 0x7f777c06ada0 2024-09-13T18:53:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7783200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777c15d950 con 0x7f777c06cd80 2024-09-13T18:53:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7781400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f777c06cd80 0x7f777c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7781e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f777c15ca20 0x7f777c15ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59778/0 (socket says 172.21.15.81:59778) 2024-09-13T18:53:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.279+0000 7f7781e00700 1 -- 172.21.15.81:0/1509664288 learned_addr learned my addr 172.21.15.81:0/1509664288 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7781400700 1 -- 172.21.15.81:0/1509664288 >> v1:172.21.15.178:6789/0 conn(0x7f777c06ada0 legacy=0x7f777c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7781400700 1 -- 172.21.15.81:0/1509664288 >> v1:172.21.15.81:6789/0 conn(0x7f777c15ca20 legacy=0x7f777c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7781400700 1 -- 172.21.15.81:0/1509664288 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c15dc30 con 0x7f777c06cd80 2024-09-13T18:53:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7780a00700 1 -- 172.21.15.81:0/1509664288 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549087772 0 0) 0x7f777c160680 con 0x7f777c15ca20 2024-09-13T18:53:13.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7781400700 1 --2- 172.21.15.81:0/1509664288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06cd80 0x7f777c0b4310 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f776c009850 tx=0x7f776c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05a3faf88afe8e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7780a00700 1 -- 172.21.15.81:0/1509664288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c011830 con 0x7f777c06cd80 2024-09-13T18:53:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7780a00700 1 -- 172.21.15.81:0/1509664288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c011990 con 0x7f777c06cd80 2024-09-13T18:53:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7780a00700 1 -- 172.21.15.81:0/1509664288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c011d20 con 0x7f777c06cd80 2024-09-13T18:53:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 -- 172.21.15.81:0/1509664288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06cd80 msgr2=0x7f777c0b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 --2- 172.21.15.81:0/1509664288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06cd80 0x7f777c0b4310 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f776c009850 tx=0x7f776c009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:13.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 -- 172.21.15.81:0/1509664288 shutdown_connections 2024-09-13T18:53:13.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 --2- 172.21.15.81:0/1509664288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06cd80 0x7f777c0b4310 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 -- 172.21.15.81:0/1509664288 >> 172.21.15.81:0/1509664288 conn(0x7f777c071d20 msgr2=0x7f777c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 -- 172.21.15.81:0/1509664288 shutdown_connections 2024-09-13T18:53:13.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.283+0000 7f7783200700 1 -- 172.21.15.81:0/1509664288 wait complete. 2024-09-13T18:53:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 Processor -- start 2024-09-13T18:53:13.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 -- start start 2024-09-13T18:53:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06ada0 0x7f777c145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f777c06cd80 0x7f777c152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f777c15ca20 0x7f777c15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c154700 con 0x7f777c06ada0 2024-09-13T18:53:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c153a80 con 0x7f777c06cd80 2024-09-13T18:53:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c153d60 con 0x7f777c15ca20 2024-09-13T18:53:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06ada0 0x7f777c145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06ada0 0x7f777c145410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48988/0 (socket says 172.21.15.81:48988) 2024-09-13T18:53:13.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 -- 172.21.15.81:0/3164818005 learned_addr learned my addr 172.21.15.81:0/3164818005 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781400700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f777c06cd80 0x7f777c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7782800700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f777c15ca20 0x7f777c15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 -- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f777c15ca20 msgr2=0x7f777c15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f777c15ca20 0x7f777c15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 -- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f777c06cd80 msgr2=0x7f777c152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f777c06cd80 0x7f777c152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 -- 172.21.15.81:0/3164818005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0094b0 con 0x7f777c06ada0 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7782800700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f777c15ca20 0x7f777c15b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781400700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f777c06cd80 0x7f777c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7781e00700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f777c06ada0 0x7f777c145410 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f777000c4a0 tx=0x7f777000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7776000700 1 -- 172.21.15.81:0/3164818005 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770004ca0 con 0x7f777c06ada0 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7776000700 1 -- 172.21.15.81:0/3164818005 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7770004e00 con 0x7f777c06ada0 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7776000700 1 -- 172.21.15.81:0/3164818005 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770007310 con 0x7f777c06ada0 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.287+0000 7f7783200700 1 -- 172.21.15.81:0/3164818005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c154040 con 0x7f777c06ada0 2024-09-13T18:53:13.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.291+0000 7f7783200700 1 -- 172.21.15.81:0/3164818005 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c152ea0 con 0x7f777c06ada0 2024-09-13T18:53:13.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.291+0000 7f7776000700 1 -- 172.21.15.81:0/3164818005 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7770007470 con 0x7f777c06ada0 2024-09-13T18:53:13.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.295+0000 7f7776000700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7760066730 0x7f7760068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.295+0000 7f7776000700 1 -- 172.21.15.81:0/3164818005 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7770084060 con 0x7f777c06ada0 2024-09-13T18:53:13.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.295+0000 7f7781400700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7760066730 0x7f7760068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.295+0000 7f7787cb8740 1 Processor -- start 2024-09-13T18:53:13.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.295+0000 7f7787cb8740 1 -- start start 2024-09-13T18:53:13.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.295+0000 7f7781400700 1 --2- 172.21.15.81:0/3164818005 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7760066730 0x7f7760068bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f776c0090b0 tx=0x7f776c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2bf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7787cb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1e1020 con 0xd2bcc10 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1de7b0 con 0xd2b4e20 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd1da0a0 con 0xd2ba2e0 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7781e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2bf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48998/0 (socket says 172.21.15.81:48998) 2024-09-13T18:53:13.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 -- 172.21.15.81:0/2959369105 learned_addr learned my addr 172.21.15.81:0/2959369105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7781400700 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 -- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 msgr2=0xd2bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 -- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 msgr2=0xd2b9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2b9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 -- 172.21.15.81:0/2959369105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd04c9c0 con 0xd2bcc10 2024-09-13T18:53:13.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f7782800700 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2bf000 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7778002150 tx=0x7f777800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c9e07ee63ef962 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f776a600700 1 -- 172.21.15.81:0/2959369105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777800b070 con 0xd2bcc10 2024-09-13T18:53:13.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f776a600700 1 -- 172.21.15.81:0/2959369105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778003a40 con 0xd2bcc10 2024-09-13T18:53:13.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.299+0000 7f776a600700 1 -- 172.21.15.81:0/2959369105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777800dea0 con 0xd2bcc10 2024-09-13T18:53:13.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- 172.21.15.81:0/2959369105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 msgr2=0xd2bf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2bf000 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7778002150 tx=0x7f777800d430 comp rx=0 tx=0).stop 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- 172.21.15.81:0/2959369105 shutdown_connections 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2bf000 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- 172.21.15.81:0/2959369105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2b9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- 172.21.15.81:0/2959369105 >> 172.21.15.81:0/2959369105 conn(0xd001530 msgr2=0xd29b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- 172.21.15.81:0/2959369105 shutdown_connections 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- 172.21.15.81:0/2959369105 wait complete. 2024-09-13T18:53:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- start start 2024-09-13T18:53:13.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 Processor -- start 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2b4e20 0xd2716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2bcc10 0xd2b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1978b0 con 0xd2ba2e0 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd19d720 con 0xd2bcc10 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd085b00 con 0xd2b4e20 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7787cb8740 10 client.0 _ll_register_callbacks cb 0xd1d38b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7781400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7781e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2b4e20 0xd2716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7781400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49014/0 (socket says 172.21.15.81:49014) 2024-09-13T18:53:13.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7781400700 1 -- 172.21.15.81:0/118392557 learned_addr learned my addr 172.21.15.81:0/118392557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.303+0000 7f7782800700 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2bcc10 0xd2b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781400700 1 -- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2b4e20 msgr2=0xd2716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781400700 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2b4e20 0xd2716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781400700 1 -- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2bcc10 msgr2=0xd2b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781400700 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2bcc10 0xd2b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781400700 1 -- 172.21.15.81:0/118392557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c15d670 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781400700 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2b8640 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f777c0d1a40 tx=0x7f776c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864a4ab5d5b6ce41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 1 -- 172.21.15.81:0/118392557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c003f30 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 1 -- 172.21.15.81:0/118392557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f776c004590 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd00e240 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 1 -- 172.21.15.81:0/118392557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f776c01c440 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 10 client.7860 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xd1a0440 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 1 -- 172.21.15.81:0/118392557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd00e240 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 1 -- 172.21.15.81:0/118392557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f776c01c5a0 con 0xd2ba2e0 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 10 client.7860 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 10 client.7860 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 20 client.7860 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:13.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd26de50 0xd26e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 4 client.7860 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:13.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd0584c0 con 0xd26de50 2024-09-13T18:53:13.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781e00700 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd26de50 0xd26e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f7781e00700 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd26de50 0xd26e230 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=825f82aa8f7b560f server_cookie=3d31070d46c8b478 in_seq=0 out_seq=0 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.307+0000 7f775ea00700 10 client.7860 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f775ea00700 1 -- 172.21.15.81:0/118392557 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xd0584c0 con 0xd26de50 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f775ea00700 10 client.7860 handle_command_reply: tid=0 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 client.7860 shutdown 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 msgr2=0xd2b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2b8640 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f777c0d1a40 tx=0x7f776c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 shutdown_connections 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd26de50 0xd26e230 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2bcc10 0xd2b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2b8640 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f775ea00700 0 client.7860 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 --2- 172.21.15.81:0/118392557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2b4e20 0xd2716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 >> 172.21.15.81:0/118392557 conn(0xd001530 msgr2=0xd29b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 shutdown_connections 2024-09-13T18:53:13.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 1 -- 172.21.15.81:0/118392557 wait complete. 2024-09-13T18:53:13.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.311+0000 7f7787cb8740 20 client.7860 trim_cache size 0 max 16384 2024-09-13T18:53:13.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 Processor -- start 2024-09-13T18:53:13.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 -- start start 2024-09-13T18:53:13.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1d74a0 con 0xd2bcc10 2024-09-13T18:53:13.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd209bf0 con 0xd2b4e20 2024-09-13T18:53:13.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd194410 con 0xd2ba2e0 2024-09-13T18:53:13.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7782800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7782800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49020/0 (socket says 172.21.15.81:49020) 2024-09-13T18:53:13.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7782800700 1 -- 172.21.15.81:0/857817127 learned_addr learned my addr 172.21.15.81:0/857817127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7781e00700 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.331+0000 7f7781400700 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7782800700 1 -- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 msgr2=0xd2b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7782800700 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7782800700 1 -- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 msgr2=0xd2d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7782800700 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7782800700 1 -- 172.21.15.81:0/857817127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd186470 con 0xd2bcc10 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7782800700 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2b8760 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7778016040 tx=0x7f777800b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce00349fa723dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f776b000700 1 -- 172.21.15.81:0/857817127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778001c50 con 0xd2bcc10 2024-09-13T18:53:13.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f776b000700 1 -- 172.21.15.81:0/857817127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778001db0 con 0xd2bcc10 2024-09-13T18:53:13.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f776b000700 1 -- 172.21.15.81:0/857817127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777800dee0 con 0xd2bcc10 2024-09-13T18:53:13.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 -- 172.21.15.81:0/857817127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 msgr2=0xd2b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2b8760 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f7778016040 tx=0x7f777800b000 comp rx=0 tx=0).stop 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 -- 172.21.15.81:0/857817127 shutdown_connections 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2bcc10 0xd2b8760 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2ba2e0 0xd2b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 --2- 172.21.15.81:0/857817127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 -- 172.21.15.81:0/857817127 >> 172.21.15.81:0/857817127 conn(0xd001530 msgr2=0xd2c9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 -- 172.21.15.81:0/857817127 shutdown_connections 2024-09-13T18:53:13.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.335+0000 7f7787cb8740 1 -- 172.21.15.81:0/857817127 wait complete. 2024-09-13T18:53:13.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 -- start start 2024-09-13T18:53:13.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 Processor -- start 2024-09-13T18:53:13.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2bcc10 0xd2d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1d78b0 con 0xd2ba2e0 2024-09-13T18:53:13.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd1df190 con 0xd2b4e20 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd26f1e0 con 0xd2bcc10 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7787cb8740 10 client.0 _ll_register_callbacks cb 0xd19b6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7781400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7781400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2d2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49030/0 (socket says 172.21.15.81:49030) 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7781400700 1 -- 172.21.15.81:0/1832289163 learned_addr learned my addr 172.21.15.81:0/1832289163 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7781e00700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.339+0000 7f7782800700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2bcc10 0xd2d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781400700 1 -- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2bcc10 msgr2=0xd2d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781400700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2bcc10 0xd2d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781400700 1 -- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 msgr2=0xd2d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781400700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781400700 1 -- 172.21.15.81:0/1832289163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd04c9c0 con 0xd2ba2e0 2024-09-13T18:53:13.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7782800700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2bcc10 0xd2d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:13.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781400700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2d2690 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f776c009850 tx=0x7f776c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fd9237f122bcb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 1 -- 172.21.15.81:0/1832289163 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c003f30 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 1 -- 172.21.15.81:0/1832289163 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f776c004090 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7778003a40 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 1 -- 172.21.15.81:0/1832289163 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f776c004590 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 10 client.7866 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xd17a740 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 1 -- 172.21.15.81:0/1832289163 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7778003a40 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 1 -- 172.21.15.81:0/1832289163 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f776c048460 con 0xd2ba2e0 2024-09-13T18:53:13.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 10 client.7866 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:13.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 10 client.7866 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:13.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 20 client.7866 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:13.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd2ce910 0xd2cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 4 client.7866 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-13T18:53:13.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0xd07d240 con 0xd2ce910 2024-09-13T18:53:13.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781e00700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd2ce910 0xd2cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7781e00700 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd2ce910 0xd2cecf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19407b2ccbabfd90 server_cookie=78e6cd4c0dc7003a in_seq=0 out_seq=0 2024-09-13T18:53:13.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 10 client.7866 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 1 -- 172.21.15.81:0/1832289163 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0xd07d240 con 0xd2ce910 2024-09-13T18:53:13.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f775ea00700 10 client.7866 handle_command_reply: tid=0 2024-09-13T18:53:13.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.343+0000 7f7787cb8740 1 client.7866 shutdown 2024-09-13T18:53:13.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 msgr2=0xd2d2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2d2690 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f776c009850 tx=0x7f776c009240 comp rx=0 tx=0).stop 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 shutdown_connections 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xd2ce910 0xd2cecf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd2bcc10 0xd2d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f775ea00700 0 client.7866 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd2ba2e0 0xd2d2690 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 --2- 172.21.15.81:0/1832289163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd2b4e20 0xd2d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 >> 172.21.15.81:0/1832289163 conn(0xd001530 msgr2=0xd2977b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 shutdown_connections 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 1 -- 172.21.15.81:0/1832289163 wait complete. 2024-09-13T18:53:13.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.347+0000 7f7787cb8740 20 client.7866 trim_cache size 0 max 16384 2024-09-13T18:53:13.357 INFO:teuthology.orchestra.run.smithi081.stderr:Error EXDEV: Not rank 0 2024-09-13T18:53:13.366 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-13T18:53:13.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-13T18:53:13.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:53:13.432 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:53:13.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.531+0000 7faecd200700 1 Processor -- start 2024-09-13T18:53:13.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.531+0000 7faecd200700 1 -- start start 2024-09-13T18:53:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faecd200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faec81464c0 0x7faec8071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faecd200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faec80b1980 0x7faec80b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faecd200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec8070da0 con 0x7faec806c960 2024-09-13T18:53:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faecd200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec80b2440 con 0x7faec81464c0 2024-09-13T18:53:13.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faecd200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec80b2720 con 0x7faec80b1980 2024-09-13T18:53:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faec81464c0 0x7faec8071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7faec806c960 0x7faec80ac890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59790/0 (socket says 172.21.15.81:59790) 2024-09-13T18:53:13.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7e00700 1 -- 172.21.15.81:0/1999288353 learned_addr learned my addr 172.21.15.81:0/1999288353 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec6a00700 1 --2- 172.21.15.81:0/1999288353 >> v2:172.21.15.178:3300/0 conn(0x7faec80b1980 0x7faec80b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7400700 1 -- 172.21.15.81:0/1999288353 >> v2:172.21.15.178:3300/0 conn(0x7faec80b1980 msgr2=0x7faec80b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7400700 1 --2- 172.21.15.81:0/1999288353 >> v2:172.21.15.178:3300/0 conn(0x7faec80b1980 0x7faec80b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec6000700 1 -- 172.21.15.81:0/1999288353 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910841295 0 0) 0x7faec8070da0 con 0x7faec806c960 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7400700 1 -- 172.21.15.81:0/1999288353 >> v1:172.21.15.81:6789/0 conn(0x7faec806c960 legacy=0x7faec80ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7400700 1 -- 172.21.15.81:0/1999288353 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec8071060 con 0x7faec81464c0 2024-09-13T18:53:13.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec6a00700 1 --2- 172.21.15.81:0/1999288353 >> v2:172.21.15.178:3300/0 conn(0x7faec80b1980 0x7faec80b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec7400700 1 --2- 172.21.15.81:0/1999288353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec81464c0 0x7faec8071860 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7faec806dae0 tx=0x7faeb8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a44a57df8af8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec6000700 1 -- 172.21.15.81:0/1999288353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011830 con 0x7faec81464c0 2024-09-13T18:53:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec6000700 1 -- 172.21.15.81:0/1999288353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb8011990 con 0x7faec81464c0 2024-09-13T18:53:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.535+0000 7faec6000700 1 -- 172.21.15.81:0/1999288353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8011d40 con 0x7faec81464c0 2024-09-13T18:53:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 -- 172.21.15.81:0/1999288353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec81464c0 msgr2=0x7faec8071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 --2- 172.21.15.81:0/1999288353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec81464c0 0x7faec8071860 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7faec806dae0 tx=0x7faeb8009b30 comp rx=0 tx=0).stop 2024-09-13T18:53:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 -- 172.21.15.81:0/1999288353 shutdown_connections 2024-09-13T18:53:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 --2- 172.21.15.81:0/1999288353 >> v2:172.21.15.178:3300/0 conn(0x7faec80b1980 0x7faec80b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 --2- 172.21.15.81:0/1999288353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec81464c0 0x7faec8071860 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 -- 172.21.15.81:0/1999288353 >> 172.21.15.81:0/1999288353 conn(0x7faec806a390 msgr2=0x7faec806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 -- 172.21.15.81:0/1999288353 shutdown_connections 2024-09-13T18:53:13.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.539+0000 7faecd200700 1 -- 172.21.15.81:0/1999288353 wait complete. 2024-09-13T18:53:13.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 Processor -- start 2024-09-13T18:53:13.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 -- start start 2024-09-13T18:53:13.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faec806c960 0x7faec81f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec80b1980 0x7faec815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faec81464c0 0x7faec80b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec80c3ab0 con 0x7faec80b1980 2024-09-13T18:53:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec813fa90 con 0x7faec81464c0 2024-09-13T18:53:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faecd200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec81f6630 con 0x7faec806c960 2024-09-13T18:53:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec80b1980 0x7faec815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec80b1980 0x7faec815f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49052/0 (socket says 172.21.15.81:49052) 2024-09-13T18:53:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 -- 172.21.15.81:0/1327427692 learned_addr learned my addr 172.21.15.81:0/1327427692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec7e00700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faec81464c0 0x7faec80b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec7400700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faec806c960 0x7faec81f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 -- 172.21.15.81:0/1327427692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faec806c960 msgr2=0x7faec81f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faec806c960 0x7faec81f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 -- 172.21.15.81:0/1327427692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faec81464c0 msgr2=0x7faec80b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faec81464c0 0x7faec80b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.543+0000 7faec6a00700 1 -- 172.21.15.81:0/1327427692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80094b0 con 0x7faec80b1980 2024-09-13T18:53:13.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.547+0000 7faec6a00700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faec80b1980 0x7faec815f410 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e810 tx=0x7faeb400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.547+0000 7faebf400700 1 -- 172.21.15.81:0/1327427692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400c070 con 0x7faec80b1980 2024-09-13T18:53:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.547+0000 7faebf400700 1 -- 172.21.15.81:0/1327427692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4013610 con 0x7faec80b1980 2024-09-13T18:53:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.547+0000 7faecd200700 1 -- 172.21.15.81:0/1327427692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec81f5db0 con 0x7faec80b1980 2024-09-13T18:53:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.547+0000 7faebf400700 1 -- 172.21.15.81:0/1327427692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb40139a0 con 0x7faec80b1980 2024-09-13T18:53:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.547+0000 7faecd200700 1 -- 172.21.15.81:0/1327427692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec81f6350 con 0x7faec80b1980 2024-09-13T18:53:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faebf400700 1 -- 172.21.15.81:0/1327427692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faeb4013b00 con 0x7faec80b1980 2024-09-13T18:53:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 Processor -- start 2024-09-13T18:53:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faebf400700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faea8066730 0x7faea8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faebf400700 1 -- 172.21.15.81:0/1327427692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faeb4083fe0 con 0x7faec80b1980 2024-09-13T18:53:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 -- start start 2024-09-13T18:53:13.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faec7e00700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faea8066730 0x7faea8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf119a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf13b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf062dd0 con 0xf13af60 2024-09-13T18:53:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf060560 con 0xf13b880 2024-09-13T18:53:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.551+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf05be50 con 0xf1194a0 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf119a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf119a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49068/0 (socket says 172.21.15.81:49068) 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7400700 1 -- 172.21.15.81:0/479887990 learned_addr learned my addr 172.21.15.81:0/479887990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf13b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7e00700 1 --2- 172.21.15.81:0/1327427692 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7faea8066730 0x7faea8068bf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faec0001c70 tx=0x7faec0001c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7e00700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 -- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 msgr2=0xf0ef5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0ef5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 -- 172.21.15.81:0/479887990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 msgr2=0xf119a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf119a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 -- 172.21.15.81:0/479887990 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xeecea00 con 0xf1194a0 2024-09-13T18:53:13.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7400700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf119a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec7e00700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:13.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faec6a00700 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf13b340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeb40823d0 tx=0x7faeb4055580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c558692c496345a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faeb3e00700 1 -- 172.21.15.81:0/479887990 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4054e80 con 0xf1194a0 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faeb3e00700 1 -- 172.21.15.81:0/479887990 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4055e90 con 0xf1194a0 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faeb3e00700 1 -- 172.21.15.81:0/479887990 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4058cb0 con 0xf1194a0 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 -- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 msgr2=0xf13b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf13b340 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faeb40823d0 tx=0x7faeb4055580 comp rx=0 tx=0).stop 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 -- 172.21.15.81:0/479887990 shutdown_connections 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf13b340 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 --2- 172.21.15.81:0/479887990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf119a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 -- 172.21.15.81:0/479887990 >> 172.21.15.81:0/479887990 conn(0xee83570 msgr2=0xf11c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 -- 172.21.15.81:0/479887990 shutdown_connections 2024-09-13T18:53:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.555+0000 7faed1c00740 1 -- 172.21.15.81:0/479887990 wait complete. 2024-09-13T18:53:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 -- start start 2024-09-13T18:53:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 Processor -- start 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf0f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf0f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf019760 con 0xf13af60 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf01f5e0 con 0xf13b880 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xef07b40 con 0xf1194a0 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 10 client.0 _ll_register_callbacks cb 0xf020b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf0f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf0f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49080/0 (socket says 172.21.15.81:49080) 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 -- 172.21.15.81:0/1172250257 learned_addr learned my addr 172.21.15.81:0/1172250257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec7400700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf0f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec7e00700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 -- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 msgr2=0xf0f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf0f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 -- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 msgr2=0xf0f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 -- 172.21.15.81:0/1172250257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec8071060 con 0xf13af60 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faec6a00700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf0f4ab0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7faeb40554e0 tx=0x7faeb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e389dde752740f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faeb0c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:13.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faeb0c00700 1 -- 172.21.15.81:0/1172250257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4082170 con 0xf13af60 2024-09-13T18:53:13.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faeb0c00700 1 -- 172.21.15.81:0/1172250257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faeb4058cb0 con 0xf13af60 2024-09-13T18:53:13.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xee90280 con 0xf13af60 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faeb0c00700 1 -- 172.21.15.81:0/1172250257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeb4054e80 con 0xf13af60 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 10 client.7881 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.559+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x7faec81f6350 con 0xf13af60 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faeb0c00700 1 -- 172.21.15.81:0/1172250257 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xee90280 con 0xf13af60 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faeb0c00700 1 -- 172.21.15.81:0/1172250257 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7faeb405cde0 con 0xf13af60 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 10 client.7881 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 10 client.7881 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 20 client.7881 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf1412d0 0xf0ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 4 client.7881 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xeeda500 con 0xf1412d0 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faec7400700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf1412d0 0xf0ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faeb0c00700 10 client.7881 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faec7400700 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf1412d0 0xf0ef5f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82fe229369298966 server_cookie=4867721c5d4ca0f5 in_seq=0 out_seq=0 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faeb0c00700 1 -- 172.21.15.81:0/1172250257 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xeeda500 con 0xf1412d0 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faeb0c00700 10 client.7881 handle_command_reply: tid=0 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 client.7881 shutdown 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 msgr2=0xf0f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf0f4ab0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7faeb40554e0 tx=0x7faeb4000bc0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 shutdown_connections 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf1412d0 0xf0ef5f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf13b880 0xf0f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13af60 0xf0f4ab0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faeb0c00700 0 client.7881 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 --2- 172.21.15.81:0/1172250257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1194a0 0xf0f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 >> 172.21.15.81:0/1172250257 conn(0xee83570 msgr2=0xf114780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 shutdown_connections 2024-09-13T18:53:13.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 1 -- 172.21.15.81:0/1172250257 wait complete. 2024-09-13T18:53:13.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.563+0000 7faed1c00740 20 client.7881 trim_cache size 0 max 16384 2024-09-13T18:53:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 Processor -- start 2024-09-13T18:53:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 -- start start 2024-09-13T18:53:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf196f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf197450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf018730 con 0xf13b880 2024-09-13T18:53:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf00b410 con 0xf1194a0 2024-09-13T18:53:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.583+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf026520 con 0xf13af60 2024-09-13T18:53:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:56582/0 (socket says 172.21.15.81:56582) 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 -- 172.21.15.81:0/1288626709 learned_addr learned my addr 172.21.15.81:0/1288626709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec7400700 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 -- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 msgr2=0xf196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 -- 172.21.15.81:0/1288626709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 msgr2=0xf149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 -- 172.21.15.81:0/1288626709 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf022250 con 0xf13af60 2024-09-13T18:53:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faec6a00700 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf197450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e7e0 tx=0x7faeb406e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5886125e3228caa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faebcc00700 1 -- 172.21.15.81:0/1288626709 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4082170 con 0xf13af60 2024-09-13T18:53:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faebcc00700 1 -- 172.21.15.81:0/1288626709 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4009520 con 0xf13af60 2024-09-13T18:53:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faebcc00700 1 -- 172.21.15.81:0/1288626709 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4059e10 con 0xf13af60 2024-09-13T18:53:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 -- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 msgr2=0xf197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf197450 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e7e0 tx=0x7faeb406e070 comp rx=0 tx=0).stop 2024-09-13T18:53:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 -- 172.21.15.81:0/1288626709 shutdown_connections 2024-09-13T18:53:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf197450 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 --2- 172.21.15.81:0/1288626709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 -- 172.21.15.81:0/1288626709 >> 172.21.15.81:0/1288626709 conn(0xee83570 msgr2=0xf1184a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 -- 172.21.15.81:0/1288626709 shutdown_connections 2024-09-13T18:53:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 -- 172.21.15.81:0/1288626709 wait complete. 2024-09-13T18:53:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.587+0000 7faed1c00740 1 -- start start 2024-09-13T18:53:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 Processor -- start 2024-09-13T18:53:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf15a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xf12ffb0 con 0xf13b880 2024-09-13T18:53:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xeffa4a0 con 0xf1194a0 2024-09-13T18:53:13.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf026330 con 0xf13af60 2024-09-13T18:53:13.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 10 client.0 _ll_register_callbacks cb 0xf001cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:13.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf15a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49106/0 (socket says 172.21.15.81:49106) 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 -- 172.21.15.81:0/2430650164 learned_addr learned my addr 172.21.15.81:0/2430650164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec6a00700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7400700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 -- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 msgr2=0xf1a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf1a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 -- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 msgr2=0xf1a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf1a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 -- 172.21.15.81:0/2430650164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec81f6350 con 0xf13b880 2024-09-13T18:53:13.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faec7e00700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf15a760 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7faec0013e80 tx=0x7faec0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6850628b49e3fcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faeb0c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faeb0c00700 1 -- 172.21.15.81:0/2430650164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0021a20 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faeb4055e90 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faeb0c00700 1 -- 172.21.15.81:0/2430650164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faec001b040 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faeb0c00700 1 -- 172.21.15.81:0/2430650164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7faec0021b80 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 10 client.7887 fetch_fsmap learned FSMap version 77 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.591+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xf008480 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faeb0c00700 1 -- 172.21.15.81:0/2430650164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4055e90 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faeb0c00700 1 -- 172.21.15.81:0/2430650164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 77) v1 ==== 3150+0+0 (secure 0 0 0) 0x7faec0021ce0 con 0xf13b880 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 10 client.7887 fetch_fsmap finished waiting for FSMap version 77 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 10 client.7887 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 20 client.7887 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf15aca0 0xf15b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:13.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 4 client.7887 mds_command: new command op to 7467 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-13T18:53:13.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 --> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0xeeff280 con 0xf15aca0 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faec7400700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf15aca0 0xf15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faeb0c00700 10 client.7887 ms_handle_connect on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faec7400700 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf15aca0 0xf15b080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8fefb38ec42e7386 server_cookie=ea835ea8836d58e5 in_seq=0 out_seq=0 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faeb0c00700 1 -- 172.21.15.81:0/2430650164 <== mds.1 v2:172.21.15.81:6834/3178710454 1 ==== command_reply(tid 0: -18 Not rank 0) v1 ==== 18+0+0 (crc 0 0 0) 0xeeff280 con 0xf15aca0 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faeb0c00700 10 client.7887 handle_command_reply: tid=0 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 client.7887 shutdown 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 msgr2=0xf15a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf15a760 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7faec0013e80 tx=0x7faec0012000 comp rx=0 tx=0).stop 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 shutdown_connections 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:6834/3178710454,v1:172.21.15.81:6835/3178710454] conn(0xf15aca0 0xf15b080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xf13b880 0xf15a760 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf13af60 0xf1a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 --2- 172.21.15.81:0/2430650164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1194a0 0xf1a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faeb0c00700 0 client.7887 ms_handle_reset on v2:172.21.15.81:6834/3178710454 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 >> 172.21.15.81:0/2430650164 conn(0xee83570 msgr2=0xf114710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 shutdown_connections 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 1 -- 172.21.15.81:0/2430650164 wait complete. 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:13.595+0000 7faed1c00740 20 client.7887 trim_cache size 0 max 16384 2024-09-13T18:53:13.606 INFO:teuthology.orchestra.run.smithi081.stderr:Error EXDEV: Not rank 0 2024-09-13T18:53:13.616 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-13T18:53:13.616 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:53:13.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:53:13.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:53:13.750 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:53:13.750 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:53:13.750 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:13.767 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:53:13.767 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:13.832 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.047+0000 7f792da00700 1 Processor -- start 2024-09-13T18:53:14.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.047+0000 7f792da00700 1 -- start start 2024-09-13T18:53:14.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.047+0000 7f792da00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79281610b0 0x7f79280719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.047+0000 7f792da00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f792806aaa0 0x7f792806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.047+0000 7f792da00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79280b2670 0x7f79280b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792da00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7928070b30 con 0x7f79280b2670 2024-09-13T18:53:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792da00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280b3040 con 0x7f79281610b0 2024-09-13T18:53:14.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792da00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280b3560 con 0x7f792806aaa0 2024-09-13T18:53:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79280b2670 0x7f79280b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79280b2670 0x7f79280b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49114/0 (socket says 172.21.15.81:49114) 2024-09-13T18:53:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 -- 172.21.15.81:0/4024424363 learned_addr learned my addr 172.21.15.81:0/4024424363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f7927e00700 1 --2- 172.21.15.81:0/4024424363 >> v2:172.21.15.178:3300/0 conn(0x7f79281610b0 0x7f79280719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f791f400700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f792806aaa0 0x7f792806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 -- 172.21.15.81:0/4024424363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f792806aaa0 msgr2=0x7f792806aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f792806aaa0 0x7f792806aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 -- 172.21.15.81:0/4024424363 >> v2:172.21.15.178:3300/0 conn(0x7f79281610b0 msgr2=0x7f79280719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 --2- 172.21.15.81:0/4024424363 >> v2:172.21.15.178:3300/0 conn(0x7f79281610b0 0x7f79280719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 -- 172.21.15.81:0/4024424363 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792806b420 con 0x7f79280b2670 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f791f400700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f792806aaa0 0x7f792806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:14.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f7927e00700 1 --2- 172.21.15.81:0/4024424363 >> v2:172.21.15.178:3300/0 conn(0x7f79281610b0 0x7f79280719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f792d000700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79280b2670 0x7f79280b2b00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f792806b660 tx=0x7f7920009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce88c2b3af4e182 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f7927400700 1 -- 172.21.15.81:0/4024424363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920011830 con 0x7f79280b2670 2024-09-13T18:53:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f7927400700 1 -- 172.21.15.81:0/4024424363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7920011990 con 0x7f79280b2670 2024-09-13T18:53:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.051+0000 7f7927400700 1 -- 172.21.15.81:0/4024424363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7920011d20 con 0x7f79280b2670 2024-09-13T18:53:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 -- 172.21.15.81:0/4024424363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79280b2670 msgr2=0x7f79280b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79280b2670 0x7f79280b2b00 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f792806b660 tx=0x7f7920009bf0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 -- 172.21.15.81:0/4024424363 shutdown_connections 2024-09-13T18:53:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79280b2670 0x7f79280b2b00 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 --2- 172.21.15.81:0/4024424363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f792806aaa0 0x7f792806aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 --2- 172.21.15.81:0/4024424363 >> v2:172.21.15.178:3300/0 conn(0x7f79281610b0 0x7f79280719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 -- 172.21.15.81:0/4024424363 >> 172.21.15.81:0/4024424363 conn(0x7f79280b0c40 msgr2=0x7f792806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:14.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 -- 172.21.15.81:0/4024424363 shutdown_connections 2024-09-13T18:53:14.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 -- 172.21.15.81:0/4024424363 wait complete. 2024-09-13T18:53:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 Processor -- start 2024-09-13T18:53:14.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.055+0000 7f792da00700 1 -- start start 2024-09-13T18:53:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 0x7f7928159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79280b2670 0x7f7928164360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79281610b0 0x7f79281f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792815a290 con 0x7f792806aaa0 2024-09-13T18:53:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792815a570 con 0x7f79280b2670 2024-09-13T18:53:14.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792815a850 con 0x7f79281610b0 2024-09-13T18:53:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 0x7f7928159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 0x7f7928159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49118/0 (socket says 172.21.15.81:49118) 2024-09-13T18:53:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 -- 172.21.15.81:0/2978328958 learned_addr learned my addr 172.21.15.81:0/2978328958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f791f400700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79280b2670 0x7f7928164360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792d000700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79281610b0 0x7f79281f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 -- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79281610b0 msgr2=0x7f79281f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79281610b0 0x7f79281f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 -- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79280b2670 msgr2=0x7f7928164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79280b2670 0x7f7928164360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 -- 172.21.15.81:0/2978328958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100094b0 con 0x7f792806aaa0 2024-09-13T18:53:14.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7927e00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 0x7f7928159bb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f791800efc0 tx=0x7f791800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791800ce80 con 0x7f792806aaa0 2024-09-13T18:53:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791800f040 con 0x7f792806aaa0 2024-09-13T18:53:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7918009a70 con 0x7f792806aaa0 2024-09-13T18:53:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79180146a0 con 0x7f792806aaa0 2024-09-13T18:53:14.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.059+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7920009570 con 0x7f792806aaa0 2024-09-13T18:53:14.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.063+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f792804e700 con 0x7f792806aaa0 2024-09-13T18:53:14.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.063+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7918014800 con 0x7f792806aaa0 2024-09-13T18:53:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.067+0000 7f7924c00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.067+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7918084fe0 con 0x7f792806aaa0 2024-09-13T18:53:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.067+0000 7f791f400700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.067+0000 7f791f400700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7904066730 0x7f7904068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f79281fa0d0 tx=0x7f7910008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.071+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7918052180 con 0x7f792806aaa0 2024-09-13T18:53:14.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.255+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79280afb60 con 0x7f792806aaa0 2024-09-13T18:53:14.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.259+0000 7f7924c00700 1 -- 172.21.15.81:0/2978328958 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f79180557a0 con 0x7f792806aaa0 2024-09-13T18:53:14.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:14.267 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:40.994239+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:14.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7904066730 msgr2=0x7f7904068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7904066730 0x7f7904068bf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f79281fa0d0 tx=0x7f7910008040 comp rx=0 tx=0).stop 2024-09-13T18:53:14.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 msgr2=0x7f7928159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 0x7f7928159bb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f791800efc0 tx=0x7f791800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 shutdown_connections 2024-09-13T18:53:14.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7904066730 0x7f7904068bf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79281610b0 0x7f79281f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79280b2670 0x7f7928164360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 --2- 172.21.15.81:0/2978328958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f792806aaa0 0x7f7928159bb0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 >> 172.21.15.81:0/2978328958 conn(0x7f79280b0c40 msgr2=0x7f792806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 shutdown_connections 2024-09-13T18:53:14.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.263+0000 7f792da00700 1 -- 172.21.15.81:0/2978328958 wait complete. 2024-09-13T18:53:14.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:52:37.994343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:52:38.976827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:53:14.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:53:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.463+0000 7f7e82600700 1 Processor -- start 2024-09-13T18:53:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.463+0000 7f7e82600700 1 -- start start 2024-09-13T18:53:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.463+0000 7f7e82600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7c143b60 0x7f7e7c0d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.463+0000 7f7e82600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e7c0cf3b0 0x7f7e7c0cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.463+0000 7f7e82600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c0d0780 con 0x7f7e7c15e720 2024-09-13T18:53:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.463+0000 7f7e82600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c15f710 con 0x7f7e7c143b60 2024-09-13T18:53:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c0d19e0 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7c143b60 0x7f7e7c0d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7e7c143b60 0x7f7e7c0d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49126/0 (socket says 172.21.15.81:49126) 2024-09-13T18:53:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 -- 172.21.15.81:0/1748441476 learned_addr learned my addr 172.21.15.81:0/1748441476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7aa00700 1 --2- 172.21.15.81:0/1748441476 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c0cf3b0 0x7f7e7c0cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 -- 172.21.15.81:0/1748441476 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c0cf3b0 msgr2=0x7f7e7c0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 --2- 172.21.15.81:0/1748441476 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c0cf3b0 0x7f7e7c0cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 -- 172.21.15.81:0/1748441476 >> v1:172.21.15.178:6789/0 conn(0x7f7e7c15e720 legacy=0x7f7e7c15eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 -- 172.21.15.81:0/1748441476 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c143f40 con 0x7f7e7c143b60 2024-09-13T18:53:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7b400700 1 --2- 172.21.15.81:0/1748441476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c143b60 0x7f7e7c0d14a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009910 tx=0x7f7e6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1c2eb2e20bc843 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7a000700 1 -- 172.21.15.81:0/1748441476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011830 con 0x7f7e7c143b60 2024-09-13T18:53:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7a000700 1 -- 172.21.15.81:0/1748441476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c011990 con 0x7f7e7c143b60 2024-09-13T18:53:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e7a000700 1 -- 172.21.15.81:0/1748441476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011d40 con 0x7f7e7c143b60 2024-09-13T18:53:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 -- 172.21.15.81:0/1748441476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c143b60 msgr2=0x7f7e7c0d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 --2- 172.21.15.81:0/1748441476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c143b60 0x7f7e7c0d14a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009910 tx=0x7f7e6c009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 -- 172.21.15.81:0/1748441476 shutdown_connections 2024-09-13T18:53:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 --2- 172.21.15.81:0/1748441476 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c0cf3b0 0x7f7e7c0cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 --2- 172.21.15.81:0/1748441476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c143b60 0x7f7e7c0d14a0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 -- 172.21.15.81:0/1748441476 >> 172.21.15.81:0/1748441476 conn(0x7f7e7c06e660 msgr2=0x7f7e7c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 -- 172.21.15.81:0/1748441476 shutdown_connections 2024-09-13T18:53:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.467+0000 7f7e82600700 1 -- 172.21.15.81:0/1748441476 wait complete. 2024-09-13T18:53:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 Processor -- start 2024-09-13T18:53:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 -- start start 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 0x7f7e7c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c143b60 0x7f7e7c141870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c15e720 0x7f7e7c141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c13ada0 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c13a190 con 0x7f7e7c15e720 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e82600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c13a470 con 0x7f7e7c143b60 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 0x7f7e7c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 0x7f7e7c15d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49134/0 (socket says 172.21.15.81:49134) 2024-09-13T18:53:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 -- 172.21.15.81:0/2649275306 learned_addr learned my addr 172.21.15.81:0/2649275306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7aa00700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c143b60 0x7f7e7c141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 -- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c143b60 msgr2=0x7f7e7c141870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c143b60 0x7f7e7c141870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 -- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c15e720 msgr2=0x7f7e7c141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c15e720 0x7f7e7c141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 -- 172.21.15.81:0/2649275306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c009570 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7aa00700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c143b60 0x7f7e7c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e7b400700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 0x7f7e7c15d6a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000c00 tx=0x7f7e6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.471+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0036c0 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.475+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c01e070 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.475+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c13a750 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.475+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c003aa0 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.475+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c15dbe0 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.475+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c0cf820 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.475+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7e6c003c00 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.479+0000 7f7e73400700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e5c066730 0x7f7e5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.479+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7e6c085400 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.479+0000 7f7e7aa00700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e5c066730 0x7f7e5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.479+0000 7f7e7aa00700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e5c066730 0x7f7e5c068bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0ad2b0 tx=0x7f7e68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.483+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7e6c052660 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.667+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e7c0b5b50 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.667+0000 7f7e73400700 1 -- 172.21.15.81:0/2649275306 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e6c055c80 con 0x7f7e7c0cf3b0 2024-09-13T18:53:14.677 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:53:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e5c066730 msgr2=0x7f7e5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e5c066730 0x7f7e5c068bf0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c0ad2b0 tx=0x7f7e68008040 comp rx=0 tx=0).stop 2024-09-13T18:53:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 msgr2=0x7f7e7c15d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 0x7f7e7c15d6a0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000c00 tx=0x7f7e6c004770 comp rx=0 tx=0).stop 2024-09-13T18:53:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 shutdown_connections 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7e5c066730 0x7f7e5c068bf0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c15e720 0x7f7e7c141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c143b60 0x7f7e7c141870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 --2- 172.21.15.81:0/2649275306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e7c0cf3b0 0x7f7e7c15d6a0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 >> 172.21.15.81:0/2649275306 conn(0x7f7e7c06e660 msgr2=0x7f7e7c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 shutdown_connections 2024-09-13T18:53:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.671+0000 7f7e82600700 1 -- 172.21.15.81:0/2649275306 wait complete. 2024-09-13T18:53:14.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:53:14.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.867+0000 7f86f3e00700 1 Processor -- start 2024-09-13T18:53:14.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.871+0000 7f86f3e00700 1 -- start start 2024-09-13T18:53:14.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.871+0000 7f86f3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f40b1980 0x7f86f40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.871+0000 7f86f3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86f406c960 0x7f86f406cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.871+0000 7f86f3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f4071f70 con 0x7f86f41464c0 2024-09-13T18:53:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.871+0000 7f86f3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f406d330 con 0x7f86f406c960 2024-09-13T18:53:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.871+0000 7f86f3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f4070da0 con 0x7f86f40b1980 2024-09-13T18:53:14.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86f406c960 0x7f86f406cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86f406c960 0x7f86f406cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:43142/0 (socket says 172.21.15.81:43142) 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f2a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f86f41464c0 0x7f86f4071860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:52998/0 (socket says 172.21.15.81:52998) 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 -- 172.21.15.81:0/1893253154 learned_addr learned my addr 172.21.15.81:0/1893253154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86ebe00700 1 --2- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f40b1980 0x7f86f40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 -- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f40b1980 msgr2=0x7f86f40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 --2- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f40b1980 0x7f86f40b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 -- 172.21.15.81:0/1893253154 >> v1:172.21.15.178:6789/0 conn(0x7f86f41464c0 legacy=0x7f86f4071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 -- 172.21.15.81:0/1893253154 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40b2440 con 0x7f86f406c960 2024-09-13T18:53:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3400700 1 --2- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f406c960 0x7f86f406cdf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009e50 tx=0x7f86ec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1c37330667cdac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f2000700 1 -- 172.21.15.81:0/1893253154 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00e070 con 0x7f86f406c960 2024-09-13T18:53:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f2000700 1 -- 172.21.15.81:0/1893253154 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00b910 con 0x7f86f406c960 2024-09-13T18:53:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f2000700 1 -- 172.21.15.81:0/1893253154 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec00bcc0 con 0x7f86f406c960 2024-09-13T18:53:14.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3e00700 1 -- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f406c960 msgr2=0x7f86f406cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f406c960 0x7f86f406cdf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009e50 tx=0x7f86ec00b330 comp rx=0 tx=0).stop 2024-09-13T18:53:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3e00700 1 -- 172.21.15.81:0/1893253154 shutdown_connections 2024-09-13T18:53:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f406c960 0x7f86f406cdf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1893253154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f40b1980 0x7f86f40b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.875+0000 7f86f3e00700 1 -- 172.21.15.81:0/1893253154 >> 172.21.15.81:0/1893253154 conn(0x7f86f406a390 msgr2=0x7f86f406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:14.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.879+0000 7f86f3e00700 1 -- 172.21.15.81:0/1893253154 shutdown_connections 2024-09-13T18:53:14.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.879+0000 7f86f3e00700 1 -- 172.21.15.81:0/1893253154 wait complete. 2024-09-13T18:53:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.879+0000 7f86f3e00700 1 Processor -- start 2024-09-13T18:53:14.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.879+0000 7f86f3e00700 1 -- start start 2024-09-13T18:53:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f406c960 0x7f86f4145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 0x7f86f413ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f41464c0 0x7f86f415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41f2730 con 0x7f86f40b1980 2024-09-13T18:53:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41440c0 con 0x7f86f41464c0 2024-09-13T18:53:14.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f413b400 con 0x7f86f406c960 2024-09-13T18:53:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 0x7f86f413ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 0x7f86f413ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49150/0 (socket says 172.21.15.81:49150) 2024-09-13T18:53:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 -- 172.21.15.81:0/1817755479 learned_addr learned my addr 172.21.15.81:0/1817755479 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f2a00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f406c960 0x7f86f4145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86f3400700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f41464c0 0x7f86f415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 -- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f406c960 msgr2=0x7f86f4145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f406c960 0x7f86f4145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 -- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f41464c0 msgr2=0x7f86f415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f41464c0 0x7f86f415f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 -- 172.21.15.81:0/1817755479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009b30 con 0x7f86f40b1980 2024-09-13T18:53:14.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86ebe00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 0x7f86f413ad70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00e840 tx=0x7f86dc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0095a0 con 0x7f86f40b1980 2024-09-13T18:53:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc013680 con 0x7f86f40b1980 2024-09-13T18:53:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.883+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc0139f0 con 0x7f86f40b1980 2024-09-13T18:53:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.887+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f413b6e0 con 0x7f86f40b1980 2024-09-13T18:53:14.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.887+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f413bca0 con 0x7f86f40b1980 2024-09-13T18:53:14.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.887+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f406cdf0 con 0x7f86f40b1980 2024-09-13T18:53:14.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.887+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86dc013b50 con 0x7f86f40b1980 2024-09-13T18:53:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.891+0000 7f86eaa00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f86d0066730 0x7f86d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:14.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.891+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f86dc084120 con 0x7f86f40b1980 2024-09-13T18:53:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.891+0000 7f86f2a00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f86d0066730 0x7f86d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.891+0000 7f86f2a00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f86d0066730 0x7f86d0068bf0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f86e4000f60 tx=0x7f86e4007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:14.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:14.899+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f86dc0512b0 con 0x7f86f40b1980 2024-09-13T18:53:15.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.075+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86f4071030 con 0x7f86f40b1980 2024-09-13T18:53:15.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.075+0000 7f86eaa00700 1 -- 172.21.15.81:0/1817755479 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86dc0548d0 con 0x7f86f40b1980 2024-09-13T18:53:15.084 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f86d0066730 msgr2=0x7f86d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f86d0066730 0x7f86d0068bf0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f86e4000f60 tx=0x7f86e4007ef0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 msgr2=0x7f86f413ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 0x7f86f413ad70 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00e840 tx=0x7f86dc00eb50 comp rx=0 tx=0).stop 2024-09-13T18:53:15.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 shutdown_connections 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f86d0066730 0x7f86d0068bf0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86f41464c0 0x7f86f415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86f40b1980 0x7f86f413ad70 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 --2- 172.21.15.81:0/1817755479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86f406c960 0x7f86f4145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 >> 172.21.15.81:0/1817755479 conn(0x7f86f406a390 msgr2=0x7f86f40cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 shutdown_connections 2024-09-13T18:53:15.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.079+0000 7f86f3e00700 1 -- 172.21.15.81:0/1817755479 wait complete. 2024-09-13T18:53:15.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:53:15.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 Processor -- start 2024-09-13T18:53:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 -- start start 2024-09-13T18:53:15.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69801590a0 0x7f698015a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f6980070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698015a540 con 0x7f69800ccff0 2024-09-13T18:53:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800cd890 con 0x7f69801590a0 2024-09-13T18:53:15.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f6985400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6980159480 con 0x7f69800cd460 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.275+0000 7f697fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69801590a0 0x7f698015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f69801590a0 0x7f698015a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49164/0 (socket says 172.21.15.81:49164) 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 -- 172.21.15.81:0/4107309372 learned_addr learned my addr 172.21.15.81:0/4107309372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6984a00700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f6980070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 -- 172.21.15.81:0/4107309372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 msgr2=0x7f6980070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f6980070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 -- 172.21.15.81:0/4107309372 >> v1:172.21.15.178:6789/0 conn(0x7f69800ccff0 legacy=0x7f69800b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 -- 172.21.15.81:0/4107309372 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698006d560 con 0x7f69801590a0 2024-09-13T18:53:15.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6984a00700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f6980070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697fe00700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f698015a000 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6970009910 tx=0x7f6970009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=219ea5996699cf02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:15.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697ea00700 1 -- 172.21.15.81:0/4107309372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000ba60 con 0x7f69801590a0 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697ea00700 1 -- 172.21.15.81:0/4107309372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000bbc0 con 0x7f69801590a0 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f697ea00700 1 -- 172.21.15.81:0/4107309372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970009e60 con 0x7f69801590a0 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 -- 172.21.15.81:0/4107309372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 msgr2=0x7f698015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f698015a000 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6970009910 tx=0x7f6970009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 -- 172.21.15.81:0/4107309372 shutdown_connections 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f6980070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 --2- 172.21.15.81:0/4107309372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f698015a000 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 -- 172.21.15.81:0/4107309372 >> 172.21.15.81:0/4107309372 conn(0x7f698006a390 msgr2=0x7f698006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 -- 172.21.15.81:0/4107309372 shutdown_connections 2024-09-13T18:53:15.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.279+0000 7f6985400700 1 -- 172.21.15.81:0/4107309372 wait complete. 2024-09-13T18:53:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 Processor -- start 2024-09-13T18:53:15.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 -- start start 2024-09-13T18:53:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69800ccff0 0x7f69800c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f69801f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f69800711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801f3720 con 0x7f69801590a0 2024-09-13T18:53:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69801f6be0 con 0x7f69800ccff0 2024-09-13T18:53:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69801f6060 con 0x7f69800cd460 2024-09-13T18:53:15.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6984a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f69800711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6984a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f69800711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49176/0 (socket says 172.21.15.81:49176) 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69800ccff0 0x7f69800c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6984a00700 1 -- 172.21.15.81:0/3851030616 learned_addr learned my addr 172.21.15.81:0/3851030616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697f400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f69801f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 -- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 msgr2=0x7f69801f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f69801f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 -- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 msgr2=0x7f69800711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f69800711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 -- 172.21.15.81:0/3851030616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009570 con 0x7f69800ccff0 2024-09-13T18:53:15.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6984a00700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f69800711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f697fe00700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69800ccff0 0x7f69800c9590 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6970016000 tx=0x7f6970004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970004590 con 0x7f69800ccff0 2024-09-13T18:53:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697001e070 con 0x7f69800ccff0 2024-09-13T18:53:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69801f6340 con 0x7f69800ccff0 2024-09-13T18:53:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.283+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970003900 con 0x7f69800ccff0 2024-09-13T18:53:15.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.287+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69801f6900 con 0x7f69800ccff0 2024-09-13T18:53:15.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.287+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69800c7d00 con 0x7f69800ccff0 2024-09-13T18:53:15.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.287+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6970003a60 con 0x7f69800ccff0 2024-09-13T18:53:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.291+0000 7f6977e00700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f695c066730 0x7f695c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.291+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6970020070 con 0x7f69800ccff0 2024-09-13T18:53:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.291+0000 7f697f400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f695c066730 0x7f695c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.291+0000 7f697f400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f695c066730 0x7f695c068bf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f69801560d0 tx=0x7f6968009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.299+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69800c7d00 con 0x7f69800ccff0 2024-09-13T18:53:15.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.479+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69800c7d00 con 0x7f69800ccff0 2024-09-13T18:53:15.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.479+0000 7f6977e00700 1 -- 172.21.15.81:0/3851030616 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6970015020 con 0x7f69800ccff0 2024-09-13T18:53:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:53:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f695c066730 msgr2=0x7f695c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f695c066730 0x7f695c068bf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f69801560d0 tx=0x7f6968009040 comp rx=0 tx=0).stop 2024-09-13T18:53:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69800ccff0 msgr2=0x7f69800c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69800ccff0 0x7f69800c9590 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6970016000 tx=0x7f6970004770 comp rx=0 tx=0).stop 2024-09-13T18:53:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 shutdown_connections 2024-09-13T18:53:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f695c066730 0x7f695c068bf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69801590a0 0x7f69800711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69800cd460 0x7f69801f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 --2- 172.21.15.81:0/3851030616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69800ccff0 0x7f69800c9590 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 >> 172.21.15.81:0/3851030616 conn(0x7f698006a390 msgr2=0x7f698006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 shutdown_connections 2024-09-13T18:53:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.483+0000 7f6985400700 1 -- 172.21.15.81:0/3851030616 wait complete. 2024-09-13T18:53:15.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:53:15.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.675+0000 7f9da6e00700 1 Processor -- start 2024-09-13T18:53:15.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.675+0000 7f9da6e00700 1 -- start start 2024-09-13T18:53:15.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9da00cd430 0x7f9da00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da00d1800 con 0x7f9da015e070 2024-09-13T18:53:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da015e450 con 0x7f9da00cd430 2024-09-13T18:53:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00b2e90 con 0x7f9da00b2a80 2024-09-13T18:53:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9da00cd430 0x7f9da00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9da00cd430 0x7f9da00b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49184/0 (socket says 172.21.15.81:49184) 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da6400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:56674/0 (socket says 172.21.15.81:56674) 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9da015e070 0x7f9da00d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:53014/0 (socket says 172.21.15.81:53014) 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 -- 172.21.15.81:0/1005666504 learned_addr learned my addr 172.21.15.81:0/1005666504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 -- 172.21.15.81:0/1005666504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 msgr2=0x7f9da00b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 --2- 172.21.15.81:0/1005666504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 -- 172.21.15.81:0/1005666504 >> v1:172.21.15.178:6789/0 conn(0x7f9da015e070 legacy=0x7f9da00d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9d9fe00700 1 -- 172.21.15.81:0/1005666504 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853858508 0 0) 0x7f9da00d1800 con 0x7f9da015e070 2024-09-13T18:53:15.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 -- 172.21.15.81:0/1005666504 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00d0050 con 0x7f9da00cd430 2024-09-13T18:53:15.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9da5000700 1 --2- 172.21.15.81:0/1005666504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00cd430 0x7f9da00b2540 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009910 tx=0x7f9d8c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e277ffdf5ea2cde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:15.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9d9fe00700 1 -- 172.21.15.81:0/1005666504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c011830 con 0x7f9da00cd430 2024-09-13T18:53:15.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9d9fe00700 1 -- 172.21.15.81:0/1005666504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c011990 con 0x7f9da00cd430 2024-09-13T18:53:15.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.679+0000 7f9d9fe00700 1 -- 172.21.15.81:0/1005666504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c011d40 con 0x7f9da00cd430 2024-09-13T18:53:15.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 -- 172.21.15.81:0/1005666504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00cd430 msgr2=0x7f9da00b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1005666504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00cd430 0x7f9da00b2540 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009910 tx=0x7f9d8c009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 -- 172.21.15.81:0/1005666504 shutdown_connections 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1005666504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1005666504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da00cd430 0x7f9da00b2540 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 -- 172.21.15.81:0/1005666504 >> 172.21.15.81:0/1005666504 conn(0x7f9da0071f00 msgr2=0x7f9da00722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 -- 172.21.15.81:0/1005666504 shutdown_connections 2024-09-13T18:53:15.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 -- 172.21.15.81:0/1005666504 wait complete. 2024-09-13T18:53:15.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 Processor -- start 2024-09-13T18:53:15.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.683+0000 7f9da6e00700 1 -- start start 2024-09-13T18:53:15.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9da00cd430 0x7f9da015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 0x7f9da01f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c59b0 con 0x7f9da015e070 2024-09-13T18:53:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da015a5b0 con 0x7f9da00cd430 2024-09-13T18:53:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c5610 con 0x7f9da00b2a80 2024-09-13T18:53:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 0x7f9da01f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 0x7f9da01f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49188/0 (socket says 172.21.15.81:49188) 2024-09-13T18:53:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 -- 172.21.15.81:0/1092761455 learned_addr learned my addr 172.21.15.81:0/1092761455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da5000700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9da00cd430 0x7f9da015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da5a00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 -- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 msgr2=0x7f9da00af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00af1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 -- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9da00cd430 msgr2=0x7f9da015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9da00cd430 0x7f9da015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 -- 172.21.15.81:0/1092761455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d8c009570 con 0x7f9da015e070 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6400700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 0x7f9da01f2370 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e7f0 tx=0x7f9d9800eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980095c0 con 0x7f9da015e070 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d98013680 con 0x7f9da015e070 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da01f2cb0 con 0x7f9da015e070 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98013a10 con 0x7f9da015e070 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da01f3270 con 0x7f9da015e070 2024-09-13T18:53:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.687+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da00c5af0 con 0x7f9da015e070 2024-09-13T18:53:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.691+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d98013b70 con 0x7f9da015e070 2024-09-13T18:53:15.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.691+0000 7f9d9d600700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d80066730 0x7f9d80068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:15.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.691+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d980841a0 con 0x7f9da015e070 2024-09-13T18:53:15.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.691+0000 7f9da5a00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d80066730 0x7f9d80068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:15.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.691+0000 7f9da5a00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d80066730 0x7f9d80068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9d940012e0 tx=0x7f9d940018c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:15.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.699+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9da00c5af0 con 0x7f9da015e070 2024-09-13T18:53:15.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.891+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9da00c5af0 con 0x7f9da015e070 2024-09-13T18:53:15.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.895+0000 7f9d9d600700 1 -- 172.21.15.81:0/1092761455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9da00c5af0 con 0x7f9da015e070 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d80066730 msgr2=0x7f9d80068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d80066730 0x7f9d80068bf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9d940012e0 tx=0x7f9d940018c0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 msgr2=0x7f9da01f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 0x7f9da01f2370 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800e7f0 tx=0x7f9d9800eb00 comp rx=0 tx=0).stop 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 shutdown_connections 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d80066730 0x7f9d80068bf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9da015e070 0x7f9da01f2370 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9da00cd430 0x7f9da015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 --2- 172.21.15.81:0/1092761455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9da00b2a80 0x7f9da00af1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 >> 172.21.15.81:0/1092761455 conn(0x7f9da0071f00 msgr2=0x7f9da00ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 shutdown_connections 2024-09-13T18:53:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:15.899+0000 7f9da6e00700 1 -- 172.21.15.81:0/1092761455 wait complete. 2024-09-13T18:53:15.911 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:53:15.930 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:53:15.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:15.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:53:15.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:53:15.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:15.973 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:53:16.031 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:53:16.031 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:16.051 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:53:16.051 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:53:16.051 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:16.090 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:53:16.091 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:53:16.091 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:16.110 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:53:16.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:16.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.295+0000 7f309fe00700 1 Processor -- start 2024-09-13T18:53:16.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.295+0000 7f309fe00700 1 -- start start 2024-09-13T18:53:16.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f30a00cb020 0x7f30a00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30a006aaa0 0x7f30a006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a006b430 con 0x7f30a015c2a0 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00b2ad0 con 0x7f30a006aaa0 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a015b960 con 0x7f30a00cb020 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f30a006aaa0 0x7f30a006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309e000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f30a015c2a0 0x7f30a015b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59798/0 (socket says 172.21.15.81:59798) 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309e000700 1 -- 172.21.15.81:0/1176940331 learned_addr learned my addr 172.21.15.81:0/1176940331 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:16.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309ea00700 1 --2- 172.21.15.81:0/1176940331 >> v2:172.21.15.178:3300/0 conn(0x7f30a00cb020 0x7f30a00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309f400700 1 -- 172.21.15.81:0/1176940331 >> v2:172.21.15.178:3300/0 conn(0x7f30a00cb020 msgr2=0x7f30a00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309f400700 1 --2- 172.21.15.81:0/1176940331 >> v2:172.21.15.178:3300/0 conn(0x7f30a00cb020 0x7f30a00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309f400700 1 -- 172.21.15.81:0/1176940331 >> v1:172.21.15.81:6789/0 conn(0x7f30a015c2a0 legacy=0x7f30a015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309f400700 1 -- 172.21.15.81:0/1176940331 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a015bc40 con 0x7f30a006aaa0 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309ea00700 1 --2- 172.21.15.81:0/1176940331 >> v2:172.21.15.178:3300/0 conn(0x7f30a00cb020 0x7f30a00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309d600700 1 -- 172.21.15.81:0/1176940331 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607502925 0 0) 0x7f308c001110 con 0x7f30a015c2a0 2024-09-13T18:53:16.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.299+0000 7f309f400700 1 --2- 172.21.15.81:0/1176940331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a006aaa0 0x7f30a006aef0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f30a006b660 tx=0x7f309800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd277e0ca2ee8a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:16.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309d600700 1 -- 172.21.15.81:0/1176940331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800e070 con 0x7f30a006aaa0 2024-09-13T18:53:16.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309d600700 1 -- 172.21.15.81:0/1176940331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800bbd0 con 0x7f30a006aaa0 2024-09-13T18:53:16.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309d600700 1 -- 172.21.15.81:0/1176940331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098012430 con 0x7f30a006aaa0 2024-09-13T18:53:16.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 -- 172.21.15.81:0/1176940331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a006aaa0 msgr2=0x7f30a006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 --2- 172.21.15.81:0/1176940331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a006aaa0 0x7f30a006aef0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f30a006b660 tx=0x7f309800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:16.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 -- 172.21.15.81:0/1176940331 shutdown_connections 2024-09-13T18:53:16.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 --2- 172.21.15.81:0/1176940331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a006aaa0 0x7f30a006aef0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 --2- 172.21.15.81:0/1176940331 >> v2:172.21.15.178:3300/0 conn(0x7f30a00cb020 0x7f30a00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 -- 172.21.15.81:0/1176940331 >> 172.21.15.81:0/1176940331 conn(0x7f30a00b0c40 msgr2=0x7f30a006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:16.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 -- 172.21.15.81:0/1176940331 shutdown_connections 2024-09-13T18:53:16.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 -- 172.21.15.81:0/1176940331 wait complete. 2024-09-13T18:53:16.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 Processor -- start 2024-09-13T18:53:16.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.303+0000 7f309fe00700 1 -- start start 2024-09-13T18:53:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a006aaa0 0x7f30a00c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 0x7f30a01f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a015c2a0 0x7f30a00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c9ea0 con 0x7f30a00cb020 2024-09-13T18:53:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c7dc0 con 0x7f30a006aaa0 2024-09-13T18:53:16.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c80a0 con 0x7f30a015c2a0 2024-09-13T18:53:16.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 0x7f30a01f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 0x7f30a01f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49208/0 (socket says 172.21.15.81:49208) 2024-09-13T18:53:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 -- 172.21.15.81:0/1219051859 learned_addr learned my addr 172.21.15.81:0/1219051859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309ea00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a006aaa0 0x7f30a00c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309f400700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a015c2a0 0x7f30a00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 -- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a015c2a0 msgr2=0x7f30a00c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a015c2a0 0x7f30a00c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 -- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a006aaa0 msgr2=0x7f30a00c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a006aaa0 0x7f30a00c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 -- 172.21.15.81:0/1219051859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3098009a70 con 0x7f30a00cb020 2024-09-13T18:53:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309f400700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a015c2a0 0x7f30a00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309e000700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 0x7f30a01f2c90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c4e0 tx=0x7f308c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:16.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c004ca0 con 0x7f30a00cb020 2024-09-13T18:53:16.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c004e20 con 0x7f30a00cb020 2024-09-13T18:53:16.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a00c8380 con 0x7f30a00cb020 2024-09-13T18:53:16.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c007310 con 0x7f30a00cb020 2024-09-13T18:53:16.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.307+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a01f31d0 con 0x7f30a00cb020 2024-09-13T18:53:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.311+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a00c88a0 con 0x7f30a00cb020 2024-09-13T18:53:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.311+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f308c007470 con 0x7f30a00cb020 2024-09-13T18:53:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.311+0000 7f3097400700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3080066730 0x7f3080068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.311+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f308c083e00 con 0x7f30a00cb020 2024-09-13T18:53:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.311+0000 7f309ea00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3080066730 0x7f3080068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.315+0000 7f309ea00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3080066730 0x7f3080068bf0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3090009950 tx=0x7f3090008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.319+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f30a00c88a0 con 0x7f30a00cb020 2024-09-13T18:53:16.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.539+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30a006b430 con 0x7f30a00cb020 2024-09-13T18:53:16.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f3097400700 1 -- 172.21.15.81:0/1219051859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f30a006b430 con 0x7f30a00cb020 2024-09-13T18:53:16.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:16.552 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:53:15.306260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:53:16.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3080066730 msgr2=0x7f3080068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3080066730 0x7f3080068bf0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3090009950 tx=0x7f3090008040 comp rx=0 tx=0).stop 2024-09-13T18:53:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 msgr2=0x7f30a01f2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 0x7f30a01f2c90 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f308c00c4e0 tx=0x7f308c00c8a0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 shutdown_connections 2024-09-13T18:53:16.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3080066730 0x7f3080068bf0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30a015c2a0 0x7f30a00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a00cb020 0x7f30a01f2c90 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.543+0000 7f309fe00700 1 --2- 172.21.15.81:0/1219051859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30a006aaa0 0x7f30a00c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.547+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 >> 172.21.15.81:0/1219051859 conn(0x7f30a00b0c40 msgr2=0x7f30a0159680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.547+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 shutdown_connections 2024-09-13T18:53:16.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.547+0000 7f309fe00700 1 -- 172.21.15.81:0/1219051859 wait complete. 2024-09-13T18:53:16.557 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 78 2024-09-13T18:53:16.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:16.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 Processor -- start 2024-09-13T18:53:16.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 -- start start 2024-09-13T18:53:16.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f406a5d0 0x7f57f4071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57f40cd610 0x7f57f406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f40ce140 con 0x7f57f40b19f0 2024-09-13T18:53:16.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f40b1e30 con 0x7f57f40cd610 2024-09-13T18:53:16.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40cde60 con 0x7f57f406a5d0 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57f40cd610 0x7f57f406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57f40cd610 0x7f57f406ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48508/0 (socket says 172.21.15.81:48508) 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 -- 172.21.15.81:0/1589857562 learned_addr learned my addr 172.21.15.81:0/1589857562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f1e00700 1 --2- 172.21.15.81:0/1589857562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f406a5d0 0x7f57f4071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 -- 172.21.15.81:0/1589857562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f406a5d0 msgr2=0x7f57f4071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 --2- 172.21.15.81:0/1589857562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f406a5d0 0x7f57f4071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 -- 172.21.15.81:0/1589857562 >> v1:172.21.15.178:6789/0 conn(0x7f57f40b19f0 legacy=0x7f57f406a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 -- 172.21.15.81:0/1589857562 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f406c3b0 con 0x7f57f40cd610 2024-09-13T18:53:16.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.739+0000 7f57f2800700 1 --2- 172.21.15.81:0/1589857562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f40cd610 0x7f57f406ce90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009e50 tx=0x7f57ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79830c74af433db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f0a00700 1 -- 172.21.15.81:0/1589857562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec00e070 con 0x7f57f40cd610 2024-09-13T18:53:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f0a00700 1 -- 172.21.15.81:0/1589857562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ec00b9c0 con 0x7f57f40cd610 2024-09-13T18:53:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f0a00700 1 -- 172.21.15.81:0/1589857562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec00bd70 con 0x7f57f40cd610 2024-09-13T18:53:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 -- 172.21.15.81:0/1589857562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f40cd610 msgr2=0x7f57f406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 --2- 172.21.15.81:0/1589857562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f40cd610 0x7f57f406ce90 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009e50 tx=0x7f57ec00b330 comp rx=0 tx=0).stop 2024-09-13T18:53:16.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 -- 172.21.15.81:0/1589857562 shutdown_connections 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 --2- 172.21.15.81:0/1589857562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f40cd610 0x7f57f406ce90 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 --2- 172.21.15.81:0/1589857562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f406a5d0 0x7f57f4071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 -- 172.21.15.81:0/1589857562 >> 172.21.15.81:0/1589857562 conn(0x7f57f40b08d0 msgr2=0x7f57f40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 -- 172.21.15.81:0/1589857562 shutdown_connections 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 -- 172.21.15.81:0/1589857562 wait complete. 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 Processor -- start 2024-09-13T18:53:16.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.743+0000 7f57f9200700 1 -- start start 2024-09-13T18:53:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 0x7f57f41f9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57f40b19f0 0x7f57f4140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f40cd610 0x7f57f4140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f41422f0 con 0x7f57f406a5d0 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4144ae0 con 0x7f57f40b19f0 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f4144d80 con 0x7f57f40cd610 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 0x7f57f41f9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 0x7f57f41f9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48512/0 (socket says 172.21.15.81:48512) 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 -- 172.21.15.81:0/241385869 learned_addr learned my addr 172.21.15.81:0/241385869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1400700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57f40b19f0 0x7f57f4140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f2800700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f40cd610 0x7f57f4140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 -- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f40cd610 msgr2=0x7f57f4140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f40cd610 0x7f57f4140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 -- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57f40b19f0 msgr2=0x7f57f4140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57f40b19f0 0x7f57f4140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 -- 172.21.15.81:0/241385869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec009b30 con 0x7f57f406a5d0 2024-09-13T18:53:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f2800700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f40cd610 0x7f57f4140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1400700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57f40b19f0 0x7f57f4140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f1e00700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 0x7f57f41f9ba0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e810 tx=0x7f57e400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4013610 con 0x7f57f406a5d0 2024-09-13T18:53:16.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e4013770 con 0x7f57f406a5d0 2024-09-13T18:53:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f4145060 con 0x7f57f406a5d0 2024-09-13T18:53:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4013b20 con 0x7f57f406a5d0 2024-09-13T18:53:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.747+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f41fa0e0 con 0x7f57f406a5d0 2024-09-13T18:53:16.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.751+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f41489e0 con 0x7f57f406a5d0 2024-09-13T18:53:16.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.755+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f57e4013c80 con 0x7f57f406a5d0 2024-09-13T18:53:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.755+0000 7f57ea000700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f57d4066730 0x7f57d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:16.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.755+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f57e4084290 con 0x7f57f406a5d0 2024-09-13T18:53:16.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.755+0000 7f57f1400700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f57d4066730 0x7f57d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:16.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.755+0000 7f57f1400700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f57d4066730 0x7f57d4068bf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f57f4140360 tx=0x7f57e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:16.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.759+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f57e40514b0 con 0x7f57f406a5d0 2024-09-13T18:53:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.959+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57f41489e0 con 0x7f57f406a5d0 2024-09-13T18:53:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57ea000700 1 -- 172.21.15.81:0/241385869 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f57f41489e0 con 0x7f57f406a5d0 2024-09-13T18:53:16.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:40.994239+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f57d4066730 msgr2=0x7f57d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f57d4066730 0x7f57d4068bf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f57f4140360 tx=0x7f57e0009040 comp rx=0 tx=0).stop 2024-09-13T18:53:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 msgr2=0x7f57f41f9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 0x7f57f41f9ba0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f57e400e810 tx=0x7f57e400ebd0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 shutdown_connections 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f57d4066730 0x7f57d4068bf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57f40cd610 0x7f57f4140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57f40b19f0 0x7f57f4140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 --2- 172.21.15.81:0/241385869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57f406a5d0 0x7f57f41f9ba0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 >> 172.21.15.81:0/241385869 conn(0x7f57f40b08d0 msgr2=0x7f57f40b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 shutdown_connections 2024-09-13T18:53:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:16.963+0000 7f57f9200700 1 -- 172.21.15.81:0/241385869 wait complete. 2024-09-13T18:53:16.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:52:37.994343+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:52:38.976827+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:53:16.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:53:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.171+0000 7f2a8bc00700 1 Processor -- start 2024-09-13T18:53:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.171+0000 7f2a8bc00700 1 -- start start 2024-09-13T18:53:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a8bc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 0x7f2a840d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a8bc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a840d38e0 0x7f2a840ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a8bc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a840cdb00 con 0x7f2a841604a0 2024-09-13T18:53:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a8bc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a840cdde0 con 0x7f2a840d38e0 2024-09-13T18:53:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a8bc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840ce0c0 con 0x7f2a840cfee0 2024-09-13T18:53:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 0x7f2a840d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a89c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a840d38e0 0x7f2a840ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a89200700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2a841604a0 0x7f2a840cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:60646/0 (socket says 172.21.15.81:60646) 2024-09-13T18:53:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 0x7f2a840d16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39486/0 (socket says 172.21.15.81:39486) 2024-09-13T18:53:17.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a89200700 1 -- 172.21.15.81:0/2749898356 learned_addr learned my addr 172.21.15.81:0/2749898356 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 -- 172.21.15.81:0/2749898356 >> v2:172.21.15.178:3300/0 conn(0x7f2a840d38e0 msgr2=0x7f2a840ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 --2- 172.21.15.81:0/2749898356 >> v2:172.21.15.178:3300/0 conn(0x7f2a840d38e0 0x7f2a840ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 -- 172.21.15.81:0/2749898356 >> v1:172.21.15.178:6789/0 conn(0x7f2a841604a0 legacy=0x7f2a840cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 -- 172.21.15.81:0/2749898356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a840ce3a0 con 0x7f2a840cfee0 2024-09-13T18:53:17.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.175+0000 7f2a83e00700 1 --2- 172.21.15.81:0/2749898356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 0x7f2a840d16e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009850 tx=0x7f2a70009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=302e50c5a0b91e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a83400700 1 -- 172.21.15.81:0/2749898356 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70011830 con 0x7f2a840cfee0 2024-09-13T18:53:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a83400700 1 -- 172.21.15.81:0/2749898356 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a70011990 con 0x7f2a840cfee0 2024-09-13T18:53:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a83400700 1 -- 172.21.15.81:0/2749898356 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70011d40 con 0x7f2a840cfee0 2024-09-13T18:53:17.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2749898356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 msgr2=0x7f2a840d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2749898356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 0x7f2a840d16e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a70009850 tx=0x7f2a70009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2749898356 shutdown_connections 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2749898356 >> v2:172.21.15.178:3300/0 conn(0x7f2a840d38e0 0x7f2a840ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2749898356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a840cfee0 0x7f2a840d16e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2749898356 >> 172.21.15.81:0/2749898356 conn(0x7f2a840d2dc0 msgr2=0x7f2a840d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2749898356 shutdown_connections 2024-09-13T18:53:17.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2749898356 wait complete. 2024-09-13T18:53:17.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 Processor -- start 2024-09-13T18:53:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.179+0000 7f2a8bc00700 1 -- start start 2024-09-13T18:53:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 0x7f2a8414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a840d38e0 0x7f2a84159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a841604a0 0x7f2a8415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840c7fe0 con 0x7f2a840cfee0 2024-09-13T18:53:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840c73d0 con 0x7f2a840d38e0 2024-09-13T18:53:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a840c76b0 con 0x7f2a841604a0 2024-09-13T18:53:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 0x7f2a8414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 0x7f2a8414a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48524/0 (socket says 172.21.15.81:48524) 2024-09-13T18:53:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89200700 1 -- 172.21.15.81:0/2050615708 learned_addr learned my addr 172.21.15.81:0/2050615708 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a83e00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a840d38e0 0x7f2a84159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a841604a0 0x7f2a8415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 -- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a840d38e0 msgr2=0x7f2a84159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a840d38e0 0x7f2a84159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 -- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 msgr2=0x7f2a8414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 0x7f2a8414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 -- 172.21.15.81:0/2050615708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a700094b0 con 0x7f2a841604a0 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89200700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 0x7f2a8414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a83e00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a840d38e0 0x7f2a84159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a89c00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a841604a0 0x7f2a8415a1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00ef90 tx=0x7f2a7c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00cc90 con 0x7f2a841604a0 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c00f040 con 0x7f2a841604a0 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0146c0 con 0x7f2a841604a0 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a840c7990 con 0x7f2a841604a0 2024-09-13T18:53:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.183+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8414a680 con 0x7f2a841604a0 2024-09-13T18:53:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.187+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a840cac40 con 0x7f2a841604a0 2024-09-13T18:53:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.187+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a7c014820 con 0x7f2a841604a0 2024-09-13T18:53:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.187+0000 7f2a80c00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a64066730 0x7f2a64068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.191+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2a7c084e30 con 0x7f2a841604a0 2024-09-13T18:53:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.191+0000 7f2a89200700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a64066730 0x7f2a64068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.191+0000 7f2a89200700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a64066730 0x7f2a64068bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2a78005930 tx=0x7f2a78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.195+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a7c051fc0 con 0x7f2a841604a0 2024-09-13T18:53:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.375+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a840c77f0 con 0x7f2a841604a0 2024-09-13T18:53:17.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.375+0000 7f2a80c00700 1 -- 172.21.15.81:0/2050615708 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a840c77f0 con 0x7f2a841604a0 2024-09-13T18:53:17.384 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a64066730 msgr2=0x7f2a64068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a64066730 0x7f2a64068bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2a78005930 tx=0x7f2a78009040 comp rx=0 tx=0).stop 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a841604a0 msgr2=0x7f2a8415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a841604a0 0x7f2a8415a1e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00ef90 tx=0x7f2a7c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 shutdown_connections 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a64066730 0x7f2a64068bf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a841604a0 0x7f2a8415a1e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a840d38e0 0x7f2a84159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 --2- 172.21.15.81:0/2050615708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a840cfee0 0x7f2a8414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 >> 172.21.15.81:0/2050615708 conn(0x7f2a840d2dc0 msgr2=0x7f2a8406d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 shutdown_connections 2024-09-13T18:53:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.379+0000 7f2a8bc00700 1 -- 172.21.15.81:0/2050615708 wait complete. 2024-09-13T18:53:17.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:53:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.583+0000 7fdeea000700 1 Processor -- start 2024-09-13T18:53:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.583+0000 7fdeea000700 1 -- start start 2024-09-13T18:53:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdeea000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdee406c5a0 0x7fdee415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdeea000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee40b4680 con 0x7fdee406c980 2024-09-13T18:53:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdeea000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee40b4960 con 0x7fdee40cf830 2024-09-13T18:53:17.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdeea000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee40b5dd0 con 0x7fdee406c5a0 2024-09-13T18:53:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee3e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdee406c980 0x7fdee40b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35174/0 (socket says 172.21.15.81:35174) 2024-09-13T18:53:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee3e00700 1 -- 172.21.15.81:0/891893720 learned_addr learned my addr 172.21.15.81:0/891893720 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:17.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee8c00700 1 --2- 172.21.15.81:0/891893720 >> v2:172.21.15.81:3300/0 conn(0x7fdee406c5a0 0x7fdee415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee3400700 1 -- 172.21.15.81:0/891893720 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461352929 0 0) 0x7fdee40b4680 con 0x7fdee406c980 2024-09-13T18:53:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee3400700 1 -- 172.21.15.81:0/891893720 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0035d0 con 0x7fdee406c980 2024-09-13T18:53:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee8c00700 1 -- 172.21.15.81:0/891893720 >> v1:172.21.15.178:6789/0 conn(0x7fdee40cf830 legacy=0x7fdee40cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee8c00700 1 -- 172.21.15.81:0/891893720 >> v1:172.21.15.81:6789/0 conn(0x7fdee406c980 legacy=0x7fdee40b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee8c00700 1 -- 172.21.15.81:0/891893720 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40cf030 con 0x7fdee406c5a0 2024-09-13T18:53:17.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee8c00700 1 --2- 172.21.15.81:0/891893720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c5a0 0x7fdee415aa90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fded8009850 tx=0x7fded8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1326a5ac502b661 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.587+0000 7fdee3400700 1 -- 172.21.15.81:0/891893720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8011830 con 0x7fdee406c5a0 2024-09-13T18:53:17.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdee3400700 1 -- 172.21.15.81:0/891893720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8011990 con 0x7fdee406c5a0 2024-09-13T18:53:17.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdee3400700 1 -- 172.21.15.81:0/891893720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8011d40 con 0x7fdee406c5a0 2024-09-13T18:53:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 -- 172.21.15.81:0/891893720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c5a0 msgr2=0x7fdee415aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 --2- 172.21.15.81:0/891893720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c5a0 0x7fdee415aa90 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fded8009850 tx=0x7fded8009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 -- 172.21.15.81:0/891893720 shutdown_connections 2024-09-13T18:53:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 --2- 172.21.15.81:0/891893720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c5a0 0x7fdee415aa90 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 -- 172.21.15.81:0/891893720 >> 172.21.15.81:0/891893720 conn(0x7fdee4071d20 msgr2=0x7fdee4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 -- 172.21.15.81:0/891893720 shutdown_connections 2024-09-13T18:53:17.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.591+0000 7fdeea000700 1 -- 172.21.15.81:0/891893720 wait complete. 2024-09-13T18:53:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 Processor -- start 2024-09-13T18:53:17.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 -- start start 2024-09-13T18:53:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406c5a0 0x7fdee413e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 0x7fdee414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee40cf830 0x7fdee414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee413e6d0 con 0x7fdee406c980 2024-09-13T18:53:17.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4150a40 con 0x7fdee406c5a0 2024-09-13T18:53:17.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdeea000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee4150d20 con 0x7fdee40cf830 2024-09-13T18:53:17.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 0x7fdee414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 0x7fdee414e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48540/0 (socket says 172.21.15.81:48540) 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 -- 172.21.15.81:0/4098948069 learned_addr learned my addr 172.21.15.81:0/4098948069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee8c00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406c5a0 0x7fdee413e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee9600700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee40cf830 0x7fdee414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 -- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee40cf830 msgr2=0x7fdee414ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee40cf830 0x7fdee414ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 -- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406c5a0 msgr2=0x7fdee413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406c5a0 0x7fdee413e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee3e00700 1 -- 172.21.15.81:0/4098948069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80094b0 con 0x7fdee406c980 2024-09-13T18:53:17.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.595+0000 7fdee8c00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406c5a0 0x7fdee413e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:17.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdee3e00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 0x7fdee414e680 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fded000c700 tx=0x7fded000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0005d90 con 0x7fdee406c980 2024-09-13T18:53:17.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded00070d0 con 0x7fdee406c980 2024-09-13T18:53:17.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee4151000 con 0x7fdee406c980 2024-09-13T18:53:17.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0007480 con 0x7fdee406c980 2024-09-13T18:53:17.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee41515c0 con 0x7fdee406c980 2024-09-13T18:53:17.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.599+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee40cec70 con 0x7fdee406c980 2024-09-13T18:53:17.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.603+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fded00075e0 con 0x7fdee406c980 2024-09-13T18:53:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.603+0000 7fdee0c00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.603+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fded0083930 con 0x7fdee406c980 2024-09-13T18:53:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.603+0000 7fdee8c00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.603+0000 7fdee8c00700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fded80090b0 tx=0x7fded8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.607+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fded0050ad0 con 0x7fdee406c980 2024-09-13T18:53:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.791+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdee414bf50 con 0x7fdee406c980 2024-09-13T18:53:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.791+0000 7fdee0c00700 1 -- 172.21.15.81:0/4098948069 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fded00540f0 con 0x7fdee406c980 2024-09-13T18:53:17.799 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:53:17.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.791+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 msgr2=0x7fdec4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.791+0000 7fdeea000700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fded80090b0 tx=0x7fded8008030 comp rx=0 tx=0).stop 2024-09-13T18:53:17.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.791+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 msgr2=0x7fdee414e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.791+0000 7fdeea000700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 0x7fdee414e680 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fded000c700 tx=0x7fded000cac0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 shutdown_connections 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee40cf830 0x7fdee414ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406c980 0x7fdee414e680 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 --2- 172.21.15.81:0/4098948069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406c5a0 0x7fdee413e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 >> 172.21.15.81:0/4098948069 conn(0x7fdee4071d20 msgr2=0x7fdee406b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 shutdown_connections 2024-09-13T18:53:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.795+0000 7fdeea000700 1 -- 172.21.15.81:0/4098948069 wait complete. 2024-09-13T18:53:17.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:53:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.983+0000 7f1850c00700 1 Processor -- start 2024-09-13T18:53:17.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.983+0000 7f1850c00700 1 -- start start 2024-09-13T18:53:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1850c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c15ed90 0x7f184c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1850c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f184c06f480 0x7f184c0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:17.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1850c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184c15b050 con 0x7f184c15f170 2024-09-13T18:53:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1850c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f184c15b330 con 0x7f184c06f480 2024-09-13T18:53:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1850c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c15b610 con 0x7f184c15ed90 2024-09-13T18:53:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f184c06f480 0x7f184c0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f184c06f480 0x7f184c0ccc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48552/0 (socket says 172.21.15.81:48552) 2024-09-13T18:53:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 -- 172.21.15.81:0/985759590 learned_addr learned my addr 172.21.15.81:0/985759590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1849e00700 1 --2- 172.21.15.81:0/985759590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c15ed90 0x7f184c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 -- 172.21.15.81:0/985759590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c15ed90 msgr2=0x7f184c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 --2- 172.21.15.81:0/985759590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c15ed90 0x7f184c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 -- 172.21.15.81:0/985759590 >> v1:172.21.15.81:6789/0 conn(0x7f184c15f170 legacy=0x7f184c06ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 -- 172.21.15.81:0/985759590 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c15b8f0 con 0x7f184c06f480 2024-09-13T18:53:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f184a800700 1 --2- 172.21.15.81:0/985759590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c06f480 0x7f184c0ccc20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1844009e50 tx=0x7f184400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858a0e403f353305 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1848a00700 1 -- 172.21.15.81:0/985759590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400e070 con 0x7f184c06f480 2024-09-13T18:53:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1848a00700 1 -- 172.21.15.81:0/985759590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184400b9c0 con 0x7f184c06f480 2024-09-13T18:53:17.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.987+0000 7f1848a00700 1 -- 172.21.15.81:0/985759590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400bd70 con 0x7f184c06f480 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 -- 172.21.15.81:0/985759590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c06f480 msgr2=0x7f184c0ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 --2- 172.21.15.81:0/985759590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c06f480 0x7f184c0ccc20 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1844009e50 tx=0x7f184400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 -- 172.21.15.81:0/985759590 shutdown_connections 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 --2- 172.21.15.81:0/985759590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c06f480 0x7f184c0ccc20 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 --2- 172.21.15.81:0/985759590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c15ed90 0x7f184c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 -- 172.21.15.81:0/985759590 >> 172.21.15.81:0/985759590 conn(0x7f184c0b1e10 msgr2=0x7f184c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 -- 172.21.15.81:0/985759590 shutdown_connections 2024-09-13T18:53:17.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 -- 172.21.15.81:0/985759590 wait complete. 2024-09-13T18:53:18.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 Processor -- start 2024-09-13T18:53:18.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.991+0000 7f1850c00700 1 -- start start 2024-09-13T18:53:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c06f480 0x7f184c1e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f184c15ed90 0x7f184c149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 0x7f184c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0b4bb0 con 0x7f184c15f170 2024-09-13T18:53:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c1f27b0 con 0x7f184c15ed90 2024-09-13T18:53:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184c15c950 con 0x7f184c06f480 2024-09-13T18:53:18.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 0x7f184c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 0x7f184c15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48568/0 (socket says 172.21.15.81:48568) 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 -- 172.21.15.81:0/1972573007 learned_addr learned my addr 172.21.15.81:0/1972573007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1849400700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f184c15ed90 0x7f184c149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1849e00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c06f480 0x7f184c1e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 -- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c06f480 msgr2=0x7f184c1e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c06f480 0x7f184c1e4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 -- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f184c15ed90 msgr2=0x7f184c149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f184c15ed90 0x7f184c149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 -- 172.21.15.81:0/1972573007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844009b30 con 0x7f184c15f170 2024-09-13T18:53:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f184a800700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 0x7f184c15c410 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f184c0670d0 tx=0x7f1844004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1844004800 con 0x7f184c15f170 2024-09-13T18:53:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440092e0 con 0x7f184c15f170 2024-09-13T18:53:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c15cb80 con 0x7f184c15f170 2024-09-13T18:53:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184401c660 con 0x7f184c15f170 2024-09-13T18:53:18.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.995+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c15d140 con 0x7f184c15f170 2024-09-13T18:53:18.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.999+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c1f2920 con 0x7f184c15f170 2024-09-13T18:53:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:17.999+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f184401c7c0 con 0x7f184c15f170 2024-09-13T18:53:18.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.003+0000 7f1842000700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f182c066760 0x7f182c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.003+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1844085da0 con 0x7f184c15f170 2024-09-13T18:53:18.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.003+0000 7f1849e00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f182c066760 0x7f182c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.003+0000 7f1849e00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f182c066760 0x7f182c068c20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f183c009a00 tx=0x7f183c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.007+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f184c1f2920 con 0x7f184c15f170 2024-09-13T18:53:18.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.187+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f184c1f2920 con 0x7f184c15f170 2024-09-13T18:53:18.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.187+0000 7f1842000700 1 -- 172.21.15.81:0/1972573007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f184c1f2920 con 0x7f184c15f170 2024-09-13T18:53:18.196 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:53:18.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f182c066760 msgr2=0x7f182c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f182c066760 0x7f182c068c20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f183c009a00 tx=0x7f183c008040 comp rx=0 tx=0).stop 2024-09-13T18:53:18.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 msgr2=0x7f184c15c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 0x7f184c15c410 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f184c0670d0 tx=0x7f1844004af0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 shutdown_connections 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f182c066760 0x7f182c068c20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c15f170 0x7f184c15c410 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f184c15ed90 0x7f184c149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 --2- 172.21.15.81:0/1972573007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f184c06f480 0x7f184c1e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 >> 172.21.15.81:0/1972573007 conn(0x7f184c0b1e10 msgr2=0x7f184c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 shutdown_connections 2024-09-13T18:53:18.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.191+0000 7f1850c00700 1 -- 172.21.15.81:0/1972573007 wait complete. 2024-09-13T18:53:18.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.379+0000 7f2ef5c00700 1 Processor -- start 2024-09-13T18:53:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.379+0000 7f2ef5c00700 1 -- start start 2024-09-13T18:53:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2ef5c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef0159bd0 0x7f2ef00cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2ef5c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef006b1b0 0x7f2ef01636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2ef5c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00707d0 con 0x7f2ef0071870 2024-09-13T18:53:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2ef5c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef00720a0 con 0x7f2ef0159bd0 2024-09-13T18:53:18.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2ef5c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef006fee0 con 0x7f2ef006b1b0 2024-09-13T18:53:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2eefe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef0159bd0 0x7f2ef00cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2eefe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2ef0159bd0 0x7f2ef00cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48578/0 (socket says 172.21.15.81:48578) 2024-09-13T18:53:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2eefe00700 1 -- 172.21.15.81:0/2630657306 learned_addr learned my addr 172.21.15.81:0/2630657306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:18.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.383+0000 7f2ef5200700 1 --2- 172.21.15.81:0/2630657306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef006b1b0 0x7f2ef01636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eefe00700 1 -- 172.21.15.81:0/2630657306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef006b1b0 msgr2=0x7f2ef01636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eefe00700 1 --2- 172.21.15.81:0/2630657306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef006b1b0 0x7f2ef01636b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eefe00700 1 -- 172.21.15.81:0/2630657306 >> v1:172.21.15.178:6789/0 conn(0x7f2ef0071870 legacy=0x7f2ef006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eefe00700 1 -- 172.21.15.81:0/2630657306 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef00b2ef0 con 0x7f2ef0159bd0 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eeea00700 1 -- 172.21.15.81:0/2630657306 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622153590 0 0) 0x7f2ef00707d0 con 0x7f2ef0071870 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eefe00700 1 --2- 172.21.15.81:0/2630657306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00cb700 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009910 tx=0x7f2ee0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9eaaddf54eb8e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eeea00700 1 -- 172.21.15.81:0/2630657306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0011830 con 0x7f2ef0159bd0 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eeea00700 1 -- 172.21.15.81:0/2630657306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee0011990 con 0x7f2ef0159bd0 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2eeea00700 1 -- 172.21.15.81:0/2630657306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0011d40 con 0x7f2ef0159bd0 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2630657306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 msgr2=0x7f2ef00cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2630657306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00cb700 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0009910 tx=0x7f2ee0009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2630657306 shutdown_connections 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2630657306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef006b1b0 0x7f2ef01636b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2630657306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00cb700 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2630657306 >> 172.21.15.81:0/2630657306 conn(0x7f2ef00b0c40 msgr2=0x7f2ef006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:18.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2630657306 shutdown_connections 2024-09-13T18:53:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.387+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2630657306 wait complete. 2024-09-13T18:53:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 Processor -- start 2024-09-13T18:53:18.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 -- start start 2024-09-13T18:53:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef006b1b0 0x7f2ef014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef0071870 0x7f2ef00accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01517f0 con 0x7f2ef0159bd0 2024-09-13T18:53:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef01f2980 con 0x7f2ef006b1b0 2024-09-13T18:53:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef015cc30 con 0x7f2ef0071870 2024-09-13T18:53:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48582/0 (socket says 172.21.15.81:48582) 2024-09-13T18:53:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 -- 172.21.15.81:0/2041759355 learned_addr learned my addr 172.21.15.81:0/2041759355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2eefe00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef006b1b0 0x7f2ef014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2eef400700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef0071870 0x7f2ef00accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 -- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef0071870 msgr2=0x7f2ef00accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef0071870 0x7f2ef00accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 -- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef006b1b0 msgr2=0x7f2ef014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef006b1b0 0x7f2ef014e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 -- 172.21.15.81:0/2041759355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0009570 con 0x7f2ef0159bd0 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5200700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00ad230 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800efc0 tx=0x7f2ee800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800cb80 con 0x7f2ef0159bd0 2024-09-13T18:53:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee800f040 con 0x7f2ef0159bd0 2024-09-13T18:53:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef01f2b90 con 0x7f2ef0159bd0 2024-09-13T18:53:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.391+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee8014480 con 0x7f2ef0159bd0 2024-09-13T18:53:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.395+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef01f3150 con 0x7f2ef0159bd0 2024-09-13T18:53:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.395+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef0070c40 con 0x7f2ef0159bd0 2024-09-13T18:53:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.395+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ee80145e0 con 0x7f2ef0159bd0 2024-09-13T18:53:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.395+0000 7f2ee7e00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2ed0066730 0x7f2ed0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.399+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2ee8084ad0 con 0x7f2ef0159bd0 2024-09-13T18:53:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.399+0000 7f2eefe00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2ed0066730 0x7f2ed0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.399+0000 7f2eefe00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2ed0066730 0x7f2ed0068bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0000c00 tx=0x7f2ee0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.403+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ef0070c40 con 0x7f2ef0159bd0 2024-09-13T18:53:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.627+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ef0070c40 con 0x7f2ef0159bd0 2024-09-13T18:53:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.627+0000 7f2ee7e00700 1 -- 172.21.15.81:0/2041759355 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f2ef0070c40 con 0x7f2ef0159bd0 2024-09-13T18:53:18.636 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:18.636 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:53:15.306260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2ed0066730 msgr2=0x7f2ed0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2ed0066730 0x7f2ed0068bf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0000c00 tx=0x7f2ee0008030 comp rx=0 tx=0).stop 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 msgr2=0x7f2ef00ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00ad230 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800efc0 tx=0x7f2ee800c0c0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 shutdown_connections 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2ed0066730 0x7f2ed0068bf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef0159bd0 0x7f2ef00ad230 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef0071870 0x7f2ef00accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 --2- 172.21.15.81:0/2041759355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef006b1b0 0x7f2ef014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 >> 172.21.15.81:0/2041759355 conn(0x7f2ef00b0c40 msgr2=0x7f2ef00ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 shutdown_connections 2024-09-13T18:53:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.631+0000 7f2ef5c00700 1 -- 172.21.15.81:0/2041759355 wait complete. 2024-09-13T18:53:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 78 2024-09-13T18:53:18.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.815+0000 7f0799400700 1 Processor -- start 2024-09-13T18:53:18.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.819+0000 7f0799400700 1 -- start start 2024-09-13T18:53:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.819+0000 7f0799400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 0x7f0794071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.819+0000 7f0799400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f07940667a0 0x7f079415cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.819+0000 7f0799400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079406bc30 con 0x7f07940cd8a0 2024-09-13T18:53:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.819+0000 7f0799400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0794161100 con 0x7f07940667a0 2024-09-13T18:53:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.819+0000 7f0799400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07940716b0 con 0x7f079415cb30 2024-09-13T18:53:18.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 0x7f0794071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0798a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f07940667a0 0x7f079415cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 0x7f0794071170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39558/0 (socket says 172.21.15.81:39558) 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 -- 172.21.15.81:0/2670337710 learned_addr learned my addr 172.21.15.81:0/2670337710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 -- 172.21.15.81:0/2670337710 >> v2:172.21.15.178:3300/0 conn(0x7f07940667a0 msgr2=0x7f079415cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 --2- 172.21.15.81:0/2670337710 >> v2:172.21.15.178:3300/0 conn(0x7f07940667a0 0x7f079415cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 -- 172.21.15.81:0/2670337710 >> v1:172.21.15.178:6789/0 conn(0x7f07940cd8a0 legacy=0x7f0794066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 -- 172.21.15.81:0/2670337710 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0794160810 con 0x7f079415cb30 2024-09-13T18:53:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0793e00700 1 --2- 172.21.15.81:0/2670337710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 0x7f0794071170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0784009910 tx=0x7f0784009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703409a90ffe0130 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0792a00700 1 -- 172.21.15.81:0/2670337710 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784011830 con 0x7f079415cb30 2024-09-13T18:53:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0792a00700 1 -- 172.21.15.81:0/2670337710 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0784011990 con 0x7f079415cb30 2024-09-13T18:53:18.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0792a00700 1 -- 172.21.15.81:0/2670337710 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784011d40 con 0x7f079415cb30 2024-09-13T18:53:18.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 -- 172.21.15.81:0/2670337710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 msgr2=0x7f0794071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 --2- 172.21.15.81:0/2670337710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 0x7f0794071170 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0784009910 tx=0x7f0784009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:18.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 -- 172.21.15.81:0/2670337710 shutdown_connections 2024-09-13T18:53:18.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 --2- 172.21.15.81:0/2670337710 >> v2:172.21.15.178:3300/0 conn(0x7f07940667a0 0x7f079415cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 --2- 172.21.15.81:0/2670337710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f079415cb30 0x7f0794071170 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 -- 172.21.15.81:0/2670337710 >> 172.21.15.81:0/2670337710 conn(0x7f079406ca10 msgr2=0x7f079406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:18.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 -- 172.21.15.81:0/2670337710 shutdown_connections 2024-09-13T18:53:18.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.823+0000 7f0799400700 1 -- 172.21.15.81:0/2670337710 wait complete. 2024-09-13T18:53:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.827+0000 7f0799400700 1 Processor -- start 2024-09-13T18:53:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.827+0000 7f0799400700 1 -- start start 2024-09-13T18:53:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.827+0000 7f0799400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 0x7f0794150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.827+0000 7f0799400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07940cd8a0 0x7f079415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.827+0000 7f0799400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079415cb30 0x7f079415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.827+0000 7f0799400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07941f2290 con 0x7f07940667a0 2024-09-13T18:53:18.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0799400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940b2520 con 0x7f079415cb30 2024-09-13T18:53:18.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0799400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07941517f0 con 0x7f07940cd8a0 2024-09-13T18:53:18.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 0x7f0794150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 0x7f0794150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48584/0 (socket says 172.21.15.81:48584) 2024-09-13T18:53:18.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 -- 172.21.15.81:0/2977627625 learned_addr learned my addr 172.21.15.81:0/2977627625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07940cd8a0 0x7f079415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0798a00700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079415cb30 0x7f079415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 -- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07940cd8a0 msgr2=0x7f079415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07940cd8a0 0x7f079415fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 -- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079415cb30 msgr2=0x7f079415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079415cb30 0x7f079415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 -- 172.21.15.81:0/2977627625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784009570 con 0x7f07940667a0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0798a00700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079415cb30 0x7f079415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0793e00700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 0x7f0794150f50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f07940717f0 tx=0x7f0784004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078401a8f0 con 0x7f07940667a0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078401e070 con 0x7f07940667a0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079415bb00 con 0x7f07940667a0 2024-09-13T18:53:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078401ac70 con 0x7f07940667a0 2024-09-13T18:53:18.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.831+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07940b1ed0 con 0x7f07940667a0 2024-09-13T18:53:18.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.835+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079406cdf0 con 0x7f07940667a0 2024-09-13T18:53:18.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.835+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f078402d450 con 0x7f07940667a0 2024-09-13T18:53:18.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.839+0000 7f078be00700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0774066730 0x7f0774068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:18.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.839+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f07840852f0 con 0x7f07940667a0 2024-09-13T18:53:18.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.839+0000 7f0793400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0774066730 0x7f0774068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:18.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.839+0000 7f0793400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0774066730 0x7f0774068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f079415dfe0 tx=0x7f0780009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:18.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:18.847+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0784055f10 con 0x7f07940667a0 2024-09-13T18:53:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.035+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0794071170 con 0x7f07940667a0 2024-09-13T18:53:19.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.035+0000 7f078be00700 1 -- 172.21.15.81:0/2977627625 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f0784006da0 con 0x7f07940667a0 2024-09-13T18:53:19.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:19.046 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:40.994239+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0774066730 msgr2=0x7f0774068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0774066730 0x7f0774068bf0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f079415dfe0 tx=0x7f0780009040 comp rx=0 tx=0).stop 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 msgr2=0x7f0794150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 0x7f0794150f50 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f07940717f0 tx=0x7f0784004770 comp rx=0 tx=0).stop 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 shutdown_connections 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0774066730 0x7f0774068bf0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f079415cb30 0x7f079415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07940cd8a0 0x7f079415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 --2- 172.21.15.81:0/2977627625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07940667a0 0x7f0794150f50 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 >> 172.21.15.81:0/2977627625 conn(0x7f079406ca10 msgr2=0x7f07940b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 shutdown_connections 2024-09-13T18:53:19.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.039+0000 7f0799400700 1 -- 172.21.15.81:0/2977627625 wait complete. 2024-09-13T18:53:19.070 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:53:19.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 Processor -- start 2024-09-13T18:53:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 -- start start 2024-09-13T18:53:19.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbe980cc6f0 0x7fbe9815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980ccb40 con 0x7fbe980cb020 2024-09-13T18:53:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9806b430 con 0x7fbe980cc6f0 2024-09-13T18:53:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980b2ad0 con 0x7fbe9806aaa0 2024-09-13T18:53:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9d000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbe980cb020 0x7fbe9815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35202/0 (socket says 172.21.15.81:35202) 2024-09-13T18:53:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9d000700 1 -- 172.21.15.81:0/2748893985 learned_addr learned my addr 172.21.15.81:0/2748893985 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe97e00700 1 --2- 172.21.15.81:0/2748893985 >> v2:172.21.15.178:3300/0 conn(0x7fbe980cc6f0 0x7fbe9815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe9da00700 1 --2- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.227+0000 7fbe97400700 1 -- 172.21.15.81:0/2748893985 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950334289 0 0) 0x7fbe980ccb40 con 0x7fbe980cb020 2024-09-13T18:53:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97400700 1 -- 172.21.15.81:0/2748893985 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe800035d0 con 0x7fbe980cb020 2024-09-13T18:53:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97e00700 1 -- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 msgr2=0x7fbe9806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97e00700 1 --2- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97e00700 1 -- 172.21.15.81:0/2748893985 >> v1:172.21.15.81:6789/0 conn(0x7fbe980cb020 legacy=0x7fbe9815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97e00700 1 -- 172.21.15.81:0/2748893985 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9815b960 con 0x7fbe980cc6f0 2024-09-13T18:53:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97e00700 1 --2- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cc6f0 0x7fbe9815b0e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009850 tx=0x7fbe84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e744aa0eff9bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97400700 1 -- 172.21.15.81:0/2748893985 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011830 con 0x7fbe980cc6f0 2024-09-13T18:53:19.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97400700 1 -- 172.21.15.81:0/2748893985 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe84011990 con 0x7fbe980cc6f0 2024-09-13T18:53:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe97400700 1 -- 172.21.15.81:0/2748893985 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe84011d40 con 0x7fbe980cc6f0 2024-09-13T18:53:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 -- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cc6f0 msgr2=0x7fbe9815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 --2- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cc6f0 0x7fbe9815b0e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbe84009850 tx=0x7fbe84009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 -- 172.21.15.81:0/2748893985 shutdown_connections 2024-09-13T18:53:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 --2- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 --2- 172.21.15.81:0/2748893985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cc6f0 0x7fbe9815b0e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 -- 172.21.15.81:0/2748893985 >> 172.21.15.81:0/2748893985 conn(0x7fbe980b0c40 msgr2=0x7fbe9806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 -- 172.21.15.81:0/2748893985 shutdown_connections 2024-09-13T18:53:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.231+0000 7fbe9e400700 1 -- 172.21.15.81:0/2748893985 wait complete. 2024-09-13T18:53:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.235+0000 7fbe9e400700 1 Processor -- start 2024-09-13T18:53:19.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.235+0000 7fbe9e400700 1 -- start start 2024-09-13T18:53:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.235+0000 7fbe9e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cb020 0x7fbe9813ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 0x7fbe9814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9814c360 con 0x7fbe980cc6f0 2024-09-13T18:53:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98154540 con 0x7fbe980cb020 2024-09-13T18:53:19.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9814c5b0 con 0x7fbe9806aaa0 2024-09-13T18:53:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 0x7fbe9814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 0x7fbe9814aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48596/0 (socket says 172.21.15.81:48596) 2024-09-13T18:53:19.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 -- 172.21.15.81:0/4041207753 learned_addr learned my addr 172.21.15.81:0/4041207753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe97e00700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cb020 0x7fbe9813ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9d000700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 -- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 msgr2=0x7fbe9814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 -- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cb020 msgr2=0x7fbe9813ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cb020 0x7fbe9813ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 -- 172.21.15.81:0/4041207753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840094b0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9d000700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:19.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9da00700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 0x7fbe9814aa40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000efc0 tx=0x7fbe9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:19.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90009ea0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9000f040 con 0x7fbe980cc6f0 2024-09-13T18:53:19.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9814c890 con 0x7fbe980cc6f0 2024-09-13T18:53:19.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe90014480 con 0x7fbe980cc6f0 2024-09-13T18:53:19.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.239+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe981404e0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.243+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe9814cdb0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.243+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe900145e0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.243+0000 7fbe94c00700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe78066730 0x7fbe78068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.243+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbe90084c80 con 0x7fbe980cc6f0 2024-09-13T18:53:19.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.243+0000 7fbe9d000700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe78066730 0x7fbe78068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.247+0000 7fbe9d000700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe78066730 0x7fbe78068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0011e0 tx=0x7fbe8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:19.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.251+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbe9814cdb0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.479+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe9814cdb0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.479+0000 7fbe94c00700 1 -- 172.21.15.81:0/4041207753 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4776 (secure 0 0 0) 0x7fbe9814cdb0 con 0x7fbe980cc6f0 2024-09-13T18:53:19.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:19.490 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:53:15.306260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:53:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe78066730 msgr2=0x7fbe78068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe78066730 0x7fbe78068bf0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c0011e0 tx=0x7fbe8c009040 comp rx=0 tx=0).stop 2024-09-13T18:53:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 msgr2=0x7fbe9814aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 0x7fbe9814aa40 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbe9000efc0 tx=0x7fbe9000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 shutdown_connections 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbe78066730 0x7fbe78068bf0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe980cc6f0 0x7fbe9814aa40 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe980cb020 0x7fbe9813ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 --2- 172.21.15.81:0/4041207753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe9806aaa0 0x7fbe9814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 >> 172.21.15.81:0/4041207753 conn(0x7fbe980b0c40 msgr2=0x7fbe98158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 shutdown_connections 2024-09-13T18:53:19.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.483+0000 7fbe9e400700 1 -- 172.21.15.81:0/4041207753 wait complete. 2024-09-13T18:53:19.495 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 78 2024-09-13T18:53:19.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.679+0000 7f130d000700 1 Processor -- start 2024-09-13T18:53:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.679+0000 7f130d000700 1 -- start start 2024-09-13T18:53:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f130d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1308151aa0 0x7f13080b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f130d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130806c5a0 0x7f130806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f130d000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13080b3e20 con 0x7f130815b040 2024-09-13T18:53:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f130d000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130815c910 con 0x7f1308151aa0 2024-09-13T18:53:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f130d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130806cf70 con 0x7f130806c5a0 2024-09-13T18:53:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1308151aa0 0x7f13080b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f130815b040 0x7f130815c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35212/0 (socket says 172.21.15.81:35212) 2024-09-13T18:53:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305400700 1 -- 172.21.15.81:0/3398930865 learned_addr learned my addr 172.21.15.81:0/3398930865 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1306800700 1 --2- 172.21.15.81:0/3398930865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130806c5a0 0x7f130806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305e00700 1 -- 172.21.15.81:0/3398930865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130806c5a0 msgr2=0x7f130806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305e00700 1 --2- 172.21.15.81:0/3398930865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130806c5a0 0x7f130806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305e00700 1 -- 172.21.15.81:0/3398930865 >> v1:172.21.15.81:6789/0 conn(0x7f130815b040 legacy=0x7f130815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305e00700 1 -- 172.21.15.81:0/3398930865 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130815b7e0 con 0x7f1308151aa0 2024-09-13T18:53:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1304a00700 1 -- 172.21.15.81:0/3398930865 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871015738 0 0) 0x7f13080b3e20 con 0x7f130815b040 2024-09-13T18:53:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.683+0000 7f1305e00700 1 --2- 172.21.15.81:0/3398930865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b5ac0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009850 tx=0x7f12f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f35090908f9269 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f1304a00700 1 -- 172.21.15.81:0/3398930865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8011830 con 0x7f1308151aa0 2024-09-13T18:53:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f1304a00700 1 -- 172.21.15.81:0/3398930865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8011990 con 0x7f1308151aa0 2024-09-13T18:53:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f1304a00700 1 -- 172.21.15.81:0/3398930865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8011d40 con 0x7f1308151aa0 2024-09-13T18:53:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 -- 172.21.15.81:0/3398930865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 msgr2=0x7f13080b5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 --2- 172.21.15.81:0/3398930865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b5ac0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009850 tx=0x7f12f8009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 -- 172.21.15.81:0/3398930865 shutdown_connections 2024-09-13T18:53:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 --2- 172.21.15.81:0/3398930865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130806c5a0 0x7f130806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 --2- 172.21.15.81:0/3398930865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b5ac0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 -- 172.21.15.81:0/3398930865 >> 172.21.15.81:0/3398930865 conn(0x7f130806e660 msgr2=0x7f130806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:19.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 -- 172.21.15.81:0/3398930865 shutdown_connections 2024-09-13T18:53:19.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.687+0000 7f130d000700 1 -- 172.21.15.81:0/3398930865 wait complete. 2024-09-13T18:53:19.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 Processor -- start 2024-09-13T18:53:19.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 -- start start 2024-09-13T18:53:19.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130806c5a0 0x7f130814cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130815b040 0x7f1308159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1308155240 con 0x7f1308151aa0 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130814c910 con 0x7f130806c5a0 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f130d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13081545c0 con 0x7f130815b040 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f1305400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f1305400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48620/0 (socket says 172.21.15.81:48620) 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f1305400700 1 -- 172.21.15.81:0/70626783 learned_addr learned my addr 172.21.15.81:0/70626783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f1306800700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130815b040 0x7f1308159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.691+0000 7f1305e00700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130806c5a0 0x7f130814cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f1305400700 1 -- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130815b040 msgr2=0x7f1308159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f1305400700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130815b040 0x7f1308159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f1305400700 1 -- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130806c5a0 msgr2=0x7f130814cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f1305400700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130806c5a0 0x7f130814cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f1305400700 1 -- 172.21.15.81:0/70626783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80094b0 con 0x7f1308151aa0 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f1305400700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b11a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c4e0 tx=0x7f12f400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4004ca0 con 0x7f1308151aa0 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4004e20 con 0x7f1308151aa0 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4007310 con 0x7f1308151aa0 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13081548a0 con 0x7f1308151aa0 2024-09-13T18:53:19.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1308154e60 con 0x7f1308151aa0 2024-09-13T18:53:19.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.695+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130806ca30 con 0x7f1308151aa0 2024-09-13T18:53:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.699+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12f4007470 con 0x7f1308151aa0 2024-09-13T18:53:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.699+0000 7f12fe000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12e8066730 0x7f12e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.699+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f12f4083e90 con 0x7f1308151aa0 2024-09-13T18:53:19.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.699+0000 7f1305e00700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12e8066730 0x7f12e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:19.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.699+0000 7f1305e00700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12e8066730 0x7f12e8068bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f12f80090b0 tx=0x7f12f8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:19.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.707+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12f40510b0 con 0x7f1308151aa0 2024-09-13T18:53:19.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.943+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f130814df50 con 0x7f1308151aa0 2024-09-13T18:53:19.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.943+0000 7f12fe000700 1 -- 172.21.15.81:0/70626783 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f12f4007720 con 0x7f1308151aa0 2024-09-13T18:53:19.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:19.954 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:52:39.990227+0000","modified":"2024-09-13T18:53:15.306260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7476,"mds_1":7467,"mds_2":6479},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6479":{"gid":6479,"name":"d","rank":2,"incarnation":74,"state":"up:active","state_seq":6,"addr":"172.21.15.178:6835/3142422230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3142422230},{"type":"v1","addr":"172.21.15.178:6835","nonce":3142422230}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7467":{"gid":7467,"name":"c","rank":1,"incarnation":72,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6835/3178710454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3178710454},{"type":"v1","addr":"172.21.15.81:6835","nonce":3178710454}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_7476":{"gid":7476,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/3243728894","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3243728894},{"type":"v1","addr":"172.21.15.81:6837","nonce":3243728894}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12e8066730 msgr2=0x7f12e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12e8066730 0x7f12e8068bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f12f80090b0 tx=0x7f12f8008030 comp rx=0 tx=0).stop 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 msgr2=0x7f13080b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b11a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c4e0 tx=0x7f12f400c7f0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 shutdown_connections 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f12e8066730 0x7f12e8068bf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f130815b040 0x7f1308159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1308151aa0 0x7f13080b11a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 --2- 172.21.15.81:0/70626783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f130806c5a0 0x7f130814cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:19.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 >> 172.21.15.81:0/70626783 conn(0x7f130806e660 msgr2=0x7f13080d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 shutdown_connections 2024-09-13T18:53:19.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:19.947+0000 7f130d000700 1 -- 172.21.15.81:0/70626783 wait complete. 2024-09-13T18:53:19.959 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 78 2024-09-13T18:53:19.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.139+0000 7f831be00700 1 Processor -- start 2024-09-13T18:53:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.139+0000 7f831be00700 1 -- start start 2024-09-13T18:53:20.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 0x7f831c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831be00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f831c15c2a0 0x7f831c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c0b2ad0 con 0x7f831c06aaa0 2024-09-13T18:53:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831be00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c15b960 con 0x7f831c15c2a0 2024-09-13T18:53:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c15bc40 con 0x7f831c0cb020 2024-09-13T18:53:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 0x7f831c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 0x7f831c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:39622/0 (socket says 172.21.15.81:39622) 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 -- 172.21.15.81:0/258850583 learned_addr learned my addr 172.21.15.81:0/258850583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f8312000700 1 --2- 172.21.15.81:0/258850583 >> v2:172.21.15.178:3300/0 conn(0x7f831c15c2a0 0x7f831c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 -- 172.21.15.81:0/258850583 >> v2:172.21.15.178:3300/0 conn(0x7f831c15c2a0 msgr2=0x7f831c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 --2- 172.21.15.81:0/258850583 >> v2:172.21.15.178:3300/0 conn(0x7f831c15c2a0 0x7f831c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 -- 172.21.15.81:0/258850583 >> v1:172.21.15.178:6789/0 conn(0x7f831c06aaa0 legacy=0x7f831c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 -- 172.21.15.81:0/258850583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c15bf20 con 0x7f831c0cb020 2024-09-13T18:53:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f8312000700 1 --2- 172.21.15.81:0/258850583 >> v2:172.21.15.178:3300/0 conn(0x7f831c15c2a0 0x7f831c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:20.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831aa00700 1 --2- 172.21.15.81:0/258850583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 0x7f831c0cc6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f830c009910 tx=0x7f830c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3ed470fce1014d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:20.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831a000700 1 -- 172.21.15.81:0/258850583 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c011830 con 0x7f831c0cb020 2024-09-13T18:53:20.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831a000700 1 -- 172.21.15.81:0/258850583 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c011990 con 0x7f831c0cb020 2024-09-13T18:53:20.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.143+0000 7f831a000700 1 -- 172.21.15.81:0/258850583 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c011d40 con 0x7f831c0cb020 2024-09-13T18:53:20.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 -- 172.21.15.81:0/258850583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 msgr2=0x7f831c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 --2- 172.21.15.81:0/258850583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 0x7f831c0cc6f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f830c009910 tx=0x7f830c009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 -- 172.21.15.81:0/258850583 shutdown_connections 2024-09-13T18:53:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 --2- 172.21.15.81:0/258850583 >> v2:172.21.15.178:3300/0 conn(0x7f831c15c2a0 0x7f831c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 --2- 172.21.15.81:0/258850583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c0cb020 0x7f831c0cc6f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 -- 172.21.15.81:0/258850583 >> 172.21.15.81:0/258850583 conn(0x7f831c0b0c40 msgr2=0x7f831c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 -- 172.21.15.81:0/258850583 shutdown_connections 2024-09-13T18:53:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 -- 172.21.15.81:0/258850583 wait complete. 2024-09-13T18:53:20.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 Processor -- start 2024-09-13T18:53:20.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.147+0000 7f831be00700 1 -- start start 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c06aaa0 0x7f831c137560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 0x7f831c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831c15c2a0 0x7f831c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c137aa0 con 0x7f831c0cb020 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c13ae30 con 0x7f831c15c2a0 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c13a220 con 0x7f831c06aaa0 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 0x7f831c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 0x7f831c1544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48622/0 (socket says 172.21.15.81:48622) 2024-09-13T18:53:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 -- 172.21.15.81:0/3461816589 learned_addr learned my addr 172.21.15.81:0/3461816589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831aa00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c06aaa0 0x7f831c137560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831b400700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831c15c2a0 0x7f831c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 -- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c06aaa0 msgr2=0x7f831c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c06aaa0 0x7f831c137560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 -- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831c15c2a0 msgr2=0x7f831c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831c15c2a0 0x7f831c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 -- 172.21.15.81:0/3461816589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040094b0 con 0x7f831c0cb020 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8312000700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 0x7f831c1544a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f830400ebb0 tx=0x7f830400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830400c850 con 0x7f831c0cb020 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830400c9b0 con 0x7f831c0cb020 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c009570 con 0x7f831c0cb020 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830400cd20 con 0x7f831c0cb020 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.151+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c13a7e0 con 0x7f831c0cb020 2024-09-13T18:53:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.155+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c0cc6f0 con 0x7f831c0cb020 2024-09-13T18:53:20.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.155+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8304013470 con 0x7f831c0cb020 2024-09-13T18:53:20.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.155+0000 7f8313400700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f8066730 0x7f82f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.155+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f83040843a0 con 0x7f831c0cb020 2024-09-13T18:53:20.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.155+0000 7f831aa00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f8066730 0x7f82f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.159+0000 7f831aa00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f8066730 0x7f82f8068bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f830c009c60 tx=0x7f830c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.163+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83040515d0 con 0x7f831c0cb020 2024-09-13T18:53:20.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.383+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f831c1557a0 con 0x7f831c0cb020 2024-09-13T18:53:20.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f8313400700 1 -- 172.21.15.81:0/3461816589 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f8304054bf0 con 0x7f831c0cb020 2024-09-13T18:53:20.395 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:20.396 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:52:40.994239+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:52:37.994343+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-09-13T18:52:38.976827+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f8066730 msgr2=0x7f82f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f8066730 0x7f82f8068bf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f830c009c60 tx=0x7f830c008030 comp rx=0 tx=0).stop 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 msgr2=0x7f831c1544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 0x7f831c1544a0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f830400ebb0 tx=0x7f830400ef70 comp rx=0 tx=0).stop 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 shutdown_connections 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f8066730 0x7f82f8068bf0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831c15c2a0 0x7f831c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831c0cb020 0x7f831c1544a0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 --2- 172.21.15.81:0/3461816589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f831c06aaa0 0x7f831c137560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 >> 172.21.15.81:0/3461816589 conn(0x7f831c0b0c40 msgr2=0x7f831c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.387+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 shutdown_connections 2024-09-13T18:53:20.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.391+0000 7f831be00700 1 -- 172.21.15.81:0/3461816589 wait complete. 2024-09-13T18:53:20.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:53:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.579+0000 7f3749800700 1 Processor -- start 2024-09-13T18:53:20.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.579+0000 7f3749800700 1 -- start start 2024-09-13T18:53:20.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3749800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37441610b0 0x7f37440719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3749800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f374406aaa0 0x7f374406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3749800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37440b3560 con 0x7f37440b2670 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3749800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3744070b30 con 0x7f37441610b0 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3749800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374406b450 con 0x7f374406aaa0 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37441610b0 0x7f37440719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f37441610b0 0x7f37440719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48634/0 (socket says 172.21.15.81:48634) 2024-09-13T18:53:20.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 -- 172.21.15.81:0/2914570983 learned_addr learned my addr 172.21.15.81:0/2914570983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:20.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f373b400700 1 --2- 172.21.15.81:0/2914570983 >> v2:172.21.15.178:3300/0 conn(0x7f374406aaa0 0x7f374406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 -- 172.21.15.81:0/2914570983 >> v2:172.21.15.178:3300/0 conn(0x7f374406aaa0 msgr2=0x7f374406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:20.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 --2- 172.21.15.81:0/2914570983 >> v2:172.21.15.178:3300/0 conn(0x7f374406aaa0 0x7f374406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 -- 172.21.15.81:0/2914570983 >> v1:172.21.15.178:6789/0 conn(0x7f37440b2670 legacy=0x7f37440b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 -- 172.21.15.81:0/2914570983 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440b3280 con 0x7f37441610b0 2024-09-13T18:53:20.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743e00700 1 --2- 172.21.15.81:0/2914570983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440719c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3734009940 tx=0x7f3734009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c87e377c8af8e33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:20.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.583+0000 7f3743400700 1 -- 172.21.15.81:0/2914570983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734011830 con 0x7f37441610b0 2024-09-13T18:53:20.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3743400700 1 -- 172.21.15.81:0/2914570983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734011990 con 0x7f37441610b0 2024-09-13T18:53:20.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3743400700 1 -- 172.21.15.81:0/2914570983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734011d20 con 0x7f37441610b0 2024-09-13T18:53:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 -- 172.21.15.81:0/2914570983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 msgr2=0x7f37440719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 --2- 172.21.15.81:0/2914570983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440719c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f3734009940 tx=0x7f3734009c50 comp rx=0 tx=0).stop 2024-09-13T18:53:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 -- 172.21.15.81:0/2914570983 shutdown_connections 2024-09-13T18:53:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 --2- 172.21.15.81:0/2914570983 >> v2:172.21.15.178:3300/0 conn(0x7f374406aaa0 0x7f374406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 --2- 172.21.15.81:0/2914570983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440719c0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 -- 172.21.15.81:0/2914570983 >> 172.21.15.81:0/2914570983 conn(0x7f37440b0c40 msgr2=0x7f374406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 -- 172.21.15.81:0/2914570983 shutdown_connections 2024-09-13T18:53:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.587+0000 7f3749800700 1 -- 172.21.15.81:0/2914570983 wait complete. 2024-09-13T18:53:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 Processor -- start 2024-09-13T18:53:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 -- start start 2024-09-13T18:53:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f374406aaa0 0x7f374415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440b2670 0x7f37440cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440a8480 con 0x7f37441610b0 2024-09-13T18:53:20.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37441f78d0 con 0x7f374406aaa0 2024-09-13T18:53:20.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3749800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37440a8720 con 0x7f37440b2670 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48640/0 (socket says 172.21.15.81:48640) 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 -- 172.21.15.81:0/2488502055 learned_addr learned my addr 172.21.15.81:0/2488502055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3743e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f374406aaa0 0x7f374415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f373b400700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440b2670 0x7f37440cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 -- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440b2670 msgr2=0x7f37440cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440b2670 0x7f37440cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 -- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f374406aaa0 msgr2=0x7f374415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f374406aaa0 0x7f374415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 -- 172.21.15.81:0/2488502055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009570 con 0x7f37441610b0 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f373b400700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440b2670 0x7f37440cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3743e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f374406aaa0 0x7f374415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.591+0000 7f3748e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440cddd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f373c00cba0 tx=0x7f373c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c003c20 con 0x7f37441610b0 2024-09-13T18:53:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37440a8a00 con 0x7f37441610b0 2024-09-13T18:53:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c003d80 con 0x7f37441610b0 2024-09-13T18:53:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00abc0 con 0x7f37441610b0 2024-09-13T18:53:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374415ded0 con 0x7f37441610b0 2024-09-13T18:53:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37440a8f20 con 0x7f37441610b0 2024-09-13T18:53:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.595+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f373c00ad20 con 0x7f37441610b0 2024-09-13T18:53:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.599+0000 7f3740c00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3720066760 0x7f3720068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.599+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f373c084400 con 0x7f37441610b0 2024-09-13T18:53:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.599+0000 7f3743e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3720066760 0x7f3720068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:20.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.599+0000 7f3743e00700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3720066760 0x7f3720068c20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3734009890 tx=0x7f3734008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:20.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.603+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f37440a8f20 con 0x7f37441610b0 2024-09-13T18:53:20.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.827+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f37440a8f20 con 0x7f37441610b0 2024-09-13T18:53:20.837 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:53:20.827+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:53:20.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.843+0000 7f3740c00700 1 -- 172.21.15.81:0/2488502055 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f37440a8f20 con 0x7f37441610b0 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3720066760 msgr2=0x7f3720068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3720066760 0x7f3720068c20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3734009890 tx=0x7f3734008030 comp rx=0 tx=0).stop 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 msgr2=0x7f37440cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440cddd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f373c00cba0 tx=0x7f373c00cf60 comp rx=0 tx=0).stop 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 shutdown_connections 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3720066760 0x7f3720068c20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37441610b0 0x7f37440cddd0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37440b2670 0x7f37440cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 --2- 172.21.15.81:0/2488502055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f374406aaa0 0x7f374415d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:20.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 >> 172.21.15.81:0/2488502055 conn(0x7f37440b0c40 msgr2=0x7f37440ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:20.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 shutdown_connections 2024-09-13T18:53:20.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:20.847+0000 7f3749800700 1 -- 172.21.15.81:0/2488502055 wait complete. 2024-09-13T18:53:20.856 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:53:20.864 INFO:tasks.ceph.mds.a.smithi081.stderr: -9347> 2024-09-13T18:52:40.472+0000 7ff670e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:53:20.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:53:20.915 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:53:20.916 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:53:20.923 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:53:21.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.039+0000 7f6451000700 1 Processor -- start 2024-09-13T18:53:21.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.039+0000 7f6451000700 1 -- start start 2024-09-13T18:53:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6451000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c1590a0 0x7f644c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6451000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f644c0cd430 0x7f644c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6451000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c15a540 con 0x7f644c0ccff0 2024-09-13T18:53:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6451000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c0cd8a0 con 0x7f644c0cd430 2024-09-13T18:53:21.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6451000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c159480 con 0x7f644c1590a0 2024-09-13T18:53:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6442a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f644c0ccff0 0x7f644c0b1980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35240/0 (socket says 172.21.15.81:35240) 2024-09-13T18:53:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f6442a00700 1 -- 172.21.15.81:0/4271922716 learned_addr learned my addr 172.21.15.81:0/4271922716 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f644b400700 1 --2- 172.21.15.81:0/4271922716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c1590a0 0x7f644c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:21.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f644be00700 1 --2- 172.21.15.81:0/4271922716 >> v2:172.21.15.178:3300/0 conn(0x7f644c0cd430 0x7f644c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.043+0000 7f644aa00700 1 -- 172.21.15.81:0/4271922716 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418554803 0 0) 0x7f6434001110 con 0x7f644c0ccff0 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644aa00700 1 -- 172.21.15.81:0/4271922716 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64300035d0 con 0x7f644c0ccff0 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644b400700 1 -- 172.21.15.81:0/4271922716 >> v2:172.21.15.178:3300/0 conn(0x7f644c0cd430 msgr2=0x7f644c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644b400700 1 --2- 172.21.15.81:0/4271922716 >> v2:172.21.15.178:3300/0 conn(0x7f644c0cd430 0x7f644c070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644b400700 1 -- 172.21.15.81:0/4271922716 >> v1:172.21.15.81:6789/0 conn(0x7f644c0ccff0 legacy=0x7f644c0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644b400700 1 -- 172.21.15.81:0/4271922716 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c06d560 con 0x7f644c1590a0 2024-09-13T18:53:21.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644b400700 1 --2- 172.21.15.81:0/4271922716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c1590a0 0x7f644c15a000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f643c009850 tx=0x7f643c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed20377807b6360e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644aa00700 1 -- 172.21.15.81:0/4271922716 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011830 con 0x7f644c1590a0 2024-09-13T18:53:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644aa00700 1 -- 172.21.15.81:0/4271922716 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c011990 con 0x7f644c1590a0 2024-09-13T18:53:21.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f644aa00700 1 -- 172.21.15.81:0/4271922716 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011d40 con 0x7f644c1590a0 2024-09-13T18:53:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 -- 172.21.15.81:0/4271922716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c1590a0 msgr2=0x7f644c15a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 --2- 172.21.15.81:0/4271922716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c1590a0 0x7f644c15a000 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f643c009850 tx=0x7f643c009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 -- 172.21.15.81:0/4271922716 shutdown_connections 2024-09-13T18:53:21.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 --2- 172.21.15.81:0/4271922716 >> v2:172.21.15.178:3300/0 conn(0x7f644c0cd430 0x7f644c070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 --2- 172.21.15.81:0/4271922716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c1590a0 0x7f644c15a000 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 -- 172.21.15.81:0/4271922716 >> 172.21.15.81:0/4271922716 conn(0x7f644c06a390 msgr2=0x7f644c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:21.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 -- 172.21.15.81:0/4271922716 shutdown_connections 2024-09-13T18:53:21.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.047+0000 7f6451000700 1 -- 172.21.15.81:0/4271922716 wait complete. 2024-09-13T18:53:21.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 Processor -- start 2024-09-13T18:53:21.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 -- start start 2024-09-13T18:53:21.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c0ccff0 0x7f644c1e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:21.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 0x7f644c14e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:21.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f644c1590a0 0x7f644c1e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:21.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c1e5c30 con 0x7f644c0cd430 2024-09-13T18:53:21.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c1e5950 con 0x7f644c1590a0 2024-09-13T18:53:21.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6451000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c1dfb80 con 0x7f644c0ccff0 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6442a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 0x7f644c14e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6442a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 0x7f644c14e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48684/0 (socket says 172.21.15.81:48684) 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.051+0000 7f6442a00700 1 -- 172.21.15.81:0/1989051269 learned_addr learned my addr 172.21.15.81:0/1989051269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f644b400700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c0ccff0 0x7f644c1e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f644be00700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f644c1590a0 0x7f644c1e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6442a00700 1 -- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c0ccff0 msgr2=0x7f644c1e69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6442a00700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c0ccff0 0x7f644c1e69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6442a00700 1 -- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f644c1590a0 msgr2=0x7f644c1e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:21.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6442a00700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f644c1590a0 0x7f644c1e4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6442a00700 1 -- 172.21.15.81:0/1989051269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0094b0 con 0x7f644c0cd430 2024-09-13T18:53:21.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f644be00700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f644c1590a0 0x7f644c1e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:21.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6442a00700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 0x7f644c14e320 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f643400c410 tx=0x7f643400c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:21.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434005d90 con 0x7f644c0cd430 2024-09-13T18:53:21.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340070d0 con 0x7f644c0cd430 2024-09-13T18:53:21.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c1dfe60 con 0x7f644c0cd430 2024-09-13T18:53:21.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434007460 con 0x7f644c0cd430 2024-09-13T18:53:21.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c1e6f30 con 0x7f644c0cd430 2024-09-13T18:53:21.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.055+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c1df9e0 con 0x7f644c0cd430 2024-09-13T18:53:21.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.059+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64340075c0 con 0x7f644c0cd430 2024-09-13T18:53:21.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.059+0000 7f6443e00700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6428066730 0x7f6428068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:21.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.059+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f6434083700 con 0x7f644c0cd430 2024-09-13T18:53:21.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.059+0000 7f644b400700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6428066730 0x7f6428068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:21.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.063+0000 7f644b400700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6428066730 0x7f6428068bf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f643c0090b0 tx=0x7f643c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:21.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.067+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f644c1df9e0 con 0x7f644c0cd430 2024-09-13T18:53:21.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.287+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f644c1e0380 con 0x7f644c0cd430 2024-09-13T18:53:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.847+0000 7f6443e00700 1 -- 172.21.15.81:0/1989051269 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f644c1e0380 con 0x7f644c0cd430 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6428066730 msgr2=0x7f6428068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6428066730 0x7f6428068bf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f643c0090b0 tx=0x7f643c008030 comp rx=0 tx=0).stop 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 msgr2=0x7f644c14e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 0x7f644c14e320 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f643400c410 tx=0x7f643400c720 comp rx=0 tx=0).stop 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 shutdown_connections 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6428066730 0x7f6428068bf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f644c1590a0 0x7f644c1e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0cd430 0x7f644c14e320 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 --2- 172.21.15.81:0/1989051269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f644c0ccff0 0x7f644c1e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 >> 172.21.15.81:0/1989051269 conn(0x7f644c06a390 msgr2=0x7f644c06ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 shutdown_connections 2024-09-13T18:53:21.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:21.851+0000 7f6451000700 1 -- 172.21.15.81:0/1989051269 wait complete. 2024-09-13T18:53:21.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:53:22.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.091+0000 7fb7fea00700 1 Processor -- start 2024-09-13T18:53:22.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fea00700 1 -- start start 2024-09-13T18:53:22.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7f81586a0 0x7fb7f806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:22.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f80cc6f0 0x7fb7f806c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:22.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fea00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f806d920 con 0x7fb7f80ccb20 2024-09-13T18:53:22.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fea00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f80b1300 con 0x7fb7f80cc6f0 2024-09-13T18:53:22.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fea00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f8070170 con 0x7fb7f81586a0 2024-09-13T18:53:22.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f80cc6f0 0x7fb7f806c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:22.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7f80cc6f0 0x7fb7f806c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48686/0 (socket says 172.21.15.81:48686) 2024-09-13T18:53:22.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 -- 172.21.15.81:0/1624144673 learned_addr learned my addr 172.21.15.81:0/1624144673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:22.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fd600700 1 --2- 172.21.15.81:0/1624144673 >> v2:172.21.15.178:3300/0 conn(0x7fb7f81586a0 0x7fb7f806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:22.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 -- 172.21.15.81:0/1624144673 >> v2:172.21.15.178:3300/0 conn(0x7fb7f81586a0 msgr2=0x7fb7f806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:22.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 --2- 172.21.15.81:0/1624144673 >> v2:172.21.15.178:3300/0 conn(0x7fb7f81586a0 0x7fb7f806fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 -- 172.21.15.81:0/1624144673 >> v1:172.21.15.178:6789/0 conn(0x7fb7f80ccb20 legacy=0x7fb7f815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:22.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 -- 172.21.15.81:0/1624144673 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f806db90 con 0x7fb7f80cc6f0 2024-09-13T18:53:22.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.095+0000 7fb7fcc00700 1 --2- 172.21.15.81:0/1624144673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f80cc6f0 0x7fb7f806c430 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8067bf0 tx=0x7fb7e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f93f21195a3f3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:22.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7f7e00700 1 -- 172.21.15.81:0/1624144673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4011830 con 0x7fb7f80cc6f0 2024-09-13T18:53:22.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7f7e00700 1 -- 172.21.15.81:0/1624144673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4011990 con 0x7fb7f80cc6f0 2024-09-13T18:53:22.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7f7e00700 1 -- 172.21.15.81:0/1624144673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4011d20 con 0x7fb7f80cc6f0 2024-09-13T18:53:22.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 -- 172.21.15.81:0/1624144673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f80cc6f0 msgr2=0x7fb7f806c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 --2- 172.21.15.81:0/1624144673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f80cc6f0 0x7fb7f806c430 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8067bf0 tx=0x7fb7e4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 -- 172.21.15.81:0/1624144673 shutdown_connections 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 --2- 172.21.15.81:0/1624144673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f80cc6f0 0x7fb7f806c430 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 --2- 172.21.15.81:0/1624144673 >> v2:172.21.15.178:3300/0 conn(0x7fb7f81586a0 0x7fb7f806fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 -- 172.21.15.81:0/1624144673 >> 172.21.15.81:0/1624144673 conn(0x7fb7f80b05a0 msgr2=0x7fb7f80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 -- 172.21.15.81:0/1624144673 shutdown_connections 2024-09-13T18:53:22.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.099+0000 7fb7fea00700 1 -- 172.21.15.81:0/1624144673 wait complete. 2024-09-13T18:53:22.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 Processor -- start 2024-09-13T18:53:22.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 -- start start 2024-09-13T18:53:22.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7f80cc6f0 0x7fb7f81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:22.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7f80ccb20 0x7fb7f81e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:22.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 0x7fb7f81e5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:22.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81e4e30 con 0x7fb7f81586a0 2024-09-13T18:53:22.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81e5110 con 0x7fb7f80ccb20 2024-09-13T18:53:22.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fea00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81e53f0 con 0x7fb7f80cc6f0 2024-09-13T18:53:22.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 0x7fb7f81e5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:22.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 0x7fb7f81e5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48696/0 (socket says 172.21.15.81:48696) 2024-09-13T18:53:22.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 -- 172.21.15.81:0/3434754187 learned_addr learned my addr 172.21.15.81:0/3434754187 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:22.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fcc00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7f80ccb20 0x7fb7f81e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fd600700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7f80cc6f0 0x7fb7f81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 -- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7f80cc6f0 msgr2=0x7fb7f81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7f80cc6f0 0x7fb7f81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 -- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7f80ccb20 msgr2=0x7fb7f81e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7f80ccb20 0x7fb7f81e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 -- 172.21.15.81:0/3434754187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4009570 con 0x7fb7f81586a0 2024-09-13T18:53:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fcc00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7f80ccb20 0x7fb7f81e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.103+0000 7fb7fe000700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 0x7fb7f81e5eb0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000cc50 tx=0x7fb7f000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000ad80 con 0x7fb7f81586a0 2024-09-13T18:53:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000ce50 con 0x7fb7f81586a0 2024-09-13T18:53:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f81e56d0 con 0x7fb7f81586a0 2024-09-13T18:53:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0003c60 con 0x7fb7f81586a0 2024-09-13T18:53:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f81e4a50 con 0x7fb7f81586a0 2024-09-13T18:53:22.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f806c430 con 0x7fb7f81586a0 2024-09-13T18:53:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.107+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7f00050d0 con 0x7fb7f81586a0 2024-09-13T18:53:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.111+0000 7fb7f5600700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7d8066730 0x7fb7d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:22.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.111+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6287+0+0 (secure 0 0 0) 0x7fb7f00844c0 con 0x7fb7f81586a0 2024-09-13T18:53:22.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.111+0000 7fb7fd600700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7d8066730 0x7fb7d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:22.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.111+0000 7fb7fd600700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7d8066730 0x7fb7d8068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80ad610 tx=0x7fb7ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:22.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.115+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7f00515e0 con 0x7fb7f81586a0 2024-09-13T18:53:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.299+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb7f815f3e0 con 0x7fb7f81586a0 2024-09-13T18:53:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.859+0000 7fb7f5600700 1 -- 172.21.15.81:0/3434754187 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb7f815f3e0 con 0x7fb7f81586a0 2024-09-13T18:53:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7d8066730 msgr2=0x7fb7d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7d8066730 0x7fb7d8068bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80ad610 tx=0x7fb7ec008040 comp rx=0 tx=0).stop 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 msgr2=0x7fb7f81e5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 0x7fb7f81e5eb0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb7f000cc50 tx=0x7fb7f000a340 comp rx=0 tx=0).stop 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 shutdown_connections 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb7d8066730 0x7fb7d8068bf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7f81586a0 0x7fb7f81e5eb0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7f80ccb20 0x7fb7f81e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 --2- 172.21.15.81:0/3434754187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7f80cc6f0 0x7fb7f81522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 >> 172.21.15.81:0/3434754187 conn(0x7fb7f80b05a0 msgr2=0x7fb7f80afc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 shutdown_connections 2024-09-13T18:53:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:22.863+0000 7fb7fea00700 1 -- 172.21.15.81:0/3434754187 wait complete. 2024-09-13T18:53:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:53:22.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:53:23.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06da400700 1 Processor -- start 2024-09-13T18:53:23.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06da400700 1 -- start start 2024-09-13T18:53:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06da400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06d4144320 0x7f06d40cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06da400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d406a430 con 0x7f06d40b4d60 2024-09-13T18:53:23.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06da400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d406a710 con 0x7f06d40cf520 2024-09-13T18:53:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06da400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d406a9f0 con 0x7f06d4144320 2024-09-13T18:53:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d9a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f06d40b4d60 0x7f06d406b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35244/0 (socket says 172.21.15.81:35244) 2024-09-13T18:53:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d9a00700 1 -- 172.21.15.81:0/1293650369 learned_addr learned my addr 172.21.15.81:0/1293650369 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:23.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d9000700 1 --2- 172.21.15.81:0/1293650369 >> v2:172.21.15.178:3300/0 conn(0x7f06d4144320 0x7f06d40cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d9000700 1 -- 172.21.15.81:0/1293650369 >> v1:172.21.15.178:6789/0 conn(0x7f06d40cf520 legacy=0x7f06d415ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d9000700 1 -- 172.21.15.81:0/1293650369 >> v1:172.21.15.81:6789/0 conn(0x7f06d40b4d60 legacy=0x7f06d406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d9000700 1 -- 172.21.15.81:0/1293650369 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d406acd0 con 0x7f06d4144320 2024-09-13T18:53:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.075+0000 7f06d3400700 1 -- 172.21.15.81:0/1293650369 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946074332 0 0) 0x7f06d406a430 con 0x7f06d40b4d60 2024-09-13T18:53:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06d9000700 1 --2- 172.21.15.81:0/1293650369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d4144320 0x7f06d40cefe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009850 tx=0x7f06c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=376f7989116af8c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06d3400700 1 -- 172.21.15.81:0/1293650369 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8011830 con 0x7f06d4144320 2024-09-13T18:53:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06d3400700 1 -- 172.21.15.81:0/1293650369 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8011990 con 0x7f06d4144320 2024-09-13T18:53:23.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06d3400700 1 -- 172.21.15.81:0/1293650369 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8011d20 con 0x7f06d4144320 2024-09-13T18:53:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 -- 172.21.15.81:0/1293650369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d4144320 msgr2=0x7f06d40cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 --2- 172.21.15.81:0/1293650369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d4144320 0x7f06d40cefe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009850 tx=0x7f06c8009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:23.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 -- 172.21.15.81:0/1293650369 shutdown_connections 2024-09-13T18:53:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 --2- 172.21.15.81:0/1293650369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d4144320 0x7f06d40cefe0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 -- 172.21.15.81:0/1293650369 >> 172.21.15.81:0/1293650369 conn(0x7f06d4070cd0 msgr2=0x7f06d40710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 -- 172.21.15.81:0/1293650369 shutdown_connections 2024-09-13T18:53:23.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.079+0000 7f06da400700 1 -- 172.21.15.81:0/1293650369 wait complete. 2024-09-13T18:53:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 Processor -- start 2024-09-13T18:53:23.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 -- start start 2024-09-13T18:53:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40b4d60 0x7f06d41f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40cf520 0x7f06d4158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 0x7f06d413af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41e56d0 con 0x7f06d4144320 2024-09-13T18:53:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41e59b0 con 0x7f06d40b4d60 2024-09-13T18:53:23.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06da400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41e5c90 con 0x7f06d40cf520 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 0x7f06d413af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 0x7f06d413af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48708/0 (socket says 172.21.15.81:48708) 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 -- 172.21.15.81:0/638863758 learned_addr learned my addr 172.21.15.81:0/638863758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9000700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40b4d60 0x7f06d41f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d3e00700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40cf520 0x7f06d4158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 -- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40cf520 msgr2=0x7f06d4158ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40cf520 0x7f06d4158ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 -- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40b4d60 msgr2=0x7f06d41f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40b4d60 0x7f06d41f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d9a00700 1 -- 172.21.15.81:0/638863758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80094b0 con 0x7f06d4144320 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.083+0000 7f06d3e00700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40cf520 0x7f06d4158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:23.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06d9a00700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 0x7f06d413af10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f06cc002230 tx=0x7f06cc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00ab70 con 0x7f06d4144320 2024-09-13T18:53:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc00acf0 con 0x7f06d4144320 2024-09-13T18:53:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc007310 con 0x7f06d4144320 2024-09-13T18:53:23.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d41e5f70 con 0x7f06d4144320 2024-09-13T18:53:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d4158ff0 con 0x7f06d4144320 2024-09-13T18:53:23.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.087+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d41e6490 con 0x7f06d4144320 2024-09-13T18:53:23.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.091+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06cc007470 con 0x7f06d4144320 2024-09-13T18:53:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.091+0000 7f06d0c00700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06b4066730 0x7f06b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:23.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.091+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f06cc083e70 con 0x7f06d4144320 2024-09-13T18:53:23.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.091+0000 7f06d9000700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06b4066730 0x7f06b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:23.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.091+0000 7f06d9000700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06b4066730 0x7f06b4068bf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f06c8014040 tx=0x7f06c801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:23.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.099+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06d41e6490 con 0x7f06d4144320 2024-09-13T18:53:23.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.283+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f06d41e6490 con 0x7f06d4144320 2024-09-13T18:53:23.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.867+0000 7f06d0c00700 1 -- 172.21.15.81:0/638863758 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7f06d41e6490 con 0x7f06d4144320 2024-09-13T18:53:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06b4066730 msgr2=0x7f06b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06b4066730 0x7f06b4068bf0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f06c8014040 tx=0x7f06c801c040 comp rx=0 tx=0).stop 2024-09-13T18:53:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 msgr2=0x7f06d413af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 0x7f06d413af10 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f06cc002230 tx=0x7f06cc00cf50 comp rx=0 tx=0).stop 2024-09-13T18:53:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 shutdown_connections 2024-09-13T18:53:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06b4066730 0x7f06b4068bf0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d4144320 0x7f06d413af10 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40cf520 0x7f06d4158ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 --2- 172.21.15.81:0/638863758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40b4d60 0x7f06d41f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 >> 172.21.15.81:0/638863758 conn(0x7f06d4070cd0 msgr2=0x7f06d4140b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 shutdown_connections 2024-09-13T18:53:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:23.875+0000 7f06da400700 1 -- 172.21.15.81:0/638863758 wait complete. 2024-09-13T18:53:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:53:23.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:53:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.067+0000 7fa561600700 1 Processor -- start 2024-09-13T18:53:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.067+0000 7fa561600700 1 -- start start 2024-09-13T18:53:24.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa561600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa55c1590a0 0x7fa55c15a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa561600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c0cd460 0x7fa55c070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa561600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c15a540 con 0x7fa55c0ccff0 2024-09-13T18:53:24.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa561600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0cd890 con 0x7fa55c1590a0 2024-09-13T18:53:24.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa561600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c159480 con 0x7fa55c0cd460 2024-09-13T18:53:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa55b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa55c0ccff0 0x7fa55c0b1980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35250/0 (socket says 172.21.15.81:35250) 2024-09-13T18:53:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa55b400700 1 -- 172.21.15.81:0/4136009595 learned_addr learned my addr 172.21.15.81:0/4136009595 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa560c00700 1 --2- 172.21.15.81:0/4136009595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c0cd460 0x7fa55c070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa55be00700 1 --2- 172.21.15.81:0/4136009595 >> v2:172.21.15.178:3300/0 conn(0x7fa55c1590a0 0x7fa55c15a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa55aa00700 1 -- 172.21.15.81:0/4136009595 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891456982 0 0) 0x7fa544001110 con 0x7fa55c0ccff0 2024-09-13T18:53:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa55aa00700 1 -- 172.21.15.81:0/4136009595 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5400057e0 con 0x7fa55c0ccff0 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa560c00700 1 -- 172.21.15.81:0/4136009595 >> v2:172.21.15.178:3300/0 conn(0x7fa55c1590a0 msgr2=0x7fa55c15a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa560c00700 1 --2- 172.21.15.81:0/4136009595 >> v2:172.21.15.178:3300/0 conn(0x7fa55c1590a0 0x7fa55c15a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa560c00700 1 -- 172.21.15.81:0/4136009595 >> v1:172.21.15.81:6789/0 conn(0x7fa55c0ccff0 legacy=0x7fa55c0b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa560c00700 1 -- 172.21.15.81:0/4136009595 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c06d560 con 0x7fa55c0cd460 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.071+0000 7fa560c00700 1 --2- 172.21.15.81:0/4136009595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c0cd460 0x7fa55c070f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa554009d90 tx=0x7fa55400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66eba71f56a4ddc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa55aa00700 1 -- 172.21.15.81:0/4136009595 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400e070 con 0x7fa55c0cd460 2024-09-13T18:53:24.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa55aa00700 1 -- 172.21.15.81:0/4136009595 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400bb20 con 0x7fa55c0cd460 2024-09-13T18:53:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa55aa00700 1 -- 172.21.15.81:0/4136009595 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554012430 con 0x7fa55c0cd460 2024-09-13T18:53:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 -- 172.21.15.81:0/4136009595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c0cd460 msgr2=0x7fa55c070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 --2- 172.21.15.81:0/4136009595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c0cd460 0x7fa55c070f50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa554009d90 tx=0x7fa55400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 -- 172.21.15.81:0/4136009595 shutdown_connections 2024-09-13T18:53:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 --2- 172.21.15.81:0/4136009595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c0cd460 0x7fa55c070f50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 --2- 172.21.15.81:0/4136009595 >> v2:172.21.15.178:3300/0 conn(0x7fa55c1590a0 0x7fa55c15a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 -- 172.21.15.81:0/4136009595 >> 172.21.15.81:0/4136009595 conn(0x7fa55c06a390 msgr2=0x7fa55c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 -- 172.21.15.81:0/4136009595 shutdown_connections 2024-09-13T18:53:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.075+0000 7fa561600700 1 -- 172.21.15.81:0/4136009595 wait complete. 2024-09-13T18:53:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 Processor -- start 2024-09-13T18:53:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 -- start start 2024-09-13T18:53:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 0x7fa55c1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa55c0cd460 0x7fa55c156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c1590a0 0x7fa55c156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c146510 con 0x7fa55c0ccff0 2024-09-13T18:53:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c1fb5c0 con 0x7fa55c0cd460 2024-09-13T18:53:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa561600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c145b70 con 0x7fa55c1590a0 2024-09-13T18:53:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 0x7fa55c1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 0x7fa55c1f4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48710/0 (socket says 172.21.15.81:48710) 2024-09-13T18:53:24.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 -- 172.21.15.81:0/674522612 learned_addr learned my addr 172.21.15.81:0/674522612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:24.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa560c00700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c1590a0 0x7fa55c156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 -- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c1590a0 msgr2=0x7fa55c156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55b400700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa55c0cd460 0x7fa55c156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c1590a0 0x7fa55c156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 -- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa55c0cd460 msgr2=0x7fa55c156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.079+0000 7fa55be00700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa55c0cd460 0x7fa55c156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa55be00700 1 -- 172.21.15.81:0/674522612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554009a70 con 0x7fa55c0ccff0 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa560c00700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c1590a0 0x7fa55c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa55b400700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa55c0cd460 0x7fa55c156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa55be00700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 0x7fa55c1f4540 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e9d0 tx=0x7fa54c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c009720 con 0x7fa55c0ccff0 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c00c850 con 0x7fa55c0ccff0 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c145e50 con 0x7fa55c0ccff0 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00cbc0 con 0x7fa55c0ccff0 2024-09-13T18:53:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c146930 con 0x7fa55c0ccff0 2024-09-13T18:53:24.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.083+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c06cef0 con 0x7fa55c0ccff0 2024-09-13T18:53:24.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.087+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa54c00cd20 con 0x7fa55c0ccff0 2024-09-13T18:53:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.087+0000 7fa553e00700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa538066730 0x7fa538068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.087+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fa54c084140 con 0x7fa55c0ccff0 2024-09-13T18:53:24.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.087+0000 7fa55b400700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa538066730 0x7fa538068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.091+0000 7fa55b400700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa538066730 0x7fa538068bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa55c157270 tx=0x7fa544009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:24.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.095+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa54c0515b0 con 0x7fa55c0ccff0 2024-09-13T18:53:24.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.275+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa55c0cc410 con 0x7fa55c0ccff0 2024-09-13T18:53:24.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.283+0000 7fa553e00700 1 -- 172.21.15.81:0/674522612 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa54c054bd0 con 0x7fa55c0ccff0 2024-09-13T18:53:24.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa538066730 msgr2=0x7fa538068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa538066730 0x7fa538068bf0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa55c157270 tx=0x7fa544009040 comp rx=0 tx=0).stop 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 msgr2=0x7fa55c1f4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 0x7fa55c1f4540 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e9d0 tx=0x7fa54c00ed90 comp rx=0 tx=0).stop 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 shutdown_connections 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa538066730 0x7fa538068bf0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa55c1590a0 0x7fa55c156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa55c0cd460 0x7fa55c156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 --2- 172.21.15.81:0/674522612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa55c0ccff0 0x7fa55c1f4540 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 >> 172.21.15.81:0/674522612 conn(0x7fa55c06a390 msgr2=0x7fa55c0b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 shutdown_connections 2024-09-13T18:53:24.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.287+0000 7fa561600700 1 -- 172.21.15.81:0/674522612 wait complete. 2024-09-13T18:53:24.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2024-09-13T18:53:24.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 Processor -- start 2024-09-13T18:53:24.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 -- start start 2024-09-13T18:53:24.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1aac1610b0 0x7f1aac0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1aac0b2670 0x7f1aac0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac070b30 con 0x7f1aac0b2670 2024-09-13T18:53:24.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0b3040 con 0x7f1aac1610b0 2024-09-13T18:53:24.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aabe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0b3560 con 0x7f1aac06aaa0 2024-09-13T18:53:24.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aab400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1aac0b2670 0x7f1aac0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aab400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1aac0b2670 0x7f1aac0b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48726/0 (socket says 172.21.15.81:48726) 2024-09-13T18:53:24.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aab400700 1 -- 172.21.15.81:0/3036720555 learned_addr learned my addr 172.21.15.81:0/3036720555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:24.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aaaa00700 1 --2- 172.21.15.81:0/3036720555 >> v2:172.21.15.178:3300/0 conn(0x7f1aac1610b0 0x7f1aac0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.479+0000 7f1aaa000700 1 --2- 172.21.15.81:0/3036720555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aab400700 1 -- 172.21.15.81:0/3036720555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 msgr2=0x7f1aac06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:24.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aab400700 1 --2- 172.21.15.81:0/3036720555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aab400700 1 -- 172.21.15.81:0/3036720555 >> v2:172.21.15.178:3300/0 conn(0x7f1aac1610b0 msgr2=0x7f1aac0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:24.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aab400700 1 --2- 172.21.15.81:0/3036720555 >> v2:172.21.15.178:3300/0 conn(0x7f1aac1610b0 0x7f1aac0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aab400700 1 -- 172.21.15.81:0/3036720555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac06b420 con 0x7f1aac0b2670 2024-09-13T18:53:24.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aaaa00700 1 --2- 172.21.15.81:0/3036720555 >> v2:172.21.15.178:3300/0 conn(0x7f1aac1610b0 0x7f1aac0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:24.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aab400700 1 --2- 172.21.15.81:0/3036720555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac0b2670 0x7f1aac0b2b00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1aac06b660 tx=0x7f1aa400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d2ed37f25ce656 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:24.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aa9600700 1 -- 172.21.15.81:0/3036720555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400e070 con 0x7f1aac0b2670 2024-09-13T18:53:24.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aa9600700 1 -- 172.21.15.81:0/3036720555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400b910 con 0x7f1aac0b2670 2024-09-13T18:53:24.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aa9600700 1 -- 172.21.15.81:0/3036720555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400bcc0 con 0x7f1aac0b2670 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 -- 172.21.15.81:0/3036720555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac0b2670 msgr2=0x7f1aac0b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 --2- 172.21.15.81:0/3036720555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac0b2670 0x7f1aac0b2b00 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1aac06b660 tx=0x7f1aa400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 -- 172.21.15.81:0/3036720555 shutdown_connections 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 --2- 172.21.15.81:0/3036720555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac0b2670 0x7f1aac0b2b00 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 --2- 172.21.15.81:0/3036720555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 --2- 172.21.15.81:0/3036720555 >> v2:172.21.15.178:3300/0 conn(0x7f1aac1610b0 0x7f1aac0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 -- 172.21.15.81:0/3036720555 >> 172.21.15.81:0/3036720555 conn(0x7f1aac0b0c40 msgr2=0x7f1aac06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 -- 172.21.15.81:0/3036720555 shutdown_connections 2024-09-13T18:53:24.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.483+0000 7f1aabe00700 1 -- 172.21.15.81:0/3036720555 wait complete. 2024-09-13T18:53:24.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 Processor -- start 2024-09-13T18:53:24.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 -- start start 2024-09-13T18:53:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac162550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1aac0b2670 0x7f1aac163c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 0x7f1aac1641b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac159360 con 0x7f1aac1610b0 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac162a90 con 0x7f1aac0b2670 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.487+0000 7f1aabe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac1646f0 con 0x7f1aac06aaa0 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 0x7f1aac1641b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 0x7f1aac1641b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48728/0 (socket says 172.21.15.81:48728) 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 -- 172.21.15.81:0/42218824 learned_addr learned my addr 172.21.15.81:0/42218824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aaaa00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac162550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aaa000700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1aac0b2670 0x7f1aac163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 -- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 msgr2=0x7f1aac162550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac162550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 -- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1aac0b2670 msgr2=0x7f1aac163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1aac0b2670 0x7f1aac163c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 -- 172.21.15.81:0/42218824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c0094b0 con 0x7f1aac1610b0 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aab400700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 0x7f1aac1641b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0b1690 tx=0x7f1aa4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40092e0 con 0x7f1aac1610b0 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400ce80 con 0x7f1aac1610b0 2024-09-13T18:53:24.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4009b30 con 0x7f1aac1610b0 2024-09-13T18:53:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40044b0 con 0x7f1aac1610b0 2024-09-13T18:53:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac1595b0 con 0x7f1aac1610b0 2024-09-13T18:53:24.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.491+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac0afc70 con 0x7f1aac1610b0 2024-09-13T18:53:24.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.495+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1aa4004610 con 0x7f1aac1610b0 2024-09-13T18:53:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.495+0000 7f1aa2a00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a8c066730 0x7f1a8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.495+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f1aa40853d0 con 0x7f1aac1610b0 2024-09-13T18:53:24.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.495+0000 7f1aaaa00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a8c066730 0x7f1a8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:24.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.499+0000 7f1aaaa00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a8c066730 0x7f1a8c068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1aac04e8d0 tx=0x7f1a9c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:24.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.503+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1aa4056380 con 0x7f1aac1610b0 2024-09-13T18:53:24.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.771+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) v1 -- 0x7f1aac0cae50 con 0x7f1aac1610b0 2024-09-13T18:53:24.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.871+0000 7f1aa2a00700 1 -- 172.21.15.81:0/42218824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v323) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1aa4055f10 con 0x7f1aac1610b0 2024-09-13T18:53:24.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a8c066730 msgr2=0x7f1a8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a8c066730 0x7f1a8c068bf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1aac04e8d0 tx=0x7f1a9c009240 comp rx=0 tx=0).stop 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 msgr2=0x7f1aac1641b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 0x7f1aac1641b0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1aac0b1690 tx=0x7f1aa4004af0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 shutdown_connections 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1a8c066730 0x7f1a8c068bf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1aac1610b0 0x7f1aac1641b0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1aac0b2670 0x7f1aac163c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 --2- 172.21.15.81:0/42218824 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1aac06aaa0 0x7f1aac162550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 >> 172.21.15.81:0/42218824 conn(0x7f1aac0b0c40 msgr2=0x7f1aac06d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 shutdown_connections 2024-09-13T18:53:24.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:24.875+0000 7f1aabe00700 1 -- 172.21.15.81:0/42218824 wait complete. 2024-09-13T18:53:24.909 INFO:tasks.cephfs_test_runner:test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-13T18:53:24.909 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-13T18:53:24.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 Processor -- start 2024-09-13T18:53:25.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 -- start start 2024-09-13T18:53:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f03c40cb020 0x7f03c40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c406b430 con 0x7f03c415c2a0 2024-09-13T18:53:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c40b2ad0 con 0x7f03c40cb020 2024-09-13T18:53:25.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03cac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c415b960 con 0x7f03c406aaa0 2024-09-13T18:53:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03c8e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03c415c2a0 0x7f03c415b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35258/0 (socket says 172.21.15.81:35258) 2024-09-13T18:53:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03c8e00700 1 -- 172.21.15.81:0/3686680686 learned_addr learned my addr 172.21.15.81:0/3686680686 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.075+0000 7f03c9800700 1 --2- 172.21.15.81:0/3686680686 >> v2:172.21.15.178:3300/0 conn(0x7f03c40cb020 0x7f03c40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03ca200700 1 --2- 172.21.15.81:0/3686680686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03c3e00700 1 -- 172.21.15.81:0/3686680686 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140607289 0 0) 0x7f03b0001110 con 0x7f03c415c2a0 2024-09-13T18:53:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03c3e00700 1 -- 172.21.15.81:0/3686680686 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03ac0035d0 con 0x7f03c415c2a0 2024-09-13T18:53:25.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03ca200700 1 -- 172.21.15.81:0/3686680686 >> v2:172.21.15.178:3300/0 conn(0x7f03c40cb020 msgr2=0x7f03c40cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03ca200700 1 --2- 172.21.15.81:0/3686680686 >> v2:172.21.15.178:3300/0 conn(0x7f03c40cb020 0x7f03c40cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03ca200700 1 -- 172.21.15.81:0/3686680686 >> v1:172.21.15.81:6789/0 conn(0x7f03c415c2a0 legacy=0x7f03c415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03ca200700 1 -- 172.21.15.81:0/3686680686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c415bc40 con 0x7f03c406aaa0 2024-09-13T18:53:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03c9800700 1 --2- 172.21.15.81:0/3686680686 >> v2:172.21.15.178:3300/0 conn(0x7f03c40cb020 0x7f03c40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:25.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03ca200700 1 --2- 172.21.15.81:0/3686680686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c406aef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009d90 tx=0x7f03bc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7acadc4f4dcac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03c3e00700 1 -- 172.21.15.81:0/3686680686 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00e070 con 0x7f03c406aaa0 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03c3e00700 1 -- 172.21.15.81:0/3686680686 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00bb20 con 0x7f03c406aaa0 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03c3e00700 1 -- 172.21.15.81:0/3686680686 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc012430 con 0x7f03c406aaa0 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 -- 172.21.15.81:0/3686680686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 msgr2=0x7f03c406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 --2- 172.21.15.81:0/3686680686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c406aef0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009d90 tx=0x7f03bc00b330 comp rx=0 tx=0).stop 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 -- 172.21.15.81:0/3686680686 shutdown_connections 2024-09-13T18:53:25.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 --2- 172.21.15.81:0/3686680686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c406aef0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 --2- 172.21.15.81:0/3686680686 >> v2:172.21.15.178:3300/0 conn(0x7f03c40cb020 0x7f03c40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 -- 172.21.15.81:0/3686680686 >> 172.21.15.81:0/3686680686 conn(0x7f03c40b0c40 msgr2=0x7f03c406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:25.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 -- 172.21.15.81:0/3686680686 shutdown_connections 2024-09-13T18:53:25.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.079+0000 7f03cac00700 1 -- 172.21.15.81:0/3686680686 wait complete. 2024-09-13T18:53:25.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 Processor -- start 2024-09-13T18:53:25.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 -- start start 2024-09-13T18:53:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c414c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c40cb020 0x7f03c4145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 0x7f03c40c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c414eaa0 con 0x7f03c415c2a0 2024-09-13T18:53:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40ca350 con 0x7f03c40cb020 2024-09-13T18:53:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03cac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4155890 con 0x7f03c406aaa0 2024-09-13T18:53:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03ca200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 0x7f03c40c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03ca200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 0x7f03c40c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48734/0 (socket says 172.21.15.81:48734) 2024-09-13T18:53:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03ca200700 1 -- 172.21.15.81:0/1042712779 learned_addr learned my addr 172.21.15.81:0/1042712779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03c9800700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c414c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.083+0000 7f03c8e00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c40cb020 0x7f03c4145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03ca200700 1 -- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 msgr2=0x7f03c414c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03ca200700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c414c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03ca200700 1 -- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c40cb020 msgr2=0x7f03c4145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03ca200700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c40cb020 0x7f03c4145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03ca200700 1 -- 172.21.15.81:0/1042712779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b80094b0 con 0x7f03c415c2a0 2024-09-13T18:53:25.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03ca200700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 0x7f03c40c9e10 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f03c415baa0 tx=0x7f03bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc012430 con 0x7f03c415c2a0 2024-09-13T18:53:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc020070 con 0x7f03c415c2a0 2024-09-13T18:53:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc009a70 con 0x7f03c415c2a0 2024-09-13T18:53:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0098f0 con 0x7f03c415c2a0 2024-09-13T18:53:25.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c414ecf0 con 0x7f03c415c2a0 2024-09-13T18:53:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.087+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c4157cf0 con 0x7f03c415c2a0 2024-09-13T18:53:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.091+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03bc004040 con 0x7f03c415c2a0 2024-09-13T18:53:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.091+0000 7f03c1600700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03a4066730 0x7f03a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.091+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f03bc022070 con 0x7f03c415c2a0 2024-09-13T18:53:25.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.091+0000 7f03c9800700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03a4066730 0x7f03a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.095+0000 7f03c9800700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03a4066730 0x7f03a4068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009d80 tx=0x7f03b8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.099+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03c4157cf0 con 0x7f03c415c2a0 2024-09-13T18:53:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.287+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03c4157cf0 con 0x7f03c415c2a0 2024-09-13T18:53:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.291+0000 7f03c1600700 1 -- 172.21.15.81:0/1042712779 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13454 (secure 0 0 0) 0x7f03c4157cf0 con 0x7f03c415c2a0 2024-09-13T18:53:25.300 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:25.300 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:53:23.857561+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6836/3243728894":"2024-09-14T18:53:20.831145+0000","172.21.15.81:6837/3243728894":"2024-09-14T18:53:20.831145+0000","172.21.15.178:6835/3142422230":"2024-09-14T18:53:20.831109+0000","172.21.15.178:6834/3142422230":"2024-09-14T18:53:20.831109+0000","172.21.15.81:6835/3178710454":"2024-09-14T18:53:20.831133+0000","172.21.15.81:6834/3178710454":"2024-09-14T18:53:20.831133+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:25.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.291+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03a4066730 msgr2=0x7f03a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.291+0000 7f03cac00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03a4066730 0x7f03a4068bf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009d80 tx=0x7f03b8009240 comp rx=0 tx=0).stop 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.291+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 msgr2=0x7f03c40c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.291+0000 7f03cac00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 0x7f03c40c9e10 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f03c415baa0 tx=0x7f03bc004af0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 shutdown_connections 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f03a4066730 0x7f03a4068bf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c415c2a0 0x7f03c40c9e10 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03c40cb020 0x7f03c4145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 --2- 172.21.15.81:0/1042712779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03c406aaa0 0x7f03c414c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 >> 172.21.15.81:0/1042712779 conn(0x7f03c40b0c40 msgr2=0x7f03c414f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 shutdown_connections 2024-09-13T18:53:25.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.295+0000 7f03cac00700 1 -- 172.21.15.81:0/1042712779 wait complete. 2024-09-13T18:53:25.326 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:53:25.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:53:25.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.495+0000 7fcf82600700 1 Processor -- start 2024-09-13T18:53:25.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.495+0000 7fcf82600700 1 -- start start 2024-09-13T18:53:25.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf82600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf7c06d760 0x7fcf7c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf82600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf7c144710 0x7fcf7c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf82600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c06bcf0 con 0x7fcf7c144330 2024-09-13T18:53:25.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf82600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c0cce10 con 0x7fcf7c144710 2024-09-13T18:53:25.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf82600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c06cb50 con 0x7fcf7c06d760 2024-09-13T18:53:25.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf7c144710 0x7fcf7c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7aa00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf7c06d760 0x7fcf7c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcf7c144710 0x7fcf7c0b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48744/0 (socket says 172.21.15.81:48744) 2024-09-13T18:53:25.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 -- 172.21.15.81:0/2488022434 learned_addr learned my addr 172.21.15.81:0/2488022434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:25.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7b400700 1 --1- 172.21.15.81:0/2488022434 >> v1:172.21.15.178:6789/0 conn(0x7fcf7c144330 0x7fcf7c0cef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:60744/0 (socket says 172.21.15.81:60744) 2024-09-13T18:53:25.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 -- 172.21.15.81:0/2488022434 >> v2:172.21.15.178:3300/0 conn(0x7fcf7c06d760 msgr2=0x7fcf7c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:25.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 --2- 172.21.15.81:0/2488022434 >> v2:172.21.15.178:3300/0 conn(0x7fcf7c06d760 0x7fcf7c0b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 -- 172.21.15.81:0/2488022434 >> v1:172.21.15.178:6789/0 conn(0x7fcf7c144330 legacy=0x7fcf7c0cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 -- 172.21.15.81:0/2488022434 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c06bf40 con 0x7fcf7c144710 2024-09-13T18:53:25.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7a000700 1 -- 172.21.15.81:0/2488022434 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698318026 0 0) 0x7fcf7c06bcf0 con 0x7fcf7c144330 2024-09-13T18:53:25.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7be00700 1 --2- 172.21.15.81:0/2488022434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144710 0x7fcf7c0b3ae0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0ce900 tx=0x7fcf7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d93a25998db00e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7a000700 1 -- 172.21.15.81:0/2488022434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400e070 con 0x7fcf7c144710 2024-09-13T18:53:25.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7a000700 1 -- 172.21.15.81:0/2488022434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7400b910 con 0x7fcf7c144710 2024-09-13T18:53:25.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.499+0000 7fcf7a000700 1 -- 172.21.15.81:0/2488022434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400bcc0 con 0x7fcf7c144710 2024-09-13T18:53:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 -- 172.21.15.81:0/2488022434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144710 msgr2=0x7fcf7c0b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 --2- 172.21.15.81:0/2488022434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144710 0x7fcf7c0b3ae0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0ce900 tx=0x7fcf7400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 -- 172.21.15.81:0/2488022434 shutdown_connections 2024-09-13T18:53:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 --2- 172.21.15.81:0/2488022434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144710 0x7fcf7c0b3ae0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 --2- 172.21.15.81:0/2488022434 >> v2:172.21.15.178:3300/0 conn(0x7fcf7c06d760 0x7fcf7c0b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 -- 172.21.15.81:0/2488022434 >> 172.21.15.81:0/2488022434 conn(0x7fcf7c06a570 msgr2=0x7fcf7c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 -- 172.21.15.81:0/2488022434 shutdown_connections 2024-09-13T18:53:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.503+0000 7fcf82600700 1 -- 172.21.15.81:0/2488022434 wait complete. 2024-09-13T18:53:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 Processor -- start 2024-09-13T18:53:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 -- start start 2024-09-13T18:53:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7c06d760 0x7fcf7c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 0x7fcf7c137380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7c13f3f0 0x7fcf7c13f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c140690 con 0x7fcf7c144330 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c15ae70 con 0x7fcf7c06d760 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c1403b0 con 0x7fcf7c13f3f0 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 0x7fcf7c137380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 0x7fcf7c137380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48746/0 (socket says 172.21.15.81:48746) 2024-09-13T18:53:25.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 -- 172.21.15.81:0/1249413595 learned_addr learned my addr 172.21.15.81:0/1249413595 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7be00700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7c13f3f0 0x7fcf7c13f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 -- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7c13f3f0 msgr2=0x7fcf7c13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7b400700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7c06d760 0x7fcf7c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7c13f3f0 0x7fcf7c13f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 -- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7c06d760 msgr2=0x7fcf7c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7c06d760 0x7fcf7c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 -- 172.21.15.81:0/1249413595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74009b30 con 0x7fcf7c144330 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7b400700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7c06d760 0x7fcf7c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf7aa00700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 0x7fcf7c137380 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800e9a0 tx=0x7fcf6800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68009720 con 0x7fcf7c144330 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6800c7f0 con 0x7fcf7c144330 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800cba0 con 0x7fcf7c144330 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.507+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c0b3070 con 0x7fcf7c144330 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.511+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c13d400 con 0x7fcf7c144330 2024-09-13T18:53:25.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.511+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7c0ae6d0 con 0x7fcf7c144330 2024-09-13T18:53:25.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.511+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf6800cd00 con 0x7fcf7c144330 2024-09-13T18:53:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.515+0000 7fcf73400700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf5c066760 0x7fcf5c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.515+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fcf68084490 con 0x7fcf7c144330 2024-09-13T18:53:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.515+0000 7fcf7b400700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf5c066760 0x7fcf5c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.515+0000 7fcf7b400700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf5c066760 0x7fcf5c068c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000f60 tx=0x7fcf6c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.519+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf7c0ae6d0 con 0x7fcf7c144330 2024-09-13T18:53:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.699+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf7c0ae6d0 con 0x7fcf7c144330 2024-09-13T18:53:25.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf73400700 1 -- 172.21.15.81:0/1249413595 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf7c0ae6d0 con 0x7fcf7c144330 2024-09-13T18:53:25.710 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:53:25.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf5c066760 msgr2=0x7fcf5c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf5c066760 0x7fcf5c068c20 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c000f60 tx=0x7fcf6c009040 comp rx=0 tx=0).stop 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 msgr2=0x7fcf7c137380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 0x7fcf7c137380 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800e9a0 tx=0x7fcf6800ed60 comp rx=0 tx=0).stop 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 shutdown_connections 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf5c066760 0x7fcf5c068c20 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7c13f3f0 0x7fcf7c13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7c144330 0x7fcf7c137380 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 --2- 172.21.15.81:0/1249413595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf7c06d760 0x7fcf7c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 >> 172.21.15.81:0/1249413595 conn(0x7fcf7c06a570 msgr2=0x7fcf7c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 shutdown_connections 2024-09-13T18:53:25.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.703+0000 7fcf82600700 1 -- 172.21.15.81:0/1249413595 wait complete. 2024-09-13T18:53:25.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2024-09-13T18:53:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.887+0000 7fee1fe00700 1 Processor -- start 2024-09-13T18:53:25.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.887+0000 7fee1fe00700 1 -- start start 2024-09-13T18:53:25.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200b5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee2006b5b0 0x7fee2006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee200b4a00 con 0x7fee200b2a60 2024-09-13T18:53:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200b4c70 con 0x7fee2006b5b0 2024-09-13T18:53:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee200b4f50 con 0x7fee20145ea0 2024-09-13T18:53:25.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee2006b5b0 0x7fee2006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1f400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee200b2a60 0x7fee200d0a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35266/0 (socket says 172.21.15.81:35266) 2024-09-13T18:53:25.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1f400700 1 -- 172.21.15.81:0/1268084778 learned_addr learned my addr 172.21.15.81:0/1268084778 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:25.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee2006b5b0 0x7fee2006cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48752/0 (socket says 172.21.15.81:48752) 2024-09-13T18:53:25.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1ea00700 1 --2- 172.21.15.81:0/1268084778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200b5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 -- 172.21.15.81:0/1268084778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 msgr2=0x7fee200b5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 --2- 172.21.15.81:0/1268084778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200b5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 -- 172.21.15.81:0/1268084778 >> v1:172.21.15.81:6789/0 conn(0x7fee200b2a60 legacy=0x7fee200d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 -- 172.21.15.81:0/1268084778 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200b5230 con 0x7fee2006b5b0 2024-09-13T18:53:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee1e000700 1 -- 172.21.15.81:0/1268084778 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443018227 0 0) 0x7fee200b4a00 con 0x7fee200b2a60 2024-09-13T18:53:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.891+0000 7fee17e00700 1 --2- 172.21.15.81:0/1268084778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2006cf40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fee08009850 tx=0x7fee08009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2833ad4a10c72d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1e000700 1 -- 172.21.15.81:0/1268084778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011830 con 0x7fee2006b5b0 2024-09-13T18:53:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1e000700 1 -- 172.21.15.81:0/1268084778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08011990 con 0x7fee2006b5b0 2024-09-13T18:53:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1e000700 1 -- 172.21.15.81:0/1268084778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08011d40 con 0x7fee2006b5b0 2024-09-13T18:53:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 -- 172.21.15.81:0/1268084778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 msgr2=0x7fee2006cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1268084778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2006cf40 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fee08009850 tx=0x7fee08009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 -- 172.21.15.81:0/1268084778 shutdown_connections 2024-09-13T18:53:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1268084778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2006cf40 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1268084778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200b5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 -- 172.21.15.81:0/1268084778 >> 172.21.15.81:0/1268084778 conn(0x7fee20071d90 msgr2=0x7fee20072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 -- 172.21.15.81:0/1268084778 shutdown_connections 2024-09-13T18:53:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 -- 172.21.15.81:0/1268084778 wait complete. 2024-09-13T18:53:25.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.895+0000 7fee1fe00700 1 Processor -- start 2024-09-13T18:53:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 -- start start 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2013bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee200b2a60 0x7fee200d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee200ca520 con 0x7fee2006b5b0 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2013d8e0 con 0x7fee200b2a60 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2013dd70 con 0x7fee20145ea0 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2013bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2013bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48768/0 (socket says 172.21.15.81:48768) 2024-09-13T18:53:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 -- 172.21.15.81:0/1399754596 learned_addr learned my addr 172.21.15.81:0/1399754596 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1f400700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee17e00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee200b2a60 0x7fee200d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 -- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 msgr2=0x7fee200d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 -- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee200b2a60 msgr2=0x7fee200d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee200b2a60 0x7fee200d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 -- 172.21.15.81:0/1399754596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080094b0 con 0x7fee2006b5b0 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee17e00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee200b2a60 0x7fee200d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:25.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1ea00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2013bc00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fee1000e870 tx=0x7fee1000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee100095a0 con 0x7fee2006b5b0 2024-09-13T18:53:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000ee70 con 0x7fee2006b5b0 2024-09-13T18:53:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee201440a0 con 0x7fee2006b5b0 2024-09-13T18:53:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000ca50 con 0x7fee2006b5b0 2024-09-13T18:53:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.899+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2013cfb0 con 0x7fee2006b5b0 2024-09-13T18:53:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.903+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2006cf40 con 0x7fee2006b5b0 2024-09-13T18:53:25.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.903+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee1000cbb0 con 0x7fee2006b5b0 2024-09-13T18:53:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.907+0000 7fee16a00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fedfc066730 0x7fedfc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.907+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fee10084070 con 0x7fee2006b5b0 2024-09-13T18:53:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.907+0000 7fee17e00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fedfc066730 0x7fedfc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:25.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.907+0000 7fee17e00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fedfc066730 0x7fedfc068bf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fee2015af90 tx=0x7fee08008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:25.911+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee100b5db0 con 0x7fee2006b5b0 2024-09-13T18:53:26.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.163+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) v1 -- 0x7fee2015ca90 con 0x7fee2006b5b0 2024-09-13T18:53:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.883+0000 7fee16a00700 1 -- 172.21.15.81:0/1399754596 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v325) v1 ==== 157+0+0 (secure 0 0 0) 0x7fee100514e0 con 0x7fee2006b5b0 2024-09-13T18:53:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fedfc066730 msgr2=0x7fedfc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fedfc066730 0x7fedfc068bf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fee2015af90 tx=0x7fee08008030 comp rx=0 tx=0).stop 2024-09-13T18:53:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 msgr2=0x7fee2013bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:26.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2013bc00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fee1000e870 tx=0x7fee1000ec30 comp rx=0 tx=0).stop 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 shutdown_connections 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fedfc066730 0x7fedfc068bf0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee20145ea0 0x7fee200d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee200b2a60 0x7fee200d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 --2- 172.21.15.81:0/1399754596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee2006b5b0 0x7fee2013bc00 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 >> 172.21.15.81:0/1399754596 conn(0x7fee20071d90 msgr2=0x7fee200b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 shutdown_connections 2024-09-13T18:53:26.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:26.887+0000 7fee1fe00700 1 -- 172.21.15.81:0/1399754596 wait complete. 2024-09-13T18:53:26.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:53:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 Processor -- start 2024-09-13T18:53:27.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 -- start start 2024-09-13T18:53:27.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f35d41601b0 0x7f35d40b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35d4160840 0x7f35d4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40ce1f0 con 0x7f35d41611f0 2024-09-13T18:53:27.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d40d0710 con 0x7f35d4160840 2024-09-13T18:53:27.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.095+0000 7f35d9c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d4160590 con 0x7f35d41601b0 2024-09-13T18:53:27.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35d4160840 0x7f35d4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35d4160840 0x7f35d4160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46090/0 (socket says 172.21.15.81:46090) 2024-09-13T18:53:27.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 -- 172.21.15.81:0/3406007483 learned_addr learned my addr 172.21.15.81:0/3406007483 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:27.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3e00700 1 --2- 172.21.15.81:0/3406007483 >> v2:172.21.15.178:3300/0 conn(0x7f35d41601b0 0x7f35d40b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 -- 172.21.15.81:0/3406007483 >> v2:172.21.15.178:3300/0 conn(0x7f35d41601b0 msgr2=0x7f35d40b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:27.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 --2- 172.21.15.81:0/3406007483 >> v2:172.21.15.178:3300/0 conn(0x7f35d41601b0 0x7f35d40b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 -- 172.21.15.81:0/3406007483 >> v1:172.21.15.178:6789/0 conn(0x7f35d41611f0 legacy=0x7f35d40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 -- 172.21.15.81:0/3406007483 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40b3cb0 con 0x7f35d4160840 2024-09-13T18:53:27.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3e00700 1 --2- 172.21.15.81:0/3406007483 >> v2:172.21.15.178:3300/0 conn(0x7f35d41601b0 0x7f35d40b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:27.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d3400700 1 --2- 172.21.15.81:0/3406007483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d4160840 0x7f35d4160cb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f35d406e1d0 tx=0x7f35c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbd43b8285d5bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:27.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d2a00700 1 -- 172.21.15.81:0/3406007483 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0011830 con 0x7f35d4160840 2024-09-13T18:53:27.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d2a00700 1 -- 172.21.15.81:0/3406007483 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0011990 con 0x7f35d4160840 2024-09-13T18:53:27.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d2a00700 1 -- 172.21.15.81:0/3406007483 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0011d20 con 0x7f35d4160840 2024-09-13T18:53:27.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d9c00700 1 -- 172.21.15.81:0/3406007483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d4160840 msgr2=0x7f35d4160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.099+0000 7f35d9c00700 1 --2- 172.21.15.81:0/3406007483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d4160840 0x7f35d4160cb0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f35d406e1d0 tx=0x7f35c0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 -- 172.21.15.81:0/3406007483 shutdown_connections 2024-09-13T18:53:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 --2- 172.21.15.81:0/3406007483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d4160840 0x7f35d4160cb0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 --2- 172.21.15.81:0/3406007483 >> v2:172.21.15.178:3300/0 conn(0x7f35d41601b0 0x7f35d40b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 -- 172.21.15.81:0/3406007483 >> 172.21.15.81:0/3406007483 conn(0x7f35d40d2b40 msgr2=0x7f35d40d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:27.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 -- 172.21.15.81:0/3406007483 shutdown_connections 2024-09-13T18:53:27.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 -- 172.21.15.81:0/3406007483 wait complete. 2024-09-13T18:53:27.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 Processor -- start 2024-09-13T18:53:27.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.103+0000 7f35d9c00700 1 -- start start 2024-09-13T18:53:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35d41601b0 0x7f35d4159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35d4160840 0x7f35d40c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 0x7f35d40b24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40b67d0 con 0x7f35d41611f0 2024-09-13T18:53:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d41f3590 con 0x7f35d41601b0 2024-09-13T18:53:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4159680 con 0x7f35d4160840 2024-09-13T18:53:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 0x7f35d40b24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 0x7f35d40b24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46100/0 (socket says 172.21.15.81:46100) 2024-09-13T18:53:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 -- 172.21.15.81:0/2137634327 learned_addr learned my addr 172.21.15.81:0/2137634327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d3e00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35d41601b0 0x7f35d4159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d3400700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35d4160840 0x7f35d40c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 -- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35d4160840 msgr2=0x7f35d40c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35d4160840 0x7f35d40c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 -- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35d41601b0 msgr2=0x7f35d4159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35d41601b0 0x7f35d4159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 -- 172.21.15.81:0/2137634327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40094b0 con 0x7f35d41611f0 2024-09-13T18:53:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d3400700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35d4160840 0x7f35d40c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.107+0000 7f35d9200700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 0x7f35d40b24a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00cb50 tx=0x7f35cc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc003c20 con 0x7f35d41611f0 2024-09-13T18:53:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc003d80 con 0x7f35d41611f0 2024-09-13T18:53:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c0009570 con 0x7f35d41611f0 2024-09-13T18:53:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00aac0 con 0x7f35d41611f0 2024-09-13T18:53:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40b5cf0 con 0x7f35d41611f0 2024-09-13T18:53:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d408cc60 con 0x7f35d41611f0 2024-09-13T18:53:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.111+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f35cc00ac20 con 0x7f35d41611f0 2024-09-13T18:53:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.115+0000 7f35cbe00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35b4066730 0x7f35b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.115+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f35cc083f90 con 0x7f35d41611f0 2024-09-13T18:53:27.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.115+0000 7f35d3e00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35b4066730 0x7f35b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.115+0000 7f35d3e00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35b4066730 0x7f35b4068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f35d415f7a0 tx=0x7f35c4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:27.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.123+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35cc0b5db0 con 0x7f35d41611f0 2024-09-13T18:53:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.303+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f35d4067cd0 con 0x7f35d41611f0 2024-09-13T18:53:27.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.307+0000 7f35cbe00700 1 -- 172.21.15.81:0/2137634327 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f35cc0514a0 con 0x7f35d41611f0 2024-09-13T18:53:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35b4066730 msgr2=0x7f35b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35b4066730 0x7f35b4068bf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f35d415f7a0 tx=0x7f35c4009240 comp rx=0 tx=0).stop 2024-09-13T18:53:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 msgr2=0x7f35d40b24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 0x7f35d40b24a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00cb50 tx=0x7f35cc00ce60 comp rx=0 tx=0).stop 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 shutdown_connections 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f35b4066730 0x7f35b4068bf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35d41611f0 0x7f35d40b24a0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35d4160840 0x7f35d40c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 --2- 172.21.15.81:0/2137634327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35d41601b0 0x7f35d4159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 >> 172.21.15.81:0/2137634327 conn(0x7f35d40d2b40 msgr2=0x7f35d40b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 shutdown_connections 2024-09-13T18:53:27.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.311+0000 7f35d9c00700 1 -- 172.21.15.81:0/2137634327 wait complete. 2024-09-13T18:53:27.343 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:53:27.343 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:53:27.385 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:53:27.428 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:53:27.428 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:53:27.429 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:27.445 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:53:27.445 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:53:27.445 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:27.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:53:27.490 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:53:27.490 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:27.507 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:53:27.507 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:53:27.507 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:27.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:53:27.551 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:53:27.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:27.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 Processor -- start 2024-09-13T18:53:27.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 -- start start 2024-09-13T18:53:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f98a415c2a0 0x7f98a415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40b2ad0 con 0x7f98a406aaa0 2024-09-13T18:53:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a415b960 con 0x7f98a415c2a0 2024-09-13T18:53:27.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f98a9a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a415bc40 con 0x7f98a40cb020 2024-09-13T18:53:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.715+0000 7f989b400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f98a415c2a0 0x7f98a415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a9000700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f98a406aaa0 0x7f98a40b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:52472/0 (socket says 172.21.15.81:52472) 2024-09-13T18:53:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a9000700 1 -- 172.21.15.81:0/4049772324 learned_addr learned my addr 172.21.15.81:0/4049772324 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3e00700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3400700 1 -- 172.21.15.81:0/4049772324 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864081044 0 0) 0x7f98a40b2ad0 con 0x7f98a406aaa0 2024-09-13T18:53:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3400700 1 -- 172.21.15.81:0/4049772324 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98880035d0 con 0x7f98a406aaa0 2024-09-13T18:53:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f989b400700 1 -- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 msgr2=0x7f98a40cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f989b400700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f989b400700 1 -- 172.21.15.81:0/4049772324 >> v1:172.21.15.178:6789/0 conn(0x7f98a406aaa0 legacy=0x7f98a40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f989b400700 1 -- 172.21.15.81:0/4049772324 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a415bf20 con 0x7f98a415c2a0 2024-09-13T18:53:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3e00700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f989b400700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a415c2a0 0x7f98a415b0e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f988c009850 tx=0x7f988c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895a261fd5937c09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3400700 1 -- 172.21.15.81:0/4049772324 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c011830 con 0x7f98a415c2a0 2024-09-13T18:53:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3400700 1 -- 172.21.15.81:0/4049772324 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c011990 con 0x7f98a415c2a0 2024-09-13T18:53:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a3400700 1 -- 172.21.15.81:0/4049772324 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c011d40 con 0x7f98a415c2a0 2024-09-13T18:53:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a9a00700 1 -- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a415c2a0 msgr2=0x7f98a415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.719+0000 7f98a9a00700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a415c2a0 0x7f98a415b0e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f988c009850 tx=0x7f988c009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 -- 172.21.15.81:0/4049772324 shutdown_connections 2024-09-13T18:53:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a415c2a0 0x7f98a415b0e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 --2- 172.21.15.81:0/4049772324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 -- 172.21.15.81:0/4049772324 >> 172.21.15.81:0/4049772324 conn(0x7f98a40b0c40 msgr2=0x7f98a406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 -- 172.21.15.81:0/4049772324 shutdown_connections 2024-09-13T18:53:27.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 -- 172.21.15.81:0/4049772324 wait complete. 2024-09-13T18:53:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.723+0000 7f98a9a00700 1 Processor -- start 2024-09-13T18:53:27.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 -- start start 2024-09-13T18:53:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a406aaa0 0x7f98a40c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 0x7f98a40c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40c8ac0 con 0x7f98a415c2a0 2024-09-13T18:53:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40c73c0 con 0x7f98a406aaa0 2024-09-13T18:53:27.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40c51d0 con 0x7f98a40cb020 2024-09-13T18:53:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 0x7f98a40c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 0x7f98a40c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46110/0 (socket says 172.21.15.81:46110) 2024-09-13T18:53:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9000700 1 -- 172.21.15.81:0/3013587951 learned_addr learned my addr 172.21.15.81:0/3013587951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a3e00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a406aaa0 0x7f98a40c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 -- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a406aaa0 msgr2=0x7f98a40c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a406aaa0 0x7f98a40c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 -- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 msgr2=0x7f98a40c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 0x7f98a40c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 -- 172.21.15.81:0/3013587951 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009a70 con 0x7f98a40cb020 2024-09-13T18:53:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f98a9000700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 0x7f98a40c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.727+0000 7f989b400700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40c8580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f988c016000 tx=0x7f988c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.731+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c004510 con 0x7f98a40cb020 2024-09-13T18:53:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.731+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c01e070 con 0x7f98a40cb020 2024-09-13T18:53:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.731+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c0094b0 con 0x7f98a40cb020 2024-09-13T18:53:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.731+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c003900 con 0x7f98a40cb020 2024-09-13T18:53:27.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.731+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a40c67b0 con 0x7f98a40cb020 2024-09-13T18:53:27.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.731+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a40c8c60 con 0x7f98a40cb020 2024-09-13T18:53:27.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.735+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f988c003a60 con 0x7f98a40cb020 2024-09-13T18:53:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.735+0000 7f98a0c00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9880066760 0x7f9880068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.735+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f988c085430 con 0x7f98a40cb020 2024-09-13T18:53:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.735+0000 7f98a3e00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9880066760 0x7f9880068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:27.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.735+0000 7f98a3e00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9880066760 0x7f9880068c20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9894009fd0 tx=0x7f989400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.743+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f988c052920 con 0x7f98a40cb020 2024-09-13T18:53:27.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.975+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98a40cc690 con 0x7f98a40cb020 2024-09-13T18:53:27.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.975+0000 7f98a0c00700 1 -- 172.21.15.81:0/3013587951 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f988c020de0 con 0x7f98a40cb020 2024-09-13T18:53:27.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:27.986 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6476,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6833/2365038153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":2365038153},{"type":"v1","addr":"172.21.15.178:6833","nonce":2365038153}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7600,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1563682453","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1563682453},{"type":"v1","addr":"172.21.15.178:6835","nonce":1563682453}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7998,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/2545537459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2545537459},{"type":"v1","addr":"172.21.15.81:6835","nonce":2545537459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":8004,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3933128525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3933128525},{"type":"v1","addr":"172.21.15.81:6837","nonce":3933128525}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2024-09-13T18:53:27.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9880066760 msgr2=0x7f9880068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9880066760 0x7f9880068c20 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9894009fd0 tx=0x7f989400b040 comp rx=0 tx=0).stop 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 msgr2=0x7f98a40c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40c8580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f988c016000 tx=0x7f988c004770 comp rx=0 tx=0).stop 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 shutdown_connections 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9880066760 0x7f9880068c20 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98a415c2a0 0x7f98a40c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98a40cb020 0x7f98a40c8580 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 --2- 172.21.15.81:0/3013587951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98a406aaa0 0x7f98a40c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 >> 172.21.15.81:0/3013587951 conn(0x7f98a40b0c40 msgr2=0x7f98a415d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 shutdown_connections 2024-09-13T18:53:27.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:27.979+0000 7f98a9a00700 1 -- 172.21.15.81:0/3013587951 wait complete. 2024-09-13T18:53:27.991 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 80 2024-09-13T18:53:28.010 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:53:28.011 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:53:28.011 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:53:28.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:53:28.011 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:53:28.011 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:53:28.011 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:53:28.011 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:53:28.012 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:53:28.012 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:53:28.012 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:53:28.012 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:53:28.012 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:53:28.012 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:53:28.012 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:53:28.012 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:53:28.036 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:53:28.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:53:28.037 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:53:28.037 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:53:28.038 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:53:28.039 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:53:28.040 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:53:28.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:53:28.086 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:53:28.087 DEBUG:teuthology.parallel:result is None 2024-09-13T18:53:28.089 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:53:28.089 DEBUG:teuthology.parallel:result is None 2024-09-13T18:53:28.091 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:53:28.092 DEBUG:teuthology.parallel:result is None 2024-09-13T18:53:28.094 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:53:28.094 DEBUG:teuthology.parallel:result is None 2024-09-13T18:53:28.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:53:28.198 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:53:28.199 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:53:28.201 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:53:28.191+0000 7fe895000700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-13T18:53:28.216 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:53:28.217 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:53:28.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 Processor -- start 2024-09-13T18:53:28.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 -- start start 2024-09-13T18:53:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4de00cb020 0x7f4de00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4de006aaa0 0x7f4de006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de006b430 con 0x7f4de015c2a0 2024-09-13T18:53:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de00b2ad0 con 0x7f4de006aaa0 2024-09-13T18:53:28.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4de5200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de015b960 con 0x7f4de00cb020 2024-09-13T18:53:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4ddfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4de006aaa0 0x7f4de006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4ddfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4de006aaa0 0x7f4de006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46152/0 (socket says 172.21.15.81:46152) 2024-09-13T18:53:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4ddfe00700 1 -- 172.21.15.81:0/1620116249 learned_addr learned my addr 172.21.15.81:0/1620116249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:28.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.259+0000 7f4ddf400700 1 --2- 172.21.15.81:0/1620116249 >> v2:172.21.15.178:3300/0 conn(0x7f4de00cb020 0x7f4de00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4ddfe00700 1 -- 172.21.15.81:0/1620116249 >> v2:172.21.15.178:3300/0 conn(0x7f4de00cb020 msgr2=0x7f4de00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4ddfe00700 1 --2- 172.21.15.81:0/1620116249 >> v2:172.21.15.178:3300/0 conn(0x7f4de00cb020 0x7f4de00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4ddfe00700 1 -- 172.21.15.81:0/1620116249 >> v1:172.21.15.178:6789/0 conn(0x7f4de015c2a0 legacy=0x7f4de015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4ddfe00700 1 -- 172.21.15.81:0/1620116249 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de015bc40 con 0x7f4de006aaa0 2024-09-13T18:53:28.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4ddfe00700 1 --2- 172.21.15.81:0/1620116249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006aef0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f4de006b660 tx=0x7f4dd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48adc055ebd8289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:28.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4dde000700 1 -- 172.21.15.81:0/1620116249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800e070 con 0x7f4de006aaa0 2024-09-13T18:53:28.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4dde000700 1 -- 172.21.15.81:0/1620116249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800b910 con 0x7f4de006aaa0 2024-09-13T18:53:28.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4dde000700 1 -- 172.21.15.81:0/1620116249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800bcc0 con 0x7f4de006aaa0 2024-09-13T18:53:28.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 -- 172.21.15.81:0/1620116249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 msgr2=0x7f4de006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:28.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 --2- 172.21.15.81:0/1620116249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006aef0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f4de006b660 tx=0x7f4dd800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:28.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 -- 172.21.15.81:0/1620116249 shutdown_connections 2024-09-13T18:53:28.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 --2- 172.21.15.81:0/1620116249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006aef0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 --2- 172.21.15.81:0/1620116249 >> v2:172.21.15.178:3300/0 conn(0x7f4de00cb020 0x7f4de00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 -- 172.21.15.81:0/1620116249 >> 172.21.15.81:0/1620116249 conn(0x7f4de00b0c40 msgr2=0x7f4de006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 -- 172.21.15.81:0/1620116249 shutdown_connections 2024-09-13T18:53:28.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.263+0000 7f4de5200700 1 -- 172.21.15.81:0/1620116249 wait complete. 2024-09-13T18:53:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 Processor -- start 2024-09-13T18:53:28.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 -- start start 2024-09-13T18:53:28.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:28.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4de00cb020 0x7f4de013e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4de015c2a0 0x7f4de013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de00707e0 con 0x7f4de006aaa0 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0070ac0 con 0x7f4de00cb020 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4de5200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de0070da0 con 0x7f4de015c2a0 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4ddf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4ddf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46162/0 (socket says 172.21.15.81:46162) 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4ddf400700 1 -- 172.21.15.81:0/2211513942 learned_addr learned my addr 172.21.15.81:0/2211513942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4ddfe00700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4de015c2a0 0x7f4de013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:28.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.267+0000 7f4ddea00700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4de00cb020 0x7f4de013e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:28.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddf400700 1 -- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4de015c2a0 msgr2=0x7f4de013e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:28.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddf400700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4de015c2a0 0x7f4de013e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:28.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddf400700 1 -- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4de00cb020 msgr2=0x7f4de013e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:28.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddf400700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4de00cb020 0x7f4de013e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddf400700 1 -- 172.21.15.81:0/2211513942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd8009b30 con 0x7f4de006aaa0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddfe00700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4de015c2a0 0x7f4de013e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddea00700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4de00cb020 0x7f4de013e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4ddf400700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006fd40 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000e9d0 tx=0x7f4dd000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0009720 con 0x7f4de006aaa0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd000c850 con 0x7f4de006aaa0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd000cbc0 con 0x7f4de006aaa0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de0071080 con 0x7f4de006aaa0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de0149930 con 0x7f4de006aaa0 2024-09-13T18:53:28.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.271+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de006aef0 con 0x7f4de006aaa0 2024-09-13T18:53:28.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.275+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4dd000cd20 con 0x7f4de006aaa0 2024-09-13T18:53:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.275+0000 7f4dd7400700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4dc0066730 0x7f4dc0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.275+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4dd0084220 con 0x7f4de006aaa0 2024-09-13T18:53:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.275+0000 7f4ddea00700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4dc0066730 0x7f4dc0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:28.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.275+0000 7f4ddea00700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4dc0066730 0x7f4dc0068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4de00c7db0 tx=0x7f4dcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:28.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.279+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4dd0051600 con 0x7f4de006aaa0 2024-09-13T18:53:28.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:28.479+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4de00ce520 con 0x7f4de006aaa0 2024-09-13T18:53:29.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.235+0000 7f4dd7400700 1 -- 172.21.15.81:0/2211513942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4dd0054c20 con 0x7f4de006aaa0 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4dc0066730 msgr2=0x7f4dc0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4dc0066730 0x7f4dc0068bf0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4de00c7db0 tx=0x7f4dcc009040 comp rx=0 tx=0).stop 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 msgr2=0x7f4de006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006fd40 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000e9d0 tx=0x7f4dd000ed90 comp rx=0 tx=0).stop 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 shutdown_connections 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4dc0066730 0x7f4dc0068bf0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4de015c2a0 0x7f4de013e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4de00cb020 0x7f4de013e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 --2- 172.21.15.81:0/2211513942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4de006aaa0 0x7f4de006fd40 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 >> 172.21.15.81:0/2211513942 conn(0x7f4de00b0c40 msgr2=0x7f4de006d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 shutdown_connections 2024-09-13T18:53:29.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.239+0000 7f4de5200700 1 -- 172.21.15.81:0/2211513942 wait complete. 2024-09-13T18:53:29.251 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-13T18:53:29.271 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:53:29.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.431+0000 7fb29e800700 1 Processor -- start 2024-09-13T18:53:29.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.431+0000 7fb29e800700 1 -- start start 2024-09-13T18:53:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2980cb020 0x7fb2980cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29806aaa0 0x7fb29806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29e800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29806b430 con 0x7fb29815c2a0 2024-09-13T18:53:29.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29e800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980b2ad0 con 0x7fb2980cb020 2024-09-13T18:53:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29815b960 con 0x7fb29806aaa0 2024-09-13T18:53:29.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2980cb020 0x7fb2980cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2980cb020 0x7fb2980cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46168/0 (socket says 172.21.15.81:46168) 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 -- 172.21.15.81:0/731679682 learned_addr learned my addr 172.21.15.81:0/731679682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29de00700 1 --2- 172.21.15.81:0/731679682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29806aaa0 0x7fb29806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 -- 172.21.15.81:0/731679682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29806aaa0 msgr2=0x7fb29806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 --2- 172.21.15.81:0/731679682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29806aaa0 0x7fb29806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 -- 172.21.15.81:0/731679682 >> v1:172.21.15.178:6789/0 conn(0x7fb29815c2a0 legacy=0x7fb29815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 -- 172.21.15.81:0/731679682 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29815bc40 con 0x7fb2980cb020 2024-09-13T18:53:29.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb29d400700 1 --2- 172.21.15.81:0/731679682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2980cb020 0x7fb2980cc6f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009910 tx=0x7fb28c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a5f503b05bef11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:29.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb297e00700 1 -- 172.21.15.81:0/731679682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00ba60 con 0x7fb2980cb020 2024-09-13T18:53:29.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb297e00700 1 -- 172.21.15.81:0/731679682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c00bbc0 con 0x7fb2980cb020 2024-09-13T18:53:29.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.435+0000 7fb297e00700 1 -- 172.21.15.81:0/731679682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c009e60 con 0x7fb2980cb020 2024-09-13T18:53:29.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 -- 172.21.15.81:0/731679682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2980cb020 msgr2=0x7fb2980cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 --2- 172.21.15.81:0/731679682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2980cb020 0x7fb2980cc6f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009910 tx=0x7fb28c009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:29.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 -- 172.21.15.81:0/731679682 shutdown_connections 2024-09-13T18:53:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 --2- 172.21.15.81:0/731679682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29806aaa0 0x7fb29806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 --2- 172.21.15.81:0/731679682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2980cb020 0x7fb2980cc6f0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 -- 172.21.15.81:0/731679682 >> 172.21.15.81:0/731679682 conn(0x7fb2980b0c40 msgr2=0x7fb29806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 -- 172.21.15.81:0/731679682 shutdown_connections 2024-09-13T18:53:29.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.439+0000 7fb29e800700 1 -- 172.21.15.81:0/731679682 wait complete. 2024-09-13T18:53:29.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 Processor -- start 2024-09-13T18:53:29.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 -- start start 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 0x7fb298144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2980cb020 0x7fb298141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29815c2a0 0x7fb2980ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb298141eb0 con 0x7fb29806aaa0 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb298155070 con 0x7fb2980cb020 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29e800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb298154460 con 0x7fb29815c2a0 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 0x7fb298144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 0x7fb298144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46172/0 (socket says 172.21.15.81:46172) 2024-09-13T18:53:29.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 -- 172.21.15.81:0/117788073 learned_addr learned my addr 172.21.15.81:0/117788073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:29.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29de00700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29815c2a0 0x7fb2980ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29ca00700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2980cb020 0x7fb298141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 -- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29815c2a0 msgr2=0x7fb2980ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29815c2a0 0x7fb2980ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 -- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2980cb020 msgr2=0x7fb298141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2980cb020 0x7fb298141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29d400700 1 -- 172.21.15.81:0/117788073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c009570 con 0x7fb29806aaa0 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.443+0000 7fb29ca00700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2980cb020 0x7fb298141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb29d400700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 0x7fb298144d90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fb2980b1690 tx=0x7fb28c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c004610 con 0x7fb29806aaa0 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c01f070 con 0x7fb29806aaa0 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb298154740 con 0x7fb29806aaa0 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c003900 con 0x7fb29806aaa0 2024-09-13T18:53:29.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb298154d00 con 0x7fb29806aaa0 2024-09-13T18:53:29.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.447+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb298154e90 con 0x7fb29806aaa0 2024-09-13T18:53:29.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.451+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb28c003a60 con 0x7fb29806aaa0 2024-09-13T18:53:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.451+0000 7fb295600700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb278066730 0x7fb278068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.451+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb28c021070 con 0x7fb29806aaa0 2024-09-13T18:53:29.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.451+0000 7fb29ca00700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb278066730 0x7fb278068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.451+0000 7fb29ca00700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb278066730 0x7fb278068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb298071f20 tx=0x7fb284009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:29.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.459+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb28c052dc0 con 0x7fb29806aaa0 2024-09-13T18:53:29.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.711+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb29806aef0 con 0x7fb29806aaa0 2024-09-13T18:53:29.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.711+0000 7fb295600700 1 -- 172.21.15.81:0/117788073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb28c0563e0 con 0x7fb29806aaa0 2024-09-13T18:53:29.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw==", 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.722 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw==", 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.723 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q==", 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.724 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g==", 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-13T18:53:29.725 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g==", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw==", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA==", 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg==", 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw==", 2024-09-13T18:53:29.728 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw==", 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.729 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A==", 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q==", 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ==", 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.731 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg==", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:53:29.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg==", 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.733 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng==", 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.734 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB2iORm9hwhIRAASJc+x3PH9tdxfNlBIxr8ZA==", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA==", 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.735 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g==", 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:29.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T18:53:29.737 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb278066730 msgr2=0x7fb278068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb278066730 0x7fb278068bf0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb298071f20 tx=0x7fb284009040 comp rx=0 tx=0).stop 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 msgr2=0x7fb298144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 0x7fb298144d90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fb2980b1690 tx=0x7fb28c004770 comp rx=0 tx=0).stop 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 shutdown_connections 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb278066730 0x7fb278068bf0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb29815c2a0 0x7fb2980ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2980cb020 0x7fb298141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 --2- 172.21.15.81:0/117788073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb29806aaa0 0x7fb298144d90 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 >> 172.21.15.81:0/117788073 conn(0x7fb2980b0c40 msgr2=0x7fb29815dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 shutdown_connections 2024-09-13T18:53:29.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.715+0000 7fb29e800700 1 -- 172.21.15.81:0/117788073 wait complete. 2024-09-13T18:53:29.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 Processor -- start 2024-09-13T18:53:29.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 -- start start 2024-09-13T18:53:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69741610b0 0x7f69740719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f697406aaa0 0x7f697406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69740b3560 con 0x7f69740b2670 2024-09-13T18:53:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6974070b30 con 0x7f697406aaa0 2024-09-13T18:53:29.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.911+0000 7f6973e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697406b450 con 0x7f69741610b0 2024-09-13T18:53:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f697406aaa0 0x7f697406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69740b2670 0x7f69740b2ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47622/0 (socket says 172.21.15.81:47622) 2024-09-13T18:53:29.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973400700 1 -- 172.21.15.81:0/2084502510 learned_addr learned my addr 172.21.15.81:0/2084502510 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972a00700 1 --2- 172.21.15.81:0/2084502510 >> v2:172.21.15.178:3300/0 conn(0x7f69741610b0 0x7f69740719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972000700 1 -- 172.21.15.81:0/2084502510 >> v2:172.21.15.178:3300/0 conn(0x7f69741610b0 msgr2=0x7f69740719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972000700 1 --2- 172.21.15.81:0/2084502510 >> v2:172.21.15.178:3300/0 conn(0x7f69741610b0 0x7f69740719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972000700 1 -- 172.21.15.81:0/2084502510 >> v1:172.21.15.81:6789/0 conn(0x7f69740b2670 legacy=0x7f69740b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972000700 1 -- 172.21.15.81:0/2084502510 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69740b3280 con 0x7f697406aaa0 2024-09-13T18:53:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6972000700 1 --2- 172.21.15.81:0/2084502510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f697406aaa0 0x7f697406af10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6960009880 tx=0x7f6960009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2342364b1316c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6971600700 1 -- 172.21.15.81:0/2084502510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960011830 con 0x7f697406aaa0 2024-09-13T18:53:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6971600700 1 -- 172.21.15.81:0/2084502510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6960011990 con 0x7f697406aaa0 2024-09-13T18:53:29.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6971600700 1 -- 172.21.15.81:0/2084502510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960011d20 con 0x7f697406aaa0 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 -- 172.21.15.81:0/2084502510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f697406aaa0 msgr2=0x7f697406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 --2- 172.21.15.81:0/2084502510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f697406aaa0 0x7f697406af10 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f6960009880 tx=0x7f6960009b90 comp rx=0 tx=0).stop 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 -- 172.21.15.81:0/2084502510 shutdown_connections 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 --2- 172.21.15.81:0/2084502510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f697406aaa0 0x7f697406af10 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 --2- 172.21.15.81:0/2084502510 >> v2:172.21.15.178:3300/0 conn(0x7f69741610b0 0x7f69740719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 -- 172.21.15.81:0/2084502510 >> 172.21.15.81:0/2084502510 conn(0x7f69740b0c40 msgr2=0x7f697406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 -- 172.21.15.81:0/2084502510 shutdown_connections 2024-09-13T18:53:29.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.915+0000 7f6973e00700 1 -- 172.21.15.81:0/2084502510 wait complete. 2024-09-13T18:53:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 Processor -- start 2024-09-13T18:53:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 -- start start 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f697406aaa0 0x7f697415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 0x7f69740acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69741610b0 0x7f69741f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741f7ca0 con 0x7f69740b2670 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741f7f80 con 0x7f697406aaa0 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69741f8260 con 0x7f69741610b0 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 0x7f69740acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 0x7f69740acb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46192/0 (socket says 172.21.15.81:46192) 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 -- 172.21.15.81:0/849691034 learned_addr learned my addr 172.21.15.81:0/849691034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973400700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69741610b0 0x7f69741f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972a00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f697406aaa0 0x7f697415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 -- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69741610b0 msgr2=0x7f69741f9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69741610b0 0x7f69741f9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 -- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f697406aaa0 msgr2=0x7f697415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f697406aaa0 0x7f697415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 -- 172.21.15.81:0/849691034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600094b0 con 0x7f69740b2670 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972a00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f697406aaa0 0x7f697415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6973400700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69741610b0 0x7f69741f9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:29.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.919+0000 7f6972000700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 0x7f69740acb30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f6960009bd0 tx=0x7f6960004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69600036c0 con 0x7f69740b2670 2024-09-13T18:53:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6960003820 con 0x7f69740b2670 2024-09-13T18:53:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960003b90 con 0x7f69740b2670 2024-09-13T18:53:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69741f8540 con 0x7f69740b2670 2024-09-13T18:53:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69741f7910 con 0x7f69740b2670 2024-09-13T18:53:29.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974161490 con 0x7f69740b2670 2024-09-13T18:53:29.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.923+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6960003cf0 con 0x7f69740b2670 2024-09-13T18:53:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.927+0000 7f696b400700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6954066730 0x7f6954068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.927+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6960085550 con 0x7f69740b2670 2024-09-13T18:53:29.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.927+0000 7f6972a00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6954066730 0x7f6954068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:29.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.927+0000 7f6972a00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6954066730 0x7f6954068bf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6964009ad0 tx=0x7f6964008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:29.931+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6960052b60 con 0x7f69740b2670 2024-09-13T18:53:30.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.119+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697415ffb0 con 0x7f69740b2670 2024-09-13T18:53:30.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f696b400700 1 -- 172.21.15.81:0/849691034 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+13063 (secure 0 0 0) 0x7f6960056180 con 0x7f69740b2670 2024-09-13T18:53:30.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:30.132 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":89,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:53:29.231630+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:30.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6954066730 msgr2=0x7f6954068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6954066730 0x7f6954068bf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6964009ad0 tx=0x7f6964008040 comp rx=0 tx=0).stop 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 msgr2=0x7f69740acb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 0x7f69740acb30 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f6960009bd0 tx=0x7f6960004770 comp rx=0 tx=0).stop 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 shutdown_connections 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6954066730 0x7f6954068bf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69741610b0 0x7f69741f9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69740b2670 0x7f69740acb30 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 --2- 172.21.15.81:0/849691034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f697406aaa0 0x7f697415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.123+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 >> 172.21.15.81:0/849691034 conn(0x7f69740b0c40 msgr2=0x7f69741636b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.127+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 shutdown_connections 2024-09-13T18:53:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.127+0000 7f6973e00700 1 -- 172.21.15.81:0/849691034 wait complete. 2024-09-13T18:53:30.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:53:30.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:53:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.327+0000 7fc3e3200700 1 Processor -- start 2024-09-13T18:53:30.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.327+0000 7fc3e3200700 1 -- start start 2024-09-13T18:53:30.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3dc0b35b0 0x7fc3dc06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc06f2b0 0x7fc3dc0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc0b58f0 con 0x7fc3dc15a3a0 2024-09-13T18:53:30.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3dc06f740 con 0x7fc3dc0b35b0 2024-09-13T18:53:30.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15ae90 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3dc0b35b0 0x7fc3dc06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3dc0b35b0 0x7fc3dc06ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46196/0 (socket says 172.21.15.81:46196) 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 -- 172.21.15.81:0/3889968283 learned_addr learned my addr 172.21.15.81:0/3889968283 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e1200700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc06f2b0 0x7fc3dc0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 -- 172.21.15.81:0/3889968283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc06f2b0 msgr2=0x7fc3dc0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc06f2b0 0x7fc3dc0cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 -- 172.21.15.81:0/3889968283 >> v1:172.21.15.178:6789/0 conn(0x7fc3dc15a3a0 legacy=0x7fc3dc15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 -- 172.21.15.81:0/3889968283 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc0b3a90 con 0x7fc3dc0b35b0 2024-09-13T18:53:30.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e1200700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc06f2b0 0x7fc3dc0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3db400700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc0b35b0 0x7fc3dc06ed70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009910 tx=0x7fc3c8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7a053495f0109f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3daa00700 1 -- 172.21.15.81:0/3889968283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800ba60 con 0x7fc3dc0b35b0 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3daa00700 1 -- 172.21.15.81:0/3889968283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c800bbc0 con 0x7fc3dc0b35b0 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3daa00700 1 -- 172.21.15.81:0/3889968283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c8009e60 con 0x7fc3dc0b35b0 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 -- 172.21.15.81:0/3889968283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc0b35b0 msgr2=0x7fc3dc06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.331+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc0b35b0 0x7fc3dc06ed70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8009910 tx=0x7fc3c8009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- 172.21.15.81:0/3889968283 shutdown_connections 2024-09-13T18:53:30.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc06f2b0 0x7fc3dc0cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3889968283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc0b35b0 0x7fc3dc06ed70 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- 172.21.15.81:0/3889968283 >> 172.21.15.81:0/3889968283 conn(0x7fc3dc06d530 msgr2=0x7fc3dc06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:30.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- 172.21.15.81:0/3889968283 shutdown_connections 2024-09-13T18:53:30.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- 172.21.15.81:0/3889968283 wait complete. 2024-09-13T18:53:30.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 Processor -- start 2024-09-13T18:53:30.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- start start 2024-09-13T18:53:30.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 0x7fc3dc1389d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc15a3a0 0x7fc3dc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3dc15cd70 0x7fc3dc156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc13b400 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc13b6e0 con 0x7fc3dc15cd70 2024-09-13T18:53:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3e3200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc13b9c0 con 0x7fc3dc15a3a0 2024-09-13T18:53:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 0x7fc3dc1389d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 0x7fc3dc1389d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46208/0 (socket says 172.21.15.81:46208) 2024-09-13T18:53:30.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.335+0000 7fc3dbe00700 1 -- 172.21.15.81:0/3254378198 learned_addr learned my addr 172.21.15.81:0/3254378198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3e1200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3dc15cd70 0x7fc3dc156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3db400700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc15a3a0 0x7fc3dc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3dbe00700 1 -- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc15a3a0 msgr2=0x7fc3dc15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3dbe00700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc15a3a0 0x7fc3dc15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3dbe00700 1 -- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3dc15cd70 msgr2=0x7fc3dc156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3dbe00700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3dc15cd70 0x7fc3dc156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3dbe00700 1 -- 172.21.15.81:0/3254378198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8009570 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3db400700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc15a3a0 0x7fc3dc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:30.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3dbe00700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 0x7fc3dc1389d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c500 tx=0x7fc3cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:30.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0052d0 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc005430 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc13bca0 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0055a0 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc138f10 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.339+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc13be90 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.343+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3cc0038e0 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.343+0000 7fc3d3e00700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc3bc066730 0x7fc3bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.343+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc3cc083490 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.343+0000 7fc3db400700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc3bc066730 0x7fc3bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.343+0000 7fc3db400700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc3bc066730 0x7fc3bc068bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b5370 tx=0x7fc3c8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:30.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.347+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3cc050a00 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.527+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3dc1595e0 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.527+0000 7fc3d3e00700 1 -- 172.21.15.81:0/3254378198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3cc054020 con 0x7fc3dc06f2b0 2024-09-13T18:53:30.536 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:53:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc3bc066730 msgr2=0x7fc3bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc3bc066730 0x7fc3bc068bf0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc0b5370 tx=0x7fc3c8008030 comp rx=0 tx=0).stop 2024-09-13T18:53:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 msgr2=0x7fc3dc1389d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 0x7fc3dc1389d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c500 tx=0x7fc3cc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 shutdown_connections 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc3bc066730 0x7fc3bc068bf0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3dc15cd70 0x7fc3dc156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3dc15a3a0 0x7fc3dc15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 --2- 172.21.15.81:0/3254378198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3dc06f2b0 0x7fc3dc1389d0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 >> 172.21.15.81:0/3254378198 conn(0x7fc3dc06d530 msgr2=0x7fc3dc14df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 shutdown_connections 2024-09-13T18:53:30.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.531+0000 7fc3e3200700 1 -- 172.21.15.81:0/3254378198 wait complete. 2024-09-13T18:53:30.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:53:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.715+0000 7f9f5a000700 1 Processor -- start 2024-09-13T18:53:30.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.715+0000 7f9f5a000700 1 -- start start 2024-09-13T18:53:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f5a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f540cc6f0 0x7f9f5415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f5a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f5406aaa0 0x7f9f5406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f5a000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f540ccb40 con 0x7f9f540cb020 2024-09-13T18:53:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f5a000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5406b430 con 0x7f9f540cc6f0 2024-09-13T18:53:30.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f5a000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f540b2ad0 con 0x7f9f5406aaa0 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f540cc6f0 0x7f9f5415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f540cc6f0 0x7f9f5415b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46222/0 (socket says 172.21.15.81:46222) 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 -- 172.21.15.81:0/4166872452 learned_addr learned my addr 172.21.15.81:0/4166872452 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f59600700 1 --2- 172.21.15.81:0/4166872452 >> v2:172.21.15.178:3300/0 conn(0x7f9f5406aaa0 0x7f9f5406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 -- 172.21.15.81:0/4166872452 >> v2:172.21.15.178:3300/0 conn(0x7f9f5406aaa0 msgr2=0x7f9f5406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 --2- 172.21.15.81:0/4166872452 >> v2:172.21.15.178:3300/0 conn(0x7f9f5406aaa0 0x7f9f5406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 -- 172.21.15.81:0/4166872452 >> v1:172.21.15.178:6789/0 conn(0x7f9f540cb020 legacy=0x7f9f5415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 -- 172.21.15.81:0/4166872452 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5415b960 con 0x7f9f540cc6f0 2024-09-13T18:53:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f4be00700 1 --2- 172.21.15.81:0/4166872452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cc6f0 0x7f9f5415b0e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9f540cd7e0 tx=0x7f9f3c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7c7fb81d5a1ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f53e00700 1 -- 172.21.15.81:0/4166872452 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00b8a0 con 0x7f9f540cc6f0 2024-09-13T18:53:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.719+0000 7f9f53e00700 1 -- 172.21.15.81:0/4166872452 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00ba00 con 0x7f9f540cc6f0 2024-09-13T18:53:30.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f53e00700 1 -- 172.21.15.81:0/4166872452 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00bd90 con 0x7f9f540cc6f0 2024-09-13T18:53:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 -- 172.21.15.81:0/4166872452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cc6f0 msgr2=0x7f9f5415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 --2- 172.21.15.81:0/4166872452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cc6f0 0x7f9f5415b0e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f9f540cd7e0 tx=0x7f9f3c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 -- 172.21.15.81:0/4166872452 shutdown_connections 2024-09-13T18:53:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 --2- 172.21.15.81:0/4166872452 >> v2:172.21.15.178:3300/0 conn(0x7f9f5406aaa0 0x7f9f5406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 --2- 172.21.15.81:0/4166872452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cc6f0 0x7f9f5415b0e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 -- 172.21.15.81:0/4166872452 >> 172.21.15.81:0/4166872452 conn(0x7f9f540b0c40 msgr2=0x7f9f5406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 -- 172.21.15.81:0/4166872452 shutdown_connections 2024-09-13T18:53:30.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.723+0000 7f9f5a000700 1 -- 172.21.15.81:0/4166872452 wait complete. 2024-09-13T18:53:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 Processor -- start 2024-09-13T18:53:30.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 -- start start 2024-09-13T18:53:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5406aaa0 0x7f9f541401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 0x7f9f541545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f540cc6f0 0x7f9f5406cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54142090 con 0x7f9f540cb020 2024-09-13T18:53:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54155e90 con 0x7f9f5406aaa0 2024-09-13T18:53:30.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f5a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54141db0 con 0x7f9f540cc6f0 2024-09-13T18:53:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f4be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 0x7f9f541545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f4be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 0x7f9f541545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46232/0 (socket says 172.21.15.81:46232) 2024-09-13T18:53:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f4be00700 1 -- 172.21.15.81:0/2898739732 learned_addr learned my addr 172.21.15.81:0/2898739732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f59600700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f540cc6f0 0x7f9f5406cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.727+0000 7f9f58c00700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5406aaa0 0x7f9f541401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f4be00700 1 -- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f540cc6f0 msgr2=0x7f9f5406cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f4be00700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f540cc6f0 0x7f9f5406cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f4be00700 1 -- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5406aaa0 msgr2=0x7f9f541401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f4be00700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5406aaa0 0x7f9f541401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f4be00700 1 -- 172.21.15.81:0/2898739732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009570 con 0x7f9f540cb020 2024-09-13T18:53:30.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f4be00700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 0x7f9f541545a0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c000c00 tx=0x7f9f3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0038c0 con 0x7f9f540cb020 2024-09-13T18:53:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c003a20 con 0x7f9f540cb020 2024-09-13T18:53:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f54156130 con 0x7f9f540cb020 2024-09-13T18:53:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003dd0 con 0x7f9f540cb020 2024-09-13T18:53:30.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f54141aa0 con 0x7f9f540cb020 2024-09-13T18:53:30.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.731+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f54156650 con 0x7f9f540cb020 2024-09-13T18:53:30.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.735+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f3c011420 con 0x7f9f540cb020 2024-09-13T18:53:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.735+0000 7f9f51600700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f30066730 0x7f9f30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:30.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.739+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9f3c020030 con 0x7f9f540cb020 2024-09-13T18:53:30.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.739+0000 7f9f58c00700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f30066730 0x7f9f30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:30.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.739+0000 7f9f58c00700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f30066730 0x7f9f30068bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f440018a0 tx=0x7f9f44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:30.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.743+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f54156650 con 0x7f9f540cb020 2024-09-13T18:53:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.935+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9f54156650 con 0x7f9f540cb020 2024-09-13T18:53:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.935+0000 7f9f51600700 1 -- 172.21.15.81:0/2898739732 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9f54156650 con 0x7f9f540cb020 2024-09-13T18:53:30.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:30.943 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:53:30.943 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:53:30.944 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:53:30.944 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:53:30.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:53:30.944 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f30066730 msgr2=0x7f9f30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f30066730 0x7f9f30068bf0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9f440018a0 tx=0x7f9f44009040 comp rx=0 tx=0).stop 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 msgr2=0x7f9f541545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 0x7f9f541545a0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c000c00 tx=0x7f9f3c004770 comp rx=0 tx=0).stop 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 shutdown_connections 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f30066730 0x7f9f30068bf0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f540cc6f0 0x7f9f5406cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f540cb020 0x7f9f541545a0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 --2- 172.21.15.81:0/2898739732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f5406aaa0 0x7f9f541401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 >> 172.21.15.81:0/2898739732 conn(0x7f9f540b0c40 msgr2=0x7f9f540ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 shutdown_connections 2024-09-13T18:53:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:30.939+0000 7f9f5a000700 1 -- 172.21.15.81:0/2898739732 wait complete. 2024-09-13T18:53:30.971 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:53:30.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:53:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.147+0000 7f3649800700 1 Processor -- start 2024-09-13T18:53:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.147+0000 7f3649800700 1 -- start start 2024-09-13T18:53:31.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3649800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36441580b0 0x7f364406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3649800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36440b3d10 con 0x7f364406b4b0 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3649800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3644161d50 con 0x7f36441614b0 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3649800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3644162030 con 0x7f36441580b0 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3643e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36441580b0 0x7f364406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3648e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f364406b4b0 0x7f36440b44f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47636/0 (socket says 172.21.15.81:47636) 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3648e00700 1 -- 172.21.15.81:0/2700041648 learned_addr learned my addr 172.21.15.81:0/2700041648 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:31.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3643e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f36441580b0 0x7f364406cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46246/0 (socket says 172.21.15.81:46246) 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3643e00700 1 -- 172.21.15.81:0/2700041648 >> v1:172.21.15.178:6789/0 conn(0x7f36441614b0 legacy=0x7f364406ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3643e00700 1 -- 172.21.15.81:0/2700041648 >> v1:172.21.15.81:6789/0 conn(0x7f364406b4b0 legacy=0x7f36440b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3643e00700 1 -- 172.21.15.81:0/2700041648 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3644162310 con 0x7f36441580b0 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3643e00700 1 --2- 172.21.15.81:0/2700041648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441580b0 0x7f364406cc90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f36440b3f00 tx=0x7f3634009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3683a55b9fac5a2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3642a00700 1 -- 172.21.15.81:0/2700041648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3634004230 con 0x7f36441580b0 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3642a00700 1 -- 172.21.15.81:0/2700041648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634004390 con 0x7f36441580b0 2024-09-13T18:53:31.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.151+0000 7f3642a00700 1 -- 172.21.15.81:0/2700041648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340036c0 con 0x7f36441580b0 2024-09-13T18:53:31.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 -- 172.21.15.81:0/2700041648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441580b0 msgr2=0x7f364406cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 --2- 172.21.15.81:0/2700041648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441580b0 0x7f364406cc90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f36440b3f00 tx=0x7f3634009b30 comp rx=0 tx=0).stop 2024-09-13T18:53:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 -- 172.21.15.81:0/2700041648 shutdown_connections 2024-09-13T18:53:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 --2- 172.21.15.81:0/2700041648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441580b0 0x7f364406cc90 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 -- 172.21.15.81:0/2700041648 >> 172.21.15.81:0/2700041648 conn(0x7f3644071ce0 msgr2=0x7f36440720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 -- 172.21.15.81:0/2700041648 shutdown_connections 2024-09-13T18:53:31.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.155+0000 7f3649800700 1 -- 172.21.15.81:0/2700041648 wait complete. 2024-09-13T18:53:31.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 Processor -- start 2024-09-13T18:53:31.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 -- start start 2024-09-13T18:53:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364406b4b0 0x7f364414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:31.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36441580b0 0x7f36440cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 0x7f36440d0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364414dc00 con 0x7f36441614b0 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36440d08d0 con 0x7f36441580b0 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3649800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36440d0bb0 con 0x7f364406b4b0 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 0x7f36440d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 0x7f36440d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46256/0 (socket says 172.21.15.81:46256) 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 -- 172.21.15.81:0/805495915 learned_addr learned my addr 172.21.15.81:0/805495915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3643e00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364406b4b0 0x7f364414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3643400700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36441580b0 0x7f36440cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 -- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364406b4b0 msgr2=0x7f364414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364406b4b0 0x7f364414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 -- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36441580b0 msgr2=0x7f36440cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36441580b0 0x7f36440cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3648e00700 1 -- 172.21.15.81:0/805495915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340094b0 con 0x7f36441614b0 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.159+0000 7f3643400700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36441580b0 0x7f36440cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:31.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f3648e00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 0x7f36440d0080 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f363c00cbc0 tx=0x7f363c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00a7b0 con 0x7f36441614b0 2024-09-13T18:53:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00a910 con 0x7f36441614b0 2024-09-13T18:53:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364414d540 con 0x7f36441614b0 2024-09-13T18:53:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00ac80 con 0x7f36441614b0 2024-09-13T18:53:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36440d05c0 con 0x7f36441614b0 2024-09-13T18:53:31.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.163+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364406cc90 con 0x7f36441614b0 2024-09-13T18:53:31.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.167+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f363c01b3b0 con 0x7f36441614b0 2024-09-13T18:53:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.167+0000 7f363be00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3624066730 0x7f3624068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.167+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f363c083730 con 0x7f36441614b0 2024-09-13T18:53:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.167+0000 7f3643e00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3624066730 0x7f3624068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.167+0000 7f3643e00700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3624066730 0x7f3624068bf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36440b3f00 tx=0x7f3634008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:31.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.171+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f363c050d50 con 0x7f36441614b0 2024-09-13T18:53:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.351+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3644067730 con 0x7f36441614b0 2024-09-13T18:53:31.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.935+0000 7f363be00700 1 -- 172.21.15.81:0/805495915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) v1 ==== 138+0+0 (secure 0 0 0) 0x7f363c054370 con 0x7f36441614b0 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3624066730 msgr2=0x7f3624068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3624066730 0x7f3624068bf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36440b3f00 tx=0x7f3634008030 comp rx=0 tx=0).stop 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 msgr2=0x7f36440d0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 0x7f36440d0080 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f363c00cbc0 tx=0x7f363c00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 shutdown_connections 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3624066730 0x7f3624068bf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36441614b0 0x7f36440d0080 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36441580b0 0x7f36440cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 --2- 172.21.15.81:0/805495915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f364406b4b0 0x7f364414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 >> 172.21.15.81:0/805495915 conn(0x7f3644071ce0 msgr2=0x7f364406ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:31.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 shutdown_connections 2024-09-13T18:53:31.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:31.939+0000 7f3649800700 1 -- 172.21.15.81:0/805495915 wait complete. 2024-09-13T18:53:31.950 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:53:31.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:53:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.135+0000 7ffa7e000700 1 Processor -- start 2024-09-13T18:53:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.135+0000 7ffa7e000700 1 -- start start 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7e000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa78156e70 0x7ffa7815d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780b3ea0 0x7ffa780ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7e000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780ceae0 con 0x7ffa780cf3a0 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7e000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7815d450 con 0x7ffa78156e70 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780cedc0 con 0x7ffa780b3ea0 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7d600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ffa780cf3a0 0x7ffa78159700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47640/0 (socket says 172.21.15.81:47640) 2024-09-13T18:53:32.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7d600700 1 -- 172.21.15.81:0/3726759200 learned_addr learned my addr 172.21.15.81:0/3726759200 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:32.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3726759200 >> v2:172.21.15.178:3300/0 conn(0x7ffa78156e70 0x7ffa7815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa77e00700 1 --2- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780b3ea0 0x7ffa780ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa77400700 1 -- 172.21.15.81:0/3726759200 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799445514 0 0) 0x7ffa780ceae0 con 0x7ffa780cf3a0 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa77400700 1 -- 172.21.15.81:0/3726759200 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa600035d0 con 0x7ffa780cf3a0 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7cc00700 1 -- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780b3ea0 msgr2=0x7ffa780ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780b3ea0 0x7ffa780ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7cc00700 1 -- 172.21.15.81:0/3726759200 >> v1:172.21.15.81:6789/0 conn(0x7ffa780cf3a0 legacy=0x7ffa78159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:32.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7cc00700 1 -- 172.21.15.81:0/3726759200 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7815cd90 con 0x7ffa78156e70 2024-09-13T18:53:32.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa78156e70 0x7ffa7815d870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009850 tx=0x7ffa6c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9fa6af0c71fbd28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa77400700 1 -- 172.21.15.81:0/3726759200 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c011830 con 0x7ffa78156e70 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa77400700 1 -- 172.21.15.81:0/3726759200 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c011990 con 0x7ffa78156e70 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.139+0000 7ffa77400700 1 -- 172.21.15.81:0/3726759200 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c011d40 con 0x7ffa78156e70 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa78156e70 msgr2=0x7ffa7815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa78156e70 0x7ffa7815d870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009850 tx=0x7ffa6c009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- 172.21.15.81:0/3726759200 shutdown_connections 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780b3ea0 0x7ffa780ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3726759200 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa78156e70 0x7ffa7815d870 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- 172.21.15.81:0/3726759200 >> 172.21.15.81:0/3726759200 conn(0x7ffa7806a570 msgr2=0x7ffa7806a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- 172.21.15.81:0/3726759200 shutdown_connections 2024-09-13T18:53:32.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- 172.21.15.81:0/3726759200 wait complete. 2024-09-13T18:53:32.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 Processor -- start 2024-09-13T18:53:32.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- start start 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa780b3ea0 0x7ffa780af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780cf3a0 0x7ffa78154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 0x7ffa781e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa781e67f0 con 0x7ffa78156e70 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa781e5f00 con 0x7ffa780b3ea0 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.143+0000 7ffa7e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780afcd0 con 0x7ffa780cf3a0 2024-09-13T18:53:32.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 0x7ffa781e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 0x7ffa781e6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46258/0 (socket says 172.21.15.81:46258) 2024-09-13T18:53:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 -- 172.21.15.81:0/3801189987 learned_addr learned my addr 172.21.15.81:0/3801189987 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:32.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa780b3ea0 0x7ffa780af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa77e00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780cf3a0 0x7ffa78154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 -- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780cf3a0 msgr2=0x7ffa78154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780cf3a0 0x7ffa78154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 -- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa780b3ea0 msgr2=0x7ffa780af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa780b3ea0 0x7ffa780af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 -- 172.21.15.81:0/3801189987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0094b0 con 0x7ffa78156e70 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa77e00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780cf3a0 0x7ffa78154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa780b3ea0 0x7ffa780af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:32.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7d600700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 0x7ffa781e6c80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000cb40 tx=0x7ffa7000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000a9e0 con 0x7ffa78156e70 2024-09-13T18:53:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000ab40 con 0x7ffa78156e70 2024-09-13T18:53:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000ce60 con 0x7ffa78156e70 2024-09-13T18:53:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa781e61a0 con 0x7ffa78156e70 2024-09-13T18:53:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa780af9c0 con 0x7ffa78156e70 2024-09-13T18:53:32.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.147+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa781e69a0 con 0x7ffa78156e70 2024-09-13T18:53:32.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.151+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa7001b3b0 con 0x7ffa78156e70 2024-09-13T18:53:32.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.151+0000 7ffa74c00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffa58066730 0x7ffa58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:32.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.151+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5547+0+0 (secure 0 0 0) 0x7ffa70083d60 con 0x7ffa78156e70 2024-09-13T18:53:32.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.151+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffa58066730 0x7ffa58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:32.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.151+0000 7ffa7cc00700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffa58066730 0x7ffa58068bf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0090b0 tx=0x7ffa6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:32.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.155+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa70051250 con 0x7ffa78156e70 2024-09-13T18:53:32.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.339+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ffa780ceae0 con 0x7ffa78156e70 2024-09-13T18:53:32.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.947+0000 7ffa74c00700 1 -- 172.21.15.81:0/3801189987 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) v1 ==== 170+0+0 (secure 0 0 0) 0x7ffa70054870 con 0x7ffa78156e70 2024-09-13T18:53:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffa58066730 msgr2=0x7ffa58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffa58066730 0x7ffa58068bf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0090b0 tx=0x7ffa6c008030 comp rx=0 tx=0).stop 2024-09-13T18:53:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 msgr2=0x7ffa781e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:32.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 0x7ffa781e6c80 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000cb40 tx=0x7ffa7000cc20 comp rx=0 tx=0).stop 2024-09-13T18:53:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 shutdown_connections 2024-09-13T18:53:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffa58066730 0x7ffa58068bf0 secure :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0090b0 tx=0x7ffa6c008030 comp rx=0 tx=0).stop 2024-09-13T18:53:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa78156e70 0x7ffa781e6c80 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa780cf3a0 0x7ffa78154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 --2- 172.21.15.81:0/3801189987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa780b3ea0 0x7ffa780af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:32.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.959+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 >> 172.21.15.81:0/3801189987 conn(0x7ffa7806a570 msgr2=0x7ffa7815bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.963+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 shutdown_connections 2024-09-13T18:53:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:32.963+0000 7ffa7e000700 1 -- 172.21.15.81:0/3801189987 wait complete. 2024-09-13T18:53:32.973 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:53:32.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:53:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.159+0000 7f696e400700 1 Processor -- start 2024-09-13T18:53:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.159+0000 7f696e400700 1 -- start start 2024-09-13T18:53:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696e400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69680b1ff0 0x7f696806b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f696815d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696e400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6968161510 con 0x7f69680cef60 2024-09-13T18:53:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696e400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696806bd50 con 0x7f69680b1ff0 2024-09-13T18:53:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6968153ee0 con 0x7f696806b560 2024-09-13T18:53:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696d000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f69680cef60 0x7f69680b18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47650/0 (socket says 172.21.15.81:47650) 2024-09-13T18:53:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696d000700 1 -- 172.21.15.81:0/2494105360 learned_addr learned my addr 172.21.15.81:0/2494105360 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696da00700 1 --2- 172.21.15.81:0/2494105360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f696815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967e00700 1 --2- 172.21.15.81:0/2494105360 >> v2:172.21.15.178:3300/0 conn(0x7f69680b1ff0 0x7f696806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967400700 1 -- 172.21.15.81:0/2494105360 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759489154 0 0) 0x7f695c001110 con 0x7f69680cef60 2024-09-13T18:53:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967400700 1 -- 172.21.15.81:0/2494105360 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69500035d0 con 0x7f69680cef60 2024-09-13T18:53:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696da00700 1 -- 172.21.15.81:0/2494105360 >> v2:172.21.15.178:3300/0 conn(0x7f69680b1ff0 msgr2=0x7f696806b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696da00700 1 --2- 172.21.15.81:0/2494105360 >> v2:172.21.15.178:3300/0 conn(0x7f69680b1ff0 0x7f696806b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696da00700 1 -- 172.21.15.81:0/2494105360 >> v1:172.21.15.81:6789/0 conn(0x7f69680cef60 legacy=0x7f69680b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696da00700 1 -- 172.21.15.81:0/2494105360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69681607b0 con 0x7f696806b560 2024-09-13T18:53:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967e00700 1 --2- 172.21.15.81:0/2494105360 >> v2:172.21.15.178:3300/0 conn(0x7f69680b1ff0 0x7f696806b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f696da00700 1 --2- 172.21.15.81:0/2494105360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f696815d020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6960009d90 tx=0x7f696000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e658c8c7046b9cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967400700 1 -- 172.21.15.81:0/2494105360 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696000e070 con 0x7f696806b560 2024-09-13T18:53:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967400700 1 -- 172.21.15.81:0/2494105360 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696000bb20 con 0x7f696806b560 2024-09-13T18:53:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.163+0000 7f6967400700 1 -- 172.21.15.81:0/2494105360 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960012430 con 0x7f696806b560 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 -- 172.21.15.81:0/2494105360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 msgr2=0x7f696815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 --2- 172.21.15.81:0/2494105360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f696815d020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6960009d90 tx=0x7f696000b330 comp rx=0 tx=0).stop 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 -- 172.21.15.81:0/2494105360 shutdown_connections 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 --2- 172.21.15.81:0/2494105360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f696815d020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 --2- 172.21.15.81:0/2494105360 >> v2:172.21.15.178:3300/0 conn(0x7f69680b1ff0 0x7f696806b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 -- 172.21.15.81:0/2494105360 >> 172.21.15.81:0/2494105360 conn(0x7f696806cb90 msgr2=0x7f696806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 -- 172.21.15.81:0/2494105360 shutdown_connections 2024-09-13T18:53:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 -- 172.21.15.81:0/2494105360 wait complete. 2024-09-13T18:53:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 Processor -- start 2024-09-13T18:53:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.167+0000 7f696e400700 1 -- start start 2024-09-13T18:53:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f69680adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 0x7f69680ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69680cef60 0x7f696814b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696814eba0 con 0x7f69680b1ff0 2024-09-13T18:53:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69681e73e0 con 0x7f69680cef60 2024-09-13T18:53:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696814edd0 con 0x7f696806b560 2024-09-13T18:53:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 0x7f69680ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 0x7f69680ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46272/0 (socket says 172.21.15.81:46272) 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 -- 172.21.15.81:0/3334365285 learned_addr learned my addr 172.21.15.81:0/3334365285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696d000700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f69680adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696da00700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69680cef60 0x7f696814b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 -- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 msgr2=0x7f69680adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f69680adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 -- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69680cef60 msgr2=0x7f696814b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69680cef60 0x7f696814b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 -- 172.21.15.81:0/3334365285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540094b0 con 0x7f69680b1ff0 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696d000700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f69680adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6967e00700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 0x7f69680ae230 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f695400ebe0 tx=0x7f695400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400c890 con 0x7f69680b1ff0 2024-09-13T18:53:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400c9f0 con 0x7f69680b1ff0 2024-09-13T18:53:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400cd80 con 0x7f69680b1ff0 2024-09-13T18:53:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6960009a70 con 0x7f69680b1ff0 2024-09-13T18:53:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.171+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696814f390 con 0x7f69680b1ff0 2024-09-13T18:53:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.175+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696806b020 con 0x7f69680b1ff0 2024-09-13T18:53:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.175+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6954013470 con 0x7f69680b1ff0 2024-09-13T18:53:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.179+0000 7f6964c00700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6948066730 0x7f6948068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.179+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f6954084c40 con 0x7f69680b1ff0 2024-09-13T18:53:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.179+0000 7f696d000700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6948066730 0x7f6948068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.179+0000 7f696d000700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6948066730 0x7f6948068bf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f695c001270 tx=0x7f695c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.183+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6954051e20 con 0x7f69680b1ff0 2024-09-13T18:53:33.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.399+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f696806a750 con 0x7f69680b1ff0 2024-09-13T18:53:33.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.415+0000 7f6964c00700 1 -- 172.21.15.81:0/3334365285 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6954021070 con 0x7f69680b1ff0 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6948066730 msgr2=0x7f6948068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6948066730 0x7f6948068bf0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f695c001270 tx=0x7f695c009040 comp rx=0 tx=0).stop 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 msgr2=0x7f69680ae230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 0x7f69680ae230 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f695400ebe0 tx=0x7f695400eef0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 shutdown_connections 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6948066730 0x7f6948068bf0 secure :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f695c001270 tx=0x7f695c009040 comp rx=0 tx=0).stop 2024-09-13T18:53:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69680cef60 0x7f696814b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69680b1ff0 0x7f69680ae230 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 --2- 172.21.15.81:0/3334365285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696806b560 0x7f69680adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 >> 172.21.15.81:0/3334365285 conn(0x7f696806cb90 msgr2=0x7f696806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 shutdown_connections 2024-09-13T18:53:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.419+0000 7f696e400700 1 -- 172.21.15.81:0/3334365285 wait complete. 2024-09-13T18:53:33.445 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 13 and data pool 14 2024-09-13T18:53:33.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.623+0000 7f0015a00700 1 Processor -- start 2024-09-13T18:53:33.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.623+0000 7f0015a00700 1 -- start start 2024-09-13T18:53:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f0015a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f001013ebc0 0x7f001006a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f0015a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 0x7f001006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f0015a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 0x7f001015d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f0015a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001013fcc0 con 0x7f001006ab10 2024-09-13T18:53:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f0015a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001006af50 con 0x7f001013ebc0 2024-09-13T18:53:33.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f0015a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001013f0f0 con 0x7f00100703d0 2024-09-13T18:53:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 0x7f001006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 0x7f001015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000ea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f001013ebc0 0x7f001006a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000ea00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f001013ebc0 0x7f001006a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:48184/0 (socket says 172.21.15.81:48184) 2024-09-13T18:53:33.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 0x7f001015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:51696/0 (socket says 172.21.15.81:51696) 2024-09-13T18:53:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 0x7f001006fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46284/0 (socket says 172.21.15.81:46284) 2024-09-13T18:53:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 -- 172.21.15.81:0/1279548584 learned_addr learned my addr 172.21.15.81:0/1279548584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 -- 172.21.15.81:0/1279548584 >> v2:172.21.15.178:3300/0 conn(0x7f001013ebc0 msgr2=0x7f001006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 --2- 172.21.15.81:0/1279548584 >> v2:172.21.15.178:3300/0 conn(0x7f001013ebc0 0x7f001006a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 -- 172.21.15.81:0/1279548584 >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 msgr2=0x7f001006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 --2- 172.21.15.81:0/1279548584 >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 0x7f001006fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000f400700 1 -- 172.21.15.81:0/1279548584 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001013f390 con 0x7f00100703d0 2024-09-13T18:53:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.627+0000 7f000e000700 1 --2- 172.21.15.81:0/1279548584 >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 0x7f001006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f000f400700 1 --2- 172.21.15.81:0/1279548584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 0x7f001015d560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00100cc5b0 tx=0x7f000800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0930c8c49f14f05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f000d600700 1 -- 172.21.15.81:0/1279548584 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800e070 con 0x7f00100703d0 2024-09-13T18:53:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f000d600700 1 -- 172.21.15.81:0/1279548584 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800b910 con 0x7f00100703d0 2024-09-13T18:53:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f000d600700 1 -- 172.21.15.81:0/1279548584 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800bcc0 con 0x7f00100703d0 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 -- 172.21.15.81:0/1279548584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 msgr2=0x7f001015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 --2- 172.21.15.81:0/1279548584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 0x7f001015d560 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00100cc5b0 tx=0x7f000800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 -- 172.21.15.81:0/1279548584 shutdown_connections 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 --2- 172.21.15.81:0/1279548584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100703d0 0x7f001015d560 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 --2- 172.21.15.81:0/1279548584 >> v2:172.21.15.81:3300/0 conn(0x7f001006ab10 0x7f001006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 --2- 172.21.15.81:0/1279548584 >> v2:172.21.15.178:3300/0 conn(0x7f001013ebc0 0x7f001006a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 -- 172.21.15.81:0/1279548584 >> 172.21.15.81:0/1279548584 conn(0x7f00100b08d0 msgr2=0x7f00100b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 -- 172.21.15.81:0/1279548584 shutdown_connections 2024-09-13T18:53:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.631+0000 7f0015a00700 1 -- 172.21.15.81:0/1279548584 wait complete. 2024-09-13T18:53:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.635+0000 7f0015a00700 1 Processor -- start 2024-09-13T18:53:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.635+0000 7f0015a00700 1 -- start start 2024-09-13T18:53:33.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 0x7f001015da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100703d0 0x7f00100ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f001013ebc0 0x7f0010155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100ce120 con 0x7f001006ab10 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100cd250 con 0x7f00100703d0 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100cd4a0 con 0x7f001013ebc0 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 0x7f001015da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 0x7f001015da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46298/0 (socket says 172.21.15.81:46298) 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 -- 172.21.15.81:0/3219172545 learned_addr learned my addr 172.21.15.81:0/3219172545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000e000700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100703d0 0x7f00100ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000f400700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f001013ebc0 0x7f0010155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 -- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f001013ebc0 msgr2=0x7f0010155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f001013ebc0 0x7f0010155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 -- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100703d0 msgr2=0x7f00100ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100703d0 0x7f00100ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 -- 172.21.15.81:0/3219172545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0094b0 con 0x7f001006ab10 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000f400700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f001013ebc0 0x7f0010155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f000ea00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 0x7f001015da10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f000000ebe0 tx=0x7f000000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000009740 con 0x7f001006ab10 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0008009b30 con 0x7f001006ab10 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000c850 con 0x7f001006ab10 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000cbe0 con 0x7f001006ab10 2024-09-13T18:53:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.639+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00100cda60 con 0x7f001006ab10 2024-09-13T18:53:33.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.643+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100ce260 con 0x7f001006ab10 2024-09-13T18:53:33.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.643+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f000000cd40 con 0x7f001006ab10 2024-09-13T18:53:33.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.643+0000 7f0006a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efff0066730 0x7efff0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:33.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.643+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0000084290 con 0x7f001006ab10 2024-09-13T18:53:33.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.643+0000 7f000e000700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efff0066730 0x7efff0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:33.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.647+0000 7f000e000700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efff0066730 0x7efff0068bf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f00101f4040 tx=0x7efffc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:33.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.651+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0000051550 con 0x7f001006ab10 2024-09-13T18:53:33.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.835+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0010070860 con 0x7f001006ab10 2024-09-13T18:53:33.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.835+0000 7f0006a00700 1 -- 172.21.15.81:0/3219172545 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16730 (secure 0 0 0) 0x7f0000054b70 con 0x7f001006ab10 2024-09-13T18:53:33.847 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:33.847 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:53:33.402717+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efff0066730 msgr2=0x7efff0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efff0066730 0x7efff0068bf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f00101f4040 tx=0x7efffc009240 comp rx=0 tx=0).stop 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 msgr2=0x7f001015da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 0x7f001015da10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f000000ebe0 tx=0x7f000000eef0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 shutdown_connections 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efff0066730 0x7efff0068bf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f001013ebc0 0x7f0010155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100703d0 0x7f00100ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 --2- 172.21.15.81:0/3219172545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f001006ab10 0x7f001015da10 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 >> 172.21.15.81:0/3219172545 conn(0x7f00100b08d0 msgr2=0x7f001013da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 shutdown_connections 2024-09-13T18:53:33.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:33.839+0000 7f0015a00700 1 -- 172.21.15.81:0/3219172545 wait complete. 2024-09-13T18:53:33.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:34.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.030+0000 7fd23ec00700 1 Processor -- start 2024-09-13T18:53:34.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.030+0000 7fd23ec00700 1 -- start start 2024-09-13T18:53:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23ec00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23806c460 0x7fd23806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23ec00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd23806a5d0 0x7fd23806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23ec00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2380cdd90 con 0x7fd23815b700 2024-09-13T18:53:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23ec00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23806ce10 con 0x7fd23806c460 2024-09-13T18:53:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23ec00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23806af50 con 0x7fd23806a5d0 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23806c460 0x7fd23806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd23806c460 0x7fd23806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46300/0 (socket says 172.21.15.81:46300) 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 -- 172.21.15.81:0/395815507 learned_addr learned my addr 172.21.15.81:0/395815507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd23815b700 0x7fd23815bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47654/0 (socket says 172.21.15.81:47654) 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23cc00700 1 --2- 172.21.15.81:0/395815507 >> v2:172.21.15.178:3300/0 conn(0x7fd23806a5d0 0x7fd23806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 -- 172.21.15.81:0/395815507 >> v2:172.21.15.178:3300/0 conn(0x7fd23806a5d0 msgr2=0x7fd23806aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 --2- 172.21.15.81:0/395815507 >> v2:172.21.15.178:3300/0 conn(0x7fd23806a5d0 0x7fd23806aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 -- 172.21.15.81:0/395815507 >> v1:172.21.15.81:6789/0 conn(0x7fd23815b700 legacy=0x7fd23815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 -- 172.21.15.81:0/395815507 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23806d7e0 con 0x7fd23806c460 2024-09-13T18:53:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd23cc00700 1 --2- 172.21.15.81:0/395815507 >> v2:172.21.15.178:3300/0 conn(0x7fd23806a5d0 0x7fd23806aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd237400700 1 --2- 172.21.15.81:0/395815507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806c460 0x7fd23806d2a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd2380722a0 tx=0x7fd224009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7598123bcf4bba36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd236a00700 1 -- 172.21.15.81:0/395815507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400b8a0 con 0x7fd23806c460 2024-09-13T18:53:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd236a00700 1 -- 172.21.15.81:0/395815507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22400ba00 con 0x7fd23806c460 2024-09-13T18:53:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.034+0000 7fd236a00700 1 -- 172.21.15.81:0/395815507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22400bd90 con 0x7fd23806c460 2024-09-13T18:53:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 -- 172.21.15.81:0/395815507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806c460 msgr2=0x7fd23806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 --2- 172.21.15.81:0/395815507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806c460 0x7fd23806d2a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd2380722a0 tx=0x7fd224009bf0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 -- 172.21.15.81:0/395815507 shutdown_connections 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 --2- 172.21.15.81:0/395815507 >> v2:172.21.15.178:3300/0 conn(0x7fd23806a5d0 0x7fd23806aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 --2- 172.21.15.81:0/395815507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806c460 0x7fd23806d2a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 -- 172.21.15.81:0/395815507 >> 172.21.15.81:0/395815507 conn(0x7fd2380b08d0 msgr2=0x7fd2380b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 -- 172.21.15.81:0/395815507 shutdown_connections 2024-09-13T18:53:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 -- 172.21.15.81:0/395815507 wait complete. 2024-09-13T18:53:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 Processor -- start 2024-09-13T18:53:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.038+0000 7fd23ec00700 1 -- start start 2024-09-13T18:53:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 0x7fd23815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd23806c460 0x7fd2381e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd23815b700 0x7fd2381e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381e46e0 con 0x7fd23806a5d0 2024-09-13T18:53:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381e7bf0 con 0x7fd23806c460 2024-09-13T18:53:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381e4930 con 0x7fd23815b700 2024-09-13T18:53:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 0x7fd23815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 0x7fd23815d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46306/0 (socket says 172.21.15.81:46306) 2024-09-13T18:53:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 -- 172.21.15.81:0/397960472 learned_addr learned my addr 172.21.15.81:0/397960472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237400700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd23806c460 0x7fd2381e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23cc00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd23815b700 0x7fd2381e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 -- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd23815b700 msgr2=0x7fd2381e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd23815b700 0x7fd2381e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 -- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd23806c460 msgr2=0x7fd2381e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd23806c460 0x7fd2381e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 -- 172.21.15.81:0/397960472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224009570 con 0x7fd23806a5d0 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237400700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd23806c460 0x7fd2381e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd237e00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 0x7fd23815d070 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c410 tx=0x7fd22800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228005cd0 con 0x7fd23806a5d0 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228005e30 con 0x7fd23806a5d0 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2381e4c10 con 0x7fd23806a5d0 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280072f0 con 0x7fd23806a5d0 2024-09-13T18:53:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.042+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23815c870 con 0x7fd23806a5d0 2024-09-13T18:53:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.046+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23806aa10 con 0x7fd23806a5d0 2024-09-13T18:53:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.046+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd228007450 con 0x7fd23806a5d0 2024-09-13T18:53:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.046+0000 7fd22fe00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd218066730 0x7fd218068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.046+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd228083730 con 0x7fd23806a5d0 2024-09-13T18:53:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.046+0000 7fd237400700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd218066730 0x7fd218068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.050+0000 7fd237400700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd218066730 0x7fd218068bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd224000c00 tx=0x7fd224008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.054+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd228050960 con 0x7fd23806a5d0 2024-09-13T18:53:34.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.238+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd23806c240 con 0x7fd23806a5d0 2024-09-13T18:53:34.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.242+0000 7fd22fe00700 1 -- 172.21.15.81:0/397960472 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16730 (secure 0 0 0) 0x7fd228053f80 con 0x7fd23806a5d0 2024-09-13T18:53:34.252 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:34.252 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:53:33.402717+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd218066730 msgr2=0x7fd218068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd218066730 0x7fd218068bf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd224000c00 tx=0x7fd224008030 comp rx=0 tx=0).stop 2024-09-13T18:53:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 msgr2=0x7fd23815d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 0x7fd23815d070 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c410 tx=0x7fd22800c7d0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 shutdown_connections 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd218066730 0x7fd218068bf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd23815b700 0x7fd2381e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd23806c460 0x7fd2381e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 --2- 172.21.15.81:0/397960472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd23806a5d0 0x7fd23815d070 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 >> 172.21.15.81:0/397960472 conn(0x7fd2380b08d0 msgr2=0x7fd2380b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 shutdown_connections 2024-09-13T18:53:34.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.246+0000 7fd23ec00700 1 -- 172.21.15.81:0/397960472 wait complete. 2024-09-13T18:53:34.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:53:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.442+0000 7f3c07000700 1 Processor -- start 2024-09-13T18:53:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.442+0000 7f3c07000700 1 -- start start 2024-09-13T18:53:34.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c07000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c0006d070 0x7f3c001657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c07000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000b1980 con 0x7f3c0006d620 2024-09-13T18:53:34.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c07000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c000b2500 con 0x7f3c00143b70 2024-09-13T18:53:34.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c07000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000b1bd0 con 0x7f3c0006d070 2024-09-13T18:53:34.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c05200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3c0006d620 0x7f3c0006c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47656/0 (socket says 172.21.15.81:47656) 2024-09-13T18:53:34.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c05200700 1 -- 172.21.15.81:0/1239388936 learned_addr learned my addr 172.21.15.81:0/1239388936 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:34.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c05c00700 1 --1- 172.21.15.81:0/1239388936 >> v1:172.21.15.178:6789/0 conn(0x7f3c00143b70 0x7f3c000cde20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:52524/0 (socket says 172.21.15.81:52524) 2024-09-13T18:53:34.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c06600700 1 --2- 172.21.15.81:0/1239388936 >> v2:172.21.15.178:3300/0 conn(0x7f3c0006d070 0x7f3c001657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353100016 0 0) 0x7f3c000b2500 con 0x7f3c00143b70 2024-09-13T18:53:34.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be40035d0 con 0x7f3c00143b70 2024-09-13T18:53:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630431450 0 0) 0x7f3c000b1980 con 0x7f3c0006d620 2024-09-13T18:53:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c000b2500 con 0x7f3c0006d620 2024-09-13T18:53:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c06600700 1 -- 172.21.15.81:0/1239388936 >> v1:172.21.15.178:6789/0 conn(0x7f3c00143b70 legacy=0x7f3c000cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c06600700 1 -- 172.21.15.81:0/1239388936 >> v1:172.21.15.81:6789/0 conn(0x7f3c0006d620 legacy=0x7f3c0006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c06600700 1 -- 172.21.15.81:0/1239388936 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c000b1eb0 con 0x7f3c0006d070 2024-09-13T18:53:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.446+0000 7f3c06600700 1 --2- 172.21.15.81:0/1239388936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d070 0x7f3c001657b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009d90 tx=0x7f3bf800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de3126ade103acb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800e070 con 0x7f3c0006d070 2024-09-13T18:53:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf800bb20 con 0x7f3c0006d070 2024-09-13T18:53:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3bffe00700 1 -- 172.21.15.81:0/1239388936 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf800be90 con 0x7f3c0006d070 2024-09-13T18:53:34.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 -- 172.21.15.81:0/1239388936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d070 msgr2=0x7f3c001657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 --2- 172.21.15.81:0/1239388936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d070 0x7f3c001657b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009d90 tx=0x7f3bf800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:34.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 -- 172.21.15.81:0/1239388936 shutdown_connections 2024-09-13T18:53:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 --2- 172.21.15.81:0/1239388936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d070 0x7f3c001657b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 -- 172.21.15.81:0/1239388936 >> 172.21.15.81:0/1239388936 conn(0x7f3c0006a390 msgr2=0x7f3c0006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 -- 172.21.15.81:0/1239388936 shutdown_connections 2024-09-13T18:53:34.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.450+0000 7f3c07000700 1 -- 172.21.15.81:0/1239388936 wait complete. 2024-09-13T18:53:34.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 Processor -- start 2024-09-13T18:53:34.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 -- start start 2024-09-13T18:53:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 0x7f3c0013cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d620 0x7f3c001f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c00143b70 0x7f3c000ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f72e0 con 0x7f3c0006d070 2024-09-13T18:53:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f3d50 con 0x7f3c0006d620 2024-09-13T18:53:34.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c07000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f6760 con 0x7f3c00143b70 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 0x7f3c0013cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 0x7f3c0013cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46316/0 (socket says 172.21.15.81:46316) 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 -- 172.21.15.81:0/3817383004 learned_addr learned my addr 172.21.15.81:0/3817383004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c06600700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c00143b70 0x7f3c000ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05200700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d620 0x7f3c001f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 -- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c00143b70 msgr2=0x7f3c000ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c00143b70 0x7f3c000ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 -- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d620 msgr2=0x7f3c001f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d620 0x7f3c001f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05c00700 1 -- 172.21.15.81:0/3817383004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009a70 con 0x7f3c0006d070 2024-09-13T18:53:34.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.454+0000 7f3c05200700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d620 0x7f3c001f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3c05c00700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 0x7f3c0013cf70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c4d0 tx=0x7f3bf000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0005cd0 con 0x7f3c0006d070 2024-09-13T18:53:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf0005e30 con 0x7f3c0006d070 2024-09-13T18:53:34.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c001f6a40 con 0x7f3c0006d070 2024-09-13T18:53:34.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0007310 con 0x7f3c0006d070 2024-09-13T18:53:34.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c001f7000 con 0x7f3c0006d070 2024-09-13T18:53:34.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0006c960 con 0x7f3c0006d070 2024-09-13T18:53:34.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.458+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3bf0007470 con 0x7f3c0006d070 2024-09-13T18:53:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.462+0000 7f3bfd600700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3be0066730 0x7f3be0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.462+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3bf0083760 con 0x7f3c0006d070 2024-09-13T18:53:34.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.462+0000 7f3c05200700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3be0066730 0x7f3be0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:34.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.462+0000 7f3c05200700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3be0066730 0x7f3be0068bf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3c00155860 tx=0x7f3bec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:34.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.466+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3bf0050910 con 0x7f3c0006d070 2024-09-13T18:53:34.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:34.694+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3c00071f60 con 0x7f3c0006d070 2024-09-13T18:53:35.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.422+0000 7f3bfd600700 1 -- 172.21.15.81:0/3817383004 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3bf0053f30 con 0x7f3c0006d070 2024-09-13T18:53:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3be0066730 msgr2=0x7f3be0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3be0066730 0x7f3be0068bf0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3c00155860 tx=0x7f3bec009040 comp rx=0 tx=0).stop 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 msgr2=0x7f3c0013cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 0x7f3c0013cf70 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000c4d0 tx=0x7f3bf000c7e0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 shutdown_connections 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3be0066730 0x7f3be0068bf0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c00143b70 0x7f3c000ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c0006d620 0x7f3c001f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 --2- 172.21.15.81:0/3817383004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c0006d070 0x7f3c0013cf70 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 >> 172.21.15.81:0/3817383004 conn(0x7f3c0006a390 msgr2=0x7f3c000cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 shutdown_connections 2024-09-13T18:53:35.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.426+0000 7f3c07000700 1 -- 172.21.15.81:0/3817383004 wait complete. 2024-09-13T18:53:35.461 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:53:35.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:53:35.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9409a00700 1 Processor -- start 2024-09-13T18:53:35.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9409a00700 1 -- start start 2024-09-13T18:53:35.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9409a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f94040d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9409a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94040d0780 con 0x7f940415e720 2024-09-13T18:53:35.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9409a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9404143f40 con 0x7f9404143b60 2024-09-13T18:53:35.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9409a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940415f710 con 0x7f94040cfac0 2024-09-13T18:53:35.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9403400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f940415e720 0x7f940415ebd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47666/0 (socket says 172.21.15.81:47666) 2024-09-13T18:53:35.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.630+0000 7f9403400700 1 -- 172.21.15.81:0/1923740686 learned_addr learned my addr 172.21.15.81:0/1923740686 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:35.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f94040d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938967408 0 0) 0x7f93fc001490 con 0x7f940415e720 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e80035d0 con 0x7f940415e720 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2739767488 0 0) 0x7f93e80035d0 con 0x7f940415e720 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 msgr2=0x7f94040d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f94040d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 >> v1:172.21.15.178:6789/0 conn(0x7f9404143b60 legacy=0x7f94040cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940415f430 con 0x7f940415e720 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f93fc001b80 con 0x7f940415e720 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 >> v1:172.21.15.81:6789/0 conn(0x7f940415e720 legacy=0x7f940415ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f93e8003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8003f90 0x7f93e8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8004db0 0x7f93e8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940415f710 con 0x7f93e8004db0 2024-09-13T18:53:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e800ba90 con 0x7f93e8003f90 2024-09-13T18:53:35.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e800bc50 con 0x7f94040cfac0 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9403400700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8004db0 0x7f93e8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8003f90 0x7f93e8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402a00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f93e8003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 -- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 msgr2=0x7f93e8003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f93e8003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 -- 172.21.15.81:0/1923740686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8004db0 msgr2=0x7f93e8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93e8004db0 0x7f93e8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 -- 172.21.15.81:0/1923740686 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80035d0 con 0x7f93e8003f90 2024-09-13T18:53:35.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402a00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94040cfac0 0x7f93e8003a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:35.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8003f90 0x7f93e8004870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009b70 tx=0x7f93e80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1030826500bfb274 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:35.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00e6c0 con 0x7f93e8003f90 2024-09-13T18:53:35.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec00e820 con 0x7f93e8003f90 2024-09-13T18:53:35.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.634+0000 7f9402000700 1 -- 172.21.15.81:0/1923740686 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00eb90 con 0x7f93e8003f90 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 -- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8003f90 msgr2=0x7f93e8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 --2- 172.21.15.81:0/1923740686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e8003f90 0x7f93e8004870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f93ec009b70 tx=0x7f93e80058a0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9403400700 1 -- 172.21.15.81:0/1923740686 reap_dead start 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 -- 172.21.15.81:0/1923740686 shutdown_connections 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 -- 172.21.15.81:0/1923740686 >> 172.21.15.81:0/1923740686 conn(0x7f940406e660 msgr2=0x7f940406ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 -- 172.21.15.81:0/1923740686 shutdown_connections 2024-09-13T18:53:35.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 -- 172.21.15.81:0/1923740686 wait complete. 2024-09-13T18:53:35.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 Processor -- start 2024-09-13T18:53:35.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.638+0000 7f9409a00700 1 -- start start 2024-09-13T18:53:35.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e8003f90 0x7f94041f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 0x7f940415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940406a390 0x7f940406a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94041f6d00 con 0x7f940406b500 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94041f6460 con 0x7f940406a390 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94041f6740 con 0x7f93e8003f90 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 0x7f940415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 0x7f940415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46334/0 (socket says 172.21.15.81:46334) 2024-09-13T18:53:35.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 -- 172.21.15.81:0/1235848913 learned_addr learned my addr 172.21.15.81:0/1235848913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:35.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9402a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e8003f90 0x7f94041f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 -- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e8003f90 msgr2=0x7f94041f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e8003f90 0x7f94041f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9403400700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940406a390 0x7f940406a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 -- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940406a390 msgr2=0x7f940406a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940406a390 0x7f940406a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 -- 172.21.15.81:0/1235848913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94041f6a20 con 0x7f940406b500 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9403400700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940406a390 0x7f940406a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93fbe00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 0x7f940415d750 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f93e800bc20 tx=0x7f93ec0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00e6c0 con 0x7f940406b500 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec004050 con 0x7f940406b500 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec009ee0 con 0x7f940406b500 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94041f29a0 con 0x7f940406b500 2024-09-13T18:53:35.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.642+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94041f2ec0 con 0x7f940406b500 2024-09-13T18:53:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.646+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94040d1880 con 0x7f940406b500 2024-09-13T18:53:35.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.646+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93ec004400 con 0x7f940406b500 2024-09-13T18:53:35.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.646+0000 7f93faa00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93e0066730 0x7f93e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:35.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.646+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93ec0858d0 con 0x7f940406b500 2024-09-13T18:53:35.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.646+0000 7f9402a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93e0066730 0x7f93e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:35.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.650+0000 7f9402a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93e0066730 0x7f93e0068bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.654+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93ec052af0 con 0x7f940406b500 2024-09-13T18:53:35.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:35.874+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f940406ebf0 con 0x7f940406b500 2024-09-13T18:53:36.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.422+0000 7f93faa00700 1 -- 172.21.15.81:0/1235848913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f93ec056110 con 0x7f940406b500 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93e0066730 msgr2=0x7f93e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93e0066730 0x7f93e0068bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f4009040 comp rx=0 tx=0).stop 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 msgr2=0x7f940415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 0x7f940415d750 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f93e800bc20 tx=0x7f93ec0047e0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 shutdown_connections 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f93e0066730 0x7f93e0068bf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f940406a390 0x7f940406a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f940406b500 0x7f940415d750 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 --2- 172.21.15.81:0/1235848913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e8003f90 0x7f94041f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 >> 172.21.15.81:0/1235848913 conn(0x7f940406e660 msgr2=0x7f94040b3150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 shutdown_connections 2024-09-13T18:53:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.430+0000 7f9409a00700 1 -- 172.21.15.81:0/1235848913 wait complete. 2024-09-13T18:53:36.464 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:53:36.464 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.630+0000 7f6e48c00700 1 Processor -- start 2024-09-13T18:53:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.630+0000 7f6e48c00700 1 -- start start 2024-09-13T18:53:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e48c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e440ce4c0 0x7f6e4406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e48c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e440ad480 con 0x7f6e441573b0 2024-09-13T18:53:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e48c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e44157790 con 0x7f6e4406ab10 2024-09-13T18:53:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e48c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4406afa0 con 0x7f6e440ce4c0 2024-09-13T18:53:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e41e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6e441573b0 0x7f6e440cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45372/0 (socket says 172.21.15.81:45372) 2024-09-13T18:53:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e41e00700 1 -- 172.21.15.81:0/2080983599 learned_addr learned my addr 172.21.15.81:0/2080983599 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e41400700 1 --2- 172.21.15.81:0/2080983599 >> v2:172.21.15.81:3300/0 conn(0x7f6e440ce4c0 0x7f6e4406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196583318 0 0) 0x7f6e440ad480 con 0x7f6e441573b0 2024-09-13T18:53:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e280035d0 con 0x7f6e441573b0 2024-09-13T18:53:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 421817336 0 0) 0x7f6e280035d0 con 0x7f6e441573b0 2024-09-13T18:53:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 >> v2:172.21.15.81:3300/0 conn(0x7f6e440ce4c0 msgr2=0x7f6e4406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 --2- 172.21.15.81:0/2080983599 >> v2:172.21.15.81:3300/0 conn(0x7f6e440ce4c0 0x7f6e4406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 >> v1:172.21.15.178:6789/0 conn(0x7f6e4406ab10 legacy=0x7f6e4406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440ad6d0 con 0x7f6e441573b0 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f6e340019f0 con 0x7f6e441573b0 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 >> v1:172.21.15.81:6789/0 conn(0x7f6e441573b0 legacy=0x7f6e440cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.634+0000 7f6e40a00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e28003a20 0x7f6e28003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e28004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e28005230 0x7f6e2800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4406afa0 con 0x7f6e28004870 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2800c1d0 con 0x7f6e28003a20 2024-09-13T18:53:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2800c390 con 0x7f6e28005230 2024-09-13T18:53:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e28004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41e00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e28003a20 0x7f6e28003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e42800700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e28005230 0x7f6e2800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 -- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e28005230 msgr2=0x7f6e2800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e28005230 0x7f6e2800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 -- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e28003a20 msgr2=0x7f6e28003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e28003a20 0x7f6e28003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 -- 172.21.15.81:0/2080983599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280035d0 con 0x7f6e28004870 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41e00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e28003a20 0x7f6e28003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e42800700 1 -- 172.21.15.81:0/2080983599 reap_dead start 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e41400700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e28004cf0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009b70 tx=0x7f6e280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307a4bab18131574 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000e6c0 con 0x7f6e28004870 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000e820 con 0x7f6e28004870 2024-09-13T18:53:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e40a00700 1 -- 172.21.15.81:0/2080983599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000eb90 con 0x7f6e28004870 2024-09-13T18:53:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 -- 172.21.15.81:0/2080983599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 msgr2=0x7f6e28004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e28004cf0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009b70 tx=0x7f6e280058a0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 -- 172.21.15.81:0/2080983599 shutdown_connections 2024-09-13T18:53:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2080983599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e28004cf0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 -- 172.21.15.81:0/2080983599 >> 172.21.15.81:0/2080983599 conn(0x7f6e440b08d0 msgr2=0x7f6e440b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 -- 172.21.15.81:0/2080983599 shutdown_connections 2024-09-13T18:53:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.638+0000 7f6e48c00700 1 -- 172.21.15.81:0/2080983599 wait complete. 2024-09-13T18:53:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 Processor -- start 2024-09-13T18:53:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 -- start start 2024-09-13T18:53:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e4414cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e441564e0 0x7f6e4414d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e4414d880 0x7f6e4415fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441560c0 con 0x7f6e28004870 2024-09-13T18:53:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e441587b0 con 0x7f6e4414d880 2024-09-13T18:53:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.642+0000 7f6e48c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e44156960 con 0x7f6e441564e0 2024-09-13T18:53:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e4414cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e4414cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46434/0 (socket says 172.21.15.81:46434) 2024-09-13T18:53:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 -- 172.21.15.81:0/2778337436 learned_addr learned my addr 172.21.15.81:0/2778337436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e42800700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e4414d880 0x7f6e4415fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41400700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e441564e0 0x7f6e4414d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 -- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e441564e0 msgr2=0x7f6e4414d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e441564e0 0x7f6e4414d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 -- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e4414d880 msgr2=0x7f6e4415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e4414d880 0x7f6e4415fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 -- 172.21.15.81:0/2778337436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440b36b0 con 0x7f6e28004870 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e41e00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e4414cd20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400e410 tx=0x7f6e3400e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3400edd0 con 0x7f6e28004870 2024-09-13T18:53:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e34013420 con 0x7f6e28004870 2024-09-13T18:53:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34013790 con 0x7f6e28004870 2024-09-13T18:53:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e440b3160 con 0x7f6e28004870 2024-09-13T18:53:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e44155a00 con 0x7f6e28004870 2024-09-13T18:53:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.646+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4406a5d0 con 0x7f6e28004870 2024-09-13T18:53:36.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.650+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e340138f0 con 0x7f6e28004870 2024-09-13T18:53:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.650+0000 7f6e3a000700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e24066760 0x7f6e24068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.654+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6e34084a00 con 0x7f6e28004870 2024-09-13T18:53:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.654+0000 7f6e41400700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e24066760 0x7f6e24068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:36.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.654+0000 7f6e41400700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e24066760 0x7f6e24068c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6e300090b0 tx=0x7f6e30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.658+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e34051b90 con 0x7f6e28004870 2024-09-13T18:53:36.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.890+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e44161580 con 0x7f6e28004870 2024-09-13T18:53:36.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.890+0000 7f6e3a000700 1 -- 172.21.15.81:0/2778337436 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f6e34084070 con 0x7f6e28004870 2024-09-13T18:53:36.901 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:36.902 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7675,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:53:36.421441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:53:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e24066760 msgr2=0x7f6e24068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e24066760 0x7f6e24068c20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6e300090b0 tx=0x7f6e30008030 comp rx=0 tx=0).stop 2024-09-13T18:53:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 msgr2=0x7f6e4414cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:36.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e4414cd20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400e410 tx=0x7f6e3400e4f0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 shutdown_connections 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e24066760 0x7f6e24068c20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e4414d880 0x7f6e4415fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e441564e0 0x7f6e4414d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 --2- 172.21.15.81:0/2778337436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e28004870 0x7f6e4414cd20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 >> 172.21.15.81:0/2778337436 conn(0x7f6e440b08d0 msgr2=0x7f6e4406cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 shutdown_connections 2024-09-13T18:53:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:36.894+0000 7f6e48c00700 1 -- 172.21.15.81:0/2778337436 wait complete. 2024-09-13T18:53:36.907 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 86 2024-09-13T18:53:36.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:53:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.090+0000 7fb8de400700 1 Processor -- start 2024-09-13T18:53:37.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.090+0000 7fb8de400700 1 -- start start 2024-09-13T18:53:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8de400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 0x7fb8d80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8de400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8de400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d80b2ad0 con 0x7fb8d806aaa0 2024-09-13T18:53:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8de400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d815b960 con 0x7fb8d80cb020 2024-09-13T18:53:37.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8de400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d815bc40 con 0x7fb8d815c2a0 2024-09-13T18:53:37.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8dd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 0x7fb8d80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8d7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8dd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 0x7fb8d80cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46438/0 (socket says 172.21.15.81:46438) 2024-09-13T18:53:37.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8dd000700 1 -- 172.21.15.81:0/3626238389 learned_addr learned my addr 172.21.15.81:0/3626238389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8d7400700 1 -- 172.21.15.81:0/3626238389 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791387290 0 0) 0x7fb8d80b2ad0 con 0x7fb8d806aaa0 2024-09-13T18:53:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8d7e00700 1 -- 172.21.15.81:0/3626238389 >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 msgr2=0x7fb8d80cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8d7e00700 1 --2- 172.21.15.81:0/3626238389 >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 0x7fb8d80cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8d7e00700 1 -- 172.21.15.81:0/3626238389 >> v1:172.21.15.178:6789/0 conn(0x7fb8d806aaa0 legacy=0x7fb8d80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8d7e00700 1 -- 172.21.15.81:0/3626238389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d815bf20 con 0x7fb8d815c2a0 2024-09-13T18:53:37.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.094+0000 7fb8dd000700 1 --2- 172.21.15.81:0/3626238389 >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 0x7fb8d80cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:37.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8d7e00700 1 --2- 172.21.15.81:0/3626238389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d815b0e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009850 tx=0x7fb8c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f167e2e2f1258860 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8d7400700 1 -- 172.21.15.81:0/3626238389 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011830 con 0x7fb8d815c2a0 2024-09-13T18:53:37.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8d7400700 1 -- 172.21.15.81:0/3626238389 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4011990 con 0x7fb8d815c2a0 2024-09-13T18:53:37.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8d7400700 1 -- 172.21.15.81:0/3626238389 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011d40 con 0x7fb8d815c2a0 2024-09-13T18:53:37.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 -- 172.21.15.81:0/3626238389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 msgr2=0x7fb8d815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 --2- 172.21.15.81:0/3626238389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d815b0e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009850 tx=0x7fb8c4009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:37.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 -- 172.21.15.81:0/3626238389 shutdown_connections 2024-09-13T18:53:37.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 --2- 172.21.15.81:0/3626238389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d815b0e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 --2- 172.21.15.81:0/3626238389 >> v2:172.21.15.81:3300/0 conn(0x7fb8d80cb020 0x7fb8d80cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 -- 172.21.15.81:0/3626238389 >> 172.21.15.81:0/3626238389 conn(0x7fb8d80b0c40 msgr2=0x7fb8d806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:37.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 -- 172.21.15.81:0/3626238389 shutdown_connections 2024-09-13T18:53:37.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.098+0000 7fb8de400700 1 -- 172.21.15.81:0/3626238389 wait complete. 2024-09-13T18:53:37.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 Processor -- start 2024-09-13T18:53:37.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 -- start start 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8d806aaa0 0x7fb8d81f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 0x7fb8d81ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d806cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81f3540 con 0x7fb8d80cb020 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8155b10 con 0x7fb8d806aaa0 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8de400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d8155df0 con 0x7fb8d815c2a0 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 0x7fb8d81ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 0x7fb8d81ef960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46448/0 (socket says 172.21.15.81:46448) 2024-09-13T18:53:37.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 -- 172.21.15.81:0/4267277601 learned_addr learned my addr 172.21.15.81:0/4267277601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:37.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8dda00700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d806cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8dd000700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8d806aaa0 0x7fb8d81f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 -- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 msgr2=0x7fb8d806cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d806cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 -- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8d806aaa0 msgr2=0x7fb8d81f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8d806aaa0 0x7fb8d81f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8d7e00700 1 -- 172.21.15.81:0/4267277601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009570 con 0x7fb8d80cb020 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.102+0000 7fb8dda00700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8d7e00700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 0x7fb8d81ef960 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000c00 tx=0x7fb8c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4019ab0 con 0x7fb8d80cb020 2024-09-13T18:53:37.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c401e070 con 0x7fb8d80cb020 2024-09-13T18:53:37.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40094b0 con 0x7fb8d80cb020 2024-09-13T18:53:37.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4019e50 con 0x7fb8d80cb020 2024-09-13T18:53:37.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d81563b0 con 0x7fb8d80cb020 2024-09-13T18:53:37.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d80ce4b0 con 0x7fb8d80cb020 2024-09-13T18:53:37.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.106+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8c402d450 con 0x7fb8d80cb020 2024-09-13T18:53:37.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.110+0000 7fb8d4c00700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8b8066760 0x7fb8b8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.110+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb8c4085340 con 0x7fb8d80cb020 2024-09-13T18:53:37.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.110+0000 7fb8dd000700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8b8066760 0x7fb8b8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.110+0000 7fb8dd000700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8b8066760 0x7fb8b8068c20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009d10 tx=0x7fb8cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.114+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8c4052560 con 0x7fb8d80cb020 2024-09-13T18:53:37.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.302+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8d80ce1d0 con 0x7fb8d80cb020 2024-09-13T18:53:37.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.306+0000 7fb8d4c00700 1 -- 172.21.15.81:0/4267277601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16717 (secure 0 0 0) 0x7fb8c4055b80 con 0x7fb8d80cb020 2024-09-13T18:53:37.317 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:37.317 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:53:34.407611+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8b8066760 msgr2=0x7fb8b8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8b8066760 0x7fb8b8068c20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009d10 tx=0x7fb8cc008040 comp rx=0 tx=0).stop 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 msgr2=0x7fb8d81ef960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 0x7fb8d81ef960 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4000c00 tx=0x7fb8c4004770 comp rx=0 tx=0).stop 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 shutdown_connections 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8b8066760 0x7fb8b8068c20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8d815c2a0 0x7fb8d806cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8d80cb020 0x7fb8d81ef960 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 --2- 172.21.15.81:0/4267277601 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8d806aaa0 0x7fb8d81f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 >> 172.21.15.81:0/4267277601 conn(0x7fb8d80b0c40 msgr2=0x7fb8d8071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 shutdown_connections 2024-09-13T18:53:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.310+0000 7fb8de400700 1 -- 172.21.15.81:0/4267277601 wait complete. 2024-09-13T18:53:37.344 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:53:37.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:53:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.502+0000 7f9983e00700 1 Processor -- start 2024-09-13T18:53:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.502+0000 7f9983e00700 1 -- start start 2024-09-13T18:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.502+0000 7f9983e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f998406aaa0 0x7f998406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.502+0000 7f9983e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99840b2670 0x7f99840b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.502+0000 7f9983e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99840b3560 con 0x7f99841610b0 2024-09-13T18:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.502+0000 7f9983e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9984070b30 con 0x7f998406aaa0 2024-09-13T18:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998406b450 con 0x7f99840b2670 2024-09-13T18:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f998406aaa0 0x7f998406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f998406aaa0 0x7f998406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46464/0 (socket says 172.21.15.81:46464) 2024-09-13T18:53:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 -- 172.21.15.81:0/1677585748 learned_addr learned my addr 172.21.15.81:0/1677585748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983400700 1 --2- 172.21.15.81:0/1677585748 >> v2:172.21.15.178:3300/0 conn(0x7f99840b2670 0x7f99840b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 -- 172.21.15.81:0/1677585748 >> v2:172.21.15.178:3300/0 conn(0x7f99840b2670 msgr2=0x7f99840b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 --2- 172.21.15.81:0/1677585748 >> v2:172.21.15.178:3300/0 conn(0x7f99840b2670 0x7f99840b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 -- 172.21.15.81:0/1677585748 >> v1:172.21.15.178:6789/0 conn(0x7f99841610b0 legacy=0x7f99840719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 -- 172.21.15.81:0/1677585748 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840b3000 con 0x7f998406aaa0 2024-09-13T18:53:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f997a000700 1 --2- 172.21.15.81:0/1677585748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f998406aaa0 0x7f998406af10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f996c009940 tx=0x7f996c009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db314669935af6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9982000700 1 -- 172.21.15.81:0/1677585748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00b9e0 con 0x7f998406aaa0 2024-09-13T18:53:37.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9982000700 1 -- 172.21.15.81:0/1677585748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c009e90 con 0x7f998406aaa0 2024-09-13T18:53:37.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9982000700 1 -- 172.21.15.81:0/1677585748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00bd60 con 0x7f998406aaa0 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 -- 172.21.15.81:0/1677585748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f998406aaa0 msgr2=0x7f998406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 --2- 172.21.15.81:0/1677585748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f998406aaa0 0x7f998406af10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f996c009940 tx=0x7f996c009c50 comp rx=0 tx=0).stop 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 -- 172.21.15.81:0/1677585748 shutdown_connections 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 --2- 172.21.15.81:0/1677585748 >> v2:172.21.15.178:3300/0 conn(0x7f99840b2670 0x7f99840b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 --2- 172.21.15.81:0/1677585748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f998406aaa0 0x7f998406af10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 -- 172.21.15.81:0/1677585748 >> 172.21.15.81:0/1677585748 conn(0x7f99840b0c40 msgr2=0x7f998406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 -- 172.21.15.81:0/1677585748 shutdown_connections 2024-09-13T18:53:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.506+0000 7f9983e00700 1 -- 172.21.15.81:0/1677585748 wait complete. 2024-09-13T18:53:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.510+0000 7f9983e00700 1 Processor -- start 2024-09-13T18:53:37.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.510+0000 7f9983e00700 1 -- start start 2024-09-13T18:53:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998406aaa0 0x7f998414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99840b2670 0x7f9984157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 0x7f9984157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998414be50 con 0x7f99841610b0 2024-09-13T18:53:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9984162460 con 0x7f998406aaa0 2024-09-13T18:53:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9984162740 con 0x7f99840b2670 2024-09-13T18:53:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 0x7f9984157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 0x7f9984157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46470/0 (socket says 172.21.15.81:46470) 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 -- 172.21.15.81:0/2873544793 learned_addr learned my addr 172.21.15.81:0/2873544793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9982a00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998406aaa0 0x7f998414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f997a000700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99840b2670 0x7f9984157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 -- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99840b2670 msgr2=0x7f9984157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99840b2670 0x7f9984157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 -- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998406aaa0 msgr2=0x7f998414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998406aaa0 0x7f998414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 -- 172.21.15.81:0/2873544793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009570 con 0x7f99841610b0 2024-09-13T18:53:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983400700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 0x7f9984157b50 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f997c00e810 tx=0x7f997c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c00c070 con 0x7f99841610b0 2024-09-13T18:53:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c013650 con 0x7f99841610b0 2024-09-13T18:53:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9984162a20 con 0x7f99841610b0 2024-09-13T18:53:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c013a00 con 0x7f99841610b0 2024-09-13T18:53:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.514+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9984162fe0 con 0x7f99841610b0 2024-09-13T18:53:37.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.518+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984161490 con 0x7f99841610b0 2024-09-13T18:53:37.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.518+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f997c013b60 con 0x7f99841610b0 2024-09-13T18:53:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.522+0000 7f997b400700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9960066730 0x7f9960068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.522+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f997c083cb0 con 0x7f99841610b0 2024-09-13T18:53:37.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.522+0000 7f9982a00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9960066730 0x7f9960068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.522+0000 7f9982a00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9960066730 0x7f9960068bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f997400f290 tx=0x7f9974009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.526+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f997c050ed0 con 0x7f99841610b0 2024-09-13T18:53:37.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.710+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99840711c0 con 0x7f9960066730 2024-09-13T18:53:37.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.726+0000 7f997b400700 1 -- 172.21.15.81:0/2873544793 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283867 (secure 0 0 0) 0x7f997400fc50 con 0x7f9960066730 2024-09-13T18:53:37.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9960066730 msgr2=0x7f9960068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9960066730 0x7f9960068bf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f997400f290 tx=0x7f9974009040 comp rx=0 tx=0).stop 2024-09-13T18:53:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 msgr2=0x7f9984157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 0x7f9984157b50 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f997c00e810 tx=0x7f997c00eb20 comp rx=0 tx=0).stop 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 shutdown_connections 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9960066730 0x7f9960068bf0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99841610b0 0x7f9984157b50 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99840b2670 0x7f9984157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 --2- 172.21.15.81:0/2873544793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f998406aaa0 0x7f998414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 >> 172.21.15.81:0/2873544793 conn(0x7f99840b0c40 msgr2=0x7f99840af170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 shutdown_connections 2024-09-13T18:53:37.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.734+0000 7f9983e00700 1 -- 172.21.15.81:0/2873544793 wait complete. 2024-09-13T18:53:37.746 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:53:37.764 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-13T18:53:37.098022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258792,"kb_used_data":9856,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754715928,"statfs":{"total":773094113280,"available":772829110272,"internally_reserved":0,"allocated":10092544,"data_stored":5257686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.164049"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963924+0000","last_change":"2024-09-13T18:53:32.963924+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963924+0000","last_undegraded":"2024-09-13T18:53:32.963924+0000","last_fullsized":"2024-09-13T18:53:32.963924+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:37.538954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962396+0000","last_change":"2024-09-13T18:53:32.962396+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962396+0000","last_undegraded":"2024-09-13T18:53:32.962396+0000","last_fullsized":"2024-09-13T18:53:32.962396+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.964538+0000","last_change":"2024-09-13T18:53:32.964538+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.964538+0000","last_undegraded":"2024-09-13T18:53:32.964538+0000","last_fullsized":"2024-09-13T18:53:32.964538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:43.160897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965579+0000","last_change":"2024-09-13T18:53:32.965579+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965579+0000","last_undegraded":"2024-09-13T18:53:32.965579+0000","last_fullsized":"2024-09-13T18:53:32.965579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965421+0000","last_change":"2024-09-13T18:53:32.965421+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965421+0000","last_undegraded":"2024-09-13T18:53:32.965421+0000","last_fullsized":"2024-09-13T18:53:32.965421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963942+0000","last_change":"2024-09-13T18:53:32.963942+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963942+0000","last_undegraded":"2024-09-13T18:53:32.963942+0000","last_fullsized":"2024-09-13T18:53:32.963942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:53.286165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960216+0000","last_change":"2024-09-13T18:53:32.960216+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960216+0000","last_undegraded":"2024-09-13T18:53:32.960216+0000","last_fullsized":"2024-09-13T18:53:32.960216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963013+0000","last_change":"2024-09-13T18:53:32.963013+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963013+0000","last_undegraded":"2024-09-13T18:53:32.963013+0000","last_fullsized":"2024-09-13T18:53:32.963013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962334+0000","last_change":"2024-09-13T18:53:32.962334+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962334+0000","last_undegraded":"2024-09-13T18:53:32.962334+0000","last_fullsized":"2024-09-13T18:53:32.962334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959061+0000","last_change":"2024-09-13T18:53:32.959061+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959061+0000","last_undegraded":"2024-09-13T18:53:32.959061+0000","last_fullsized":"2024-09-13T18:53:32.959061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.346936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.968233+0000","last_change":"2024-09-13T18:53:32.968233+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.968233+0000","last_undegraded":"2024-09-13T18:53:32.968233+0000","last_fullsized":"2024-09-13T18:53:32.968233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959574+0000","last_change":"2024-09-13T18:53:32.959574+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959574+0000","last_undegraded":"2024-09-13T18:53:32.959574+0000","last_fullsized":"2024-09-13T18:53:32.959574+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958589+0000","last_change":"2024-09-13T18:53:32.958589+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958589+0000","last_undegraded":"2024-09-13T18:53:32.958589+0000","last_fullsized":"2024-09-13T18:53:32.958589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967599+0000","last_change":"2024-09-13T18:53:32.967599+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967599+0000","last_undegraded":"2024-09-13T18:53:32.967599+0000","last_fullsized":"2024-09-13T18:53:32.967599+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958324+0000","last_change":"2024-09-13T18:53:32.958324+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958324+0000","last_undegraded":"2024-09-13T18:53:32.958324+0000","last_fullsized":"2024-09-13T18:53:32.958324+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960023+0000","last_change":"2024-09-13T18:53:32.960023+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960023+0000","last_undegraded":"2024-09-13T18:53:32.960023+0000","last_fullsized":"2024-09-13T18:53:32.960023+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:39.591604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962631+0000","last_change":"2024-09-13T18:53:32.962631+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962631+0000","last_undegraded":"2024-09-13T18:53:32.962631+0000","last_fullsized":"2024-09-13T18:53:32.962631+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.445067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.966390+0000","last_change":"2024-09-13T18:53:32.966390+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.966390+0000","last_undegraded":"2024-09-13T18:53:32.966390+0000","last_fullsized":"2024-09-13T18:53:32.966390+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:11.980134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965178+0000","last_change":"2024-09-13T18:53:32.965178+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965178+0000","last_undegraded":"2024-09-13T18:53:32.965178+0000","last_fullsized":"2024-09-13T18:53:32.965178+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960846+0000","last_change":"2024-09-13T18:53:32.960846+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960846+0000","last_undegraded":"2024-09-13T18:53:32.960846+0000","last_fullsized":"2024-09-13T18:53:32.960846+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965964+0000","last_change":"2024-09-13T18:53:32.965964+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965964+0000","last_undegraded":"2024-09-13T18:53:32.965964+0000","last_fullsized":"2024-09-13T18:53:32.965964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967143+0000","last_change":"2024-09-13T18:53:32.967143+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967143+0000","last_undegraded":"2024-09-13T18:53:32.967143+0000","last_fullsized":"2024-09-13T18:53:32.967143+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957095+0000","last_change":"2024-09-13T18:53:32.957095+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957095+0000","last_undegraded":"2024-09-13T18:53:32.957095+0000","last_fullsized":"2024-09-13T18:53:32.957095+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962964+0000","last_change":"2024-09-13T18:53:32.962964+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962964+0000","last_undegraded":"2024-09-13T18:53:32.962964+0000","last_fullsized":"2024-09-13T18:53:32.962964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:30.589532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962046+0000","last_change":"2024-09-13T18:53:32.962046+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962046+0000","last_undegraded":"2024-09-13T18:53:32.962046+0000","last_fullsized":"2024-09-13T18:53:32.962046+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.969322+0000","last_change":"2024-09-13T18:53:32.969322+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.969322+0000","last_undegraded":"2024-09-13T18:53:32.969322+0000","last_fullsized":"2024-09-13T18:53:32.969322+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959093+0000","last_change":"2024-09-13T18:53:32.959093+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959093+0000","last_undegraded":"2024-09-13T18:53:32.959093+0000","last_fullsized":"2024-09-13T18:53:32.959093+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:34.977610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959992+0000","last_change":"2024-09-13T18:53:32.959992+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959992+0000","last_undegraded":"2024-09-13T18:53:32.959992+0000","last_fullsized":"2024-09-13T18:53:32.959992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961472+0000","last_change":"2024-09-13T18:53:32.961472+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961472+0000","last_undegraded":"2024-09-13T18:53:32.961472+0000","last_fullsized":"2024-09-13T18:53:32.961472+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.966709+0000","last_change":"2024-09-13T18:53:32.966709+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.966709+0000","last_undegraded":"2024-09-13T18:53:32.966709+0000","last_fullsized":"2024-09-13T18:53:32.966709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963679+0000","last_change":"2024-09-13T18:53:32.963679+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963679+0000","last_undegraded":"2024-09-13T18:53:32.963679+0000","last_fullsized":"2024-09-13T18:53:32.963679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959635+0000","last_change":"2024-09-13T18:53:32.959635+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959635+0000","last_undegraded":"2024-09-13T18:53:32.959635+0000","last_fullsized":"2024-09-13T18:53:32.959635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:51.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961057+0000","last_change":"2024-09-13T18:53:32.961057+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961057+0000","last_undegraded":"2024-09-13T18:53:32.961057+0000","last_fullsized":"2024-09-13T18:53:32.961057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:25.336257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976843+0000","last_change":"2024-09-13T18:53:32.974455+0000","last_active":"2024-09-13T18:53:32.976843+0000","last_peered":"2024-09-13T18:53:32.976843+0000","last_clean":"2024-09-13T18:53:32.976843+0000","last_became_active":"2024-09-13T18:53:32.974185+0000","last_became_peered":"2024-09-13T18:53:32.974185+0000","last_unstale":"2024-09-13T18:53:32.976843+0000","last_undegraded":"2024-09-13T18:53:32.976843+0000","last_fullsized":"2024-09-13T18:53:32.976843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:13.889692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956672+0000","last_change":"2024-09-13T18:53:32.956672+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956672+0000","last_undegraded":"2024-09-13T18:53:32.956672+0000","last_fullsized":"2024-09-13T18:53:32.956672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:59.976141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976558+0000","last_change":"2024-09-13T18:53:32.974168+0000","last_active":"2024-09-13T18:53:32.976558+0000","last_peered":"2024-09-13T18:53:32.976558+0000","last_clean":"2024-09-13T18:53:32.976558+0000","last_became_active":"2024-09-13T18:53:32.973823+0000","last_became_peered":"2024-09-13T18:53:32.973823+0000","last_unstale":"2024-09-13T18:53:32.976558+0000","last_undegraded":"2024-09-13T18:53:32.976558+0000","last_fullsized":"2024-09-13T18:53:32.976558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:53.038961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960698+0000","last_change":"2024-09-13T18:53:32.960698+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960698+0000","last_undegraded":"2024-09-13T18:53:32.960698+0000","last_fullsized":"2024-09-13T18:53:32.960698+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.983091+0000","last_change":"2024-09-13T18:53:32.982524+0000","last_active":"2024-09-13T18:53:32.983091+0000","last_peered":"2024-09-13T18:53:32.983091+0000","last_clean":"2024-09-13T18:53:32.983091+0000","last_became_active":"2024-09-13T18:53:32.982071+0000","last_became_peered":"2024-09-13T18:53:32.982071+0000","last_unstale":"2024-09-13T18:53:32.983091+0000","last_undegraded":"2024-09-13T18:53:32.983091+0000","last_fullsized":"2024-09-13T18:53:32.983091+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955886+0000","last_change":"2024-09-13T18:53:32.955886+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955886+0000","last_undegraded":"2024-09-13T18:53:32.955886+0000","last_fullsized":"2024-09-13T18:53:32.955886+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:27.303458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973282+0000","last_change":"2024-09-13T18:53:32.969226+0000","last_active":"2024-09-13T18:53:32.973282+0000","last_peered":"2024-09-13T18:53:32.973282+0000","last_clean":"2024-09-13T18:53:32.973282+0000","last_became_active":"2024-09-13T18:53:32.968542+0000","last_became_peered":"2024-09-13T18:53:32.968542+0000","last_unstale":"2024-09-13T18:53:32.973282+0000","last_undegraded":"2024-09-13T18:53:32.973282+0000","last_fullsized":"2024-09-13T18:53:32.973282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957253+0000","last_change":"2024-09-13T18:53:32.957253+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957253+0000","last_undegraded":"2024-09-13T18:53:32.957253+0000","last_fullsized":"2024-09-13T18:53:32.957253+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981074+0000","last_change":"2024-09-13T18:53:32.979540+0000","last_active":"2024-09-13T18:53:32.981074+0000","last_peered":"2024-09-13T18:53:32.981074+0000","last_clean":"2024-09-13T18:53:32.981074+0000","last_became_active":"2024-09-13T18:53:32.979212+0000","last_became_peered":"2024-09-13T18:53:32.979212+0000","last_unstale":"2024-09-13T18:53:32.981074+0000","last_undegraded":"2024-09-13T18:53:32.981074+0000","last_fullsized":"2024-09-13T18:53:32.981074+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:53.373570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955916+0000","last_change":"2024-09-13T18:53:32.955916+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955916+0000","last_undegraded":"2024-09-13T18:53:32.955916+0000","last_fullsized":"2024-09-13T18:53:32.955916+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981520+0000","last_change":"2024-09-13T18:53:32.975163+0000","last_active":"2024-09-13T18:53:32.981520+0000","last_peered":"2024-09-13T18:53:32.981520+0000","last_clean":"2024-09-13T18:53:32.981520+0000","last_became_active":"2024-09-13T18:53:32.974855+0000","last_became_peered":"2024-09-13T18:53:32.974855+0000","last_unstale":"2024-09-13T18:53:32.981520+0000","last_undegraded":"2024-09-13T18:53:32.981520+0000","last_fullsized":"2024-09-13T18:53:32.981520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962140+0000","last_change":"2024-09-13T18:53:32.962140+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962140+0000","last_undegraded":"2024-09-13T18:53:32.962140+0000","last_fullsized":"2024-09-13T18:53:32.962140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:05.116179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978912+0000","last_change":"2024-09-13T18:53:32.974717+0000","last_active":"2024-09-13T18:53:32.978912+0000","last_peered":"2024-09-13T18:53:32.978912+0000","last_clean":"2024-09-13T18:53:32.978912+0000","last_became_active":"2024-09-13T18:53:32.974438+0000","last_became_peered":"2024-09-13T18:53:32.974438+0000","last_unstale":"2024-09-13T18:53:32.978912+0000","last_undegraded":"2024-09-13T18:53:32.978912+0000","last_fullsized":"2024-09-13T18:53:32.978912+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:58.112314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958144+0000","last_change":"2024-09-13T18:53:32.958144+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958144+0000","last_undegraded":"2024-09-13T18:53:32.958144+0000","last_fullsized":"2024-09-13T18:53:32.958144+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:30.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980683+0000","last_change":"2024-09-13T18:53:32.977072+0000","last_active":"2024-09-13T18:53:32.980683+0000","last_peered":"2024-09-13T18:53:32.980683+0000","last_clean":"2024-09-13T18:53:32.980683+0000","last_became_active":"2024-09-13T18:53:32.974368+0000","last_became_peered":"2024-09-13T18:53:32.974368+0000","last_unstale":"2024-09-13T18:53:32.980683+0000","last_undegraded":"2024-09-13T18:53:32.980683+0000","last_fullsized":"2024-09-13T18:53:32.980683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967583+0000","last_change":"2024-09-13T18:53:32.967583+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967583+0000","last_undegraded":"2024-09-13T18:53:32.967583+0000","last_fullsized":"2024-09-13T18:53:32.967583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978504+0000","last_change":"2024-09-13T18:53:32.971936+0000","last_active":"2024-09-13T18:53:32.978504+0000","last_peered":"2024-09-13T18:53:32.978504+0000","last_clean":"2024-09-13T18:53:32.978504+0000","last_became_active":"2024-09-13T18:53:32.971646+0000","last_became_peered":"2024-09-13T18:53:32.971646+0000","last_unstale":"2024-09-13T18:53:32.978504+0000","last_undegraded":"2024-09-13T18:53:32.978504+0000","last_fullsized":"2024-09-13T18:53:32.978504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961391+0000","last_change":"2024-09-13T18:53:32.961391+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961391+0000","last_undegraded":"2024-09-13T18:53:32.961391+0000","last_fullsized":"2024-09-13T18:53:32.961391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978108+0000","last_change":"2024-09-13T18:53:32.975559+0000","last_active":"2024-09-13T18:53:32.978108+0000","last_peered":"2024-09-13T18:53:32.978108+0000","last_clean":"2024-09-13T18:53:32.978108+0000","last_became_active":"2024-09-13T18:53:32.975226+0000","last_became_peered":"2024-09-13T18:53:32.975226+0000","last_unstale":"2024-09-13T18:53:32.978108+0000","last_undegraded":"2024-09-13T18:53:32.978108+0000","last_fullsized":"2024-09-13T18:53:32.978108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.754508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965971+0000","last_change":"2024-09-13T18:53:32.965971+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965971+0000","last_undegraded":"2024-09-13T18:53:32.965971+0000","last_fullsized":"2024-09-13T18:53:32.965971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:46.856863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981028+0000","last_change":"2024-09-13T18:53:32.979461+0000","last_active":"2024-09-13T18:53:32.981028+0000","last_peered":"2024-09-13T18:53:32.981028+0000","last_clean":"2024-09-13T18:53:32.981028+0000","last_became_active":"2024-09-13T18:53:32.978929+0000","last_became_peered":"2024-09-13T18:53:32.978929+0000","last_unstale":"2024-09-13T18:53:32.981028+0000","last_undegraded":"2024-09-13T18:53:32.981028+0000","last_fullsized":"2024-09-13T18:53:32.981028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:54.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957615+0000","last_change":"2024-09-13T18:53:32.957615+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957615+0000","last_undegraded":"2024-09-13T18:53:32.957615+0000","last_fullsized":"2024-09-13T18:53:32.957615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.968130+0000","last_change":"2024-09-13T18:53:32.962678+0000","last_active":"2024-09-13T18:53:32.968130+0000","last_peered":"2024-09-13T18:53:32.968130+0000","last_clean":"2024-09-13T18:53:32.968130+0000","last_became_active":"2024-09-13T18:53:32.962353+0000","last_became_peered":"2024-09-13T18:53:32.962353+0000","last_unstale":"2024-09-13T18:53:32.968130+0000","last_undegraded":"2024-09-13T18:53:32.968130+0000","last_fullsized":"2024-09-13T18:53:32.968130+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:21.019937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956705+0000","last_change":"2024-09-13T18:53:32.956705+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956705+0000","last_undegraded":"2024-09-13T18:53:32.956705+0000","last_fullsized":"2024-09-13T18:53:32.956705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980625+0000","last_change":"2024-09-13T18:53:32.977043+0000","last_active":"2024-09-13T18:53:32.980625+0000","last_peered":"2024-09-13T18:53:32.980625+0000","last_clean":"2024-09-13T18:53:32.980625+0000","last_became_active":"2024-09-13T18:53:32.974269+0000","last_became_peered":"2024-09-13T18:53:32.974269+0000","last_unstale":"2024-09-13T18:53:32.980625+0000","last_undegraded":"2024-09-13T18:53:32.980625+0000","last_fullsized":"2024-09-13T18:53:32.980625+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965539+0000","last_change":"2024-09-13T18:53:32.965539+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965539+0000","last_undegraded":"2024-09-13T18:53:32.965539+0000","last_fullsized":"2024-09-13T18:53:32.965539+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973418+0000","last_change":"2024-09-13T18:53:32.968390+0000","last_active":"2024-09-13T18:53:32.973418+0000","last_peered":"2024-09-13T18:53:32.973418+0000","last_clean":"2024-09-13T18:53:32.973418+0000","last_became_active":"2024-09-13T18:53:32.968173+0000","last_became_peered":"2024-09-13T18:53:32.968173+0000","last_unstale":"2024-09-13T18:53:32.973418+0000","last_undegraded":"2024-09-13T18:53:32.973418+0000","last_fullsized":"2024-09-13T18:53:32.973418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:16.066340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957979+0000","last_change":"2024-09-13T18:53:32.957979+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957979+0000","last_undegraded":"2024-09-13T18:53:32.957979+0000","last_fullsized":"2024-09-13T18:53:32.957979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:00.853298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.982247+0000","last_change":"2024-09-13T18:53:32.978943+0000","last_active":"2024-09-13T18:53:32.982247+0000","last_peered":"2024-09-13T18:53:32.982247+0000","last_clean":"2024-09-13T18:53:32.982247+0000","last_became_active":"2024-09-13T18:53:32.978004+0000","last_became_peered":"2024-09-13T18:53:32.978004+0000","last_unstale":"2024-09-13T18:53:32.982247+0000","last_undegraded":"2024-09-13T18:53:32.982247+0000","last_fullsized":"2024-09-13T18:53:32.982247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959358+0000","last_change":"2024-09-13T18:53:32.959358+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959358+0000","last_undegraded":"2024-09-13T18:53:32.959358+0000","last_fullsized":"2024-09-13T18:53:32.959358+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:35.073791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.979214+0000","last_change":"2024-09-13T18:53:32.972297+0000","last_active":"2024-09-13T18:53:32.979214+0000","last_peered":"2024-09-13T18:53:32.979214+0000","last_clean":"2024-09-13T18:53:32.979214+0000","last_became_active":"2024-09-13T18:53:32.972040+0000","last_became_peered":"2024-09-13T18:53:32.972040+0000","last_unstale":"2024-09-13T18:53:32.979214+0000","last_undegraded":"2024-09-13T18:53:32.979214+0000","last_fullsized":"2024-09-13T18:53:32.979214+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955754+0000","last_change":"2024-09-13T18:53:32.955754+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955754+0000","last_undegraded":"2024-09-13T18:53:32.955754+0000","last_fullsized":"2024-09-13T18:53:32.955754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:00.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.972772+0000","last_change":"2024-09-13T18:53:32.966972+0000","last_active":"2024-09-13T18:53:32.972772+0000","last_peered":"2024-09-13T18:53:32.972772+0000","last_clean":"2024-09-13T18:53:32.972772+0000","last_became_active":"2024-09-13T18:53:32.966526+0000","last_became_peered":"2024-09-13T18:53:32.966526+0000","last_unstale":"2024-09-13T18:53:32.972772+0000","last_undegraded":"2024-09-13T18:53:32.972772+0000","last_fullsized":"2024-09-13T18:53:32.972772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:58.976298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956061+0000","last_change":"2024-09-13T18:53:32.956061+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956061+0000","last_undegraded":"2024-09-13T18:53:32.956061+0000","last_fullsized":"2024-09-13T18:53:32.956061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980687+0000","last_change":"2024-09-13T18:53:32.976908+0000","last_active":"2024-09-13T18:53:32.980687+0000","last_peered":"2024-09-13T18:53:32.980687+0000","last_clean":"2024-09-13T18:53:32.980687+0000","last_became_active":"2024-09-13T18:53:32.976653+0000","last_became_peered":"2024-09-13T18:53:32.976653+0000","last_unstale":"2024-09-13T18:53:32.980687+0000","last_undegraded":"2024-09-13T18:53:32.980687+0000","last_fullsized":"2024-09-13T18:53:32.980687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.968175+0000","last_change":"2024-09-13T18:53:32.968175+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.968175+0000","last_undegraded":"2024-09-13T18:53:32.968175+0000","last_fullsized":"2024-09-13T18:53:32.968175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980273+0000","last_change":"2024-09-13T18:53:32.976609+0000","last_active":"2024-09-13T18:53:32.980273+0000","last_peered":"2024-09-13T18:53:32.980273+0000","last_clean":"2024-09-13T18:53:32.980273+0000","last_became_active":"2024-09-13T18:53:32.976333+0000","last_became_peered":"2024-09-13T18:53:32.976333+0000","last_unstale":"2024-09-13T18:53:32.980273+0000","last_undegraded":"2024-09-13T18:53:32.980273+0000","last_fullsized":"2024-09-13T18:53:32.980273+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:53.755995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955379+0000","last_change":"2024-09-13T18:53:32.955379+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955379+0000","last_undegraded":"2024-09-13T18:53:32.955379+0000","last_fullsized":"2024-09-13T18:53:32.955379+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:18.970121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980839+0000","last_change":"2024-09-13T18:53:32.976670+0000","last_active":"2024-09-13T18:53:32.980839+0000","last_peered":"2024-09-13T18:53:32.980839+0000","last_clean":"2024-09-13T18:53:32.980839+0000","last_became_active":"2024-09-13T18:53:32.976354+0000","last_became_peered":"2024-09-13T18:53:32.976354+0000","last_unstale":"2024-09-13T18:53:32.980839+0000","last_undegraded":"2024-09-13T18:53:32.980839+0000","last_fullsized":"2024-09-13T18:53:32.980839+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962938+0000","last_change":"2024-09-13T18:53:32.962938+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962938+0000","last_undegraded":"2024-09-13T18:53:32.962938+0000","last_fullsized":"2024-09-13T18:53:32.962938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.971731+0000","last_change":"2024-09-13T18:53:32.966984+0000","last_active":"2024-09-13T18:53:32.971731+0000","last_peered":"2024-09-13T18:53:32.971731+0000","last_clean":"2024-09-13T18:53:32.971731+0000","last_became_active":"2024-09-13T18:53:32.966665+0000","last_became_peered":"2024-09-13T18:53:32.966665+0000","last_unstale":"2024-09-13T18:53:32.971731+0000","last_undegraded":"2024-09-13T18:53:32.971731+0000","last_fullsized":"2024-09-13T18:53:32.971731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.908915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961094+0000","last_change":"2024-09-13T18:53:32.961094+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961094+0000","last_undegraded":"2024-09-13T18:53:32.961094+0000","last_fullsized":"2024-09-13T18:53:32.961094+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981412+0000","last_change":"2024-09-13T18:53:32.977136+0000","last_active":"2024-09-13T18:53:32.981412+0000","last_peered":"2024-09-13T18:53:32.981412+0000","last_clean":"2024-09-13T18:53:32.981412+0000","last_became_active":"2024-09-13T18:53:32.974769+0000","last_became_peered":"2024-09-13T18:53:32.974769+0000","last_unstale":"2024-09-13T18:53:32.981412+0000","last_undegraded":"2024-09-13T18:53:32.981412+0000","last_fullsized":"2024-09-13T18:53:32.981412+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960960+0000","last_change":"2024-09-13T18:53:32.960960+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960960+0000","last_undegraded":"2024-09-13T18:53:32.960960+0000","last_fullsized":"2024-09-13T18:53:32.960960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:59.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978684+0000","last_change":"2024-09-13T18:53:32.973495+0000","last_active":"2024-09-13T18:53:32.978684+0000","last_peered":"2024-09-13T18:53:32.978684+0000","last_clean":"2024-09-13T18:53:32.978684+0000","last_became_active":"2024-09-13T18:53:32.973173+0000","last_became_peered":"2024-09-13T18:53:32.973173+0000","last_unstale":"2024-09-13T18:53:32.978684+0000","last_undegraded":"2024-09-13T18:53:32.978684+0000","last_fullsized":"2024-09-13T18:53:32.978684+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:11.941564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956438+0000","last_change":"2024-09-13T18:53:32.956438+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956438+0000","last_undegraded":"2024-09-13T18:53:32.956438+0000","last_fullsized":"2024-09-13T18:53:32.956438+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976435+0000","last_change":"2024-09-13T18:53:32.975551+0000","last_active":"2024-09-13T18:53:32.976435+0000","last_peered":"2024-09-13T18:53:32.976435+0000","last_clean":"2024-09-13T18:53:32.976435+0000","last_became_active":"2024-09-13T18:53:32.973976+0000","last_became_peered":"2024-09-13T18:53:32.973976+0000","last_unstale":"2024-09-13T18:53:32.976435+0000","last_undegraded":"2024-09-13T18:53:32.976435+0000","last_fullsized":"2024-09-13T18:53:32.976435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955079+0000","last_change":"2024-09-13T18:53:32.955079+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955079+0000","last_undegraded":"2024-09-13T18:53:32.955079+0000","last_fullsized":"2024-09-13T18:53:32.955079+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:32.417668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980975+0000","last_change":"2024-09-13T18:53:32.978157+0000","last_active":"2024-09-13T18:53:32.980975+0000","last_peered":"2024-09-13T18:53:32.980975+0000","last_clean":"2024-09-13T18:53:32.980975+0000","last_became_active":"2024-09-13T18:53:32.977850+0000","last_became_peered":"2024-09-13T18:53:32.977850+0000","last_unstale":"2024-09-13T18:53:32.980975+0000","last_undegraded":"2024-09-13T18:53:32.980975+0000","last_fullsized":"2024-09-13T18:53:32.980975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:07.000712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955530+0000","last_change":"2024-09-13T18:53:32.955530+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955530+0000","last_undegraded":"2024-09-13T18:53:32.955530+0000","last_fullsized":"2024-09-13T18:53:32.955530+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980952+0000","last_change":"2024-09-13T18:53:32.977923+0000","last_active":"2024-09-13T18:53:32.980952+0000","last_peered":"2024-09-13T18:53:32.980952+0000","last_clean":"2024-09-13T18:53:32.980952+0000","last_became_active":"2024-09-13T18:53:32.977485+0000","last_became_peered":"2024-09-13T18:53:32.977485+0000","last_unstale":"2024-09-13T18:53:32.980952+0000","last_undegraded":"2024-09-13T18:53:32.980952+0000","last_fullsized":"2024-09-13T18:53:32.980952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.319921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961601+0000","last_change":"2024-09-13T18:53:32.961601+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961601+0000","last_undegraded":"2024-09-13T18:53:32.961601+0000","last_fullsized":"2024-09-13T18:53:32.961601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973160+0000","last_change":"2024-09-13T18:53:32.969065+0000","last_active":"2024-09-13T18:53:32.973160+0000","last_peered":"2024-09-13T18:53:32.973160+0000","last_clean":"2024-09-13T18:53:32.973160+0000","last_became_active":"2024-09-13T18:53:32.968189+0000","last_became_peered":"2024-09-13T18:53:32.968189+0000","last_unstale":"2024-09-13T18:53:32.973160+0000","last_undegraded":"2024-09-13T18:53:32.973160+0000","last_fullsized":"2024-09-13T18:53:32.973160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956903+0000","last_change":"2024-09-13T18:53:32.956903+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956903+0000","last_undegraded":"2024-09-13T18:53:32.956903+0000","last_fullsized":"2024-09-13T18:53:32.956903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:29.365964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.975858+0000","last_change":"2024-09-13T18:53:32.971783+0000","last_active":"2024-09-13T18:53:32.975858+0000","last_peered":"2024-09-13T18:53:32.975858+0000","last_clean":"2024-09-13T18:53:32.975858+0000","last_became_active":"2024-09-13T18:53:32.971544+0000","last_became_peered":"2024-09-13T18:53:32.971544+0000","last_unstale":"2024-09-13T18:53:32.975858+0000","last_undegraded":"2024-09-13T18:53:32.975858+0000","last_fullsized":"2024-09-13T18:53:32.975858+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:19.672579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965568+0000","last_change":"2024-09-13T18:53:32.965568+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965568+0000","last_undegraded":"2024-09-13T18:53:32.965568+0000","last_fullsized":"2024-09-13T18:53:32.965568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:25.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981420+0000","last_change":"2024-09-13T18:53:32.979624+0000","last_active":"2024-09-13T18:53:32.981420+0000","last_peered":"2024-09-13T18:53:32.981420+0000","last_clean":"2024-09-13T18:53:32.981420+0000","last_became_active":"2024-09-13T18:53:32.979380+0000","last_became_peered":"2024-09-13T18:53:32.979380+0000","last_unstale":"2024-09-13T18:53:32.981420+0000","last_undegraded":"2024-09-13T18:53:32.981420+0000","last_fullsized":"2024-09-13T18:53:32.981420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955789+0000","last_change":"2024-09-13T18:53:32.955789+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955789+0000","last_undegraded":"2024-09-13T18:53:32.955789+0000","last_fullsized":"2024-09-13T18:53:32.955789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.974169+0000","last_change":"2024-09-13T18:53:32.971426+0000","last_active":"2024-09-13T18:53:32.974169+0000","last_peered":"2024-09-13T18:53:32.974169+0000","last_clean":"2024-09-13T18:53:32.974169+0000","last_became_active":"2024-09-13T18:53:32.971188+0000","last_became_peered":"2024-09-13T18:53:32.971188+0000","last_unstale":"2024-09-13T18:53:32.974169+0000","last_undegraded":"2024-09-13T18:53:32.974169+0000","last_fullsized":"2024-09-13T18:53:32.974169+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:48.187135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956210+0000","last_change":"2024-09-13T18:53:32.956210+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956210+0000","last_undegraded":"2024-09-13T18:53:32.956210+0000","last_fullsized":"2024-09-13T18:53:32.956210+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:02.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980701+0000","last_change":"2024-09-13T18:53:32.977404+0000","last_active":"2024-09-13T18:53:32.980701+0000","last_peered":"2024-09-13T18:53:32.980701+0000","last_clean":"2024-09-13T18:53:32.980701+0000","last_became_active":"2024-09-13T18:53:32.977089+0000","last_became_peered":"2024-09-13T18:53:32.977089+0000","last_unstale":"2024-09-13T18:53:32.980701+0000","last_undegraded":"2024-09-13T18:53:32.980701+0000","last_fullsized":"2024-09-13T18:53:32.980701+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963992+0000","last_change":"2024-09-13T18:53:32.963992+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963992+0000","last_undegraded":"2024-09-13T18:53:32.963992+0000","last_fullsized":"2024-09-13T18:53:32.963992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.982205+0000","last_change":"2024-09-13T18:53:32.978373+0000","last_active":"2024-09-13T18:53:32.982205+0000","last_peered":"2024-09-13T18:53:32.982205+0000","last_clean":"2024-09-13T18:53:32.982205+0000","last_became_active":"2024-09-13T18:53:32.977238+0000","last_became_peered":"2024-09-13T18:53:32.977238+0000","last_unstale":"2024-09-13T18:53:32.982205+0000","last_undegraded":"2024-09-13T18:53:32.982205+0000","last_fullsized":"2024-09-13T18:53:32.982205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:39.620579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:53:31.947462+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:53:31.947462+0000","last_peered":"2024-09-13T18:53:31.947462+0000","last_clean":"2024-09-13T18:53:31.947462+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:53:31.947462+0000","last_undegraded":"2024-09-13T18:53:31.947462+0000","last_fullsized":"2024-09-13T18:53:31.947462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":1098338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.415,"5min":1.72,"15min":1.72},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.524,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1419999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.117,"15min":1.137},"min":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.589},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.208},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.252}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.79200000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.605,"5min":1.885,"15min":1.885},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.1890000000000001,"15min":1.206},"min":{"1min":0.97199999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.335}]},{"osd":3,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2649999999999999,"15min":1.2749999999999999},"min":{"1min":0.94799999999999995,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.5640000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.413},{"interface":"front","average":{"1min":1.391,"5min":1.327,"15min":1.427},"min":{"1min":0.96399999999999997,"5min":0.90900000000000003,"15min":0.81999999999999995},"max":{"1min":1.669,"5min":1.861,"15min":2.2610000000000001},"last":1.538}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.111},"min":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.226,"5min":1.22,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.66700000000000004,"15min":0.63700000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.3080000000000001},"min":{"1min":0.87,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.522,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.212,"5min":1.208,"15min":1.2230000000000001},"min":{"1min":0.79000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.375,"15min":1.399},"min":{"1min":1.0629999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.47},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.371,"15min":1.413},"min":{"1min":0.95399999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6279999999999999,"5min":1.845,"15min":1.845},"last":1.71}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1122304,"data_stored":514565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0860000000000001,"15min":1.1339999999999999},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.619,"5min":1.8169999999999999,"15min":3.0369999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.099,"15min":1.161},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5529999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.4890000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.155,"15min":1.1919999999999999},"min":{"1min":0.90200000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.4950000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.169,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":1.675,"15min":3.7480000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1859999999999999,"15min":1.4399999999999999},"min":{"1min":0.82699999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.4099999999999999,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.4790000000000001},"min":{"1min":0.97999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6339999999999999,"5min":1.7230000000000001,"15min":4.883},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2669999999999999,"15min":1.4910000000000001},"min":{"1min":0.89200000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":4.8630000000000004},"last":1.325}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.288},"min":{"1min":0.76600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.526,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5589999999999999,"5min":1.796,"15min":2.077},"last":1.375}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.395},"min":{"1min":0.81899999999999995,"5min":0.755,"15min":0.755},"max":{"1min":1.456,"5min":1.764,"15min":2.1699999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.389,"15min":1.4670000000000001},"min":{"1min":0.97299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5860000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.5}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.4510000000000001},"min":{"1min":1.0049999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.611},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.361,"15min":1.5049999999999999},"min":{"1min":1.0640000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.367},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1122304,"data_stored":514565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0569999999999999,"15min":1.177},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.125,"15min":1.155},"min":{"1min":0.90300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":2.278},"last":1.1599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.2549999999999999},"min":{"1min":0.79700000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.476,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.111},{"interface":"front","average":{"1min":1.097,"5min":1.119,"15min":1.1799999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.532,"5min":1.5649999999999999,"15min":2.1040000000000001},"last":1.512}]},{"osd":2,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1910000000000001,"15min":1.274},"min":{"1min":0.76700000000000002,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.619,"5min":1.7470000000000001,"15min":1.9059999999999999},"last":1.399},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.157},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.25,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.749},"max":{"1min":1.5660000000000001,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.4179999999999999},"min":{"1min":0.90600000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":2.9470000000000001},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1100000000000001,"15min":1.2030000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5109999999999999,"5min":1.579,"15min":1.8500000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2669999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4990000000000001,"5min":1.742,"15min":1.974},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2909999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.536,"5min":1.669,"15min":2.0219999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.694,"5min":1.694,"15min":2.1739999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":1.0580000000000001,"5min":0.87,"15min":0.81699999999999995},"max":{"1min":1.6499999999999999,"5min":1.7649999999999999,"15min":2.169},"last":1.323},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.5},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.641,"5min":1.804,"15min":2.8140000000000001},"last":1.5569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.002},{"interface":"front","average":{"1min":1.121,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.77200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.518,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2949999999999999,"15min":1.351},"min":{"1min":0.77000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6539999999999999,"5min":1.6739999999999999,"15min":2.6930000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.3169999999999999},"min":{"1min":0.73799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4970000000000001,"5min":1.806,"15min":2.423},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2190000000000001,"15min":1.28},"min":{"1min":0.94999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.99},"last":1.589},{"interface":"front","average":{"1min":1.266,"5min":1.3,"15min":1.371},"min":{"1min":0.82699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":2.335},"last":1.218}]},{"osd":3,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2010000000000001,"15min":1.2989999999999999},"min":{"1min":0.82199999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":2.621},"last":1.24},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1839999999999999,"15min":1.2569999999999999},"min":{"1min":0.91000000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.302,"5min":1.5669999999999999,"15min":1.8640000000000001},"last":1.4470000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.153,"15min":1.284},"min":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":2.274},"last":1.129},{"interface":"front","average":{"1min":1.196,"5min":1.2230000000000001,"15min":1.304},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.988,"5min":1.988,"15min":2.266},"last":1.4910000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2070000000000001,"15min":1.333},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5189999999999999,"5min":2.319,"15min":2.4710000000000001},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3480000000000001,"15min":1.444},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5720000000000001,"5min":1.851,"15min":2.5},"last":1.2969999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.351,"15min":1.446},"min":{"1min":0.72399999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.395},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.355,"15min":1.454},"min":{"1min":1.0429999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9059999999999999,"5min":2.415,"15min":2.415},"last":1.7490000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.88600000000000001},"min":{"1min":0.48799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0800000000000001,"5min":1.331,"15min":1.4510000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.879},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0589999999999999,"5min":1.444,"15min":1.444},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3500000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.069},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94899999999999995,"15min":1.0880000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.464,"15min":4.0149999999999997},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.004,"15min":1.002},"min":{"1min":0.71599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.319,"5min":1.611,"15min":1.611},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.161},"min":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.536,"5min":1.569,"15min":2.4729999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.179,"15min":1.2370000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1519999999999999,"15min":1.226},"min":{"1min":0.82299999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.8220000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2170000000000001,"15min":1.3049999999999999},"min":{"1min":0.94799999999999995,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.4850000000000001,"5min":1.855,"15min":2.0099999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2789999999999999,"15min":1.365},"min":{"1min":0.85099999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6000000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3089999999999999,"15min":1.413},"min":{"1min":0.875,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.49,"5min":1.9239999999999999,"15min":2.714},"last":1.339},{"interface":"front","average":{"1min":1.222,"5min":1.278,"15min":1.4039999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7270000000000001,"5min":1.8520000000000001,"15min":2.52},"last":1.119}]},{"osd":7,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3049999999999999,"15min":1.4890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7789999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.302,"15min":1.4199999999999999},"min":{"1min":1.0029999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5580000000000001,"5min":1.946,"15min":1.9810000000000001},"last":1.1040000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77500000000000002,"15min":0.95699999999999996},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1000000000000001,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80900000000000005,"15min":1.0209999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.54,"5min":1.54,"15min":4.6349999999999998},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.84399999999999997,"15min":1.1000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1990000000000001,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.762,"5min":1.762,"15min":4.7009999999999996},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.117,"15min":1.294},"min":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5329999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":1.04},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.202},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.339,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.878}]},{"osd":4,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.204,"15min":1.5980000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":8.6989999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.224,"15min":1.4219999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.383,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":0.998}]},{"osd":5,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2809999999999999,"15min":1.484},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6319999999999999,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.24,"15min":1.46},"min":{"1min":0.88600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5649999999999999,"5min":1.7370000000000001,"15min":4.335},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.5089999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.5569999999999999,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.2450000000000001,"15min":1.696},"min":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":1.6319999999999999,"15min":8.6300000000000008},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3200000000000001,"15min":1.5329999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.137},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.355,"15min":1.589},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":4.4050000000000002},"last":1.0880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.86799999999999999},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0309999999999999,"5min":1.385,"15min":2.2170000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":1.026},"min":{"1min":0.61699999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.036,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.169},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.46,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":1.0589999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5589999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1080000000000001,"15min":1.294},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4550000000000001,"5min":1.637,"15min":6.0919999999999996},"last":1.016},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0449999999999999,"15min":1.3779999999999999},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4970000000000001,"5min":1.768,"15min":10.368},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.3640000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6040000000000001,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2450000000000001,"15min":1.351},"min":{"1min":0.94099999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.633,"5min":1.958,"15min":2.911},"last":1.085}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.677},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.532,"5min":1.6499999999999999,"15min":10.214},"last":1.409},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.286,"15min":1.458},"min":{"1min":0.92700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.498,"5min":1.96,"15min":2.8849999999999998},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2749999999999999,"15min":1.5449999999999999},"min":{"1min":0.95699999999999996,"5min":0.874,"15min":0.874},"max":{"1min":1.702,"5min":1.915,"15min":6.032},"last":1.486},{"interface":"front","average":{"1min":1.256,"5min":1.2769999999999999,"15min":1.7250000000000001},"min":{"1min":0.94099999999999995,"5min":0.84399999999999997,"15min":0.77300000000000002},"max":{"1min":1.5980000000000001,"5min":1.774,"15min":10.112},"last":1.528}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3500000000000001,"15min":1.79},"min":{"1min":0.97599999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.677,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.595},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3560000000000001,"15min":1.5469999999999999},"min":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.702,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.4450000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":1098338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75700000000000001,"15min":0.97199999999999998},"min":{"1min":0.48899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.373,"5min":1.5289999999999999,"15min":4.2039999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.99099999999999999},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.874}]},{"osd":2,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":1.119},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2569999999999999,"5min":1.294,"15min":3.7349999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":1.1890000000000001},"min":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.399,"5min":1.623,"15min":3.5640000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.97599999999999998,"15min":1.1679999999999999},"min":{"1min":0.58399999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3009999999999999,"5min":1.917,"15min":4.093},"last":1.401},{"interface":"front","average":{"1min":1.081,"5min":1.129,"15min":1.3879999999999999},"min":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":2.0750000000000002,"15min":4.7439999999999998},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.212,"15min":1.4239999999999999},"min":{"1min":0.99399999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4930000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.228,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4419999999999999,"5min":1.597,"15min":4.5449999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.282,"15min":1.5780000000000001},"min":{"1min":0.85899999999999999,"5min":0.753,"15min":0.753},"max":{"1min":1.52,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.218,"5min":1.256,"15min":1.512},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.675,"15min":3.2290000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2609999999999999,"15min":1.5209999999999999},"min":{"1min":0.93799999999999994,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3899999999999999,"5min":1.714,"15min":4.4569999999999999},"last":1.222},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.319,"15min":1.661},"min":{"1min":0.94499999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4830000000000001,"5min":1.696,"15min":4.8570000000000002},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.333,"15min":1.569},"min":{"1min":0.89700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.6459999999999999,"5min":1.756,"15min":3.056},"last":1.304},{"interface":"front","average":{"1min":1.278,"5min":1.296,"15min":1.587},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":4.5019999999999998},"last":1.3140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:53:37.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:53:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f1800800700 1 Processor -- start 2024-09-13T18:53:37.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f1800800700 1 -- start start 2024-09-13T18:53:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f1800800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f80b19f0 0x7f17f806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f1800800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f80b1e80 con 0x7f17f806a5d0 2024-09-13T18:53:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f1800800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f80ce140 con 0x7f17f8071d20 2024-09-13T18:53:37.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f1800800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80cde60 con 0x7f17f80b19f0 2024-09-13T18:53:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f17fde00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f17f806a5d0 0x7f17f806a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45376/0 (socket says 172.21.15.81:45376) 2024-09-13T18:53:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f17fde00700 1 -- 172.21.15.81:0/646329642 learned_addr learned my addr 172.21.15.81:0/646329642 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:37.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.970+0000 7f17fe800700 1 --2- 172.21.15.81:0/646329642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f80b19f0 0x7f17f806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fe800700 1 -- 172.21.15.81:0/646329642 >> v1:172.21.15.178:6789/0 conn(0x7f17f8071d20 legacy=0x7f17f80cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fca00700 1 -- 172.21.15.81:0/646329642 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778863628 0 0) 0x7f17f80b1e80 con 0x7f17f806a5d0 2024-09-13T18:53:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fe800700 1 -- 172.21.15.81:0/646329642 >> v1:172.21.15.81:6789/0 conn(0x7f17f806a5d0 legacy=0x7f17f806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fe800700 1 -- 172.21.15.81:0/646329642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f806c3b0 con 0x7f17f80b19f0 2024-09-13T18:53:37.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fe800700 1 --2- 172.21.15.81:0/646329642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f80b19f0 0x7f17f806ce90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009dc0 tx=0x7f17f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b44f4a4f31f4efa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fca00700 1 -- 172.21.15.81:0/646329642 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e070 con 0x7f17f80b19f0 2024-09-13T18:53:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fca00700 1 -- 172.21.15.81:0/646329642 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400bbd0 con 0x7f17f80b19f0 2024-09-13T18:53:37.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f17fca00700 1 -- 172.21.15.81:0/646329642 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4012430 con 0x7f17f80b19f0 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 -- 172.21.15.81:0/646329642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f80b19f0 msgr2=0x7f17f806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 --2- 172.21.15.81:0/646329642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f80b19f0 0x7f17f806ce90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009dc0 tx=0x7f17f400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 -- 172.21.15.81:0/646329642 shutdown_connections 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 --2- 172.21.15.81:0/646329642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f80b19f0 0x7f17f806ce90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 -- 172.21.15.81:0/646329642 >> 172.21.15.81:0/646329642 conn(0x7f17f80b08d0 msgr2=0x7f17f80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 -- 172.21.15.81:0/646329642 shutdown_connections 2024-09-13T18:53:37.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.974+0000 7f1800800700 1 -- 172.21.15.81:0/646329642 wait complete. 2024-09-13T18:53:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.978+0000 7f1800800700 1 Processor -- start 2024-09-13T18:53:37.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.978+0000 7f1800800700 1 -- start start 2024-09-13T18:53:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.978+0000 7f1800800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f806a5d0 0x7f17f81f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.978+0000 7f1800800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 0x7f17f81e9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f1800800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f80b19f0 0x7f17f81e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f1800800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80affb0 con 0x7f17f8071d20 2024-09-13T18:53:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f1800800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81f76f0 con 0x7f17f80b19f0 2024-09-13T18:53:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f1800800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f80af330 con 0x7f17f806a5d0 2024-09-13T18:53:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 0x7f17f81e9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 0x7f17f81e9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46486/0 (socket says 172.21.15.81:46486) 2024-09-13T18:53:37.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 -- 172.21.15.81:0/1737606275 learned_addr learned my addr 172.21.15.81:0/1737606275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fde00700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f806a5d0 0x7f17f81f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fe800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f80b19f0 0x7f17f81e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 -- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f806a5d0 msgr2=0x7f17f81f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f806a5d0 0x7f17f81f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 -- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f80b19f0 msgr2=0x7f17f81e9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f80b19f0 0x7f17f81e9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 -- 172.21.15.81:0/1737606275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009a70 con 0x7f17f8071d20 2024-09-13T18:53:37.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17fd400700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 0x7f17f81e9850 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f17e800c530 tx=0x7f17e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80052d0 con 0x7f17f8071d20 2024-09-13T18:53:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e8005430 con 0x7f17f8071d20 2024-09-13T18:53:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80055a0 con 0x7f17f8071d20 2024-09-13T18:53:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f80af610 con 0x7f17f8071d20 2024-09-13T18:53:37.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.982+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f80afbd0 con 0x7f17f8071d20 2024-09-13T18:53:37.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.986+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f806d810 con 0x7f17f8071d20 2024-09-13T18:53:37.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.986+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17e80038e0 con 0x7f17f8071d20 2024-09-13T18:53:37.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.986+0000 7f17f2000700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f17dc066730 0x7f17dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.986+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f17e80837b0 con 0x7f17f8071d20 2024-09-13T18:53:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.986+0000 7f17fde00700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f17dc066730 0x7f17dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:37.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.990+0000 7f17fde00700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f17dc066730 0x7f17dc068bf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec007c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:38.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:37.994+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f17e80509d0 con 0x7f17f8071d20 2024-09-13T18:53:38.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.246+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17f814afb0 con 0x7f17dc066730 2024-09-13T18:53:38.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.258+0000 7f17f2000700 1 -- 172.21.15.81:0/1737606275 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283867 (secure 0 0 0) 0x7f17ec0012b0 con 0x7f17dc066730 2024-09-13T18:53:38.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f17dc066730 msgr2=0x7f17dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f17dc066730 0x7f17dc068bf0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000f60 tx=0x7f17ec007c60 comp rx=0 tx=0).stop 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 msgr2=0x7f17f81e9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 0x7f17f81e9850 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f17e800c530 tx=0x7f17e800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 shutdown_connections 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f17dc066730 0x7f17dc068bf0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17f80b19f0 0x7f17f81e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f8071d20 0x7f17f81e9850 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 --2- 172.21.15.81:0/1737606275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17f806a5d0 0x7f17f81f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 >> 172.21.15.81:0/1737606275 conn(0x7f17f80b08d0 msgr2=0x7f17f80b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 shutdown_connections 2024-09-13T18:53:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.266+0000 7f1800800700 1 -- 172.21.15.81:0/1737606275 wait complete. 2024-09-13T18:53:38.280 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:53:38.300 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-13T18:53:37.098022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258792,"kb_used_data":9856,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754715928,"statfs":{"total":773094113280,"available":772829110272,"internally_reserved":0,"allocated":10092544,"data_stored":5257686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.164049"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963924+0000","last_change":"2024-09-13T18:53:32.963924+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963924+0000","last_undegraded":"2024-09-13T18:53:32.963924+0000","last_fullsized":"2024-09-13T18:53:32.963924+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:37.538954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962396+0000","last_change":"2024-09-13T18:53:32.962396+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962396+0000","last_undegraded":"2024-09-13T18:53:32.962396+0000","last_fullsized":"2024-09-13T18:53:32.962396+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.964538+0000","last_change":"2024-09-13T18:53:32.964538+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.964538+0000","last_undegraded":"2024-09-13T18:53:32.964538+0000","last_fullsized":"2024-09-13T18:53:32.964538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:43.160897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965579+0000","last_change":"2024-09-13T18:53:32.965579+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965579+0000","last_undegraded":"2024-09-13T18:53:32.965579+0000","last_fullsized":"2024-09-13T18:53:32.965579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965421+0000","last_change":"2024-09-13T18:53:32.965421+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965421+0000","last_undegraded":"2024-09-13T18:53:32.965421+0000","last_fullsized":"2024-09-13T18:53:32.965421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963942+0000","last_change":"2024-09-13T18:53:32.963942+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963942+0000","last_undegraded":"2024-09-13T18:53:32.963942+0000","last_fullsized":"2024-09-13T18:53:32.963942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:53.286165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960216+0000","last_change":"2024-09-13T18:53:32.960216+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960216+0000","last_undegraded":"2024-09-13T18:53:32.960216+0000","last_fullsized":"2024-09-13T18:53:32.960216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963013+0000","last_change":"2024-09-13T18:53:32.963013+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963013+0000","last_undegraded":"2024-09-13T18:53:32.963013+0000","last_fullsized":"2024-09-13T18:53:32.963013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962334+0000","last_change":"2024-09-13T18:53:32.962334+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962334+0000","last_undegraded":"2024-09-13T18:53:32.962334+0000","last_fullsized":"2024-09-13T18:53:32.962334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959061+0000","last_change":"2024-09-13T18:53:32.959061+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959061+0000","last_undegraded":"2024-09-13T18:53:32.959061+0000","last_fullsized":"2024-09-13T18:53:32.959061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.346936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.968233+0000","last_change":"2024-09-13T18:53:32.968233+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.968233+0000","last_undegraded":"2024-09-13T18:53:32.968233+0000","last_fullsized":"2024-09-13T18:53:32.968233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959574+0000","last_change":"2024-09-13T18:53:32.959574+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959574+0000","last_undegraded":"2024-09-13T18:53:32.959574+0000","last_fullsized":"2024-09-13T18:53:32.959574+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958589+0000","last_change":"2024-09-13T18:53:32.958589+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958589+0000","last_undegraded":"2024-09-13T18:53:32.958589+0000","last_fullsized":"2024-09-13T18:53:32.958589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967599+0000","last_change":"2024-09-13T18:53:32.967599+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967599+0000","last_undegraded":"2024-09-13T18:53:32.967599+0000","last_fullsized":"2024-09-13T18:53:32.967599+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958324+0000","last_change":"2024-09-13T18:53:32.958324+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958324+0000","last_undegraded":"2024-09-13T18:53:32.958324+0000","last_fullsized":"2024-09-13T18:53:32.958324+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960023+0000","last_change":"2024-09-13T18:53:32.960023+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960023+0000","last_undegraded":"2024-09-13T18:53:32.960023+0000","last_fullsized":"2024-09-13T18:53:32.960023+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:39.591604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962631+0000","last_change":"2024-09-13T18:53:32.962631+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962631+0000","last_undegraded":"2024-09-13T18:53:32.962631+0000","last_fullsized":"2024-09-13T18:53:32.962631+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.445067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.966390+0000","last_change":"2024-09-13T18:53:32.966390+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.966390+0000","last_undegraded":"2024-09-13T18:53:32.966390+0000","last_fullsized":"2024-09-13T18:53:32.966390+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:11.980134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965178+0000","last_change":"2024-09-13T18:53:32.965178+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965178+0000","last_undegraded":"2024-09-13T18:53:32.965178+0000","last_fullsized":"2024-09-13T18:53:32.965178+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960846+0000","last_change":"2024-09-13T18:53:32.960846+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960846+0000","last_undegraded":"2024-09-13T18:53:32.960846+0000","last_fullsized":"2024-09-13T18:53:32.960846+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965964+0000","last_change":"2024-09-13T18:53:32.965964+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965964+0000","last_undegraded":"2024-09-13T18:53:32.965964+0000","last_fullsized":"2024-09-13T18:53:32.965964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967143+0000","last_change":"2024-09-13T18:53:32.967143+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967143+0000","last_undegraded":"2024-09-13T18:53:32.967143+0000","last_fullsized":"2024-09-13T18:53:32.967143+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957095+0000","last_change":"2024-09-13T18:53:32.957095+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957095+0000","last_undegraded":"2024-09-13T18:53:32.957095+0000","last_fullsized":"2024-09-13T18:53:32.957095+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962964+0000","last_change":"2024-09-13T18:53:32.962964+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962964+0000","last_undegraded":"2024-09-13T18:53:32.962964+0000","last_fullsized":"2024-09-13T18:53:32.962964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:30.589532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962046+0000","last_change":"2024-09-13T18:53:32.962046+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962046+0000","last_undegraded":"2024-09-13T18:53:32.962046+0000","last_fullsized":"2024-09-13T18:53:32.962046+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.969322+0000","last_change":"2024-09-13T18:53:32.969322+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.969322+0000","last_undegraded":"2024-09-13T18:53:32.969322+0000","last_fullsized":"2024-09-13T18:53:32.969322+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959093+0000","last_change":"2024-09-13T18:53:32.959093+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959093+0000","last_undegraded":"2024-09-13T18:53:32.959093+0000","last_fullsized":"2024-09-13T18:53:32.959093+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:34.977610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959992+0000","last_change":"2024-09-13T18:53:32.959992+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959992+0000","last_undegraded":"2024-09-13T18:53:32.959992+0000","last_fullsized":"2024-09-13T18:53:32.959992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961472+0000","last_change":"2024-09-13T18:53:32.961472+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961472+0000","last_undegraded":"2024-09-13T18:53:32.961472+0000","last_fullsized":"2024-09-13T18:53:32.961472+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.966709+0000","last_change":"2024-09-13T18:53:32.966709+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.966709+0000","last_undegraded":"2024-09-13T18:53:32.966709+0000","last_fullsized":"2024-09-13T18:53:32.966709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963679+0000","last_change":"2024-09-13T18:53:32.963679+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963679+0000","last_undegraded":"2024-09-13T18:53:32.963679+0000","last_fullsized":"2024-09-13T18:53:32.963679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959635+0000","last_change":"2024-09-13T18:53:32.959635+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959635+0000","last_undegraded":"2024-09-13T18:53:32.959635+0000","last_fullsized":"2024-09-13T18:53:32.959635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:51.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961057+0000","last_change":"2024-09-13T18:53:32.961057+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961057+0000","last_undegraded":"2024-09-13T18:53:32.961057+0000","last_fullsized":"2024-09-13T18:53:32.961057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:25.336257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976843+0000","last_change":"2024-09-13T18:53:32.974455+0000","last_active":"2024-09-13T18:53:32.976843+0000","last_peered":"2024-09-13T18:53:32.976843+0000","last_clean":"2024-09-13T18:53:32.976843+0000","last_became_active":"2024-09-13T18:53:32.974185+0000","last_became_peered":"2024-09-13T18:53:32.974185+0000","last_unstale":"2024-09-13T18:53:32.976843+0000","last_undegraded":"2024-09-13T18:53:32.976843+0000","last_fullsized":"2024-09-13T18:53:32.976843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:13.889692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956672+0000","last_change":"2024-09-13T18:53:32.956672+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956672+0000","last_undegraded":"2024-09-13T18:53:32.956672+0000","last_fullsized":"2024-09-13T18:53:32.956672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:59.976141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976558+0000","last_change":"2024-09-13T18:53:32.974168+0000","last_active":"2024-09-13T18:53:32.976558+0000","last_peered":"2024-09-13T18:53:32.976558+0000","last_clean":"2024-09-13T18:53:32.976558+0000","last_became_active":"2024-09-13T18:53:32.973823+0000","last_became_peered":"2024-09-13T18:53:32.973823+0000","last_unstale":"2024-09-13T18:53:32.976558+0000","last_undegraded":"2024-09-13T18:53:32.976558+0000","last_fullsized":"2024-09-13T18:53:32.976558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:53.038961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960698+0000","last_change":"2024-09-13T18:53:32.960698+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960698+0000","last_undegraded":"2024-09-13T18:53:32.960698+0000","last_fullsized":"2024-09-13T18:53:32.960698+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.983091+0000","last_change":"2024-09-13T18:53:32.982524+0000","last_active":"2024-09-13T18:53:32.983091+0000","last_peered":"2024-09-13T18:53:32.983091+0000","last_clean":"2024-09-13T18:53:32.983091+0000","last_became_active":"2024-09-13T18:53:32.982071+0000","last_became_peered":"2024-09-13T18:53:32.982071+0000","last_unstale":"2024-09-13T18:53:32.983091+0000","last_undegraded":"2024-09-13T18:53:32.983091+0000","last_fullsized":"2024-09-13T18:53:32.983091+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955886+0000","last_change":"2024-09-13T18:53:32.955886+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955886+0000","last_undegraded":"2024-09-13T18:53:32.955886+0000","last_fullsized":"2024-09-13T18:53:32.955886+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:27.303458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973282+0000","last_change":"2024-09-13T18:53:32.969226+0000","last_active":"2024-09-13T18:53:32.973282+0000","last_peered":"2024-09-13T18:53:32.973282+0000","last_clean":"2024-09-13T18:53:32.973282+0000","last_became_active":"2024-09-13T18:53:32.968542+0000","last_became_peered":"2024-09-13T18:53:32.968542+0000","last_unstale":"2024-09-13T18:53:32.973282+0000","last_undegraded":"2024-09-13T18:53:32.973282+0000","last_fullsized":"2024-09-13T18:53:32.973282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957253+0000","last_change":"2024-09-13T18:53:32.957253+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957253+0000","last_undegraded":"2024-09-13T18:53:32.957253+0000","last_fullsized":"2024-09-13T18:53:32.957253+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981074+0000","last_change":"2024-09-13T18:53:32.979540+0000","last_active":"2024-09-13T18:53:32.981074+0000","last_peered":"2024-09-13T18:53:32.981074+0000","last_clean":"2024-09-13T18:53:32.981074+0000","last_became_active":"2024-09-13T18:53:32.979212+0000","last_became_peered":"2024-09-13T18:53:32.979212+0000","last_unstale":"2024-09-13T18:53:32.981074+0000","last_undegraded":"2024-09-13T18:53:32.981074+0000","last_fullsized":"2024-09-13T18:53:32.981074+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:53.373570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955916+0000","last_change":"2024-09-13T18:53:32.955916+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955916+0000","last_undegraded":"2024-09-13T18:53:32.955916+0000","last_fullsized":"2024-09-13T18:53:32.955916+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981520+0000","last_change":"2024-09-13T18:53:32.975163+0000","last_active":"2024-09-13T18:53:32.981520+0000","last_peered":"2024-09-13T18:53:32.981520+0000","last_clean":"2024-09-13T18:53:32.981520+0000","last_became_active":"2024-09-13T18:53:32.974855+0000","last_became_peered":"2024-09-13T18:53:32.974855+0000","last_unstale":"2024-09-13T18:53:32.981520+0000","last_undegraded":"2024-09-13T18:53:32.981520+0000","last_fullsized":"2024-09-13T18:53:32.981520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962140+0000","last_change":"2024-09-13T18:53:32.962140+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962140+0000","last_undegraded":"2024-09-13T18:53:32.962140+0000","last_fullsized":"2024-09-13T18:53:32.962140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:05.116179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978912+0000","last_change":"2024-09-13T18:53:32.974717+0000","last_active":"2024-09-13T18:53:32.978912+0000","last_peered":"2024-09-13T18:53:32.978912+0000","last_clean":"2024-09-13T18:53:32.978912+0000","last_became_active":"2024-09-13T18:53:32.974438+0000","last_became_peered":"2024-09-13T18:53:32.974438+0000","last_unstale":"2024-09-13T18:53:32.978912+0000","last_undegraded":"2024-09-13T18:53:32.978912+0000","last_fullsized":"2024-09-13T18:53:32.978912+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:58.112314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958144+0000","last_change":"2024-09-13T18:53:32.958144+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958144+0000","last_undegraded":"2024-09-13T18:53:32.958144+0000","last_fullsized":"2024-09-13T18:53:32.958144+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:30.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980683+0000","last_change":"2024-09-13T18:53:32.977072+0000","last_active":"2024-09-13T18:53:32.980683+0000","last_peered":"2024-09-13T18:53:32.980683+0000","last_clean":"2024-09-13T18:53:32.980683+0000","last_became_active":"2024-09-13T18:53:32.974368+0000","last_became_peered":"2024-09-13T18:53:32.974368+0000","last_unstale":"2024-09-13T18:53:32.980683+0000","last_undegraded":"2024-09-13T18:53:32.980683+0000","last_fullsized":"2024-09-13T18:53:32.980683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967583+0000","last_change":"2024-09-13T18:53:32.967583+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967583+0000","last_undegraded":"2024-09-13T18:53:32.967583+0000","last_fullsized":"2024-09-13T18:53:32.967583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978504+0000","last_change":"2024-09-13T18:53:32.971936+0000","last_active":"2024-09-13T18:53:32.978504+0000","last_peered":"2024-09-13T18:53:32.978504+0000","last_clean":"2024-09-13T18:53:32.978504+0000","last_became_active":"2024-09-13T18:53:32.971646+0000","last_became_peered":"2024-09-13T18:53:32.971646+0000","last_unstale":"2024-09-13T18:53:32.978504+0000","last_undegraded":"2024-09-13T18:53:32.978504+0000","last_fullsized":"2024-09-13T18:53:32.978504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961391+0000","last_change":"2024-09-13T18:53:32.961391+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961391+0000","last_undegraded":"2024-09-13T18:53:32.961391+0000","last_fullsized":"2024-09-13T18:53:32.961391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978108+0000","last_change":"2024-09-13T18:53:32.975559+0000","last_active":"2024-09-13T18:53:32.978108+0000","last_peered":"2024-09-13T18:53:32.978108+0000","last_clean":"2024-09-13T18:53:32.978108+0000","last_became_active":"2024-09-13T18:53:32.975226+0000","last_became_peered":"2024-09-13T18:53:32.975226+0000","last_unstale":"2024-09-13T18:53:32.978108+0000","last_undegraded":"2024-09-13T18:53:32.978108+0000","last_fullsized":"2024-09-13T18:53:32.978108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.754508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965971+0000","last_change":"2024-09-13T18:53:32.965971+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965971+0000","last_undegraded":"2024-09-13T18:53:32.965971+0000","last_fullsized":"2024-09-13T18:53:32.965971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:46.856863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981028+0000","last_change":"2024-09-13T18:53:32.979461+0000","last_active":"2024-09-13T18:53:32.981028+0000","last_peered":"2024-09-13T18:53:32.981028+0000","last_clean":"2024-09-13T18:53:32.981028+0000","last_became_active":"2024-09-13T18:53:32.978929+0000","last_became_peered":"2024-09-13T18:53:32.978929+0000","last_unstale":"2024-09-13T18:53:32.981028+0000","last_undegraded":"2024-09-13T18:53:32.981028+0000","last_fullsized":"2024-09-13T18:53:32.981028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:54.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957615+0000","last_change":"2024-09-13T18:53:32.957615+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957615+0000","last_undegraded":"2024-09-13T18:53:32.957615+0000","last_fullsized":"2024-09-13T18:53:32.957615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.968130+0000","last_change":"2024-09-13T18:53:32.962678+0000","last_active":"2024-09-13T18:53:32.968130+0000","last_peered":"2024-09-13T18:53:32.968130+0000","last_clean":"2024-09-13T18:53:32.968130+0000","last_became_active":"2024-09-13T18:53:32.962353+0000","last_became_peered":"2024-09-13T18:53:32.962353+0000","last_unstale":"2024-09-13T18:53:32.968130+0000","last_undegraded":"2024-09-13T18:53:32.968130+0000","last_fullsized":"2024-09-13T18:53:32.968130+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:21.019937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956705+0000","last_change":"2024-09-13T18:53:32.956705+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956705+0000","last_undegraded":"2024-09-13T18:53:32.956705+0000","last_fullsized":"2024-09-13T18:53:32.956705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980625+0000","last_change":"2024-09-13T18:53:32.977043+0000","last_active":"2024-09-13T18:53:32.980625+0000","last_peered":"2024-09-13T18:53:32.980625+0000","last_clean":"2024-09-13T18:53:32.980625+0000","last_became_active":"2024-09-13T18:53:32.974269+0000","last_became_peered":"2024-09-13T18:53:32.974269+0000","last_unstale":"2024-09-13T18:53:32.980625+0000","last_undegraded":"2024-09-13T18:53:32.980625+0000","last_fullsized":"2024-09-13T18:53:32.980625+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965539+0000","last_change":"2024-09-13T18:53:32.965539+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965539+0000","last_undegraded":"2024-09-13T18:53:32.965539+0000","last_fullsized":"2024-09-13T18:53:32.965539+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973418+0000","last_change":"2024-09-13T18:53:32.968390+0000","last_active":"2024-09-13T18:53:32.973418+0000","last_peered":"2024-09-13T18:53:32.973418+0000","last_clean":"2024-09-13T18:53:32.973418+0000","last_became_active":"2024-09-13T18:53:32.968173+0000","last_became_peered":"2024-09-13T18:53:32.968173+0000","last_unstale":"2024-09-13T18:53:32.973418+0000","last_undegraded":"2024-09-13T18:53:32.973418+0000","last_fullsized":"2024-09-13T18:53:32.973418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:16.066340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957979+0000","last_change":"2024-09-13T18:53:32.957979+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957979+0000","last_undegraded":"2024-09-13T18:53:32.957979+0000","last_fullsized":"2024-09-13T18:53:32.957979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:00.853298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.982247+0000","last_change":"2024-09-13T18:53:32.978943+0000","last_active":"2024-09-13T18:53:32.982247+0000","last_peered":"2024-09-13T18:53:32.982247+0000","last_clean":"2024-09-13T18:53:32.982247+0000","last_became_active":"2024-09-13T18:53:32.978004+0000","last_became_peered":"2024-09-13T18:53:32.978004+0000","last_unstale":"2024-09-13T18:53:32.982247+0000","last_undegraded":"2024-09-13T18:53:32.982247+0000","last_fullsized":"2024-09-13T18:53:32.982247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959358+0000","last_change":"2024-09-13T18:53:32.959358+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959358+0000","last_undegraded":"2024-09-13T18:53:32.959358+0000","last_fullsized":"2024-09-13T18:53:32.959358+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:35.073791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.979214+0000","last_change":"2024-09-13T18:53:32.972297+0000","last_active":"2024-09-13T18:53:32.979214+0000","last_peered":"2024-09-13T18:53:32.979214+0000","last_clean":"2024-09-13T18:53:32.979214+0000","last_became_active":"2024-09-13T18:53:32.972040+0000","last_became_peered":"2024-09-13T18:53:32.972040+0000","last_unstale":"2024-09-13T18:53:32.979214+0000","last_undegraded":"2024-09-13T18:53:32.979214+0000","last_fullsized":"2024-09-13T18:53:32.979214+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955754+0000","last_change":"2024-09-13T18:53:32.955754+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955754+0000","last_undegraded":"2024-09-13T18:53:32.955754+0000","last_fullsized":"2024-09-13T18:53:32.955754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:00.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.972772+0000","last_change":"2024-09-13T18:53:32.966972+0000","last_active":"2024-09-13T18:53:32.972772+0000","last_peered":"2024-09-13T18:53:32.972772+0000","last_clean":"2024-09-13T18:53:32.972772+0000","last_became_active":"2024-09-13T18:53:32.966526+0000","last_became_peered":"2024-09-13T18:53:32.966526+0000","last_unstale":"2024-09-13T18:53:32.972772+0000","last_undegraded":"2024-09-13T18:53:32.972772+0000","last_fullsized":"2024-09-13T18:53:32.972772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:58.976298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956061+0000","last_change":"2024-09-13T18:53:32.956061+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956061+0000","last_undegraded":"2024-09-13T18:53:32.956061+0000","last_fullsized":"2024-09-13T18:53:32.956061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980687+0000","last_change":"2024-09-13T18:53:32.976908+0000","last_active":"2024-09-13T18:53:32.980687+0000","last_peered":"2024-09-13T18:53:32.980687+0000","last_clean":"2024-09-13T18:53:32.980687+0000","last_became_active":"2024-09-13T18:53:32.976653+0000","last_became_peered":"2024-09-13T18:53:32.976653+0000","last_unstale":"2024-09-13T18:53:32.980687+0000","last_undegraded":"2024-09-13T18:53:32.980687+0000","last_fullsized":"2024-09-13T18:53:32.980687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.968175+0000","last_change":"2024-09-13T18:53:32.968175+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.968175+0000","last_undegraded":"2024-09-13T18:53:32.968175+0000","last_fullsized":"2024-09-13T18:53:32.968175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980273+0000","last_change":"2024-09-13T18:53:32.976609+0000","last_active":"2024-09-13T18:53:32.980273+0000","last_peered":"2024-09-13T18:53:32.980273+0000","last_clean":"2024-09-13T18:53:32.980273+0000","last_became_active":"2024-09-13T18:53:32.976333+0000","last_became_peered":"2024-09-13T18:53:32.976333+0000","last_unstale":"2024-09-13T18:53:32.980273+0000","last_undegraded":"2024-09-13T18:53:32.980273+0000","last_fullsized":"2024-09-13T18:53:32.980273+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:53.755995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955379+0000","last_change":"2024-09-13T18:53:32.955379+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955379+0000","last_undegraded":"2024-09-13T18:53:32.955379+0000","last_fullsized":"2024-09-13T18:53:32.955379+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:18.970121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980839+0000","last_change":"2024-09-13T18:53:32.976670+0000","last_active":"2024-09-13T18:53:32.980839+0000","last_peered":"2024-09-13T18:53:32.980839+0000","last_clean":"2024-09-13T18:53:32.980839+0000","last_became_active":"2024-09-13T18:53:32.976354+0000","last_became_peered":"2024-09-13T18:53:32.976354+0000","last_unstale":"2024-09-13T18:53:32.980839+0000","last_undegraded":"2024-09-13T18:53:32.980839+0000","last_fullsized":"2024-09-13T18:53:32.980839+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962938+0000","last_change":"2024-09-13T18:53:32.962938+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962938+0000","last_undegraded":"2024-09-13T18:53:32.962938+0000","last_fullsized":"2024-09-13T18:53:32.962938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.971731+0000","last_change":"2024-09-13T18:53:32.966984+0000","last_active":"2024-09-13T18:53:32.971731+0000","last_peered":"2024-09-13T18:53:32.971731+0000","last_clean":"2024-09-13T18:53:32.971731+0000","last_became_active":"2024-09-13T18:53:32.966665+0000","last_became_peered":"2024-09-13T18:53:32.966665+0000","last_unstale":"2024-09-13T18:53:32.971731+0000","last_undegraded":"2024-09-13T18:53:32.971731+0000","last_fullsized":"2024-09-13T18:53:32.971731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.908915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961094+0000","last_change":"2024-09-13T18:53:32.961094+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961094+0000","last_undegraded":"2024-09-13T18:53:32.961094+0000","last_fullsized":"2024-09-13T18:53:32.961094+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981412+0000","last_change":"2024-09-13T18:53:32.977136+0000","last_active":"2024-09-13T18:53:32.981412+0000","last_peered":"2024-09-13T18:53:32.981412+0000","last_clean":"2024-09-13T18:53:32.981412+0000","last_became_active":"2024-09-13T18:53:32.974769+0000","last_became_peered":"2024-09-13T18:53:32.974769+0000","last_unstale":"2024-09-13T18:53:32.981412+0000","last_undegraded":"2024-09-13T18:53:32.981412+0000","last_fullsized":"2024-09-13T18:53:32.981412+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960960+0000","last_change":"2024-09-13T18:53:32.960960+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960960+0000","last_undegraded":"2024-09-13T18:53:32.960960+0000","last_fullsized":"2024-09-13T18:53:32.960960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:59.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978684+0000","last_change":"2024-09-13T18:53:32.973495+0000","last_active":"2024-09-13T18:53:32.978684+0000","last_peered":"2024-09-13T18:53:32.978684+0000","last_clean":"2024-09-13T18:53:32.978684+0000","last_became_active":"2024-09-13T18:53:32.973173+0000","last_became_peered":"2024-09-13T18:53:32.973173+0000","last_unstale":"2024-09-13T18:53:32.978684+0000","last_undegraded":"2024-09-13T18:53:32.978684+0000","last_fullsized":"2024-09-13T18:53:32.978684+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:11.941564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956438+0000","last_change":"2024-09-13T18:53:32.956438+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956438+0000","last_undegraded":"2024-09-13T18:53:32.956438+0000","last_fullsized":"2024-09-13T18:53:32.956438+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976435+0000","last_change":"2024-09-13T18:53:32.975551+0000","last_active":"2024-09-13T18:53:32.976435+0000","last_peered":"2024-09-13T18:53:32.976435+0000","last_clean":"2024-09-13T18:53:32.976435+0000","last_became_active":"2024-09-13T18:53:32.973976+0000","last_became_peered":"2024-09-13T18:53:32.973976+0000","last_unstale":"2024-09-13T18:53:32.976435+0000","last_undegraded":"2024-09-13T18:53:32.976435+0000","last_fullsized":"2024-09-13T18:53:32.976435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955079+0000","last_change":"2024-09-13T18:53:32.955079+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955079+0000","last_undegraded":"2024-09-13T18:53:32.955079+0000","last_fullsized":"2024-09-13T18:53:32.955079+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:32.417668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980975+0000","last_change":"2024-09-13T18:53:32.978157+0000","last_active":"2024-09-13T18:53:32.980975+0000","last_peered":"2024-09-13T18:53:32.980975+0000","last_clean":"2024-09-13T18:53:32.980975+0000","last_became_active":"2024-09-13T18:53:32.977850+0000","last_became_peered":"2024-09-13T18:53:32.977850+0000","last_unstale":"2024-09-13T18:53:32.980975+0000","last_undegraded":"2024-09-13T18:53:32.980975+0000","last_fullsized":"2024-09-13T18:53:32.980975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:07.000712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955530+0000","last_change":"2024-09-13T18:53:32.955530+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955530+0000","last_undegraded":"2024-09-13T18:53:32.955530+0000","last_fullsized":"2024-09-13T18:53:32.955530+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980952+0000","last_change":"2024-09-13T18:53:32.977923+0000","last_active":"2024-09-13T18:53:32.980952+0000","last_peered":"2024-09-13T18:53:32.980952+0000","last_clean":"2024-09-13T18:53:32.980952+0000","last_became_active":"2024-09-13T18:53:32.977485+0000","last_became_peered":"2024-09-13T18:53:32.977485+0000","last_unstale":"2024-09-13T18:53:32.980952+0000","last_undegraded":"2024-09-13T18:53:32.980952+0000","last_fullsized":"2024-09-13T18:53:32.980952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.319921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961601+0000","last_change":"2024-09-13T18:53:32.961601+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961601+0000","last_undegraded":"2024-09-13T18:53:32.961601+0000","last_fullsized":"2024-09-13T18:53:32.961601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973160+0000","last_change":"2024-09-13T18:53:32.969065+0000","last_active":"2024-09-13T18:53:32.973160+0000","last_peered":"2024-09-13T18:53:32.973160+0000","last_clean":"2024-09-13T18:53:32.973160+0000","last_became_active":"2024-09-13T18:53:32.968189+0000","last_became_peered":"2024-09-13T18:53:32.968189+0000","last_unstale":"2024-09-13T18:53:32.973160+0000","last_undegraded":"2024-09-13T18:53:32.973160+0000","last_fullsized":"2024-09-13T18:53:32.973160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956903+0000","last_change":"2024-09-13T18:53:32.956903+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956903+0000","last_undegraded":"2024-09-13T18:53:32.956903+0000","last_fullsized":"2024-09-13T18:53:32.956903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:29.365964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.975858+0000","last_change":"2024-09-13T18:53:32.971783+0000","last_active":"2024-09-13T18:53:32.975858+0000","last_peered":"2024-09-13T18:53:32.975858+0000","last_clean":"2024-09-13T18:53:32.975858+0000","last_became_active":"2024-09-13T18:53:32.971544+0000","last_became_peered":"2024-09-13T18:53:32.971544+0000","last_unstale":"2024-09-13T18:53:32.975858+0000","last_undegraded":"2024-09-13T18:53:32.975858+0000","last_fullsized":"2024-09-13T18:53:32.975858+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:19.672579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965568+0000","last_change":"2024-09-13T18:53:32.965568+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965568+0000","last_undegraded":"2024-09-13T18:53:32.965568+0000","last_fullsized":"2024-09-13T18:53:32.965568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:25.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981420+0000","last_change":"2024-09-13T18:53:32.979624+0000","last_active":"2024-09-13T18:53:32.981420+0000","last_peered":"2024-09-13T18:53:32.981420+0000","last_clean":"2024-09-13T18:53:32.981420+0000","last_became_active":"2024-09-13T18:53:32.979380+0000","last_became_peered":"2024-09-13T18:53:32.979380+0000","last_unstale":"2024-09-13T18:53:32.981420+0000","last_undegraded":"2024-09-13T18:53:32.981420+0000","last_fullsized":"2024-09-13T18:53:32.981420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955789+0000","last_change":"2024-09-13T18:53:32.955789+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955789+0000","last_undegraded":"2024-09-13T18:53:32.955789+0000","last_fullsized":"2024-09-13T18:53:32.955789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.974169+0000","last_change":"2024-09-13T18:53:32.971426+0000","last_active":"2024-09-13T18:53:32.974169+0000","last_peered":"2024-09-13T18:53:32.974169+0000","last_clean":"2024-09-13T18:53:32.974169+0000","last_became_active":"2024-09-13T18:53:32.971188+0000","last_became_peered":"2024-09-13T18:53:32.971188+0000","last_unstale":"2024-09-13T18:53:32.974169+0000","last_undegraded":"2024-09-13T18:53:32.974169+0000","last_fullsized":"2024-09-13T18:53:32.974169+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:48.187135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956210+0000","last_change":"2024-09-13T18:53:32.956210+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956210+0000","last_undegraded":"2024-09-13T18:53:32.956210+0000","last_fullsized":"2024-09-13T18:53:32.956210+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:02.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980701+0000","last_change":"2024-09-13T18:53:32.977404+0000","last_active":"2024-09-13T18:53:32.980701+0000","last_peered":"2024-09-13T18:53:32.980701+0000","last_clean":"2024-09-13T18:53:32.980701+0000","last_became_active":"2024-09-13T18:53:32.977089+0000","last_became_peered":"2024-09-13T18:53:32.977089+0000","last_unstale":"2024-09-13T18:53:32.980701+0000","last_undegraded":"2024-09-13T18:53:32.980701+0000","last_fullsized":"2024-09-13T18:53:32.980701+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963992+0000","last_change":"2024-09-13T18:53:32.963992+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963992+0000","last_undegraded":"2024-09-13T18:53:32.963992+0000","last_fullsized":"2024-09-13T18:53:32.963992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.982205+0000","last_change":"2024-09-13T18:53:32.978373+0000","last_active":"2024-09-13T18:53:32.982205+0000","last_peered":"2024-09-13T18:53:32.982205+0000","last_clean":"2024-09-13T18:53:32.982205+0000","last_became_active":"2024-09-13T18:53:32.977238+0000","last_became_peered":"2024-09-13T18:53:32.977238+0000","last_unstale":"2024-09-13T18:53:32.982205+0000","last_undegraded":"2024-09-13T18:53:32.982205+0000","last_fullsized":"2024-09-13T18:53:32.982205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:39.620579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:53:31.947462+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:53:31.947462+0000","last_peered":"2024-09-13T18:53:31.947462+0000","last_clean":"2024-09-13T18:53:31.947462+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:53:31.947462+0000","last_undegraded":"2024-09-13T18:53:31.947462+0000","last_fullsized":"2024-09-13T18:53:31.947462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":1098338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.415,"5min":1.72,"15min":1.72},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.524,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1419999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.117,"15min":1.137},"min":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.589},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.208},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.252}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.79200000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.605,"5min":1.885,"15min":1.885},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.1890000000000001,"15min":1.206},"min":{"1min":0.97199999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.335}]},{"osd":3,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2649999999999999,"15min":1.2749999999999999},"min":{"1min":0.94799999999999995,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.5640000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.413},{"interface":"front","average":{"1min":1.391,"5min":1.327,"15min":1.427},"min":{"1min":0.96399999999999997,"5min":0.90900000000000003,"15min":0.81999999999999995},"max":{"1min":1.669,"5min":1.861,"15min":2.2610000000000001},"last":1.538}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.111},"min":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.226,"5min":1.22,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.66700000000000004,"15min":0.63700000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.3080000000000001},"min":{"1min":0.87,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.522,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.212,"5min":1.208,"15min":1.2230000000000001},"min":{"1min":0.79000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.375,"15min":1.399},"min":{"1min":1.0629999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.47},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.371,"15min":1.413},"min":{"1min":0.95399999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6279999999999999,"5min":1.845,"15min":1.845},"last":1.71}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1122304,"data_stored":514565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0860000000000001,"15min":1.1339999999999999},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.619,"5min":1.8169999999999999,"15min":3.0369999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.099,"15min":1.161},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5529999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.4890000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.155,"15min":1.1919999999999999},"min":{"1min":0.90200000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.4950000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.169,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":1.675,"15min":3.7480000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1859999999999999,"15min":1.4399999999999999},"min":{"1min":0.82699999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.4099999999999999,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.4790000000000001},"min":{"1min":0.97999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6339999999999999,"5min":1.7230000000000001,"15min":4.883},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2669999999999999,"15min":1.4910000000000001},"min":{"1min":0.89200000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":4.8630000000000004},"last":1.325}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.288},"min":{"1min":0.76600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.526,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5589999999999999,"5min":1.796,"15min":2.077},"last":1.375}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.395},"min":{"1min":0.81899999999999995,"5min":0.755,"15min":0.755},"max":{"1min":1.456,"5min":1.764,"15min":2.1699999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.389,"15min":1.4670000000000001},"min":{"1min":0.97299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5860000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.5}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.4510000000000001},"min":{"1min":1.0049999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.611},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.361,"15min":1.5049999999999999},"min":{"1min":1.0640000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.367},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1122304,"data_stored":514565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0569999999999999,"15min":1.177},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.125,"15min":1.155},"min":{"1min":0.90300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":2.278},"last":1.1599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.2549999999999999},"min":{"1min":0.79700000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.476,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.111},{"interface":"front","average":{"1min":1.097,"5min":1.119,"15min":1.1799999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.532,"5min":1.5649999999999999,"15min":2.1040000000000001},"last":1.512}]},{"osd":2,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1910000000000001,"15min":1.274},"min":{"1min":0.76700000000000002,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.619,"5min":1.7470000000000001,"15min":1.9059999999999999},"last":1.399},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.157},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.25,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.749},"max":{"1min":1.5660000000000001,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.4179999999999999},"min":{"1min":0.90600000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":2.9470000000000001},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1100000000000001,"15min":1.2030000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5109999999999999,"5min":1.579,"15min":1.8500000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2669999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4990000000000001,"5min":1.742,"15min":1.974},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2909999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.536,"5min":1.669,"15min":2.0219999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.694,"5min":1.694,"15min":2.1739999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":1.0580000000000001,"5min":0.87,"15min":0.81699999999999995},"max":{"1min":1.6499999999999999,"5min":1.7649999999999999,"15min":2.169},"last":1.323},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.5},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.641,"5min":1.804,"15min":2.8140000000000001},"last":1.5569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.002},{"interface":"front","average":{"1min":1.121,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.77200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.518,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2949999999999999,"15min":1.351},"min":{"1min":0.77000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6539999999999999,"5min":1.6739999999999999,"15min":2.6930000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.3169999999999999},"min":{"1min":0.73799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4970000000000001,"5min":1.806,"15min":2.423},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2190000000000001,"15min":1.28},"min":{"1min":0.94999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.99},"last":1.589},{"interface":"front","average":{"1min":1.266,"5min":1.3,"15min":1.371},"min":{"1min":0.82699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":2.335},"last":1.218}]},{"osd":3,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2010000000000001,"15min":1.2989999999999999},"min":{"1min":0.82199999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":2.621},"last":1.24},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1839999999999999,"15min":1.2569999999999999},"min":{"1min":0.91000000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.302,"5min":1.5669999999999999,"15min":1.8640000000000001},"last":1.4470000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.153,"15min":1.284},"min":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":2.274},"last":1.129},{"interface":"front","average":{"1min":1.196,"5min":1.2230000000000001,"15min":1.304},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.988,"5min":1.988,"15min":2.266},"last":1.4910000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2070000000000001,"15min":1.333},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5189999999999999,"5min":2.319,"15min":2.4710000000000001},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3480000000000001,"15min":1.444},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5720000000000001,"5min":1.851,"15min":2.5},"last":1.2969999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.351,"15min":1.446},"min":{"1min":0.72399999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.395},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.355,"15min":1.454},"min":{"1min":1.0429999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9059999999999999,"5min":2.415,"15min":2.415},"last":1.7490000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.88600000000000001},"min":{"1min":0.48799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0800000000000001,"5min":1.331,"15min":1.4510000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.879},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0589999999999999,"5min":1.444,"15min":1.444},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3500000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.069},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94899999999999995,"15min":1.0880000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.464,"15min":4.0149999999999997},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.004,"15min":1.002},"min":{"1min":0.71599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.319,"5min":1.611,"15min":1.611},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.161},"min":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.536,"5min":1.569,"15min":2.4729999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.179,"15min":1.2370000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1519999999999999,"15min":1.226},"min":{"1min":0.82299999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.8220000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2170000000000001,"15min":1.3049999999999999},"min":{"1min":0.94799999999999995,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.4850000000000001,"5min":1.855,"15min":2.0099999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2789999999999999,"15min":1.365},"min":{"1min":0.85099999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6000000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3089999999999999,"15min":1.413},"min":{"1min":0.875,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.49,"5min":1.9239999999999999,"15min":2.714},"last":1.339},{"interface":"front","average":{"1min":1.222,"5min":1.278,"15min":1.4039999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7270000000000001,"5min":1.8520000000000001,"15min":2.52},"last":1.119}]},{"osd":7,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3049999999999999,"15min":1.4890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7789999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.302,"15min":1.4199999999999999},"min":{"1min":1.0029999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5580000000000001,"5min":1.946,"15min":1.9810000000000001},"last":1.1040000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77500000000000002,"15min":0.95699999999999996},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1000000000000001,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80900000000000005,"15min":1.0209999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.54,"5min":1.54,"15min":4.6349999999999998},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.84399999999999997,"15min":1.1000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1990000000000001,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.762,"5min":1.762,"15min":4.7009999999999996},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.117,"15min":1.294},"min":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5329999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":1.04},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.202},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.339,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.878}]},{"osd":4,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.204,"15min":1.5980000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":8.6989999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.224,"15min":1.4219999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.383,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":0.998}]},{"osd":5,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2809999999999999,"15min":1.484},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6319999999999999,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.24,"15min":1.46},"min":{"1min":0.88600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5649999999999999,"5min":1.7370000000000001,"15min":4.335},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.5089999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.5569999999999999,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.2450000000000001,"15min":1.696},"min":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":1.6319999999999999,"15min":8.6300000000000008},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3200000000000001,"15min":1.5329999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.137},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.355,"15min":1.589},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":4.4050000000000002},"last":1.0880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.86799999999999999},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0309999999999999,"5min":1.385,"15min":2.2170000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":1.026},"min":{"1min":0.61699999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.036,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.169},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.46,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":1.0589999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5589999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1080000000000001,"15min":1.294},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4550000000000001,"5min":1.637,"15min":6.0919999999999996},"last":1.016},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0449999999999999,"15min":1.3779999999999999},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4970000000000001,"5min":1.768,"15min":10.368},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.3640000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6040000000000001,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2450000000000001,"15min":1.351},"min":{"1min":0.94099999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.633,"5min":1.958,"15min":2.911},"last":1.085}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.677},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.532,"5min":1.6499999999999999,"15min":10.214},"last":1.409},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.286,"15min":1.458},"min":{"1min":0.92700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.498,"5min":1.96,"15min":2.8849999999999998},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2749999999999999,"15min":1.5449999999999999},"min":{"1min":0.95699999999999996,"5min":0.874,"15min":0.874},"max":{"1min":1.702,"5min":1.915,"15min":6.032},"last":1.486},{"interface":"front","average":{"1min":1.256,"5min":1.2769999999999999,"15min":1.7250000000000001},"min":{"1min":0.94099999999999995,"5min":0.84399999999999997,"15min":0.77300000000000002},"max":{"1min":1.5980000000000001,"5min":1.774,"15min":10.112},"last":1.528}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3500000000000001,"15min":1.79},"min":{"1min":0.97599999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.677,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.595},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3560000000000001,"15min":1.5469999999999999},"min":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.702,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.4450000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":1098338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75700000000000001,"15min":0.97199999999999998},"min":{"1min":0.48899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.373,"5min":1.5289999999999999,"15min":4.2039999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.99099999999999999},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.874}]},{"osd":2,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":1.119},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2569999999999999,"5min":1.294,"15min":3.7349999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":1.1890000000000001},"min":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.399,"5min":1.623,"15min":3.5640000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.97599999999999998,"15min":1.1679999999999999},"min":{"1min":0.58399999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3009999999999999,"5min":1.917,"15min":4.093},"last":1.401},{"interface":"front","average":{"1min":1.081,"5min":1.129,"15min":1.3879999999999999},"min":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":2.0750000000000002,"15min":4.7439999999999998},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.212,"15min":1.4239999999999999},"min":{"1min":0.99399999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4930000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.228,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4419999999999999,"5min":1.597,"15min":4.5449999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.282,"15min":1.5780000000000001},"min":{"1min":0.85899999999999999,"5min":0.753,"15min":0.753},"max":{"1min":1.52,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.218,"5min":1.256,"15min":1.512},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.675,"15min":3.2290000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2609999999999999,"15min":1.5209999999999999},"min":{"1min":0.93799999999999994,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3899999999999999,"5min":1.714,"15min":4.4569999999999999},"last":1.222},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.319,"15min":1.661},"min":{"1min":0.94499999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4830000000000001,"5min":1.696,"15min":4.8570000000000002},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.333,"15min":1.569},"min":{"1min":0.89700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.6459999999999999,"5min":1.756,"15min":3.056},"last":1.304},{"interface":"front","average":{"1min":1.278,"5min":1.296,"15min":1.587},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":4.5019999999999998},"last":1.3140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:53:38.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:53:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.506+0000 7f1018400700 1 Processor -- start 2024-09-13T18:53:38.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.506+0000 7f1018400700 1 -- start start 2024-09-13T18:53:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1018400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f101006a5d0 0x7f1010071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1018400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10100cd610 0x7f101006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1018400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10100ce140 con 0x7f10100b19f0 2024-09-13T18:53:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1018400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100b1e60 con 0x7f10100cd610 2024-09-13T18:53:38.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1018400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10100cde60 con 0x7f101006a5d0 2024-09-13T18:53:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10100cd610 0x7f101006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10100cd610 0x7f101006ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46488/0 (socket says 172.21.15.81:46488) 2024-09-13T18:53:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 -- 172.21.15.81:0/2455586050 learned_addr learned my addr 172.21.15.81:0/2455586050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1015a00700 1 --2- 172.21.15.81:0/2455586050 >> v2:172.21.15.178:3300/0 conn(0x7f101006a5d0 0x7f1010071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 -- 172.21.15.81:0/2455586050 >> v2:172.21.15.178:3300/0 conn(0x7f101006a5d0 msgr2=0x7f1010071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 --2- 172.21.15.81:0/2455586050 >> v2:172.21.15.178:3300/0 conn(0x7f101006a5d0 0x7f1010071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 -- 172.21.15.81:0/2455586050 >> v1:172.21.15.178:6789/0 conn(0x7f10100b19f0 legacy=0x7f101006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 -- 172.21.15.81:0/2455586050 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101006c3b0 con 0x7f10100cd610 2024-09-13T18:53:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.510+0000 7f1016400700 1 --2- 172.21.15.81:0/2455586050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10100cd610 0x7f101006ce90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f10100cc4e0 tx=0x7f100800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3451538cbfb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f100fe00700 1 -- 172.21.15.81:0/2455586050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800e070 con 0x7f10100cd610 2024-09-13T18:53:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f100fe00700 1 -- 172.21.15.81:0/2455586050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800b910 con 0x7f10100cd610 2024-09-13T18:53:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f100fe00700 1 -- 172.21.15.81:0/2455586050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100800bcc0 con 0x7f10100cd610 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 -- 172.21.15.81:0/2455586050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10100cd610 msgr2=0x7f101006ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 --2- 172.21.15.81:0/2455586050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10100cd610 0x7f101006ce90 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f10100cc4e0 tx=0x7f100800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 -- 172.21.15.81:0/2455586050 shutdown_connections 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 --2- 172.21.15.81:0/2455586050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10100cd610 0x7f101006ce90 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 --2- 172.21.15.81:0/2455586050 >> v2:172.21.15.178:3300/0 conn(0x7f101006a5d0 0x7f1010071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 -- 172.21.15.81:0/2455586050 >> 172.21.15.81:0/2455586050 conn(0x7f10100b08d0 msgr2=0x7f10100b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 -- 172.21.15.81:0/2455586050 shutdown_connections 2024-09-13T18:53:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 -- 172.21.15.81:0/2455586050 wait complete. 2024-09-13T18:53:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.514+0000 7f1018400700 1 Processor -- start 2024-09-13T18:53:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 -- start start 2024-09-13T18:53:38.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 0x7f101013e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100b19f0 0x7f10100b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd610 0x7f10100b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1010145a50 con 0x7f101006a5d0 2024-09-13T18:53:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101451b0 con 0x7f10100b19f0 2024-09-13T18:53:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1010145490 con 0x7f10100cd610 2024-09-13T18:53:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 0x7f101013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 0x7f101013e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46494/0 (socket says 172.21.15.81:46494) 2024-09-13T18:53:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 -- 172.21.15.81:0/378430488 learned_addr learned my addr 172.21.15.81:0/378430488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:38.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1016400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd610 0x7f10100b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:38.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 -- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd610 msgr2=0x7f10100b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015000700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100b19f0 0x7f10100b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd610 0x7f10100b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 -- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100b19f0 msgr2=0x7f10100b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100b19f0 0x7f10100b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 -- 172.21.15.81:0/378430488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009b30 con 0x7f101006a5d0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015000700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100b19f0 0x7f10100b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1015a00700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 0x7f101013e810 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f100400e840 tx=0x7f100400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10040095a0 con 0x7f101006a5d0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100400c690 con 0x7f101006a5d0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1010145770 con 0x7f101006a5d0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100400ca00 con 0x7f101006a5d0 2024-09-13T18:53:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.518+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1010144430 con 0x7f101006a5d0 2024-09-13T18:53:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.522+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1010071d20 con 0x7f101006a5d0 2024-09-13T18:53:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.522+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f100400cb60 con 0x7f101006a5d0 2024-09-13T18:53:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.522+0000 7f100d600700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066730 0x7f0ff0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.526+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1004084320 con 0x7f101006a5d0 2024-09-13T18:53:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.526+0000 7f1015000700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066730 0x7f0ff0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.526+0000 7f1015000700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066730 0x7f0ff0068bf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f101013ed50 tx=0x7f0ffc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.530+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10040514b0 con 0x7f101006a5d0 2024-09-13T18:53:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.722+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f101014afb0 con 0x7f0ff0066730 2024-09-13T18:53:38.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.734+0000 7f100d600700 1 -- 172.21.15.81:0/378430488 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283867 (secure 0 0 0) 0x7f0ffc014420 con 0x7f0ff0066730 2024-09-13T18:53:38.749 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066730 msgr2=0x7f0ff0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066730 0x7f0ff0068bf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f101013ed50 tx=0x7f0ffc009040 comp rx=0 tx=0).stop 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 msgr2=0x7f101013e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 0x7f101013e810 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f100400e840 tx=0x7f100400ec00 comp rx=0 tx=0).stop 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 shutdown_connections 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0ff0066730 0x7f0ff0068bf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10100cd610 0x7f10100b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10100b19f0 0x7f10100b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 --2- 172.21.15.81:0/378430488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f101006a5d0 0x7f101013e810 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 >> 172.21.15.81:0/378430488 conn(0x7f10100b08d0 msgr2=0x7f10100b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 shutdown_connections 2024-09-13T18:53:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.742+0000 7f1018400700 1 -- 172.21.15.81:0/378430488 wait complete. 2024-09-13T18:53:38.755 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:53:38.773 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-13T18:53:37.098022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258792,"kb_used_data":9856,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754715928,"statfs":{"total":773094113280,"available":772829110272,"internally_reserved":0,"allocated":10092544,"data_stored":5257686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.164049"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963924+0000","last_change":"2024-09-13T18:53:32.963924+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963924+0000","last_undegraded":"2024-09-13T18:53:32.963924+0000","last_fullsized":"2024-09-13T18:53:32.963924+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:37.538954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962396+0000","last_change":"2024-09-13T18:53:32.962396+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962396+0000","last_undegraded":"2024-09-13T18:53:32.962396+0000","last_fullsized":"2024-09-13T18:53:32.962396+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.964538+0000","last_change":"2024-09-13T18:53:32.964538+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.964538+0000","last_undegraded":"2024-09-13T18:53:32.964538+0000","last_fullsized":"2024-09-13T18:53:32.964538+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:43.160897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965579+0000","last_change":"2024-09-13T18:53:32.965579+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965579+0000","last_undegraded":"2024-09-13T18:53:32.965579+0000","last_fullsized":"2024-09-13T18:53:32.965579+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965421+0000","last_change":"2024-09-13T18:53:32.965421+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965421+0000","last_undegraded":"2024-09-13T18:53:32.965421+0000","last_fullsized":"2024-09-13T18:53:32.965421+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963942+0000","last_change":"2024-09-13T18:53:32.963942+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963942+0000","last_undegraded":"2024-09-13T18:53:32.963942+0000","last_fullsized":"2024-09-13T18:53:32.963942+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:53.286165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960216+0000","last_change":"2024-09-13T18:53:32.960216+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960216+0000","last_undegraded":"2024-09-13T18:53:32.960216+0000","last_fullsized":"2024-09-13T18:53:32.960216+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963013+0000","last_change":"2024-09-13T18:53:32.963013+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963013+0000","last_undegraded":"2024-09-13T18:53:32.963013+0000","last_fullsized":"2024-09-13T18:53:32.963013+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962334+0000","last_change":"2024-09-13T18:53:32.962334+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962334+0000","last_undegraded":"2024-09-13T18:53:32.962334+0000","last_fullsized":"2024-09-13T18:53:32.962334+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959061+0000","last_change":"2024-09-13T18:53:32.959061+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959061+0000","last_undegraded":"2024-09-13T18:53:32.959061+0000","last_fullsized":"2024-09-13T18:53:32.959061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.346936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.968233+0000","last_change":"2024-09-13T18:53:32.968233+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.968233+0000","last_undegraded":"2024-09-13T18:53:32.968233+0000","last_fullsized":"2024-09-13T18:53:32.968233+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959574+0000","last_change":"2024-09-13T18:53:32.959574+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959574+0000","last_undegraded":"2024-09-13T18:53:32.959574+0000","last_fullsized":"2024-09-13T18:53:32.959574+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958589+0000","last_change":"2024-09-13T18:53:32.958589+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958589+0000","last_undegraded":"2024-09-13T18:53:32.958589+0000","last_fullsized":"2024-09-13T18:53:32.958589+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967599+0000","last_change":"2024-09-13T18:53:32.967599+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967599+0000","last_undegraded":"2024-09-13T18:53:32.967599+0000","last_fullsized":"2024-09-13T18:53:32.967599+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958324+0000","last_change":"2024-09-13T18:53:32.958324+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958324+0000","last_undegraded":"2024-09-13T18:53:32.958324+0000","last_fullsized":"2024-09-13T18:53:32.958324+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960023+0000","last_change":"2024-09-13T18:53:32.960023+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960023+0000","last_undegraded":"2024-09-13T18:53:32.960023+0000","last_fullsized":"2024-09-13T18:53:32.960023+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:39.591604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962631+0000","last_change":"2024-09-13T18:53:32.962631+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962631+0000","last_undegraded":"2024-09-13T18:53:32.962631+0000","last_fullsized":"2024-09-13T18:53:32.962631+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.445067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.966390+0000","last_change":"2024-09-13T18:53:32.966390+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.966390+0000","last_undegraded":"2024-09-13T18:53:32.966390+0000","last_fullsized":"2024-09-13T18:53:32.966390+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:11.980134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965178+0000","last_change":"2024-09-13T18:53:32.965178+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965178+0000","last_undegraded":"2024-09-13T18:53:32.965178+0000","last_fullsized":"2024-09-13T18:53:32.965178+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960846+0000","last_change":"2024-09-13T18:53:32.960846+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960846+0000","last_undegraded":"2024-09-13T18:53:32.960846+0000","last_fullsized":"2024-09-13T18:53:32.960846+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965964+0000","last_change":"2024-09-13T18:53:32.965964+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965964+0000","last_undegraded":"2024-09-13T18:53:32.965964+0000","last_fullsized":"2024-09-13T18:53:32.965964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967143+0000","last_change":"2024-09-13T18:53:32.967143+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967143+0000","last_undegraded":"2024-09-13T18:53:32.967143+0000","last_fullsized":"2024-09-13T18:53:32.967143+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957095+0000","last_change":"2024-09-13T18:53:32.957095+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957095+0000","last_undegraded":"2024-09-13T18:53:32.957095+0000","last_fullsized":"2024-09-13T18:53:32.957095+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962964+0000","last_change":"2024-09-13T18:53:32.962964+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962964+0000","last_undegraded":"2024-09-13T18:53:32.962964+0000","last_fullsized":"2024-09-13T18:53:32.962964+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:30.589532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962046+0000","last_change":"2024-09-13T18:53:32.962046+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962046+0000","last_undegraded":"2024-09-13T18:53:32.962046+0000","last_fullsized":"2024-09-13T18:53:32.962046+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.969322+0000","last_change":"2024-09-13T18:53:32.969322+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.969322+0000","last_undegraded":"2024-09-13T18:53:32.969322+0000","last_fullsized":"2024-09-13T18:53:32.969322+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959093+0000","last_change":"2024-09-13T18:53:32.959093+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959093+0000","last_undegraded":"2024-09-13T18:53:32.959093+0000","last_fullsized":"2024-09-13T18:53:32.959093+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:34.977610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959992+0000","last_change":"2024-09-13T18:53:32.959992+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959992+0000","last_undegraded":"2024-09-13T18:53:32.959992+0000","last_fullsized":"2024-09-13T18:53:32.959992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961472+0000","last_change":"2024-09-13T18:53:32.961472+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961472+0000","last_undegraded":"2024-09-13T18:53:32.961472+0000","last_fullsized":"2024-09-13T18:53:32.961472+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.966709+0000","last_change":"2024-09-13T18:53:32.966709+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.966709+0000","last_undegraded":"2024-09-13T18:53:32.966709+0000","last_fullsized":"2024-09-13T18:53:32.966709+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963679+0000","last_change":"2024-09-13T18:53:32.963679+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963679+0000","last_undegraded":"2024-09-13T18:53:32.963679+0000","last_fullsized":"2024-09-13T18:53:32.963679+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959635+0000","last_change":"2024-09-13T18:53:32.959635+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959635+0000","last_undegraded":"2024-09-13T18:53:32.959635+0000","last_fullsized":"2024-09-13T18:53:32.959635+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:51.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961057+0000","last_change":"2024-09-13T18:53:32.961057+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961057+0000","last_undegraded":"2024-09-13T18:53:32.961057+0000","last_fullsized":"2024-09-13T18:53:32.961057+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:25.336257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976843+0000","last_change":"2024-09-13T18:53:32.974455+0000","last_active":"2024-09-13T18:53:32.976843+0000","last_peered":"2024-09-13T18:53:32.976843+0000","last_clean":"2024-09-13T18:53:32.976843+0000","last_became_active":"2024-09-13T18:53:32.974185+0000","last_became_peered":"2024-09-13T18:53:32.974185+0000","last_unstale":"2024-09-13T18:53:32.976843+0000","last_undegraded":"2024-09-13T18:53:32.976843+0000","last_fullsized":"2024-09-13T18:53:32.976843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:13.889692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956672+0000","last_change":"2024-09-13T18:53:32.956672+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956672+0000","last_undegraded":"2024-09-13T18:53:32.956672+0000","last_fullsized":"2024-09-13T18:53:32.956672+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:59.976141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976558+0000","last_change":"2024-09-13T18:53:32.974168+0000","last_active":"2024-09-13T18:53:32.976558+0000","last_peered":"2024-09-13T18:53:32.976558+0000","last_clean":"2024-09-13T18:53:32.976558+0000","last_became_active":"2024-09-13T18:53:32.973823+0000","last_became_peered":"2024-09-13T18:53:32.973823+0000","last_unstale":"2024-09-13T18:53:32.976558+0000","last_undegraded":"2024-09-13T18:53:32.976558+0000","last_fullsized":"2024-09-13T18:53:32.976558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:53.038961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960698+0000","last_change":"2024-09-13T18:53:32.960698+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960698+0000","last_undegraded":"2024-09-13T18:53:32.960698+0000","last_fullsized":"2024-09-13T18:53:32.960698+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.983091+0000","last_change":"2024-09-13T18:53:32.982524+0000","last_active":"2024-09-13T18:53:32.983091+0000","last_peered":"2024-09-13T18:53:32.983091+0000","last_clean":"2024-09-13T18:53:32.983091+0000","last_became_active":"2024-09-13T18:53:32.982071+0000","last_became_peered":"2024-09-13T18:53:32.982071+0000","last_unstale":"2024-09-13T18:53:32.983091+0000","last_undegraded":"2024-09-13T18:53:32.983091+0000","last_fullsized":"2024-09-13T18:53:32.983091+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955886+0000","last_change":"2024-09-13T18:53:32.955886+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955886+0000","last_undegraded":"2024-09-13T18:53:32.955886+0000","last_fullsized":"2024-09-13T18:53:32.955886+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:27.303458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973282+0000","last_change":"2024-09-13T18:53:32.969226+0000","last_active":"2024-09-13T18:53:32.973282+0000","last_peered":"2024-09-13T18:53:32.973282+0000","last_clean":"2024-09-13T18:53:32.973282+0000","last_became_active":"2024-09-13T18:53:32.968542+0000","last_became_peered":"2024-09-13T18:53:32.968542+0000","last_unstale":"2024-09-13T18:53:32.973282+0000","last_undegraded":"2024-09-13T18:53:32.973282+0000","last_fullsized":"2024-09-13T18:53:32.973282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957253+0000","last_change":"2024-09-13T18:53:32.957253+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957253+0000","last_undegraded":"2024-09-13T18:53:32.957253+0000","last_fullsized":"2024-09-13T18:53:32.957253+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981074+0000","last_change":"2024-09-13T18:53:32.979540+0000","last_active":"2024-09-13T18:53:32.981074+0000","last_peered":"2024-09-13T18:53:32.981074+0000","last_clean":"2024-09-13T18:53:32.981074+0000","last_became_active":"2024-09-13T18:53:32.979212+0000","last_became_peered":"2024-09-13T18:53:32.979212+0000","last_unstale":"2024-09-13T18:53:32.981074+0000","last_undegraded":"2024-09-13T18:53:32.981074+0000","last_fullsized":"2024-09-13T18:53:32.981074+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:53.373570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955916+0000","last_change":"2024-09-13T18:53:32.955916+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955916+0000","last_undegraded":"2024-09-13T18:53:32.955916+0000","last_fullsized":"2024-09-13T18:53:32.955916+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981520+0000","last_change":"2024-09-13T18:53:32.975163+0000","last_active":"2024-09-13T18:53:32.981520+0000","last_peered":"2024-09-13T18:53:32.981520+0000","last_clean":"2024-09-13T18:53:32.981520+0000","last_became_active":"2024-09-13T18:53:32.974855+0000","last_became_peered":"2024-09-13T18:53:32.974855+0000","last_unstale":"2024-09-13T18:53:32.981520+0000","last_undegraded":"2024-09-13T18:53:32.981520+0000","last_fullsized":"2024-09-13T18:53:32.981520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962140+0000","last_change":"2024-09-13T18:53:32.962140+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962140+0000","last_undegraded":"2024-09-13T18:53:32.962140+0000","last_fullsized":"2024-09-13T18:53:32.962140+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:05.116179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978912+0000","last_change":"2024-09-13T18:53:32.974717+0000","last_active":"2024-09-13T18:53:32.978912+0000","last_peered":"2024-09-13T18:53:32.978912+0000","last_clean":"2024-09-13T18:53:32.978912+0000","last_became_active":"2024-09-13T18:53:32.974438+0000","last_became_peered":"2024-09-13T18:53:32.974438+0000","last_unstale":"2024-09-13T18:53:32.978912+0000","last_undegraded":"2024-09-13T18:53:32.978912+0000","last_fullsized":"2024-09-13T18:53:32.978912+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:58.112314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.958144+0000","last_change":"2024-09-13T18:53:32.958144+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.958144+0000","last_undegraded":"2024-09-13T18:53:32.958144+0000","last_fullsized":"2024-09-13T18:53:32.958144+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:30.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980683+0000","last_change":"2024-09-13T18:53:32.977072+0000","last_active":"2024-09-13T18:53:32.980683+0000","last_peered":"2024-09-13T18:53:32.980683+0000","last_clean":"2024-09-13T18:53:32.980683+0000","last_became_active":"2024-09-13T18:53:32.974368+0000","last_became_peered":"2024-09-13T18:53:32.974368+0000","last_unstale":"2024-09-13T18:53:32.980683+0000","last_undegraded":"2024-09-13T18:53:32.980683+0000","last_fullsized":"2024-09-13T18:53:32.980683+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.967583+0000","last_change":"2024-09-13T18:53:32.967583+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.967583+0000","last_undegraded":"2024-09-13T18:53:32.967583+0000","last_fullsized":"2024-09-13T18:53:32.967583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978504+0000","last_change":"2024-09-13T18:53:32.971936+0000","last_active":"2024-09-13T18:53:32.978504+0000","last_peered":"2024-09-13T18:53:32.978504+0000","last_clean":"2024-09-13T18:53:32.978504+0000","last_became_active":"2024-09-13T18:53:32.971646+0000","last_became_peered":"2024-09-13T18:53:32.971646+0000","last_unstale":"2024-09-13T18:53:32.978504+0000","last_undegraded":"2024-09-13T18:53:32.978504+0000","last_fullsized":"2024-09-13T18:53:32.978504+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961391+0000","last_change":"2024-09-13T18:53:32.961391+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961391+0000","last_undegraded":"2024-09-13T18:53:32.961391+0000","last_fullsized":"2024-09-13T18:53:32.961391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978108+0000","last_change":"2024-09-13T18:53:32.975559+0000","last_active":"2024-09-13T18:53:32.978108+0000","last_peered":"2024-09-13T18:53:32.978108+0000","last_clean":"2024-09-13T18:53:32.978108+0000","last_became_active":"2024-09-13T18:53:32.975226+0000","last_became_peered":"2024-09-13T18:53:32.975226+0000","last_unstale":"2024-09-13T18:53:32.978108+0000","last_undegraded":"2024-09-13T18:53:32.978108+0000","last_fullsized":"2024-09-13T18:53:32.978108+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.754508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965971+0000","last_change":"2024-09-13T18:53:32.965971+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965971+0000","last_undegraded":"2024-09-13T18:53:32.965971+0000","last_fullsized":"2024-09-13T18:53:32.965971+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:46.856863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981028+0000","last_change":"2024-09-13T18:53:32.979461+0000","last_active":"2024-09-13T18:53:32.981028+0000","last_peered":"2024-09-13T18:53:32.981028+0000","last_clean":"2024-09-13T18:53:32.981028+0000","last_became_active":"2024-09-13T18:53:32.978929+0000","last_became_peered":"2024-09-13T18:53:32.978929+0000","last_unstale":"2024-09-13T18:53:32.981028+0000","last_undegraded":"2024-09-13T18:53:32.981028+0000","last_fullsized":"2024-09-13T18:53:32.981028+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:54.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957615+0000","last_change":"2024-09-13T18:53:32.957615+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957615+0000","last_undegraded":"2024-09-13T18:53:32.957615+0000","last_fullsized":"2024-09-13T18:53:32.957615+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.968130+0000","last_change":"2024-09-13T18:53:32.962678+0000","last_active":"2024-09-13T18:53:32.968130+0000","last_peered":"2024-09-13T18:53:32.968130+0000","last_clean":"2024-09-13T18:53:32.968130+0000","last_became_active":"2024-09-13T18:53:32.962353+0000","last_became_peered":"2024-09-13T18:53:32.962353+0000","last_unstale":"2024-09-13T18:53:32.968130+0000","last_undegraded":"2024-09-13T18:53:32.968130+0000","last_fullsized":"2024-09-13T18:53:32.968130+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:21.019937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956705+0000","last_change":"2024-09-13T18:53:32.956705+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956705+0000","last_undegraded":"2024-09-13T18:53:32.956705+0000","last_fullsized":"2024-09-13T18:53:32.956705+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980625+0000","last_change":"2024-09-13T18:53:32.977043+0000","last_active":"2024-09-13T18:53:32.980625+0000","last_peered":"2024-09-13T18:53:32.980625+0000","last_clean":"2024-09-13T18:53:32.980625+0000","last_became_active":"2024-09-13T18:53:32.974269+0000","last_became_peered":"2024-09-13T18:53:32.974269+0000","last_unstale":"2024-09-13T18:53:32.980625+0000","last_undegraded":"2024-09-13T18:53:32.980625+0000","last_fullsized":"2024-09-13T18:53:32.980625+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965539+0000","last_change":"2024-09-13T18:53:32.965539+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965539+0000","last_undegraded":"2024-09-13T18:53:32.965539+0000","last_fullsized":"2024-09-13T18:53:32.965539+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973418+0000","last_change":"2024-09-13T18:53:32.968390+0000","last_active":"2024-09-13T18:53:32.973418+0000","last_peered":"2024-09-13T18:53:32.973418+0000","last_clean":"2024-09-13T18:53:32.973418+0000","last_became_active":"2024-09-13T18:53:32.968173+0000","last_became_peered":"2024-09-13T18:53:32.968173+0000","last_unstale":"2024-09-13T18:53:32.973418+0000","last_undegraded":"2024-09-13T18:53:32.973418+0000","last_fullsized":"2024-09-13T18:53:32.973418+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:16.066340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.957979+0000","last_change":"2024-09-13T18:53:32.957979+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.957979+0000","last_undegraded":"2024-09-13T18:53:32.957979+0000","last_fullsized":"2024-09-13T18:53:32.957979+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:00.853298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.982247+0000","last_change":"2024-09-13T18:53:32.978943+0000","last_active":"2024-09-13T18:53:32.982247+0000","last_peered":"2024-09-13T18:53:32.982247+0000","last_clean":"2024-09-13T18:53:32.982247+0000","last_became_active":"2024-09-13T18:53:32.978004+0000","last_became_peered":"2024-09-13T18:53:32.978004+0000","last_unstale":"2024-09-13T18:53:32.982247+0000","last_undegraded":"2024-09-13T18:53:32.982247+0000","last_fullsized":"2024-09-13T18:53:32.982247+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.959358+0000","last_change":"2024-09-13T18:53:32.959358+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.959358+0000","last_undegraded":"2024-09-13T18:53:32.959358+0000","last_fullsized":"2024-09-13T18:53:32.959358+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:35.073791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.979214+0000","last_change":"2024-09-13T18:53:32.972297+0000","last_active":"2024-09-13T18:53:32.979214+0000","last_peered":"2024-09-13T18:53:32.979214+0000","last_clean":"2024-09-13T18:53:32.979214+0000","last_became_active":"2024-09-13T18:53:32.972040+0000","last_became_peered":"2024-09-13T18:53:32.972040+0000","last_unstale":"2024-09-13T18:53:32.979214+0000","last_undegraded":"2024-09-13T18:53:32.979214+0000","last_fullsized":"2024-09-13T18:53:32.979214+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955754+0000","last_change":"2024-09-13T18:53:32.955754+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955754+0000","last_undegraded":"2024-09-13T18:53:32.955754+0000","last_fullsized":"2024-09-13T18:53:32.955754+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:00.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.972772+0000","last_change":"2024-09-13T18:53:32.966972+0000","last_active":"2024-09-13T18:53:32.972772+0000","last_peered":"2024-09-13T18:53:32.972772+0000","last_clean":"2024-09-13T18:53:32.972772+0000","last_became_active":"2024-09-13T18:53:32.966526+0000","last_became_peered":"2024-09-13T18:53:32.966526+0000","last_unstale":"2024-09-13T18:53:32.972772+0000","last_undegraded":"2024-09-13T18:53:32.972772+0000","last_fullsized":"2024-09-13T18:53:32.972772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:58.976298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956061+0000","last_change":"2024-09-13T18:53:32.956061+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956061+0000","last_undegraded":"2024-09-13T18:53:32.956061+0000","last_fullsized":"2024-09-13T18:53:32.956061+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980687+0000","last_change":"2024-09-13T18:53:32.976908+0000","last_active":"2024-09-13T18:53:32.980687+0000","last_peered":"2024-09-13T18:53:32.980687+0000","last_clean":"2024-09-13T18:53:32.980687+0000","last_became_active":"2024-09-13T18:53:32.976653+0000","last_became_peered":"2024-09-13T18:53:32.976653+0000","last_unstale":"2024-09-13T18:53:32.980687+0000","last_undegraded":"2024-09-13T18:53:32.980687+0000","last_fullsized":"2024-09-13T18:53:32.980687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.968175+0000","last_change":"2024-09-13T18:53:32.968175+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.968175+0000","last_undegraded":"2024-09-13T18:53:32.968175+0000","last_fullsized":"2024-09-13T18:53:32.968175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980273+0000","last_change":"2024-09-13T18:53:32.976609+0000","last_active":"2024-09-13T18:53:32.980273+0000","last_peered":"2024-09-13T18:53:32.980273+0000","last_clean":"2024-09-13T18:53:32.980273+0000","last_became_active":"2024-09-13T18:53:32.976333+0000","last_became_peered":"2024-09-13T18:53:32.976333+0000","last_unstale":"2024-09-13T18:53:32.980273+0000","last_undegraded":"2024-09-13T18:53:32.980273+0000","last_fullsized":"2024-09-13T18:53:32.980273+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:53.755995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955379+0000","last_change":"2024-09-13T18:53:32.955379+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955379+0000","last_undegraded":"2024-09-13T18:53:32.955379+0000","last_fullsized":"2024-09-13T18:53:32.955379+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:18.970121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980839+0000","last_change":"2024-09-13T18:53:32.976670+0000","last_active":"2024-09-13T18:53:32.980839+0000","last_peered":"2024-09-13T18:53:32.980839+0000","last_clean":"2024-09-13T18:53:32.980839+0000","last_became_active":"2024-09-13T18:53:32.976354+0000","last_became_peered":"2024-09-13T18:53:32.976354+0000","last_unstale":"2024-09-13T18:53:32.980839+0000","last_undegraded":"2024-09-13T18:53:32.980839+0000","last_fullsized":"2024-09-13T18:53:32.980839+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.962938+0000","last_change":"2024-09-13T18:53:32.962938+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.962938+0000","last_undegraded":"2024-09-13T18:53:32.962938+0000","last_fullsized":"2024-09-13T18:53:32.962938+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.971731+0000","last_change":"2024-09-13T18:53:32.966984+0000","last_active":"2024-09-13T18:53:32.971731+0000","last_peered":"2024-09-13T18:53:32.971731+0000","last_clean":"2024-09-13T18:53:32.971731+0000","last_became_active":"2024-09-13T18:53:32.966665+0000","last_became_peered":"2024-09-13T18:53:32.966665+0000","last_unstale":"2024-09-13T18:53:32.971731+0000","last_undegraded":"2024-09-13T18:53:32.971731+0000","last_fullsized":"2024-09-13T18:53:32.971731+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.908915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961094+0000","last_change":"2024-09-13T18:53:32.961094+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961094+0000","last_undegraded":"2024-09-13T18:53:32.961094+0000","last_fullsized":"2024-09-13T18:53:32.961094+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981412+0000","last_change":"2024-09-13T18:53:32.977136+0000","last_active":"2024-09-13T18:53:32.981412+0000","last_peered":"2024-09-13T18:53:32.981412+0000","last_clean":"2024-09-13T18:53:32.981412+0000","last_became_active":"2024-09-13T18:53:32.974769+0000","last_became_peered":"2024-09-13T18:53:32.974769+0000","last_unstale":"2024-09-13T18:53:32.981412+0000","last_undegraded":"2024-09-13T18:53:32.981412+0000","last_fullsized":"2024-09-13T18:53:32.981412+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.960960+0000","last_change":"2024-09-13T18:53:32.960960+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.960960+0000","last_undegraded":"2024-09-13T18:53:32.960960+0000","last_fullsized":"2024-09-13T18:53:32.960960+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:59.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.978684+0000","last_change":"2024-09-13T18:53:32.973495+0000","last_active":"2024-09-13T18:53:32.978684+0000","last_peered":"2024-09-13T18:53:32.978684+0000","last_clean":"2024-09-13T18:53:32.978684+0000","last_became_active":"2024-09-13T18:53:32.973173+0000","last_became_peered":"2024-09-13T18:53:32.973173+0000","last_unstale":"2024-09-13T18:53:32.978684+0000","last_undegraded":"2024-09-13T18:53:32.978684+0000","last_fullsized":"2024-09-13T18:53:32.978684+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:11.941564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956438+0000","last_change":"2024-09-13T18:53:32.956438+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956438+0000","last_undegraded":"2024-09-13T18:53:32.956438+0000","last_fullsized":"2024-09-13T18:53:32.956438+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.976435+0000","last_change":"2024-09-13T18:53:32.975551+0000","last_active":"2024-09-13T18:53:32.976435+0000","last_peered":"2024-09-13T18:53:32.976435+0000","last_clean":"2024-09-13T18:53:32.976435+0000","last_became_active":"2024-09-13T18:53:32.973976+0000","last_became_peered":"2024-09-13T18:53:32.973976+0000","last_unstale":"2024-09-13T18:53:32.976435+0000","last_undegraded":"2024-09-13T18:53:32.976435+0000","last_fullsized":"2024-09-13T18:53:32.976435+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955079+0000","last_change":"2024-09-13T18:53:32.955079+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955079+0000","last_undegraded":"2024-09-13T18:53:32.955079+0000","last_fullsized":"2024-09-13T18:53:32.955079+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:32.417668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980975+0000","last_change":"2024-09-13T18:53:32.978157+0000","last_active":"2024-09-13T18:53:32.980975+0000","last_peered":"2024-09-13T18:53:32.980975+0000","last_clean":"2024-09-13T18:53:32.980975+0000","last_became_active":"2024-09-13T18:53:32.977850+0000","last_became_peered":"2024-09-13T18:53:32.977850+0000","last_unstale":"2024-09-13T18:53:32.980975+0000","last_undegraded":"2024-09-13T18:53:32.980975+0000","last_fullsized":"2024-09-13T18:53:32.980975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:07.000712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955530+0000","last_change":"2024-09-13T18:53:32.955530+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955530+0000","last_undegraded":"2024-09-13T18:53:32.955530+0000","last_fullsized":"2024-09-13T18:53:32.955530+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980952+0000","last_change":"2024-09-13T18:53:32.977923+0000","last_active":"2024-09-13T18:53:32.980952+0000","last_peered":"2024-09-13T18:53:32.980952+0000","last_clean":"2024-09-13T18:53:32.980952+0000","last_became_active":"2024-09-13T18:53:32.977485+0000","last_became_peered":"2024-09-13T18:53:32.977485+0000","last_unstale":"2024-09-13T18:53:32.980952+0000","last_undegraded":"2024-09-13T18:53:32.980952+0000","last_fullsized":"2024-09-13T18:53:32.980952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.319921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.961601+0000","last_change":"2024-09-13T18:53:32.961601+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.961601+0000","last_undegraded":"2024-09-13T18:53:32.961601+0000","last_fullsized":"2024-09-13T18:53:32.961601+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.973160+0000","last_change":"2024-09-13T18:53:32.969065+0000","last_active":"2024-09-13T18:53:32.973160+0000","last_peered":"2024-09-13T18:53:32.973160+0000","last_clean":"2024-09-13T18:53:32.973160+0000","last_became_active":"2024-09-13T18:53:32.968189+0000","last_became_peered":"2024-09-13T18:53:32.968189+0000","last_unstale":"2024-09-13T18:53:32.973160+0000","last_undegraded":"2024-09-13T18:53:32.973160+0000","last_fullsized":"2024-09-13T18:53:32.973160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956903+0000","last_change":"2024-09-13T18:53:32.956903+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956903+0000","last_undegraded":"2024-09-13T18:53:32.956903+0000","last_fullsized":"2024-09-13T18:53:32.956903+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:29.365964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.975858+0000","last_change":"2024-09-13T18:53:32.971783+0000","last_active":"2024-09-13T18:53:32.975858+0000","last_peered":"2024-09-13T18:53:32.975858+0000","last_clean":"2024-09-13T18:53:32.975858+0000","last_became_active":"2024-09-13T18:53:32.971544+0000","last_became_peered":"2024-09-13T18:53:32.971544+0000","last_unstale":"2024-09-13T18:53:32.975858+0000","last_undegraded":"2024-09-13T18:53:32.975858+0000","last_fullsized":"2024-09-13T18:53:32.975858+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:19.672579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.965568+0000","last_change":"2024-09-13T18:53:32.965568+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.965568+0000","last_undegraded":"2024-09-13T18:53:32.965568+0000","last_fullsized":"2024-09-13T18:53:32.965568+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:25.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.981420+0000","last_change":"2024-09-13T18:53:32.979624+0000","last_active":"2024-09-13T18:53:32.981420+0000","last_peered":"2024-09-13T18:53:32.981420+0000","last_clean":"2024-09-13T18:53:32.981420+0000","last_became_active":"2024-09-13T18:53:32.979380+0000","last_became_peered":"2024-09-13T18:53:32.979380+0000","last_unstale":"2024-09-13T18:53:32.981420+0000","last_undegraded":"2024-09-13T18:53:32.981420+0000","last_fullsized":"2024-09-13T18:53:32.981420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.955789+0000","last_change":"2024-09-13T18:53:32.955789+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.955789+0000","last_undegraded":"2024-09-13T18:53:32.955789+0000","last_fullsized":"2024-09-13T18:53:32.955789+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.974169+0000","last_change":"2024-09-13T18:53:32.971426+0000","last_active":"2024-09-13T18:53:32.974169+0000","last_peered":"2024-09-13T18:53:32.974169+0000","last_clean":"2024-09-13T18:53:32.974169+0000","last_became_active":"2024-09-13T18:53:32.971188+0000","last_became_peered":"2024-09-13T18:53:32.971188+0000","last_unstale":"2024-09-13T18:53:32.974169+0000","last_undegraded":"2024-09-13T18:53:32.974169+0000","last_fullsized":"2024-09-13T18:53:32.974169+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:48.187135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.956210+0000","last_change":"2024-09-13T18:53:32.956210+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.956210+0000","last_undegraded":"2024-09-13T18:53:32.956210+0000","last_fullsized":"2024-09-13T18:53:32.956210+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:02.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.980701+0000","last_change":"2024-09-13T18:53:32.977404+0000","last_active":"2024-09-13T18:53:32.980701+0000","last_peered":"2024-09-13T18:53:32.980701+0000","last_clean":"2024-09-13T18:53:32.980701+0000","last_became_active":"2024-09-13T18:53:32.977089+0000","last_became_peered":"2024-09-13T18:53:32.977089+0000","last_unstale":"2024-09-13T18:53:32.980701+0000","last_undegraded":"2024-09-13T18:53:32.980701+0000","last_fullsized":"2024-09-13T18:53:32.980701+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":91,"state":"creating+peering","last_fresh":"2024-09-13T18:53:32.963992+0000","last_change":"2024-09-13T18:53:32.963992+0000","last_active":"2024-09-13T18:53:32.934243+0000","last_peered":"2024-09-13T18:53:32.934243+0000","last_clean":"2024-09-13T18:53:32.934243+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:53:32.963992+0000","last_undegraded":"2024-09-13T18:53:32.963992+0000","last_fullsized":"2024-09-13T18:53:32.963992+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:53:32.982205+0000","last_change":"2024-09-13T18:53:32.978373+0000","last_active":"2024-09-13T18:53:32.982205+0000","last_peered":"2024-09-13T18:53:32.982205+0000","last_clean":"2024-09-13T18:53:32.982205+0000","last_became_active":"2024-09-13T18:53:32.977238+0000","last_became_peered":"2024-09-13T18:53:32.977238+0000","last_unstale":"2024-09-13T18:53:32.982205+0000","last_undegraded":"2024-09-13T18:53:32.982205+0000","last_fullsized":"2024-09-13T18:53:32.982205+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:39.620579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":223,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:53:31.947462+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:53:31.947462+0000","last_peered":"2024-09-13T18:53:31.947462+0000","last_clean":"2024-09-13T18:53:31.947462+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:53:31.947462+0000","last_undegraded":"2024-09-13T18:53:31.947462+0000","last_fullsized":"2024-09-13T18:53:31.947462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":1098338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.415,"5min":1.72,"15min":1.72},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.524,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.1419999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.117,"15min":1.137},"min":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.589},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.208},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.252}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.79200000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.605,"5min":1.885,"15min":1.885},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.1890000000000001,"15min":1.206},"min":{"1min":0.97199999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.335}]},{"osd":3,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2649999999999999,"15min":1.2749999999999999},"min":{"1min":0.94799999999999995,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.5640000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.413},{"interface":"front","average":{"1min":1.391,"5min":1.327,"15min":1.427},"min":{"1min":0.96399999999999997,"5min":0.90900000000000003,"15min":0.81999999999999995},"max":{"1min":1.669,"5min":1.861,"15min":2.2610000000000001},"last":1.538}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.111},"min":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.226,"5min":1.22,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.66700000000000004,"15min":0.63700000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.1020000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.3080000000000001},"min":{"1min":0.87,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.522,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.212,"5min":1.208,"15min":1.2230000000000001},"min":{"1min":0.79000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1830000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.375,"15min":1.399},"min":{"1min":1.0629999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.47},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.371,"15min":1.413},"min":{"1min":0.95399999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6279999999999999,"5min":1.845,"15min":1.845},"last":1.71}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1122304,"data_stored":514565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0860000000000001,"15min":1.1339999999999999},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.619,"5min":1.8169999999999999,"15min":3.0369999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.133,"5min":1.099,"15min":1.161},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5529999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.4890000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.155,"15min":1.1919999999999999},"min":{"1min":0.90200000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.4950000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.169,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":1.675,"15min":3.7480000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1859999999999999,"15min":1.4399999999999999},"min":{"1min":0.82699999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.4099999999999999,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.4790000000000001},"min":{"1min":0.97999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6339999999999999,"5min":1.7230000000000001,"15min":4.883},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2669999999999999,"15min":1.4910000000000001},"min":{"1min":0.89200000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":4.8630000000000004},"last":1.325}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.288},"min":{"1min":0.76600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.526,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5589999999999999,"5min":1.796,"15min":2.077},"last":1.375}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.395},"min":{"1min":0.81899999999999995,"5min":0.755,"15min":0.755},"max":{"1min":1.456,"5min":1.764,"15min":2.1699999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.389,"15min":1.4670000000000001},"min":{"1min":0.97299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5860000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.5}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.4510000000000001},"min":{"1min":1.0049999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.611},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.361,"15min":1.5049999999999999},"min":{"1min":1.0640000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.367},"last":1.5169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1122304,"data_stored":514565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0569999999999999,"15min":1.177},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.125,"15min":1.155},"min":{"1min":0.90300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":2.278},"last":1.1599999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.2549999999999999},"min":{"1min":0.79700000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.476,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.111},{"interface":"front","average":{"1min":1.097,"5min":1.119,"15min":1.1799999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.532,"5min":1.5649999999999999,"15min":2.1040000000000001},"last":1.512}]},{"osd":2,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1910000000000001,"15min":1.274},"min":{"1min":0.76700000000000002,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.619,"5min":1.7470000000000001,"15min":1.9059999999999999},"last":1.399},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.157},"last":0.99099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.25,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.749},"max":{"1min":1.5660000000000001,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.4179999999999999},"min":{"1min":0.90600000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":2.9470000000000001},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1100000000000001,"15min":1.2030000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5109999999999999,"5min":1.579,"15min":1.8500000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2669999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4990000000000001,"5min":1.742,"15min":1.974},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2909999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.536,"5min":1.669,"15min":2.0219999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.694,"5min":1.694,"15min":2.1739999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":1.0580000000000001,"5min":0.87,"15min":0.81699999999999995},"max":{"1min":1.6499999999999999,"5min":1.7649999999999999,"15min":2.169},"last":1.323},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.5},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.641,"5min":1.804,"15min":2.8140000000000001},"last":1.5569999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.002},{"interface":"front","average":{"1min":1.121,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.77200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.518,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2949999999999999,"15min":1.351},"min":{"1min":0.77000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6539999999999999,"5min":1.6739999999999999,"15min":2.6930000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.3169999999999999},"min":{"1min":0.73799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4970000000000001,"5min":1.806,"15min":2.423},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2190000000000001,"15min":1.28},"min":{"1min":0.94999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.99},"last":1.589},{"interface":"front","average":{"1min":1.266,"5min":1.3,"15min":1.371},"min":{"1min":0.82699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":2.335},"last":1.218}]},{"osd":3,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2010000000000001,"15min":1.2989999999999999},"min":{"1min":0.82199999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":2.621},"last":1.24},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1839999999999999,"15min":1.2569999999999999},"min":{"1min":0.91000000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.302,"5min":1.5669999999999999,"15min":1.8640000000000001},"last":1.4470000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.153,"15min":1.284},"min":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":2.274},"last":1.129},{"interface":"front","average":{"1min":1.196,"5min":1.2230000000000001,"15min":1.304},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.988,"5min":1.988,"15min":2.266},"last":1.4910000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2070000000000001,"15min":1.333},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5189999999999999,"5min":2.319,"15min":2.4710000000000001},"last":1.6859999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3480000000000001,"15min":1.444},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5720000000000001,"5min":1.851,"15min":2.5},"last":1.2969999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.351,"15min":1.446},"min":{"1min":0.72399999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.395},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.355,"15min":1.454},"min":{"1min":1.0429999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9059999999999999,"5min":2.415,"15min":2.415},"last":1.7490000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.88600000000000001},"min":{"1min":0.48799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0800000000000001,"5min":1.331,"15min":1.4510000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.879},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0589999999999999,"5min":1.444,"15min":1.444},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3500000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.069},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94899999999999995,"15min":1.0880000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.464,"15min":4.0149999999999997},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.004,"15min":1.002},"min":{"1min":0.71599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.319,"5min":1.611,"15min":1.611},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.161},"min":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.536,"5min":1.569,"15min":2.4729999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.179,"15min":1.2370000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1519999999999999,"15min":1.226},"min":{"1min":0.82299999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.8220000000000001},"last":1.1559999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2170000000000001,"15min":1.3049999999999999},"min":{"1min":0.94799999999999995,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.4850000000000001,"5min":1.855,"15min":2.0099999999999998},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2789999999999999,"15min":1.365},"min":{"1min":0.85099999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6000000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":0.97699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3089999999999999,"15min":1.413},"min":{"1min":0.875,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.49,"5min":1.9239999999999999,"15min":2.714},"last":1.339},{"interface":"front","average":{"1min":1.222,"5min":1.278,"15min":1.4039999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7270000000000001,"5min":1.8520000000000001,"15min":2.52},"last":1.119}]},{"osd":7,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3049999999999999,"15min":1.4890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7789999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.302,"15min":1.4199999999999999},"min":{"1min":1.0029999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5580000000000001,"5min":1.946,"15min":1.9810000000000001},"last":1.1040000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77500000000000002,"15min":0.95699999999999996},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1000000000000001,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80900000000000005,"15min":1.0209999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.54,"5min":1.54,"15min":4.6349999999999998},"last":0.92700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.84399999999999997,"15min":1.1000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1990000000000001,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.762,"5min":1.762,"15min":4.7009999999999996},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.117,"15min":1.294},"min":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5329999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":1.04},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.202},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.339,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.878}]},{"osd":4,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.204,"15min":1.5980000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":8.6989999999999998},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.224,"15min":1.4219999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.383,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":0.998}]},{"osd":5,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2809999999999999,"15min":1.484},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6319999999999999,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.24,"15min":1.46},"min":{"1min":0.88600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5649999999999999,"5min":1.7370000000000001,"15min":4.335},"last":0.90600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.5089999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.5569999999999999,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.2450000000000001,"15min":1.696},"min":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":1.6319999999999999,"15min":8.6300000000000008},"last":1.304}]},{"osd":7,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3200000000000001,"15min":1.5329999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.137},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.355,"15min":1.589},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":4.4050000000000002},"last":1.0880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":507970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.86799999999999999},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0309999999999999,"5min":1.385,"15min":2.2170000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":1.026},"min":{"1min":0.61699999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.036,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.169},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.46,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":1.0589999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5589999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.86199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1080000000000001,"15min":1.294},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4550000000000001,"5min":1.637,"15min":6.0919999999999996},"last":1.016},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0449999999999999,"15min":1.3779999999999999},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4970000000000001,"5min":1.768,"15min":10.368},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.3640000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6040000000000001,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2450000000000001,"15min":1.351},"min":{"1min":0.94099999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.633,"5min":1.958,"15min":2.911},"last":1.085}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.677},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.532,"5min":1.6499999999999999,"15min":10.214},"last":1.409},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.286,"15min":1.458},"min":{"1min":0.92700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.498,"5min":1.96,"15min":2.8849999999999998},"last":1.1519999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2749999999999999,"15min":1.5449999999999999},"min":{"1min":0.95699999999999996,"5min":0.874,"15min":0.874},"max":{"1min":1.702,"5min":1.915,"15min":6.032},"last":1.486},{"interface":"front","average":{"1min":1.256,"5min":1.2769999999999999,"15min":1.7250000000000001},"min":{"1min":0.94099999999999995,"5min":0.84399999999999997,"15min":0.77300000000000002},"max":{"1min":1.5980000000000001,"5min":1.774,"15min":10.112},"last":1.528}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3500000000000001,"15min":1.79},"min":{"1min":0.97599999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.677,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.595},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3560000000000001,"15min":1.5469999999999999},"min":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.702,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.4450000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1703936,"data_stored":1098338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75700000000000001,"15min":0.97199999999999998},"min":{"1min":0.48899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.373,"5min":1.5289999999999999,"15min":4.2039999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.99099999999999999},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.874}]},{"osd":2,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":1.119},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2569999999999999,"5min":1.294,"15min":3.7349999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":1.1890000000000001},"min":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.399,"5min":1.623,"15min":3.5640000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.97599999999999998,"15min":1.1679999999999999},"min":{"1min":0.58399999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3009999999999999,"5min":1.917,"15min":4.093},"last":1.401},{"interface":"front","average":{"1min":1.081,"5min":1.129,"15min":1.3879999999999999},"min":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":2.0750000000000002,"15min":4.7439999999999998},"last":1.4339999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.212,"15min":1.4239999999999999},"min":{"1min":0.99399999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4930000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.228,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4419999999999999,"5min":1.597,"15min":4.5449999999999999},"last":1.135}]},{"osd":5,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.282,"15min":1.5780000000000001},"min":{"1min":0.85899999999999999,"5min":0.753,"15min":0.753},"max":{"1min":1.52,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.218,"5min":1.256,"15min":1.512},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.675,"15min":3.2290000000000001},"last":1.1639999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2609999999999999,"15min":1.5209999999999999},"min":{"1min":0.93799999999999994,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3899999999999999,"5min":1.714,"15min":4.4569999999999999},"last":1.222},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.319,"15min":1.661},"min":{"1min":0.94499999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4830000000000001,"5min":1.696,"15min":4.8570000000000002},"last":1.0649999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.333,"15min":1.569},"min":{"1min":0.89700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.6459999999999999,"5min":1.756,"15min":3.056},"last":1.304},{"interface":"front","average":{"1min":1.278,"5min":1.296,"15min":1.587},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":4.5019999999999998},"last":1.3140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:53:38.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2024-09-13T18:53:38.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.963924+0000', 'last_change': '2024-09-13T18:53:32.963924+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.963924+0000', 'last_undegraded': '2024-09-13T18:53:32.963924+0000', 'last_fullsized': '2024-09-13T18:53:32.963924+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:52:37.538954+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:53:38.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962396+0000', 'last_change': '2024-09-13T18:53:32.962396+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962396+0000', 'last_undegraded': '2024-09-13T18:53:32.962396+0000', 'last_fullsized': '2024-09-13T18:53:32.962396+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.964538+0000', 'last_change': '2024-09-13T18:53:32.964538+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.964538+0000', 'last_undegraded': '2024-09-13T18:53:32.964538+0000', 'last_fullsized': '2024-09-13T18:53:32.964538+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:40:43.160897+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965579+0000', 'last_change': '2024-09-13T18:53:32.965579+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965579+0000', 'last_undegraded': '2024-09-13T18:53:32.965579+0000', 'last_fullsized': '2024-09-13T18:53:32.965579+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965421+0000', 'last_change': '2024-09-13T18:53:32.965421+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965421+0000', 'last_undegraded': '2024-09-13T18:53:32.965421+0000', 'last_fullsized': '2024-09-13T18:53:32.965421+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.963942+0000', 'last_change': '2024-09-13T18:53:32.963942+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.963942+0000', 'last_undegraded': '2024-09-13T18:53:32.963942+0000', 'last_fullsized': '2024-09-13T18:53:32.963942+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:40:53.286165+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2024-09-13T18:53:38.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.960216+0000', 'last_change': '2024-09-13T18:53:32.960216+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.960216+0000', 'last_undegraded': '2024-09-13T18:53:32.960216+0000', 'last_fullsized': '2024-09-13T18:53:32.960216+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:53:38.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2024-09-13T18:53:38.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.963013+0000', 'last_change': '2024-09-13T18:53:32.963013+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.963013+0000', 'last_undegraded': '2024-09-13T18:53:32.963013+0000', 'last_fullsized': '2024-09-13T18:53:32.963013+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2024-09-13T18:53:38.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962334+0000', 'last_change': '2024-09-13T18:53:32.962334+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962334+0000', 'last_undegraded': '2024-09-13T18:53:32.962334+0000', 'last_fullsized': '2024-09-13T18:53:32.962334+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2024-09-13T18:53:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.959061+0000', 'last_change': '2024-09-13T18:53:32.959061+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.959061+0000', 'last_undegraded': '2024-09-13T18:53:32.959061+0000', 'last_fullsized': '2024-09-13T18:53:32.959061+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:01:20.346936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:53:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2024-09-13T18:53:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.968233+0000', 'last_change': '2024-09-13T18:53:32.968233+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.968233+0000', 'last_undegraded': '2024-09-13T18:53:32.968233+0000', 'last_fullsized': '2024-09-13T18:53:32.968233+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2024-09-13T18:53:38.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.959574+0000', 'last_change': '2024-09-13T18:53:32.959574+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.959574+0000', 'last_undegraded': '2024-09-13T18:53:32.959574+0000', 'last_fullsized': '2024-09-13T18:53:32.959574+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:55:39.805762+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:53:38.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2024-09-13T18:53:38.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.958589+0000', 'last_change': '2024-09-13T18:53:32.958589+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.958589+0000', 'last_undegraded': '2024-09-13T18:53:32.958589+0000', 'last_fullsized': '2024-09-13T18:53:32.958589+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2024-09-13T18:53:38.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.967599+0000', 'last_change': '2024-09-13T18:53:32.967599+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.967599+0000', 'last_undegraded': '2024-09-13T18:53:32.967599+0000', 'last_fullsized': '2024-09-13T18:53:32.967599+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2024-09-13T18:53:38.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.958324+0000', 'last_change': '2024-09-13T18:53:32.958324+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.958324+0000', 'last_undegraded': '2024-09-13T18:53:32.958324+0000', 'last_fullsized': '2024-09-13T18:53:32.958324+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2024-09-13T18:53:38.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.960023+0000', 'last_change': '2024-09-13T18:53:32.960023+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.960023+0000', 'last_undegraded': '2024-09-13T18:53:32.960023+0000', 'last_fullsized': '2024-09-13T18:53:32.960023+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:14:39.591604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2024-09-13T18:53:38.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962631+0000', 'last_change': '2024-09-13T18:53:32.962631+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962631+0000', 'last_undegraded': '2024-09-13T18:53:32.962631+0000', 'last_fullsized': '2024-09-13T18:53:32.962631+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:12:55.445067+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2024-09-13T18:53:38.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.966390+0000', 'last_change': '2024-09-13T18:53:32.966390+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.966390+0000', 'last_undegraded': '2024-09-13T18:53:32.966390+0000', 'last_fullsized': '2024-09-13T18:53:32.966390+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T03:54:11.980134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:53:38.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2024-09-13T18:53:38.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965178+0000', 'last_change': '2024-09-13T18:53:32.965178+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965178+0000', 'last_undegraded': '2024-09-13T18:53:32.965178+0000', 'last_fullsized': '2024-09-13T18:53:32.965178+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2024-09-13T18:53:38.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.960846+0000', 'last_change': '2024-09-13T18:53:32.960846+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.960846+0000', 'last_undegraded': '2024-09-13T18:53:32.960846+0000', 'last_fullsized': '2024-09-13T18:53:32.960846+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2024-09-13T18:53:38.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965964+0000', 'last_change': '2024-09-13T18:53:32.965964+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965964+0000', 'last_undegraded': '2024-09-13T18:53:32.965964+0000', 'last_fullsized': '2024-09-13T18:53:32.965964+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2024-09-13T18:53:38.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.967143+0000', 'last_change': '2024-09-13T18:53:32.967143+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.967143+0000', 'last_undegraded': '2024-09-13T18:53:32.967143+0000', 'last_fullsized': '2024-09-13T18:53:32.967143+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2024-09-13T18:53:38.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.957095+0000', 'last_change': '2024-09-13T18:53:32.957095+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.957095+0000', 'last_undegraded': '2024-09-13T18:53:32.957095+0000', 'last_fullsized': '2024-09-13T18:53:32.957095+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:53:38.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2024-09-13T18:53:38.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962964+0000', 'last_change': '2024-09-13T18:53:32.962964+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962964+0000', 'last_undegraded': '2024-09-13T18:53:32.962964+0000', 'last_fullsized': '2024-09-13T18:53:32.962964+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:33:30.589532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:53:38.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2024-09-13T18:53:38.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962046+0000', 'last_change': '2024-09-13T18:53:32.962046+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962046+0000', 'last_undegraded': '2024-09-13T18:53:32.962046+0000', 'last_fullsized': '2024-09-13T18:53:32.962046+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:53:38.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2024-09-13T18:53:38.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.969322+0000', 'last_change': '2024-09-13T18:53:32.969322+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.969322+0000', 'last_undegraded': '2024-09-13T18:53:32.969322+0000', 'last_fullsized': '2024-09-13T18:53:32.969322+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2024-09-13T18:53:38.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.959093+0000', 'last_change': '2024-09-13T18:53:32.959093+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.959093+0000', 'last_undegraded': '2024-09-13T18:53:32.959093+0000', 'last_fullsized': '2024-09-13T18:53:32.959093+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:22:34.977610+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:53:38.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2024-09-13T18:53:38.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.959992+0000', 'last_change': '2024-09-13T18:53:32.959992+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.959992+0000', 'last_undegraded': '2024-09-13T18:53:32.959992+0000', 'last_fullsized': '2024-09-13T18:53:32.959992+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2024-09-13T18:53:38.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.961472+0000', 'last_change': '2024-09-13T18:53:32.961472+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.961472+0000', 'last_undegraded': '2024-09-13T18:53:32.961472+0000', 'last_fullsized': '2024-09-13T18:53:32.961472+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:53:38.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2024-09-13T18:53:38.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.966709+0000', 'last_change': '2024-09-13T18:53:32.966709+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.966709+0000', 'last_undegraded': '2024-09-13T18:53:32.966709+0000', 'last_fullsized': '2024-09-13T18:53:32.966709+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2024-09-13T18:53:38.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.963679+0000', 'last_change': '2024-09-13T18:53:32.963679+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.963679+0000', 'last_undegraded': '2024-09-13T18:53:32.963679+0000', 'last_fullsized': '2024-09-13T18:53:32.963679+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:53:38.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2024-09-13T18:53:38.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.959635+0000', 'last_change': '2024-09-13T18:53:32.959635+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.959635+0000', 'last_undegraded': '2024-09-13T18:53:32.959635+0000', 'last_fullsized': '2024-09-13T18:53:32.959635+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T19:11:51.528747+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2024-09-13T18:53:38.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.961057+0000', 'last_change': '2024-09-13T18:53:32.961057+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.961057+0000', 'last_undegraded': '2024-09-13T18:53:32.961057+0000', 'last_fullsized': '2024-09-13T18:53:32.961057+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:12:25.336257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2024-09-13T18:53:38.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.956672+0000', 'last_change': '2024-09-13T18:53:32.956672+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.956672+0000', 'last_undegraded': '2024-09-13T18:53:32.956672+0000', 'last_fullsized': '2024-09-13T18:53:32.956672+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:32:59.976141+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2024-09-13T18:53:38.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.960698+0000', 'last_change': '2024-09-13T18:53:32.960698+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.960698+0000', 'last_undegraded': '2024-09-13T18:53:32.960698+0000', 'last_fullsized': '2024-09-13T18:53:32.960698+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:53:38.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2024-09-13T18:53:38.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955886+0000', 'last_change': '2024-09-13T18:53:32.955886+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955886+0000', 'last_undegraded': '2024-09-13T18:53:32.955886+0000', 'last_fullsized': '2024-09-13T18:53:32.955886+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:29:27.303458+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2024-09-13T18:53:38.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.957253+0000', 'last_change': '2024-09-13T18:53:32.957253+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.957253+0000', 'last_undegraded': '2024-09-13T18:53:32.957253+0000', 'last_fullsized': '2024-09-13T18:53:32.957253+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2024-09-13T18:53:38.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955916+0000', 'last_change': '2024-09-13T18:53:32.955916+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955916+0000', 'last_undegraded': '2024-09-13T18:53:32.955916+0000', 'last_fullsized': '2024-09-13T18:53:32.955916+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:53:38.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2024-09-13T18:53:38.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962140+0000', 'last_change': '2024-09-13T18:53:32.962140+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962140+0000', 'last_undegraded': '2024-09-13T18:53:32.962140+0000', 'last_fullsized': '2024-09-13T18:53:32.962140+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:00:05.116179+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2024-09-13T18:53:38.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.958144+0000', 'last_change': '2024-09-13T18:53:32.958144+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.958144+0000', 'last_undegraded': '2024-09-13T18:53:32.958144+0000', 'last_fullsized': '2024-09-13T18:53:32.958144+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:42:30.778361+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2024-09-13T18:53:38.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.967583+0000', 'last_change': '2024-09-13T18:53:32.967583+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.967583+0000', 'last_undegraded': '2024-09-13T18:53:32.967583+0000', 'last_fullsized': '2024-09-13T18:53:32.967583+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2024-09-13T18:53:38.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.961391+0000', 'last_change': '2024-09-13T18:53:32.961391+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.961391+0000', 'last_undegraded': '2024-09-13T18:53:32.961391+0000', 'last_fullsized': '2024-09-13T18:53:32.961391+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:53:38.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2024-09-13T18:53:38.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965971+0000', 'last_change': '2024-09-13T18:53:32.965971+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965971+0000', 'last_undegraded': '2024-09-13T18:53:32.965971+0000', 'last_fullsized': '2024-09-13T18:53:32.965971+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:42:46.856863+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:53:38.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2024-09-13T18:53:38.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.957615+0000', 'last_change': '2024-09-13T18:53:32.957615+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.957615+0000', 'last_undegraded': '2024-09-13T18:53:32.957615+0000', 'last_fullsized': '2024-09-13T18:53:32.957615+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2024-09-13T18:53:38.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.956705+0000', 'last_change': '2024-09-13T18:53:32.956705+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.956705+0000', 'last_undegraded': '2024-09-13T18:53:32.956705+0000', 'last_fullsized': '2024-09-13T18:53:32.956705+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T18:53:38.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965539+0000', 'last_change': '2024-09-13T18:53:32.965539+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965539+0000', 'last_undegraded': '2024-09-13T18:53:32.965539+0000', 'last_fullsized': '2024-09-13T18:53:32.965539+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.957979+0000', 'last_change': '2024-09-13T18:53:32.957979+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.957979+0000', 'last_undegraded': '2024-09-13T18:53:32.957979+0000', 'last_fullsized': '2024-09-13T18:53:32.957979+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:04:00.853298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.959358+0000', 'last_change': '2024-09-13T18:53:32.959358+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.959358+0000', 'last_undegraded': '2024-09-13T18:53:32.959358+0000', 'last_fullsized': '2024-09-13T18:53:32.959358+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:18:35.073791+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2024-09-13T18:53:38.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955754+0000', 'last_change': '2024-09-13T18:53:32.955754+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955754+0000', 'last_undegraded': '2024-09-13T18:53:32.955754+0000', 'last_fullsized': '2024-09-13T18:53:32.955754+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:45:00.543904+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2024-09-13T18:53:38.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.956061+0000', 'last_change': '2024-09-13T18:53:32.956061+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.956061+0000', 'last_undegraded': '2024-09-13T18:53:32.956061+0000', 'last_fullsized': '2024-09-13T18:53:32.956061+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:53:38.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2024-09-13T18:53:38.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.968175+0000', 'last_change': '2024-09-13T18:53:32.968175+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.968175+0000', 'last_undegraded': '2024-09-13T18:53:32.968175+0000', 'last_fullsized': '2024-09-13T18:53:32.968175+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-13T18:53:38.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2024-09-13T18:53:38.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955379+0000', 'last_change': '2024-09-13T18:53:32.955379+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955379+0000', 'last_undegraded': '2024-09-13T18:53:32.955379+0000', 'last_fullsized': '2024-09-13T18:53:32.955379+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:12:18.970121+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.962938+0000', 'last_change': '2024-09-13T18:53:32.962938+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.962938+0000', 'last_undegraded': '2024-09-13T18:53:32.962938+0000', 'last_fullsized': '2024-09-13T18:53:32.962938+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.961094+0000', 'last_change': '2024-09-13T18:53:32.961094+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.961094+0000', 'last_undegraded': '2024-09-13T18:53:32.961094+0000', 'last_fullsized': '2024-09-13T18:53:32.961094+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.960960+0000', 'last_change': '2024-09-13T18:53:32.960960+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.960960+0000', 'last_undegraded': '2024-09-13T18:53:32.960960+0000', 'last_fullsized': '2024-09-13T18:53:32.960960+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:02:59.087816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2024-09-13T18:53:38.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.956438+0000', 'last_change': '2024-09-13T18:53:32.956438+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.956438+0000', 'last_undegraded': '2024-09-13T18:53:32.956438+0000', 'last_fullsized': '2024-09-13T18:53:32.956438+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:53:38.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2024-09-13T18:53:38.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955079+0000', 'last_change': '2024-09-13T18:53:32.955079+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955079+0000', 'last_undegraded': '2024-09-13T18:53:32.955079+0000', 'last_fullsized': '2024-09-13T18:53:32.955079+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:03:32.417668+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2024-09-13T18:53:38.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955530+0000', 'last_change': '2024-09-13T18:53:32.955530+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955530+0000', 'last_undegraded': '2024-09-13T18:53:32.955530+0000', 'last_fullsized': '2024-09-13T18:53:32.955530+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:00:31.226459+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2024-09-13T18:53:38.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.961601+0000', 'last_change': '2024-09-13T18:53:32.961601+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.961601+0000', 'last_undegraded': '2024-09-13T18:53:32.961601+0000', 'last_fullsized': '2024-09-13T18:53:32.961601+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:53:38.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2024-09-13T18:53:38.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.956903+0000', 'last_change': '2024-09-13T18:53:32.956903+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.956903+0000', 'last_undegraded': '2024-09-13T18:53:32.956903+0000', 'last_fullsized': '2024-09-13T18:53:32.956903+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:40:29.365964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T18:53:38.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.965568+0000', 'last_change': '2024-09-13T18:53:32.965568+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.965568+0000', 'last_undegraded': '2024-09-13T18:53:32.965568+0000', 'last_fullsized': '2024-09-13T18:53:32.965568+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:11:25.130785+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.955789+0000', 'last_change': '2024-09-13T18:53:32.955789+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.955789+0000', 'last_undegraded': '2024-09-13T18:53:32.955789+0000', 'last_fullsized': '2024-09-13T18:53:32.955789+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.956210+0000', 'last_change': '2024-09-13T18:53:32.956210+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.956210+0000', 'last_undegraded': '2024-09-13T18:53:32.956210+0000', 'last_fullsized': '2024-09-13T18:53:32.956210+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:30:02.468754+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2024-09-13T18:53:38.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 91, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:53:32.963992+0000', 'last_change': '2024-09-13T18:53:32.963992+0000', 'last_active': '2024-09-13T18:53:32.934243+0000', 'last_peered': '2024-09-13T18:53:32.934243+0000', 'last_clean': '2024-09-13T18:53:32.934243+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:53:32.963992+0000', 'last_undegraded': '2024-09-13T18:53:32.963992+0000', 'last_fullsized': '2024-09-13T18:53:32.963992+0000', 'mapping_epoch': 91, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 91, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'last_clean_scrub_stamp': '2024-09-13T18:53:32.934243+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-13T18:53:38.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:53:38.916 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:53:38.906+0000 7fe88d800700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:53:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.986+0000 7f4386e00700 1 Processor -- start 2024-09-13T18:53:38.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.986+0000 7f4386e00700 1 -- start start 2024-09-13T18:53:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4386e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f438006c960 0x7f4380161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4386e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4380162340 con 0x7f438006cd40 2024-09-13T18:53:38.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4386e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43800b2280 con 0x7f43800b1980 2024-09-13T18:53:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4386e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43800b2560 con 0x7f438006c960 2024-09-13T18:53:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f438006cd40 0x7f43800b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45382/0 (socket says 172.21.15.81:45382) 2024-09-13T18:53:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385000700 1 -- 172.21.15.81:0/1176371156 learned_addr learned my addr 172.21.15.81:0/1176371156 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:38.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385a00700 1 --2- 172.21.15.81:0/1176371156 >> v2:172.21.15.81:3300/0 conn(0x7f438006c960 0x7f4380161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f437fe00700 1 -- 172.21.15.81:0/1176371156 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620036632 0 0) 0x7f4380162340 con 0x7f438006cd40 2024-09-13T18:53:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f437fe00700 1 -- 172.21.15.81:0/1176371156 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43680035d0 con 0x7f438006cd40 2024-09-13T18:53:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385a00700 1 -- 172.21.15.81:0/1176371156 >> v1:172.21.15.178:6789/0 conn(0x7f43800b1980 legacy=0x7f4380162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385a00700 1 -- 172.21.15.81:0/1176371156 >> v1:172.21.15.81:6789/0 conn(0x7f438006cd40 legacy=0x7f43800b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f437fe00700 1 -- 172.21.15.81:0/1176371156 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424763549 0 0) 0x7f43680035d0 con 0x7f438006cd40 2024-09-13T18:53:39.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385a00700 1 -- 172.21.15.81:0/1176371156 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800b2840 con 0x7f438006c960 2024-09-13T18:53:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f4385a00700 1 --2- 172.21.15.81:0/1176371156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006c960 0x7f4380161e00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f4374009850 tx=0x7f4374009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7b9cbbfcf0e7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f437fe00700 1 -- 172.21.15.81:0/1176371156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c001670 con 0x7f438006c960 2024-09-13T18:53:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f437fe00700 1 -- 172.21.15.81:0/1176371156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4374004030 con 0x7f438006c960 2024-09-13T18:53:39.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.990+0000 7f437fe00700 1 -- 172.21.15.81:0/1176371156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43740043a0 con 0x7f438006c960 2024-09-13T18:53:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 -- 172.21.15.81:0/1176371156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006c960 msgr2=0x7f4380161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 --2- 172.21.15.81:0/1176371156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006c960 0x7f4380161e00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f4374009850 tx=0x7f4374009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:39.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 -- 172.21.15.81:0/1176371156 shutdown_connections 2024-09-13T18:53:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 --2- 172.21.15.81:0/1176371156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006c960 0x7f4380161e00 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 -- 172.21.15.81:0/1176371156 >> 172.21.15.81:0/1176371156 conn(0x7f438006a390 msgr2=0x7f438006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 -- 172.21.15.81:0/1176371156 shutdown_connections 2024-09-13T18:53:39.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 -- 172.21.15.81:0/1176371156 wait complete. 2024-09-13T18:53:39.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 Processor -- start 2024-09-13T18:53:39.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.994+0000 7f4386e00700 1 -- start start 2024-09-13T18:53:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f438006c960 0x7f4380156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 0x7f438015ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43800b1980 0x7f43801e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015c390 con 0x7f438006cd40 2024-09-13T18:53:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438015c670 con 0x7f43800b1980 2024-09-13T18:53:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438015c950 con 0x7f438006c960 2024-09-13T18:53:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 0x7f438015ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 0x7f438015ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46522/0 (socket says 172.21.15.81:46522) 2024-09-13T18:53:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 -- 172.21.15.81:0/1801981560 learned_addr learned my addr 172.21.15.81:0/1801981560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385a00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f438006c960 0x7f4380156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386400700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43800b1980 0x7f43801e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 -- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f438006c960 msgr2=0x7f4380156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f438006c960 0x7f4380156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 -- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43800b1980 msgr2=0x7f43801e81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43800b1980 0x7f43801e81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 -- 172.21.15.81:0/1801981560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740094b0 con 0x7f438006cd40 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4385000700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 0x7f438015ba40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f436c00c530 tx=0x7f436c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c004ca0 con 0x7f438006cd40 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c004e00 con 0x7f438006cd40 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438015d150 con 0x7f438006cd40 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c007310 con 0x7f438006cd40 2024-09-13T18:53:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:38.998+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4380157420 con 0x7f438006cd40 2024-09-13T18:53:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.002+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438015d670 con 0x7f438006cd40 2024-09-13T18:53:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.002+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f436c007470 con 0x7f438006cd40 2024-09-13T18:53:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.002+0000 7f437d600700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4360066730 0x7f4360068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.002+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f436c0840e0 con 0x7f438006cd40 2024-09-13T18:53:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.002+0000 7f4385a00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4360066730 0x7f4360068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.002+0000 7f4385a00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4360066730 0x7f4360068bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f43740090b0 tx=0x7f4374008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:39.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.010+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f438015d670 con 0x7f438006cd40 2024-09-13T18:53:39.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.262+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f438015d670 con 0x7f438006cd40 2024-09-13T18:53:39.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.262+0000 7f437d600700 1 -- 172.21.15.81:0/1801981560 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1195 (secure 0 0 0) 0x7f438015d670 con 0x7f438006cd40 2024-09-13T18:53:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:39.274 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":408,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":93,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":265003008,"bytes_avail":772829110272,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":86,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-13T18:53:21.093715+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:53:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4360066730 msgr2=0x7f4360068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4360066730 0x7f4360068bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f43740090b0 tx=0x7f4374008030 comp rx=0 tx=0).stop 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 msgr2=0x7f438015ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 0x7f438015ba40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f436c00c530 tx=0x7f436c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 shutdown_connections 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4360066730 0x7f4360068bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43800b1980 0x7f43801e81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f438006cd40 0x7f438015ba40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 --2- 172.21.15.81:0/1801981560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f438006c960 0x7f4380156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 >> 172.21.15.81:0/1801981560 conn(0x7f438006a390 msgr2=0x7f43801e6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:39.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 shutdown_connections 2024-09-13T18:53:39.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.266+0000 7f4386e00700 1 -- 172.21.15.81:0/1801981560 wait complete. 2024-09-13T18:53:39.299 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:53:39.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:53:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.462+0000 7f3cef200700 1 Processor -- start 2024-09-13T18:53:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.462+0000 7f3cef200700 1 -- start start 2024-09-13T18:53:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.462+0000 7f3cef200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ce80b2c50 0x7f3ce80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.462+0000 7f3cef200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce80d1800 con 0x7f3ce80cd430 2024-09-13T18:53:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.462+0000 7f3cef200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce815e450 con 0x7f3ce815e070 2024-09-13T18:53:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.462+0000 7f3cef200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce80d0050 con 0x7f3ce80b2c50 2024-09-13T18:53:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ced400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3ce80cd430 0x7f3ce80b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45386/0 (socket says 172.21.15.81:45386) 2024-09-13T18:53:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ced400700 1 -- 172.21.15.81:0/761404102 learned_addr learned my addr 172.21.15.81:0/761404102 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cee800700 1 --2- 172.21.15.81:0/761404102 >> v2:172.21.15.178:3300/0 conn(0x7f3ce80b2c50 0x7f3ce80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ceca00700 1 -- 172.21.15.81:0/761404102 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845069600 0 0) 0x7f3ce80d1800 con 0x7f3ce80cd430 2024-09-13T18:53:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ceca00700 1 -- 172.21.15.81:0/761404102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd00035d0 con 0x7f3ce80cd430 2024-09-13T18:53:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cee800700 1 -- 172.21.15.81:0/761404102 >> v1:172.21.15.178:6789/0 conn(0x7f3ce815e070 legacy=0x7f3ce80d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ceca00700 1 -- 172.21.15.81:0/761404102 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650228080 0 0) 0x7f3ce815e450 con 0x7f3ce815e070 2024-09-13T18:53:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cee800700 1 -- 172.21.15.81:0/761404102 >> v1:172.21.15.81:6789/0 conn(0x7f3ce80cd430 legacy=0x7f3ce80b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cee800700 1 -- 172.21.15.81:0/761404102 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce80d0330 con 0x7f3ce80b2c50 2024-09-13T18:53:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cee800700 1 --2- 172.21.15.81:0/761404102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b38b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009d90 tx=0x7f3ce400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0b62b5c2cdc553a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ceca00700 1 -- 172.21.15.81:0/761404102 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400e070 con 0x7f3ce80b2c50 2024-09-13T18:53:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ceca00700 1 -- 172.21.15.81:0/761404102 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400bb20 con 0x7f3ce80b2c50 2024-09-13T18:53:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3ceca00700 1 -- 172.21.15.81:0/761404102 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400bed0 con 0x7f3ce80b2c50 2024-09-13T18:53:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 -- 172.21.15.81:0/761404102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 msgr2=0x7f3ce80b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 --2- 172.21.15.81:0/761404102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b38b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009d90 tx=0x7f3ce400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 -- 172.21.15.81:0/761404102 shutdown_connections 2024-09-13T18:53:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 --2- 172.21.15.81:0/761404102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b38b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 -- 172.21.15.81:0/761404102 >> 172.21.15.81:0/761404102 conn(0x7f3ce8071f00 msgr2=0x7f3ce80722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 -- 172.21.15.81:0/761404102 shutdown_connections 2024-09-13T18:53:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.466+0000 7f3cef200700 1 -- 172.21.15.81:0/761404102 wait complete. 2024-09-13T18:53:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 Processor -- start 2024-09-13T18:53:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 -- start start 2024-09-13T18:53:39.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 0x7f3ce8154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ce815e070 0x7f3ce814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce8155760 con 0x7f3ce80cd430 2024-09-13T18:53:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80c8500 con 0x7f3ce80b2c50 2024-09-13T18:53:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.470+0000 7f3cef200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce80c87e0 con 0x7f3ce815e070 2024-09-13T18:53:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 0x7f3ce8154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 0x7f3ce8154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46530/0 (socket says 172.21.15.81:46530) 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 -- 172.21.15.81:0/2745983073 learned_addr learned my addr 172.21.15.81:0/2745983073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3cee800700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ce815e070 0x7f3ce814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3cede00700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 -- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ce815e070 msgr2=0x7f3ce814f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ce815e070 0x7f3ce814f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 -- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 msgr2=0x7f3ce80b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 -- 172.21.15.81:0/2745983073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009a70 con 0x7f3ce80cd430 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ced400700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 0x7f3ce8154d70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c4d0 tx=0x7f3cd800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8005d90 con 0x7f3ce80cd430 2024-09-13T18:53:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800ce80 con 0x7f3ce80cd430 2024-09-13T18:53:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce80c8ac0 con 0x7f3ce80cd430 2024-09-13T18:53:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80072d0 con 0x7f3ce80cd430 2024-09-13T18:53:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce814f760 con 0x7f3ce80cd430 2024-09-13T18:53:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.474+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce80c8fe0 con 0x7f3ce80cd430 2024-09-13T18:53:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.478+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3cd8007430 con 0x7f3ce80cd430 2024-09-13T18:53:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.478+0000 7f3ce2000700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ccc066730 0x7f3ccc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.478+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3cd80834e0 con 0x7f3ce80cd430 2024-09-13T18:53:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.478+0000 7f3cede00700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ccc066730 0x7f3ccc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.482+0000 7f3cede00700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ccc066730 0x7f3ccc068bf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc007fd0 tx=0x7f3cdc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:39.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.486+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ce80c8fe0 con 0x7f3ce80cd430 2024-09-13T18:53:39.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.678+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce80d0bd0 con 0x7f3ccc066730 2024-09-13T18:53:39.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.694+0000 7f3ce2000700 1 -- 172.21.15.81:0/2745983073 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286836 (secure 0 0 0) 0x7f3cdc0015d0 con 0x7f3ccc066730 2024-09-13T18:53:39.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ccc066730 msgr2=0x7f3ccc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ccc066730 0x7f3ccc068bf0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc007fd0 tx=0x7f3cdc009040 comp rx=0 tx=0).stop 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 msgr2=0x7f3ce8154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 0x7f3ce8154d70 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800c4d0 tx=0x7f3cd800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 shutdown_connections 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3ccc066730 0x7f3ccc068bf0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ce815e070 0x7f3ce814f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ce80cd430 0x7f3ce8154d70 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 --2- 172.21.15.81:0/2745983073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ce80b2c50 0x7f3ce80b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 >> 172.21.15.81:0/2745983073 conn(0x7f3ce8071f00 msgr2=0x7f3ce80cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 shutdown_connections 2024-09-13T18:53:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:39.702+0000 7f3cef200700 1 -- 172.21.15.81:0/2745983073 wait complete. 2024-09-13T18:53:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:53:39.735 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-13T18:53:39.098646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259176,"kb_used_data":10184,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754715544,"statfs":{"total":773094113280,"available":772828717056,"internally_reserved":0,"allocated":10428416,"data_stored":5411700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.149219"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443986+0000","last_change":"2024-09-13T18:53:33.440907+0000","last_active":"2024-09-13T18:53:33.443986+0000","last_peered":"2024-09-13T18:53:33.443986+0000","last_clean":"2024-09-13T18:53:33.443986+0000","last_became_active":"2024-09-13T18:53:33.440634+0000","last_became_peered":"2024-09-13T18:53:33.440634+0000","last_unstale":"2024-09-13T18:53:33.443986+0000","last_undegraded":"2024-09-13T18:53:33.443986+0000","last_fullsized":"2024-09-13T18:53:33.443986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:37.538954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447799+0000","last_change":"2024-09-13T18:53:33.444561+0000","last_active":"2024-09-13T18:53:33.447799+0000","last_peered":"2024-09-13T18:53:33.447799+0000","last_clean":"2024-09-13T18:53:33.447799+0000","last_became_active":"2024-09-13T18:53:33.444234+0000","last_became_peered":"2024-09-13T18:53:33.444234+0000","last_unstale":"2024-09-13T18:53:33.447799+0000","last_undegraded":"2024-09-13T18:53:33.447799+0000","last_fullsized":"2024-09-13T18:53:33.447799+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443952+0000","last_change":"2024-09-13T18:53:33.440297+0000","last_active":"2024-09-13T18:53:33.443952+0000","last_peered":"2024-09-13T18:53:33.443952+0000","last_clean":"2024-09-13T18:53:33.443952+0000","last_became_active":"2024-09-13T18:53:33.439493+0000","last_became_peered":"2024-09-13T18:53:33.439493+0000","last_unstale":"2024-09-13T18:53:33.443952+0000","last_undegraded":"2024-09-13T18:53:33.443952+0000","last_fullsized":"2024-09-13T18:53:33.443952+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:43.160897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446413+0000","last_change":"2024-09-13T18:53:33.440117+0000","last_active":"2024-09-13T18:53:33.446413+0000","last_peered":"2024-09-13T18:53:33.446413+0000","last_clean":"2024-09-13T18:53:33.446413+0000","last_became_active":"2024-09-13T18:53:33.439833+0000","last_became_peered":"2024-09-13T18:53:33.439833+0000","last_unstale":"2024-09-13T18:53:33.446413+0000","last_undegraded":"2024-09-13T18:53:33.446413+0000","last_fullsized":"2024-09-13T18:53:33.446413+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438270+0000","last_change":"2024-09-13T18:53:33.436645+0000","last_active":"2024-09-13T18:53:33.438270+0000","last_peered":"2024-09-13T18:53:33.438270+0000","last_clean":"2024-09-13T18:53:33.438270+0000","last_became_active":"2024-09-13T18:53:33.436351+0000","last_became_peered":"2024-09-13T18:53:33.436351+0000","last_unstale":"2024-09-13T18:53:33.438270+0000","last_undegraded":"2024-09-13T18:53:33.438270+0000","last_fullsized":"2024-09-13T18:53:33.438270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445566+0000","last_change":"2024-09-13T18:53:33.434402+0000","last_active":"2024-09-13T18:53:33.445566+0000","last_peered":"2024-09-13T18:53:33.445566+0000","last_clean":"2024-09-13T18:53:33.445566+0000","last_became_active":"2024-09-13T18:53:33.434088+0000","last_became_peered":"2024-09-13T18:53:33.434088+0000","last_unstale":"2024-09-13T18:53:33.445566+0000","last_undegraded":"2024-09-13T18:53:33.445566+0000","last_fullsized":"2024-09-13T18:53:33.445566+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:53.286165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.439490+0000","last_change":"2024-09-13T18:53:33.438143+0000","last_active":"2024-09-13T18:53:33.439490+0000","last_peered":"2024-09-13T18:53:33.439490+0000","last_clean":"2024-09-13T18:53:33.439490+0000","last_became_active":"2024-09-13T18:53:33.437856+0000","last_became_peered":"2024-09-13T18:53:33.437856+0000","last_unstale":"2024-09-13T18:53:33.439490+0000","last_undegraded":"2024-09-13T18:53:33.439490+0000","last_fullsized":"2024-09-13T18:53:33.439490+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.428422+0000","last_change":"2024-09-13T18:53:33.423517+0000","last_active":"2024-09-13T18:53:33.428422+0000","last_peered":"2024-09-13T18:53:33.428422+0000","last_clean":"2024-09-13T18:53:33.428422+0000","last_became_active":"2024-09-13T18:53:33.423257+0000","last_became_peered":"2024-09-13T18:53:33.423257+0000","last_unstale":"2024-09-13T18:53:33.428422+0000","last_undegraded":"2024-09-13T18:53:33.428422+0000","last_fullsized":"2024-09-13T18:53:33.428422+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445612+0000","last_change":"2024-09-13T18:53:33.443912+0000","last_active":"2024-09-13T18:53:33.445612+0000","last_peered":"2024-09-13T18:53:33.445612+0000","last_clean":"2024-09-13T18:53:33.445612+0000","last_became_active":"2024-09-13T18:53:33.443599+0000","last_became_peered":"2024-09-13T18:53:33.443599+0000","last_unstale":"2024-09-13T18:53:33.445612+0000","last_undegraded":"2024-09-13T18:53:33.445612+0000","last_fullsized":"2024-09-13T18:53:33.445612+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445554+0000","last_change":"2024-09-13T18:53:33.440913+0000","last_active":"2024-09-13T18:53:33.445554+0000","last_peered":"2024-09-13T18:53:33.445554+0000","last_clean":"2024-09-13T18:53:33.445554+0000","last_became_active":"2024-09-13T18:53:33.440641+0000","last_became_peered":"2024-09-13T18:53:33.440641+0000","last_unstale":"2024-09-13T18:53:33.445554+0000","last_undegraded":"2024-09-13T18:53:33.445554+0000","last_fullsized":"2024-09-13T18:53:33.445554+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.346936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.432694+0000","last_change":"2024-09-13T18:53:33.430330+0000","last_active":"2024-09-13T18:53:33.432694+0000","last_peered":"2024-09-13T18:53:33.432694+0000","last_clean":"2024-09-13T18:53:33.432694+0000","last_became_active":"2024-09-13T18:53:33.430078+0000","last_became_peered":"2024-09-13T18:53:33.430078+0000","last_unstale":"2024-09-13T18:53:33.432694+0000","last_undegraded":"2024-09-13T18:53:33.432694+0000","last_fullsized":"2024-09-13T18:53:33.432694+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447953+0000","last_change":"2024-09-13T18:53:33.442077+0000","last_active":"2024-09-13T18:53:33.447953+0000","last_peered":"2024-09-13T18:53:33.447953+0000","last_clean":"2024-09-13T18:53:33.447953+0000","last_became_active":"2024-09-13T18:53:33.441750+0000","last_became_peered":"2024-09-13T18:53:33.441750+0000","last_unstale":"2024-09-13T18:53:33.447953+0000","last_undegraded":"2024-09-13T18:53:33.447953+0000","last_fullsized":"2024-09-13T18:53:33.447953+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438691+0000","last_change":"2024-09-13T18:53:33.424644+0000","last_active":"2024-09-13T18:53:33.438691+0000","last_peered":"2024-09-13T18:53:33.438691+0000","last_clean":"2024-09-13T18:53:33.438691+0000","last_became_active":"2024-09-13T18:53:33.423824+0000","last_became_peered":"2024-09-13T18:53:33.423824+0000","last_unstale":"2024-09-13T18:53:33.438691+0000","last_undegraded":"2024-09-13T18:53:33.438691+0000","last_fullsized":"2024-09-13T18:53:33.438691+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449881+0000","last_change":"2024-09-13T18:53:33.448451+0000","last_active":"2024-09-13T18:53:33.449881+0000","last_peered":"2024-09-13T18:53:33.449881+0000","last_clean":"2024-09-13T18:53:33.449881+0000","last_became_active":"2024-09-13T18:53:33.447977+0000","last_became_peered":"2024-09-13T18:53:33.447977+0000","last_unstale":"2024-09-13T18:53:33.449881+0000","last_undegraded":"2024-09-13T18:53:33.449881+0000","last_fullsized":"2024-09-13T18:53:33.449881+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447907+0000","last_change":"2024-09-13T18:53:33.442697+0000","last_active":"2024-09-13T18:53:33.447907+0000","last_peered":"2024-09-13T18:53:33.447907+0000","last_clean":"2024-09-13T18:53:33.447907+0000","last_became_active":"2024-09-13T18:53:33.442339+0000","last_became_peered":"2024-09-13T18:53:33.442339+0000","last_unstale":"2024-09-13T18:53:33.447907+0000","last_undegraded":"2024-09-13T18:53:33.447907+0000","last_fullsized":"2024-09-13T18:53:33.447907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447900+0000","last_change":"2024-09-13T18:53:33.435426+0000","last_active":"2024-09-13T18:53:33.447900+0000","last_peered":"2024-09-13T18:53:33.447900+0000","last_clean":"2024-09-13T18:53:33.447900+0000","last_became_active":"2024-09-13T18:53:33.434905+0000","last_became_peered":"2024-09-13T18:53:33.434905+0000","last_unstale":"2024-09-13T18:53:33.447900+0000","last_undegraded":"2024-09-13T18:53:33.447900+0000","last_fullsized":"2024-09-13T18:53:33.447900+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:39.591604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448018+0000","last_change":"2024-09-13T18:53:33.443504+0000","last_active":"2024-09-13T18:53:33.448018+0000","last_peered":"2024-09-13T18:53:33.448018+0000","last_clean":"2024-09-13T18:53:33.448018+0000","last_became_active":"2024-09-13T18:53:33.443234+0000","last_became_peered":"2024-09-13T18:53:33.443234+0000","last_unstale":"2024-09-13T18:53:33.448018+0000","last_undegraded":"2024-09-13T18:53:33.448018+0000","last_fullsized":"2024-09-13T18:53:33.448018+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.445067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448598+0000","last_change":"2024-09-13T18:53:33.441997+0000","last_active":"2024-09-13T18:53:33.448598+0000","last_peered":"2024-09-13T18:53:33.448598+0000","last_clean":"2024-09-13T18:53:33.448598+0000","last_became_active":"2024-09-13T18:53:33.441749+0000","last_became_peered":"2024-09-13T18:53:33.441749+0000","last_unstale":"2024-09-13T18:53:33.448598+0000","last_undegraded":"2024-09-13T18:53:33.448598+0000","last_fullsized":"2024-09-13T18:53:33.448598+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:11.980134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449385+0000","last_change":"2024-09-13T18:53:33.447908+0000","last_active":"2024-09-13T18:53:33.449385+0000","last_peered":"2024-09-13T18:53:33.449385+0000","last_clean":"2024-09-13T18:53:33.449385+0000","last_became_active":"2024-09-13T18:53:33.447617+0000","last_became_peered":"2024-09-13T18:53:33.447617+0000","last_unstale":"2024-09-13T18:53:33.449385+0000","last_undegraded":"2024-09-13T18:53:33.449385+0000","last_fullsized":"2024-09-13T18:53:33.449385+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449008+0000","last_change":"2024-09-13T18:53:33.445473+0000","last_active":"2024-09-13T18:53:33.449008+0000","last_peered":"2024-09-13T18:53:33.449008+0000","last_clean":"2024-09-13T18:53:33.449008+0000","last_became_active":"2024-09-13T18:53:33.445176+0000","last_became_peered":"2024-09-13T18:53:33.445176+0000","last_unstale":"2024-09-13T18:53:33.449008+0000","last_undegraded":"2024-09-13T18:53:33.449008+0000","last_fullsized":"2024-09-13T18:53:33.449008+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436548+0000","last_change":"2024-09-13T18:53:33.432915+0000","last_active":"2024-09-13T18:53:33.436548+0000","last_peered":"2024-09-13T18:53:33.436548+0000","last_clean":"2024-09-13T18:53:33.436548+0000","last_became_active":"2024-09-13T18:53:33.432665+0000","last_became_peered":"2024-09-13T18:53:33.432665+0000","last_unstale":"2024-09-13T18:53:33.436548+0000","last_undegraded":"2024-09-13T18:53:33.436548+0000","last_fullsized":"2024-09-13T18:53:33.436548+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449668+0000","last_change":"2024-09-13T18:53:33.448052+0000","last_active":"2024-09-13T18:53:33.449668+0000","last_peered":"2024-09-13T18:53:33.449668+0000","last_clean":"2024-09-13T18:53:33.449668+0000","last_became_active":"2024-09-13T18:53:33.447731+0000","last_became_peered":"2024-09-13T18:53:33.447731+0000","last_unstale":"2024-09-13T18:53:33.449668+0000","last_undegraded":"2024-09-13T18:53:33.449668+0000","last_fullsized":"2024-09-13T18:53:33.449668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440412+0000","last_change":"2024-09-13T18:53:33.430950+0000","last_active":"2024-09-13T18:53:33.440412+0000","last_peered":"2024-09-13T18:53:33.440412+0000","last_clean":"2024-09-13T18:53:33.440412+0000","last_became_active":"2024-09-13T18:53:33.430486+0000","last_became_peered":"2024-09-13T18:53:33.430486+0000","last_unstale":"2024-09-13T18:53:33.440412+0000","last_undegraded":"2024-09-13T18:53:33.440412+0000","last_fullsized":"2024-09-13T18:53:33.440412+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.442889+0000","last_change":"2024-09-13T18:53:33.431708+0000","last_active":"2024-09-13T18:53:33.442889+0000","last_peered":"2024-09-13T18:53:33.442889+0000","last_clean":"2024-09-13T18:53:33.442889+0000","last_became_active":"2024-09-13T18:53:33.431440+0000","last_became_peered":"2024-09-13T18:53:33.431440+0000","last_unstale":"2024-09-13T18:53:33.442889+0000","last_undegraded":"2024-09-13T18:53:33.442889+0000","last_fullsized":"2024-09-13T18:53:33.442889+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:30.589532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446141+0000","last_change":"2024-09-13T18:53:33.436197+0000","last_active":"2024-09-13T18:53:33.446141+0000","last_peered":"2024-09-13T18:53:33.446141+0000","last_clean":"2024-09-13T18:53:33.446141+0000","last_became_active":"2024-09-13T18:53:33.435859+0000","last_became_peered":"2024-09-13T18:53:33.435859+0000","last_unstale":"2024-09-13T18:53:33.446141+0000","last_undegraded":"2024-09-13T18:53:33.446141+0000","last_fullsized":"2024-09-13T18:53:33.446141+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449878+0000","last_change":"2024-09-13T18:53:33.448354+0000","last_active":"2024-09-13T18:53:33.449878+0000","last_peered":"2024-09-13T18:53:33.449878+0000","last_clean":"2024-09-13T18:53:33.449878+0000","last_became_active":"2024-09-13T18:53:33.447963+0000","last_became_peered":"2024-09-13T18:53:33.447963+0000","last_unstale":"2024-09-13T18:53:33.449878+0000","last_undegraded":"2024-09-13T18:53:33.449878+0000","last_fullsized":"2024-09-13T18:53:33.449878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440452+0000","last_change":"2024-09-13T18:53:33.438769+0000","last_active":"2024-09-13T18:53:33.440452+0000","last_peered":"2024-09-13T18:53:33.440452+0000","last_clean":"2024-09-13T18:53:33.440452+0000","last_became_active":"2024-09-13T18:53:33.438185+0000","last_became_peered":"2024-09-13T18:53:33.438185+0000","last_unstale":"2024-09-13T18:53:33.440452+0000","last_undegraded":"2024-09-13T18:53:33.440452+0000","last_fullsized":"2024-09-13T18:53:33.440452+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:34.977610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440199+0000","last_change":"2024-09-13T18:53:33.433828+0000","last_active":"2024-09-13T18:53:33.440199+0000","last_peered":"2024-09-13T18:53:33.440199+0000","last_clean":"2024-09-13T18:53:33.440199+0000","last_became_active":"2024-09-13T18:53:33.433610+0000","last_became_peered":"2024-09-13T18:53:33.433610+0000","last_unstale":"2024-09-13T18:53:33.440199+0000","last_undegraded":"2024-09-13T18:53:33.440199+0000","last_fullsized":"2024-09-13T18:53:33.440199+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438659+0000","last_change":"2024-09-13T18:53:33.434456+0000","last_active":"2024-09-13T18:53:33.438659+0000","last_peered":"2024-09-13T18:53:33.438659+0000","last_clean":"2024-09-13T18:53:33.438659+0000","last_became_active":"2024-09-13T18:53:33.431371+0000","last_became_peered":"2024-09-13T18:53:33.431371+0000","last_unstale":"2024-09-13T18:53:33.438659+0000","last_undegraded":"2024-09-13T18:53:33.438659+0000","last_fullsized":"2024-09-13T18:53:33.438659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445806+0000","last_change":"2024-09-13T18:53:33.443913+0000","last_active":"2024-09-13T18:53:33.445806+0000","last_peered":"2024-09-13T18:53:33.445806+0000","last_clean":"2024-09-13T18:53:33.445806+0000","last_became_active":"2024-09-13T18:53:33.443664+0000","last_became_peered":"2024-09-13T18:53:33.443664+0000","last_unstale":"2024-09-13T18:53:33.445806+0000","last_undegraded":"2024-09-13T18:53:33.445806+0000","last_fullsized":"2024-09-13T18:53:33.445806+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443052+0000","last_change":"2024-09-13T18:53:33.430508+0000","last_active":"2024-09-13T18:53:33.443052+0000","last_peered":"2024-09-13T18:53:33.443052+0000","last_clean":"2024-09-13T18:53:33.443052+0000","last_became_active":"2024-09-13T18:53:33.430240+0000","last_became_peered":"2024-09-13T18:53:33.430240+0000","last_unstale":"2024-09-13T18:53:33.443052+0000","last_undegraded":"2024-09-13T18:53:33.443052+0000","last_fullsized":"2024-09-13T18:53:33.443052+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440238+0000","last_change":"2024-09-13T18:53:33.428827+0000","last_active":"2024-09-13T18:53:33.440238+0000","last_peered":"2024-09-13T18:53:33.440238+0000","last_clean":"2024-09-13T18:53:33.440238+0000","last_became_active":"2024-09-13T18:53:33.428606+0000","last_became_peered":"2024-09-13T18:53:33.428606+0000","last_unstale":"2024-09-13T18:53:33.440238+0000","last_undegraded":"2024-09-13T18:53:33.440238+0000","last_fullsized":"2024-09-13T18:53:33.440238+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:51.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440423+0000","last_change":"2024-09-13T18:53:33.432762+0000","last_active":"2024-09-13T18:53:33.440423+0000","last_peered":"2024-09-13T18:53:33.440423+0000","last_clean":"2024-09-13T18:53:33.440423+0000","last_became_active":"2024-09-13T18:53:33.432383+0000","last_became_peered":"2024-09-13T18:53:33.432383+0000","last_unstale":"2024-09-13T18:53:33.440423+0000","last_undegraded":"2024-09-13T18:53:33.440423+0000","last_fullsized":"2024-09-13T18:53:33.440423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:25.336257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450488+0000","last_change":"2024-09-13T18:53:32.974455+0000","last_active":"2024-09-13T18:53:33.450488+0000","last_peered":"2024-09-13T18:53:33.450488+0000","last_clean":"2024-09-13T18:53:33.450488+0000","last_became_active":"2024-09-13T18:53:32.974185+0000","last_became_peered":"2024-09-13T18:53:32.974185+0000","last_unstale":"2024-09-13T18:53:33.450488+0000","last_undegraded":"2024-09-13T18:53:33.450488+0000","last_fullsized":"2024-09-13T18:53:33.450488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:13.889692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.434273+0000","last_change":"2024-09-13T18:53:33.427788+0000","last_active":"2024-09-13T18:53:33.434273+0000","last_peered":"2024-09-13T18:53:33.434273+0000","last_clean":"2024-09-13T18:53:33.434273+0000","last_became_active":"2024-09-13T18:53:33.426899+0000","last_became_peered":"2024-09-13T18:53:33.426899+0000","last_unstale":"2024-09-13T18:53:33.434273+0000","last_undegraded":"2024-09-13T18:53:33.434273+0000","last_fullsized":"2024-09-13T18:53:33.434273+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:59.976141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445606+0000","last_change":"2024-09-13T18:53:32.974168+0000","last_active":"2024-09-13T18:53:33.445606+0000","last_peered":"2024-09-13T18:53:33.445606+0000","last_clean":"2024-09-13T18:53:33.445606+0000","last_became_active":"2024-09-13T18:53:32.973823+0000","last_became_peered":"2024-09-13T18:53:32.973823+0000","last_unstale":"2024-09-13T18:53:33.445606+0000","last_undegraded":"2024-09-13T18:53:33.445606+0000","last_fullsized":"2024-09-13T18:53:33.445606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:53.038961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436492+0000","last_change":"2024-09-13T18:53:33.432492+0000","last_active":"2024-09-13T18:53:33.436492+0000","last_peered":"2024-09-13T18:53:33.436492+0000","last_clean":"2024-09-13T18:53:33.436492+0000","last_became_active":"2024-09-13T18:53:33.432227+0000","last_became_peered":"2024-09-13T18:53:33.432227+0000","last_unstale":"2024-09-13T18:53:33.436492+0000","last_undegraded":"2024-09-13T18:53:33.436492+0000","last_fullsized":"2024-09-13T18:53:33.436492+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443631+0000","last_change":"2024-09-13T18:53:32.982524+0000","last_active":"2024-09-13T18:53:33.443631+0000","last_peered":"2024-09-13T18:53:33.443631+0000","last_clean":"2024-09-13T18:53:33.443631+0000","last_became_active":"2024-09-13T18:53:32.982071+0000","last_became_peered":"2024-09-13T18:53:32.982071+0000","last_unstale":"2024-09-13T18:53:33.443631+0000","last_undegraded":"2024-09-13T18:53:33.443631+0000","last_fullsized":"2024-09-13T18:53:33.443631+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446231+0000","last_change":"2024-09-13T18:53:33.437583+0000","last_active":"2024-09-13T18:53:33.446231+0000","last_peered":"2024-09-13T18:53:33.446231+0000","last_clean":"2024-09-13T18:53:33.446231+0000","last_became_active":"2024-09-13T18:53:33.436456+0000","last_became_peered":"2024-09-13T18:53:33.436456+0000","last_unstale":"2024-09-13T18:53:33.446231+0000","last_undegraded":"2024-09-13T18:53:33.446231+0000","last_fullsized":"2024-09-13T18:53:33.446231+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:27.303458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.451624+0000","last_change":"2024-09-13T18:53:32.969226+0000","last_active":"2024-09-13T18:53:33.451624+0000","last_peered":"2024-09-13T18:53:33.451624+0000","last_clean":"2024-09-13T18:53:33.451624+0000","last_became_active":"2024-09-13T18:53:32.968542+0000","last_became_peered":"2024-09-13T18:53:32.968542+0000","last_unstale":"2024-09-13T18:53:33.451624+0000","last_undegraded":"2024-09-13T18:53:33.451624+0000","last_fullsized":"2024-09-13T18:53:33.451624+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446351+0000","last_change":"2024-09-13T18:53:33.438180+0000","last_active":"2024-09-13T18:53:33.446351+0000","last_peered":"2024-09-13T18:53:33.446351+0000","last_clean":"2024-09-13T18:53:33.446351+0000","last_became_active":"2024-09-13T18:53:33.437943+0000","last_became_peered":"2024-09-13T18:53:33.437943+0000","last_unstale":"2024-09-13T18:53:33.446351+0000","last_undegraded":"2024-09-13T18:53:33.446351+0000","last_fullsized":"2024-09-13T18:53:33.446351+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.442551+0000","last_change":"2024-09-13T18:53:32.979540+0000","last_active":"2024-09-13T18:53:33.442551+0000","last_peered":"2024-09-13T18:53:33.442551+0000","last_clean":"2024-09-13T18:53:33.442551+0000","last_became_active":"2024-09-13T18:53:32.979212+0000","last_became_peered":"2024-09-13T18:53:32.979212+0000","last_unstale":"2024-09-13T18:53:33.442551+0000","last_undegraded":"2024-09-13T18:53:33.442551+0000","last_fullsized":"2024-09-13T18:53:33.442551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:53.373570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440391+0000","last_change":"2024-09-13T18:53:33.430753+0000","last_active":"2024-09-13T18:53:33.440391+0000","last_peered":"2024-09-13T18:53:33.440391+0000","last_clean":"2024-09-13T18:53:33.440391+0000","last_became_active":"2024-09-13T18:53:33.430049+0000","last_became_peered":"2024-09-13T18:53:33.430049+0000","last_unstale":"2024-09-13T18:53:33.440391+0000","last_undegraded":"2024-09-13T18:53:33.440391+0000","last_fullsized":"2024-09-13T18:53:33.440391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446323+0000","last_change":"2024-09-13T18:53:32.975163+0000","last_active":"2024-09-13T18:53:33.446323+0000","last_peered":"2024-09-13T18:53:33.446323+0000","last_clean":"2024-09-13T18:53:33.446323+0000","last_became_active":"2024-09-13T18:53:32.974855+0000","last_became_peered":"2024-09-13T18:53:32.974855+0000","last_unstale":"2024-09-13T18:53:33.446323+0000","last_undegraded":"2024-09-13T18:53:33.446323+0000","last_fullsized":"2024-09-13T18:53:33.446323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445981+0000","last_change":"2024-09-13T18:53:33.436344+0000","last_active":"2024-09-13T18:53:33.445981+0000","last_peered":"2024-09-13T18:53:33.445981+0000","last_clean":"2024-09-13T18:53:33.445981+0000","last_became_active":"2024-09-13T18:53:33.432746+0000","last_became_peered":"2024-09-13T18:53:33.432746+0000","last_unstale":"2024-09-13T18:53:33.445981+0000","last_undegraded":"2024-09-13T18:53:33.445981+0000","last_fullsized":"2024-09-13T18:53:33.445981+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:05.116179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.432778+0000","last_change":"2024-09-13T18:53:32.974717+0000","last_active":"2024-09-13T18:53:33.432778+0000","last_peered":"2024-09-13T18:53:33.432778+0000","last_clean":"2024-09-13T18:53:33.432778+0000","last_became_active":"2024-09-13T18:53:32.974438+0000","last_became_peered":"2024-09-13T18:53:32.974438+0000","last_unstale":"2024-09-13T18:53:33.432778+0000","last_undegraded":"2024-09-13T18:53:33.432778+0000","last_fullsized":"2024-09-13T18:53:33.432778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:58.112314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.439835+0000","last_change":"2024-09-13T18:53:33.431320+0000","last_active":"2024-09-13T18:53:33.439835+0000","last_peered":"2024-09-13T18:53:33.439835+0000","last_clean":"2024-09-13T18:53:33.439835+0000","last_became_active":"2024-09-13T18:53:33.428033+0000","last_became_peered":"2024-09-13T18:53:33.428033+0000","last_unstale":"2024-09-13T18:53:33.439835+0000","last_undegraded":"2024-09-13T18:53:33.439835+0000","last_fullsized":"2024-09-13T18:53:33.439835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:30.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415553+0000","last_change":"2024-09-13T18:53:32.977072+0000","last_active":"2024-09-13T18:53:33.415553+0000","last_peered":"2024-09-13T18:53:33.415553+0000","last_clean":"2024-09-13T18:53:33.415553+0000","last_became_active":"2024-09-13T18:53:32.974368+0000","last_became_peered":"2024-09-13T18:53:32.974368+0000","last_unstale":"2024-09-13T18:53:33.415553+0000","last_undegraded":"2024-09-13T18:53:33.415553+0000","last_fullsized":"2024-09-13T18:53:33.415553+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448023+0000","last_change":"2024-09-13T18:53:33.446118+0000","last_active":"2024-09-13T18:53:33.448023+0000","last_peered":"2024-09-13T18:53:33.448023+0000","last_clean":"2024-09-13T18:53:33.448023+0000","last_became_active":"2024-09-13T18:53:33.445868+0000","last_became_peered":"2024-09-13T18:53:33.445868+0000","last_unstale":"2024-09-13T18:53:33.448023+0000","last_undegraded":"2024-09-13T18:53:33.448023+0000","last_fullsized":"2024-09-13T18:53:33.448023+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.428511+0000","last_change":"2024-09-13T18:53:32.971936+0000","last_active":"2024-09-13T18:53:33.428511+0000","last_peered":"2024-09-13T18:53:33.428511+0000","last_clean":"2024-09-13T18:53:33.428511+0000","last_became_active":"2024-09-13T18:53:32.971646+0000","last_became_peered":"2024-09-13T18:53:32.971646+0000","last_unstale":"2024-09-13T18:53:33.428511+0000","last_undegraded":"2024-09-13T18:53:33.428511+0000","last_fullsized":"2024-09-13T18:53:33.428511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.435510+0000","last_change":"2024-09-13T18:53:33.433060+0000","last_active":"2024-09-13T18:53:33.435510+0000","last_peered":"2024-09-13T18:53:33.435510+0000","last_clean":"2024-09-13T18:53:33.435510+0000","last_became_active":"2024-09-13T18:53:33.432785+0000","last_became_peered":"2024-09-13T18:53:33.432785+0000","last_unstale":"2024-09-13T18:53:33.435510+0000","last_undegraded":"2024-09-13T18:53:33.435510+0000","last_fullsized":"2024-09-13T18:53:33.435510+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436064+0000","last_change":"2024-09-13T18:53:32.975559+0000","last_active":"2024-09-13T18:53:33.436064+0000","last_peered":"2024-09-13T18:53:33.436064+0000","last_clean":"2024-09-13T18:53:33.436064+0000","last_became_active":"2024-09-13T18:53:32.975226+0000","last_became_peered":"2024-09-13T18:53:32.975226+0000","last_unstale":"2024-09-13T18:53:33.436064+0000","last_undegraded":"2024-09-13T18:53:33.436064+0000","last_fullsized":"2024-09-13T18:53:33.436064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.754508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.444033+0000","last_change":"2024-09-13T18:53:33.441520+0000","last_active":"2024-09-13T18:53:33.444033+0000","last_peered":"2024-09-13T18:53:33.444033+0000","last_clean":"2024-09-13T18:53:33.444033+0000","last_became_active":"2024-09-13T18:53:33.441260+0000","last_became_peered":"2024-09-13T18:53:33.441260+0000","last_unstale":"2024-09-13T18:53:33.444033+0000","last_undegraded":"2024-09-13T18:53:33.444033+0000","last_fullsized":"2024-09-13T18:53:33.444033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:46.856863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"92'3","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450715+0000","last_change":"2024-09-13T18:53:32.979461+0000","last_active":"2024-09-13T18:53:33.450715+0000","last_peered":"2024-09-13T18:53:33.450715+0000","last_clean":"2024-09-13T18:53:33.450715+0000","last_became_active":"2024-09-13T18:53:32.978929+0000","last_became_peered":"2024-09-13T18:53:32.978929+0000","last_unstale":"2024-09-13T18:53:33.450715+0000","last_undegraded":"2024-09-13T18:53:33.450715+0000","last_fullsized":"2024-09-13T18:53:33.450715+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:54.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443170+0000","last_change":"2024-09-13T18:53:33.435893+0000","last_active":"2024-09-13T18:53:33.443170+0000","last_peered":"2024-09-13T18:53:33.443170+0000","last_clean":"2024-09-13T18:53:33.443170+0000","last_became_active":"2024-09-13T18:53:33.435663+0000","last_became_peered":"2024-09-13T18:53:33.435663+0000","last_unstale":"2024-09-13T18:53:33.443170+0000","last_undegraded":"2024-09-13T18:53:33.443170+0000","last_fullsized":"2024-09-13T18:53:33.443170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450758+0000","last_change":"2024-09-13T18:53:32.962678+0000","last_active":"2024-09-13T18:53:33.450758+0000","last_peered":"2024-09-13T18:53:33.450758+0000","last_clean":"2024-09-13T18:53:33.450758+0000","last_became_active":"2024-09-13T18:53:32.962353+0000","last_became_peered":"2024-09-13T18:53:32.962353+0000","last_unstale":"2024-09-13T18:53:33.450758+0000","last_undegraded":"2024-09-13T18:53:33.450758+0000","last_fullsized":"2024-09-13T18:53:33.450758+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:21.019937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436712+0000","last_change":"2024-09-13T18:53:33.424091+0000","last_active":"2024-09-13T18:53:33.436712+0000","last_peered":"2024-09-13T18:53:33.436712+0000","last_clean":"2024-09-13T18:53:33.436712+0000","last_became_active":"2024-09-13T18:53:33.423842+0000","last_became_peered":"2024-09-13T18:53:33.423842+0000","last_unstale":"2024-09-13T18:53:33.436712+0000","last_undegraded":"2024-09-13T18:53:33.436712+0000","last_fullsized":"2024-09-13T18:53:33.436712+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450658+0000","last_change":"2024-09-13T18:53:32.977043+0000","last_active":"2024-09-13T18:53:33.450658+0000","last_peered":"2024-09-13T18:53:33.450658+0000","last_clean":"2024-09-13T18:53:33.450658+0000","last_became_active":"2024-09-13T18:53:32.974269+0000","last_became_peered":"2024-09-13T18:53:32.974269+0000","last_unstale":"2024-09-13T18:53:33.450658+0000","last_undegraded":"2024-09-13T18:53:33.450658+0000","last_fullsized":"2024-09-13T18:53:33.450658+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438735+0000","last_change":"2024-09-13T18:53:33.438113+0000","last_active":"2024-09-13T18:53:33.438735+0000","last_peered":"2024-09-13T18:53:33.438735+0000","last_clean":"2024-09-13T18:53:33.438735+0000","last_became_active":"2024-09-13T18:53:33.437855+0000","last_became_peered":"2024-09-13T18:53:33.437855+0000","last_unstale":"2024-09-13T18:53:33.438735+0000","last_undegraded":"2024-09-13T18:53:33.438735+0000","last_fullsized":"2024-09-13T18:53:33.438735+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.418056+0000","last_change":"2024-09-13T18:53:32.968390+0000","last_active":"2024-09-13T18:53:33.418056+0000","last_peered":"2024-09-13T18:53:33.418056+0000","last_clean":"2024-09-13T18:53:33.418056+0000","last_became_active":"2024-09-13T18:53:32.968173+0000","last_became_peered":"2024-09-13T18:53:32.968173+0000","last_unstale":"2024-09-13T18:53:33.418056+0000","last_undegraded":"2024-09-13T18:53:33.418056+0000","last_fullsized":"2024-09-13T18:53:33.418056+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:16.066340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445747+0000","last_change":"2024-09-13T18:53:33.440531+0000","last_active":"2024-09-13T18:53:33.445747+0000","last_peered":"2024-09-13T18:53:33.445747+0000","last_clean":"2024-09-13T18:53:33.445747+0000","last_became_active":"2024-09-13T18:53:33.440275+0000","last_became_peered":"2024-09-13T18:53:33.440275+0000","last_unstale":"2024-09-13T18:53:33.445747+0000","last_undegraded":"2024-09-13T18:53:33.445747+0000","last_fullsized":"2024-09-13T18:53:33.445747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:00.853298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415690+0000","last_change":"2024-09-13T18:53:32.978943+0000","last_active":"2024-09-13T18:53:33.415690+0000","last_peered":"2024-09-13T18:53:33.415690+0000","last_clean":"2024-09-13T18:53:33.415690+0000","last_became_active":"2024-09-13T18:53:32.978004+0000","last_became_peered":"2024-09-13T18:53:32.978004+0000","last_unstale":"2024-09-13T18:53:33.415690+0000","last_undegraded":"2024-09-13T18:53:33.415690+0000","last_fullsized":"2024-09-13T18:53:33.415690+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.430520+0000","last_change":"2024-09-13T18:53:33.426781+0000","last_active":"2024-09-13T18:53:33.430520+0000","last_peered":"2024-09-13T18:53:33.430520+0000","last_clean":"2024-09-13T18:53:33.430520+0000","last_became_active":"2024-09-13T18:53:33.426520+0000","last_became_peered":"2024-09-13T18:53:33.426520+0000","last_unstale":"2024-09-13T18:53:33.430520+0000","last_undegraded":"2024-09-13T18:53:33.430520+0000","last_fullsized":"2024-09-13T18:53:33.430520+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:35.073791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450471+0000","last_change":"2024-09-13T18:53:32.972297+0000","last_active":"2024-09-13T18:53:33.450471+0000","last_peered":"2024-09-13T18:53:33.450471+0000","last_clean":"2024-09-13T18:53:33.450471+0000","last_became_active":"2024-09-13T18:53:32.972040+0000","last_became_peered":"2024-09-13T18:53:32.972040+0000","last_unstale":"2024-09-13T18:53:33.450471+0000","last_undegraded":"2024-09-13T18:53:33.450471+0000","last_fullsized":"2024-09-13T18:53:33.450471+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440376+0000","last_change":"2024-09-13T18:53:33.432609+0000","last_active":"2024-09-13T18:53:33.440376+0000","last_peered":"2024-09-13T18:53:33.440376+0000","last_clean":"2024-09-13T18:53:33.440376+0000","last_became_active":"2024-09-13T18:53:33.432061+0000","last_became_peered":"2024-09-13T18:53:33.432061+0000","last_unstale":"2024-09-13T18:53:33.440376+0000","last_undegraded":"2024-09-13T18:53:33.440376+0000","last_fullsized":"2024-09-13T18:53:33.440376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:00.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.444512+0000","last_change":"2024-09-13T18:53:32.966972+0000","last_active":"2024-09-13T18:53:33.444512+0000","last_peered":"2024-09-13T18:53:33.444512+0000","last_clean":"2024-09-13T18:53:33.444512+0000","last_became_active":"2024-09-13T18:53:32.966526+0000","last_became_peered":"2024-09-13T18:53:32.966526+0000","last_unstale":"2024-09-13T18:53:33.444512+0000","last_undegraded":"2024-09-13T18:53:33.444512+0000","last_fullsized":"2024-09-13T18:53:33.444512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:58.976298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.444193+0000","last_change":"2024-09-13T18:53:33.434995+0000","last_active":"2024-09-13T18:53:33.444193+0000","last_peered":"2024-09-13T18:53:33.444193+0000","last_clean":"2024-09-13T18:53:33.444193+0000","last_became_active":"2024-09-13T18:53:33.434685+0000","last_became_peered":"2024-09-13T18:53:33.434685+0000","last_unstale":"2024-09-13T18:53:33.444193+0000","last_undegraded":"2024-09-13T18:53:33.444193+0000","last_fullsized":"2024-09-13T18:53:33.444193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447178+0000","last_change":"2024-09-13T18:53:32.976908+0000","last_active":"2024-09-13T18:53:33.447178+0000","last_peered":"2024-09-13T18:53:33.447178+0000","last_clean":"2024-09-13T18:53:33.447178+0000","last_became_active":"2024-09-13T18:53:32.976653+0000","last_became_peered":"2024-09-13T18:53:32.976653+0000","last_unstale":"2024-09-13T18:53:33.447178+0000","last_undegraded":"2024-09-13T18:53:33.447178+0000","last_fullsized":"2024-09-13T18:53:33.447178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.434027+0000","last_change":"2024-09-13T18:53:33.429127+0000","last_active":"2024-09-13T18:53:33.434027+0000","last_peered":"2024-09-13T18:53:33.434027+0000","last_clean":"2024-09-13T18:53:33.434027+0000","last_became_active":"2024-09-13T18:53:33.428857+0000","last_became_peered":"2024-09-13T18:53:33.428857+0000","last_unstale":"2024-09-13T18:53:33.434027+0000","last_undegraded":"2024-09-13T18:53:33.434027+0000","last_fullsized":"2024-09-13T18:53:33.434027+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449336+0000","last_change":"2024-09-13T18:53:32.976609+0000","last_active":"2024-09-13T18:53:33.449336+0000","last_peered":"2024-09-13T18:53:33.449336+0000","last_clean":"2024-09-13T18:53:33.449336+0000","last_became_active":"2024-09-13T18:53:32.976333+0000","last_became_peered":"2024-09-13T18:53:32.976333+0000","last_unstale":"2024-09-13T18:53:33.449336+0000","last_undegraded":"2024-09-13T18:53:33.449336+0000","last_fullsized":"2024-09-13T18:53:33.449336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:53.755995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447919+0000","last_change":"2024-09-13T18:53:33.435567+0000","last_active":"2024-09-13T18:53:33.447919+0000","last_peered":"2024-09-13T18:53:33.447919+0000","last_clean":"2024-09-13T18:53:33.447919+0000","last_became_active":"2024-09-13T18:53:33.435197+0000","last_became_peered":"2024-09-13T18:53:33.435197+0000","last_unstale":"2024-09-13T18:53:33.447919+0000","last_undegraded":"2024-09-13T18:53:33.447919+0000","last_fullsized":"2024-09-13T18:53:33.447919+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:18.970121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446075+0000","last_change":"2024-09-13T18:53:32.976670+0000","last_active":"2024-09-13T18:53:33.446075+0000","last_peered":"2024-09-13T18:53:33.446075+0000","last_clean":"2024-09-13T18:53:33.446075+0000","last_became_active":"2024-09-13T18:53:32.976354+0000","last_became_peered":"2024-09-13T18:53:32.976354+0000","last_unstale":"2024-09-13T18:53:33.446075+0000","last_undegraded":"2024-09-13T18:53:33.446075+0000","last_fullsized":"2024-09-13T18:53:33.446075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446191+0000","last_change":"2024-09-13T18:53:33.437557+0000","last_active":"2024-09-13T18:53:33.446191+0000","last_peered":"2024-09-13T18:53:33.446191+0000","last_clean":"2024-09-13T18:53:33.446191+0000","last_became_active":"2024-09-13T18:53:33.437254+0000","last_became_peered":"2024-09-13T18:53:33.437254+0000","last_unstale":"2024-09-13T18:53:33.446191+0000","last_undegraded":"2024-09-13T18:53:33.446191+0000","last_fullsized":"2024-09-13T18:53:33.446191+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.422898+0000","last_change":"2024-09-13T18:53:32.966984+0000","last_active":"2024-09-13T18:53:33.422898+0000","last_peered":"2024-09-13T18:53:33.422898+0000","last_clean":"2024-09-13T18:53:33.422898+0000","last_became_active":"2024-09-13T18:53:32.966665+0000","last_became_peered":"2024-09-13T18:53:32.966665+0000","last_unstale":"2024-09-13T18:53:33.422898+0000","last_undegraded":"2024-09-13T18:53:33.422898+0000","last_fullsized":"2024-09-13T18:53:33.422898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.908915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446804+0000","last_change":"2024-09-13T18:53:33.442786+0000","last_active":"2024-09-13T18:53:33.446804+0000","last_peered":"2024-09-13T18:53:33.446804+0000","last_clean":"2024-09-13T18:53:33.446804+0000","last_became_active":"2024-09-13T18:53:33.442495+0000","last_became_peered":"2024-09-13T18:53:33.442495+0000","last_unstale":"2024-09-13T18:53:33.446804+0000","last_undegraded":"2024-09-13T18:53:33.446804+0000","last_fullsized":"2024-09-13T18:53:33.446804+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.421843+0000","last_change":"2024-09-13T18:53:32.977136+0000","last_active":"2024-09-13T18:53:33.421843+0000","last_peered":"2024-09-13T18:53:33.421843+0000","last_clean":"2024-09-13T18:53:33.421843+0000","last_became_active":"2024-09-13T18:53:32.974769+0000","last_became_peered":"2024-09-13T18:53:32.974769+0000","last_unstale":"2024-09-13T18:53:33.421843+0000","last_undegraded":"2024-09-13T18:53:33.421843+0000","last_fullsized":"2024-09-13T18:53:33.421843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.434443+0000","last_change":"2024-09-13T18:53:33.426594+0000","last_active":"2024-09-13T18:53:33.434443+0000","last_peered":"2024-09-13T18:53:33.434443+0000","last_clean":"2024-09-13T18:53:33.434443+0000","last_became_active":"2024-09-13T18:53:33.426310+0000","last_became_peered":"2024-09-13T18:53:33.426310+0000","last_unstale":"2024-09-13T18:53:33.434443+0000","last_undegraded":"2024-09-13T18:53:33.434443+0000","last_fullsized":"2024-09-13T18:53:33.434443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:59.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.422832+0000","last_change":"2024-09-13T18:53:32.973495+0000","last_active":"2024-09-13T18:53:33.422832+0000","last_peered":"2024-09-13T18:53:33.422832+0000","last_clean":"2024-09-13T18:53:33.422832+0000","last_became_active":"2024-09-13T18:53:32.973173+0000","last_became_peered":"2024-09-13T18:53:32.973173+0000","last_unstale":"2024-09-13T18:53:33.422832+0000","last_undegraded":"2024-09-13T18:53:33.422832+0000","last_fullsized":"2024-09-13T18:53:33.422832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:11.941564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445229+0000","last_change":"2024-09-13T18:53:33.441580+0000","last_active":"2024-09-13T18:53:33.445229+0000","last_peered":"2024-09-13T18:53:33.445229+0000","last_clean":"2024-09-13T18:53:33.445229+0000","last_became_active":"2024-09-13T18:53:33.441385+0000","last_became_peered":"2024-09-13T18:53:33.441385+0000","last_unstale":"2024-09-13T18:53:33.445229+0000","last_undegraded":"2024-09-13T18:53:33.445229+0000","last_fullsized":"2024-09-13T18:53:33.445229+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449475+0000","last_change":"2024-09-13T18:53:32.975551+0000","last_active":"2024-09-13T18:53:33.449475+0000","last_peered":"2024-09-13T18:53:33.449475+0000","last_clean":"2024-09-13T18:53:33.449475+0000","last_became_active":"2024-09-13T18:53:32.973976+0000","last_became_peered":"2024-09-13T18:53:32.973976+0000","last_unstale":"2024-09-13T18:53:33.449475+0000","last_undegraded":"2024-09-13T18:53:33.449475+0000","last_fullsized":"2024-09-13T18:53:33.449475+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447976+0000","last_change":"2024-09-13T18:53:33.434327+0000","last_active":"2024-09-13T18:53:33.447976+0000","last_peered":"2024-09-13T18:53:33.447976+0000","last_clean":"2024-09-13T18:53:33.447976+0000","last_became_active":"2024-09-13T18:53:33.433696+0000","last_became_peered":"2024-09-13T18:53:33.433696+0000","last_unstale":"2024-09-13T18:53:33.447976+0000","last_undegraded":"2024-09-13T18:53:33.447976+0000","last_fullsized":"2024-09-13T18:53:33.447976+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:32.417668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.421379+0000","last_change":"2024-09-13T18:53:32.978157+0000","last_active":"2024-09-13T18:53:33.421379+0000","last_peered":"2024-09-13T18:53:33.421379+0000","last_clean":"2024-09-13T18:53:33.421379+0000","last_became_active":"2024-09-13T18:53:32.977850+0000","last_became_peered":"2024-09-13T18:53:32.977850+0000","last_unstale":"2024-09-13T18:53:33.421379+0000","last_undegraded":"2024-09-13T18:53:33.421379+0000","last_fullsized":"2024-09-13T18:53:33.421379+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:07.000712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436788+0000","last_change":"2024-09-13T18:53:33.432306+0000","last_active":"2024-09-13T18:53:33.436788+0000","last_peered":"2024-09-13T18:53:33.436788+0000","last_clean":"2024-09-13T18:53:33.436788+0000","last_became_active":"2024-09-13T18:53:33.431427+0000","last_became_peered":"2024-09-13T18:53:33.431427+0000","last_unstale":"2024-09-13T18:53:33.436788+0000","last_undegraded":"2024-09-13T18:53:33.436788+0000","last_fullsized":"2024-09-13T18:53:33.436788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.426682+0000","last_change":"2024-09-13T18:53:32.977923+0000","last_active":"2024-09-13T18:53:33.426682+0000","last_peered":"2024-09-13T18:53:33.426682+0000","last_clean":"2024-09-13T18:53:33.426682+0000","last_became_active":"2024-09-13T18:53:32.977485+0000","last_became_peered":"2024-09-13T18:53:32.977485+0000","last_unstale":"2024-09-13T18:53:33.426682+0000","last_undegraded":"2024-09-13T18:53:33.426682+0000","last_fullsized":"2024-09-13T18:53:33.426682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.319921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443176+0000","last_change":"2024-09-13T18:53:33.432658+0000","last_active":"2024-09-13T18:53:33.443176+0000","last_peered":"2024-09-13T18:53:33.443176+0000","last_clean":"2024-09-13T18:53:33.443176+0000","last_became_active":"2024-09-13T18:53:33.432392+0000","last_became_peered":"2024-09-13T18:53:33.432392+0000","last_unstale":"2024-09-13T18:53:33.443176+0000","last_undegraded":"2024-09-13T18:53:33.443176+0000","last_fullsized":"2024-09-13T18:53:33.443176+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.424489+0000","last_change":"2024-09-13T18:53:32.969065+0000","last_active":"2024-09-13T18:53:33.424489+0000","last_peered":"2024-09-13T18:53:33.424489+0000","last_clean":"2024-09-13T18:53:33.424489+0000","last_became_active":"2024-09-13T18:53:32.968189+0000","last_became_peered":"2024-09-13T18:53:32.968189+0000","last_unstale":"2024-09-13T18:53:33.424489+0000","last_undegraded":"2024-09-13T18:53:33.424489+0000","last_fullsized":"2024-09-13T18:53:33.424489+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436636+0000","last_change":"2024-09-13T18:53:33.433371+0000","last_active":"2024-09-13T18:53:33.436636+0000","last_peered":"2024-09-13T18:53:33.436636+0000","last_clean":"2024-09-13T18:53:33.436636+0000","last_became_active":"2024-09-13T18:53:33.433122+0000","last_became_peered":"2024-09-13T18:53:33.433122+0000","last_unstale":"2024-09-13T18:53:33.436636+0000","last_undegraded":"2024-09-13T18:53:33.436636+0000","last_fullsized":"2024-09-13T18:53:33.436636+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:29.365964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.417894+0000","last_change":"2024-09-13T18:53:32.971783+0000","last_active":"2024-09-13T18:53:33.417894+0000","last_peered":"2024-09-13T18:53:33.417894+0000","last_clean":"2024-09-13T18:53:33.417894+0000","last_became_active":"2024-09-13T18:53:32.971544+0000","last_became_peered":"2024-09-13T18:53:32.971544+0000","last_unstale":"2024-09-13T18:53:33.417894+0000","last_undegraded":"2024-09-13T18:53:33.417894+0000","last_fullsized":"2024-09-13T18:53:33.417894+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:19.672579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450116+0000","last_change":"2024-09-13T18:53:33.445208+0000","last_active":"2024-09-13T18:53:33.450116+0000","last_peered":"2024-09-13T18:53:33.450116+0000","last_clean":"2024-09-13T18:53:33.450116+0000","last_became_active":"2024-09-13T18:53:33.445002+0000","last_became_peered":"2024-09-13T18:53:33.445002+0000","last_unstale":"2024-09-13T18:53:33.450116+0000","last_undegraded":"2024-09-13T18:53:33.450116+0000","last_fullsized":"2024-09-13T18:53:33.450116+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:25.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.422623+0000","last_change":"2024-09-13T18:53:32.979624+0000","last_active":"2024-09-13T18:53:33.422623+0000","last_peered":"2024-09-13T18:53:33.422623+0000","last_clean":"2024-09-13T18:53:33.422623+0000","last_became_active":"2024-09-13T18:53:32.979380+0000","last_became_peered":"2024-09-13T18:53:32.979380+0000","last_unstale":"2024-09-13T18:53:33.422623+0000","last_undegraded":"2024-09-13T18:53:33.422623+0000","last_fullsized":"2024-09-13T18:53:33.422623+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.441751+0000","last_change":"2024-09-13T18:53:33.434205+0000","last_active":"2024-09-13T18:53:33.441751+0000","last_peered":"2024-09-13T18:53:33.441751+0000","last_clean":"2024-09-13T18:53:33.441751+0000","last_became_active":"2024-09-13T18:53:33.430464+0000","last_became_peered":"2024-09-13T18:53:33.430464+0000","last_unstale":"2024-09-13T18:53:33.441751+0000","last_undegraded":"2024-09-13T18:53:33.441751+0000","last_fullsized":"2024-09-13T18:53:33.441751+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.424629+0000","last_change":"2024-09-13T18:53:32.971426+0000","last_active":"2024-09-13T18:53:33.424629+0000","last_peered":"2024-09-13T18:53:33.424629+0000","last_clean":"2024-09-13T18:53:33.424629+0000","last_became_active":"2024-09-13T18:53:32.971188+0000","last_became_peered":"2024-09-13T18:53:32.971188+0000","last_unstale":"2024-09-13T18:53:33.424629+0000","last_undegraded":"2024-09-13T18:53:33.424629+0000","last_fullsized":"2024-09-13T18:53:33.424629+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:48.187135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448129+0000","last_change":"2024-09-13T18:53:33.446250+0000","last_active":"2024-09-13T18:53:33.448129+0000","last_peered":"2024-09-13T18:53:33.448129+0000","last_clean":"2024-09-13T18:53:33.448129+0000","last_became_active":"2024-09-13T18:53:33.445591+0000","last_became_peered":"2024-09-13T18:53:33.445591+0000","last_unstale":"2024-09-13T18:53:33.448129+0000","last_undegraded":"2024-09-13T18:53:33.448129+0000","last_fullsized":"2024-09-13T18:53:33.448129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:02.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415291+0000","last_change":"2024-09-13T18:53:32.977404+0000","last_active":"2024-09-13T18:53:33.415291+0000","last_peered":"2024-09-13T18:53:33.415291+0000","last_clean":"2024-09-13T18:53:33.415291+0000","last_became_active":"2024-09-13T18:53:32.977089+0000","last_became_peered":"2024-09-13T18:53:32.977089+0000","last_unstale":"2024-09-13T18:53:33.415291+0000","last_undegraded":"2024-09-13T18:53:33.415291+0000","last_fullsized":"2024-09-13T18:53:33.415291+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443092+0000","last_change":"2024-09-13T18:53:33.441985+0000","last_active":"2024-09-13T18:53:33.443092+0000","last_peered":"2024-09-13T18:53:33.443092+0000","last_clean":"2024-09-13T18:53:33.443092+0000","last_became_active":"2024-09-13T18:53:33.441735+0000","last_became_peered":"2024-09-13T18:53:33.441735+0000","last_unstale":"2024-09-13T18:53:33.443092+0000","last_undegraded":"2024-09-13T18:53:33.443092+0000","last_fullsized":"2024-09-13T18:53:33.443092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.416513+0000","last_change":"2024-09-13T18:53:32.978373+0000","last_active":"2024-09-13T18:53:33.416513+0000","last_peered":"2024-09-13T18:53:33.416513+0000","last_clean":"2024-09-13T18:53:33.416513+0000","last_became_active":"2024-09-13T18:53:32.977238+0000","last_became_peered":"2024-09-13T18:53:32.977238+0000","last_unstale":"2024-09-13T18:53:33.416513+0000","last_undegraded":"2024-09-13T18:53:33.416513+0000","last_fullsized":"2024-09-13T18:53:33.416513+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:39.620579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":225,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415429+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:53:33.415429+0000","last_peered":"2024-09-13T18:53:33.415429+0000","last_clean":"2024-09-13T18:53:33.415429+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:53:33.415429+0000","last_undegraded":"2024-09-13T18:53:33.415429+0000","last_fullsized":"2024-09-13T18:53:33.415429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1748992,"data_stored":1118704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.415,"5min":1.72,"15min":1.72},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.524,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.054}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.117,"15min":1.137},"min":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.208},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.262}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.79200000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.605,"5min":1.885,"15min":1.885},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1890000000000001,"15min":1.206},"min":{"1min":0.97199999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.0940000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2649999999999999,"15min":1.2749999999999999},"min":{"1min":0.94799999999999995,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.5640000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.327,"15min":1.427},"min":{"1min":0.96399999999999997,"5min":0.90900000000000003,"15min":0.81999999999999995},"max":{"1min":1.669,"5min":1.861,"15min":2.2610000000000001},"last":1.3560000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.111},"min":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.22,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.66700000000000004,"15min":0.63700000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2929999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.3080000000000001},"min":{"1min":0.87,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.522,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.208,"15min":1.2230000000000001},"min":{"1min":0.79000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.375,"15min":1.399},"min":{"1min":1.0629999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.371,"15min":1.413},"min":{"1min":0.95399999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6279999999999999,"5min":1.845,"15min":1.845},"last":1.3919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1167360,"data_stored":530448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0860000000000001,"15min":1.1339999999999999},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.619,"5min":1.8169999999999999,"15min":3.0369999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.099,"15min":1.161},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5529999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.4890000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.155,"15min":1.1919999999999999},"min":{"1min":0.90200000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.4950000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.089}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.169,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":1.675,"15min":3.7480000000000002},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1859999999999999,"15min":1.4399999999999999},"min":{"1min":0.82699999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.4099999999999999,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":1.042}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.4790000000000001},"min":{"1min":0.97999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6339999999999999,"5min":1.7230000000000001,"15min":4.883},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2669999999999999,"15min":1.4910000000000001},"min":{"1min":0.89200000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":4.8630000000000004},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.288},"min":{"1min":0.76600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.526,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.123},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5589999999999999,"5min":1.796,"15min":2.077},"last":1.276}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.395},"min":{"1min":0.81899999999999995,"5min":0.755,"15min":0.755},"max":{"1min":1.456,"5min":1.764,"15min":2.1699999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.389,"15min":1.4670000000000001},"min":{"1min":0.97299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5860000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1970000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.4510000000000001},"min":{"1min":1.0049999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.536},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.361,"15min":1.5049999999999999},"min":{"1min":1.0640000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.367},"last":1.343}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1146880,"data_stored":528280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0569999999999999,"15min":1.177},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.125,"15min":1.155},"min":{"1min":0.90300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":2.278},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.2549999999999999},"min":{"1min":0.79700000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.476,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.119,"15min":1.1799999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.532,"5min":1.5649999999999999,"15min":2.1040000000000001},"last":1.038}]},{"osd":2,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1910000000000001,"15min":1.274},"min":{"1min":0.76700000000000002,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.619,"5min":1.7470000000000001,"15min":1.9059999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.157},"last":1.393}]},{"osd":3,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.25,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.749},"max":{"1min":1.5660000000000001,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.4179999999999999},"min":{"1min":0.90600000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":2.9470000000000001},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1100000000000001,"15min":1.2030000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5109999999999999,"5min":1.579,"15min":1.8500000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2669999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4990000000000001,"5min":1.742,"15min":1.974},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2909999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.536,"5min":1.669,"15min":2.0219999999999998},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.694,"5min":1.694,"15min":2.1739999999999999},"last":1.5600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":1.0580000000000001,"5min":0.87,"15min":0.81699999999999995},"max":{"1min":1.6499999999999999,"5min":1.7649999999999999,"15min":2.169},"last":1.274},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.5},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.641,"5min":1.804,"15min":2.8140000000000001},"last":1.5309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1155072,"data_stored":528440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.77200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.518,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2949999999999999,"15min":1.351},"min":{"1min":0.77000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6539999999999999,"5min":1.6739999999999999,"15min":2.6930000000000001},"last":1.24},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.3169999999999999},"min":{"1min":0.73799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4970000000000001,"5min":1.806,"15min":2.423},"last":1.1599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2190000000000001,"15min":1.28},"min":{"1min":0.94999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.99},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.3,"15min":1.371},"min":{"1min":0.82699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":2.335},"last":1.353}]},{"osd":3,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2010000000000001,"15min":1.2989999999999999},"min":{"1min":0.82199999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":2.621},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1839999999999999,"15min":1.2569999999999999},"min":{"1min":0.91000000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.302,"5min":1.5669999999999999,"15min":1.8640000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.153,"15min":1.284},"min":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":2.274},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2230000000000001,"15min":1.304},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.988,"5min":1.988,"15min":2.266},"last":1.3300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2070000000000001,"15min":1.333},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5189999999999999,"5min":2.319,"15min":2.4710000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3480000000000001,"15min":1.444},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5720000000000001,"5min":1.851,"15min":2.5},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.351,"15min":1.446},"min":{"1min":0.72399999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.395},"last":1.419},{"interface":"front","average":{"1min":1.405,"5min":1.355,"15min":1.454},"min":{"1min":1.0429999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9059999999999999,"5min":2.415,"15min":2.415},"last":1.3779999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1146880,"data_stored":528280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.88600000000000001},"min":{"1min":0.48799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0800000000000001,"5min":1.331,"15min":1.4510000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.879},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0589999999999999,"5min":1.444,"15min":1.444},"last":1.159}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3500000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.032},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94899999999999995,"15min":1.0880000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.464,"15min":4.0149999999999997},"last":0.98099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.004,"15min":1.002},"min":{"1min":0.71599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.319,"5min":1.611,"15min":1.611},"last":1.631},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.161},"min":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.536,"5min":1.569,"15min":2.4729999999999999},"last":1.488}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.179,"15min":1.2370000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.361},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1519999999999999,"15min":1.226},"min":{"1min":0.82299999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.8220000000000001},"last":1.405}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2170000000000001,"15min":1.3049999999999999},"min":{"1min":0.94799999999999995,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.4850000000000001,"5min":1.855,"15min":2.0099999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2789999999999999,"15min":1.365},"min":{"1min":0.85099999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6000000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.2270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3089999999999999,"15min":1.413},"min":{"1min":0.875,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.49,"5min":1.9239999999999999,"15min":2.714},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.278,"15min":1.4039999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7270000000000001,"5min":1.8520000000000001,"15min":2.52},"last":1.444}]},{"osd":7,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3049999999999999,"15min":1.4890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7789999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.302,"15min":1.4199999999999999},"min":{"1min":1.0029999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5580000000000001,"5min":1.946,"15min":1.9810000000000001},"last":1.536}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1146880,"data_stored":528280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77500000000000002,"15min":0.95699999999999996},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1000000000000001,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80900000000000005,"15min":1.0209999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.54,"5min":1.54,"15min":4.6349999999999998},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.84399999999999997,"15min":1.1000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1990000000000001,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.762,"5min":1.762,"15min":4.7009999999999996},"last":1.022}]},{"osd":3,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.117,"15min":1.294},"min":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5329999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.202},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.339,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.98299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.204,"15min":1.5980000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":8.6989999999999998},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.224,"15min":1.4219999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.383,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":1.4119999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2809999999999999,"15min":1.484},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6319999999999999,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.107},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.24,"15min":1.46},"min":{"1min":0.88600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5649999999999999,"5min":1.7370000000000001,"15min":4.335},"last":1.256}]},{"osd":6,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.5089999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.5569999999999999,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2450000000000001,"15min":1.696},"min":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":1.6319999999999999,"15min":8.6300000000000008},"last":1.1439999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3200000000000001,"15min":1.5329999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.194},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.355,"15min":1.589},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":4.4050000000000002},"last":1.165}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1150976,"data_stored":528350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.86799999999999999},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0309999999999999,"5min":1.385,"15min":2.2170000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":1.026},"min":{"1min":0.61699999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.036,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.169},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.46,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":1.0589999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5589999999999999,"5min":1.804,"15min":2.6219999999999999},"last":1.288}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1080000000000001,"15min":1.294},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4550000000000001,"5min":1.637,"15min":6.0919999999999996},"last":1.748},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0449999999999999,"15min":1.3779999999999999},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4970000000000001,"5min":1.768,"15min":10.368},"last":0.997}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.3640000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6040000000000001,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":1.038},{"interface":"front","average":{"1min":1.234,"5min":1.2450000000000001,"15min":1.351},"min":{"1min":0.94099999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.633,"5min":1.958,"15min":2.911},"last":1.6919999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.677},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.532,"5min":1.6499999999999999,"15min":10.214},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.286,"15min":1.458},"min":{"1min":0.92700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.498,"5min":1.96,"15min":2.8849999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2749999999999999,"15min":1.5449999999999999},"min":{"1min":0.95699999999999996,"5min":0.874,"15min":0.874},"max":{"1min":1.702,"5min":1.915,"15min":6.032},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2769999999999999,"15min":1.7250000000000001},"min":{"1min":0.94099999999999995,"5min":0.84399999999999997,"15min":0.77300000000000002},"max":{"1min":1.5980000000000001,"5min":1.774,"15min":10.112},"last":1.4119999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3500000000000001,"15min":1.79},"min":{"1min":0.97599999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.677,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3560000000000001,"15min":1.5469999999999999},"min":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.702,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.643}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1765376,"data_stored":1120918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75700000000000001,"15min":0.97199999999999998},"min":{"1min":0.48899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.373,"5min":1.5289999999999999,"15min":4.2039999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.99099999999999999},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":1.119},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2569999999999999,"5min":1.294,"15min":3.7349999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":1.1890000000000001},"min":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.399,"5min":1.623,"15min":3.5640000000000001},"last":1.2130000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.97599999999999998,"15min":1.1679999999999999},"min":{"1min":0.58399999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3009999999999999,"5min":1.917,"15min":4.093},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.081,"5min":1.129,"15min":1.3879999999999999},"min":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":2.0750000000000002,"15min":4.7439999999999998},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.212,"15min":1.4239999999999999},"min":{"1min":0.99399999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4930000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.403},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.228,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4419999999999999,"5min":1.597,"15min":4.5449999999999999},"last":1.242}]},{"osd":5,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.282,"15min":1.5780000000000001},"min":{"1min":0.85899999999999999,"5min":0.753,"15min":0.753},"max":{"1min":1.52,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.256,"15min":1.512},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.675,"15min":3.2290000000000001},"last":1.3460000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2609999999999999,"15min":1.5209999999999999},"min":{"1min":0.93799999999999994,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3899999999999999,"5min":1.714,"15min":4.4569999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.319,"15min":1.661},"min":{"1min":0.94499999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4830000000000001,"5min":1.696,"15min":4.8570000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.333,"15min":1.569},"min":{"1min":0.89700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.6459999999999999,"5min":1.756,"15min":3.056},"last":1.45},{"interface":"front","average":{"1min":1.278,"5min":1.296,"15min":1.587},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":4.5019999999999998},"last":1.3759999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:53:42.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:53:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.902+0000 7fde4ae00700 1 Processor -- start 2024-09-13T18:53:42.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde4ae00700 1 -- start start 2024-09-13T18:53:42.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde4ae00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:42.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde4ae00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4415e560 con 0x7fde440b3980 2024-09-13T18:53:42.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde4ae00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4415d920 con 0x7fde4415e9f0 2024-09-13T18:53:42.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde4ae00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440adf90 con 0x7fde4406aaa0 2024-09-13T18:53:42.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde49000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fde440b3980 0x7fde4406ae80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45390/0 (socket says 172.21.15.81:45390) 2024-09-13T18:53:42.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde49000700 1 -- 172.21.15.81:0/1347523021 learned_addr learned my addr 172.21.15.81:0/1347523021 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:42.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde49a00700 1 --2- 172.21.15.81:0/1347523021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:42.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845741854 0 0) 0x7fde4415e560 con 0x7fde440b3980 2024-09-13T18:53:42.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde2c0035d0 con 0x7fde440b3980 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851319770 0 0) 0x7fde4415d920 con 0x7fde4415e9f0 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde4415e560 con 0x7fde4415e9f0 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3405642645 0 0) 0x7fde2c0035d0 con 0x7fde440b3980 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde49a00700 1 -- 172.21.15.81:0/1347523021 >> v1:172.21.15.178:6789/0 conn(0x7fde4415e9f0 legacy=0x7fde4415eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde49a00700 1 -- 172.21.15.81:0/1347523021 >> v1:172.21.15.81:6789/0 conn(0x7fde440b3980 legacy=0x7fde4406ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.906+0000 7fde49a00700 1 -- 172.21.15.81:0/1347523021 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4415dc00 con 0x7fde4406aaa0 2024-09-13T18:53:42.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde49a00700 1 --2- 172.21.15.81:0/1347523021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415d310 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fde38009df0 tx=0x7fde3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e677dcdff4c9173 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:42.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3800e070 con 0x7fde4406aaa0 2024-09-13T18:53:42.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde38003a40 con 0x7fde4406aaa0 2024-09-13T18:53:42.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde43e00700 1 -- 172.21.15.81:0/1347523021 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30001670 con 0x7fde4406aaa0 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 -- 172.21.15.81:0/1347523021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 msgr2=0x7fde4415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 --2- 172.21.15.81:0/1347523021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415d310 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fde38009df0 tx=0x7fde3800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 -- 172.21.15.81:0/1347523021 shutdown_connections 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 --2- 172.21.15.81:0/1347523021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415d310 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 -- 172.21.15.81:0/1347523021 >> 172.21.15.81:0/1347523021 conn(0x7fde440b0c40 msgr2=0x7fde4406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 -- 172.21.15.81:0/1347523021 shutdown_connections 2024-09-13T18:53:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.910+0000 7fde4ae00700 1 -- 172.21.15.81:0/1347523021 wait complete. 2024-09-13T18:53:42.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 Processor -- start 2024-09-13T18:53:42.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 -- start start 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde440b3980 0x7fde441e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 0x7fde440ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde44145e00 con 0x7fde4415e9f0 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde441460e0 con 0x7fde440b3980 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4ae00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde441438d0 con 0x7fde4406aaa0 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 0x7fde440ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 0x7fde440ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46538/0 (socket says 172.21.15.81:46538) 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde4a400700 1 -- 172.21.15.81:0/2391974006 learned_addr learned my addr 172.21.15.81:0/2391974006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:42.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde49a00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.914+0000 7fde49000700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde440b3980 0x7fde441e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4a400700 1 -- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 msgr2=0x7fde4415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4a400700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4a400700 1 -- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde440b3980 msgr2=0x7fde441e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4a400700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde440b3980 0x7fde441e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4a400700 1 -- 172.21.15.81:0/2391974006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38009a70 con 0x7fde4415e9f0 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde49000700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde440b3980 0x7fde441e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:42.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4a400700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 0x7fde440ccbd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c410 tx=0x7fde3c00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0052d0 con 0x7fde4415e9f0 2024-09-13T18:53:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c005430 con 0x7fde4415e9f0 2024-09-13T18:53:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde44143bb0 con 0x7fde4415e9f0 2024-09-13T18:53:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0055a0 con 0x7fde4415e9f0 2024-09-13T18:53:42.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde44145ad0 con 0x7fde4415e9f0 2024-09-13T18:53:42.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.918+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde441440d0 con 0x7fde4415e9f0 2024-09-13T18:53:42.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.922+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fde3c0038e0 con 0x7fde4415e9f0 2024-09-13T18:53:42.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.922+0000 7fde41600700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:42.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.922+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde3c0837b0 con 0x7fde4415e9f0 2024-09-13T18:53:42.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.922+0000 7fde49a00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:42.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.926+0000 7fde49a00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fde38015040 tx=0x7fde38010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:42.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:42.930+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde441440d0 con 0x7fde4415e9f0 2024-09-13T18:53:43.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.114+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde440b3dc0 con 0x7fde24066730 2024-09-13T18:53:43.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.130+0000 7fde41600700 1 -- 172.21.15.81:0/2391974006 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286755 (secure 0 0 0) 0x7fde38003cd0 con 0x7fde24066730 2024-09-13T18:53:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 msgr2=0x7fde24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fde38015040 tx=0x7fde38010000 comp rx=0 tx=0).stop 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 msgr2=0x7fde440ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 0x7fde440ccbd0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c410 tx=0x7fde3c00c720 comp rx=0 tx=0).stop 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 shutdown_connections 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415e9f0 0x7fde440ccbd0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde440b3980 0x7fde441e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 --2- 172.21.15.81:0/2391974006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde4406aaa0 0x7fde4415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 >> 172.21.15.81:0/2391974006 conn(0x7fde440b0c40 msgr2=0x7fde4406d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 shutdown_connections 2024-09-13T18:53:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.142+0000 7fde4ae00700 1 -- 172.21.15.81:0/2391974006 wait complete. 2024-09-13T18:53:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:53:43.170 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-09-13T18:53:43.100189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259176,"kb_used_data":10184,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754715544,"statfs":{"total":773094113280,"available":772828717056,"internally_reserved":0,"allocated":10428416,"data_stored":5411700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.691795"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443986+0000","last_change":"2024-09-13T18:53:33.440907+0000","last_active":"2024-09-13T18:53:33.443986+0000","last_peered":"2024-09-13T18:53:33.443986+0000","last_clean":"2024-09-13T18:53:33.443986+0000","last_became_active":"2024-09-13T18:53:33.440634+0000","last_became_peered":"2024-09-13T18:53:33.440634+0000","last_unstale":"2024-09-13T18:53:33.443986+0000","last_undegraded":"2024-09-13T18:53:33.443986+0000","last_fullsized":"2024-09-13T18:53:33.443986+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:37.538954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447799+0000","last_change":"2024-09-13T18:53:33.444561+0000","last_active":"2024-09-13T18:53:33.447799+0000","last_peered":"2024-09-13T18:53:33.447799+0000","last_clean":"2024-09-13T18:53:33.447799+0000","last_became_active":"2024-09-13T18:53:33.444234+0000","last_became_peered":"2024-09-13T18:53:33.444234+0000","last_unstale":"2024-09-13T18:53:33.447799+0000","last_undegraded":"2024-09-13T18:53:33.447799+0000","last_fullsized":"2024-09-13T18:53:33.447799+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443952+0000","last_change":"2024-09-13T18:53:33.440297+0000","last_active":"2024-09-13T18:53:33.443952+0000","last_peered":"2024-09-13T18:53:33.443952+0000","last_clean":"2024-09-13T18:53:33.443952+0000","last_became_active":"2024-09-13T18:53:33.439493+0000","last_became_peered":"2024-09-13T18:53:33.439493+0000","last_unstale":"2024-09-13T18:53:33.443952+0000","last_undegraded":"2024-09-13T18:53:33.443952+0000","last_fullsized":"2024-09-13T18:53:33.443952+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:43.160897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446413+0000","last_change":"2024-09-13T18:53:33.440117+0000","last_active":"2024-09-13T18:53:33.446413+0000","last_peered":"2024-09-13T18:53:33.446413+0000","last_clean":"2024-09-13T18:53:33.446413+0000","last_became_active":"2024-09-13T18:53:33.439833+0000","last_became_peered":"2024-09-13T18:53:33.439833+0000","last_unstale":"2024-09-13T18:53:33.446413+0000","last_undegraded":"2024-09-13T18:53:33.446413+0000","last_fullsized":"2024-09-13T18:53:33.446413+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438270+0000","last_change":"2024-09-13T18:53:33.436645+0000","last_active":"2024-09-13T18:53:33.438270+0000","last_peered":"2024-09-13T18:53:33.438270+0000","last_clean":"2024-09-13T18:53:33.438270+0000","last_became_active":"2024-09-13T18:53:33.436351+0000","last_became_peered":"2024-09-13T18:53:33.436351+0000","last_unstale":"2024-09-13T18:53:33.438270+0000","last_undegraded":"2024-09-13T18:53:33.438270+0000","last_fullsized":"2024-09-13T18:53:33.438270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445566+0000","last_change":"2024-09-13T18:53:33.434402+0000","last_active":"2024-09-13T18:53:33.445566+0000","last_peered":"2024-09-13T18:53:33.445566+0000","last_clean":"2024-09-13T18:53:33.445566+0000","last_became_active":"2024-09-13T18:53:33.434088+0000","last_became_peered":"2024-09-13T18:53:33.434088+0000","last_unstale":"2024-09-13T18:53:33.445566+0000","last_undegraded":"2024-09-13T18:53:33.445566+0000","last_fullsized":"2024-09-13T18:53:33.445566+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:53.286165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.439490+0000","last_change":"2024-09-13T18:53:33.438143+0000","last_active":"2024-09-13T18:53:33.439490+0000","last_peered":"2024-09-13T18:53:33.439490+0000","last_clean":"2024-09-13T18:53:33.439490+0000","last_became_active":"2024-09-13T18:53:33.437856+0000","last_became_peered":"2024-09-13T18:53:33.437856+0000","last_unstale":"2024-09-13T18:53:33.439490+0000","last_undegraded":"2024-09-13T18:53:33.439490+0000","last_fullsized":"2024-09-13T18:53:33.439490+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.428422+0000","last_change":"2024-09-13T18:53:33.423517+0000","last_active":"2024-09-13T18:53:33.428422+0000","last_peered":"2024-09-13T18:53:33.428422+0000","last_clean":"2024-09-13T18:53:33.428422+0000","last_became_active":"2024-09-13T18:53:33.423257+0000","last_became_peered":"2024-09-13T18:53:33.423257+0000","last_unstale":"2024-09-13T18:53:33.428422+0000","last_undegraded":"2024-09-13T18:53:33.428422+0000","last_fullsized":"2024-09-13T18:53:33.428422+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445612+0000","last_change":"2024-09-13T18:53:33.443912+0000","last_active":"2024-09-13T18:53:33.445612+0000","last_peered":"2024-09-13T18:53:33.445612+0000","last_clean":"2024-09-13T18:53:33.445612+0000","last_became_active":"2024-09-13T18:53:33.443599+0000","last_became_peered":"2024-09-13T18:53:33.443599+0000","last_unstale":"2024-09-13T18:53:33.445612+0000","last_undegraded":"2024-09-13T18:53:33.445612+0000","last_fullsized":"2024-09-13T18:53:33.445612+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445554+0000","last_change":"2024-09-13T18:53:33.440913+0000","last_active":"2024-09-13T18:53:33.445554+0000","last_peered":"2024-09-13T18:53:33.445554+0000","last_clean":"2024-09-13T18:53:33.445554+0000","last_became_active":"2024-09-13T18:53:33.440641+0000","last_became_peered":"2024-09-13T18:53:33.440641+0000","last_unstale":"2024-09-13T18:53:33.445554+0000","last_undegraded":"2024-09-13T18:53:33.445554+0000","last_fullsized":"2024-09-13T18:53:33.445554+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:20.346936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.432694+0000","last_change":"2024-09-13T18:53:33.430330+0000","last_active":"2024-09-13T18:53:33.432694+0000","last_peered":"2024-09-13T18:53:33.432694+0000","last_clean":"2024-09-13T18:53:33.432694+0000","last_became_active":"2024-09-13T18:53:33.430078+0000","last_became_peered":"2024-09-13T18:53:33.430078+0000","last_unstale":"2024-09-13T18:53:33.432694+0000","last_undegraded":"2024-09-13T18:53:33.432694+0000","last_fullsized":"2024-09-13T18:53:33.432694+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447953+0000","last_change":"2024-09-13T18:53:33.442077+0000","last_active":"2024-09-13T18:53:33.447953+0000","last_peered":"2024-09-13T18:53:33.447953+0000","last_clean":"2024-09-13T18:53:33.447953+0000","last_became_active":"2024-09-13T18:53:33.441750+0000","last_became_peered":"2024-09-13T18:53:33.441750+0000","last_unstale":"2024-09-13T18:53:33.447953+0000","last_undegraded":"2024-09-13T18:53:33.447953+0000","last_fullsized":"2024-09-13T18:53:33.447953+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.805762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438691+0000","last_change":"2024-09-13T18:53:33.424644+0000","last_active":"2024-09-13T18:53:33.438691+0000","last_peered":"2024-09-13T18:53:33.438691+0000","last_clean":"2024-09-13T18:53:33.438691+0000","last_became_active":"2024-09-13T18:53:33.423824+0000","last_became_peered":"2024-09-13T18:53:33.423824+0000","last_unstale":"2024-09-13T18:53:33.438691+0000","last_undegraded":"2024-09-13T18:53:33.438691+0000","last_fullsized":"2024-09-13T18:53:33.438691+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449881+0000","last_change":"2024-09-13T18:53:33.448451+0000","last_active":"2024-09-13T18:53:33.449881+0000","last_peered":"2024-09-13T18:53:33.449881+0000","last_clean":"2024-09-13T18:53:33.449881+0000","last_became_active":"2024-09-13T18:53:33.447977+0000","last_became_peered":"2024-09-13T18:53:33.447977+0000","last_unstale":"2024-09-13T18:53:33.449881+0000","last_undegraded":"2024-09-13T18:53:33.449881+0000","last_fullsized":"2024-09-13T18:53:33.449881+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:57.726616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447907+0000","last_change":"2024-09-13T18:53:33.442697+0000","last_active":"2024-09-13T18:53:33.447907+0000","last_peered":"2024-09-13T18:53:33.447907+0000","last_clean":"2024-09-13T18:53:33.447907+0000","last_became_active":"2024-09-13T18:53:33.442339+0000","last_became_peered":"2024-09-13T18:53:33.442339+0000","last_unstale":"2024-09-13T18:53:33.447907+0000","last_undegraded":"2024-09-13T18:53:33.447907+0000","last_fullsized":"2024-09-13T18:53:33.447907+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447900+0000","last_change":"2024-09-13T18:53:33.435426+0000","last_active":"2024-09-13T18:53:33.447900+0000","last_peered":"2024-09-13T18:53:33.447900+0000","last_clean":"2024-09-13T18:53:33.447900+0000","last_became_active":"2024-09-13T18:53:33.434905+0000","last_became_peered":"2024-09-13T18:53:33.434905+0000","last_unstale":"2024-09-13T18:53:33.447900+0000","last_undegraded":"2024-09-13T18:53:33.447900+0000","last_fullsized":"2024-09-13T18:53:33.447900+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:14:39.591604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448018+0000","last_change":"2024-09-13T18:53:33.443504+0000","last_active":"2024-09-13T18:53:33.448018+0000","last_peered":"2024-09-13T18:53:33.448018+0000","last_clean":"2024-09-13T18:53:33.448018+0000","last_became_active":"2024-09-13T18:53:33.443234+0000","last_became_peered":"2024-09-13T18:53:33.443234+0000","last_unstale":"2024-09-13T18:53:33.448018+0000","last_undegraded":"2024-09-13T18:53:33.448018+0000","last_fullsized":"2024-09-13T18:53:33.448018+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:55.445067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448598+0000","last_change":"2024-09-13T18:53:33.441997+0000","last_active":"2024-09-13T18:53:33.448598+0000","last_peered":"2024-09-13T18:53:33.448598+0000","last_clean":"2024-09-13T18:53:33.448598+0000","last_became_active":"2024-09-13T18:53:33.441749+0000","last_became_peered":"2024-09-13T18:53:33.441749+0000","last_unstale":"2024-09-13T18:53:33.448598+0000","last_undegraded":"2024-09-13T18:53:33.448598+0000","last_fullsized":"2024-09-13T18:53:33.448598+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:54:11.980134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449385+0000","last_change":"2024-09-13T18:53:33.447908+0000","last_active":"2024-09-13T18:53:33.449385+0000","last_peered":"2024-09-13T18:53:33.449385+0000","last_clean":"2024-09-13T18:53:33.449385+0000","last_became_active":"2024-09-13T18:53:33.447617+0000","last_became_peered":"2024-09-13T18:53:33.447617+0000","last_unstale":"2024-09-13T18:53:33.449385+0000","last_undegraded":"2024-09-13T18:53:33.449385+0000","last_fullsized":"2024-09-13T18:53:33.449385+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449008+0000","last_change":"2024-09-13T18:53:33.445473+0000","last_active":"2024-09-13T18:53:33.449008+0000","last_peered":"2024-09-13T18:53:33.449008+0000","last_clean":"2024-09-13T18:53:33.449008+0000","last_became_active":"2024-09-13T18:53:33.445176+0000","last_became_peered":"2024-09-13T18:53:33.445176+0000","last_unstale":"2024-09-13T18:53:33.449008+0000","last_undegraded":"2024-09-13T18:53:33.449008+0000","last_fullsized":"2024-09-13T18:53:33.449008+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436548+0000","last_change":"2024-09-13T18:53:33.432915+0000","last_active":"2024-09-13T18:53:33.436548+0000","last_peered":"2024-09-13T18:53:33.436548+0000","last_clean":"2024-09-13T18:53:33.436548+0000","last_became_active":"2024-09-13T18:53:33.432665+0000","last_became_peered":"2024-09-13T18:53:33.432665+0000","last_unstale":"2024-09-13T18:53:33.436548+0000","last_undegraded":"2024-09-13T18:53:33.436548+0000","last_fullsized":"2024-09-13T18:53:33.436548+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449668+0000","last_change":"2024-09-13T18:53:33.448052+0000","last_active":"2024-09-13T18:53:33.449668+0000","last_peered":"2024-09-13T18:53:33.449668+0000","last_clean":"2024-09-13T18:53:33.449668+0000","last_became_active":"2024-09-13T18:53:33.447731+0000","last_became_peered":"2024-09-13T18:53:33.447731+0000","last_unstale":"2024-09-13T18:53:33.449668+0000","last_undegraded":"2024-09-13T18:53:33.449668+0000","last_fullsized":"2024-09-13T18:53:33.449668+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:36.315201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440412+0000","last_change":"2024-09-13T18:53:33.430950+0000","last_active":"2024-09-13T18:53:33.440412+0000","last_peered":"2024-09-13T18:53:33.440412+0000","last_clean":"2024-09-13T18:53:33.440412+0000","last_became_active":"2024-09-13T18:53:33.430486+0000","last_became_peered":"2024-09-13T18:53:33.430486+0000","last_unstale":"2024-09-13T18:53:33.440412+0000","last_undegraded":"2024-09-13T18:53:33.440412+0000","last_fullsized":"2024-09-13T18:53:33.440412+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.442889+0000","last_change":"2024-09-13T18:53:33.431708+0000","last_active":"2024-09-13T18:53:33.442889+0000","last_peered":"2024-09-13T18:53:33.442889+0000","last_clean":"2024-09-13T18:53:33.442889+0000","last_became_active":"2024-09-13T18:53:33.431440+0000","last_became_peered":"2024-09-13T18:53:33.431440+0000","last_unstale":"2024-09-13T18:53:33.442889+0000","last_undegraded":"2024-09-13T18:53:33.442889+0000","last_fullsized":"2024-09-13T18:53:33.442889+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:30.589532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446141+0000","last_change":"2024-09-13T18:53:33.436197+0000","last_active":"2024-09-13T18:53:33.446141+0000","last_peered":"2024-09-13T18:53:33.446141+0000","last_clean":"2024-09-13T18:53:33.446141+0000","last_became_active":"2024-09-13T18:53:33.435859+0000","last_became_peered":"2024-09-13T18:53:33.435859+0000","last_unstale":"2024-09-13T18:53:33.446141+0000","last_undegraded":"2024-09-13T18:53:33.446141+0000","last_fullsized":"2024-09-13T18:53:33.446141+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:54:40.382194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449878+0000","last_change":"2024-09-13T18:53:33.448354+0000","last_active":"2024-09-13T18:53:33.449878+0000","last_peered":"2024-09-13T18:53:33.449878+0000","last_clean":"2024-09-13T18:53:33.449878+0000","last_became_active":"2024-09-13T18:53:33.447963+0000","last_became_peered":"2024-09-13T18:53:33.447963+0000","last_unstale":"2024-09-13T18:53:33.449878+0000","last_undegraded":"2024-09-13T18:53:33.449878+0000","last_fullsized":"2024-09-13T18:53:33.449878+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440452+0000","last_change":"2024-09-13T18:53:33.438769+0000","last_active":"2024-09-13T18:53:33.440452+0000","last_peered":"2024-09-13T18:53:33.440452+0000","last_clean":"2024-09-13T18:53:33.440452+0000","last_became_active":"2024-09-13T18:53:33.438185+0000","last_became_peered":"2024-09-13T18:53:33.438185+0000","last_unstale":"2024-09-13T18:53:33.440452+0000","last_undegraded":"2024-09-13T18:53:33.440452+0000","last_fullsized":"2024-09-13T18:53:33.440452+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:34.977610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440199+0000","last_change":"2024-09-13T18:53:33.433828+0000","last_active":"2024-09-13T18:53:33.440199+0000","last_peered":"2024-09-13T18:53:33.440199+0000","last_clean":"2024-09-13T18:53:33.440199+0000","last_became_active":"2024-09-13T18:53:33.433610+0000","last_became_peered":"2024-09-13T18:53:33.433610+0000","last_unstale":"2024-09-13T18:53:33.440199+0000","last_undegraded":"2024-09-13T18:53:33.440199+0000","last_fullsized":"2024-09-13T18:53:33.440199+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:34.125452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438659+0000","last_change":"2024-09-13T18:53:33.434456+0000","last_active":"2024-09-13T18:53:33.438659+0000","last_peered":"2024-09-13T18:53:33.438659+0000","last_clean":"2024-09-13T18:53:33.438659+0000","last_became_active":"2024-09-13T18:53:33.431371+0000","last_became_peered":"2024-09-13T18:53:33.431371+0000","last_unstale":"2024-09-13T18:53:33.438659+0000","last_undegraded":"2024-09-13T18:53:33.438659+0000","last_fullsized":"2024-09-13T18:53:33.438659+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:26.007022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445806+0000","last_change":"2024-09-13T18:53:33.443913+0000","last_active":"2024-09-13T18:53:33.445806+0000","last_peered":"2024-09-13T18:53:33.445806+0000","last_clean":"2024-09-13T18:53:33.445806+0000","last_became_active":"2024-09-13T18:53:33.443664+0000","last_became_peered":"2024-09-13T18:53:33.443664+0000","last_unstale":"2024-09-13T18:53:33.445806+0000","last_undegraded":"2024-09-13T18:53:33.445806+0000","last_fullsized":"2024-09-13T18:53:33.445806+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443052+0000","last_change":"2024-09-13T18:53:33.430508+0000","last_active":"2024-09-13T18:53:33.443052+0000","last_peered":"2024-09-13T18:53:33.443052+0000","last_clean":"2024-09-13T18:53:33.443052+0000","last_became_active":"2024-09-13T18:53:33.430240+0000","last_became_peered":"2024-09-13T18:53:33.430240+0000","last_unstale":"2024-09-13T18:53:33.443052+0000","last_undegraded":"2024-09-13T18:53:33.443052+0000","last_fullsized":"2024-09-13T18:53:33.443052+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440238+0000","last_change":"2024-09-13T18:53:33.428827+0000","last_active":"2024-09-13T18:53:33.440238+0000","last_peered":"2024-09-13T18:53:33.440238+0000","last_clean":"2024-09-13T18:53:33.440238+0000","last_became_active":"2024-09-13T18:53:33.428606+0000","last_became_peered":"2024-09-13T18:53:33.428606+0000","last_unstale":"2024-09-13T18:53:33.440238+0000","last_undegraded":"2024-09-13T18:53:33.440238+0000","last_fullsized":"2024-09-13T18:53:33.440238+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:51.528747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440423+0000","last_change":"2024-09-13T18:53:33.432762+0000","last_active":"2024-09-13T18:53:33.440423+0000","last_peered":"2024-09-13T18:53:33.440423+0000","last_clean":"2024-09-13T18:53:33.440423+0000","last_became_active":"2024-09-13T18:53:33.432383+0000","last_became_peered":"2024-09-13T18:53:33.432383+0000","last_unstale":"2024-09-13T18:53:33.440423+0000","last_undegraded":"2024-09-13T18:53:33.440423+0000","last_fullsized":"2024-09-13T18:53:33.440423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:25.336257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450488+0000","last_change":"2024-09-13T18:53:32.974455+0000","last_active":"2024-09-13T18:53:33.450488+0000","last_peered":"2024-09-13T18:53:33.450488+0000","last_clean":"2024-09-13T18:53:33.450488+0000","last_became_active":"2024-09-13T18:53:32.974185+0000","last_became_peered":"2024-09-13T18:53:32.974185+0000","last_unstale":"2024-09-13T18:53:33.450488+0000","last_undegraded":"2024-09-13T18:53:33.450488+0000","last_fullsized":"2024-09-13T18:53:33.450488+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:24:13.889692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.434273+0000","last_change":"2024-09-13T18:53:33.427788+0000","last_active":"2024-09-13T18:53:33.434273+0000","last_peered":"2024-09-13T18:53:33.434273+0000","last_clean":"2024-09-13T18:53:33.434273+0000","last_became_active":"2024-09-13T18:53:33.426899+0000","last_became_peered":"2024-09-13T18:53:33.426899+0000","last_unstale":"2024-09-13T18:53:33.434273+0000","last_undegraded":"2024-09-13T18:53:33.434273+0000","last_fullsized":"2024-09-13T18:53:33.434273+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:59.976141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445606+0000","last_change":"2024-09-13T18:53:32.974168+0000","last_active":"2024-09-13T18:53:33.445606+0000","last_peered":"2024-09-13T18:53:33.445606+0000","last_clean":"2024-09-13T18:53:33.445606+0000","last_became_active":"2024-09-13T18:53:32.973823+0000","last_became_peered":"2024-09-13T18:53:32.973823+0000","last_unstale":"2024-09-13T18:53:33.445606+0000","last_undegraded":"2024-09-13T18:53:33.445606+0000","last_fullsized":"2024-09-13T18:53:33.445606+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:53.038961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436492+0000","last_change":"2024-09-13T18:53:33.432492+0000","last_active":"2024-09-13T18:53:33.436492+0000","last_peered":"2024-09-13T18:53:33.436492+0000","last_clean":"2024-09-13T18:53:33.436492+0000","last_became_active":"2024-09-13T18:53:33.432227+0000","last_became_peered":"2024-09-13T18:53:33.432227+0000","last_unstale":"2024-09-13T18:53:33.436492+0000","last_undegraded":"2024-09-13T18:53:33.436492+0000","last_fullsized":"2024-09-13T18:53:33.436492+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443631+0000","last_change":"2024-09-13T18:53:32.982524+0000","last_active":"2024-09-13T18:53:33.443631+0000","last_peered":"2024-09-13T18:53:33.443631+0000","last_clean":"2024-09-13T18:53:33.443631+0000","last_became_active":"2024-09-13T18:53:32.982071+0000","last_became_peered":"2024-09-13T18:53:32.982071+0000","last_unstale":"2024-09-13T18:53:33.443631+0000","last_undegraded":"2024-09-13T18:53:33.443631+0000","last_fullsized":"2024-09-13T18:53:33.443631+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446231+0000","last_change":"2024-09-13T18:53:33.437583+0000","last_active":"2024-09-13T18:53:33.446231+0000","last_peered":"2024-09-13T18:53:33.446231+0000","last_clean":"2024-09-13T18:53:33.446231+0000","last_became_active":"2024-09-13T18:53:33.436456+0000","last_became_peered":"2024-09-13T18:53:33.436456+0000","last_unstale":"2024-09-13T18:53:33.446231+0000","last_undegraded":"2024-09-13T18:53:33.446231+0000","last_fullsized":"2024-09-13T18:53:33.446231+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:27.303458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.451624+0000","last_change":"2024-09-13T18:53:32.969226+0000","last_active":"2024-09-13T18:53:33.451624+0000","last_peered":"2024-09-13T18:53:33.451624+0000","last_clean":"2024-09-13T18:53:33.451624+0000","last_became_active":"2024-09-13T18:53:32.968542+0000","last_became_peered":"2024-09-13T18:53:32.968542+0000","last_unstale":"2024-09-13T18:53:33.451624+0000","last_undegraded":"2024-09-13T18:53:33.451624+0000","last_fullsized":"2024-09-13T18:53:33.451624+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446351+0000","last_change":"2024-09-13T18:53:33.438180+0000","last_active":"2024-09-13T18:53:33.446351+0000","last_peered":"2024-09-13T18:53:33.446351+0000","last_clean":"2024-09-13T18:53:33.446351+0000","last_became_active":"2024-09-13T18:53:33.437943+0000","last_became_peered":"2024-09-13T18:53:33.437943+0000","last_unstale":"2024-09-13T18:53:33.446351+0000","last_undegraded":"2024-09-13T18:53:33.446351+0000","last_fullsized":"2024-09-13T18:53:33.446351+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.442551+0000","last_change":"2024-09-13T18:53:32.979540+0000","last_active":"2024-09-13T18:53:33.442551+0000","last_peered":"2024-09-13T18:53:33.442551+0000","last_clean":"2024-09-13T18:53:33.442551+0000","last_became_active":"2024-09-13T18:53:32.979212+0000","last_became_peered":"2024-09-13T18:53:32.979212+0000","last_unstale":"2024-09-13T18:53:33.442551+0000","last_undegraded":"2024-09-13T18:53:33.442551+0000","last_fullsized":"2024-09-13T18:53:33.442551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:53.373570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440391+0000","last_change":"2024-09-13T18:53:33.430753+0000","last_active":"2024-09-13T18:53:33.440391+0000","last_peered":"2024-09-13T18:53:33.440391+0000","last_clean":"2024-09-13T18:53:33.440391+0000","last_became_active":"2024-09-13T18:53:33.430049+0000","last_became_peered":"2024-09-13T18:53:33.430049+0000","last_unstale":"2024-09-13T18:53:33.440391+0000","last_undegraded":"2024-09-13T18:53:33.440391+0000","last_fullsized":"2024-09-13T18:53:33.440391+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446323+0000","last_change":"2024-09-13T18:53:32.975163+0000","last_active":"2024-09-13T18:53:33.446323+0000","last_peered":"2024-09-13T18:53:33.446323+0000","last_clean":"2024-09-13T18:53:33.446323+0000","last_became_active":"2024-09-13T18:53:32.974855+0000","last_became_peered":"2024-09-13T18:53:32.974855+0000","last_unstale":"2024-09-13T18:53:33.446323+0000","last_undegraded":"2024-09-13T18:53:33.446323+0000","last_fullsized":"2024-09-13T18:53:33.446323+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445981+0000","last_change":"2024-09-13T18:53:33.436344+0000","last_active":"2024-09-13T18:53:33.445981+0000","last_peered":"2024-09-13T18:53:33.445981+0000","last_clean":"2024-09-13T18:53:33.445981+0000","last_became_active":"2024-09-13T18:53:33.432746+0000","last_became_peered":"2024-09-13T18:53:33.432746+0000","last_unstale":"2024-09-13T18:53:33.445981+0000","last_undegraded":"2024-09-13T18:53:33.445981+0000","last_fullsized":"2024-09-13T18:53:33.445981+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:05.116179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.432778+0000","last_change":"2024-09-13T18:53:32.974717+0000","last_active":"2024-09-13T18:53:33.432778+0000","last_peered":"2024-09-13T18:53:33.432778+0000","last_clean":"2024-09-13T18:53:33.432778+0000","last_became_active":"2024-09-13T18:53:32.974438+0000","last_became_peered":"2024-09-13T18:53:32.974438+0000","last_unstale":"2024-09-13T18:53:33.432778+0000","last_undegraded":"2024-09-13T18:53:33.432778+0000","last_fullsized":"2024-09-13T18:53:33.432778+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:52:58.112314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.439835+0000","last_change":"2024-09-13T18:53:33.431320+0000","last_active":"2024-09-13T18:53:33.439835+0000","last_peered":"2024-09-13T18:53:33.439835+0000","last_clean":"2024-09-13T18:53:33.439835+0000","last_became_active":"2024-09-13T18:53:33.428033+0000","last_became_peered":"2024-09-13T18:53:33.428033+0000","last_unstale":"2024-09-13T18:53:33.439835+0000","last_undegraded":"2024-09-13T18:53:33.439835+0000","last_fullsized":"2024-09-13T18:53:33.439835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:30.778361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415553+0000","last_change":"2024-09-13T18:53:32.977072+0000","last_active":"2024-09-13T18:53:33.415553+0000","last_peered":"2024-09-13T18:53:33.415553+0000","last_clean":"2024-09-13T18:53:33.415553+0000","last_became_active":"2024-09-13T18:53:32.974368+0000","last_became_peered":"2024-09-13T18:53:32.974368+0000","last_unstale":"2024-09-13T18:53:33.415553+0000","last_undegraded":"2024-09-13T18:53:33.415553+0000","last_fullsized":"2024-09-13T18:53:33.415553+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448023+0000","last_change":"2024-09-13T18:53:33.446118+0000","last_active":"2024-09-13T18:53:33.448023+0000","last_peered":"2024-09-13T18:53:33.448023+0000","last_clean":"2024-09-13T18:53:33.448023+0000","last_became_active":"2024-09-13T18:53:33.445868+0000","last_became_peered":"2024-09-13T18:53:33.445868+0000","last_unstale":"2024-09-13T18:53:33.448023+0000","last_undegraded":"2024-09-13T18:53:33.448023+0000","last_fullsized":"2024-09-13T18:53:33.448023+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:53:59.044544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.428511+0000","last_change":"2024-09-13T18:53:32.971936+0000","last_active":"2024-09-13T18:53:33.428511+0000","last_peered":"2024-09-13T18:53:33.428511+0000","last_clean":"2024-09-13T18:53:33.428511+0000","last_became_active":"2024-09-13T18:53:32.971646+0000","last_became_peered":"2024-09-13T18:53:32.971646+0000","last_unstale":"2024-09-13T18:53:33.428511+0000","last_undegraded":"2024-09-13T18:53:33.428511+0000","last_fullsized":"2024-09-13T18:53:33.428511+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:17.197602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.435510+0000","last_change":"2024-09-13T18:53:33.433060+0000","last_active":"2024-09-13T18:53:33.435510+0000","last_peered":"2024-09-13T18:53:33.435510+0000","last_clean":"2024-09-13T18:53:33.435510+0000","last_became_active":"2024-09-13T18:53:33.432785+0000","last_became_peered":"2024-09-13T18:53:33.432785+0000","last_unstale":"2024-09-13T18:53:33.435510+0000","last_undegraded":"2024-09-13T18:53:33.435510+0000","last_fullsized":"2024-09-13T18:53:33.435510+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436064+0000","last_change":"2024-09-13T18:53:32.975559+0000","last_active":"2024-09-13T18:53:33.436064+0000","last_peered":"2024-09-13T18:53:33.436064+0000","last_clean":"2024-09-13T18:53:33.436064+0000","last_became_active":"2024-09-13T18:53:32.975226+0000","last_became_peered":"2024-09-13T18:53:32.975226+0000","last_unstale":"2024-09-13T18:53:33.436064+0000","last_undegraded":"2024-09-13T18:53:33.436064+0000","last_fullsized":"2024-09-13T18:53:33.436064+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:56.754508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.444033+0000","last_change":"2024-09-13T18:53:33.441520+0000","last_active":"2024-09-13T18:53:33.444033+0000","last_peered":"2024-09-13T18:53:33.444033+0000","last_clean":"2024-09-13T18:53:33.444033+0000","last_became_active":"2024-09-13T18:53:33.441260+0000","last_became_peered":"2024-09-13T18:53:33.441260+0000","last_unstale":"2024-09-13T18:53:33.444033+0000","last_undegraded":"2024-09-13T18:53:33.444033+0000","last_fullsized":"2024-09-13T18:53:33.444033+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:46.856863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"92'3","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450715+0000","last_change":"2024-09-13T18:53:32.979461+0000","last_active":"2024-09-13T18:53:33.450715+0000","last_peered":"2024-09-13T18:53:33.450715+0000","last_clean":"2024-09-13T18:53:33.450715+0000","last_became_active":"2024-09-13T18:53:32.978929+0000","last_became_peered":"2024-09-13T18:53:32.978929+0000","last_unstale":"2024-09-13T18:53:33.450715+0000","last_undegraded":"2024-09-13T18:53:33.450715+0000","last_fullsized":"2024-09-13T18:53:33.450715+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:54.837875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443170+0000","last_change":"2024-09-13T18:53:33.435893+0000","last_active":"2024-09-13T18:53:33.443170+0000","last_peered":"2024-09-13T18:53:33.443170+0000","last_clean":"2024-09-13T18:53:33.443170+0000","last_became_active":"2024-09-13T18:53:33.435663+0000","last_became_peered":"2024-09-13T18:53:33.435663+0000","last_unstale":"2024-09-13T18:53:33.443170+0000","last_undegraded":"2024-09-13T18:53:33.443170+0000","last_fullsized":"2024-09-13T18:53:33.443170+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450758+0000","last_change":"2024-09-13T18:53:32.962678+0000","last_active":"2024-09-13T18:53:33.450758+0000","last_peered":"2024-09-13T18:53:33.450758+0000","last_clean":"2024-09-13T18:53:33.450758+0000","last_became_active":"2024-09-13T18:53:32.962353+0000","last_became_peered":"2024-09-13T18:53:32.962353+0000","last_unstale":"2024-09-13T18:53:33.450758+0000","last_undegraded":"2024-09-13T18:53:33.450758+0000","last_fullsized":"2024-09-13T18:53:33.450758+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:21.019937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436712+0000","last_change":"2024-09-13T18:53:33.424091+0000","last_active":"2024-09-13T18:53:33.436712+0000","last_peered":"2024-09-13T18:53:33.436712+0000","last_clean":"2024-09-13T18:53:33.436712+0000","last_became_active":"2024-09-13T18:53:33.423842+0000","last_became_peered":"2024-09-13T18:53:33.423842+0000","last_unstale":"2024-09-13T18:53:33.436712+0000","last_undegraded":"2024-09-13T18:53:33.436712+0000","last_fullsized":"2024-09-13T18:53:33.436712+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450658+0000","last_change":"2024-09-13T18:53:32.977043+0000","last_active":"2024-09-13T18:53:33.450658+0000","last_peered":"2024-09-13T18:53:33.450658+0000","last_clean":"2024-09-13T18:53:33.450658+0000","last_became_active":"2024-09-13T18:53:32.974269+0000","last_became_peered":"2024-09-13T18:53:32.974269+0000","last_unstale":"2024-09-13T18:53:33.450658+0000","last_undegraded":"2024-09-13T18:53:33.450658+0000","last_fullsized":"2024-09-13T18:53:33.450658+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.438735+0000","last_change":"2024-09-13T18:53:33.438113+0000","last_active":"2024-09-13T18:53:33.438735+0000","last_peered":"2024-09-13T18:53:33.438735+0000","last_clean":"2024-09-13T18:53:33.438735+0000","last_became_active":"2024-09-13T18:53:33.437855+0000","last_became_peered":"2024-09-13T18:53:33.437855+0000","last_unstale":"2024-09-13T18:53:33.438735+0000","last_undegraded":"2024-09-13T18:53:33.438735+0000","last_fullsized":"2024-09-13T18:53:33.438735+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.418056+0000","last_change":"2024-09-13T18:53:32.968390+0000","last_active":"2024-09-13T18:53:33.418056+0000","last_peered":"2024-09-13T18:53:33.418056+0000","last_clean":"2024-09-13T18:53:33.418056+0000","last_became_active":"2024-09-13T18:53:32.968173+0000","last_became_peered":"2024-09-13T18:53:32.968173+0000","last_unstale":"2024-09-13T18:53:33.418056+0000","last_undegraded":"2024-09-13T18:53:33.418056+0000","last_fullsized":"2024-09-13T18:53:33.418056+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:16.066340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445747+0000","last_change":"2024-09-13T18:53:33.440531+0000","last_active":"2024-09-13T18:53:33.445747+0000","last_peered":"2024-09-13T18:53:33.445747+0000","last_clean":"2024-09-13T18:53:33.445747+0000","last_became_active":"2024-09-13T18:53:33.440275+0000","last_became_peered":"2024-09-13T18:53:33.440275+0000","last_unstale":"2024-09-13T18:53:33.445747+0000","last_undegraded":"2024-09-13T18:53:33.445747+0000","last_fullsized":"2024-09-13T18:53:33.445747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:04:00.853298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415690+0000","last_change":"2024-09-13T18:53:32.978943+0000","last_active":"2024-09-13T18:53:33.415690+0000","last_peered":"2024-09-13T18:53:33.415690+0000","last_clean":"2024-09-13T18:53:33.415690+0000","last_became_active":"2024-09-13T18:53:32.978004+0000","last_became_peered":"2024-09-13T18:53:32.978004+0000","last_unstale":"2024-09-13T18:53:33.415690+0000","last_undegraded":"2024-09-13T18:53:33.415690+0000","last_fullsized":"2024-09-13T18:53:33.415690+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.430520+0000","last_change":"2024-09-13T18:53:33.426781+0000","last_active":"2024-09-13T18:53:33.430520+0000","last_peered":"2024-09-13T18:53:33.430520+0000","last_clean":"2024-09-13T18:53:33.430520+0000","last_became_active":"2024-09-13T18:53:33.426520+0000","last_became_peered":"2024-09-13T18:53:33.426520+0000","last_unstale":"2024-09-13T18:53:33.430520+0000","last_undegraded":"2024-09-13T18:53:33.430520+0000","last_fullsized":"2024-09-13T18:53:33.430520+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:35.073791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":19,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450471+0000","last_change":"2024-09-13T18:53:32.972297+0000","last_active":"2024-09-13T18:53:33.450471+0000","last_peered":"2024-09-13T18:53:33.450471+0000","last_clean":"2024-09-13T18:53:33.450471+0000","last_became_active":"2024-09-13T18:53:32.972040+0000","last_became_peered":"2024-09-13T18:53:32.972040+0000","last_unstale":"2024-09-13T18:53:33.450471+0000","last_undegraded":"2024-09-13T18:53:33.450471+0000","last_fullsized":"2024-09-13T18:53:33.450471+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.440376+0000","last_change":"2024-09-13T18:53:33.432609+0000","last_active":"2024-09-13T18:53:33.440376+0000","last_peered":"2024-09-13T18:53:33.440376+0000","last_clean":"2024-09-13T18:53:33.440376+0000","last_became_active":"2024-09-13T18:53:33.432061+0000","last_became_peered":"2024-09-13T18:53:33.432061+0000","last_unstale":"2024-09-13T18:53:33.440376+0000","last_undegraded":"2024-09-13T18:53:33.440376+0000","last_fullsized":"2024-09-13T18:53:33.440376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:00.543904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.444512+0000","last_change":"2024-09-13T18:53:32.966972+0000","last_active":"2024-09-13T18:53:33.444512+0000","last_peered":"2024-09-13T18:53:33.444512+0000","last_clean":"2024-09-13T18:53:33.444512+0000","last_became_active":"2024-09-13T18:53:32.966526+0000","last_became_peered":"2024-09-13T18:53:32.966526+0000","last_unstale":"2024-09-13T18:53:33.444512+0000","last_undegraded":"2024-09-13T18:53:33.444512+0000","last_fullsized":"2024-09-13T18:53:33.444512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:32:58.976298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.444193+0000","last_change":"2024-09-13T18:53:33.434995+0000","last_active":"2024-09-13T18:53:33.444193+0000","last_peered":"2024-09-13T18:53:33.444193+0000","last_clean":"2024-09-13T18:53:33.444193+0000","last_became_active":"2024-09-13T18:53:33.434685+0000","last_became_peered":"2024-09-13T18:53:33.434685+0000","last_unstale":"2024-09-13T18:53:33.444193+0000","last_undegraded":"2024-09-13T18:53:33.444193+0000","last_fullsized":"2024-09-13T18:53:33.444193+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447178+0000","last_change":"2024-09-13T18:53:32.976908+0000","last_active":"2024-09-13T18:53:33.447178+0000","last_peered":"2024-09-13T18:53:33.447178+0000","last_clean":"2024-09-13T18:53:33.447178+0000","last_became_active":"2024-09-13T18:53:32.976653+0000","last_became_peered":"2024-09-13T18:53:32.976653+0000","last_unstale":"2024-09-13T18:53:33.447178+0000","last_undegraded":"2024-09-13T18:53:33.447178+0000","last_fullsized":"2024-09-13T18:53:33.447178+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.434027+0000","last_change":"2024-09-13T18:53:33.429127+0000","last_active":"2024-09-13T18:53:33.434027+0000","last_peered":"2024-09-13T18:53:33.434027+0000","last_clean":"2024-09-13T18:53:33.434027+0000","last_became_active":"2024-09-13T18:53:33.428857+0000","last_became_peered":"2024-09-13T18:53:33.428857+0000","last_unstale":"2024-09-13T18:53:33.434027+0000","last_undegraded":"2024-09-13T18:53:33.434027+0000","last_fullsized":"2024-09-13T18:53:33.434027+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:40.191981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"92'1","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449336+0000","last_change":"2024-09-13T18:53:32.976609+0000","last_active":"2024-09-13T18:53:33.449336+0000","last_peered":"2024-09-13T18:53:33.449336+0000","last_clean":"2024-09-13T18:53:33.449336+0000","last_became_active":"2024-09-13T18:53:32.976333+0000","last_became_peered":"2024-09-13T18:53:32.976333+0000","last_unstale":"2024-09-13T18:53:33.449336+0000","last_undegraded":"2024-09-13T18:53:33.449336+0000","last_fullsized":"2024-09-13T18:53:33.449336+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:53.755995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447919+0000","last_change":"2024-09-13T18:53:33.435567+0000","last_active":"2024-09-13T18:53:33.447919+0000","last_peered":"2024-09-13T18:53:33.447919+0000","last_clean":"2024-09-13T18:53:33.447919+0000","last_became_active":"2024-09-13T18:53:33.435197+0000","last_became_peered":"2024-09-13T18:53:33.435197+0000","last_unstale":"2024-09-13T18:53:33.447919+0000","last_undegraded":"2024-09-13T18:53:33.447919+0000","last_fullsized":"2024-09-13T18:53:33.447919+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:18.970121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446075+0000","last_change":"2024-09-13T18:53:32.976670+0000","last_active":"2024-09-13T18:53:33.446075+0000","last_peered":"2024-09-13T18:53:33.446075+0000","last_clean":"2024-09-13T18:53:33.446075+0000","last_became_active":"2024-09-13T18:53:32.976354+0000","last_became_peered":"2024-09-13T18:53:32.976354+0000","last_unstale":"2024-09-13T18:53:33.446075+0000","last_undegraded":"2024-09-13T18:53:33.446075+0000","last_fullsized":"2024-09-13T18:53:33.446075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:24:45.215486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446191+0000","last_change":"2024-09-13T18:53:33.437557+0000","last_active":"2024-09-13T18:53:33.446191+0000","last_peered":"2024-09-13T18:53:33.446191+0000","last_clean":"2024-09-13T18:53:33.446191+0000","last_became_active":"2024-09-13T18:53:33.437254+0000","last_became_peered":"2024-09-13T18:53:33.437254+0000","last_unstale":"2024-09-13T18:53:33.446191+0000","last_undegraded":"2024-09-13T18:53:33.446191+0000","last_fullsized":"2024-09-13T18:53:33.446191+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:51.928243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.422898+0000","last_change":"2024-09-13T18:53:32.966984+0000","last_active":"2024-09-13T18:53:33.422898+0000","last_peered":"2024-09-13T18:53:33.422898+0000","last_clean":"2024-09-13T18:53:33.422898+0000","last_became_active":"2024-09-13T18:53:32.966665+0000","last_became_peered":"2024-09-13T18:53:32.966665+0000","last_unstale":"2024-09-13T18:53:33.422898+0000","last_undegraded":"2024-09-13T18:53:33.422898+0000","last_fullsized":"2024-09-13T18:53:33.422898+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:40.908915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.446804+0000","last_change":"2024-09-13T18:53:33.442786+0000","last_active":"2024-09-13T18:53:33.446804+0000","last_peered":"2024-09-13T18:53:33.446804+0000","last_clean":"2024-09-13T18:53:33.446804+0000","last_became_active":"2024-09-13T18:53:33.442495+0000","last_became_peered":"2024-09-13T18:53:33.442495+0000","last_unstale":"2024-09-13T18:53:33.446804+0000","last_undegraded":"2024-09-13T18:53:33.446804+0000","last_fullsized":"2024-09-13T18:53:33.446804+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:27.236209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.421843+0000","last_change":"2024-09-13T18:53:32.977136+0000","last_active":"2024-09-13T18:53:33.421843+0000","last_peered":"2024-09-13T18:53:33.421843+0000","last_clean":"2024-09-13T18:53:33.421843+0000","last_became_active":"2024-09-13T18:53:32.974769+0000","last_became_peered":"2024-09-13T18:53:32.974769+0000","last_unstale":"2024-09-13T18:53:33.421843+0000","last_undegraded":"2024-09-13T18:53:33.421843+0000","last_fullsized":"2024-09-13T18:53:33.421843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:09.917237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.434443+0000","last_change":"2024-09-13T18:53:33.426594+0000","last_active":"2024-09-13T18:53:33.434443+0000","last_peered":"2024-09-13T18:53:33.434443+0000","last_clean":"2024-09-13T18:53:33.434443+0000","last_became_active":"2024-09-13T18:53:33.426310+0000","last_became_peered":"2024-09-13T18:53:33.426310+0000","last_unstale":"2024-09-13T18:53:33.434443+0000","last_undegraded":"2024-09-13T18:53:33.434443+0000","last_fullsized":"2024-09-13T18:53:33.434443+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:59.087816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.422832+0000","last_change":"2024-09-13T18:53:32.973495+0000","last_active":"2024-09-13T18:53:33.422832+0000","last_peered":"2024-09-13T18:53:33.422832+0000","last_clean":"2024-09-13T18:53:33.422832+0000","last_became_active":"2024-09-13T18:53:32.973173+0000","last_became_peered":"2024-09-13T18:53:32.973173+0000","last_unstale":"2024-09-13T18:53:33.422832+0000","last_undegraded":"2024-09-13T18:53:33.422832+0000","last_fullsized":"2024-09-13T18:53:33.422832+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:11.941564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.445229+0000","last_change":"2024-09-13T18:53:33.441580+0000","last_active":"2024-09-13T18:53:33.445229+0000","last_peered":"2024-09-13T18:53:33.445229+0000","last_clean":"2024-09-13T18:53:33.445229+0000","last_became_active":"2024-09-13T18:53:33.441385+0000","last_became_peered":"2024-09-13T18:53:33.441385+0000","last_unstale":"2024-09-13T18:53:33.445229+0000","last_undegraded":"2024-09-13T18:53:33.445229+0000","last_fullsized":"2024-09-13T18:53:33.445229+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:44:13.051938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":13,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.449475+0000","last_change":"2024-09-13T18:53:32.975551+0000","last_active":"2024-09-13T18:53:33.449475+0000","last_peered":"2024-09-13T18:53:33.449475+0000","last_clean":"2024-09-13T18:53:33.449475+0000","last_became_active":"2024-09-13T18:53:32.973976+0000","last_became_peered":"2024-09-13T18:53:32.973976+0000","last_unstale":"2024-09-13T18:53:33.449475+0000","last_undegraded":"2024-09-13T18:53:33.449475+0000","last_fullsized":"2024-09-13T18:53:33.449475+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:57.478624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.447976+0000","last_change":"2024-09-13T18:53:33.434327+0000","last_active":"2024-09-13T18:53:33.447976+0000","last_peered":"2024-09-13T18:53:33.447976+0000","last_clean":"2024-09-13T18:53:33.447976+0000","last_became_active":"2024-09-13T18:53:33.433696+0000","last_became_peered":"2024-09-13T18:53:33.433696+0000","last_unstale":"2024-09-13T18:53:33.447976+0000","last_undegraded":"2024-09-13T18:53:33.447976+0000","last_fullsized":"2024-09-13T18:53:33.447976+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:32.417668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.421379+0000","last_change":"2024-09-13T18:53:32.978157+0000","last_active":"2024-09-13T18:53:33.421379+0000","last_peered":"2024-09-13T18:53:33.421379+0000","last_clean":"2024-09-13T18:53:33.421379+0000","last_became_active":"2024-09-13T18:53:32.977850+0000","last_became_peered":"2024-09-13T18:53:32.977850+0000","last_unstale":"2024-09-13T18:53:33.421379+0000","last_undegraded":"2024-09-13T18:53:33.421379+0000","last_fullsized":"2024-09-13T18:53:33.421379+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:07.000712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436788+0000","last_change":"2024-09-13T18:53:33.432306+0000","last_active":"2024-09-13T18:53:33.436788+0000","last_peered":"2024-09-13T18:53:33.436788+0000","last_clean":"2024-09-13T18:53:33.436788+0000","last_became_active":"2024-09-13T18:53:33.431427+0000","last_became_peered":"2024-09-13T18:53:33.431427+0000","last_unstale":"2024-09-13T18:53:33.436788+0000","last_undegraded":"2024-09-13T18:53:33.436788+0000","last_fullsized":"2024-09-13T18:53:33.436788+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.226459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.426682+0000","last_change":"2024-09-13T18:53:32.977923+0000","last_active":"2024-09-13T18:53:33.426682+0000","last_peered":"2024-09-13T18:53:33.426682+0000","last_clean":"2024-09-13T18:53:33.426682+0000","last_became_active":"2024-09-13T18:53:32.977485+0000","last_became_peered":"2024-09-13T18:53:32.977485+0000","last_unstale":"2024-09-13T18:53:33.426682+0000","last_undegraded":"2024-09-13T18:53:33.426682+0000","last_fullsized":"2024-09-13T18:53:33.426682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:33.319921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443176+0000","last_change":"2024-09-13T18:53:33.432658+0000","last_active":"2024-09-13T18:53:33.443176+0000","last_peered":"2024-09-13T18:53:33.443176+0000","last_clean":"2024-09-13T18:53:33.443176+0000","last_became_active":"2024-09-13T18:53:33.432392+0000","last_became_peered":"2024-09-13T18:53:33.432392+0000","last_unstale":"2024-09-13T18:53:33.443176+0000","last_undegraded":"2024-09-13T18:53:33.443176+0000","last_fullsized":"2024-09-13T18:53:33.443176+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.424489+0000","last_change":"2024-09-13T18:53:32.969065+0000","last_active":"2024-09-13T18:53:33.424489+0000","last_peered":"2024-09-13T18:53:33.424489+0000","last_clean":"2024-09-13T18:53:33.424489+0000","last_became_active":"2024-09-13T18:53:32.968189+0000","last_became_peered":"2024-09-13T18:53:32.968189+0000","last_unstale":"2024-09-13T18:53:33.424489+0000","last_undegraded":"2024-09-13T18:53:33.424489+0000","last_fullsized":"2024-09-13T18:53:33.424489+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:39:58.695627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.436636+0000","last_change":"2024-09-13T18:53:33.433371+0000","last_active":"2024-09-13T18:53:33.436636+0000","last_peered":"2024-09-13T18:53:33.436636+0000","last_clean":"2024-09-13T18:53:33.436636+0000","last_became_active":"2024-09-13T18:53:33.433122+0000","last_became_peered":"2024-09-13T18:53:33.433122+0000","last_unstale":"2024-09-13T18:53:33.436636+0000","last_undegraded":"2024-09-13T18:53:33.436636+0000","last_fullsized":"2024-09-13T18:53:33.436636+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:40:29.365964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.417894+0000","last_change":"2024-09-13T18:53:32.971783+0000","last_active":"2024-09-13T18:53:33.417894+0000","last_peered":"2024-09-13T18:53:33.417894+0000","last_clean":"2024-09-13T18:53:33.417894+0000","last_became_active":"2024-09-13T18:53:32.971544+0000","last_became_peered":"2024-09-13T18:53:32.971544+0000","last_unstale":"2024-09-13T18:53:33.417894+0000","last_undegraded":"2024-09-13T18:53:33.417894+0000","last_fullsized":"2024-09-13T18:53:33.417894+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:19.672579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.450116+0000","last_change":"2024-09-13T18:53:33.445208+0000","last_active":"2024-09-13T18:53:33.450116+0000","last_peered":"2024-09-13T18:53:33.450116+0000","last_clean":"2024-09-13T18:53:33.450116+0000","last_became_active":"2024-09-13T18:53:33.445002+0000","last_became_peered":"2024-09-13T18:53:33.445002+0000","last_unstale":"2024-09-13T18:53:33.450116+0000","last_undegraded":"2024-09-13T18:53:33.450116+0000","last_fullsized":"2024-09-13T18:53:33.450116+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:25.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.422623+0000","last_change":"2024-09-13T18:53:32.979624+0000","last_active":"2024-09-13T18:53:33.422623+0000","last_peered":"2024-09-13T18:53:33.422623+0000","last_clean":"2024-09-13T18:53:33.422623+0000","last_became_active":"2024-09-13T18:53:32.979380+0000","last_became_peered":"2024-09-13T18:53:32.979380+0000","last_unstale":"2024-09-13T18:53:33.422623+0000","last_undegraded":"2024-09-13T18:53:33.422623+0000","last_fullsized":"2024-09-13T18:53:33.422623+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:30:23.523342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.441751+0000","last_change":"2024-09-13T18:53:33.434205+0000","last_active":"2024-09-13T18:53:33.441751+0000","last_peered":"2024-09-13T18:53:33.441751+0000","last_clean":"2024-09-13T18:53:33.441751+0000","last_became_active":"2024-09-13T18:53:33.430464+0000","last_became_peered":"2024-09-13T18:53:33.430464+0000","last_unstale":"2024-09-13T18:53:33.441751+0000","last_undegraded":"2024-09-13T18:53:33.441751+0000","last_fullsized":"2024-09-13T18:53:33.441751+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:43.166750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.424629+0000","last_change":"2024-09-13T18:53:32.971426+0000","last_active":"2024-09-13T18:53:33.424629+0000","last_peered":"2024-09-13T18:53:33.424629+0000","last_clean":"2024-09-13T18:53:33.424629+0000","last_became_active":"2024-09-13T18:53:32.971188+0000","last_became_peered":"2024-09-13T18:53:32.971188+0000","last_unstale":"2024-09-13T18:53:33.424629+0000","last_undegraded":"2024-09-13T18:53:33.424629+0000","last_fullsized":"2024-09-13T18:53:33.424629+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:48.187135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.448129+0000","last_change":"2024-09-13T18:53:33.446250+0000","last_active":"2024-09-13T18:53:33.448129+0000","last_peered":"2024-09-13T18:53:33.448129+0000","last_clean":"2024-09-13T18:53:33.448129+0000","last_became_active":"2024-09-13T18:53:33.445591+0000","last_became_peered":"2024-09-13T18:53:33.445591+0000","last_unstale":"2024-09-13T18:53:33.448129+0000","last_undegraded":"2024-09-13T18:53:33.448129+0000","last_fullsized":"2024-09-13T18:53:33.448129+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:02.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415291+0000","last_change":"2024-09-13T18:53:32.977404+0000","last_active":"2024-09-13T18:53:33.415291+0000","last_peered":"2024-09-13T18:53:33.415291+0000","last_clean":"2024-09-13T18:53:33.415291+0000","last_became_active":"2024-09-13T18:53:32.977089+0000","last_became_peered":"2024-09-13T18:53:32.977089+0000","last_unstale":"2024-09-13T18:53:33.415291+0000","last_undegraded":"2024-09-13T18:53:33.415291+0000","last_fullsized":"2024-09-13T18:53:33.415291+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:55.197181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":10,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.443092+0000","last_change":"2024-09-13T18:53:33.441985+0000","last_active":"2024-09-13T18:53:33.443092+0000","last_peered":"2024-09-13T18:53:33.443092+0000","last_clean":"2024-09-13T18:53:33.443092+0000","last_became_active":"2024-09-13T18:53:33.441735+0000","last_became_peered":"2024-09-13T18:53:33.441735+0000","last_unstale":"2024-09-13T18:53:33.443092+0000","last_undegraded":"2024-09-13T18:53:33.443092+0000","last_fullsized":"2024-09-13T18:53:33.443092+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:32.934243+0000","last_clean_scrub_stamp":"2024-09-13T18:53:32.934243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:53.013038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.416513+0000","last_change":"2024-09-13T18:53:32.978373+0000","last_active":"2024-09-13T18:53:33.416513+0000","last_peered":"2024-09-13T18:53:33.416513+0000","last_clean":"2024-09-13T18:53:33.416513+0000","last_became_active":"2024-09-13T18:53:32.977238+0000","last_became_peered":"2024-09-13T18:53:32.977238+0000","last_unstale":"2024-09-13T18:53:33.416513+0000","last_undegraded":"2024-09-13T18:53:33.416513+0000","last_fullsized":"2024-09-13T18:53:33.416513+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:53:31.919804+0000","last_clean_scrub_stamp":"2024-09-13T18:53:31.919804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:39.620579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":225,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-13T18:53:33.415429+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:53:33.415429+0000","last_peered":"2024-09-13T18:53:33.415429+0000","last_clean":"2024-09-13T18:53:33.415429+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:53:33.415429+0000","last_undegraded":"2024-09-13T18:53:33.415429+0000","last_fullsized":"2024-09-13T18:53:33.415429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574931,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32832,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339008,"statfs":{"total":96636764160,"available":96603144192,"internally_reserved":0,"allocated":1748992,"data_stored":1118704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.415,"5min":1.72,"15min":1.72},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.68600000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.524,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.054}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.117,"15min":1.137},"min":{"1min":0.79100000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.1259999999999999,"15min":1.208},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.262}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.79200000000000004,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.605,"5min":1.885,"15min":1.885},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1890000000000001,"15min":1.206},"min":{"1min":0.97199999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.4399999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.0940000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.2649999999999999,"15min":1.2749999999999999},"min":{"1min":0.94799999999999995,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.5640000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.327,"15min":1.427},"min":{"1min":0.96399999999999997,"5min":0.90900000000000003,"15min":0.81999999999999995},"max":{"1min":1.669,"5min":1.861,"15min":2.2610000000000001},"last":1.3560000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.097,"15min":1.111},"min":{"1min":0.79200000000000004,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.22,"15min":1.1899999999999999},"min":{"1min":0.86299999999999999,"5min":0.66700000000000004,"15min":0.63700000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.2929999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.3080000000000001},"min":{"1min":0.87,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.522,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.208,"15min":1.2230000000000001},"min":{"1min":0.79000000000000004,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3360000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.375,"15min":1.399},"min":{"1min":1.0629999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.371,"15min":1.413},"min":{"1min":0.95399999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6279999999999999,"5min":1.845,"15min":1.845},"last":1.3919999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1167360,"data_stored":530448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0860000000000001,"15min":1.1339999999999999},"min":{"1min":0.752,"5min":0.371,"15min":0.371},"max":{"1min":1.619,"5min":1.8169999999999999,"15min":3.0369999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.133,"5min":1.099,"15min":1.161},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5529999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.77800000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.109,"15min":1.113},"min":{"1min":0.72999999999999998,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.4890000000000001,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.155,"15min":1.1919999999999999},"min":{"1min":0.90200000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.4950000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.089}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.169,"15min":1.399},"min":{"1min":0.86799999999999999,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.47,"5min":1.675,"15min":3.7480000000000002},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1859999999999999,"15min":1.4399999999999999},"min":{"1min":0.82699999999999996,"5min":0.747,"15min":0.747},"max":{"1min":1.4099999999999999,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":1.042}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.4790000000000001},"min":{"1min":0.97999999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6339999999999999,"5min":1.7230000000000001,"15min":4.883},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.268,"5min":1.2669999999999999,"15min":1.4910000000000001},"min":{"1min":0.89200000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.502,"5min":1.9810000000000001,"15min":4.8630000000000004},"last":1.0660000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1679999999999999,"15min":1.288},"min":{"1min":0.76600000000000001,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.526,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":1.123},{"interface":"front","average":{"1min":1.296,"5min":1.2470000000000001,"15min":1.327},"min":{"1min":0.997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.5589999999999999,"5min":1.796,"15min":2.077},"last":1.276}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2689999999999999,"15min":1.395},"min":{"1min":0.81899999999999995,"5min":0.755,"15min":0.755},"max":{"1min":1.456,"5min":1.764,"15min":2.1699999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.389,"15min":1.4670000000000001},"min":{"1min":0.97299999999999998,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5860000000000001,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.1970000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3600000000000001,"15min":1.4510000000000001},"min":{"1min":1.0049999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.5660000000000001,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.536},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.361,"15min":1.5049999999999999},"min":{"1min":1.0640000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.631,"5min":2.1709999999999998,"15min":2.367},"last":1.343}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1146880,"data_stored":528280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.0569999999999999,"15min":1.177},"min":{"1min":0.753,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.125,"15min":1.155},"min":{"1min":0.90300000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":2.278},"last":0.85899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.1619999999999999,"15min":1.2549999999999999},"min":{"1min":0.79700000000000004,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.476,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.119,"15min":1.1799999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.532,"5min":1.5649999999999999,"15min":2.1040000000000001},"last":1.038}]},{"osd":2,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1910000000000001,"15min":1.274},"min":{"1min":0.76700000000000002,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.619,"5min":1.7470000000000001,"15min":1.9059999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.117,"5min":1.1379999999999999,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.157},"last":1.393}]},{"osd":3,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.25,"15min":1.3580000000000001},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.749},"max":{"1min":1.5660000000000001,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2869999999999999,"15min":1.4179999999999999},"min":{"1min":0.90600000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.5600000000000001,"5min":1.7030000000000001,"15min":2.9470000000000001},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1100000000000001,"15min":1.2030000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5109999999999999,"5min":1.579,"15min":1.8500000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2090000000000001,"15min":1.2669999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4990000000000001,"5min":1.742,"15min":1.974},"last":1.0649999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.2310000000000001,"15min":1.2909999999999999},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.536,"5min":1.669,"15min":2.0219999999999998},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.2470000000000001,"15min":1.337},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.694,"5min":1.694,"15min":2.1739999999999999},"last":1.5600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:53:21 2024","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":1.0580000000000001,"5min":0.87,"15min":0.81699999999999995},"max":{"1min":1.6499999999999999,"5min":1.7649999999999999,"15min":2.169},"last":1.274},{"interface":"front","average":{"1min":1.395,"5min":1.4039999999999999,"15min":1.5},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.641,"5min":1.804,"15min":2.8140000000000001},"last":1.5309999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1155072,"data_stored":528440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.101,"15min":1.1259999999999999},"min":{"1min":0.78600000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.5349999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.121,"5min":1.1339999999999999,"15min":1.139},"min":{"1min":0.77200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.518,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2949999999999999,"15min":1.351},"min":{"1min":0.77000000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.6539999999999999,"5min":1.6739999999999999,"15min":2.6930000000000001},"last":1.24},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.3169999999999999},"min":{"1min":0.73799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4970000000000001,"5min":1.806,"15min":2.423},"last":1.1599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2190000000000001,"15min":1.28},"min":{"1min":0.94999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.99},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.3,"15min":1.371},"min":{"1min":0.82699999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":2.335},"last":1.353}]},{"osd":3,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2010000000000001,"15min":1.2989999999999999},"min":{"1min":0.82199999999999995,"5min":0.626,"15min":0.626},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":2.621},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1839999999999999,"15min":1.2569999999999999},"min":{"1min":0.91000000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.302,"5min":1.5669999999999999,"15min":1.8640000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.153,"15min":1.284},"min":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":2.274},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.2230000000000001,"15min":1.304},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.988,"5min":1.988,"15min":2.266},"last":1.3300000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.2070000000000001,"15min":1.333},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.5189999999999999,"5min":2.319,"15min":2.4710000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3480000000000001,"15min":1.444},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5720000000000001,"5min":1.851,"15min":2.5},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:12 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.351,"15min":1.446},"min":{"1min":0.72399999999999998,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.395},"last":1.419},{"interface":"front","average":{"1min":1.405,"5min":1.355,"15min":1.454},"min":{"1min":1.0429999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.9059999999999999,"5min":2.415,"15min":2.415},"last":1.3779999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1146880,"data_stored":528280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.82399999999999995,"15min":0.88600000000000001},"min":{"1min":0.48799999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0800000000000001,"5min":1.331,"15min":1.4510000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.83299999999999996,"15min":0.879},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0589999999999999,"5min":1.444,"15min":1.444},"last":1.159}]},{"osd":1,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.627,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.3500000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.032},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.94899999999999995,"15min":1.0880000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.464,"15min":4.0149999999999997},"last":0.98099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":1.004,"15min":1.002},"min":{"1min":0.71599999999999997,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.319,"5min":1.611,"15min":1.611},"last":1.631},{"interface":"front","average":{"1min":1.099,"5min":1.129,"15min":1.161},"min":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.536,"5min":1.569,"15min":2.4729999999999999},"last":1.488}]},{"osd":4,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.179,"15min":1.2370000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.361},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1519999999999999,"15min":1.226},"min":{"1min":0.82299999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.554,"5min":1.554,"15min":1.8220000000000001},"last":1.405}]},{"osd":5,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.2170000000000001,"15min":1.3049999999999999},"min":{"1min":0.94799999999999995,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.4850000000000001,"5min":1.855,"15min":2.0099999999999998},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2789999999999999,"15min":1.365},"min":{"1min":0.85099999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6000000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.2270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.3089999999999999,"15min":1.413},"min":{"1min":0.875,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.49,"5min":1.9239999999999999,"15min":2.714},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.278,"15min":1.4039999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7270000000000001,"5min":1.8520000000000001,"15min":2.52},"last":1.444}]},{"osd":7,"last update":"Fri Sep 13 18:53:15 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.3049999999999999,"15min":1.4890000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7789999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.302,"15min":1.4199999999999999},"min":{"1min":1.0029999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.5580000000000001,"5min":1.946,"15min":1.9810000000000001},"last":1.536}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1146880,"data_stored":528280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.77500000000000002,"15min":0.95699999999999996},"min":{"1min":0.434,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.1000000000000001,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80900000000000005,"15min":1.0209999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.54,"5min":1.54,"15min":4.6349999999999998},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.84399999999999997,"15min":1.1000000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1990000000000001,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.0620000000000001,"15min":1.2090000000000001},"min":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.762,"5min":1.762,"15min":4.7009999999999996},"last":1.04}]},{"osd":3,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.117,"15min":1.294},"min":{"1min":0.65000000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5329999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":1.284},{"interface":"front","average":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.202},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.339,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":1.119}]},{"osd":4,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.204,"15min":1.5980000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":8.6989999999999998},"last":1.228},{"interface":"front","average":{"1min":1.119,"5min":1.224,"15min":1.4219999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.383,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":1.4390000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2809999999999999,"15min":1.484},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6319999999999999,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.24,"15min":1.46},"min":{"1min":0.88600000000000001,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.5649999999999999,"5min":1.7370000000000001,"15min":4.335},"last":1.579}]},{"osd":6,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.5089999999999999},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.5569999999999999,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":1.488},{"interface":"front","average":{"1min":1.196,"5min":1.2450000000000001,"15min":1.696},"min":{"1min":0.80500000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.6299999999999999,"5min":1.6319999999999999,"15min":8.6300000000000008},"last":1.359}]},{"osd":7,"last update":"Fri Sep 13 18:53:16 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.3200000000000001,"15min":1.5329999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.323},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.355,"15min":1.589},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.677,"5min":1.677,"15min":4.4050000000000002},"last":1.399}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1150976,"data_stored":528350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.76700000000000002,"15min":0.86799999999999999},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.0309999999999999,"5min":1.385,"15min":2.2170000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81499999999999995,"15min":1.026},"min":{"1min":0.61699999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.036,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":1.0289999999999999,"15min":1.169},"min":{"1min":0.63300000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.46,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.96699999999999997,"15min":1.0589999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.5589999999999999,"5min":1.804,"15min":2.6219999999999999},"last":1.288}]},{"osd":3,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.1080000000000001,"15min":1.294},"min":{"1min":0.58299999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4550000000000001,"5min":1.637,"15min":6.0919999999999996},"last":1.748},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.0449999999999999,"15min":1.3779999999999999},"min":{"1min":0.59399999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.4970000000000001,"5min":1.768,"15min":10.368},"last":0.997}]},{"osd":4,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.238,"15min":1.3640000000000001},"min":{"1min":0.85299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.6040000000000001,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":1.038},{"interface":"front","average":{"1min":1.234,"5min":1.2450000000000001,"15min":1.351},"min":{"1min":0.94099999999999995,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.633,"5min":1.958,"15min":2.911},"last":1.6919999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2110000000000001,"15min":1.677},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.532,"5min":1.6499999999999999,"15min":10.214},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.286,"15min":1.458},"min":{"1min":0.92700000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.498,"5min":1.96,"15min":2.8849999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2749999999999999,"15min":1.5449999999999999},"min":{"1min":0.95699999999999996,"5min":0.874,"15min":0.874},"max":{"1min":1.702,"5min":1.915,"15min":6.032},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2769999999999999,"15min":1.7250000000000001},"min":{"1min":0.94099999999999995,"5min":0.84399999999999997,"15min":0.77300000000000002},"max":{"1min":1.5980000000000001,"5min":1.774,"15min":10.112},"last":1.4119999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:53:18 2024","interfaces":[{"interface":"back","average":{"1min":1.365,"5min":1.3500000000000001,"15min":1.79},"min":{"1min":0.97599999999999998,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.677,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3560000000000001,"15min":1.5469999999999999},"min":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.702,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.643}]}]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1765376,"data_stored":1120918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75700000000000001,"15min":0.97199999999999998},"min":{"1min":0.48899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.373,"5min":1.5289999999999999,"15min":4.2039999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.84499999999999997,"15min":0.99099999999999999},"min":{"1min":0.45800000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.325,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.84599999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.89100000000000001,"15min":1.119},"min":{"1min":0.501,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2569999999999999,"5min":1.294,"15min":3.7349999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":1.1890000000000001},"min":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.399,"5min":1.623,"15min":3.5640000000000001},"last":1.2130000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.97599999999999998,"15min":1.1679999999999999},"min":{"1min":0.58399999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3009999999999999,"5min":1.917,"15min":4.093},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.081,"5min":1.129,"15min":1.3879999999999999},"min":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.415,"5min":2.0750000000000002,"15min":4.7439999999999998},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.212,"15min":1.4239999999999999},"min":{"1min":0.99399999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.4930000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.403},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.228,"15min":1.4299999999999999},"min":{"1min":0.84099999999999997,"5min":0.82099999999999995,"15min":0.82099999999999995},"max":{"1min":1.4419999999999999,"5min":1.597,"15min":4.5449999999999999},"last":1.242}]},{"osd":5,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.282,"15min":1.5780000000000001},"min":{"1min":0.85899999999999999,"5min":0.753,"15min":0.753},"max":{"1min":1.52,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.256,"15min":1.512},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.583,"5min":1.675,"15min":3.2290000000000001},"last":1.3460000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2609999999999999,"15min":1.5209999999999999},"min":{"1min":0.93799999999999994,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.3899999999999999,"5min":1.714,"15min":4.4569999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.319,"15min":1.661},"min":{"1min":0.94499999999999995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4830000000000001,"5min":1.696,"15min":4.8570000000000002},"last":1.181}]},{"osd":7,"last update":"Fri Sep 13 18:53:14 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.333,"15min":1.569},"min":{"1min":0.89700000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.6459999999999999,"5min":1.756,"15min":3.056},"last":1.45},{"interface":"front","average":{"1min":1.278,"5min":1.296,"15min":1.587},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":4.5019999999999998},"last":1.3759999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:53:43.175 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:53:43.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:53:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.374+0000 7f7fabe00700 1 Processor -- start 2024-09-13T18:53:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7fabe00700 1 -- start start 2024-09-13T18:53:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac06b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7fabe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fac072710 0x7f7fac0cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7fabe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0af0c0 con 0x7f7fac0d00d0 2024-09-13T18:53:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7fabe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac0d0580 con 0x7f7fac072710 2024-09-13T18:53:43.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7fabe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac071b60 con 0x7f7fac15c9f0 2024-09-13T18:53:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fac072710 0x7f7fac0cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7fac072710 0x7f7fac0cfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46540/0 (socket says 172.21.15.81:46540) 2024-09-13T18:53:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 -- 172.21.15.81:0/675929110 learned_addr learned my addr 172.21.15.81:0/675929110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faaa00700 1 --2- 172.21.15.81:0/675929110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac06b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 -- 172.21.15.81:0/675929110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 msgr2=0x7f7fac06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 --2- 172.21.15.81:0/675929110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac06b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 -- 172.21.15.81:0/675929110 >> v1:172.21.15.178:6789/0 conn(0x7f7fac0d00d0 legacy=0x7f7fac066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.378+0000 7f7faa000700 1 -- 172.21.15.81:0/675929110 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac06b8e0 con 0x7f7fac072710 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7faa000700 1 --2- 172.21.15.81:0/675929110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac0cfb90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009910 tx=0x7f7f98009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bafa258a0dd955 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fa9600700 1 -- 172.21.15.81:0/675929110 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800ba60 con 0x7f7fac072710 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fa9600700 1 -- 172.21.15.81:0/675929110 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9800bbc0 con 0x7f7fac072710 2024-09-13T18:53:43.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fa9600700 1 -- 172.21.15.81:0/675929110 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98009e60 con 0x7f7fac072710 2024-09-13T18:53:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 -- 172.21.15.81:0/675929110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 msgr2=0x7f7fac0cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 --2- 172.21.15.81:0/675929110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac0cfb90 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009910 tx=0x7f7f98009c20 comp rx=0 tx=0).stop 2024-09-13T18:53:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 -- 172.21.15.81:0/675929110 shutdown_connections 2024-09-13T18:53:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 --2- 172.21.15.81:0/675929110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac0cfb90 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 --2- 172.21.15.81:0/675929110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac06b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 -- 172.21.15.81:0/675929110 >> 172.21.15.81:0/675929110 conn(0x7f7fac06cbf0 msgr2=0x7f7fac06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 -- 172.21.15.81:0/675929110 shutdown_connections 2024-09-13T18:53:43.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.382+0000 7f7fabe00700 1 -- 172.21.15.81:0/675929110 wait complete. 2024-09-13T18:53:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 Processor -- start 2024-09-13T18:53:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 -- start start 2024-09-13T18:53:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fac0d00d0 0x7f7fac150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac13fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15ef90 con 0x7f7fac072710 2024-09-13T18:53:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15f960 con 0x7f7fac0d00d0 2024-09-13T18:53:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fabe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac15e380 con 0x7f7fac15c9f0 2024-09-13T18:53:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7faaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7faaa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac15f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46544/0 (socket says 172.21.15.81:46544) 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7faaa00700 1 -- 172.21.15.81:0/2404500653 learned_addr learned my addr 172.21.15.81:0/2404500653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7faa000700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fac0d00d0 0x7f7fac150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.386+0000 7f7fab400700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac13fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faaa00700 1 -- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 msgr2=0x7f7fac13fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faaa00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac13fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faaa00700 1 -- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fac0d00d0 msgr2=0x7f7fac150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faaa00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fac0d00d0 0x7f7fac150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faaa00700 1 -- 172.21.15.81:0/2404500653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98009570 con 0x7f7fac072710 2024-09-13T18:53:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faa000700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fac0d00d0 0x7f7fac150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7faaa00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac15f420 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00d800 tx=0x7f7f9c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0125f0 con 0x7f7fac072710 2024-09-13T18:53:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c012750 con 0x7f7fac072710 2024-09-13T18:53:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac15e660 con 0x7f7fac072710 2024-09-13T18:53:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c012ac0 con 0x7f7fac072710 2024-09-13T18:53:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac15ec20 con 0x7f7fac072710 2024-09-13T18:53:43.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.390+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac15cdd0 con 0x7f7fac072710 2024-09-13T18:53:43.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.394+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7f9c012c20 con 0x7f7fac072710 2024-09-13T18:53:43.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.394+0000 7f7fa2a00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f8c066730 0x7f7f8c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.394+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7f9c084440 con 0x7f7fac072710 2024-09-13T18:53:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.394+0000 7f7faa000700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f8c066730 0x7f7f8c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.394+0000 7f7faa000700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f8c066730 0x7f7f8c068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009910 tx=0x7f7f98008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:43.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.402+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f9c051600 con 0x7f7fac072710 2024-09-13T18:53:43.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:53:43.526 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:53:43.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.642+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7fac151180 con 0x7f7fac072710 2024-09-13T18:53:43.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.654+0000 7f7fa2a00700 1 -- 172.21.15.81:0/2404500653 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7f9c054c20 con 0x7f7fac072710 2024-09-13T18:53:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f8c066730 msgr2=0x7f7f8c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f8c066730 0x7f7f8c068bf0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7f98009910 tx=0x7f7f98008030 comp rx=0 tx=0).stop 2024-09-13T18:53:43.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 msgr2=0x7f7fac15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac15f420 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00d800 tx=0x7f7f9c00db10 comp rx=0 tx=0).stop 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 shutdown_connections 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7f8c066730 0x7f7f8c068bf0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fac15c9f0 0x7f7fac13fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fac0d00d0 0x7f7fac150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 --2- 172.21.15.81:0/2404500653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7fac072710 0x7f7fac15f420 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 >> 172.21.15.81:0/2404500653 conn(0x7f7fac06cbf0 msgr2=0x7f7fac159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 shutdown_connections 2024-09-13T18:53:43.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.658+0000 7f7fabe00700 1 -- 172.21.15.81:0/2404500653 wait complete. 2024-09-13T18:53:43.671 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-13T18:53:43.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.846+0000 7f03c1600700 1 Processor -- start 2024-09-13T18:53:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.846+0000 7f03c1600700 1 -- start start 2024-09-13T18:53:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c1600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc0aedd0 0x7f03bc0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c1600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f03bc15ba90 0x7f03bc066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c1600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03bc070d80 con 0x7f03bc0665d0 2024-09-13T18:53:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c1600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03bc066a80 con 0x7f03bc15ba90 2024-09-13T18:53:43.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c1600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0cf550 con 0x7f03bc0aedd0 2024-09-13T18:53:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c0c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f03bc0665d0 0x7f03bc15e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45400/0 (socket says 172.21.15.81:45400) 2024-09-13T18:53:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03c0c00700 1 -- 172.21.15.81:0/75544641 learned_addr learned my addr 172.21.15.81:0/75544641 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bbe00700 1 --2- 172.21.15.81:0/75544641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc0aedd0 0x7f03bc0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bb400700 1 --2- 172.21.15.81:0/75544641 >> v2:172.21.15.178:3300/0 conn(0x7f03bc15ba90 0x7f03bc066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03baa00700 1 -- 172.21.15.81:0/75544641 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10328705 0 0) 0x7f03bc070d80 con 0x7f03bc0665d0 2024-09-13T18:53:43.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03baa00700 1 -- 172.21.15.81:0/75544641 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a00035d0 con 0x7f03bc0665d0 2024-09-13T18:53:43.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bbe00700 1 -- 172.21.15.81:0/75544641 >> v2:172.21.15.178:3300/0 conn(0x7f03bc15ba90 msgr2=0x7f03bc066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:43.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bbe00700 1 --2- 172.21.15.81:0/75544641 >> v2:172.21.15.178:3300/0 conn(0x7f03bc15ba90 0x7f03bc066090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bbe00700 1 -- 172.21.15.81:0/75544641 >> v1:172.21.15.81:6789/0 conn(0x7f03bc0665d0 legacy=0x7f03bc15e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bbe00700 1 -- 172.21.15.81:0/75544641 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc070fd0 con 0x7f03bc0aedd0 2024-09-13T18:53:43.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.850+0000 7f03bbe00700 1 --2- 172.21.15.81:0/75544641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc0aedd0 0x7f03bc0cf010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009850 tx=0x7f03ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8021b56fc998cfb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:43.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03baa00700 1 -- 172.21.15.81:0/75544641 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac011830 con 0x7f03bc0aedd0 2024-09-13T18:53:43.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03baa00700 1 -- 172.21.15.81:0/75544641 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac011990 con 0x7f03bc0aedd0 2024-09-13T18:53:43.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03baa00700 1 -- 172.21.15.81:0/75544641 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac011d40 con 0x7f03bc0aedd0 2024-09-13T18:53:43.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 -- 172.21.15.81:0/75544641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc0aedd0 msgr2=0x7f03bc0cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 --2- 172.21.15.81:0/75544641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc0aedd0 0x7f03bc0cf010 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009850 tx=0x7f03ac009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 -- 172.21.15.81:0/75544641 shutdown_connections 2024-09-13T18:53:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 --2- 172.21.15.81:0/75544641 >> v2:172.21.15.178:3300/0 conn(0x7f03bc15ba90 0x7f03bc066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 --2- 172.21.15.81:0/75544641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc0aedd0 0x7f03bc0cf010 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 -- 172.21.15.81:0/75544641 >> 172.21.15.81:0/75544641 conn(0x7f03bc06ca10 msgr2=0x7f03bc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 -- 172.21.15.81:0/75544641 shutdown_connections 2024-09-13T18:53:43.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.854+0000 7f03c1600700 1 -- 172.21.15.81:0/75544641 wait complete. 2024-09-13T18:53:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 Processor -- start 2024-09-13T18:53:43.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 -- start start 2024-09-13T18:53:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03bc0665d0 0x7f03bc0adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 0x7f03bc1441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc15ba90 0x7f03bc0b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0ac520 con 0x7f03bc0aedd0 2024-09-13T18:53:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0ad400 con 0x7f03bc0665d0 2024-09-13T18:53:43.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c1600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03bc0ad6e0 con 0x7f03bc15ba90 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 0x7f03bc1441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 0x7f03bc1441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46558/0 (socket says 172.21.15.81:46558) 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 -- 172.21.15.81:0/626426300 learned_addr learned my addr 172.21.15.81:0/626426300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bbe00700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03bc0665d0 0x7f03bc0adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03c0c00700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc15ba90 0x7f03bc0b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 -- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc15ba90 msgr2=0x7f03bc0b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc15ba90 0x7f03bc0b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 -- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03bc0665d0 msgr2=0x7f03bc0adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03bc0665d0 0x7f03bc0adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:43.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.858+0000 7f03bb400700 1 -- 172.21.15.81:0/626426300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0094b0 con 0x7f03bc0aedd0 2024-09-13T18:53:43.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03bb400700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 0x7f03bc1441a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009fd0 tx=0x7f03a800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:43.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80095a0 con 0x7f03bc0aedd0 2024-09-13T18:53:43.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a8013680 con 0x7f03bc0aedd0 2024-09-13T18:53:43.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc0ad9c0 con 0x7f03bc0aedd0 2024-09-13T18:53:43.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8013a10 con 0x7f03bc0aedd0 2024-09-13T18:53:43.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03bc1446e0 con 0x7f03bc0aedd0 2024-09-13T18:53:43.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.862+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc0cf010 con 0x7f03bc0aedd0 2024-09-13T18:53:43.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.866+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03a8013b70 con 0x7f03bc0aedd0 2024-09-13T18:53:43.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.866+0000 7f03b3e00700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f039c066730 0x7f039c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.866+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f03a8084170 con 0x7f03bc0aedd0 2024-09-13T18:53:43.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.866+0000 7f03bbe00700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f039c066730 0x7f039c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:43.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.866+0000 7f03bbe00700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f039c066730 0x7f039c068bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0090b0 tx=0x7f03ac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:43.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:43.870+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03a8051390 con 0x7f03bc0aedd0 2024-09-13T18:53:44.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.098+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03bc1598c0 con 0x7f03bc0aedd0 2024-09-13T18:53:44.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.098+0000 7f03b3e00700 1 -- 172.21.15.81:0/626426300 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f03a80549b0 con 0x7f03bc0aedd0 2024-09-13T18:53:44.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:44.108 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":86,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7675,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:53:36.421441+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8076},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:53:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f039c066730 msgr2=0x7f039c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f039c066730 0x7f039c068bf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0090b0 tx=0x7f03ac008030 comp rx=0 tx=0).stop 2024-09-13T18:53:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 msgr2=0x7f03bc1441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 0x7f03bc1441a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f03a8009fd0 tx=0x7f03a800eb20 comp rx=0 tx=0).stop 2024-09-13T18:53:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 shutdown_connections 2024-09-13T18:53:44.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f039c066730 0x7f039c068bf0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03bc15ba90 0x7f03bc0b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03bc0aedd0 0x7f03bc1441a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 --2- 172.21.15.81:0/626426300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f03bc0665d0 0x7f03bc0adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 >> 172.21.15.81:0/626426300 conn(0x7f03bc06ca10 msgr2=0x7f03bc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 shutdown_connections 2024-09-13T18:53:44.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.102+0000 7f03c1600700 1 -- 172.21.15.81:0/626426300 wait complete. 2024-09-13T18:53:44.114 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 86 2024-09-13T18:53:44.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:53:33.403058+0000', 'modified': '2024-09-13T18:53:36.421441+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8076}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8076': {'gid': 8076, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2448579226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2448579226}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2448579226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:53:44.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:53:44.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:53:44.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 Processor -- start 2024-09-13T18:53:44.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 -- start start 2024-09-13T18:53:44.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a806aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44a80b2670 0x7f44a80b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a80b3040 con 0x7f44a81610b0 2024-09-13T18:53:44.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a8070b30 con 0x7f44a80b2670 2024-09-13T18:53:44.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80b3560 con 0x7f44a806aaa0 2024-09-13T18:53:44.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f44a81610b0 0x7f44a80719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45416/0 (socket says 172.21.15.81:45416) 2024-09-13T18:53:44.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6a00700 1 -- 172.21.15.81:0/1362783361 learned_addr learned my addr 172.21.15.81:0/1362783361 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:44.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6000700 1 --2- 172.21.15.81:0/1362783361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a806aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a7400700 1 --2- 172.21.15.81:0/1362783361 >> v2:172.21.15.178:3300/0 conn(0x7f44a80b2670 0x7f44a80b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a5600700 1 -- 172.21.15.81:0/1362783361 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969980069 0 0) 0x7f4498001110 con 0x7f44a81610b0 2024-09-13T18:53:44.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a5600700 1 -- 172.21.15.81:0/1362783361 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f448c0035d0 con 0x7f44a81610b0 2024-09-13T18:53:44.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6000700 1 -- 172.21.15.81:0/1362783361 >> v2:172.21.15.178:3300/0 conn(0x7f44a80b2670 msgr2=0x7f44a80b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6000700 1 --2- 172.21.15.81:0/1362783361 >> v2:172.21.15.178:3300/0 conn(0x7f44a80b2670 0x7f44a80b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6000700 1 -- 172.21.15.81:0/1362783361 >> v1:172.21.15.81:6789/0 conn(0x7f44a81610b0 legacy=0x7f44a80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.702+0000 7f44a6000700 1 -- 172.21.15.81:0/1362783361 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a806b420 con 0x7f44a806aaa0 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a6000700 1 --2- 172.21.15.81:0/1362783361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a806aee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4494009850 tx=0x7f4494009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76c32ca134434d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a5600700 1 -- 172.21.15.81:0/1362783361 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494011830 con 0x7f44a806aaa0 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a5600700 1 -- 172.21.15.81:0/1362783361 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4494011990 con 0x7f44a806aaa0 2024-09-13T18:53:44.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a5600700 1 -- 172.21.15.81:0/1362783361 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494011d00 con 0x7f44a806aaa0 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 -- 172.21.15.81:0/1362783361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 msgr2=0x7f44a806aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 --2- 172.21.15.81:0/1362783361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a806aee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4494009850 tx=0x7f4494009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 -- 172.21.15.81:0/1362783361 shutdown_connections 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 --2- 172.21.15.81:0/1362783361 >> v2:172.21.15.178:3300/0 conn(0x7f44a80b2670 0x7f44a80b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 --2- 172.21.15.81:0/1362783361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a806aee0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 -- 172.21.15.81:0/1362783361 >> 172.21.15.81:0/1362783361 conn(0x7f44a80b0c40 msgr2=0x7f44a806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 -- 172.21.15.81:0/1362783361 shutdown_connections 2024-09-13T18:53:44.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.706+0000 7f44a7e00700 1 -- 172.21.15.81:0/1362783361 wait complete. 2024-09-13T18:53:44.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 Processor -- start 2024-09-13T18:53:44.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 -- start start 2024-09-13T18:53:44.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a81fa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a80b2670 0x7f44a80a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 0x7f44a80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80a8cd0 con 0x7f44a81610b0 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80a8fb0 con 0x7f44a80b2670 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.710+0000 7f44a7e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80a9290 con 0x7f44a806aaa0 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 0x7f44a80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 0x7f44a80a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46568/0 (socket says 172.21.15.81:46568) 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 -- 172.21.15.81:0/2226518237 learned_addr learned my addr 172.21.15.81:0/2226518237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a6a00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a81fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a6000700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a80b2670 0x7f44a80a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 -- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 msgr2=0x7f44a81fa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a81fa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 -- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a80b2670 msgr2=0x7f44a80a9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a80b2670 0x7f44a80a9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 -- 172.21.15.81:0/2226518237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940094b0 con 0x7f44a81610b0 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7400700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 0x7f44a80a8480 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f44a000efc0 tx=0x7f44a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f449ea00700 1 -- 172.21.15.81:0/2226518237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0009ea0 con 0x7f44a81610b0 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f449ea00700 1 -- 172.21.15.81:0/2226518237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000f040 con 0x7f44a81610b0 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a80a9570 con 0x7f44a81610b0 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f449ea00700 1 -- 172.21.15.81:0/2226518237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000ced0 con 0x7f44a81610b0 2024-09-13T18:53:44.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.714+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a80a89c0 con 0x7f44a81610b0 2024-09-13T18:53:44.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.718+0000 7f449ea00700 1 -- 172.21.15.81:0/2226518237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44a0014480 con 0x7f44a81610b0 2024-09-13T18:53:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.718+0000 7f44b0e48740 1 Processor -- start 2024-09-13T18:53:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.718+0000 7f449ea00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4488066730 0x7f4488068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 -- start start 2024-09-13T18:53:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f449ea00700 1 -- 172.21.15.81:0/2226518237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44a0084b50 con 0x7f44a81610b0 2024-09-13T18:53:44.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a6a00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4488066730 0x7f4488068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a6a00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4488066730 0x7f4488068bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4498005930 tx=0x7f4498009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3822180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37ea890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3749d80 con 0x38226c0 2024-09-13T18:53:44.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3747510 con 0x3821da0 2024-09-13T18:53:44.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3742e00 con 0x3800d00 2024-09-13T18:53:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46582/0 (socket says 172.21.15.81:46582) 2024-09-13T18:53:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 -- 172.21.15.81:0/1117780673 learned_addr learned my addr 172.21.15.81:0/1117780673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a6a00700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3822180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a6000700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37ea890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 -- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 msgr2=0x37ea890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37ea890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 -- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 msgr2=0x3822180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3822180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 -- 172.21.15.81:0/1117780673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x35b5960 con 0x38226c0 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a6000700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a6a00700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3822180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44a7400700 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37eadd0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009a40 tx=0x7f44a00558b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5184afb2767daaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f4493400700 1 -- 172.21.15.81:0/1117780673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a006d070 con 0x38226c0 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f4493400700 1 -- 172.21.15.81:0/1117780673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a00560b0 con 0x38226c0 2024-09-13T18:53:44.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f4493400700 1 -- 172.21.15.81:0/1117780673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00559b0 con 0x38226c0 2024-09-13T18:53:44.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 -- 172.21.15.81:0/1117780673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 msgr2=0x37eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.722+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37eadd0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f44a0009a40 tx=0x7f44a00558b0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- 172.21.15.81:0/1117780673 shutdown_connections 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37eadd0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37ea890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1117780673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3822180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- 172.21.15.81:0/1117780673 >> 172.21.15.81:0/1117780673 conn(0x356a4d0 msgr2=0x3803c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- 172.21.15.81:0/1117780673 shutdown_connections 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- 172.21.15.81:0/1117780673 wait complete. 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- start start 2024-09-13T18:53:44.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 Processor -- start 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37dd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x37da200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37db470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3700730 con 0x38226c0 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x37065b0 con 0x3821da0 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x35eeaa0 con 0x3800d00 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44b0e48740 10 client.0 _ll_register_callbacks cb 0x373c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37db470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37db470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46596/0 (socket says 172.21.15.81:46596) 2024-09-13T18:53:44.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a7400700 1 -- 172.21.15.81:0/4267203703 learned_addr learned my addr 172.21.15.81:0/4267203703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a6000700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x37da200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a6a00700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37dd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a7400700 1 -- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 msgr2=0x37dd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a7400700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37dd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.726+0000 7f44a7400700 1 -- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 msgr2=0x37da200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44a7400700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x37da200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44a7400700 1 -- 172.21.15.81:0/4267203703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a80a89c0 con 0x38226c0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44a7400700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37db470 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f44a0058040 tx=0x7f44a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed059a7be1afe11b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 1 -- 172.21.15.81:0/4267203703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a006d040 con 0x38226c0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 1 -- 172.21.15.81:0/4267203703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f44a005dda0 con 0x38226c0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x35771e0 con 0x38226c0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 1 -- 172.21.15.81:0/4267203703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44a0072370 con 0x38226c0 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 10 client.8244 fetch_fsmap learned FSMap version 86 2024-09-13T18:53:44.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x3709220 con 0x38226c0 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 1 -- 172.21.15.81:0/4267203703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x35771e0 con 0x38226c0 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 1 -- 172.21.15.81:0/4267203703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 86) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f44a0054ea0 con 0x38226c0 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 10 client.8244 fetch_fsmap finished waiting for FSMap version 86 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 10 client.8244 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 20 client.8244 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38021e0 0x37d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 4 client.8244 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x35c1460 con 0x38021e0 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44a6a00700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38021e0 0x37d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f44a6a00700 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38021e0 0x37d7cf0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f131c09c2df9a6b server_cookie=c69678d5e757cc0d in_seq=0 out_seq=0 2024-09-13T18:53:44.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.730+0000 7f4487e00700 10 client.8244 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:44.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f4487e00700 1 -- 172.21.15.81:0/4267203703 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x35c1460 con 0x38021e0 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f4487e00700 10 client.8244 handle_command_reply: tid=0 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 client.8244 shutdown 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 msgr2=0x37db470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37db470 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f44a0058040 tx=0x7f44a0013000 comp rx=0 tx=0).stop 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 shutdown_connections 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38021e0 0x37d7cf0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x37db470 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x37da200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 --2- 172.21.15.81:0/4267203703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x37dd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 >> 172.21.15.81:0/4267203703 conn(0x356a4d0 msgr2=0x37fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f4487e00700 0 client.8244 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:44.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 shutdown_connections 2024-09-13T18:53:44.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 1 -- 172.21.15.81:0/4267203703 wait complete. 2024-09-13T18:53:44.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.734+0000 7f44b0e48740 20 client.8244 trim_cache size 0 max 16384 2024-09-13T18:53:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 Processor -- start 2024-09-13T18:53:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 -- start start 2024-09-13T18:53:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x383b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3835340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x3835880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3700730 con 0x38226c0 2024-09-13T18:53:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3771ec0 con 0x3821da0 2024-09-13T18:53:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x37142b0 con 0x3800d00 2024-09-13T18:53:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44a7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x3835880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44a6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x383b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44a6a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x383b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:49774/0 (socket says 172.21.15.81:49774) 2024-09-13T18:53:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44a6a00700 1 -- 172.21.15.81:0/1273281661 learned_addr learned my addr 172.21.15.81:0/1273281661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.754+0000 7f44a6000700 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3835340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44a6a00700 1 -- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 msgr2=0x3835340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44a6a00700 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3835340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44a6a00700 1 -- 172.21.15.81:0/1273281661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 msgr2=0x3835880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44a6a00700 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x3835880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44a6a00700 1 -- 172.21.15.81:0/1273281661 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a81f66f0 con 0x3800d00 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44a6a00700 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x383b6e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f449800f970 tx=0x7f4498012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1dbb151b541afde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f4493e00700 1 -- 172.21.15.81:0/1273281661 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449802b030 con 0x3800d00 2024-09-13T18:53:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f4493e00700 1 -- 172.21.15.81:0/1273281661 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449800fdf0 con 0x3800d00 2024-09-13T18:53:44.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f4493e00700 1 -- 172.21.15.81:0/1273281661 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498027ea0 con 0x3800d00 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 -- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 msgr2=0x383b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x383b6e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f449800f970 tx=0x7f4498012000 comp rx=0 tx=0).stop 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 -- 172.21.15.81:0/1273281661 shutdown_connections 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x38226c0 0x3835880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3835340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 --2- 172.21.15.81:0/1273281661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3800d00 0x383b6e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 -- 172.21.15.81:0/1273281661 >> 172.21.15.81:0/1273281661 conn(0x356a4d0 msgr2=0x3800090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 -- 172.21.15.81:0/1273281661 shutdown_connections 2024-09-13T18:53:44.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.758+0000 7f44b0e48740 1 -- 172.21.15.81:0/1273281661 wait complete. 2024-09-13T18:53:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 -- start start 2024-09-13T18:53:44.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 Processor -- start 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 0x38828d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3883470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x38226c0 0x38839b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3841210 con 0x3800d00 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x383a7b0 con 0x3821da0 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3801e40 con 0x38226c0 2024-09-13T18:53:44.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44b0e48740 10 client.0 _ll_register_callbacks cb 0x3799710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:44.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44a6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 0x38828d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44a6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 0x38828d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46604/0 (socket says 172.21.15.81:46604) 2024-09-13T18:53:44.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44a6a00700 1 -- 172.21.15.81:0/394370414 learned_addr learned my addr 172.21.15.81:0/394370414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44a6000700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3883470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.762+0000 7f44a7400700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x38226c0 0x38839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6a00700 1 -- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x38226c0 msgr2=0x38839b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6a00700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x38226c0 0x38839b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6a00700 1 -- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 msgr2=0x3883470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6a00700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3883470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6a00700 1 -- 172.21.15.81:0/394370414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4498019040 con 0x3800d00 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6a00700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 0x38828d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4498025040 tx=0x7f4498007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2624c919d98ad84b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 1 -- 172.21.15.81:0/394370414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498027ea0 con 0x3800d00 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 1 -- 172.21.15.81:0/394370414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f449802c070 con 0x3800d00 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44a00560b0 con 0x3800d00 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 1 -- 172.21.15.81:0/394370414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4498023480 con 0x3800d00 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 10 client.8250 fetch_fsmap learned FSMap version 86 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x36ef450 con 0x3800d00 2024-09-13T18:53:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 1 -- 172.21.15.81:0/394370414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a00560b0 con 0x3800d00 2024-09-13T18:53:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 1 -- 172.21.15.81:0/394370414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 86) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f44980235e0 con 0x3800d00 2024-09-13T18:53:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 10 client.8250 fetch_fsmap finished waiting for FSMap version 86 2024-09-13T18:53:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 10 client.8250 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:53:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 20 client.8250 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38381c0 0x38385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 4 client.8250 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "status"}) v1 -- 0x35e61e0 con 0x38381c0 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6000700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38381c0 0x38385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f4487e00700 10 client.8250 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.766+0000 7f44a6000700 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38381c0 0x38385a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329f8f49c873009e server_cookie=895a678f7722b66a in_seq=0 out_seq=0 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f4487e00700 1 -- 172.21.15.81:0/394370414 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x35e61e0 con 0x38381c0 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f4487e00700 10 client.8250 handle_command_reply: tid=0 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 client.8250 shutdown 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 msgr2=0x38828d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 0x38828d0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f4498025040 tx=0x7f4498007c20 comp rx=0 tx=0).stop 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 shutdown_connections 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x38381c0 0x38385a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x38226c0 0x38839b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3821da0 0x3883470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 --2- 172.21.15.81:0/394370414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3800d00 0x38828d0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f4487e00700 0 client.8250 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 >> 172.21.15.81:0/394370414 conn(0x356a4d0 msgr2=0x3800090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 shutdown_connections 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 1 -- 172.21.15.81:0/394370414 wait complete. 2024-09-13T18:53:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44b0e48740 20 client.8250 trim_cache size 0 max 16384 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8076, 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 11.365377194000001, 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 86, 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 93, 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 93, 2024-09-13T18:53:44.784 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.574053793000001 2024-09-13T18:53:44.785 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4488066730 msgr2=0x7f4488068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4488066730 0x7f4488068bf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4498005930 tx=0x7f4498009040 comp rx=0 tx=0).stop 2024-09-13T18:53:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 msgr2=0x7f44a80a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 0x7f44a80a8480 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f44a000efc0 tx=0x7f44a000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 shutdown_connections 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4488066730 0x7f4488068bf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44a81610b0 0x7f44a80a8480 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a80b2670 0x7f44a80a9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 --2- 172.21.15.81:0/2226518237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a806aaa0 0x7f44a81fa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 >> 172.21.15.81:0/2226518237 conn(0x7f44a80b0c40 msgr2=0x7f44a80af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 shutdown_connections 2024-09-13T18:53:44.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.770+0000 7f44a7e00700 1 -- 172.21.15.81:0/2226518237 wait complete. 2024-09-13T18:53:44.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:53:44.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.962+0000 7f9612800700 1 Processor -- start 2024-09-13T18:53:44.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.962+0000 7f9612800700 1 -- start start 2024-09-13T18:53:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9612800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f960c1610b0 0x7f960c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9612800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f960c0b2d80 0x7f960c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9612800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c0b3560 con 0x7f960c06aaa0 2024-09-13T18:53:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9612800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c070b30 con 0x7f960c1610b0 2024-09-13T18:53:44.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9612800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c06b450 con 0x7f960c0b2d80 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9611400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f960c1610b0 0x7f960c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9611400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f960c1610b0 0x7f960c0719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46606/0 (socket says 172.21.15.81:46606) 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9611400700 1 -- 172.21.15.81:0/496943039 learned_addr learned my addr 172.21.15.81:0/496943039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.966+0000 7f9611e00700 1 --2- 172.21.15.81:0/496943039 >> v2:172.21.15.178:3300/0 conn(0x7f960c0b2d80 0x7f960c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9611400700 1 -- 172.21.15.81:0/496943039 >> v2:172.21.15.178:3300/0 conn(0x7f960c0b2d80 msgr2=0x7f960c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9611400700 1 --2- 172.21.15.81:0/496943039 >> v2:172.21.15.178:3300/0 conn(0x7f960c0b2d80 0x7f960c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9611400700 1 -- 172.21.15.81:0/496943039 >> v1:172.21.15.178:6789/0 conn(0x7f960c06aaa0 legacy=0x7f960c0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9611400700 1 -- 172.21.15.81:0/496943039 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0b3280 con 0x7f960c1610b0 2024-09-13T18:53:44.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9611e00700 1 --2- 172.21.15.81:0/496943039 >> v2:172.21.15.178:3300/0 conn(0x7f960c0b2d80 0x7f960c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:44.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9611400700 1 --2- 172.21.15.81:0/496943039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c1610b0 0x7f960c0719c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f9600009940 tx=0x7f9600009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e5734be8558df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f960be00700 1 -- 172.21.15.81:0/496943039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000b9e0 con 0x7f960c1610b0 2024-09-13T18:53:44.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f960be00700 1 -- 172.21.15.81:0/496943039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600009e90 con 0x7f960c1610b0 2024-09-13T18:53:44.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f960be00700 1 -- 172.21.15.81:0/496943039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000bd60 con 0x7f960c1610b0 2024-09-13T18:53:44.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 -- 172.21.15.81:0/496943039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c1610b0 msgr2=0x7f960c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 --2- 172.21.15.81:0/496943039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c1610b0 0x7f960c0719c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f9600009940 tx=0x7f9600009c50 comp rx=0 tx=0).stop 2024-09-13T18:53:44.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 -- 172.21.15.81:0/496943039 shutdown_connections 2024-09-13T18:53:44.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 --2- 172.21.15.81:0/496943039 >> v2:172.21.15.178:3300/0 conn(0x7f960c0b2d80 0x7f960c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 --2- 172.21.15.81:0/496943039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c1610b0 0x7f960c0719c0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 -- 172.21.15.81:0/496943039 >> 172.21.15.81:0/496943039 conn(0x7f960c0b0c40 msgr2=0x7f960c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:44.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 -- 172.21.15.81:0/496943039 shutdown_connections 2024-09-13T18:53:44.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.970+0000 7f9612800700 1 -- 172.21.15.81:0/496943039 wait complete. 2024-09-13T18:53:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.974+0000 7f9612800700 1 Processor -- start 2024-09-13T18:53:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.974+0000 7f9612800700 1 -- start start 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 0x7f960c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c0b2d80 0x7f960c0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960c1610b0 0x7f960c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0c46a0 con 0x7f960c06aaa0 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0ab2b0 con 0x7f960c0b2d80 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0ab590 con 0x7f960c1610b0 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 0x7f960c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 0x7f960c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46610/0 (socket says 172.21.15.81:46610) 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 -- 172.21.15.81:0/1159900471 learned_addr learned my addr 172.21.15.81:0/1159900471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9610a00700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c0b2d80 0x7f960c0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611e00700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960c1610b0 0x7f960c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 -- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960c1610b0 msgr2=0x7f960c0cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960c1610b0 0x7f960c0cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 -- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c0b2d80 msgr2=0x7f960c0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c0b2d80 0x7f960c0ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 -- 172.21.15.81:0/1159900471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600009570 con 0x7f960c06aaa0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9611400700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 0x7f960c1549a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9600009890 tx=0x7f9600004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600004510 con 0x7f960c06aaa0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960001e070 con 0x7f960c06aaa0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600003900 con 0x7f960c06aaa0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0ab870 con 0x7f960c06aaa0 2024-09-13T18:53:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.978+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c0abe30 con 0x7f960c06aaa0 2024-09-13T18:53:44.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.982+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c161490 con 0x7f960c06aaa0 2024-09-13T18:53:44.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.982+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9600003a60 con 0x7f960c06aaa0 2024-09-13T18:53:44.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.982+0000 7f9609600700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95ec066730 0x7f95ec068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:44.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.982+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9600020070 con 0x7f960c06aaa0 2024-09-13T18:53:44.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.982+0000 7f9610a00700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95ec066730 0x7f95ec068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:44.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.986+0000 7f9610a00700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95ec066730 0x7f95ec068bf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f960c06cda0 tx=0x7f95f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:45.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:44.990+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96000529c0 con 0x7f960c06aaa0 2024-09-13T18:53:45.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.218+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f960c1604a0 con 0x7f960c06aaa0 2024-09-13T18:53:45.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.222+0000 7f9609600700 1 -- 172.21.15.81:0/1159900471 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9600055fe0 con 0x7f960c06aaa0 2024-09-13T18:53:45.232 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95ec066730 msgr2=0x7f95ec068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95ec066730 0x7f95ec068bf0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f960c06cda0 tx=0x7f95f8009040 comp rx=0 tx=0).stop 2024-09-13T18:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 msgr2=0x7f960c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 0x7f960c1549a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f9600009890 tx=0x7f9600004770 comp rx=0 tx=0).stop 2024-09-13T18:53:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 shutdown_connections 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95ec066730 0x7f95ec068bf0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f960c1610b0 0x7f960c0cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f960c0b2d80 0x7f960c0ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 --2- 172.21.15.81:0/1159900471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f960c06aaa0 0x7f960c1549a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 >> 172.21.15.81:0/1159900471 conn(0x7f960c0b0c40 msgr2=0x7f960c0af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 shutdown_connections 2024-09-13T18:53:45.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:45.226+0000 7f9612800700 1 -- 172.21.15.81:0/1159900471 wait complete. 2024-09-13T18:53:45.257 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:53:45.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:53:45.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:53:45.257 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:53:45.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:53:45.257 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:53:45.258 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:53:45.258 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:53:45.258 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:53:45.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.258 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:53:45.276 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42067sec preferred_lft 42067sec 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:53:45.277 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:53:45.278 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.279 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:53:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:53:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::3069:26ff:fefd:eadb/64 scope link 2024-09-13T18:53:45.279 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:53:45.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.280 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:53:45.356 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:53:45.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.361 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:53:45.424 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:53:45.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.425 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:53:45.426 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:53:45.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:53:45.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:53:45.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:53:45.426 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:53:45.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.554 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:53:45.569 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:53:45.570 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:53:45.570 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:53:45.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:53:45.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:53:45.649 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:53:45.709 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:53:45.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:53:45.709 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:53:45.765 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:53:45.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:53:45.891 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:53:45.891 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:53:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:53:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:53:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:53:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:53:45.915 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:53:45.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:53:45.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:53:45.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:45.952 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:53:46.035 INFO:teuthology.orchestra.run.smithi081.stdout:client8259 2024-09-13T18:53:46.035 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:53:46.035 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:53:46.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:53:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.302+0000 7f10cb200700 1 Processor -- start 2024-09-13T18:53:46.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10cb200700 1 -- start start 2024-09-13T18:53:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10cb200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f10cc15a740 0x7f10cc0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10cb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc0cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10cb200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc0712f0 con 0x7f10cc06d710 2024-09-13T18:53:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10cb200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10cc06e380 con 0x7f10cc15a740 2024-09-13T18:53:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10cb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc070420 con 0x7f10cc071840 2024-09-13T18:53:46.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10ca800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f10cc06d710 0x7f10cc06c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:45424/0 (socket says 172.21.15.81:45424) 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10ca800700 1 -- 172.21.15.81:0/3331471616 learned_addr learned my addr 172.21.15.81:0/3331471616 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10c9e00700 1 --2- 172.21.15.81:0/3331471616 >> v2:172.21.15.81:3300/0 conn(0x7f10cc15a740 0x7f10cc0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.306+0000 7f10c9400700 1 --2- 172.21.15.81:0/3331471616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc0cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c8a00700 1 -- 172.21.15.81:0/3331471616 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234018526 0 0) 0x7f10cc0712f0 con 0x7f10cc06d710 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c8a00700 1 -- 172.21.15.81:0/3331471616 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10b00035d0 con 0x7f10cc06d710 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c9e00700 1 -- 172.21.15.81:0/3331471616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 msgr2=0x7f10cc0cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c9e00700 1 --2- 172.21.15.81:0/3331471616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc0cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c9e00700 1 -- 172.21.15.81:0/3331471616 >> v1:172.21.15.81:6789/0 conn(0x7f10cc06d710 legacy=0x7f10cc06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c9e00700 1 -- 172.21.15.81:0/3331471616 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc0706e0 con 0x7f10cc15a740 2024-09-13T18:53:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c9e00700 1 --2- 172.21.15.81:0/3331471616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc15a740 0x7f10cc0cf3b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009850 tx=0x7f10bc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ec85bbb6cffbec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c8a00700 1 -- 172.21.15.81:0/3331471616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc011830 con 0x7f10cc15a740 2024-09-13T18:53:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c8a00700 1 -- 172.21.15.81:0/3331471616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc011990 con 0x7f10cc15a740 2024-09-13T18:53:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10c8a00700 1 -- 172.21.15.81:0/3331471616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc011d40 con 0x7f10cc15a740 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 -- 172.21.15.81:0/3331471616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc15a740 msgr2=0x7f10cc0cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 --2- 172.21.15.81:0/3331471616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc15a740 0x7f10cc0cf3b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009850 tx=0x7f10bc009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 -- 172.21.15.81:0/3331471616 shutdown_connections 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 --2- 172.21.15.81:0/3331471616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc0cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 --2- 172.21.15.81:0/3331471616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc15a740 0x7f10cc0cf3b0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 -- 172.21.15.81:0/3331471616 >> 172.21.15.81:0/3331471616 conn(0x7f10cc06a780 msgr2=0x7f10cc06ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 -- 172.21.15.81:0/3331471616 shutdown_connections 2024-09-13T18:53:46.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.310+0000 7f10cb200700 1 -- 172.21.15.81:0/3331471616 wait complete. 2024-09-13T18:53:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 Processor -- start 2024-09-13T18:53:46.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 -- start start 2024-09-13T18:53:46.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 0x7f10cc14e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc14d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc15a740 0x7f10cc09bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0cde50 con 0x7f10cc06d710 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0cd2d0 con 0x7f10cc15a740 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.314+0000 7f10cb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0cd5b0 con 0x7f10cc071840 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 0x7f10cc14e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 0x7f10cc14e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46626/0 (socket says 172.21.15.81:46626) 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 -- 172.21.15.81:0/3177480094 learned_addr learned my addr 172.21.15.81:0/3177480094 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9400700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc14d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:46.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10ca800700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc15a740 0x7f10cc09bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 -- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 msgr2=0x7f10cc14d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc14d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 -- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc15a740 msgr2=0x7f10cc09bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc15a740 0x7f10cc09bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 -- 172.21.15.81:0/3177480094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0094b0 con 0x7f10cc06d710 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10ca800700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc15a740 0x7f10cc09bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c9e00700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 0x7f10cc14e750 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f10bc014040 tx=0x7f10bc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc0038c0 con 0x7f10cc06d710 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc01e070 con 0x7f10cc06d710 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc0cd890 con 0x7f10cc06d710 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc003c80 con 0x7f10cc06d710 2024-09-13T18:53:46.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc14d710 con 0x7f10cc06d710 2024-09-13T18:53:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.318+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc151b30 con 0x7f10cc06d710 2024-09-13T18:53:46.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.322+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10bc01a420 con 0x7f10cc06d710 2024-09-13T18:53:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.322+0000 7f10c2000700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10ac066730 0x7f10ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.322+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f10bc020070 con 0x7f10cc06d710 2024-09-13T18:53:46.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.322+0000 7f10c9400700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10ac066730 0x7f10ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:46.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.322+0000 7f10c9400700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10ac066730 0x7f10ac068bf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10cc151a30 tx=0x7f10b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:46.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.330+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10bc052ad0 con 0x7f10cc06d710 2024-09-13T18:53:46.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:46.550+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f10cc0cf3b0 con 0x7f10cc06d710 2024-09-13T18:53:47.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.490+0000 7f10c2000700 1 -- 172.21.15.81:0/3177480094 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v87) v1 ==== 105+0+0 (secure 0 0 0) 0x7f10bc0150b0 con 0x7f10cc06d710 2024-09-13T18:53:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10ac066730 msgr2=0x7f10ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10ac066730 0x7f10ac068bf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f10cc151a30 tx=0x7f10b8008040 comp rx=0 tx=0).stop 2024-09-13T18:53:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 msgr2=0x7f10cc14e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 0x7f10cc14e750 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f10bc014040 tx=0x7f10bc004770 comp rx=0 tx=0).stop 2024-09-13T18:53:47.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 shutdown_connections 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10ac066730 0x7f10ac068bf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10cc15a740 0x7f10cc09bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10cc071840 0x7f10cc14d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 --2- 172.21.15.81:0/3177480094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f10cc06d710 0x7f10cc14e750 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 >> 172.21.15.81:0/3177480094 conn(0x7f10cc06a780 msgr2=0x7f10cc06ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 shutdown_connections 2024-09-13T18:53:47.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.494+0000 7f10cb200700 1 -- 172.21.15.81:0/3177480094 wait complete. 2024-09-13T18:53:47.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.690+0000 7efd3a400700 1 Processor -- start 2024-09-13T18:53:47.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.690+0000 7efd3a400700 1 -- start start 2024-09-13T18:53:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd3a400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efd3406aaa0 0x7efd3406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd3a400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd340ccb40 con 0x7efd340cb020 2024-09-13T18:53:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd3a400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3406b430 con 0x7efd340cc6f0 2024-09-13T18:53:47.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd3a400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd340b2ad0 con 0x7efd3406aaa0 2024-09-13T18:53:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efd340cb020 0x7efd3415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52424/0 (socket says 172.21.15.81:52424) 2024-09-13T18:53:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39000700 1 -- 172.21.15.81:0/3921751186 learned_addr learned my addr 172.21.15.81:0/3921751186 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39a00700 1 --2- 172.21.15.81:0/3921751186 >> v2:172.21.15.178:3300/0 conn(0x7efd3406aaa0 0x7efd3406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd33400700 1 -- 172.21.15.81:0/3921751186 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256358962 0 0) 0x7efd340ccb40 con 0x7efd340cb020 2024-09-13T18:53:47.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd33400700 1 -- 172.21.15.81:0/3921751186 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd1c0035d0 con 0x7efd340cb020 2024-09-13T18:53:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39a00700 1 -- 172.21.15.81:0/3921751186 >> v1:172.21.15.178:6789/0 conn(0x7efd340cc6f0 legacy=0x7efd3415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39a00700 1 -- 172.21.15.81:0/3921751186 >> v1:172.21.15.81:6789/0 conn(0x7efd340cb020 legacy=0x7efd3415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39a00700 1 -- 172.21.15.81:0/3921751186 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3415b960 con 0x7efd3406aaa0 2024-09-13T18:53:47.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd39a00700 1 --2- 172.21.15.81:0/3921751186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd3406aaa0 0x7efd3406aef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009d90 tx=0x7efd2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1273d9d71df651ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd33400700 1 -- 172.21.15.81:0/3921751186 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c00e070 con 0x7efd3406aaa0 2024-09-13T18:53:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.694+0000 7efd33400700 1 -- 172.21.15.81:0/3921751186 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2c00bb20 con 0x7efd3406aaa0 2024-09-13T18:53:47.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd33400700 1 -- 172.21.15.81:0/3921751186 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2c012430 con 0x7efd3406aaa0 2024-09-13T18:53:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 -- 172.21.15.81:0/3921751186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd3406aaa0 msgr2=0x7efd3406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 --2- 172.21.15.81:0/3921751186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd3406aaa0 0x7efd3406aef0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009d90 tx=0x7efd2c00b330 comp rx=0 tx=0).stop 2024-09-13T18:53:47.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 -- 172.21.15.81:0/3921751186 shutdown_connections 2024-09-13T18:53:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 --2- 172.21.15.81:0/3921751186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd3406aaa0 0x7efd3406aef0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 -- 172.21.15.81:0/3921751186 >> 172.21.15.81:0/3921751186 conn(0x7efd340b0c40 msgr2=0x7efd3406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 -- 172.21.15.81:0/3921751186 shutdown_connections 2024-09-13T18:53:47.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.698+0000 7efd3a400700 1 -- 172.21.15.81:0/3921751186 wait complete. 2024-09-13T18:53:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 Processor -- start 2024-09-13T18:53:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 -- start start 2024-09-13T18:53:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd3406aaa0 0x7efd341570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 0x7efd34157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd340cc6f0 0x7efd3413af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd34158660 con 0x7efd340cb020 2024-09-13T18:53:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd341583c0 con 0x7efd340cc6f0 2024-09-13T18:53:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.702+0000 7efd3a400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd34156310 con 0x7efd3406aaa0 2024-09-13T18:53:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 0x7efd34157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd39000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd3406aaa0 0x7efd341570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 0x7efd34157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48444/0 (socket says 172.21.15.81:48444) 2024-09-13T18:53:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 -- 172.21.15.81:0/332054964 learned_addr learned my addr 172.21.15.81:0/332054964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd39a00700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd340cc6f0 0x7efd3413af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 -- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd3406aaa0 msgr2=0x7efd341570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd3406aaa0 0x7efd341570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 -- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd340cc6f0 msgr2=0x7efd3413af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd340cc6f0 0x7efd3413af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 -- 172.21.15.81:0/332054964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c009a70 con 0x7efd340cb020 2024-09-13T18:53:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd33e00700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 0x7efd34157e80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c500 tx=0x7efd2000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200052d0 con 0x7efd340cb020 2024-09-13T18:53:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20005430 con 0x7efd340cb020 2024-09-13T18:53:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd341565f0 con 0x7efd340cb020 2024-09-13T18:53:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200055a0 con 0x7efd340cb020 2024-09-13T18:53:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.706+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd34156bb0 con 0x7efd340cb020 2024-09-13T18:53:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.710+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3406aef0 con 0x7efd340cb020 2024-09-13T18:53:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.710+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efd200038e0 con 0x7efd340cb020 2024-09-13T18:53:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.710+0000 7efd30c00700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd14066760 0x7efd14068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.710+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efd20083350 con 0x7efd340cb020 2024-09-13T18:53:47.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.714+0000 7efd39000700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd14066760 0x7efd14068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:47.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.714+0000 7efd39000700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd14066760 0x7efd14068c20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efd28007fd0 tx=0x7efd28007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:47.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.718+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efd20050610 con 0x7efd340cb020 2024-09-13T18:53:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.950+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd3406b430 con 0x7efd340cb020 2024-09-13T18:53:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.954+0000 7efd30c00700 1 -- 172.21.15.81:0/332054964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4755 (secure 0 0 0) 0x7efd3406b430 con 0x7efd340cb020 2024-09-13T18:53:47.963 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:47.963 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":88,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":7675,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:53:47.493726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":8076,"mds_1":8073},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:creating","state_seq":1,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:53:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd14066760 msgr2=0x7efd14068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd14066760 0x7efd14068c20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efd28007fd0 tx=0x7efd28007de0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 msgr2=0x7efd34157e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 0x7efd34157e80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7efd2000c500 tx=0x7efd2000c810 comp rx=0 tx=0).stop 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 shutdown_connections 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efd14066760 0x7efd14068c20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd340cc6f0 0x7efd3413af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd340cb020 0x7efd34157e80 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 --2- 172.21.15.81:0/332054964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd3406aaa0 0x7efd341570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 >> 172.21.15.81:0/332054964 conn(0x7efd340b0c40 msgr2=0x7efd3406ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 shutdown_connections 2024-09-13T18:53:47.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:47.958+0000 7efd3a400700 1 -- 172.21.15.81:0/332054964 wait complete. 2024-09-13T18:53:47.971 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 88 2024-09-13T18:53:48.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:53:33.403058+0000', 'modified': '2024-09-13T18:53:47.493726+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 8076, 'mds_1': 8073}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8073': {'gid': 8073, 'name': 'c', 'rank': 1, 'incarnation': 88, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.81:6836/548467778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 548467778}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 548467778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8076': {'gid': 8076, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2448579226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2448579226}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2448579226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:53:48.400 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8073:up:creating 2024-09-13T18:53:48.917 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:53:48.906+0000 7fe88d800700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T18:53:49.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.566+0000 7fd1be400700 1 Processor -- start 2024-09-13T18:53:49.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.566+0000 7fd1be400700 1 -- start start 2024-09-13T18:53:49.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1b806aaa0 0x7fd1b815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:49.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b80b3980 0x7fd1b806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:49.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b815e560 con 0x7fd1b806cbb0 2024-09-13T18:53:49.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80adf90 con 0x7fd1b806aaa0 2024-09-13T18:53:49.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b806b3c0 con 0x7fd1b80b3980 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1b806aaa0 0x7fd1b815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1b806aaa0 0x7fd1b815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48450/0 (socket says 172.21.15.81:48450) 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 -- 172.21.15.81:0/3157821017 learned_addr learned my addr 172.21.15.81:0/3157821017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1afe00700 1 --2- 172.21.15.81:0/3157821017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b80b3980 0x7fd1b806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 -- 172.21.15.81:0/3157821017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b80b3980 msgr2=0x7fd1b806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 --2- 172.21.15.81:0/3157821017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b80b3980 0x7fd1b806ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 -- 172.21.15.81:0/3157821017 >> v1:172.21.15.178:6789/0 conn(0x7fd1b806cbb0 legacy=0x7fd1b806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 -- 172.21.15.81:0/3157821017 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b815d920 con 0x7fd1b806aaa0 2024-09-13T18:53:49.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1bd000700 1 --2- 172.21.15.81:0/3157821017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806aaa0 0x7fd1b815d310 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009e50 tx=0x7fd1a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207ed2fccaa0d71e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1b7e00700 1 -- 172.21.15.81:0/3157821017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800e070 con 0x7fd1b806aaa0 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1b7e00700 1 -- 172.21.15.81:0/3157821017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a800b9c0 con 0x7fd1b806aaa0 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1b7e00700 1 -- 172.21.15.81:0/3157821017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800bd70 con 0x7fd1b806aaa0 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 -- 172.21.15.81:0/3157821017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806aaa0 msgr2=0x7fd1b815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 --2- 172.21.15.81:0/3157821017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806aaa0 0x7fd1b815d310 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fd1a8009e50 tx=0x7fd1a800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 -- 172.21.15.81:0/3157821017 shutdown_connections 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.570+0000 7fd1be400700 1 --2- 172.21.15.81:0/3157821017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b80b3980 0x7fd1b806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.574+0000 7fd1be400700 1 --2- 172.21.15.81:0/3157821017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806aaa0 0x7fd1b815d310 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.574+0000 7fd1be400700 1 -- 172.21.15.81:0/3157821017 >> 172.21.15.81:0/3157821017 conn(0x7fd1b80b0c40 msgr2=0x7fd1b806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.574+0000 7fd1be400700 1 -- 172.21.15.81:0/3157821017 shutdown_connections 2024-09-13T18:53:49.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.574+0000 7fd1be400700 1 -- 172.21.15.81:0/3157821017 wait complete. 2024-09-13T18:53:49.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.574+0000 7fd1be400700 1 Processor -- start 2024-09-13T18:53:49.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.574+0000 7fd1be400700 1 -- start start 2024-09-13T18:53:49.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b806aaa0 0x7fd1b813aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:49.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 0x7fd1b81425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b80b3980 0x7fd1b80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80cb040 con 0x7fd1b806cbb0 2024-09-13T18:53:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8141890 con 0x7fd1b80b3980 2024-09-13T18:53:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80cb290 con 0x7fd1b806aaa0 2024-09-13T18:53:49.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 0x7fd1b81425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:49.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 0x7fd1b81425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48464/0 (socket says 172.21.15.81:48464) 2024-09-13T18:53:49.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 -- 172.21.15.81:0/1493135170 learned_addr learned my addr 172.21.15.81:0/1493135170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:49.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1bda00700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b80b3980 0x7fd1b80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:49.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1bd000700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b806aaa0 0x7fd1b813aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:49.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 -- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b806aaa0 msgr2=0x7fd1b813aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:49.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b806aaa0 0x7fd1b813aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 -- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b80b3980 msgr2=0x7fd1b80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:49.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b80b3980 0x7fd1b80cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 -- 172.21.15.81:0/1493135170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8009b30 con 0x7fd1b806cbb0 2024-09-13T18:53:49.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1afe00700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 0x7fd1b81425b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000d7d0 tx=0x7fd1a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:49.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0017070 con 0x7fd1b806cbb0 2024-09-13T18:53:49.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a0004020 con 0x7fd1b806cbb0 2024-09-13T18:53:49.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a00041b0 con 0x7fd1b806cbb0 2024-09-13T18:53:49.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80cb570 con 0x7fd1b806cbb0 2024-09-13T18:53:49.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.578+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b8142af0 con 0x7fd1b806cbb0 2024-09-13T18:53:49.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.582+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b8143540 con 0x7fd1b806cbb0 2024-09-13T18:53:49.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.582+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd1a0004310 con 0x7fd1b806cbb0 2024-09-13T18:53:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.582+0000 7fd1b5600700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd194066730 0x7fd194068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.582+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd1a0083cd0 con 0x7fd1b806cbb0 2024-09-13T18:53:49.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.582+0000 7fd1bd000700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd194066730 0x7fd194068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:49.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.586+0000 7fd1bd000700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd194066730 0x7fd194068bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800b370 tx=0x7fd1a8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:49.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.590+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd1a0050ef0 con 0x7fd1b806cbb0 2024-09-13T18:53:49.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.822+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1b806afa0 con 0x7fd1b806cbb0 2024-09-13T18:53:49.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.822+0000 7fd1b5600700 1 -- 172.21.15.81:0/1493135170 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4767 (secure 0 0 0) 0x7fd1a0054510 con 0x7fd1b806cbb0 2024-09-13T18:53:49.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:49.834 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:53:49.504696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":7,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:53:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd194066730 msgr2=0x7fd194068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd194066730 0x7fd194068bf0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800b370 tx=0x7fd1a8009000 comp rx=0 tx=0).stop 2024-09-13T18:53:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 msgr2=0x7fd1b81425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 0x7fd1b81425b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000d7d0 tx=0x7fd1a000dae0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 shutdown_connections 2024-09-13T18:53:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd194066730 0x7fd194068bf0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b80b3980 0x7fd1b80cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1b806cbb0 0x7fd1b81425b0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 --2- 172.21.15.81:0/1493135170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b806aaa0 0x7fd1b813aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 >> 172.21.15.81:0/1493135170 conn(0x7fd1b80b0c40 msgr2=0x7fd1b8071550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 shutdown_connections 2024-09-13T18:53:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:49.826+0000 7fd1be400700 1 -- 172.21.15.81:0/1493135170 wait complete. 2024-09-13T18:53:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 91 2024-09-13T18:53:50.261 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:53:33.403058+0000', 'modified': '2024-09-13T18:53:49.504696+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 8076, 'mds_1': 8073, 'mds_2': 7675}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7675': {'gid': 7675, 'name': 'd', 'rank': 2, 'incarnation': 90, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.178:6834/3980969466', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6832', 'nonce': 3980969466}, {'type': 'v1', 'addr': '172.21.15.178:6834', 'nonce': 3980969466}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8073': {'gid': 8073, 'name': 'c', 'rank': 1, 'incarnation': 88, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.81:6836/548467778', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 548467778}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 548467778}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8076': {'gid': 8076, 'name': 'a', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2448579226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2448579226}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2448579226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:53:50.261 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:53:50.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:53:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.426+0000 7fc6b1200700 1 Processor -- start 2024-09-13T18:53:50.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.426+0000 7fc6b1200700 1 -- start start 2024-09-13T18:53:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.426+0000 7fc6b1200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6b1200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc6ac0b2670 0x7fc6ac0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6b1200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac0b3040 con 0x7fc6ac1610b0 2024-09-13T18:53:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6b1200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac070b30 con 0x7fc6ac0b2670 2024-09-13T18:53:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6b1200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0b3560 con 0x7fc6ac06aaa0 2024-09-13T18:53:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6abe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc6ac0b2670 0x7fc6ac0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6ab400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fc6ac1610b0 0x7fc6ac0719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:40008/0 (socket says 172.21.15.81:40008) 2024-09-13T18:53:50.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6ab400700 1 -- 172.21.15.81:0/466075532 learned_addr learned my addr 172.21.15.81:0/466075532 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:50.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6a2a00700 1 -- 172.21.15.81:0/466075532 >> v2:172.21.15.178:3300/0 conn(0x7fc6ac0b2670 msgr2=0x7fc6ac0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/466075532 >> v2:172.21.15.178:3300/0 conn(0x7fc6ac0b2670 0x7fc6ac0b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6a2a00700 1 -- 172.21.15.81:0/466075532 >> v1:172.21.15.178:6789/0 conn(0x7fc6ac1610b0 legacy=0x7fc6ac0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6a2a00700 1 -- 172.21.15.81:0/466075532 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac06b420 con 0x7fc6ac06aaa0 2024-09-13T18:53:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/466075532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac06aee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc694009d90 tx=0x7fc69400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e76ad05e8e4f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6aaa00700 1 -- 172.21.15.81:0/466075532 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400e070 con 0x7fc6ac06aaa0 2024-09-13T18:53:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6aaa00700 1 -- 172.21.15.81:0/466075532 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400bb20 con 0x7fc6ac06aaa0 2024-09-13T18:53:50.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.430+0000 7fc6aaa00700 1 -- 172.21.15.81:0/466075532 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694012430 con 0x7fc6ac06aaa0 2024-09-13T18:53:50.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 -- 172.21.15.81:0/466075532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 msgr2=0x7fc6ac06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 --2- 172.21.15.81:0/466075532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac06aee0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc694009d90 tx=0x7fc69400b330 comp rx=0 tx=0).stop 2024-09-13T18:53:50.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 -- 172.21.15.81:0/466075532 shutdown_connections 2024-09-13T18:53:50.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 --2- 172.21.15.81:0/466075532 >> v2:172.21.15.178:3300/0 conn(0x7fc6ac0b2670 0x7fc6ac0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 --2- 172.21.15.81:0/466075532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac06aee0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 -- 172.21.15.81:0/466075532 >> 172.21.15.81:0/466075532 conn(0x7fc6ac0b0c40 msgr2=0x7fc6ac06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 -- 172.21.15.81:0/466075532 shutdown_connections 2024-09-13T18:53:50.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 -- 172.21.15.81:0/466075532 wait complete. 2024-09-13T18:53:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 Processor -- start 2024-09-13T18:53:50.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.434+0000 7fc6b1200700 1 -- start start 2024-09-13T18:53:50.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 0x7fc6ac0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6ac1610b0 0x7fc6ac15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac15b020 con 0x7fc6ac0b2670 2024-09-13T18:53:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac1f6ac0 con 0x7fc6ac1610b0 2024-09-13T18:53:50.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac158080 con 0x7fc6ac06aaa0 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 0x7fc6ac0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 0x7fc6ac0cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48478/0 (socket says 172.21.15.81:48478) 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 -- 172.21.15.81:0/1602140729 learned_addr learned my addr 172.21.15.81:0/1602140729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6abe00700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6ac1610b0 0x7fc6ac15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 -- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 msgr2=0x7fc6ac157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 -- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6ac1610b0 msgr2=0x7fc6ac15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6ac1610b0 0x7fc6ac15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 -- 172.21.15.81:0/1602140729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009a70 con 0x7fc6ac0b2670 2024-09-13T18:53:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 0x7fc6ac0cca90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc694014040 tx=0x7fc694004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a3e00700 1 -- 172.21.15.81:0/1602140729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694012430 con 0x7fc6ac0b2670 2024-09-13T18:53:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a3e00700 1 -- 172.21.15.81:0/1602140729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694020070 con 0x7fc6ac0b2670 2024-09-13T18:53:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac164180 con 0x7fc6ac0b2670 2024-09-13T18:53:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6a3e00700 1 -- 172.21.15.81:0/1602140729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694004280 con 0x7fc6ac0b2670 2024-09-13T18:53:50.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.438+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac163bc0 con 0x7fc6ac0b2670 2024-09-13T18:53:50.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.442+0000 7fc6a3e00700 1 -- 172.21.15.81:0/1602140729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc6940043e0 con 0x7fc6ac0b2670 2024-09-13T18:53:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a3e00700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc688066730 0x7fc688068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 Processor -- start 2024-09-13T18:53:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a3e00700 1 -- 172.21.15.81:0/1602140729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc694022070 con 0x7fc6ac0b2670 2024-09-13T18:53:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 -- start start 2024-09-13T18:53:50.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc688066730 0x7fc688068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26218da0 0x26219180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 0x261e1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x261e1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x26140d80 con 0x261f7d00 2024-09-13T18:53:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2613e510 con 0x26218da0 2024-09-13T18:53:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26139e00 con 0x262196c0 2024-09-13T18:53:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc688066730 0x7fc688068bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005930 tx=0x7fc69c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 0x261e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x261e1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x261e1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:42594/0 (socket says 172.21.15.81:42594) 2024-09-13T18:53:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6abe00700 1 -- 172.21.15.81:0/3982384660 learned_addr learned my addr 172.21.15.81:0/3982384660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 0x261e1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48488/0 (socket says 172.21.15.81:48488) 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6ab400700 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26218da0 0x26219180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 -- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 msgr2=0x261e1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x261e1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 -- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26218da0 msgr2=0x26219180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26218da0 0x26219180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 -- 172.21.15.81:0/3982384660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25fac960 con 0x261f7d00 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.446+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 0x261e1890 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc694056af0 tx=0x7fc694056a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb1836a4b92dfc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc69be00700 1 -- 172.21.15.81:0/3982384660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940574f0 con 0x261f7d00 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc69be00700 1 -- 172.21.15.81:0/3982384660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694056df0 con 0x261f7d00 2024-09-13T18:53:50.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc69be00700 1 -- 172.21.15.81:0/3982384660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69405ac20 con 0x261f7d00 2024-09-13T18:53:50.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- 172.21.15.81:0/3982384660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 msgr2=0x261e1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 0x261e1890 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fc694056af0 tx=0x7fc694056a00 comp rx=0 tx=0).stop 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- 172.21.15.81:0/3982384660 shutdown_connections 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x261e1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x261f7d00 0x261e1890 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/3982384660 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26218da0 0x26219180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- 172.21.15.81:0/3982384660 >> 172.21.15.81:0/3982384660 conn(0x25f614d0 msgr2=0x261fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- 172.21.15.81:0/3982384660 shutdown_connections 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- 172.21.15.81:0/3982384660 wait complete. 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- start start 2024-09-13T18:53:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 Processor -- start 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x261cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x261cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x260f7730 con 0x262196c0 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x260fd5b0 con 0x261f7d00 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25fe5aa0 con 0x26218da0 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6b5c49740 10 client.0 _ll_register_callbacks cb 0x26133610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x261cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x261cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48502/0 (socket says 172.21.15.81:48502) 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.450+0000 7fc6abe00700 1 -- 172.21.15.81:0/1744184739 learned_addr learned my addr 172.21.15.81:0/1744184739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6abe00700 1 -- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 msgr2=0x261cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6abe00700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x261cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6abe00700 1 -- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 msgr2=0x261cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6abe00700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6abe00700 1 -- 172.21.15.81:0/1744184739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac163bc0 con 0x262196c0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6abe00700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x261cdc40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4014a00 tx=0x7fc6a4014ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49198f4935e0a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc698c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc698c00700 1 -- 172.21.15.81:0/1744184739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40156f0 con 0x262196c0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc698c00700 1 -- 172.21.15.81:0/1744184739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6a4015850 con 0x262196c0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25f6e1e0 con 0x262196c0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc698c00700 1 -- 172.21.15.81:0/1744184739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6a4015a10 con 0x262196c0 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 10 client.8289 fetch_fsmap learned FSMap version 91 2024-09-13T18:53:50.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x26100220 con 0x262196c0 2024-09-13T18:53:50.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc698c00700 1 -- 172.21.15.81:0/1744184739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25f6e1e0 con 0x262196c0 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc698c00700 1 -- 172.21.15.81:0/1744184739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 91) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fc6a4015b70 con 0x262196c0 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 10 client.8289 fetch_fsmap finished waiting for FSMap version 91 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 10 client.8289 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 20 client.8289 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x26214fb0 0x26222c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 4 client.8289 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25fb8460 con 0x26214fb0 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.454+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x26214fb0 0x26222c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc698c00700 10 client.8289 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:53:50.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6ab400700 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x26214fb0 0x26222c80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2117511f7f4136d9 server_cookie=3d6bd7887077e942 in_seq=0 out_seq=0 2024-09-13T18:53:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc698c00700 1 -- 172.21.15.81:0/1744184739 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x25fb8460 con 0x26214fb0 2024-09-13T18:53:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc698c00700 10 client.8289 handle_command_reply: tid=0 2024-09-13T18:53:50.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 client.8289 shutdown 2024-09-13T18:53:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 msgr2=0x261cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x261cdc40 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4014a00 tx=0x7fc6a4014ae0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 shutdown_connections 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x26214fb0 0x26222c80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x261cdc40 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x261cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc698c00700 0 client.8289 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/1744184739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 >> 172.21.15.81:0/1744184739 conn(0x25f614d0 msgr2=0x261f48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 shutdown_connections 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 1 -- 172.21.15.81:0/1744184739 wait complete. 2024-09-13T18:53:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.458+0000 7fc6b5c49740 20 client.8289 trim_cache size 0 max 16384 2024-09-13T18:53:50.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.478+0000 7fc6b5c49740 1 Processor -- start 2024-09-13T18:53:50.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.478+0000 7fc6b5c49740 1 -- start start 2024-09-13T18:53:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 0x261f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x262173d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x26139610 con 0x26218da0 2024-09-13T18:53:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x260fbe90 con 0x261f7d00 2024-09-13T18:53:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26190580 con 0x262196c0 2024-09-13T18:53:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 0x261f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6ab400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 0x261f2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48506/0 (socket says 172.21.15.81:48506) 2024-09-13T18:53:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 -- 172.21.15.81:0/2585838216 learned_addr learned my addr 172.21.15.81:0/2585838216 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6abe00700 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x262173d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 -- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 msgr2=0x262173d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x262173d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 -- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 msgr2=0x261f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 -- 172.21.15.81:0/2585838216 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x260e6450 con 0x26218da0 2024-09-13T18:53:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6ab400700 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 0x261f2790 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc694000f80 tx=0x7fc69401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50427ac03809146c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a0c00700 1 -- 172.21.15.81:0/2585838216 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940098f0 con 0x26218da0 2024-09-13T18:53:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a0c00700 1 -- 172.21.15.81:0/2585838216 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69406e070 con 0x26218da0 2024-09-13T18:53:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6a0c00700 1 -- 172.21.15.81:0/2585838216 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940574f0 con 0x26218da0 2024-09-13T18:53:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 -- 172.21.15.81:0/2585838216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 msgr2=0x261f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 0x261f2790 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fc694000f80 tx=0x7fc69401e070 comp rx=0 tx=0).stop 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 -- 172.21.15.81:0/2585838216 shutdown_connections 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x262196c0 0x262173d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x26218da0 0x261f2790 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/2585838216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x261f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.482+0000 7fc6b5c49740 1 -- 172.21.15.81:0/2585838216 >> 172.21.15.81:0/2585838216 conn(0x25f614d0 msgr2=0x261f70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 -- 172.21.15.81:0/2585838216 shutdown_connections 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 -- 172.21.15.81:0/2585838216 wait complete. 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 -- start start 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 Processor -- start 2024-09-13T18:53:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x26238110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x2627a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x2627a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x261f78d0 con 0x262196c0 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x26231630 con 0x261f7d00 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26237790 con 0x26218da0 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6b5c49740 10 client.0 _ll_register_callbacks cb 0x26190710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x2627a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x2627a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48522/0 (socket says 172.21.15.81:48522) 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 -- 172.21.15.81:0/448515532 learned_addr learned my addr 172.21.15.81:0/448515532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6a2a00700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x2627a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6ab400700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x26238110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 -- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 msgr2=0x2627a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x2627a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 -- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 msgr2=0x26238110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x26238110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 -- 172.21.15.81:0/448515532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c019040 con 0x262196c0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc6abe00700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x2627a7f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4001eb0 tx=0x7fc6a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdca47615f3b02e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.486+0000 7fc698c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 1 -- 172.21.15.81:0/448515532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a40145c0 con 0x262196c0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc694056df0 con 0x262196c0 2024-09-13T18:53:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 1 -- 172.21.15.81:0/448515532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc6a4000e40 con 0x262196c0 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 1 -- 172.21.15.81:0/448515532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6a4005e60 con 0x262196c0 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 10 client.8295 fetch_fsmap learned FSMap version 91 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x25fac960 con 0x262196c0 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 1 -- 172.21.15.81:0/448515532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694056df0 con 0x262196c0 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 1 -- 172.21.15.81:0/448515532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 91) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fc6a40158f0 con 0x262196c0 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 10 client.8295 fetch_fsmap finished waiting for FSMap version 91 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 10 client.8295 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 20 client.8295 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x2627c010 0x2622f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 4 client.8295 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "status"}) v1 -- 0x25fdd1e0 con 0x2627c010 2024-09-13T18:53:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6ab400700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x2627c010 0x2622f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 10 client.8295 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6ab400700 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x2627c010 0x2622f7b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25d74b3d9bbce264 server_cookie=56ed9a5136a7afd3 in_seq=0 out_seq=0 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 1 -- 172.21.15.81:0/448515532 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x25fdd1e0 con 0x2627c010 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc698c00700 10 client.8295 handle_command_reply: tid=0 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.490+0000 7fc6b5c49740 1 client.8295 shutdown 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 msgr2=0x2627a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x2627a7f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4001eb0 tx=0x7fc6a4004770 comp rx=0 tx=0).stop 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 shutdown_connections 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x2627c010 0x2622f7b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x262196c0 0x2627a7f0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26218da0 0x2627a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 --2- 172.21.15.81:0/448515532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x261f7d00 0x26238110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 >> 172.21.15.81:0/448515532 conn(0x25f614d0 msgr2=0x261f1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc698c00700 0 client.8295 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 shutdown_connections 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 1 -- 172.21.15.81:0/448515532 wait complete. 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b5c49740 20 client.8295 trim_cache size 0 max 16384 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7675, 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:53:50.510 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 1.9935543739999999, 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 91, 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 93, 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 93, 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 22.280163197 2024-09-13T18:53:50.511 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc688066730 msgr2=0x7fc688068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc688066730 0x7fc688068bf0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc69c005930 tx=0x7fc69c009040 comp rx=0 tx=0).stop 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 msgr2=0x7fc6ac0cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 0x7fc6ac0cca90 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fc694014040 tx=0x7fc694004af0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 shutdown_connections 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc688066730 0x7fc688068bf0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6ac1610b0 0x7fc6ac15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6ac0b2670 0x7fc6ac0cca90 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 --2- 172.21.15.81:0/1602140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6ac06aaa0 0x7fc6ac157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 >> 172.21.15.81:0/1602140729 conn(0x7fc6ac0b0c40 msgr2=0x7fc6ac0af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 shutdown_connections 2024-09-13T18:53:50.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.494+0000 7fc6b1200700 1 -- 172.21.15.81:0/1602140729 wait complete. 2024-09-13T18:53:50.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:53:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.694+0000 7f081fe00700 1 Processor -- start 2024-09-13T18:53:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.694+0000 7f081fe00700 1 -- start start 2024-09-13T18:53:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f08200cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08200abea0 0x7f08200ac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081fe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082015afc0 con 0x7f08200b2c20 2024-09-13T18:53:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08200cd9d0 con 0x7f08200abea0 2024-09-13T18:53:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08200cdcb0 con 0x7f08200b2840 2024-09-13T18:53:50.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08200abea0 0x7f08200ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f08200cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08200abea0 0x7f08200ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:46900/0 (socket says 172.21.15.81:46900) 2024-09-13T18:53:50.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 -- 172.21.15.81:0/2167706314 learned_addr learned my addr 172.21.15.81:0/2167706314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081e000700 1 --1- 172.21.15.81:0/2167706314 >> v1:172.21.15.178:6789/0 conn(0x7f08200b2c20 0x7f08200ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:40014/0 (socket says 172.21.15.81:40014) 2024-09-13T18:53:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 -- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 msgr2=0x7f08200cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 --2- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f08200cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 -- 172.21.15.81:0/2167706314 >> v1:172.21.15.178:6789/0 conn(0x7f08200b2c20 legacy=0x7f08200ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.698+0000 7f081f400700 1 -- 172.21.15.81:0/2167706314 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08200cdf90 con 0x7f08200abea0 2024-09-13T18:53:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081f400700 1 --2- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f08200ac310 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e50 tx=0x7f081800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd85c5a33cd1a1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081d600700 1 -- 172.21.15.81:0/2167706314 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800e070 con 0x7f08200abea0 2024-09-13T18:53:50.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081d600700 1 -- 172.21.15.81:0/2167706314 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081800b910 con 0x7f08200abea0 2024-09-13T18:53:50.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081d600700 1 -- 172.21.15.81:0/2167706314 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081800bcc0 con 0x7f08200abea0 2024-09-13T18:53:50.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 -- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 msgr2=0x7f08200ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 --2- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f08200ac310 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0818009e50 tx=0x7f081800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 -- 172.21.15.81:0/2167706314 shutdown_connections 2024-09-13T18:53:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 --2- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f08200ac310 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 --2- 172.21.15.81:0/2167706314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f08200cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 -- 172.21.15.81:0/2167706314 >> 172.21.15.81:0/2167706314 conn(0x7f08200b0bc0 msgr2=0x7f08200b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 -- 172.21.15.81:0/2167706314 shutdown_connections 2024-09-13T18:53:50.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.702+0000 7f081fe00700 1 -- 172.21.15.81:0/2167706314 wait complete. 2024-09-13T18:53:50.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.706+0000 7f081fe00700 1 Processor -- start 2024-09-13T18:53:50.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.706+0000 7f081fe00700 1 -- start start 2024-09-13T18:53:50.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.706+0000 7f081fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f0820154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.706+0000 7f081fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f082009b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.706+0000 7f081fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200b2c20 0x7f082009c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082009a4b0 con 0x7f08200b2c20 2024-09-13T18:53:50.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08201f7960 con 0x7f08200abea0 2024-09-13T18:53:50.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0820156c10 con 0x7f08200b2840 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f0820154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200b2c20 0x7f082009c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f0820154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:46910/0 (socket says 172.21.15.81:46910) 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 -- 172.21.15.81:0/1079152029 learned_addr learned my addr 172.21.15.81:0/1079152029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081e000700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f082009b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 -- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 msgr2=0x7f082009b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f082009b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 -- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200b2c20 msgr2=0x7f082009c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200b2c20 0x7f082009c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 -- 172.21.15.81:0/1079152029 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818009b30 con 0x7f08200abea0 2024-09-13T18:53:50.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081ea00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f0820154900 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f081000ea00 tx=0x7f081000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f0816a00700 1 -- 172.21.15.81:0/1079152029 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810009720 con 0x7f08200abea0 2024-09-13T18:53:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f0816a00700 1 -- 172.21.15.81:0/1079152029 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081000eea0 con 0x7f08200abea0 2024-09-13T18:53:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0820099ef0 con 0x7f08200abea0 2024-09-13T18:53:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f0816a00700 1 -- 172.21.15.81:0/1079152029 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000ca50 con 0x7f08200abea0 2024-09-13T18:53:50.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.710+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08201568a0 con 0x7f08200abea0 2024-09-13T18:53:50.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.714+0000 7f0816a00700 1 -- 172.21.15.81:0/1079152029 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f081000cbb0 con 0x7f08200abea0 2024-09-13T18:53:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0816a00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0800066730 0x7f0800068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0816a00700 1 -- 172.21.15.81:0/1079152029 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f08100845f0 con 0x7f08200abea0 2024-09-13T18:53:50.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081e000700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0800066730 0x7f0800068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081e000700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0800066730 0x7f0800068bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0820159be0 tx=0x7f080c007ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 Processor -- start 2024-09-13T18:53:50.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 -- start start 2024-09-13T18:53:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3eefb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3eec3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3eec3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3ee22d80 con 0x3eefb6c0 2024-09-13T18:53:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3ee20510 con 0x3eefada0 2024-09-13T18:53:50.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3ee1be00 con 0x3eed9d00 2024-09-13T18:53:50.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3eec3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3eec3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48534/0 (socket says 172.21.15.81:48534) 2024-09-13T18:53:50.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081f400700 1 -- 172.21.15.81:0/2546526766 learned_addr learned my addr 172.21.15.81:0/2546526766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081ea00700 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3eefb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.718+0000 7f081e000700 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3eec3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081f400700 1 -- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 msgr2=0x3eec3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081f400700 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3eec3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081f400700 1 -- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 msgr2=0x3eefb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081f400700 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3eefb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081f400700 1 -- 172.21.15.81:0/2546526766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3ec8e960 con 0x3eefb6c0 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081ea00700 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3eefb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:50.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f081f400700 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3eec3dd0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f082006b7f0 tx=0x7f0818010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aef4c997d5f709f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f080b400700 1 -- 172.21.15.81:0/2546526766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818003a40 con 0x3eefb6c0 2024-09-13T18:53:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f080b400700 1 -- 172.21.15.81:0/2546526766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818003ba0 con 0x3eefb6c0 2024-09-13T18:53:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f080b400700 1 -- 172.21.15.81:0/2546526766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818004040 con 0x3eefb6c0 2024-09-13T18:53:50.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 -- 172.21.15.81:0/2546526766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 msgr2=0x3eec3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3eec3dd0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f082006b7f0 tx=0x7f0818010000 comp rx=0 tx=0).stop 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 -- 172.21.15.81:0/2546526766 shutdown_connections 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3eec3dd0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3eec3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2546526766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3eefb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 -- 172.21.15.81:0/2546526766 >> 172.21.15.81:0/2546526766 conn(0x3ec434d0 msgr2=0x3eedcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 -- 172.21.15.81:0/2546526766 shutdown_connections 2024-09-13T18:53:50.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 -- 172.21.15.81:0/2546526766 wait complete. 2024-09-13T18:53:50.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 -- start start 2024-09-13T18:53:50.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.722+0000 7f0828c7d740 1 Processor -- start 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eed9d00 0x3eefa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 0x3eef65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefb6c0 0x3ef013e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3edd9730 con 0x3eefada0 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3eddf5b0 con 0x3eed9d00 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3ecc7aa0 con 0x3eefb6c0 2024-09-13T18:53:50.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 10 client.0 _ll_register_callbacks cb 0x3ee15610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:50.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 0x3eef65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 0x3eef65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48546/0 (socket says 172.21.15.81:48546) 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 -- 172.21.15.81:0/3844625210 learned_addr learned my addr 172.21.15.81:0/3844625210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081ea00700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eed9d00 0x3eefa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081f400700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefb6c0 0x3ef013e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 -- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefb6c0 msgr2=0x3ef013e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefb6c0 0x3ef013e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 -- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eed9d00 msgr2=0x3eefa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eed9d00 0x3eefa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 -- 172.21.15.81:0/3844625210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08201568a0 con 0x3eefada0 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081ea00700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eed9d00 0x3eefa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081f400700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefb6c0 0x3ef013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f081e000700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 0x3eef65b0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f08200aeb00 tx=0x7f080c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd978ac359d3386 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f07ffe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f07ffe00700 1 -- 172.21.15.81:0/3844625210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c014bb0 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f07ffe00700 1 -- 172.21.15.81:0/3844625210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f080c014d10 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3ec501e0 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f07ffe00700 1 -- 172.21.15.81:0/3844625210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f080c0213f0 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 10 client.8304 fetch_fsmap learned FSMap version 91 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x7f081800be70 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f07ffe00700 1 -- 172.21.15.81:0/3844625210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3ec501e0 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.726+0000 7f07ffe00700 1 -- 172.21.15.81:0/3844625210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 91) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f080c020070 con 0x3eefada0 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 10 client.8304 fetch_fsmap finished waiting for FSMap version 91 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 10 client.8304 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 20 client.8304 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:50.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eeb32a0 0x3eeb3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 4 client.8304 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3ec9a460 con 0x3eeb32a0 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f081ea00700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eeb32a0 0x3eeb3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f081ea00700 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eeb32a0 0x3eeb3680 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3101432b4fbd62a4 server_cookie=41dee1a017e3626a in_seq=0 out_seq=0 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f07ffe00700 10 client.8304 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f07ffe00700 1 -- 172.21.15.81:0/3844625210 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3ec9a460 con 0x3eeb32a0 2024-09-13T18:53:50.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f07ffe00700 10 client.8304 handle_command_reply: tid=0 2024-09-13T18:53:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 client.8304 shutdown 2024-09-13T18:53:50.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 msgr2=0x3eef65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 0x3eef65b0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f08200aeb00 tx=0x7f080c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 shutdown_connections 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eeb32a0 0x3eeb3680 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefb6c0 0x3ef013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefada0 0x3eef65b0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f07ffe00700 0 client.8304 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 --2- 172.21.15.81:0/3844625210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eed9d00 0x3eefa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 >> 172.21.15.81:0/3844625210 conn(0x3ec434d0 msgr2=0x3eed6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 shutdown_connections 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 1 -- 172.21.15.81:0/3844625210 wait complete. 2024-09-13T18:53:50.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.730+0000 7f0828c7d740 20 client.8304 trim_cache size 0 max 16384 2024-09-13T18:53:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.750+0000 7f0828c7d740 1 Processor -- start 2024-09-13T18:53:50.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.750+0000 7f0828c7d740 1 -- start start 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eed9d00 0x3eed8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 0x3ef09b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefb6c0 0x3ef0a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3ee4aec0 con 0x3eed9d00 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3eeab320 con 0x3eefb6c0 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3eddde90 con 0x3eefada0 2024-09-13T18:53:50.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 0x3ef09b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eed9d00 0x3eed8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 0x3ef09b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:42688/0 (socket says 172.21.15.81:42688) 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081e000700 1 -- 172.21.15.81:0/449981019 learned_addr learned my addr 172.21.15.81:0/449981019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081f400700 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefb6c0 0x3ef0a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 -- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 msgr2=0x3ef09b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 0x3ef09b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 -- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefb6c0 msgr2=0x3ef0a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefb6c0 0x3ef0a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 -- 172.21.15.81:0/449981019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3ede2220 con 0x3eed9d00 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081e000700 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 0x3ef09b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f081ea00700 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eed9d00 0x3eed8880 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f08100829d0 tx=0x7f08100828a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f64644f326ffc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f080be00700 1 -- 172.21.15.81:0/449981019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0810059300 con 0x3eed9d00 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f080be00700 1 -- 172.21.15.81:0/449981019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081006f070 con 0x3eed9d00 2024-09-13T18:53:50.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f080be00700 1 -- 172.21.15.81:0/449981019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081005d8c0 con 0x3eed9d00 2024-09-13T18:53:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- 172.21.15.81:0/449981019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eed9d00 msgr2=0x3eed8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eed9d00 0x3eed8880 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f08100829d0 tx=0x7f08100828a0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- 172.21.15.81:0/449981019 shutdown_connections 2024-09-13T18:53:50.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefb6c0 0x3ef0a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eefada0 0x3ef09b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 --2- 172.21.15.81:0/449981019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eed9d00 0x3eed8880 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- 172.21.15.81:0/449981019 >> 172.21.15.81:0/449981019 conn(0x3ec434d0 msgr2=0x3eed5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- 172.21.15.81:0/449981019 shutdown_connections 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.754+0000 7f0828c7d740 1 -- 172.21.15.81:0/449981019 wait complete. 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.758+0000 7f0828c7d740 1 -- start start 2024-09-13T18:53:50.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.758+0000 7f0828c7d740 1 Processor -- start 2024-09-13T18:53:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.758+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3ef5d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.758+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3ef5da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3ef5df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3ef145b0 con 0x3eefb6c0 2024-09-13T18:53:50.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3ef1ab80 con 0x3eefada0 2024-09-13T18:53:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3eed95d0 con 0x3eed9d00 2024-09-13T18:53:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 10 client.0 _ll_register_callbacks cb 0x3ee72710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3ef5df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3ef5df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48550/0 (socket says 172.21.15.81:48550) 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 -- 172.21.15.81:0/2542490517 learned_addr learned my addr 172.21.15.81:0/2542490517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081e000700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3ef5da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081ea00700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3ef5d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 -- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 msgr2=0x3ef5d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3ef5d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 -- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 msgr2=0x3ef5da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3ef5da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 -- 172.21.15.81:0/2542490517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081800be70 con 0x3eefb6c0 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081f400700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3ef5df80 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0818021000 tx=0x7f081800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f23a7023ed8f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f07ffe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f07ffe00700 1 -- 172.21.15.81:0/2542490517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818003a40 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f07ffe00700 1 -- 172.21.15.81:0/2542490517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f081800b6b0 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0818003ba0 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f07ffe00700 1 -- 172.21.15.81:0/2542490517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f081801c410 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 10 client.8310 fetch_fsmap learned FSMap version 91 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x7f0820099ef0 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f07ffe00700 1 -- 172.21.15.81:0/2542490517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818003ba0 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f07ffe00700 1 -- 172.21.15.81:0/2542490517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 91) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f081800b050 con 0x3eefb6c0 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 10 client.8310 fetch_fsmap finished waiting for FSMap version 91 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 10 client.8310 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:53:50.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 20 client.8310 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eefeba0 0x3eefef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 4 client.8310 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:53:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "status"}) v1 -- 0x3ecbf1e0 con 0x3eefeba0 2024-09-13T18:53:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.762+0000 7f081ea00700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eefeba0 0x3eefef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081ea00700 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eefeba0 0x3eefef80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a20c161c86d1ad26 server_cookie=1219c924ed6267ea in_seq=0 out_seq=0 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f07ffe00700 10 client.8310 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f07ffe00700 1 -- 172.21.15.81:0/2542490517 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x3ecbf1e0 con 0x3eefeba0 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f07ffe00700 10 client.8310 handle_command_reply: tid=0 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 client.8310 shutdown 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 msgr2=0x3ef5df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3ef5df80 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0818021000 tx=0x7f081800e000 comp rx=0 tx=0).stop 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 shutdown_connections 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3eefeba0 0x3eefef80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3eefb6c0 0x3ef5df80 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3eefada0 0x3ef5da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 --2- 172.21.15.81:0/2542490517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3eed9d00 0x3ef5d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f07ffe00700 0 client.8310 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 >> 172.21.15.81:0/2542490517 conn(0x3ec434d0 msgr2=0x3eed8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 shutdown_connections 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 1 -- 172.21.15.81:0/2542490517 wait complete. 2024-09-13T18:53:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f0828c7d740 20 client.8310 trim_cache size 0 max 16384 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8073, 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 3.2723671900000002, 2024-09-13T18:53:50.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 91, 2024-09-13T18:53:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 93, 2024-09-13T18:53:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 93, 2024-09-13T18:53:50.779 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 22.571798740999999 2024-09-13T18:53:50.779 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0800066730 msgr2=0x7f0800068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0800066730 0x7f0800068bf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0820159be0 tx=0x7f080c007ef0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 msgr2=0x7f0820154900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f0820154900 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f081000ea00 tx=0x7f081000ed10 comp rx=0 tx=0).stop 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 shutdown_connections 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0800066730 0x7f0800068bf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08200b2c20 0x7f082009c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f08200b2840 0x7f082009b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 --2- 172.21.15.81:0/1079152029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08200abea0 0x7f0820154900 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 >> 172.21.15.81:0/1079152029 conn(0x7f08200b0bc0 msgr2=0x7f0820071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 shutdown_connections 2024-09-13T18:53:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.766+0000 7f081fe00700 1 -- 172.21.15.81:0/1079152029 wait complete. 2024-09-13T18:53:50.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:53:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cffe00700 1 Processor -- start 2024-09-13T18:53:50.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cffe00700 1 -- start start 2024-09-13T18:53:50.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cffe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d0006cba0 0x7f3d000b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cffe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000d1390 con 0x7f3d0015d170 2024-09-13T18:53:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cffe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000d1670 con 0x7f3d0015cd90 2024-09-13T18:53:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cffe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d000b2530 con 0x7f3d0006cba0 2024-09-13T18:53:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cff400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d0006cba0 0x7f3d000b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cff400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3d0006cba0 0x7f3d000b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48554/0 (socket says 172.21.15.81:48554) 2024-09-13T18:53:50.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.966+0000 7f3cff400700 1 -- 172.21.15.81:0/568282311 learned_addr learned my addr 172.21.15.81:0/568282311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cff400700 1 -- 172.21.15.81:0/568282311 >> v1:172.21.15.178:6789/0 conn(0x7f3d0015cd90 legacy=0x7f3d000cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cff400700 1 -- 172.21.15.81:0/568282311 >> v1:172.21.15.81:6789/0 conn(0x7f3d0015d170 legacy=0x7f3d000cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cff400700 1 -- 172.21.15.81:0/568282311 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000d1950 con 0x7f3d0006cba0 2024-09-13T18:53:50.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cff400700 1 --2- 172.21.15.81:0/568282311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0006cba0 0x7f3d000b1f50 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009e50 tx=0x7f3cf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f6e3ba17e6c085 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cfe000700 1 -- 172.21.15.81:0/568282311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800e070 con 0x7f3d0006cba0 2024-09-13T18:53:50.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cfe000700 1 -- 172.21.15.81:0/568282311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf8003a40 con 0x7f3d0006cba0 2024-09-13T18:53:50.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cfe000700 1 -- 172.21.15.81:0/568282311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8003df0 con 0x7f3d0006cba0 2024-09-13T18:53:50.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 -- 172.21.15.81:0/568282311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0006cba0 msgr2=0x7f3d000b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 --2- 172.21.15.81:0/568282311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0006cba0 0x7f3d000b1f50 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009e50 tx=0x7f3cf800b330 comp rx=0 tx=0).stop 2024-09-13T18:53:50.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 -- 172.21.15.81:0/568282311 shutdown_connections 2024-09-13T18:53:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 --2- 172.21.15.81:0/568282311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0006cba0 0x7f3d000b1f50 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 -- 172.21.15.81:0/568282311 >> 172.21.15.81:0/568282311 conn(0x7f3d000d2c10 msgr2=0x7f3d000d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 -- 172.21.15.81:0/568282311 shutdown_connections 2024-09-13T18:53:50.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.970+0000 7f3cffe00700 1 -- 172.21.15.81:0/568282311 wait complete. 2024-09-13T18:53:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 Processor -- start 2024-09-13T18:53:50.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 -- start start 2024-09-13T18:53:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0006cba0 0x7f3d0014ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 0x7f3d0014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0015d170 0x7f3d0014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0014a720 con 0x7f3d0015cd90 2024-09-13T18:53:50.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00149850 con 0x7f3d0006cba0 2024-09-13T18:53:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cffe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00149aa0 con 0x7f3d0015d170 2024-09-13T18:53:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 0x7f3d0014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 0x7f3d0014b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48556/0 (socket says 172.21.15.81:48556) 2024-09-13T18:53:50.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 -- 172.21.15.81:0/4177473646 learned_addr learned my addr 172.21.15.81:0/4177473646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cff400700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0015d170 0x7f3d0014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cfea00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0006cba0 0x7f3d0014ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 -- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0015d170 msgr2=0x7f3d0014e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0015d170 0x7f3d0014e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 -- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0006cba0 msgr2=0x7f3d0014ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0006cba0 0x7f3d0014ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 -- 172.21.15.81:0/4177473646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8009b30 con 0x7f3d0015cd90 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cfea00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0006cba0 0x7f3d0014ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 0x7f3d0014b400 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c410 tx=0x7f3ce800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.974+0000 7f3cf6a00700 1 -- 172.21.15.81:0/4177473646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80052d0 con 0x7f3d0015cd90 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.978+0000 7f3cf6a00700 1 -- 172.21.15.81:0/4177473646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8005430 con 0x7f3d0015cd90 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.978+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d00149d80 con 0x7f3d0015cd90 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.978+0000 7f3cf6a00700 1 -- 172.21.15.81:0/4177473646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80055a0 con 0x7f3d0015cd90 2024-09-13T18:53:50.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.978+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0014a340 con 0x7f3d0015cd90 2024-09-13T18:53:50.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.978+0000 7f3cf6a00700 1 -- 172.21.15.81:0/4177473646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ce80036a0 con 0x7f3d0015cd90 2024-09-13T18:53:50.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.982+0000 7f3cf6a00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3cdc066760 0x7f3cdc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.982+0000 7f3cf6a00700 1 -- 172.21.15.81:0/4177473646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ce8083470 con 0x7f3d0015cd90 2024-09-13T18:53:50.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.982+0000 7f3cfea00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3cdc066760 0x7f3cdc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.982+0000 7f3cfea00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3cdc066760 0x7f3cdc068c20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0004000 tx=0x7f3cf0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.982+0000 7f3d08fa3740 1 Processor -- start 2024-09-13T18:53:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.982+0000 7f3d08fa3740 1 -- start start 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf3a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbf02890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbf02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe61d80 con 0xbf39da0 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe5f510 con 0xbf18d00 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbe5ae00 con 0xbf3a6c0 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf3a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf3a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48558/0 (socket says 172.21.15.81:48558) 2024-09-13T18:53:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 -- 172.21.15.81:0/3691478861 learned_addr learned my addr 172.21.15.81:0/3691478861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbf02890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cff400700 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbf02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 -- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 msgr2=0xbf02dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbf02dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 -- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 msgr2=0xbf02890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbf02890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 -- 172.21.15.81:0/3691478861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xbccd960 con 0xbf39da0 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf3a180 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0006a10 tx=0x7f3cf0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5d4e0b65ebd5fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cef400700 1 -- 172.21.15.81:0/3691478861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf001d070 con 0xbf39da0 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cef400700 1 -- 172.21.15.81:0/3691478861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0007440 con 0xbf39da0 2024-09-13T18:53:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3cef400700 1 -- 172.21.15.81:0/3691478861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00075b0 con 0xbf39da0 2024-09-13T18:53:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3691478861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 msgr2=0xbf3a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf3a180 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0006a10 tx=0x7f3cf0011000 comp rx=0 tx=0).stop 2024-09-13T18:53:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3691478861 shutdown_connections 2024-09-13T18:53:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbf02dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbf02890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3691478861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf3a180 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3691478861 >> 172.21.15.81:0/3691478861 conn(0xbc824d0 msgr2=0xbf1bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3691478861 shutdown_connections 2024-09-13T18:53:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.986+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3691478861 wait complete. 2024-09-13T18:53:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 -- start start 2024-09-13T18:53:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 Processor -- start 2024-09-13T18:53:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 0xbf3a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf39da0 0xbef3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbeefbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe18730 con 0xbf18d00 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe1e5b0 con 0xbf39da0 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbd06aa0 con 0xbf3a6c0 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 10 client.0 _ll_register_callbacks cb 0xbe54610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 0xbf3a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 0xbf3a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48570/0 (socket says 172.21.15.81:48570) 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 -- 172.21.15.81:0/3454071430 learned_addr learned my addr 172.21.15.81:0/3454071430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cff400700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbeefbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf39da0 0xbef3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 -- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 msgr2=0xbeefbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbeefbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 -- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf39da0 msgr2=0xbef3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf39da0 0xbef3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 -- 172.21.15.81:0/3454071430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf000f040 con 0xbf18d00 2024-09-13T18:53:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf39da0 0xbef3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 0xbf3a180 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0xbe249e0 tx=0x7f3cf00037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c7c59587f7dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3ce3e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3454071430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000ea90 con 0xbf18d00 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3454071430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3cf002dbf0 con 0xbf18d00 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xbc8f1e0 con 0xbf18d00 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3454071430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cf002ddb0 con 0xbf18d00 2024-09-13T18:53:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 10 client.8325 fetch_fsmap learned FSMap version 91 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0xbe21220 con 0xbf18d00 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3454071430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xbc8f1e0 con 0xbf18d00 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3454071430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 91) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f3cf002a070 con 0xbf18d00 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 10 client.8325 fetch_fsmap finished waiting for FSMap version 91 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 10 client.8325 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 20 client.8325 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.990+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf40920 0xbf40d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 4 client.8325 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xbcd9460 con 0xbf40920 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf40920 0xbf40d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf40920 0xbf40d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f145dd8bfe947817 server_cookie=2a593a8066bb5962 in_seq=0 out_seq=0 2024-09-13T18:53:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3ce3e00700 10 client.8325 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3454071430 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xbcd9460 con 0xbf40920 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3ce3e00700 10 client.8325 handle_command_reply: tid=0 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 client.8325 shutdown 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 msgr2=0xbf3a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 0xbf3a180 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0xbe249e0 tx=0x7f3cf00037a0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 shutdown_connections 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf40920 0xbf40d00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbeefbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf39da0 0xbef3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3454071430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf18d00 0xbf3a180 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3ce3e00700 0 client.8325 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 >> 172.21.15.81:0/3454071430 conn(0xbc824d0 msgr2=0xbf15680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 shutdown_connections 2024-09-13T18:53:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3454071430 wait complete. 2024-09-13T18:53:51.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:50.994+0000 7f3d08fa3740 20 client.8325 trim_cache size 0 max 16384 2024-09-13T18:53:51.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.014+0000 7f3d08fa3740 1 Processor -- start 2024-09-13T18:53:51.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.014+0000 7f3d08fa3740 1 -- start start 2024-09-13T18:53:51.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf18d00 0xbeefb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf17690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf3a6c0 0xbf17bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe254f0 con 0xbf39da0 2024-09-13T18:53:51.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbe0ee80 con 0xbf3a6c0 2024-09-13T18:53:51.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbf40140 con 0xbf18d00 2024-09-13T18:53:51.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf17690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf17690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48580/0 (socket says 172.21.15.81:48580) 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 -- 172.21.15.81:0/940921288 learned_addr learned my addr 172.21.15.81:0/940921288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cfea00700 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf18d00 0xbeefb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 -- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf18d00 msgr2=0xbeefb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf18d00 0xbeefb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 -- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf3a6c0 msgr2=0xbf17bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cff400700 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf3a6c0 0xbf17bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf3a6c0 0xbf17bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 -- 172.21.15.81:0/940921288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xbe07450 con 0xbf39da0 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cff400700 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf3a6c0 0xbf17bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:51.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.018+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf17690 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8081850 tx=0x7f3ce8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8034ce0214fd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:51.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3cefe00700 1 -- 172.21.15.81:0/940921288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8058180 con 0xbf39da0 2024-09-13T18:53:51.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3cefe00700 1 -- 172.21.15.81:0/940921288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce805c740 con 0xbf39da0 2024-09-13T18:53:51.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3cefe00700 1 -- 172.21.15.81:0/940921288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce80526f0 con 0xbf39da0 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 -- 172.21.15.81:0/940921288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 msgr2=0xbf17690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf17690 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8081850 tx=0x7f3ce8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 -- 172.21.15.81:0/940921288 shutdown_connections 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf3a6c0 0xbf17bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbf17690 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/940921288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf18d00 0xbeefb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 -- 172.21.15.81:0/940921288 >> 172.21.15.81:0/940921288 conn(0xbc824d0 msgr2=0xbef3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:51.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 -- 172.21.15.81:0/940921288 shutdown_connections 2024-09-13T18:53:51.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 -- 172.21.15.81:0/940921288 wait complete. 2024-09-13T18:53:51.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 -- start start 2024-09-13T18:53:51.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.022+0000 7f3d08fa3740 1 Processor -- start 2024-09-13T18:53:51.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbfa3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbfa3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbfa4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf619d0 con 0xbf39da0 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf4a420 con 0xbf18d00 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbeef8d0 con 0xbf3a6c0 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 10 client.0 _ll_register_callbacks cb 0xbeb1710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbfa3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbfa3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48586/0 (socket says 172.21.15.81:48586) 2024-09-13T18:53:51.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 -- 172.21.15.81:0/3056626078 learned_addr learned my addr 172.21.15.81:0/3056626078 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cff400700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbfa4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbfa3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 -- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 msgr2=0xbfa4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbfa4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 -- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 msgr2=0xbfa3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbfa3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 -- 172.21.15.81:0/3056626078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0014a340 con 0xbf39da0 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cff400700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbfa4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cf7e00700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbfa3b30 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8081820 tx=0x7f3ce8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf2734585143daf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3ce3e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3056626078 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8071070 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3056626078 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ce8069040 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cf0007440 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3056626078 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce80818d0 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 10 client.8331 fetch_fsmap learned FSMap version 91 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0xbdfb720 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3056626078 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0007440 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3056626078 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 91) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f3ce80545b0 con 0xbf39da0 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 10 client.8331 fetch_fsmap finished waiting for FSMap version 91 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 10 client.8331 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 20 client.8331 populate_metadata read hostname 'smithi081' 2024-09-13T18:53:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf3cab0 0xbf3ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 4 client.8331 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:53:51.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "status"}) v1 -- 0xbcfe1e0 con 0xbf3cab0 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.026+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf3cab0 0xbf3ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cfea00700 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf3cab0 0xbf3ce90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86fdac5a54883606 server_cookie=9b83ca6364abd653 in_seq=0 out_seq=0 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3ce3e00700 10 client.8331 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3ce3e00700 1 -- 172.21.15.81:0/3056626078 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0xbcfe1e0 con 0xbf3cab0 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3ce3e00700 10 client.8331 handle_command_reply: tid=0 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 client.8331 shutdown 2024-09-13T18:53:51.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 msgr2=0xbfa3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbfa3b30 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8081820 tx=0x7f3ce8000ed0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 shutdown_connections 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0xbf3cab0 0xbf3ce90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbf3a6c0 0xbfa4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xbf39da0 0xbfa3b30 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 --2- 172.21.15.81:0/3056626078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbf18d00 0xbfa3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3ce3e00700 0 client.8331 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 >> 172.21.15.81:0/3056626078 conn(0xbc824d0 msgr2=0xbf14040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 shutdown_connections 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 1 -- 172.21.15.81:0/3056626078 wait complete. 2024-09-13T18:53:51.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3d08fa3740 20 client.8331 trim_cache size 0 max 16384 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8076, 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 17.625875268000001, 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 91, 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 93, 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 93, 2024-09-13T18:53:51.042 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 22.834537114 2024-09-13T18:53:51.043 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:53:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3cdc066760 msgr2=0x7f3cdc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3cdc066760 0x7f3cdc068c20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3cf0004000 tx=0x7f3cf0009040 comp rx=0 tx=0).stop 2024-09-13T18:53:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 msgr2=0x7f3d0014b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 0x7f3d0014b400 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c410 tx=0x7f3ce800c720 comp rx=0 tx=0).stop 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 shutdown_connections 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3cdc066760 0x7f3cdc068c20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d0015d170 0x7f3d0014e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d0015cd90 0x7f3d0014b400 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 --2- 172.21.15.81:0/4177473646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d0006cba0 0x7f3d0014ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 >> 172.21.15.81:0/4177473646 conn(0x7f3d000d2c10 msgr2=0x7f3d000cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 shutdown_connections 2024-09-13T18:53:51.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.030+0000 7f3cffe00700 1 -- 172.21.15.81:0/4177473646 wait complete. 2024-09-13T18:53:51.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:53:51.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.246+0000 7ff40f400700 1 Processor -- start 2024-09-13T18:53:51.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.246+0000 7ff40f400700 1 -- start start 2024-09-13T18:53:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff408161060 0x7ff40806b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b3180 con 0x7ff408165650 2024-09-13T18:53:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080b29e0 con 0x7ff408161060 2024-09-13T18:53:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408070d10 con 0x7ff4080667a0 2024-09-13T18:53:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff408161060 0x7ff40806b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff407e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff408165650 0x7ff408066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52448/0 (socket says 172.21.15.81:52448) 2024-09-13T18:53:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff407e00700 1 -- 172.21.15.81:0/238559705 learned_addr learned my addr 172.21.15.81:0/238559705 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:53:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40d400700 1 --2- 172.21.15.81:0/238559705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40ca00700 1 -- 172.21.15.81:0/238559705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 msgr2=0x7ff408071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:53:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40ca00700 1 --2- 172.21.15.81:0/238559705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40ca00700 1 -- 172.21.15.81:0/238559705 >> v1:172.21.15.81:6789/0 conn(0x7ff408165650 legacy=0x7ff408066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40ca00700 1 -- 172.21.15.81:0/238559705 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b2bc0 con 0x7ff408161060 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40ca00700 1 --2- 172.21.15.81:0/238559705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff40806b890 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009850 tx=0x7ff3fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594fdb88ae6df2d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff407400700 1 -- 172.21.15.81:0/238559705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011830 con 0x7ff408161060 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff407400700 1 -- 172.21.15.81:0/238559705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc011990 con 0x7ff408161060 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff407400700 1 -- 172.21.15.81:0/238559705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc011d20 con 0x7ff408161060 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- 172.21.15.81:0/238559705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 msgr2=0x7ff40806b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 --2- 172.21.15.81:0/238559705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff40806b890 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009850 tx=0x7ff3fc009b60 comp rx=0 tx=0).stop 2024-09-13T18:53:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- 172.21.15.81:0/238559705 shutdown_connections 2024-09-13T18:53:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 --2- 172.21.15.81:0/238559705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 --2- 172.21.15.81:0/238559705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff40806b890 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- 172.21.15.81:0/238559705 >> 172.21.15.81:0/238559705 conn(0x7ff4080b1e00 msgr2=0x7ff4080cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- 172.21.15.81:0/238559705 shutdown_connections 2024-09-13T18:53:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.250+0000 7ff40f400700 1 -- 172.21.15.81:0/238559705 wait complete. 2024-09-13T18:53:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 Processor -- start 2024-09-13T18:53:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 -- start start 2024-09-13T18:53:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff4081fad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff408165650 0x7ff408151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408158460 con 0x7ff408161060 2024-09-13T18:53:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408157cf0 con 0x7ff408165650 2024-09-13T18:53:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.254+0000 7ff40f400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408157fd0 con 0x7ff4080667a0 2024-09-13T18:53:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff4081fad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff4081fad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48608/0 (socket says 172.21.15.81:48608) 2024-09-13T18:53:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 -- 172.21.15.81:0/2107219341 learned_addr learned my addr 172.21.15.81:0/2107219341 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:53:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff40ca00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff40d400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff408165650 0x7ff408151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 -- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 msgr2=0x7ff408153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 -- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff408165650 msgr2=0x7ff408151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff408165650 0x7ff408151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 -- 172.21.15.81:0/2107219341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094b0 con 0x7ff408161060 2024-09-13T18:53:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff40d400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff408165650 0x7ff408151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:53:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff407e00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff4081fad60 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4001eb0 tx=0x7ff3f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4005d90 con 0x7ff408161060 2024-09-13T18:53:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f40070d0 con 0x7ff408161060 2024-09-13T18:53:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff408158700 con 0x7ff408161060 2024-09-13T18:53:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4007440 con 0x7ff408161060 2024-09-13T18:53:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40814cc70 con 0x7ff408161060 2024-09-13T18:53:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.258+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408067730 con 0x7ff408161060 2024-09-13T18:53:51.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.262+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3f40075a0 con 0x7ff408161060 2024-09-13T18:53:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.262+0000 7ff404c00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3e8066730 0x7ff3e8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:53:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.262+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff3f4083710 con 0x7ff408161060 2024-09-13T18:53:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.262+0000 7ff40ca00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3e8066730 0x7ff3e8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:53:51.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.262+0000 7ff40ca00700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3e8066730 0x7ff3e8068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000c00 tx=0x7ff3fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:53:51.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.270+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3f4050950 con 0x7ff408161060 2024-09-13T18:53:51.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.494+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff408161ad0 con 0x7ff408161060 2024-09-13T18:53:51.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.494+0000 7ff404c00700 1 -- 172.21.15.81:0/2107219341 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4767 (secure 0 0 0) 0x7ff3f4053f70 con 0x7ff408161060 2024-09-13T18:53:51.505 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:53:51.505 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":91,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:53:49.504696+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":7,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:53:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3e8066730 msgr2=0x7ff3e8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3e8066730 0x7ff3e8068bf0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000c00 tx=0x7ff3fc008030 comp rx=0 tx=0).stop 2024-09-13T18:53:51.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 msgr2=0x7ff4081fad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff4081fad60 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4001eb0 tx=0x7ff3f400c860 comp rx=0 tx=0).stop 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 shutdown_connections 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff3e8066730 0x7ff3e8068bf0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff408165650 0x7ff408151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff408161060 0x7ff4081fad60 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 --2- 172.21.15.81:0/2107219341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4080667a0 0x7ff408153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 >> 172.21.15.81:0/2107219341 conn(0x7ff4080b1e00 msgr2=0x7ff408066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 shutdown_connections 2024-09-13T18:53:51.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:53:51.498+0000 7ff40f400700 1 -- 172.21.15.81:0/2107219341 wait complete. 2024-09-13T18:53:51.512 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 91 2024-09-13T18:53:51.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:51.533 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:53:51.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:51.566 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:53:51.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:51.640 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-13T18:53:51.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:51.702 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-13T18:53:51.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:53:51.767 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-13T18:53:51.834 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:52.061 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:53:52.062 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:52.062 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:53.917 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:53:53.906+0000 7fe88d800700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:53:54.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:54.243 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:53:54.244 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:54.244 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:56.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:56.435 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:53:56.436 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:56.436 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:58.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:53:58.626 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-13T18:53:58.627 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:53:58.627 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:53:58.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:53:58.805 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:53:58.806 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:53:58.806 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:54:00.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:54:00.985 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:54:00.986 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:54:00.986 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:54:02.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:54:03.169 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:54:03.170 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:54:03.170 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:54:05.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:54:05.359 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:54:05.360 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:54:05.360 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:54:05.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:54:05.552 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:54:05.553 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:54:05.553 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:54:05.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-13T18:54:05.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 Processor -- start 2024-09-13T18:54:05.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 -- start start 2024-09-13T18:54:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f324006c960 0x7f3240161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324006cd40 0x7f32400b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f32400b1980 0x7f3240162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3240162340 con 0x7f324006c960 2024-09-13T18:54:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32400b2280 con 0x7f32400b1980 2024-09-13T18:54:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32400b2560 con 0x7f324006cd40 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f324006c960 0x7f3240161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.726+0000 7f323de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f324006c960 0x7f3240161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58246/0 (socket says 172.21.15.81:58246) 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 -- 172.21.15.81:0/4260364581 learned_addr learned my addr 172.21.15.81:0/4260364581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f3237e00700 1 --2- 172.21.15.81:0/4260364581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324006cd40 0x7f32400b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323e800700 1 --2- 172.21.15.81:0/4260364581 >> v2:172.21.15.178:3300/0 conn(0x7f32400b1980 0x7f3240162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 -- 172.21.15.81:0/4260364581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324006cd40 msgr2=0x7f32400b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 --2- 172.21.15.81:0/4260364581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324006cd40 0x7f32400b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 -- 172.21.15.81:0/4260364581 >> v2:172.21.15.178:3300/0 conn(0x7f32400b1980 msgr2=0x7f3240162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 --2- 172.21.15.81:0/4260364581 >> v2:172.21.15.178:3300/0 conn(0x7f32400b1980 0x7f3240162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 -- 172.21.15.81:0/4260364581 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400b2840 con 0x7f324006c960 2024-09-13T18:54:05.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323de00700 1 --2- 172.21.15.81:0/4260364581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240161e00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f32400b3db0 tx=0x7f3230009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc2d0fe1745c4eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323d400700 1 -- 172.21.15.81:0/4260364581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000b8a0 con 0x7f324006c960 2024-09-13T18:54:05.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323d400700 1 -- 172.21.15.81:0/4260364581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323000ba00 con 0x7f324006c960 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323d400700 1 -- 172.21.15.81:0/4260364581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323000bd90 con 0x7f324006c960 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 -- 172.21.15.81:0/4260364581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 msgr2=0x7f3240161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 --2- 172.21.15.81:0/4260364581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240161e00 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f32400b3db0 tx=0x7f3230009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 -- 172.21.15.81:0/4260364581 shutdown_connections 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 --2- 172.21.15.81:0/4260364581 >> v2:172.21.15.178:3300/0 conn(0x7f32400b1980 0x7f3240162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 --2- 172.21.15.81:0/4260364581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f324006cd40 0x7f32400b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 --2- 172.21.15.81:0/4260364581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240161e00 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 -- 172.21.15.81:0/4260364581 >> 172.21.15.81:0/4260364581 conn(0x7f324006a390 msgr2=0x7f324006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 -- 172.21.15.81:0/4260364581 shutdown_connections 2024-09-13T18:54:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.730+0000 7f323f200700 1 -- 172.21.15.81:0/4260364581 wait complete. 2024-09-13T18:54:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.734+0000 7f323f200700 1 Processor -- start 2024-09-13T18:54:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.734+0000 7f323f200700 1 -- start start 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f324006cd40 0x7f3240150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32400b1980 0x7f324015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3240152350 con 0x7f324006c960 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3240160d90 con 0x7f324006cd40 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3240151740 con 0x7f32400b1980 2024-09-13T18:54:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240160850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58254/0 (socket says 172.21.15.81:58254) 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 -- 172.21.15.81:0/1204164748 learned_addr learned my addr 172.21.15.81:0/1204164748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323e800700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32400b1980 0x7f324015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f3237e00700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f324006cd40 0x7f3240150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 -- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32400b1980 msgr2=0x7f324015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32400b1980 0x7f324015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 -- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f324006cd40 msgr2=0x7f3240150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f324006cd40 0x7f3240150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 -- 172.21.15.81:0/1204164748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009570 con 0x7f324006c960 2024-09-13T18:54:05.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f3237e00700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f324006cd40 0x7f3240150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323e800700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32400b1980 0x7f324015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323de00700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240160850 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f3230000c00 tx=0x7f3230004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f3236000700 1 -- 172.21.15.81:0/1204164748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300038c0 con 0x7f324006c960 2024-09-13T18:54:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f3236000700 1 -- 172.21.15.81:0/1204164748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230003a20 con 0x7f324006c960 2024-09-13T18:54:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3240151a20 con 0x7f324006c960 2024-09-13T18:54:05.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f3236000700 1 -- 172.21.15.81:0/1204164748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230003db0 con 0x7f324006c960 2024-09-13T18:54:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.738+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3240151fe0 con 0x7f324006c960 2024-09-13T18:54:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.742+0000 7f3236000700 1 -- 172.21.15.81:0/1204164748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3230011420 con 0x7f324006c960 2024-09-13T18:54:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.742+0000 7f3247f91740 1 Processor -- start 2024-09-13T18:54:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.742+0000 7f3247f91740 1 -- start start 2024-09-13T18:54:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3236000700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f321c066730 0x7f321c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x13114810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1315e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x130a5010 con 0x13113310 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x13032f40 con 0x1315dd90 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x13085e30 con 0x1315e170 2024-09-13T18:54:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3236000700 1 -- 172.21.15.81:0/1204164748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f3230020030 con 0x7f324006c960 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f323e800700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f321c066730 0x7f321c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58268/0 (socket says 172.21.15.81:58268) 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 -- 172.21.15.81:0/3639237263 learned_addr learned my addr 172.21.15.81:0/3639237263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f323de00700 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x13114810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 -- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 msgr2=0x1315e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1315e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 -- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 msgr2=0x13114810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x13114810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 -- 172.21.15.81:0/3639237263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12ef1a40 con 0x13113310 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3237e00700 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313c520 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f32400cafd0 tx=0x7f3228009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc1679b27ed9922 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f323e800700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f321c066730 0x7f321c068bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32380073f0 tx=0x7f32380099a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f322e600700 1 -- 172.21.15.81:0/3639237263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228004230 con 0x13113310 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f322e600700 1 -- 172.21.15.81:0/3639237263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228004390 con 0x13113310 2024-09-13T18:54:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f322e600700 1 -- 172.21.15.81:0/3639237263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32280036c0 con 0x13113310 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- 172.21.15.81:0/3639237263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 msgr2=0x1313c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313c520 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f32400cafd0 tx=0x7f3228009be0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- 172.21.15.81:0/3639237263 shutdown_connections 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1315e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313c520 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 --2- 172.21.15.81:0/3639237263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x13114810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- 172.21.15.81:0/3639237263 >> 172.21.15.81:0/3639237263 conn(0x12ea65b0 msgr2=0x13117b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- 172.21.15.81:0/3639237263 shutdown_connections 2024-09-13T18:54:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.746+0000 7f3247f91740 1 -- 172.21.15.81:0/3639237263 wait complete. 2024-09-13T18:54:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 -- start start 2024-09-13T18:54:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 Processor -- start 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13113310 0x131377e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 0x1315c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1313a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x13081150 con 0x1315dd90 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1307eeb0 con 0x13113310 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1303c8e0 con 0x1315e170 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 10 client.0 _ll_register_callbacks cb 0x1301b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 0x1315c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 0x1315c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58272/0 (socket says 172.21.15.81:58272) 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 -- 172.21.15.81:0/1258472681 learned_addr learned my addr 172.21.15.81:0/1258472681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f323de00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13113310 0x131377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f323e800700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1313a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 -- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 msgr2=0x1313a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1313a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 -- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13113310 msgr2=0x131377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13113310 0x131377e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 -- 172.21.15.81:0/1258472681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3228009560 con 0x1315dd90 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f323de00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13113310 0x131377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f323e800700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1313a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3237e00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 0x1315c370 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3228015040 tx=0x7f32280047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d10f8db56792cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3222a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3222a00700 1 -- 172.21.15.81:0/1258472681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228009040 con 0x1315dd90 2024-09-13T18:54:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3222a00700 1 -- 172.21.15.81:0/1258472681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f32280273f0 con 0x1315dd90 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12eb32c0 con 0x1315dd90 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3222a00700 1 -- 172.21.15.81:0/1258472681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32280275b0 con 0x1315dd90 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 10 client.8352 fetch_fsmap learned FSMap version 93 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x13045290 con 0x1315dd90 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.750+0000 7f3222a00700 1 -- 172.21.15.81:0/1258472681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12eb32c0 con 0x1315dd90 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3222a00700 1 -- 172.21.15.81:0/1258472681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 93) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f3228027710 con 0x1315dd90 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 10 client.8352 fetch_fsmap finished waiting for FSMap version 93 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 10 client.8352 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 20 client.8352 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1313af20 0x1315e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 4 client.8352 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x12efd540 con 0x1313af20 2024-09-13T18:54:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f323de00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1313af20 0x1315e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f323de00700 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1313af20 0x1315e550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf2c6e2b7f3aec5c server_cookie=db2dd4364edaac91 in_seq=0 out_seq=0 2024-09-13T18:54:05.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3222a00700 10 client.8352 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3222a00700 1 -- 172.21.15.81:0/1258472681 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x12efd540 con 0x1313af20 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3222a00700 10 client.8352 handle_command_reply: tid=0 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 client.8352 shutdown 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 msgr2=0x1315c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 0x1315c370 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3228015040 tx=0x7f32280047e0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 shutdown_connections 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1313af20 0x1315e550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x1313a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1315dd90 0x1315c370 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 --2- 172.21.15.81:0/1258472681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13113310 0x131377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3222a00700 0 client.8352 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 >> 172.21.15.81:0/1258472681 conn(0x12ea65b0 msgr2=0x1313c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 shutdown_connections 2024-09-13T18:54:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 1 -- 172.21.15.81:0/1258472681 wait complete. 2024-09-13T18:54:05.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.754+0000 7f3247f91740 20 client.8352 trim_cache size 0 max 16384 2024-09-13T18:54:05.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.770+0000 7f3247f91740 1 Processor -- start 2024-09-13T18:54:05.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.770+0000 7f3247f91740 1 -- start start 2024-09-13T18:54:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315dd90 0x13170a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315e170 0x13170f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x12f2ab80 con 0x13113310 2024-09-13T18:54:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1307db60 con 0x1315e170 2024-09-13T18:54:05.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1303f260 con 0x1315dd90 2024-09-13T18:54:05.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58284/0 (socket says 172.21.15.81:58284) 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 -- 172.21.15.81:0/35979789 learned_addr learned my addr 172.21.15.81:0/35979789 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323e800700 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315e170 0x13170f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3237e00700 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315dd90 0x13170a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 -- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315dd90 msgr2=0x13170a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315dd90 0x13170a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 -- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315e170 msgr2=0x13170f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315e170 0x13170f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 -- 172.21.15.81:0/35979789 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1302b4c0 con 0x13113310 2024-09-13T18:54:05.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323e800700 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315e170 0x13170f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f323de00700 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313a510 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f3230052cb0 tx=0x7f32300092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cc050ae1918d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f322f000700 1 -- 172.21.15.81:0/35979789 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230056800 con 0x13113310 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f322f000700 1 -- 172.21.15.81:0/35979789 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323005a630 con 0x13113310 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f322f000700 1 -- 172.21.15.81:0/35979789 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323005ebf0 con 0x13113310 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 -- 172.21.15.81:0/35979789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 msgr2=0x1313a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.774+0000 7f3247f91740 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313a510 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f3230052cb0 tx=0x7f32300092e0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 -- 172.21.15.81:0/35979789 shutdown_connections 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315e170 0x13170f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315dd90 0x13170a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 --2- 172.21.15.81:0/35979789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x1313a510 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 -- 172.21.15.81:0/35979789 >> 172.21.15.81:0/35979789 conn(0x12ea65b0 msgr2=0x13139c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:05.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 -- 172.21.15.81:0/35979789 shutdown_connections 2024-09-13T18:54:05.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 -- 172.21.15.81:0/35979789 wait complete. 2024-09-13T18:54:05.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 -- start start 2024-09-13T18:54:05.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.778+0000 7f3247f91740 1 Processor -- start 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x131be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x131bee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x131bf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1317ca50 con 0x13113310 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x13137410 con 0x1315dd90 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x13176620 con 0x1315e170 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 10 client.0 _ll_register_callbacks cb 0x1307d610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:05.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x131be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x131be280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58300/0 (socket says 172.21.15.81:58300) 2024-09-13T18:54:05.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 -- 172.21.15.81:0/2656405340 learned_addr learned my addr 172.21.15.81:0/2656405340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3237e00700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x131bee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323e800700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x131bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 -- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 msgr2=0x131bf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x131bf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 -- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 msgr2=0x131bee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x131bee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 -- 172.21.15.81:0/2656405340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3240151fe0 con 0x13113310 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f323de00700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x131be280 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3230009150 tx=0x7f3230006b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4c3f5f887bf399 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3222a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3222a00700 1 -- 172.21.15.81:0/2656405340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323006e1d0 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3222a00700 1 -- 172.21.15.81:0/2656405340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f3230055cf0 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13114b90 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3222a00700 1 -- 172.21.15.81:0/2656405340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3230055eb0 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 10 client.8358 fetch_fsmap learned FSMap version 93 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x1301f790 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3222a00700 1 -- 172.21.15.81:0/2656405340 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x13114b90 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3222a00700 1 -- 172.21.15.81:0/2656405340 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 93) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f323005e760 con 0x13113310 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 10 client.8358 fetch_fsmap finished waiting for FSMap version 93 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 10 client.8358 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 20 client.8358 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x131bf890 0x131bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 4 client.8358 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:54:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f3228004390 con 0x131bf890 2024-09-13T18:54:05.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.782+0000 7f3237e00700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x131bf890 0x131bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:05.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.786+0000 7f3222a00700 10 client.8358 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:05.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.786+0000 7f3237e00700 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x131bf890 0x131bfca0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ceb633eafeb508 server_cookie=3225493b9341546f in_seq=0 out_seq=0 2024-09-13T18:54:05.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3222a00700 1 -- 172.21.15.81:0/2656405340 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f3228004390 con 0x131bf890 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3222a00700 10 client.8358 handle_command_reply: tid=0 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 client.8358 shutdown 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 msgr2=0x131be280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x131be280 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3230009150 tx=0x7f3230006b80 comp rx=0 tx=0).stop 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 shutdown_connections 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x131bf890 0x131bfca0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1315e170 0x131bf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1315dd90 0x131bee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 --2- 172.21.15.81:0/2656405340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x13113310 0x131be280 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3222a00700 0 client.8358 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:05.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 >> 172.21.15.81:0/2656405340 conn(0x12ea65b0 msgr2=0x13137b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 shutdown_connections 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 1 -- 172.21.15.81:0/2656405340 wait complete. 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.802+0000 7f3247f91740 20 client.8358 trim_cache size 0 max 16384 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:54:05.815 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f321c066730 msgr2=0x7f321c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f321c066730 0x7f321c068bf0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32380073f0 tx=0x7f32380099a0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 msgr2=0x7f3240160850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240160850 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f3230000c00 tx=0x7f3230004770 comp rx=0 tx=0).stop 2024-09-13T18:54:05.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 shutdown_connections 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f321c066730 0x7f321c068bf0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32400b1980 0x7f324015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f324006cd40 0x7f3240150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 --2- 172.21.15.81:0/1204164748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324006c960 0x7f3240160850 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 >> 172.21.15.81:0/1204164748 conn(0x7f324006a390 msgr2=0x7f324006fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 shutdown_connections 2024-09-13T18:54:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.806+0000 7f323f200700 1 -- 172.21.15.81:0/1204164748 wait complete. 2024-09-13T18:54:05.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 flush journal 2024-09-13T18:54:06.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.998+0000 7f7df9600700 1 Processor -- start 2024-09-13T18:54:06.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:05.998+0000 7f7df9600700 1 -- start start 2024-09-13T18:54:06.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df9600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7df4146720 0x7f7df415e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df9600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df406c4c0 0x7f7df40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df9600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df4070670 con 0x7f7df406c8c0 2024-09-13T18:54:06.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df9600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df4070950 con 0x7f7df4146720 2024-09-13T18:54:06.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df9600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4070c30 con 0x7f7df406c4c0 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7df4146720 0x7f7df415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7df4146720 0x7f7df415e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58306/0 (socket says 172.21.15.81:58306) 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 -- 172.21.15.81:0/3335703434 learned_addr learned my addr 172.21.15.81:0/3335703434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7dea000700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df406c4c0 0x7f7df40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 -- 172.21.15.81:0/3335703434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df406c4c0 msgr2=0x7f7df40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df406c4c0 0x7f7df40ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 -- 172.21.15.81:0/3335703434 >> v1:172.21.15.178:6789/0 conn(0x7f7df406c8c0 legacy=0x7f7df4071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 -- 172.21.15.81:0/3335703434 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df4070f10 con 0x7f7df4146720 2024-09-13T18:54:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7dea000700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df406c4c0 0x7f7df40ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4146720 0x7f7df415e320 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009e50 tx=0x7f7de400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc8d0ee9ef981f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2000700 1 -- 172.21.15.81:0/3335703434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de400e070 con 0x7f7df4146720 2024-09-13T18:54:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2000700 1 -- 172.21.15.81:0/3335703434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de400b910 con 0x7f7df4146720 2024-09-13T18:54:06.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.002+0000 7f7df2000700 1 -- 172.21.15.81:0/3335703434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de400bcc0 con 0x7f7df4146720 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 -- 172.21.15.81:0/3335703434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4146720 msgr2=0x7f7df415e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4146720 0x7f7df415e320 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f7de4009e50 tx=0x7f7de400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 -- 172.21.15.81:0/3335703434 shutdown_connections 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df406c4c0 0x7f7df40ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 --2- 172.21.15.81:0/3335703434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df4146720 0x7f7df415e320 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 -- 172.21.15.81:0/3335703434 >> 172.21.15.81:0/3335703434 conn(0x7f7df406a570 msgr2=0x7f7df406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 -- 172.21.15.81:0/3335703434 shutdown_connections 2024-09-13T18:54:06.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 -- 172.21.15.81:0/3335703434 wait complete. 2024-09-13T18:54:06.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.006+0000 7f7df9600700 1 Processor -- start 2024-09-13T18:54:06.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 -- start start 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 0x7f7df4159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7df406c8c0 0x7f7df41f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df4146720 0x7f7df41f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df415a620 con 0x7f7df406c4c0 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b0a20 con 0x7f7df406c8c0 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b0d00 con 0x7f7df4146720 2024-09-13T18:54:06.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 0x7f7df4159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 0x7f7df4159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58308/0 (socket says 172.21.15.81:58308) 2024-09-13T18:54:06.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 -- 172.21.15.81:0/3662343316 learned_addr learned my addr 172.21.15.81:0/3662343316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7dea000700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7df406c8c0 0x7f7df41f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df3400700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df4146720 0x7f7df41f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 -- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df4146720 msgr2=0x7f7df41f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df4146720 0x7f7df41f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 -- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7df406c8c0 msgr2=0x7f7df41f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7df406c8c0 0x7f7df41f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 -- 172.21.15.81:0/3662343316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0094b0 con 0x7f7df406c4c0 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7dea000700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7df406c8c0 0x7f7df41f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:06.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df3400700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df4146720 0x7f7df41f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 0x7f7df4159d50 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f7de400b370 tx=0x7f7de4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7deb400700 1 -- 172.21.15.81:0/3662343316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40099b0 con 0x7f7df406c4c0 2024-09-13T18:54:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7deb400700 1 -- 172.21.15.81:0/3662343316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de40092e0 con 0x7f7df406c4c0 2024-09-13T18:54:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de4009b30 con 0x7f7df406c4c0 2024-09-13T18:54:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7deb400700 1 -- 172.21.15.81:0/3662343316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de401c640 con 0x7f7df406c4c0 2024-09-13T18:54:06.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.010+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df4134810 con 0x7f7df406c4c0 2024-09-13T18:54:06.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.014+0000 7f7deb400700 1 -- 172.21.15.81:0/3662343316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7de401c7a0 con 0x7f7df406c4c0 2024-09-13T18:54:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.014+0000 7f7deb400700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7dd0066760 0x7f7dd0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7deb400700 1 -- 172.21.15.81:0/3662343316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f7de4085ce0 con 0x7f7df406c4c0 2024-09-13T18:54:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dea000700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7dd0066760 0x7f7dd0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dea000700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7dd0066760 0x7f7dd0068c20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7df415c310 tx=0x7f7ddc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 Processor -- start 2024-09-13T18:54:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 -- start start 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a58d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a5aed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a4f6010 con 0x3a5ae950 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a483f40 con 0x3a58cd00 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.018+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3a4d6e30 con 0x3a5af270 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a58d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a58d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58314/0 (socket says 172.21.15.81:58314) 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 -- 172.21.15.81:0/1422330638 learned_addr learned my addr 172.21.15.81:0/1422330638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dea000700 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a5aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 -- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 msgr2=0x3a5625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df3400700 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 -- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 msgr2=0x3a5aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a5aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 -- 172.21.15.81:0/1422330638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3a342a40 con 0x3a5ae950 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df3400700 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:06.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a58d240 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7de405ea00 tx=0x7f7de4056750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c37fca46e775e4e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7de3000700 1 -- 172.21.15.81:0/1422330638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de405a970 con 0x3a5ae950 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7de3000700 1 -- 172.21.15.81:0/1422330638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de405ef30 con 0x3a5ae950 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7de3000700 1 -- 172.21.15.81:0/1422330638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4053250 con 0x3a5ae950 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 -- 172.21.15.81:0/1422330638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 msgr2=0x3a58d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a58d240 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f7de405ea00 tx=0x7f7de4056750 comp rx=0 tx=0).stop 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 -- 172.21.15.81:0/1422330638 shutdown_connections 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a5aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1422330638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a58d240 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 -- 172.21.15.81:0/1422330638 >> 172.21.15.81:0/1422330638 conn(0x3a2f75b0 msgr2=0x3a5689b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 -- 172.21.15.81:0/1422330638 shutdown_connections 2024-09-13T18:54:06.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 -- 172.21.15.81:0/1422330638 wait complete. 2024-09-13T18:54:06.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.022+0000 7f7dfca29740 1 -- start start 2024-09-13T18:54:06.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 Processor -- start 2024-09-13T18:54:06.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a563fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a5906f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a4d2150 con 0x3a5ae950 2024-09-13T18:54:06.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a4cfeb0 con 0x3a58cd00 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3a48d8e0 con 0x3a5af270 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dfca29740 10 client.0 _ll_register_callbacks cb 0x3a46c670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a5906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a5906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58326/0 (socket says 172.21.15.81:58326) 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 -- 172.21.15.81:0/1416861057 learned_addr learned my addr 172.21.15.81:0/1416861057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7df3400700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a563fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 -- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 msgr2=0x3a5ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 -- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 msgr2=0x3a563fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a563fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.026+0000 7f7dea000700 1 -- 172.21.15.81:0/1416861057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df4134810 con 0x3a5ae950 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dea000700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a5906f0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc015a80 tx=0x7f7ddc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b8715d77555965 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 1 -- 172.21.15.81:0/1416861057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc026070 con 0x3a5ae950 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3a3042c0 con 0x3a5ae950 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 1 -- 172.21.15.81:0/1416861057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f7ddc009e10 con 0x3a5ae950 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 1 -- 172.21.15.81:0/1416861057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ddc010e90 con 0x3a5ae950 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 10 client.8370 fetch_fsmap learned FSMap version 93 2024-09-13T18:54:06.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x3a496290 con 0x3a5ae950 2024-09-13T18:54:06.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 1 -- 172.21.15.81:0/1416861057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3a3042c0 con 0x3a5ae950 2024-09-13T18:54:06.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 1 -- 172.21.15.81:0/1416861057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 93) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f7ddc029020 con 0x3a5ae950 2024-09-13T18:54:06.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 10 client.8370 fetch_fsmap finished waiting for FSMap version 93 2024-09-13T18:54:06.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 10 client.8370 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-13T18:54:06.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 20 client.8370 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:06.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5926c0 0x3a58dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 4 client.8370 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:06.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3a34e540 con 0x3a5926c0 2024-09-13T18:54:06.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5926c0 0x3a58dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5926c0 0x3a58dca0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2ee1464cd44fd0c server_cookie=c8a863e82bcff760 in_seq=0 out_seq=0 2024-09-13T18:54:06.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 10 client.8370 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:06.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 1 -- 172.21.15.81:0/1416861057 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3a34e540 con 0x3a5926c0 2024-09-13T18:54:06.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dd7400700 10 client.8370 handle_command_reply: tid=0 2024-09-13T18:54:06.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.030+0000 7f7dfca29740 1 client.8370 shutdown 2024-09-13T18:54:06.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 msgr2=0x3a5906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a5906f0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc015a80 tx=0x7f7ddc0047e0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 shutdown_connections 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5926c0 0x3a58dca0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5af270 0x3a5ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a5906f0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dd7400700 0 client.8370 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1416861057 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a58cd00 0x3a563fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 >> 172.21.15.81:0/1416861057 conn(0x3a2f75b0 msgr2=0x3a561db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 shutdown_connections 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 1 -- 172.21.15.81:0/1416861057 wait complete. 2024-09-13T18:54:06.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.034+0000 7f7dfca29740 20 client.8370 trim_cache size 0 max 16384 2024-09-13T18:54:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 Processor -- start 2024-09-13T18:54:06.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 -- start start 2024-09-13T18:54:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a58cd00 0x3a58b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a606d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a607260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a37bb80 con 0x3a5ae950 2024-09-13T18:54:06.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a475230 con 0x3a5af270 2024-09-13T18:54:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3a489c90 con 0x3a58cd00 2024-09-13T18:54:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a606d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dea000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a606d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58328/0 (socket says 172.21.15.81:58328) 2024-09-13T18:54:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.050+0000 7f7dea000700 1 -- 172.21.15.81:0/1451773471 learned_addr learned my addr 172.21.15.81:0/1451773471 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7df3400700 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a607260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7df2a00700 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a58cd00 0x3a58b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dea000700 1 -- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a58cd00 msgr2=0x3a58b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dea000700 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a58cd00 0x3a58b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dea000700 1 -- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 msgr2=0x3a607260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dea000700 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a607260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dea000700 1 -- 172.21.15.81:0/1451773471 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3a47c4c0 con 0x3a5ae950 2024-09-13T18:54:06.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dea000700 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a606d20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc000c00 tx=0x7f7ddc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca627c2de606cf62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7de3a00700 1 -- 172.21.15.81:0/1451773471 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc026040 con 0x3a5ae950 2024-09-13T18:54:06.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7de3a00700 1 -- 172.21.15.81:0/1451773471 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc01d050 con 0x3a5ae950 2024-09-13T18:54:06.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7de3a00700 1 -- 172.21.15.81:0/1451773471 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc005c80 con 0x3a5ae950 2024-09-13T18:54:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 -- 172.21.15.81:0/1451773471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 msgr2=0x3a606d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a606d20 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc000c00 tx=0x7f7ddc017000 comp rx=0 tx=0).stop 2024-09-13T18:54:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 -- 172.21.15.81:0/1451773471 shutdown_connections 2024-09-13T18:54:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a607260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a5ae950 0x3a606d20 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 --2- 172.21.15.81:0/1451773471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a58cd00 0x3a58b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 -- 172.21.15.81:0/1451773471 >> 172.21.15.81:0/1451773471 conn(0x3a2f75b0 msgr2=0x3a5ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 -- 172.21.15.81:0/1451773471 shutdown_connections 2024-09-13T18:54:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 -- 172.21.15.81:0/1451773471 wait complete. 2024-09-13T18:54:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 -- start start 2024-09-13T18:54:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.054+0000 7f7dfca29740 1 Processor -- start 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 0x3a60fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5ae950 0x3a605f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a5c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a5c4d60 con 0x3a58cd00 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3a5c84b0 con 0x3a5af270 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3a5c4f40 con 0x3a5ae950 2024-09-13T18:54:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 10 client.0 _ll_register_callbacks cb 0x3a49f8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:06.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 0x3a60fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 0x3a60fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58342/0 (socket says 172.21.15.81:58342) 2024-09-13T18:54:06.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 -- 172.21.15.81:0/3861059826 learned_addr learned my addr 172.21.15.81:0/3861059826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df3400700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a5c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dea000700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5ae950 0x3a605f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 -- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5ae950 msgr2=0x3a605f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5ae950 0x3a605f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 -- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 msgr2=0x3a5c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a5c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 -- 172.21.15.81:0/3861059826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3a496290 con 0x3a58cd00 2024-09-13T18:54:06.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dea000700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5ae950 0x3a605f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7df2a00700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 0x3a60fd40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7de405ea00 tx=0x7f7de4009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f5814f3a24d0b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dd7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dd7400700 1 -- 172.21.15.81:0/3861059826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4082040 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7de405ef30 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dd7400700 1 -- 172.21.15.81:0/3861059826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f7de4056da0 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dd7400700 1 -- 172.21.15.81:0/3861059826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7de4056f60 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 10 client.8376 fetch_fsmap learned FSMap version 93 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x3a470790 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.058+0000 7f7dd7400700 1 -- 172.21.15.81:0/3861059826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de405ef30 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dd7400700 1 -- 172.21.15.81:0/3861059826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 93) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f7de4056030 con 0x3a58cd00 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dfca29740 10 client.8376 fetch_fsmap finished waiting for FSMap version 93 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dfca29740 10 client.8376 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dfca29740 20 client.8376 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dfca29740 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5c7a30 0x3a5c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dfca29740 4 client.8376 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:54:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x3a3732c0 con 0x3a5c7a30 2024-09-13T18:54:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dea000700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5c7a30 0x3a5c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dea000700 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5c7a30 0x3a5c53a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a6174b89ee7dc32 server_cookie=4358e931f70b576 in_seq=0 out_seq=0 2024-09-13T18:54:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.062+0000 7f7dd7400700 10 client.8376 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:06.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dd7400700 1 -- 172.21.15.81:0/3861059826 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x3a3732c0 con 0x3a5c7a30 2024-09-13T18:54:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dd7400700 10 client.8376 handle_command_reply: tid=0 2024-09-13T18:54:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 client.8376 shutdown 2024-09-13T18:54:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 msgr2=0x3a60fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 0x3a60fd40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7de405ea00 tx=0x7f7de4009810 comp rx=0 tx=0).stop 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 shutdown_connections 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x3a5c7a30 0x3a5c53a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3a5af270 0x3a5c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3a5ae950 0x3a605f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dd7400700 0 client.8376 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 --2- 172.21.15.81:0/3861059826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3a58cd00 0x3a60fd40 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.074+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 >> 172.21.15.81:0/3861059826 conn(0x3a2f75b0 msgr2=0x3a589700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 shutdown_connections 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7dfca29740 1 -- 172.21.15.81:0/3861059826 wait complete. 2024-09-13T18:54:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7dfca29740 20 client.8376 trim_cache size 0 max 16384 2024-09-13T18:54:06.088 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:06.088 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:54:06.088 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:54:06.088 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7dd0066760 msgr2=0x7f7dd0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7dd0066760 0x7f7dd0068c20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7df415c310 tx=0x7f7ddc008040 comp rx=0 tx=0).stop 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 msgr2=0x7f7df4159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 0x7f7df4159d50 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f7de400b370 tx=0x7f7de4004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 shutdown_connections 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7dd0066760 0x7f7dd0068c20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7df4146720 0x7f7df41f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7df406c8c0 0x7f7df41f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 --2- 172.21.15.81:0/3662343316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7df406c4c0 0x7f7df4159d50 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 >> 172.21.15.81:0/3662343316 conn(0x7f7df406a570 msgr2=0x7f7df40cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 shutdown_connections 2024-09-13T18:54:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.078+0000 7f7df9600700 1 -- 172.21.15.81:0/3662343316 wait complete. 2024-09-13T18:54:06.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 flush journal 2024-09-13T18:54:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 Processor -- start 2024-09-13T18:54:06.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 -- start start 2024-09-13T18:54:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fae3006cd80 0x7fae300b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae3006ada0 0x7fae3006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3006b710 con 0x7fae3015ca20 2024-09-13T18:54:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae30160680 con 0x7fae3006cd80 2024-09-13T18:54:06.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3015d670 con 0x7fae3006ada0 2024-09-13T18:54:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae26000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fae3006cd80 0x7fae300b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.286+0000 7fae2f400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae3006ada0 0x7fae3006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae3006ada0 0x7fae3006b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:41186/0 (socket says 172.21.15.81:41186) 2024-09-13T18:54:06.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 -- 172.21.15.81:0/1905092687 learned_addr learned my addr 172.21.15.81:0/1905092687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 -- 172.21.15.81:0/1905092687 >> v2:172.21.15.81:3300/0 conn(0x7fae3006cd80 msgr2=0x7fae300b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 --2- 172.21.15.81:0/1905092687 >> v2:172.21.15.81:3300/0 conn(0x7fae3006cd80 0x7fae300b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 -- 172.21.15.81:0/1905092687 >> v1:172.21.15.178:6789/0 conn(0x7fae3015ca20 legacy=0x7fae3015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 -- 172.21.15.81:0/1905092687 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3015d950 con 0x7fae3006ada0 2024-09-13T18:54:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae26000700 1 --2- 172.21.15.81:0/1905092687 >> v2:172.21.15.81:3300/0 conn(0x7fae3006cd80 0x7fae300b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:06.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2f400700 1 --2- 172.21.15.81:0/1905092687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3006ada0 0x7fae3006b1d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fae300b3290 tx=0x7fae2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5402fa2bcee2317e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2e000700 1 -- 172.21.15.81:0/1905092687 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800e070 con 0x7fae3006ada0 2024-09-13T18:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2e000700 1 -- 172.21.15.81:0/1905092687 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2800b910 con 0x7fae3006ada0 2024-09-13T18:54:06.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2e000700 1 -- 172.21.15.81:0/1905092687 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2800bcc0 con 0x7fae3006ada0 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 -- 172.21.15.81:0/1905092687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3006ada0 msgr2=0x7fae3006b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 --2- 172.21.15.81:0/1905092687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3006ada0 0x7fae3006b1d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fae300b3290 tx=0x7fae2800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 -- 172.21.15.81:0/1905092687 shutdown_connections 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 --2- 172.21.15.81:0/1905092687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3006ada0 0x7fae3006b1d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 --2- 172.21.15.81:0/1905092687 >> v2:172.21.15.81:3300/0 conn(0x7fae3006cd80 0x7fae300b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 -- 172.21.15.81:0/1905092687 >> 172.21.15.81:0/1905092687 conn(0x7fae30071d20 msgr2=0x7fae30072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 -- 172.21.15.81:0/1905092687 shutdown_connections 2024-09-13T18:54:06.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.290+0000 7fae2fe00700 1 -- 172.21.15.81:0/1905092687 wait complete. 2024-09-13T18:54:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.294+0000 7fae2fe00700 1 Processor -- start 2024-09-13T18:54:06.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.294+0000 7fae2fe00700 1 -- start start 2024-09-13T18:54:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.294+0000 7fae2fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 0x7fae3015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.294+0000 7fae2fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae3006cd80 0x7fae301f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.294+0000 7fae2fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3015ca20 0x7fae30154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.294+0000 7fae2fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300cffa0 con 0x7fae3006ada0 2024-09-13T18:54:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300cf700 con 0x7fae3015ca20 2024-09-13T18:54:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae300cf9e0 con 0x7fae3006cd80 2024-09-13T18:54:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 0x7fae3015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 0x7fae3015ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58364/0 (socket says 172.21.15.81:58364) 2024-09-13T18:54:06.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 -- 172.21.15.81:0/82473379 learned_addr learned my addr 172.21.15.81:0/82473379 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae26000700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae3006cd80 0x7fae301f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2f400700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3015ca20 0x7fae30154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 -- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae3006cd80 msgr2=0x7fae301f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae3006cd80 0x7fae301f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 -- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3015ca20 msgr2=0x7fae30154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3015ca20 0x7fae30154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 -- 172.21.15.81:0/82473379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180094b0 con 0x7fae3006ada0 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2f400700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3015ca20 0x7fae30154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae26000700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae3006cd80 0x7fae301f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2ea00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 0x7fae3015ac80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fae2000c500 tx=0x7fae2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae27400700 1 -- 172.21.15.81:0/82473379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200052d0 con 0x7fae3006ada0 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae27400700 1 -- 172.21.15.81:0/82473379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20005430 con 0x7fae3006ada0 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae28009b30 con 0x7fae3006ada0 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae27400700 1 -- 172.21.15.81:0/82473379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200055a0 con 0x7fae3006ada0 2024-09-13T18:54:06.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.298+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae300cad20 con 0x7fae3006ada0 2024-09-13T18:54:06.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.302+0000 7fae27400700 1 -- 172.21.15.81:0/82473379 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae200038e0 con 0x7fae3006ada0 2024-09-13T18:54:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.302+0000 7fae27400700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fae0c066730 0x7fae0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.302+0000 7fae27400700 1 -- 172.21.15.81:0/82473379 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fae20083780 con 0x7fae3006ada0 2024-09-13T18:54:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.302+0000 7fae26000700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fae0c066730 0x7fae0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 Processor -- start 2024-09-13T18:54:06.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 -- start start 2024-09-13T18:54:06.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fae0c066730 0x7fae0c068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fae30152cd0 tx=0x7fae18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1bd90 0x16ed2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 0x16efa520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16f1c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16e63010 con 0x16ed1310 2024-09-13T18:54:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16df0f40 con 0x16f1bd90 2024-09-13T18:54:06.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16e43e30 con 0x16f1c170 2024-09-13T18:54:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 0x16efa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 0x16efa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58366/0 (socket says 172.21.15.81:58366) 2024-09-13T18:54:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 -- 172.21.15.81:0/1997490150 learned_addr learned my addr 172.21.15.81:0/1997490150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae2f400700 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16f1c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae2ea00700 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1bd90 0x16ed2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 -- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 msgr2=0x16f1c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16f1c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 -- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1bd90 msgr2=0x16ed2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1bd90 0x16ed2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 -- 172.21.15.81:0/1997490150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16cafa40 con 0x16ed1310 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae2ea00700 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1bd90 0x16ed2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:06.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae26000700 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 0x16efa520 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fae18011df0 tx=0x7fae18014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f39730b2c831cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae1f400700 1 -- 172.21.15.81:0/1997490150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18011e20 con 0x16ed1310 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae1f400700 1 -- 172.21.15.81:0/1997490150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18015bb0 con 0x16ed1310 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.306+0000 7fae1f400700 1 -- 172.21.15.81:0/1997490150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18021440 con 0x16ed1310 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- 172.21.15.81:0/1997490150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 msgr2=0x16efa520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 0x16efa520 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fae18011df0 tx=0x7fae18014000 comp rx=0 tx=0).stop 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- 172.21.15.81:0/1997490150 shutdown_connections 2024-09-13T18:54:06.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16f1c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16ed1310 0x16efa520 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- 172.21.15.81:0/1997490150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1bd90 0x16ed2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- 172.21.15.81:0/1997490150 >> 172.21.15.81:0/1997490150 conn(0x16c645b0 msgr2=0x16ed5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- 172.21.15.81:0/1997490150 shutdown_connections 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- 172.21.15.81:0/1997490150 wait complete. 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- start start 2024-09-13T18:54:06.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 Processor -- start 2024-09-13T18:54:06.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ed1310 0x16f1cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16ef6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16e3f150 con 0x16f1bd90 2024-09-13T18:54:06.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16e3ceb0 con 0x16ed1310 2024-09-13T18:54:06.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16dfa8e0 con 0x16f1c170 2024-09-13T18:54:06.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae38ada740 10 client.0 _ll_register_callbacks cb 0x16dd9670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58372/0 (socket says 172.21.15.81:58372) 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae26000700 1 -- 172.21.15.81:0/1704416411 learned_addr learned my addr 172.21.15.81:0/1704416411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.310+0000 7fae2ea00700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ed1310 0x16f1cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae2f400700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16ef6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae26000700 1 -- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 msgr2=0x16ef6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae26000700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16ef6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae26000700 1 -- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ed1310 msgr2=0x16f1cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae26000700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ed1310 0x16f1cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae26000700 1 -- 172.21.15.81:0/1704416411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae18011ad0 con 0x16f1bd90 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae2f400700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16ef6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:06.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae2ea00700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ed1310 0x16f1cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae26000700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef6410 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fae18015a00 tx=0x7fae18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f6b27058a09221 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae13e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae13e00700 1 -- 172.21.15.81:0/1704416411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae180097a0 con 0x16f1bd90 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae13e00700 1 -- 172.21.15.81:0/1704416411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fae18031070 con 0x16f1bd90 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16c712c0 con 0x16f1bd90 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae13e00700 1 -- 172.21.15.81:0/1704416411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae18015d20 con 0x16f1bd90 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 10 client.8388 fetch_fsmap learned FSMap version 93 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x16e03290 con 0x16f1bd90 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae13e00700 1 -- 172.21.15.81:0/1704416411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16c712c0 con 0x16f1bd90 2024-09-13T18:54:06.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae13e00700 1 -- 172.21.15.81:0/1704416411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 93) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fae18035420 con 0x16f1bd90 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 10 client.8388 fetch_fsmap finished waiting for FSMap version 93 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 10 client.8388 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 20 client.8388 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16ef9330 0x16ef9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 4 client.8388 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x16cbb540 con 0x16ef9330 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.314+0000 7fae2ea00700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16ef9330 0x16ef9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae13e00700 10 client.8388 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:06.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae2ea00700 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16ef9330 0x16ef9740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a95ec6ba753e49 server_cookie=92094db17974ab26 in_seq=0 out_seq=0 2024-09-13T18:54:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae13e00700 1 -- 172.21.15.81:0/1704416411 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x16cbb540 con 0x16ef9330 2024-09-13T18:54:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae13e00700 10 client.8388 handle_command_reply: tid=0 2024-09-13T18:54:06.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 client.8388 shutdown 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 msgr2=0x16ef6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef6410 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fae18015a00 tx=0x7fae18004770 comp rx=0 tx=0).stop 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 shutdown_connections 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16ef9330 0x16ef9740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16f1c170 0x16ef6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef6410 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 --2- 172.21.15.81:0/1704416411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ed1310 0x16f1cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 >> 172.21.15.81:0/1704416411 conn(0x16c645b0 msgr2=0x16efa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae13e00700 0 client.8388 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 shutdown_connections 2024-09-13T18:54:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 1 -- 172.21.15.81:0/1704416411 wait complete. 2024-09-13T18:54:06.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.318+0000 7fae38ada740 20 client.8388 trim_cache size 0 max 16384 2024-09-13T18:54:06.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 Processor -- start 2024-09-13T18:54:06.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- start start 2024-09-13T18:54:06.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f1c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16ef5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16ce8b80 con 0x16f1bd90 2024-09-13T18:54:06.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16e41f30 con 0x16f1c170 2024-09-13T18:54:06.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16e3d760 con 0x16ed1310 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58378/0 (socket says 172.21.15.81:58378) 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 -- 172.21.15.81:0/4030711997 learned_addr learned my addr 172.21.15.81:0/4030711997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 -- 172.21.15.81:0/4030711997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 msgr2=0x16f1c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f1c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 -- 172.21.15.81:0/4030711997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 msgr2=0x16ef5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16ef5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 -- 172.21.15.81:0/4030711997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16de94c0 con 0x16f1bd90 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae26000700 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef4f40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fae180047b0 tx=0x7fae1802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0b2e2ed1e02754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae1fe00700 1 -- 172.21.15.81:0/4030711997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18021a40 con 0x16f1bd90 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae1fe00700 1 -- 172.21.15.81:0/4030711997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1802f070 con 0x16f1bd90 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae1fe00700 1 -- 172.21.15.81:0/4030711997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18021750 con 0x16f1bd90 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- 172.21.15.81:0/4030711997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 msgr2=0x16ef4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef4f40 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fae180047b0 tx=0x7fae1802d070 comp rx=0 tx=0).stop 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- 172.21.15.81:0/4030711997 shutdown_connections 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16ef5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16ef4f40 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 --2- 172.21.15.81:0/4030711997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f1c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- 172.21.15.81:0/4030711997 >> 172.21.15.81:0/4030711997 conn(0x16c645b0 msgr2=0x16ed2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- 172.21.15.81:0/4030711997 shutdown_connections 2024-09-13T18:54:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.338+0000 7fae38ada740 1 -- 172.21.15.81:0/4030711997 wait complete. 2024-09-13T18:54:06.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.342+0000 7fae38ada740 1 -- start start 2024-09-13T18:54:06.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.342+0000 7fae38ada740 1 Processor -- start 2024-09-13T18:54:06.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f2fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16f84520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16f84a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16f31750 con 0x16f1bd90 2024-09-13T18:54:06.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16f19950 con 0x16f1c170 2024-09-13T18:54:06.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16ef50c0 con 0x16ed1310 2024-09-13T18:54:06.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 10 client.0 _ll_register_callbacks cb 0x16e3b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16f84520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16f84520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58394/0 (socket says 172.21.15.81:58394) 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 -- 172.21.15.81:0/2316889291 learned_addr learned my addr 172.21.15.81:0/2316889291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae2ea00700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f2fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae2f400700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16f84a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 -- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 msgr2=0x16f2fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f2fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 -- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 msgr2=0x16f84a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:06.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16f84a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 -- 172.21.15.81:0/2316889291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x16e03290 con 0x16f1bd90 2024-09-13T18:54:06.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae26000700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16f84520 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fae18015b80 tx=0x7fae18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2b5c4e28c59d43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:06.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae13e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:06.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae13e00700 1 -- 172.21.15.81:0/2316889291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae18021750 con 0x16f1bd90 2024-09-13T18:54:06.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae18015bb0 con 0x16f1bd90 2024-09-13T18:54:06.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae13e00700 1 -- 172.21.15.81:0/2316889291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fae18031040 con 0x16f1bd90 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae13e00700 1 -- 172.21.15.81:0/2316889291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae18035980 con 0x16f1bd90 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 10 client.8394 fetch_fsmap learned FSMap version 93 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x16ddd790 con 0x16f1bd90 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae13e00700 1 -- 172.21.15.81:0/2316889291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae18015bb0 con 0x16f1bd90 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae13e00700 1 -- 172.21.15.81:0/2316889291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 93) v1 ==== 3150+0+0 (secure 0 0 0) 0x7fae18035420 con 0x16f1bd90 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 10 client.8394 fetch_fsmap finished waiting for FSMap version 93 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 10 client.8394 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 20 client.8394 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16f30050 0x16ef3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 4 client.8394 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.346+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x16ce02c0 con 0x16f30050 2024-09-13T18:54:06.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.350+0000 7fae2ea00700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16f30050 0x16ef3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:06.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.350+0000 7fae2ea00700 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16f30050 0x16ef3f30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ae06168d6b6a9a3 server_cookie=e4d4032fa2edf716 in_seq=0 out_seq=0 2024-09-13T18:54:06.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.350+0000 7fae13e00700 10 client.8394 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:06.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae13e00700 1 -- 172.21.15.81:0/2316889291 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x16ce02c0 con 0x16f30050 2024-09-13T18:54:06.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae13e00700 10 client.8394 handle_command_reply: tid=0 2024-09-13T18:54:06.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 client.8394 shutdown 2024-09-13T18:54:06.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 msgr2=0x16f84520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16f84520 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fae18015b80 tx=0x7fae18017000 comp rx=0 tx=0).stop 2024-09-13T18:54:06.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 shutdown_connections 2024-09-13T18:54:06.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x16f30050 0x16ef3f30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16f1c170 0x16f84a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x16f1bd90 0x16f84520 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 --2- 172.21.15.81:0/2316889291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ed1310 0x16f2fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 >> 172.21.15.81:0/2316889291 conn(0x16c645b0 msgr2=0x16f1c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae13e00700 0 client.8394 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:06.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 shutdown_connections 2024-09-13T18:54:06.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 1 -- 172.21.15.81:0/2316889291 wait complete. 2024-09-13T18:54:06.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae38ada740 20 client.8394 trim_cache size 0 max 16384 2024-09-13T18:54:06.380 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:06.381 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:54:06.381 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:54:06.381 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fae0c066730 msgr2=0x7fae0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fae0c066730 0x7fae0c068bf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fae30152cd0 tx=0x7fae18008040 comp rx=0 tx=0).stop 2024-09-13T18:54:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 msgr2=0x7fae3015ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 0x7fae3015ac80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fae2000c500 tx=0x7fae2000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 shutdown_connections 2024-09-13T18:54:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fae0c066730 0x7fae0c068bf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae3015ca20 0x7fae30154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae3006cd80 0x7fae301f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 --2- 172.21.15.81:0/82473379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae3006ada0 0x7fae3015ac80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 >> 172.21.15.81:0/82473379 conn(0x7fae30071d20 msgr2=0x7fae3015f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 shutdown_connections 2024-09-13T18:54:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:06.366+0000 7fae2fe00700 1 -- 172.21.15.81:0/82473379 wait complete. 2024-09-13T18:54:06.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:06.403 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-13T18:54:06.434 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/ 2024-09-13T18:54:06.435 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4 2024-09-13T18:54:06.435 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5 2024-09-13T18:54:06.435 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6 2024-09-13T18:54:06.435 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-13T18:54:06.435 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-13T18:54:06.436 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:54:06.436 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:54:06.436 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:54:06.436 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:54:06.436 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-13T18:54:06.437 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:54:06.572 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2024-09-13T18:54:06.764 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:54:06.764 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:54:06.764 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:54:06.764 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:54:06.764 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-13T18:54:06.764 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:54:06.906 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627779 2024-09-13T18:54:07.096 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:54:07.097 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:54:07.097 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:54:07.097 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:54:07.097 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-13T18:54:07.097 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:54:07.236 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627780 2024-09-13T18:54:07.422 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:54:07.423 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:54:07.423 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:54:07.423 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:54:07.423 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-13T18:54:07.423 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:54:07.568 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627781 2024-09-13T18:54:07.752 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:54:07.752 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:54:07.752 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:54:07.753 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:54:07.753 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-13T18:54:07.753 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:54:07.891 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627782 2024-09-13T18:54:08.079 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:54:08.079 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:54:08.079 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:54:08.080 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:54:08.080 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-13T18:54:08.080 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:54:08.221 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627783 2024-09-13T18:54:08.405 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-13T18:54:08.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 Processor -- start 2024-09-13T18:54:08.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 -- start start 2024-09-13T18:54:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646500d2540 0x56465018d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 0x56465023be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018fe50 0x56465023c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646500228e0 con 0x56465018ef70 2024-09-13T18:54:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564650022580 con 0x5646500d2540 2024-09-13T18:54:08.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e4b82140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56464fff88d0 con 0x56465018fe50 2024-09-13T18:54:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 0x56465023be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 0x56465023be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33674/0 (socket says 172.21.15.81:33674) 2024-09-13T18:54:08.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 -- 172.21.15.81:0/368124584 learned_addr learned my addr 172.21.15.81:0/368124584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1e00700 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646500d2540 0x56465018d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e2800700 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018fe50 0x56465023c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 -- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018fe50 msgr2=0x56465023c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018fe50 0x56465023c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 -- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646500d2540 msgr2=0x56465018d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646500d2540 0x56465018d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 -- 172.21.15.81:0/368124584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d4005d20 con 0x56465018ef70 2024-09-13T18:54:08.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9e1400700 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 0x56465023be40 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00097b0 tx=0x7fd9d0005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dec50da13b0959a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9dbe00700 1 -- 172.21.15.81:0/368124584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0017070 con 0x56465018ef70 2024-09-13T18:54:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9dbe00700 1 -- 172.21.15.81:0/368124584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d00086d0 con 0x56465018ef70 2024-09-13T18:54:08.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.510+0000 7fd9dbe00700 1 -- 172.21.15.81:0/368124584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000f040 con 0x56465018ef70 2024-09-13T18:54:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 -- 172.21.15.81:0/368124584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 msgr2=0x56465023be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 0x56465023be40 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00097b0 tx=0x7fd9d0005ac0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 -- 172.21.15.81:0/368124584 shutdown_connections 2024-09-13T18:54:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018fe50 0x56465023c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56465018ef70 0x56465023be40 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/368124584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5646500d2540 0x56465018d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 -- 172.21.15.81:0/368124584 >> 172.21.15.81:0/368124584 conn(0x5646500d3cb0 msgr2=0x5646501aa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 -- 172.21.15.81:0/368124584 shutdown_connections 2024-09-13T18:54:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 -- 172.21.15.81:0/368124584 wait complete. 2024-09-13T18:54:08.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 Processor -- start 2024-09-13T18:54:08.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.514+0000 7fd9e4b82140 1 -- start start 2024-09-13T18:54:08.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646500d2540 0x5646501ac110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018ef70 0x56465018b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56465018fe50 0x56465018bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56465018c410 con 0x5646500d2540 2024-09-13T18:54:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56465018c6a0 con 0x56465018fe50 2024-09-13T18:54:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56465018c940 con 0x56465018ef70 2024-09-13T18:54:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646500d2540 0x5646501ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646500d2540 0x5646501ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33686/0 (socket says 172.21.15.81:33686) 2024-09-13T18:54:08.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 -- 172.21.15.81:0/246472573 learned_addr learned my addr 172.21.15.81:0/246472573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1400700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018ef70 0x56465018b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e2800700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56465018fe50 0x56465018bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 -- 172.21.15.81:0/246472573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018ef70 msgr2=0x56465018b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56465018ef70 0x56465018b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 -- 172.21.15.81:0/246472573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56465018fe50 msgr2=0x56465018bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56465018fe50 0x56465018bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 -- 172.21.15.81:0/246472573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d0009410 con 0x5646500d2540 2024-09-13T18:54:08.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e1e00700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646500d2540 0x5646501ac110 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4015040 tx=0x7fd9d4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9daa00700 1 -- 172.21.15.81:0/246472573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4026430 con 0x5646500d2540 2024-09-13T18:54:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9daa00700 1 -- 172.21.15.81:0/246472573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4021070 con 0x5646500d2540 2024-09-13T18:54:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56465002aca0 con 0x5646500d2540 2024-09-13T18:54:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9daa00700 1 -- 172.21.15.81:0/246472573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d40267b0 con 0x5646500d2540 2024-09-13T18:54:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.518+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564650010b00 con 0x5646500d2540 2024-09-13T18:54:08.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9daa00700 1 -- 172.21.15.81:0/246472573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9d4023030 con 0x5646500d2540 2024-09-13T18:54:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9daa00700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd9c4065090 0x7fd9c4067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9daa00700 1 -- 172.21.15.81:0/246472573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd9d4084990 con 0x5646500d2540 2024-09-13T18:54:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9e1400700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd9c4065090 0x7fd9c4067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5646501ac650 0x564650243a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 13.12 13:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) v8 -- 0x5646501a56b0 con 0x5646501ac650 2024-09-13T18:54:08.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9e2800700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5646501ac650 0x564650243a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9e1400700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd9c4065090 0x7fd9c4067550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00057c0 tx=0x7fd9d0012000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.522+0000 7fd9e2800700 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5646501ac650 0x564650243a90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e2800700 1 -- 172.21.15.81:0/246472573 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v95'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd9dc002990 con 0x5646501ac650 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5646501ac650 msgr2=0x564650243a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x5646501ac650 0x564650243a90 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd9c4065090 msgr2=0x7fd9c4067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd9c4065090 0x7fd9c4067550 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00057c0 tx=0x7fd9d0012000 comp rx=0 tx=0).stop 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646500d2540 msgr2=0x5646501ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 --2- 172.21.15.81:0/246472573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646500d2540 0x5646501ac110 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4015040 tx=0x7fd9d4002fb0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e2800700 1 -- 172.21.15.81:0/246472573 reap_dead start 2024-09-13T18:54:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 shutdown_connections 2024-09-13T18:54:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 >> 172.21.15.81:0/246472573 conn(0x5646500d3cb0 msgr2=0x564650106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 shutdown_connections 2024-09-13T18:54:08.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.526+0000 7fd9e4b82140 1 -- 172.21.15.81:0/246472573 wait complete. 2024-09-13T18:54:08.544 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-13T18:54:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 Processor -- start 2024-09-13T18:54:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 -- start start 2024-09-13T18:54:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea5bff70 0x557bea5dcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5c1560 0x557bea547fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bea4972f0 con 0x557bea503540 2024-09-13T18:54:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bea4538e0 con 0x557bea5c1560 2024-09-13T18:54:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0f17d140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bea453580 con 0x557bea5bff70 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33700/0 (socket says 172.21.15.81:33700) 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 -- 172.21.15.81:0/1338450627 learned_addr learned my addr 172.21.15.81:0/1338450627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0ce00700 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5c1560 0x557bea547fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0ba00700 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea5bff70 0x557bea5dcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 -- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea5bff70 msgr2=0x557bea5dcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea5bff70 0x557bea5dcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 -- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5c1560 msgr2=0x557bea547fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5c1560 0x557bea547fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.602+0000 7f2c0c400700 1 -- 172.21.15.81:0/1338450627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4005de0 con 0x557bea503540 2024-09-13T18:54:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0ba00700 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea5bff70 0x557bea5dcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0c400700 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 0x557bea5372c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b1f0 tx=0x7f2bfc00b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acae35050f7fa0c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0a600700 1 -- 172.21.15.81:0/1338450627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00f3a0 con 0x557bea503540 2024-09-13T18:54:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0a600700 1 -- 172.21.15.81:0/1338450627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc00a040 con 0x557bea503540 2024-09-13T18:54:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0a600700 1 -- 172.21.15.81:0/1338450627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc00f760 con 0x557bea503540 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1338450627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 msgr2=0x557bea5372c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 0x557bea5372c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b1f0 tx=0x7f2bfc00b500 comp rx=0 tx=0).stop 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1338450627 shutdown_connections 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5c1560 0x557bea547fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea5bff70 0x557bea5dcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1338450627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1338450627 >> 172.21.15.81:0/1338450627 conn(0x557bea504cb0 msgr2=0x557bea5be100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1338450627 shutdown_connections 2024-09-13T18:54:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1338450627 wait complete. 2024-09-13T18:54:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 Processor -- start 2024-09-13T18:54:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.606+0000 7f2c0f17d140 1 -- start start 2024-09-13T18:54:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5bff70 0x557bea537800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea5c1560 0x557bea666480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bea4298d0 con 0x557bea5c1560 2024-09-13T18:54:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bea5dadd0 con 0x557bea5bff70 2024-09-13T18:54:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bea5da0a0 con 0x557bea503540 2024-09-13T18:54:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea5c1560 0x557bea666480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea5c1560 0x557bea666480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33704/0 (socket says 172.21.15.81:33704) 2024-09-13T18:54:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 -- 172.21.15.81:0/1504153432 learned_addr learned my addr 172.21.15.81:0/1504153432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ba00700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5bff70 0x557bea537800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0c400700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 -- 172.21.15.81:0/1504153432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea503540 msgr2=0x557bea5372c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557bea503540 0x557bea5372c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 -- 172.21.15.81:0/1504153432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5bff70 msgr2=0x557bea537800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557bea5bff70 0x557bea537800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 -- 172.21.15.81:0/1504153432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc001b40 con 0x557bea5c1560 2024-09-13T18:54:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0ce00700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea5c1560 0x557bea666480 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2c04010910 tx=0x7f2c04010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c09200700 1 -- 172.21.15.81:0/1504153432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04012670 con 0x557bea5c1560 2024-09-13T18:54:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c09200700 1 -- 172.21.15.81:0/1504153432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040127d0 con 0x557bea5c1560 2024-09-13T18:54:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c09200700 1 -- 172.21.15.81:0/1504153432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04012b60 con 0x557bea5c1560 2024-09-13T18:54:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557bea441b00 con 0x557bea5c1560 2024-09-13T18:54:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.610+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bea434f40 con 0x557bea5c1560 2024-09-13T18:54:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.614+0000 7f2c09200700 1 -- 172.21.15.81:0/1504153432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c04003040 con 0x557bea5c1560 2024-09-13T18:54:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.614+0000 7f2c09200700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2be8065060 0x7f2be8067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.614+0000 7f2c09200700 1 -- 172.21.15.81:0/1504153432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2c040832b0 con 0x557bea5c1560 2024-09-13T18:54:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.614+0000 7f2c0c400700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2be8065060 0x7f2be8067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.618+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x557bea667cb0 0x557bea6680c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.618+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- osd_op(unknown.0.0:1 13.12 13:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) v8 -- 0x557bea668600 con 0x557bea667cb0 2024-09-13T18:54:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.618+0000 7f2c0ba00700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x557bea667cb0 0x557bea6680c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.618+0000 7f2c0c400700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2be8065060 0x7f2be8067520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b540 tx=0x7f2bfc002000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.618+0000 7f2c0ba00700 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x557bea667cb0 0x557bea6680c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0ba00700 1 -- 172.21.15.81:0/1504153432 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v95'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2bf4019040 con 0x557bea667cb0 2024-09-13T18:54:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x557bea667cb0 msgr2=0x557bea6680c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x557bea667cb0 0x557bea6680c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2be8065060 msgr2=0x7f2be8067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2be8065060 0x7f2be8067520 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00b540 tx=0x7f2bfc002000 comp rx=0 tx=0).stop 2024-09-13T18:54:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea5c1560 msgr2=0x557bea666480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 --2- 172.21.15.81:0/1504153432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557bea5c1560 0x557bea666480 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f2c04010910 tx=0x7f2c04010c20 comp rx=0 tx=0).stop 2024-09-13T18:54:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0ce00700 1 -- 172.21.15.81:0/1504153432 reap_dead start 2024-09-13T18:54:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 shutdown_connections 2024-09-13T18:54:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 >> 172.21.15.81:0/1504153432 conn(0x557bea504cb0 msgr2=0x557bea54fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 shutdown_connections 2024-09-13T18:54:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.622+0000 7f2c0f17d140 1 -- 172.21.15.81:0/1504153432 wait complete. 2024-09-13T18:54:08.637 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-13T18:54:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 Processor -- start 2024-09-13T18:54:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 -- start start 2024-09-13T18:54:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 0x5588c60d8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c60b9f70 0x5588c60b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c6049aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c5f912f0 con 0x5588c5ffd540 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c5f4d8e0 con 0x5588c60bb560 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.686+0000 7f49dfb50140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c5f4d580 con 0x5588c60b9f70 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 0x5588c60d8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 0x5588c60d8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33716/0 (socket says 172.21.15.81:33716) 2024-09-13T18:54:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 -- 172.21.15.81:0/782994514 learned_addr learned my addr 172.21.15.81:0/782994514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dc400700 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c60b9f70 0x5588c60b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dd800700 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c6049aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 -- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c60b9f70 msgr2=0x5588c60b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c60b9f70 0x5588c60b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 -- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 msgr2=0x5588c6049aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c6049aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 -- 172.21.15.81:0/782994514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d4005d20 con 0x5588c5ffd540 2024-09-13T18:54:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dce00700 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 0x5588c60d8290 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f49cc006ed0 tx=0x7f49cc001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2feb64274e871b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49db000700 1 -- 172.21.15.81:0/782994514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc006310 con 0x5588c5ffd540 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49db000700 1 -- 172.21.15.81:0/782994514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc004520 con 0x5588c5ffd540 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49db000700 1 -- 172.21.15.81:0/782994514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0048d0 con 0x5588c5ffd540 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 -- 172.21.15.81:0/782994514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 msgr2=0x5588c60d8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 0x5588c60d8290 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f49cc006ed0 tx=0x7f49cc001930 comp rx=0 tx=0).stop 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 -- 172.21.15.81:0/782994514 shutdown_connections 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c6049aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c60b9f70 0x5588c60b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 --2- 172.21.15.81:0/782994514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c5ffd540 0x5588c60d8290 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 -- 172.21.15.81:0/782994514 >> 172.21.15.81:0/782994514 conn(0x5588c5ffecb0 msgr2=0x5588c6031220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 -- 172.21.15.81:0/782994514 shutdown_connections 2024-09-13T18:54:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 -- 172.21.15.81:0/782994514 wait complete. 2024-09-13T18:54:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.690+0000 7f49dfb50140 1 Processor -- start 2024-09-13T18:54:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 -- start start 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c5ffd540 0x5588c60d3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c60b9f70 0x5588c616a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c60d49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c5f238d0 con 0x5588c60b9f70 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588c6047f50 con 0x5588c60bb560 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588c6046100 con 0x5588c5ffd540 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c60b9f70 0x5588c616a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c60b9f70 0x5588c616a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33724/0 (socket says 172.21.15.81:33724) 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 -- 172.21.15.81:0/777675710 learned_addr learned my addr 172.21.15.81:0/777675710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dce00700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c5ffd540 0x5588c60d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dd800700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c60d49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 -- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c5ffd540 msgr2=0x5588c60d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588c5ffd540 0x5588c60d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 -- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 msgr2=0x5588c60d49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c60d49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 -- 172.21.15.81:0/777675710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0001e10 con 0x5588c60b9f70 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dd800700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588c60bb560 0x5588c60d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dc400700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c60b9f70 0x5588c616a330 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x5588c60321d0 tx=0x7f49c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49d9c00700 1 -- 172.21.15.81:0/777675710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8008dd0 con 0x5588c60b9f70 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49d9c00700 1 -- 172.21.15.81:0/777675710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8012410 con 0x5588c60b9f70 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c8005d20 con 0x5588c60b9f70 2024-09-13T18:54:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49d9c00700 1 -- 172.21.15.81:0/777675710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8012780 con 0x5588c60b9f70 2024-09-13T18:54:08.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.694+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588c5f3bb00 con 0x5588c60b9f70 2024-09-13T18:54:08.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.698+0000 7f49d9c00700 1 -- 172.21.15.81:0/777675710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49c80128e0 con 0x5588c60b9f70 2024-09-13T18:54:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.698+0000 7f49d9c00700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f49bc065060 0x7f49bc067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.698+0000 7f49d9c00700 1 -- 172.21.15.81:0/777675710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f49c80848f0 con 0x5588c60b9f70 2024-09-13T18:54:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.698+0000 7f49dce00700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f49bc065060 0x7f49bc067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.698+0000 7f49dfb50140 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588c6031610 0x5588c6046ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.698+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- osd_op(unknown.0.0:1 13.5 13:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) v8 -- 0x5588c616a870 con 0x5588c6031610 2024-09-13T18:54:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.702+0000 7f49dce00700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f49bc065060 0x7f49bc067520 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f49cc001970 tx=0x7f49cc015040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.702+0000 7f49dd800700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588c6031610 0x5588c6046ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.702+0000 7f49dd800700 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588c6031610 0x5588c6046ff0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.702+0000 7f49dd800700 1 -- 172.21.15.81:0/777675710 <== osd.4 v2:172.21.15.178:6803/1450995168 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v95'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f49d4009ab0 con 0x5588c6031610 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.702+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588c6031610 msgr2=0x5588c6046ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.702+0000 7f49dfb50140 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588c6031610 0x5588c6046ff0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f49bc065060 msgr2=0x7f49bc067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f49bc065060 0x7f49bc067520 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f49cc001970 tx=0x7f49cc015040 comp rx=0 tx=0).stop 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c60b9f70 msgr2=0x5588c616a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 --2- 172.21.15.81:0/777675710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588c60b9f70 0x5588c616a330 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x5588c60321d0 tx=0x7f49c8002fb0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dd800700 1 -- 172.21.15.81:0/777675710 reap_dead start 2024-09-13T18:54:08.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 shutdown_connections 2024-09-13T18:54:08.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 >> 172.21.15.81:0/777675710 conn(0x5588c5ffecb0 msgr2=0x5588c60bac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 shutdown_connections 2024-09-13T18:54:08.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.706+0000 7f49dfb50140 1 -- 172.21.15.81:0/777675710 wait complete. 2024-09-13T18:54:08.723 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-13T18:54:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 Processor -- start 2024-09-13T18:54:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 -- start start 2024-09-13T18:54:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a00ff170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a011b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19ffd82f0 con 0x55f1a0044540 2024-09-13T18:54:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19ff948e0 con 0x55f1a0100f70 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eee7a1140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19ff94580 con 0x55f1a0102560 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a00ff170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a00ff170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33738/0 (socket says 172.21.15.81:33738) 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 -- 172.21.15.81:0/3623756922 learned_addr learned my addr 172.21.15.81:0/3623756922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeb000700 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eec400700 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a011b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 -- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 msgr2=0x55f1a011b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a011b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 -- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 msgr2=0x55f1a011ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 -- 172.21.15.81:0/3623756922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8005d20 con 0x55f1a0044540 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eec400700 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a011b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.778+0000 7f9eeba00700 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a00ff170 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f9edc001ca0 tx=0x7f9edc00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439bb677b96330fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9ee9c00700 1 -- 172.21.15.81:0/3623756922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00be60 con 0x55f1a0044540 2024-09-13T18:54:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9ee9c00700 1 -- 172.21.15.81:0/3623756922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00e470 con 0x55f1a0044540 2024-09-13T18:54:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9ee9c00700 1 -- 172.21.15.81:0/3623756922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e820 con 0x55f1a0044540 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 -- 172.21.15.81:0/3623756922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 msgr2=0x55f1a00ff170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a00ff170 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f9edc001ca0 tx=0x7f9edc00b5d0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 -- 172.21.15.81:0/3623756922 shutdown_connections 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a011b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/3623756922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a00ff170 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 -- 172.21.15.81:0/3623756922 >> 172.21.15.81:0/3623756922 conn(0x55f1a0045cb0 msgr2=0x55f1a011bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 -- 172.21.15.81:0/3623756922 shutdown_connections 2024-09-13T18:54:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 -- 172.21.15.81:0/3623756922 wait complete. 2024-09-13T18:54:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 Processor -- start 2024-09-13T18:54:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.782+0000 7f9eee7a1140 1 -- start start 2024-09-13T18:54:08.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a0090b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a0117120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19ff6a8d0 con 0x55f1a0044540 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1a0117c40 con 0x55f1a0100f70 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1a011a730 con 0x55f1a0102560 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a0090b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a0090b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33740/0 (socket says 172.21.15.81:33740) 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 -- 172.21.15.81:0/1105109552 learned_addr learned my addr 172.21.15.81:0/1105109552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeb000700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eec400700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a0117120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 -- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 msgr2=0x55f1a0117120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f1a0102560 0x55f1a0117120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 -- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 msgr2=0x55f1a011a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f1a0100f70 0x55f1a011a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 -- 172.21.15.81:0/1105109552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed0001e10 con 0x55f1a0044540 2024-09-13T18:54:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eeba00700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a0090b10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b610 tx=0x7f9edc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9ee3e00700 1 -- 172.21.15.81:0/1105109552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc01e070 con 0x55f1a0044540 2024-09-13T18:54:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9ee3e00700 1 -- 172.21.15.81:0/1105109552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc017420 con 0x55f1a0044540 2024-09-13T18:54:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f19ff82b00 con 0x55f1a0044540 2024-09-13T18:54:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9ee3e00700 1 -- 172.21.15.81:0/1105109552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00eea0 con 0x55f1a0044540 2024-09-13T18:54:08.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.786+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f19ff75f40 con 0x55f1a0044540 2024-09-13T18:54:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.790+0000 7f9ee3e00700 1 -- 172.21.15.81:0/1105109552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9edc0177d0 con 0x55f1a0044540 2024-09-13T18:54:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.790+0000 7f9ee3e00700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9ecc065060 0x7f9ecc067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.790+0000 7f9ee3e00700 1 -- 172.21.15.81:0/1105109552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9edc084440 con 0x55f1a0044540 2024-09-13T18:54:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.790+0000 7f9eeb000700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9ecc065060 0x7f9ecc067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.790+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x55f1a008cab0 0x55f1a008cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.790+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- osd_op(unknown.0.0:1 13.9 13:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) v8 -- 0x55f1a008d400 con 0x55f1a008cab0 2024-09-13T18:54:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.794+0000 7f9eeb000700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9ecc065060 0x7f9ecc067520 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8000c00 tx=0x7f9ed800f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.794+0000 7f9eec400700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x55f1a008cab0 0x55f1a008cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.794+0000 7f9eec400700 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x55f1a008cab0 0x55f1a008cec0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eec400700 1 -- 172.21.15.81:0/1105109552 <== osd.5 v2:172.21.15.178:6824/2042484449 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v95'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ee4010660 con 0x55f1a008cab0 2024-09-13T18:54:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x55f1a008cab0 msgr2=0x55f1a008cec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x55f1a008cab0 0x55f1a008cec0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9ecc065060 msgr2=0x7f9ecc067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9ecc065060 0x7f9ecc067520 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8000c00 tx=0x7f9ed800f000 comp rx=0 tx=0).stop 2024-09-13T18:54:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 msgr2=0x55f1a0090b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 --2- 172.21.15.81:0/1105109552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f1a0044540 0x55f1a0090b10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b610 tx=0x7f9edc000bc0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eec400700 1 -- 172.21.15.81:0/1105109552 reap_dead start 2024-09-13T18:54:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 shutdown_connections 2024-09-13T18:54:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 >> 172.21.15.81:0/1105109552 conn(0x55f1a0045cb0 msgr2=0x55f1a011ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 shutdown_connections 2024-09-13T18:54:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.798+0000 7f9eee7a1140 1 -- 172.21.15.81:0/1105109552 wait complete. 2024-09-13T18:54:08.816 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-13T18:54:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 Processor -- start 2024-09-13T18:54:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 -- start start 2024-09-13T18:54:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e1909540 0x5588e194dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e193d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 0x5588e1a72cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e189d2f0 con 0x5588e19c7560 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e18598e0 con 0x5588e1909540 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efcf73140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588e1859580 con 0x5588e19c5f70 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 0x5588e1a72cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 0x5588e1a72cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33762/0 (socket says 172.21.15.81:33762) 2024-09-13T18:54:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efac00700 1 -- 172.21.15.81:0/2310791871 learned_addr learned my addr 172.21.15.81:0/2310791871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.874+0000 7f9efa200700 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e1909540 0x5588e194dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efac00700 1 -- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 msgr2=0x5588e193d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9ef9800700 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e193d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efac00700 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e193d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efac00700 1 -- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e1909540 msgr2=0x5588e194dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efac00700 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e1909540 0x5588e194dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efac00700 1 -- 172.21.15.81:0/2310791871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4005de0 con 0x5588e19c7560 2024-09-13T18:54:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9ef9800700 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e193d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efac00700 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 0x5588e1a72cf0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x5588e19c4cf0 tx=0x7f9ef400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d970f3eda77cbc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9ef3e00700 1 -- 172.21.15.81:0/2310791871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40055c0 con 0x5588e19c7560 2024-09-13T18:54:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9ef3e00700 1 -- 172.21.15.81:0/2310791871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4008b60 con 0x5588e19c7560 2024-09-13T18:54:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9ef3e00700 1 -- 172.21.15.81:0/2310791871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef401c430 con 0x5588e19c7560 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 -- 172.21.15.81:0/2310791871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 msgr2=0x5588e1a72cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 0x5588e1a72cf0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x5588e19c4cf0 tx=0x7f9ef400d000 comp rx=0 tx=0).stop 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 -- 172.21.15.81:0/2310791871 shutdown_connections 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e19c7560 0x5588e1a72cf0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e193d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 --2- 172.21.15.81:0/2310791871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e1909540 0x5588e194dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 -- 172.21.15.81:0/2310791871 >> 172.21.15.81:0/2310791871 conn(0x5588e190acb0 msgr2=0x5588e193d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 -- 172.21.15.81:0/2310791871 shutdown_connections 2024-09-13T18:54:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 -- 172.21.15.81:0/2310791871 wait complete. 2024-09-13T18:54:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 Processor -- start 2024-09-13T18:54:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.878+0000 7f9efcf73140 1 -- start start 2024-09-13T18:54:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e1909540 0x5588e19e3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e19dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e19c7560 0x5588e19d8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e182f8d0 con 0x5588e1909540 2024-09-13T18:54:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588e19d9e30 con 0x5588e19c7560 2024-09-13T18:54:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588e19df330 con 0x5588e19c5f70 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e1909540 0x5588e19e3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e1909540 0x5588e19e3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33772/0 (socket says 172.21.15.81:33772) 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 -- 172.21.15.81:0/1886647763 learned_addr learned my addr 172.21.15.81:0/1886647763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efac00700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e19c7560 0x5588e19d8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9ef9800700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e19dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 -- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 msgr2=0x5588e19dfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588e19c5f70 0x5588e19dfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 -- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e19c7560 msgr2=0x5588e19d8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e19c7560 0x5588e19d8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 -- 172.21.15.81:0/1886647763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588e1861ca0 con 0x5588e1909540 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efac00700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588e19c7560 0x5588e19d8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efa200700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e1909540 0x5588e19e3b30 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d490 tx=0x7f9eec00d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9ef2a00700 1 -- 172.21.15.81:0/1886647763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00de60 con 0x5588e1909540 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9ef2a00700 1 -- 172.21.15.81:0/1886647763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec013480 con 0x5588e1909540 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588e1847b00 con 0x5588e1909540 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9ef2a00700 1 -- 172.21.15.81:0/1886647763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec013830 con 0x5588e1909540 2024-09-13T18:54:08.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.882+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588e183af40 con 0x5588e1909540 2024-09-13T18:54:08.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.886+0000 7f9ef2a00700 1 -- 172.21.15.81:0/1886647763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9eec013990 con 0x5588e1909540 2024-09-13T18:54:08.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.886+0000 7f9ef2a00700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9edc065060 0x7f9edc067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.886+0000 7f9ef2a00700 1 -- 172.21.15.81:0/1886647763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9eec082fe0 con 0x5588e1909540 2024-09-13T18:54:08.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.886+0000 7f9ef9800700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9edc065060 0x7f9edc067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.890+0000 7f9efcf73140 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588e19e4070 0x5588e19d9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.890+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- osd_op(unknown.0.0:1 13.5 13:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) v8 -- 0x5588e19da4c0 con 0x5588e19e4070 2024-09-13T18:54:08.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.890+0000 7f9ef9800700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9edc065060 0x7f9edc067520 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80075e0 tx=0x7f9ee8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.890+0000 7f9efac00700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588e19e4070 0x5588e19d9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.890+0000 7f9efac00700 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588e19e4070 0x5588e19d9640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efac00700 1 -- 172.21.15.81:0/1886647763 <== osd.4 v2:172.21.15.178:6803/1450995168 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v95'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9ef401c430 con 0x5588e19e4070 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588e19e4070 msgr2=0x5588e19d9640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5588e19e4070 0x5588e19d9640 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9edc065060 msgr2=0x7f9edc067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9edc065060 0x7f9edc067520 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80075e0 tx=0x7f9ee8009040 comp rx=0 tx=0).stop 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e1909540 msgr2=0x5588e19e3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 --2- 172.21.15.81:0/1886647763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5588e1909540 0x5588e19e3b30 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00d490 tx=0x7f9eec00d850 comp rx=0 tx=0).stop 2024-09-13T18:54:08.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efac00700 1 -- 172.21.15.81:0/1886647763 reap_dead start 2024-09-13T18:54:08.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 shutdown_connections 2024-09-13T18:54:08.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 >> 172.21.15.81:0/1886647763 conn(0x5588e190acb0 msgr2=0x5588e19e2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 shutdown_connections 2024-09-13T18:54:08.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.894+0000 7f9efcf73140 1 -- 172.21.15.81:0/1886647763 wait complete. 2024-09-13T18:54:08.913 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-13T18:54:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.974+0000 7fb891276140 1 Processor -- start 2024-09-13T18:54:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.974+0000 7fb891276140 1 -- start start 2024-09-13T18:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8e166e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfb7a0 0x556fc8e13c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 0x556fc8d6f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fc8cd32f0 con 0x556fc8dfdb80 2024-09-13T18:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fc8c8f8e0 con 0x556fc8dfb7a0 2024-09-13T18:54:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fc8c8f580 con 0x556fc8d897c0 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 0x556fc8d6f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 0x556fc8d6f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33782/0 (socket says 172.21.15.81:33782) 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 -- 172.21.15.81:0/2596447324 learned_addr learned my addr 172.21.15.81:0/2596447324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88da00700 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfb7a0 0x556fc8e13c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88e400700 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8e166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 -- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 msgr2=0x556fc8e166e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8e166e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 -- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfb7a0 msgr2=0x556fc8e13c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfb7a0 0x556fc8e13c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 -- 172.21.15.81:0/2596447324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb87c005d20 con 0x556fc8dfdb80 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88e400700 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8e166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb88ee00700 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 0x556fc8d6f0e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fb888001710 tx=0x7fb888001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1592be7e53e623d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb887e00700 1 -- 172.21.15.81:0/2596447324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880062e0 con 0x556fc8dfdb80 2024-09-13T18:54:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb887e00700 1 -- 172.21.15.81:0/2596447324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888003450 con 0x556fc8dfdb80 2024-09-13T18:54:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb887e00700 1 -- 172.21.15.81:0/2596447324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880037c0 con 0x556fc8dfdb80 2024-09-13T18:54:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- 172.21.15.81:0/2596447324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 msgr2=0x556fc8d6f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 0x556fc8d6f0e0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fb888001710 tx=0x7fb888001a20 comp rx=0 tx=0).stop 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- 172.21.15.81:0/2596447324 shutdown_connections 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfdb80 0x556fc8d6f0e0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfb7a0 0x556fc8e13c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 --2- 172.21.15.81:0/2596447324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8e166e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- 172.21.15.81:0/2596447324 >> 172.21.15.81:0/2596447324 conn(0x556fc8d42d90 msgr2=0x556fc8dfa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- 172.21.15.81:0/2596447324 shutdown_connections 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.978+0000 7fb891276140 1 -- 172.21.15.81:0/2596447324 wait complete. 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 Processor -- start 2024-09-13T18:54:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 -- start start 2024-09-13T18:54:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8d84d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfb7a0 0x556fc8deeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfdb80 0x556fc8d6d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fc8c658d0 con 0x556fc8dfb7a0 2024-09-13T18:54:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fc8def1e0 con 0x556fc8dfdb80 2024-09-13T18:54:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb891276140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fc8def6c0 con 0x556fc8d897c0 2024-09-13T18:54:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfb7a0 0x556fc8deeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfb7a0 0x556fc8deeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33792/0 (socket says 172.21.15.81:33792) 2024-09-13T18:54:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 -- 172.21.15.81:0/1077592886 learned_addr learned my addr 172.21.15.81:0/1077592886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88ee00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfdb80 0x556fc8d6d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88e400700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8d84d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 -- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 msgr2=0x556fc8d84d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8d84d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 -- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfdb80 msgr2=0x556fc8d6d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556fc8dfdb80 0x556fc8d6d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88da00700 1 -- 172.21.15.81:0/1077592886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb888006cd0 con 0x556fc8dfb7a0 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.982+0000 7fb88e400700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556fc8d897c0 0x556fc8d84d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.986+0000 7fb88da00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfb7a0 0x556fc8deeca0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00a840 tx=0x7fb87c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.986+0000 7fb886a00700 1 -- 172.21.15.81:0/1077592886 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c012820 con 0x556fc8dfb7a0 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.986+0000 7fb886a00700 1 -- 172.21.15.81:0/1077592886 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87c0129a0 con 0x556fc8dfb7a0 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.986+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fc8c7db00 con 0x556fc8dfb7a0 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.986+0000 7fb886a00700 1 -- 172.21.15.81:0/1077592886 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87c012d50 con 0x556fc8dfb7a0 2024-09-13T18:54:09.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.986+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fc8c70f40 con 0x556fc8dfb7a0 2024-09-13T18:54:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb886a00700 1 -- 172.21.15.81:0/1077592886 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb87c02f3f0 con 0x556fc8dfb7a0 2024-09-13T18:54:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb886a00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb870065060 0x7fb870067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb886a00700 1 -- 172.21.15.81:0/1077592886 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fb87c084de0 con 0x556fc8dfb7a0 2024-09-13T18:54:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb88e400700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb870065060 0x7fb870067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb891276140 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x556fc8eaa330 0x556fc8eb5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- osd_op(unknown.0.0:1 13.1d 13:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) v8 -- 0x556fc8eb5e40 con 0x556fc8eaa330 2024-09-13T18:54:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb88e400700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb870065060 0x7fb870067520 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb8800098e0 tx=0x7fb88000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.990+0000 7fb88ee00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x556fc8eaa330 0x556fc8eb5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb88ee00700 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x556fc8eaa330 0x556fc8eb5900 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb88ee00700 1 -- 172.21.15.81:0/1077592886 <== osd.7 v2:172.21.15.178:6816/2829585854 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v95'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb8880035c0 con 0x556fc8eaa330 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x556fc8eaa330 msgr2=0x556fc8eb5900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x556fc8eaa330 0x556fc8eb5900 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb870065060 msgr2=0x7fb870067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb870065060 0x7fb870067520 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb8800098e0 tx=0x7fb88000c040 comp rx=0 tx=0).stop 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfb7a0 msgr2=0x556fc8deeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 --2- 172.21.15.81:0/1077592886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556fc8dfb7a0 0x556fc8deeca0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00a840 tx=0x7fb87c002fb0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb88ee00700 1 -- 172.21.15.81:0/1077592886 reap_dead start 2024-09-13T18:54:09.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.994+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 shutdown_connections 2024-09-13T18:54:09.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.998+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 >> 172.21.15.81:0/1077592886 conn(0x556fc8d42d90 msgr2=0x556fc8e16490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.998+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 shutdown_connections 2024-09-13T18:54:09.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:08.998+0000 7fb891276140 1 -- 172.21.15.81:0/1077592886 wait complete. 2024-09-13T18:54:09.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /d1/d2/d3 recursive,force 2024-09-13T18:54:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 Processor -- start 2024-09-13T18:54:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 -- start start 2024-09-13T18:54:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 0x7fc8340cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8340ce7d0 0x7fc8340cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340d1620 con 0x7fc8340d3810 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340cec20 con 0x7fc83415cd50 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc83a000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340d1900 con 0x7fc8340ce7d0 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc838c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 0x7fc8340cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc838c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 0x7fc8340cf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33794/0 (socket says 172.21.15.81:33794) 2024-09-13T18:54:09.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc838c00700 1 -- 172.21.15.81:0/762339292 learned_addr learned my addr 172.21.15.81:0/762339292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.186+0000 7fc839600700 1 --2- 172.21.15.81:0/762339292 >> v2:172.21.15.178:3300/0 conn(0x7fc8340ce7d0 0x7fc8340cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc839600700 1 -- 172.21.15.81:0/762339292 >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 msgr2=0x7fc8340cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc839600700 1 --2- 172.21.15.81:0/762339292 >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 0x7fc8340cf680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc839600700 1 -- 172.21.15.81:0/762339292 >> v1:172.21.15.178:6789/0 conn(0x7fc8340d3810 legacy=0x7fc8340b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc839600700 1 -- 172.21.15.81:0/762339292 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340b5be0 con 0x7fc8340ce7d0 2024-09-13T18:54:09.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc838c00700 1 --2- 172.21.15.81:0/762339292 >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 0x7fc8340cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:09.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc839600700 1 --2- 172.21.15.81:0/762339292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340ce7d0 0x7fc8340cfbc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc83408c710 tx=0x7fc82c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ac6b5e18c84ad74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc833400700 1 -- 172.21.15.81:0/762339292 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e070 con 0x7fc8340ce7d0 2024-09-13T18:54:09.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc833400700 1 -- 172.21.15.81:0/762339292 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00bb20 con 0x7fc8340ce7d0 2024-09-13T18:54:09.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc833400700 1 -- 172.21.15.81:0/762339292 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c012430 con 0x7fc8340ce7d0 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 -- 172.21.15.81:0/762339292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340ce7d0 msgr2=0x7fc8340cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 --2- 172.21.15.81:0/762339292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340ce7d0 0x7fc8340cfbc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc83408c710 tx=0x7fc82c00b330 comp rx=0 tx=0).stop 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 -- 172.21.15.81:0/762339292 shutdown_connections 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 --2- 172.21.15.81:0/762339292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340ce7d0 0x7fc8340cfbc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 --2- 172.21.15.81:0/762339292 >> v2:172.21.15.81:3300/0 conn(0x7fc83415cd50 0x7fc8340cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 -- 172.21.15.81:0/762339292 >> 172.21.15.81:0/762339292 conn(0x7fc8340d2cf0 msgr2=0x7fc8340d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 -- 172.21.15.81:0/762339292 shutdown_connections 2024-09-13T18:54:09.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.190+0000 7fc83a000700 1 -- 172.21.15.81:0/762339292 wait complete. 2024-09-13T18:54:09.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 Processor -- start 2024-09-13T18:54:09.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 -- start start 2024-09-13T18:54:09.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340ce7d0 0x7fc8341546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340d3810 0x7fc83415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 0x7fc8340cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c9f60 con 0x7fc83415cd50 2024-09-13T18:54:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340ca240 con 0x7fc8340d3810 2024-09-13T18:54:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc83a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340ca520 con 0x7fc8340ce7d0 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 0x7fc8340cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 0x7fc8340cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33800/0 (socket says 172.21.15.81:33800) 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 -- 172.21.15.81:0/1760854097 learned_addr learned my addr 172.21.15.81:0/1760854097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc833e00700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340d3810 0x7fc83415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc838c00700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340ce7d0 0x7fc8341546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 -- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340ce7d0 msgr2=0x7fc8341546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340ce7d0 0x7fc8341546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 -- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340d3810 msgr2=0x7fc83415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340d3810 0x7fc83415f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 -- 172.21.15.81:0/1760854097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009570 con 0x7fc83415cd50 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.194+0000 7fc839600700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 0x7fc8340cbe30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc82c014040 tx=0x7fc82c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.198+0000 7fc830c00700 1 -- 172.21.15.81:0/1760854097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c012430 con 0x7fc83415cd50 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.198+0000 7fc830c00700 1 -- 172.21.15.81:0/1760854097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c020070 con 0x7fc83415cd50 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.198+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c009a70 con 0x7fc83415cd50 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.198+0000 7fc830c00700 1 -- 172.21.15.81:0/1760854097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c004280 con 0x7fc83415cd50 2024-09-13T18:54:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.198+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340caae0 con 0x7fc83415cd50 2024-09-13T18:54:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.198+0000 7fc830c00700 1 -- 172.21.15.81:0/1760854097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc82c0043e0 con 0x7fc83415cd50 2024-09-13T18:54:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.202+0000 7fc830c00700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc814066730 0x7fc814068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.202+0000 7fc830c00700 1 -- 172.21.15.81:0/1760854097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fc82c022070 con 0x7fc83415cd50 2024-09-13T18:54:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.202+0000 7fc838c00700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc814066730 0x7fc814068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.202+0000 7fc838c00700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc814066730 0x7fc814068bf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc828009c70 tx=0x7fc828008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.202+0000 7fc83ea65740 1 Processor -- start 2024-09-13T18:54:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.202+0000 7fc83ea65740 1 -- start start 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246891e0 0x246ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246d3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc83ea65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x245f5530 con 0x246895c0 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x245f2cc0 con 0x246891e0 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x245ee5b0 con 0x246d1580 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc833e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246891e0 0x246ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc833e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33810/0 (socket says 172.21.15.81:33810) 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc833e00700 1 -- 172.21.15.81:0/2246716870 learned_addr learned my addr 172.21.15.81:0/2246716870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc839600700 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246d3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 -- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 msgr2=0x246d3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246d3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 -- 172.21.15.81:0/2246716870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 msgr2=0x246d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 -- 172.21.15.81:0/2246716870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x244e0f10 con 0x246891e0 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc838c00700 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246891e0 0x246ceaf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc828011e00 tx=0x7fc828014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92377c19a88d4d65 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc825200700 1 -- 172.21.15.81:0/2246716870 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828011e30 con 0x246891e0 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc825200700 1 -- 172.21.15.81:0/2246716870 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc828015bb0 con 0x246891e0 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.206+0000 7fc825200700 1 -- 172.21.15.81:0/2246716870 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828021440 con 0x246891e0 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246891e0 msgr2=0x246ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246891e0 0x246ceaf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc828011e00 tx=0x7fc828014000 comp rx=0 tx=0).stop 2024-09-13T18:54:09.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- 172.21.15.81:0/2246716870 shutdown_connections 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246d3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2246716870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246891e0 0x246ceaf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- 172.21.15.81:0/2246716870 >> 172.21.15.81:0/2246716870 conn(0x244157b0 msgr2=0x246afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- 172.21.15.81:0/2246716870 shutdown_connections 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- 172.21.15.81:0/2246716870 wait complete. 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- start start 2024-09-13T18:54:09.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 Processor -- start 2024-09-13T18:54:09.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x246ac520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246895c0 0x246aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246876e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x245b1950 con 0x246891e0 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x245b15f0 con 0x246895c0 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24583e40 con 0x246d1580 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc83ea65740 10 client.0 _ll_register_callbacks cb 0x245e7c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc838c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x246ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc838c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x246ac520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33816/0 (socket says 172.21.15.81:33816) 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc838c00700 1 -- 172.21.15.81:0/4136388389 learned_addr learned my addr 172.21.15.81:0/4136388389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc839600700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246876e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.210+0000 7fc833e00700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246895c0 0x246aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc838c00700 1 -- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 msgr2=0x246876e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc838c00700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246876e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc838c00700 1 -- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246895c0 msgr2=0x246aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc838c00700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246895c0 0x246aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc838c00700 1 -- 172.21.15.81:0/4136388389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc828011ae0 con 0x246891e0 2024-09-13T18:54:09.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc838c00700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x246ac520 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc828023040 tx=0x7fc828004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbba04bcf470203 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:09.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 1 -- 172.21.15.81:0/4136388389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828006bf0 con 0x246891e0 2024-09-13T18:54:09.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 1 -- 172.21.15.81:0/4136388389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fc828015d20 con 0x246891e0 2024-09-13T18:54:09.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x244224c0 con 0x246891e0 2024-09-13T18:54:09.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 1 -- 172.21.15.81:0/4136388389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8280219f0 con 0x246891e0 2024-09-13T18:54:09.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 10 client.8457 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:09.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x245b4630 con 0x246891e0 2024-09-13T18:54:09.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 1 -- 172.21.15.81:0/4136388389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x244224c0 con 0x246891e0 2024-09-13T18:54:09.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 1 -- 172.21.15.81:0/4136388389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc828032070 con 0x246891e0 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 10 client.8457 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 10 client.8457 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 20 client.8457 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x246844d0 0x246848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 4 client.8457 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2446c740 con 0x246844d0 2024-09-13T18:54:09.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc833e00700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x246844d0 0x246848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc833e00700 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x246844d0 0x246848b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b289d45323809d51 server_cookie=fef326341ed9c054 in_seq=0 out_seq=0 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.214+0000 7fc819600700 10 client.8457 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc819600700 1 -- 172.21.15.81:0/4136388389 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2446c740 con 0x246844d0 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc819600700 10 client.8457 handle_command_reply: tid=0 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 client.8457 shutdown 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 msgr2=0x246ac520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x246ac520 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fc828023040 tx=0x7fc828004770 comp rx=0 tx=0).stop 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 shutdown_connections 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x246844d0 0x246848b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246d1580 0x246876e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246895c0 0x246aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 --2- 172.21.15.81:0/4136388389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x246ac520 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 >> 172.21.15.81:0/4136388389 conn(0x244157b0 msgr2=0x246cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc819600700 0 client.8457 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 shutdown_connections 2024-09-13T18:54:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 1 -- 172.21.15.81:0/4136388389 wait complete. 2024-09-13T18:54:09.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.218+0000 7fc83ea65740 20 client.8457 trim_cache size 0 max 16384 2024-09-13T18:54:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 Processor -- start 2024-09-13T18:54:09.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 -- start start 2024-09-13T18:54:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246891e0 0x246d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x24684df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x245ed2d0 con 0x246895c0 2024-09-13T18:54:09.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x245ebdc0 con 0x246d1580 2024-09-13T18:54:09.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2458c5d0 con 0x246891e0 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246848b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33820/0 (socket says 172.21.15.81:33820) 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 -- 172.21.15.81:0/701959938 learned_addr learned my addr 172.21.15.81:0/701959938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc839600700 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x24684df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc838c00700 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246891e0 0x246d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 -- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246891e0 msgr2=0x246d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246891e0 0x246d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 -- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 msgr2=0x24684df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x24684df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 -- 172.21.15.81:0/701959938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2459a860 con 0x246895c0 2024-09-13T18:54:09.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc833e00700 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246848b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x246d2b70 tx=0x7fc820009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa1b00721d283d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc825c00700 1 -- 172.21.15.81:0/701959938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82001db70 con 0x246895c0 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc825c00700 1 -- 172.21.15.81:0/701959938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82001c040 con 0x246895c0 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.238+0000 7fc825c00700 1 -- 172.21.15.81:0/701959938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc820005110 con 0x246895c0 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- 172.21.15.81:0/701959938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 msgr2=0x246848b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246848b0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x246d2b70 tx=0x7fc820009040 comp rx=0 tx=0).stop 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- 172.21.15.81:0/701959938 shutdown_connections 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x24684df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246895c0 0x246848b0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- 172.21.15.81:0/701959938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246891e0 0x246d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- 172.21.15.81:0/701959938 >> 172.21.15.81:0/701959938 conn(0x244157b0 msgr2=0x246ac6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- 172.21.15.81:0/701959938 shutdown_connections 2024-09-13T18:54:09.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- 172.21.15.81:0/701959938 wait complete. 2024-09-13T18:54:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- start start 2024-09-13T18:54:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 Processor -- start 2024-09-13T18:54:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x2472ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246895c0 0x2472f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x246837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x245a8040 con 0x246891e0 2024-09-13T18:54:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x245e9da0 con 0x246d1580 2024-09-13T18:54:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x246eda30 con 0x246895c0 2024-09-13T18:54:09.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc83ea65740 10 client.0 _ll_register_callbacks cb 0x245ed180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x2472ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x2472ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33826/0 (socket says 172.21.15.81:33826) 2024-09-13T18:54:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 -- 172.21.15.81:0/2931079451 learned_addr learned my addr 172.21.15.81:0/2931079451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc839600700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x246837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 -- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246895c0 msgr2=0x2472f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc833e00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246895c0 0x2472f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246895c0 0x2472f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 -- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 msgr2=0x246837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x246837b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc838c00700 1 -- 172.21.15.81:0/2931079451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340d1620 con 0x246891e0 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc839600700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x246837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.242+0000 7fc833e00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246895c0 0x2472f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc838c00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x2472ed80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc828004790 tx=0x7fc828017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f181884498303b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 1 -- 172.21.15.81:0/2931079451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828021e70 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 1 -- 172.21.15.81:0/2931079451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fc82803e470 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24687ab0 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 1 -- 172.21.15.81:0/2931079451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc82803e630 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 10 client.8463 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x24460c40 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 1 -- 172.21.15.81:0/2931079451 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24687ab0 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 1 -- 172.21.15.81:0/2931079451 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc828015720 con 0x246891e0 2024-09-13T18:54:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 10 client.8463 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 10 client.8463 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 20 client.8463 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x24683cf0 0x246d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 4 client.8463 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x7fc828015bb0 con 0x24683cf0 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc833e00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x24683cf0 0x246d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc819600700 10 client.8463 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.246+0000 7fc833e00700 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x24683cf0 0x246d4be0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89eb5a014d18e04d server_cookie=4de493bbfbad3ed7 in_seq=0 out_seq=0 2024-09-13T18:54:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc819600700 1 -- 172.21.15.81:0/2931079451 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7fc828015bb0 con 0x24683cf0 2024-09-13T18:54:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc819600700 10 client.8463 handle_command_reply: tid=0 2024-09-13T18:54:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 client.8463 shutdown 2024-09-13T18:54:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 msgr2=0x2472ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x2472ed80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc828004790 tx=0x7fc828017000 comp rx=0 tx=0).stop 2024-09-13T18:54:09.259 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fe889200700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1) n(v3 rc2024-09-13T18:53:51.822636+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8259 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55a179fc0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.822636+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:53:51.822636+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 shutdown_connections 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x24683cf0 0x246d4be0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x246d1580 0x246837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x246895c0 0x2472f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 --2- 172.21.15.81:0/2931079451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x246891e0 0x2472ed80 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 >> 172.21.15.81:0/2931079451 conn(0x244157b0 msgr2=0x246cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc819600700 0 client.8463 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 shutdown_connections 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 1 -- 172.21.15.81:0/2931079451 wait complete. 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83ea65740 20 client.8463 trim_cache size 0 max 16384 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-13T18:54:09.261 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:09.262 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc071400700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1) n(v2 rc2024-09-13T18:53:51.822636+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8259 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x556fb49bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.822636+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:53:51.822636+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc814066730 msgr2=0x7fc814068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc814066730 0x7fc814068bf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc828009c70 tx=0x7fc828008040 comp rx=0 tx=0).stop 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 msgr2=0x7fc8340cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 0x7fc8340cbe30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc82c014040 tx=0x7fc82c004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 shutdown_connections 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc814066730 0x7fc814068bf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc83415cd50 0x7fc8340cbe30 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8340d3810 0x7fc83415f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 --2- 172.21.15.81:0/1760854097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8340ce7d0 0x7fc8341546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 >> 172.21.15.81:0/1760854097 conn(0x7fc8340d2cf0 msgr2=0x7fc8340ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 shutdown_connections 2024-09-13T18:54:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fc83a000700 1 -- 172.21.15.81:0/1760854097 wait complete. 2024-09-13T18:54:09.264 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:54:09.250+0000 7fe890a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1) n(v4 rc2024-09-13T18:53:51.822636+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={8259=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55a179fc0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.822636+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:53:51.822636+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:54:09.264 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:54:09.254+0000 7fc078c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1) n(v1 rc2024-09-13T18:53:51.822636+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={8259=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x556fb4a56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.554641+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:53:51.822636+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:54:09.264 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:54:09.257+0000 7f3cf5200700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1) n(v0 rc2024-09-13T18:53:51.554641+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8259 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55cf13a14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.554641+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:53:51.554641+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:54:09.265 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:54:09.257+0000 7f3cf5200700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/AsLsXsFsx@2},l=8259 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55cf13a15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:54:09.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub pause 2024-09-13T18:54:09.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.450+0000 7f5323200700 1 Processor -- start 2024-09-13T18:54:09.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.450+0000 7f5323200700 1 -- start start 2024-09-13T18:54:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5323200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f531c06c5a0 0x7f531c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5323200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c980 0x7f531c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5323200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f531c0b2540 0x7f531c0b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5323200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c0b4680 con 0x7f531c06c5a0 2024-09-13T18:54:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5323200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531c0b4960 con 0x7f531c0b2540 2024-09-13T18:54:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5323200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0cf030 con 0x7f531c06c980 2024-09-13T18:54:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5321e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f531c06c5a0 0x7f531c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5321e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f531c06c5a0 0x7f531c15aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33840/0 (socket says 172.21.15.81:33840) 2024-09-13T18:54:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5321e00700 1 -- 172.21.15.81:0/1507430002 learned_addr learned my addr 172.21.15.81:0/1507430002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5321400700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c980 0x7f531c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.454+0000 7f5322800700 1 --2- 172.21.15.81:0/1507430002 >> v2:172.21.15.178:3300/0 conn(0x7f531c0b2540 0x7f531c0b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321e00700 1 -- 172.21.15.81:0/1507430002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c980 msgr2=0x7f531c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321e00700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c980 0x7f531c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321e00700 1 -- 172.21.15.81:0/1507430002 >> v2:172.21.15.178:3300/0 conn(0x7f531c0b2540 msgr2=0x7f531c0b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321e00700 1 --2- 172.21.15.81:0/1507430002 >> v2:172.21.15.178:3300/0 conn(0x7f531c0b2540 0x7f531c0b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321e00700 1 -- 172.21.15.81:0/1507430002 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0cf310 con 0x7f531c06c5a0 2024-09-13T18:54:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5322800700 1 --2- 172.21.15.81:0/1507430002 >> v2:172.21.15.178:3300/0 conn(0x7f531c0b2540 0x7f531c0b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321400700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c980 0x7f531c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5321e00700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c5a0 0x7f531c15aa90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f531c06d160 tx=0x7f5310009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef9f7afc600c8a6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5320a00700 1 -- 172.21.15.81:0/1507430002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000b8a0 con 0x7f531c06c5a0 2024-09-13T18:54:09.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5320a00700 1 -- 172.21.15.81:0/1507430002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531000ba00 con 0x7f531c06c5a0 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5320a00700 1 -- 172.21.15.81:0/1507430002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531000bd90 con 0x7f531c06c5a0 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 -- 172.21.15.81:0/1507430002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c5a0 msgr2=0x7f531c15aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c5a0 0x7f531c15aa90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f531c06d160 tx=0x7f5310009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 -- 172.21.15.81:0/1507430002 shutdown_connections 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 --2- 172.21.15.81:0/1507430002 >> v2:172.21.15.178:3300/0 conn(0x7f531c0b2540 0x7f531c0b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c980 0x7f531c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 --2- 172.21.15.81:0/1507430002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c5a0 0x7f531c15aa90 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 -- 172.21.15.81:0/1507430002 >> 172.21.15.81:0/1507430002 conn(0x7f531c071d20 msgr2=0x7f531c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 -- 172.21.15.81:0/1507430002 shutdown_connections 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.458+0000 7f5323200700 1 -- 172.21.15.81:0/1507430002 wait complete. 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 Processor -- start 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 -- start start 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c5a0 0x7f531c151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 0x7f531c06b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f531c0b2540 0x7f531c154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c06a4c0 con 0x7f531c06c980 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c06a7a0 con 0x7f531c0b2540 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5323200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c06aa80 con 0x7f531c06c5a0 2024-09-13T18:54:09.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 0x7f531c06b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 0x7f531c06b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33856/0 (socket says 172.21.15.81:33856) 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 -- 172.21.15.81:0/1223298970 learned_addr learned my addr 172.21.15.81:0/1223298970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5322800700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f531c0b2540 0x7f531c154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321e00700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c5a0 0x7f531c151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 -- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c5a0 msgr2=0x7f531c151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c5a0 0x7f531c151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 -- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f531c0b2540 msgr2=0x7f531c154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f531c0b2540 0x7f531c154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321400700 1 -- 172.21.15.81:0/1223298970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310009570 con 0x7f531c06c980 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5322800700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f531c0b2540 0x7f531c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.462+0000 7f5321e00700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c5a0 0x7f531c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5321400700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 0x7f531c06b560 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f530c00d800 tx=0x7f530c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5316000700 1 -- 172.21.15.81:0/1223298970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c004030 con 0x7f531c06c980 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5316000700 1 -- 172.21.15.81:0/1223298970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c004190 con 0x7f531c06c980 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531c06ad60 con 0x7f531c06c980 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5316000700 1 -- 172.21.15.81:0/1223298970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c004540 con 0x7f531c06c980 2024-09-13T18:54:09.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c1f32b0 con 0x7f531c06c980 2024-09-13T18:54:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.466+0000 7f5316000700 1 -- 172.21.15.81:0/1223298970 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f530c0036c0 con 0x7f531c06c980 2024-09-13T18:54:09.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5316000700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5300066730 0x7f5300068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5316000700 1 -- 172.21.15.81:0/1223298970 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f530c0849f0 con 0x7f531c06c980 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5321e00700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5300066730 0x7f5300068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 Processor -- start 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 -- start start 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5321e00700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5300066730 0x7f5300068bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d5b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d5b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d5b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d4e3dd0 con 0x2d5b5810 2024-09-13T18:54:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d4e1560 con 0x2d5b49b0 2024-09-13T18:54:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2d4dce50 con 0x2d59a440 2024-09-13T18:54:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5322800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d5b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5322800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d5b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33872/0 (socket says 172.21.15.81:33872) 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5322800700 1 -- 172.21.15.81:0/2938753426 learned_addr learned my addr 172.21.15.81:0/2938753426 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.470+0000 7f5321e00700 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d5b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5321400700 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d5b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5322800700 1 -- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 msgr2=0x2d5b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5322800700 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d5b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5322800700 1 -- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 msgr2=0x2d5b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5322800700 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d5b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5322800700 1 -- 172.21.15.81:0/2938753426 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2d34fa00 con 0x2d5b5810 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5322800700 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d5b5bf0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5318009c70 tx=0x7f5318009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1ac67ef3531b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f530a600700 1 -- 172.21.15.81:0/2938753426 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318004940 con 0x2d5b5810 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f530a600700 1 -- 172.21.15.81:0/2938753426 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531800f050 con 0x2d5b5810 2024-09-13T18:54:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f530a600700 1 -- 172.21.15.81:0/2938753426 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318014650 con 0x2d5b5810 2024-09-13T18:54:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 -- 172.21.15.81:0/2938753426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 msgr2=0x2d5b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d5b5bf0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5318009c70 tx=0x7f5318009f80 comp rx=0 tx=0).stop 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 -- 172.21.15.81:0/2938753426 shutdown_connections 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d5b5bf0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d5b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2938753426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d5b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 -- 172.21.15.81:0/2938753426 >> 172.21.15.81:0/2938753426 conn(0x2d304570 msgr2=0x2d59d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 -- 172.21.15.81:0/2938753426 shutdown_connections 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 -- 172.21.15.81:0/2938753426 wait complete. 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.474+0000 7f5327c4c740 1 -- start start 2024-09-13T18:54:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 Processor -- start 2024-09-13T18:54:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d598f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d59dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b5810 0x2d59e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d49a760 con 0x2d5b49b0 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d4a05e0 con 0x2d5b5810 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2d388b40 con 0x2d59a440 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5327c4c740 10 client.0 _ll_register_callbacks cb 0x2d4a1b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5321400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d59dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5321400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d59dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33874/0 (socket says 172.21.15.81:33874) 2024-09-13T18:54:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.478+0000 7f5321400700 1 -- 172.21.15.81:0/557583735 learned_addr learned my addr 172.21.15.81:0/557583735 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321e00700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d598f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5322800700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b5810 0x2d59e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321400700 1 -- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 msgr2=0x2d598f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321400700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d598f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321400700 1 -- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b5810 msgr2=0x2d59e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321400700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b5810 0x2d59e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321400700 1 -- 172.21.15.81:0/557583735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5318009840 con 0x2d5b49b0 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321e00700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d598f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5322800700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b5810 0x2d59e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321400700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d59dd40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f530c0554d0 tx=0x7f530c055880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e2182c23bb869b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 1 -- 172.21.15.81:0/557583735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c055a30 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 1 -- 172.21.15.81:0/557583735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f530c055b90 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2d311280 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 1 -- 172.21.15.81:0/557583735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f530c054cc0 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 10 client.8475 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x2d4a3250 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 1 -- 172.21.15.81:0/557583735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2d311280 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 1 -- 172.21.15.81:0/557583735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f530c05d730 con 0x2d5b49b0 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 10 client.8475 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 10 client.8475 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 20 client.8475 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5cc650 0x2d5cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 4 client.8475 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2d35b500 con 0x2d5cc650 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321e00700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5cc650 0x2d5cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5321e00700 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5cc650 0x2d5cea40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11db8583fec77820 server_cookie=31b218d600316622 in_seq=0 out_seq=0 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 10 client.8475 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 1 -- 172.21.15.81:0/557583735 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2d35b500 con 0x2d5cc650 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f52fea00700 10 client.8475 handle_command_reply: tid=0 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.482+0000 7f5327c4c740 1 client.8475 shutdown 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 msgr2=0x2d59dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d59dd40 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f530c0554d0 tx=0x7f530c055880 comp rx=0 tx=0).stop 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 shutdown_connections 2024-09-13T18:54:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5cc650 0x2d5cea40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b5810 0x2d59e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d59dd40 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 --2- 172.21.15.81:0/557583735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d598f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f52fea00700 0 client.8475 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 >> 172.21.15.81:0/557583735 conn(0x2d304570 msgr2=0x2d5b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 shutdown_connections 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 1 -- 172.21.15.81:0/557583735 wait complete. 2024-09-13T18:54:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.486+0000 7f5327c4c740 20 client.8475 trim_cache size 0 max 16384 2024-09-13T18:54:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 Processor -- start 2024-09-13T18:54:09.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 -- start start 2024-09-13T18:54:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d617aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d617fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d597720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d467780 con 0x2d5b5810 2024-09-13T18:54:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d50bf10 con 0x2d5b49b0 2024-09-13T18:54:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2d4a7520 con 0x2d59a440 2024-09-13T18:54:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5322800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d597720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5322800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d597720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33878/0 (socket says 172.21.15.81:33878) 2024-09-13T18:54:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.506+0000 7f5322800700 1 -- 172.21.15.81:0/2628894476 learned_addr learned my addr 172.21.15.81:0/2628894476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5321400700 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d617fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5321e00700 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d617aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5322800700 1 -- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 msgr2=0x2d617aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5322800700 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d617aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5322800700 1 -- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 msgr2=0x2d617fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5322800700 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d617fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5322800700 1 -- 172.21.15.81:0/2628894476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2d489480 con 0x2d5b5810 2024-09-13T18:54:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5322800700 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d597720 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5318000f80 tx=0x7f531800d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b7b7298bd8e930 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f530b000700 1 -- 172.21.15.81:0/2628894476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318022070 con 0x2d5b5810 2024-09-13T18:54:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f530b000700 1 -- 172.21.15.81:0/2628894476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5318003a40 con 0x2d5b5810 2024-09-13T18:54:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f530b000700 1 -- 172.21.15.81:0/2628894476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5318004980 con 0x2d5b5810 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 -- 172.21.15.81:0/2628894476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 msgr2=0x2d597720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d597720 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5318000f80 tx=0x7f531800d000 comp rx=0 tx=0).stop 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 -- 172.21.15.81:0/2628894476 shutdown_connections 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b5810 0x2d597720 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d5b49b0 0x2d617fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 --2- 172.21.15.81:0/2628894476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d59a440 0x2d617aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 -- 172.21.15.81:0/2628894476 >> 172.21.15.81:0/2628894476 conn(0x2d304570 msgr2=0x2d575f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 -- 172.21.15.81:0/2628894476 shutdown_connections 2024-09-13T18:54:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.510+0000 7f5327c4c740 1 -- 172.21.15.81:0/2628894476 wait complete. 2024-09-13T18:54:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 -- start start 2024-09-13T18:54:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 Processor -- start 2024-09-13T18:54:09.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d59a440 0x2d573b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d5d84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d5b5810 0x2d5d8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d4a7330 con 0x2d5b49b0 2024-09-13T18:54:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2d48c410 con 0x2d59a440 2024-09-13T18:54:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2d617330 con 0x2d5b5810 2024-09-13T18:54:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5327c4c740 10 client.0 _ll_register_callbacks cb 0x2d483670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d5d84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d5d84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33894/0 (socket says 172.21.15.81:33894) 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 -- 172.21.15.81:0/1046810617 learned_addr learned my addr 172.21.15.81:0/1046810617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321e00700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d59a440 0x2d573b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5322800700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d5b5810 0x2d5d8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 -- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d5b5810 msgr2=0x2d5d8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d5b5810 0x2d5d8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 -- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d59a440 msgr2=0x2d573b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d59a440 0x2d573b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 -- 172.21.15.81:0/1046810617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2d34fa00 con 0x2d5b49b0 2024-09-13T18:54:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321e00700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d59a440 0x2d573b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f5321400700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d5d84c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f530c053b20 tx=0x7f530c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c600281c509547ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.514+0000 7f52fea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 1 -- 172.21.15.81:0/1046810617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c059600 con 0x2d5b49b0 2024-09-13T18:54:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 1 -- 172.21.15.81:0/1046810617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f530c051900 con 0x2d5b49b0 2024-09-13T18:54:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f531800f050 con 0x2d5b49b0 2024-09-13T18:54:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 1 -- 172.21.15.81:0/1046810617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f530c055a30 con 0x2d5b49b0 2024-09-13T18:54:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 10 client.8481 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x2d47d750 con 0x2d5b49b0 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 1 -- 172.21.15.81:0/1046810617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531800f050 con 0x2d5b49b0 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 1 -- 172.21.15.81:0/1046810617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f530c079030 con 0x2d5b49b0 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 10 client.8481 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 10 client.8481 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 20 client.8481 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5740a0 0x2d5d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 4 client.8481 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x2d380280 con 0x2d5740a0 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5321e00700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5740a0 0x2d5d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 10 client.8481 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5321e00700 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5740a0 0x2d5d8f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6371e88808ef4fc server_cookie=8fe56496facab7cb in_seq=0 out_seq=0 2024-09-13T18:54:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 1 -- 172.21.15.81:0/1046810617 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x2d380280 con 0x2d5740a0 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 10 client.8481 handle_command_reply: tid=0 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 client.8481 shutdown 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 msgr2=0x2d5d84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d5d84c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f530c053b20 tx=0x7f530c014000 comp rx=0 tx=0).stop 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 shutdown_connections 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x2d5740a0 0x2d5d8f40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2d5b5810 0x2d5d8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f52fea00700 0 client.8481 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2d5b49b0 0x2d5d84c0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 --2- 172.21.15.81:0/1046810617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2d59a440 0x2d573b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 >> 172.21.15.81:0/1046810617 conn(0x2d304570 msgr2=0x2d5767b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 shutdown_connections 2024-09-13T18:54:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.518+0000 7f5327c4c740 1 -- 172.21.15.81:0/1046810617 wait complete. 2024-09-13T18:54:09.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5327c4c740 20 client.8481 trim_cache size 0 max 16384 2024-09-13T18:54:09.532 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:09.532 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:54:09.532 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5300066730 msgr2=0x7f5300068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5300066730 0x7f5300068bf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5310000c00 tx=0x7f5310008030 comp rx=0 tx=0).stop 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 msgr2=0x7f531c06b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 0x7f531c06b560 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f530c00d800 tx=0x7f530c00dbc0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 shutdown_connections 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5300066730 0x7f5300068bf0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f531c0b2540 0x7f531c154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f531c06c980 0x7f531c06b560 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 --2- 172.21.15.81:0/1223298970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f531c06c5a0 0x7f531c151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 >> 172.21.15.81:0/1223298970 conn(0x7f531c071d20 msgr2=0x7f531c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 shutdown_connections 2024-09-13T18:54:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.522+0000 7f5323200700 1 -- 172.21.15.81:0/1223298970 wait complete. 2024-09-13T18:54:09.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 scrub status 2024-09-13T18:54:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.722+0000 7f407d200700 1 Processor -- start 2024-09-13T18:54:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.722+0000 7f407d200700 1 -- start start 2024-09-13T18:54:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f407806d760 0x7f40780b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4078144710 0x7f40780b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407806bcf0 con 0x7f4078144330 2024-09-13T18:54:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40780cce10 con 0x7f407806d760 2024-09-13T18:54:09.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407806cb50 con 0x7f4078144710 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f407806d760 0x7f40780b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f407806d760 0x7f40780b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33904/0 (socket says 172.21.15.81:33904) 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 -- 172.21.15.81:0/770867326 learned_addr learned my addr 172.21.15.81:0/770867326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4076800700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4078144710 0x7f40780b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 -- 172.21.15.81:0/770867326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4078144710 msgr2=0x7f40780b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4078144710 0x7f40780b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 -- 172.21.15.81:0/770867326 >> v1:172.21.15.178:6789/0 conn(0x7f4078144330 legacy=0x7f40780cef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 -- 172.21.15.81:0/770867326 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407806bf40 con 0x7f407806d760 2024-09-13T18:54:09.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4076800700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4078144710 0x7f40780b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4075400700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f407806d760 0x7f40780b35a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4064009910 tx=0x7f4064009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcf3e40dec4fcb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4074a00700 1 -- 172.21.15.81:0/770867326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400ba60 con 0x7f407806d760 2024-09-13T18:54:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4074a00700 1 -- 172.21.15.81:0/770867326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400bbc0 con 0x7f407806d760 2024-09-13T18:54:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f4074a00700 1 -- 172.21.15.81:0/770867326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064009e60 con 0x7f407806d760 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- 172.21.15.81:0/770867326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f407806d760 msgr2=0x7f40780b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f407806d760 0x7f40780b35a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4064009910 tx=0x7f4064009c20 comp rx=0 tx=0).stop 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- 172.21.15.81:0/770867326 shutdown_connections 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4078144710 0x7f40780b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 --2- 172.21.15.81:0/770867326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f407806d760 0x7f40780b35a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- 172.21.15.81:0/770867326 >> 172.21.15.81:0/770867326 conn(0x7f407806a570 msgr2=0x7f407806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- 172.21.15.81:0/770867326 shutdown_connections 2024-09-13T18:54:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.726+0000 7f407d200700 1 -- 172.21.15.81:0/770867326 wait complete. 2024-09-13T18:54:09.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.730+0000 7f407d200700 1 Processor -- start 2024-09-13T18:54:09.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.730+0000 7f407d200700 1 -- start start 2024-09-13T18:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407806d760 0x7f40781f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 0x7f40780b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40780b0610 0x7f40781541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40780b0ac0 con 0x7f4078144330 2024-09-13T18:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078152920 con 0x7f40780b0610 2024-09-13T18:54:09.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40780afed0 con 0x7f407806d760 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 0x7f40780b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 0x7f40780b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33918/0 (socket says 172.21.15.81:33918) 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 -- 172.21.15.81:0/3170219293 learned_addr learned my addr 172.21.15.81:0/3170219293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075e00700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407806d760 0x7f40781f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4076800700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40780b0610 0x7f40781541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 -- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407806d760 msgr2=0x7f40781f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407806d760 0x7f40781f0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 -- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40780b0610 msgr2=0x7f40781541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40780b0610 0x7f40781541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 -- 172.21.15.81:0/3170219293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4064009570 con 0x7f4078144330 2024-09-13T18:54:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f4075400700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 0x7f40780b00d0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4064013000 tx=0x7f4064004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f406e000700 1 -- 172.21.15.81:0/3170219293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064004510 con 0x7f4078144330 2024-09-13T18:54:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f406e000700 1 -- 172.21.15.81:0/3170219293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406401f070 con 0x7f4078144330 2024-09-13T18:54:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4078152010 con 0x7f4078144330 2024-09-13T18:54:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.734+0000 7f406e000700 1 -- 172.21.15.81:0/3170219293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064003900 con 0x7f4078144330 2024-09-13T18:54:09.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.738+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40781522d0 con 0x7f4078144330 2024-09-13T18:54:09.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.738+0000 7f406e000700 1 -- 172.21.15.81:0/3170219293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4064003a60 con 0x7f4078144330 2024-09-13T18:54:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.742+0000 7f406e000700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4058066730 0x7f4058068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.742+0000 7f406e000700 1 -- 172.21.15.81:0/3170219293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4064021070 con 0x7f4078144330 2024-09-13T18:54:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.742+0000 7f4075e00700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4058066730 0x7f4058068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.742+0000 7f4075e00700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4058066730 0x7f4058068bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4068000f60 tx=0x7f4068009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.742+0000 7f40805a6740 1 Processor -- start 2024-09-13T18:54:09.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- start start 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x20fe7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21008d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fbc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20f50010 con 0x21009270 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20eddf40 con 0x20fe6d00 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20f30e30 con 0x21008950 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fbc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fbc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33934/0 (socket says 172.21.15.81:33934) 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 -- 172.21.15.81:0/2382802327 learned_addr learned my addr 172.21.15.81:0/2382802327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4075e00700 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x20fe7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4075400700 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21008d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 -- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 msgr2=0x20fe7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x20fe7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 -- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 msgr2=0x21008d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21008d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 -- 172.21.15.81:0/2382802327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20d9ca40 con 0x21009270 2024-09-13T18:54:09.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4075400700 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21008d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4076800700 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fbc5d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4070009ad0 tx=0x7f4070009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91468ed0197c18af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4062a00700 1 -- 172.21.15.81:0/2382802327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700048e0 con 0x21009270 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4062a00700 1 -- 172.21.15.81:0/2382802327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407000f050 con 0x21009270 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f4062a00700 1 -- 172.21.15.81:0/2382802327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070014650 con 0x21009270 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- 172.21.15.81:0/2382802327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 msgr2=0x20fbc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fbc5d0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f4070009ad0 tx=0x7f4070009de0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- 172.21.15.81:0/2382802327 shutdown_connections 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fbc5d0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21008d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 --2- 172.21.15.81:0/2382802327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x20fe7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- 172.21.15.81:0/2382802327 >> 172.21.15.81:0/2382802327 conn(0x20d515b0 msgr2=0x20fc29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- 172.21.15.81:0/2382802327 shutdown_connections 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.746+0000 7f40805a6740 1 -- 172.21.15.81:0/2382802327 wait complete. 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 -- start start 2024-09-13T18:54:09.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 Processor -- start 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20fe6d00 0x21015790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21008950 0x21006f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fe6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20f2c150 con 0x21009270 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20f29eb0 con 0x21008950 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20ee78e0 con 0x20fe6d00 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 10 client.0 _ll_register_callbacks cb 0x20ec6670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fe6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fe6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33940/0 (socket says 172.21.15.81:33940) 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 -- 172.21.15.81:0/1044274034 learned_addr learned my addr 172.21.15.81:0/1044274034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4075e00700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20fe6d00 0x21015790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4075400700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21008950 0x21006f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 -- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20fe6d00 msgr2=0x21015790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20fe6d00 0x21015790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 -- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21008950 msgr2=0x21006f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21008950 0x21006f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 -- 172.21.15.81:0/1044274034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4070009790 con 0x21009270 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4075400700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21008950 0x21006f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4076800700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fe6070 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f407000afd0 tx=0x7f4070004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f83e7173b6245af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4057400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4057400700 1 -- 172.21.15.81:0/1044274034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070009470 con 0x21009270 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x20d5e2c0 con 0x21009270 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.750+0000 7f4057400700 1 -- 172.21.15.81:0/1044274034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4070014b30 con 0x21009270 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4057400700 1 -- 172.21.15.81:0/1044274034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4070014cf0 con 0x21009270 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 10 client.8493 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:09.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x20ef0290 con 0x21009270 2024-09-13T18:54:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4057400700 1 -- 172.21.15.81:0/1044274034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x20d5e2c0 con 0x21009270 2024-09-13T18:54:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4057400700 1 -- 172.21.15.81:0/1044274034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f4070026410 con 0x21009270 2024-09-13T18:54:09.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 10 client.8493 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 10 client.8493 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 20 client.8493 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210074b0 0x210137d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 4 client.8493 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x20da8540 con 0x210074b0 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4075e00700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210074b0 0x210137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4057400700 10 client.8493 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:09.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4075e00700 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210074b0 0x210137d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9defca3d5c0c5d9 server_cookie=bcfaa36ae216505 in_seq=0 out_seq=0 2024-09-13T18:54:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4057400700 1 -- 172.21.15.81:0/1044274034 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x20da8540 con 0x210074b0 2024-09-13T18:54:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f4057400700 10 client.8493 handle_command_reply: tid=0 2024-09-13T18:54:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 client.8493 shutdown 2024-09-13T18:54:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 msgr2=0x20fe6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fe6070 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f407000afd0 tx=0x7f4070004b60 comp rx=0 tx=0).stop 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 shutdown_connections 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.754+0000 7f40805a6740 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210074b0 0x210137d0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x20fe6070 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21008950 0x21006f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 1 --2- 172.21.15.81:0/1044274034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20fe6d00 0x21015790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f4057400700 0 client.8493 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 >> 172.21.15.81:0/1044274034 conn(0x20d515b0 msgr2=0x20fbddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 shutdown_connections 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 1 -- 172.21.15.81:0/1044274034 wait complete. 2024-09-13T18:54:09.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.758+0000 7f40805a6740 20 client.8493 trim_cache size 0 max 16384 2024-09-13T18:54:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 Processor -- start 2024-09-13T18:54:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 -- start start 2024-09-13T18:54:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x20fef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 0x21064e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21009270 0x210653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20dd5b80 con 0x21008950 2024-09-13T18:54:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20f276c0 con 0x20fe6d00 2024-09-13T18:54:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20ec8620 con 0x21009270 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 0x21064e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 0x21064e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33946/0 (socket says 172.21.15.81:33946) 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 -- 172.21.15.81:0/830743639 learned_addr learned my addr 172.21.15.81:0/830743639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075e00700 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x20fef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4076800700 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21009270 0x210653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 -- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21009270 msgr2=0x210653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21009270 0x210653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 -- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 msgr2=0x20fef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x20fef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 -- 172.21.15.81:0/830743639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20ed64c0 con 0x21008950 2024-09-13T18:54:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4075400700 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 0x21064e70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f406405e850 tx=0x7f406402feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b1dab40a56081b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4063400700 1 -- 172.21.15.81:0/830743639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064056990 con 0x21008950 2024-09-13T18:54:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4063400700 1 -- 172.21.15.81:0/830743639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406405a7c0 con 0x21008950 2024-09-13T18:54:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.782+0000 7f4063400700 1 -- 172.21.15.81:0/830743639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406405ed80 con 0x21008950 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- 172.21.15.81:0/830743639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 msgr2=0x21064e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 0x21064e70 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f406405e850 tx=0x7f406402feb0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- 172.21.15.81:0/830743639 shutdown_connections 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21009270 0x210653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21008950 0x21064e70 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- 172.21.15.81:0/830743639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x20fef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- 172.21.15.81:0/830743639 >> 172.21.15.81:0/830743639 conn(0x20d515b0 msgr2=0x20fe5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- 172.21.15.81:0/830743639 shutdown_connections 2024-09-13T18:54:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- 172.21.15.81:0/830743639 wait complete. 2024-09-13T18:54:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- start start 2024-09-13T18:54:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 Processor -- start 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21066060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x210665a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x21072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x20eb3a50 con 0x21009270 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20efac00 con 0x20fe6d00 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21023430 con 0x21008950 2024-09-13T18:54:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.786+0000 7f40805a6740 10 client.0 _ll_register_callbacks cb 0x20ef98f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x21072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x21072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33952/0 (socket says 172.21.15.81:33952) 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 -- 172.21.15.81:0/2901591811 learned_addr learned my addr 172.21.15.81:0/2901591811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4075e00700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4075400700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x210665a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 -- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 msgr2=0x210665a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x210665a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 -- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 msgr2=0x21066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21066060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 -- 172.21.15.81:0/2901591811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40781522d0 con 0x21009270 2024-09-13T18:54:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4076800700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x21072120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f4070026670 tx=0x7f4070003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ce60ae932393c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4057400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4057400700 1 -- 172.21.15.81:0/2901591811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070014d30 con 0x21009270 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4057400700 1 -- 172.21.15.81:0/2901591811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4070009410 con 0x21009270 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f407000f050 con 0x21009270 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4057400700 1 -- 172.21.15.81:0/2901591811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4070014e90 con 0x21009270 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 10 client.8499 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x20eca790 con 0x21009270 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4057400700 1 -- 172.21.15.81:0/2901591811 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407000f050 con 0x21009270 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4057400700 1 -- 172.21.15.81:0/2901591811 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f407003f070 con 0x21009270 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 10 client.8499 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 10 client.8499 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 20 client.8499 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210223b0 0x21072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 4 client.8499 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x20dcd2c0 con 0x210223b0 2024-09-13T18:54:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.790+0000 7f4075e00700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210223b0 0x21072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f4075e00700 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210223b0 0x21072660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c60ce435588471f5 server_cookie=dfa1ef19822ce166 in_seq=0 out_seq=0 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f4057400700 10 client.8499 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f4057400700 1 -- 172.21.15.81:0/2901591811 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x20dcd2c0 con 0x210223b0 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f4057400700 10 client.8499 handle_command_reply: tid=0 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 client.8499 shutdown 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 msgr2=0x21072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x21072120 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f4070026670 tx=0x7f4070003c30 comp rx=0 tx=0).stop 2024-09-13T18:54:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 shutdown_connections 2024-09-13T18:54:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x210223b0 0x21072660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x21009270 0x21072120 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f4057400700 0 client.8499 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21008950 0x210665a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 --2- 172.21.15.81:0/2901591811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20fe6d00 0x21066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 >> 172.21.15.81:0/2901591811 conn(0x20d515b0 msgr2=0x21015160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 shutdown_connections 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 1 -- 172.21.15.81:0/2901591811 wait complete. 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f40805a6740 20 client.8499 trim_cache size 0 max 16384 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:54:09.805 INFO:teuthology.orchestra.run.smithi081.stdout: "044c02c8-eb41-4dc3-8bfc-c50acb7b1630": { 2024-09-13T18:54:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:54:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:54:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:09.806 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:09.806 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4058066730 msgr2=0x7f4058068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4058066730 0x7f4058068bf0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4068000f60 tx=0x7f4068009040 comp rx=0 tx=0).stop 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 msgr2=0x7f40780b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 0x7f40780b00d0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4064013000 tx=0x7f4064004770 comp rx=0 tx=0).stop 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 shutdown_connections 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4058066730 0x7f4058068bf0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40780b0610 0x7f40781541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4078144330 0x7f40780b00d0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 --2- 172.21.15.81:0/3170219293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407806d760 0x7f40781f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 >> 172.21.15.81:0/3170219293 conn(0x7f407806a570 msgr2=0x7f407806a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 shutdown_connections 2024-09-13T18:54:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.794+0000 7f407d200700 1 -- 172.21.15.81:0/3170219293 wait complete. 2024-09-13T18:54:09.829 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:54:09.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 scrub status 2024-09-13T18:54:10.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.990+0000 7f00ffe00700 1 Processor -- start 2024-09-13T18:54:10.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.990+0000 7f00ffe00700 1 -- start start 2024-09-13T18:54:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00ffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f010006cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00ffe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01000cd2a0 con 0x7f0100159920 2024-09-13T18:54:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00ffe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010006d2c0 con 0x7f01000cd730 2024-09-13T18:54:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00ffe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01000ccc90 con 0x7f010006c960 2024-09-13T18:54:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00fea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0100159920 0x7f01000b2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52426/0 (socket says 172.21.15.81:52426) 2024-09-13T18:54:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00fea00700 1 -- 172.21.15.81:0/43541553 learned_addr learned my addr 172.21.15.81:0/43541553 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00f6000700 1 --2- 172.21.15.81:0/43541553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f010006cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00fe000700 1 -- 172.21.15.81:0/43541553 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918321316 0 0) 0x7f01000cd2a0 con 0x7f0100159920 2024-09-13T18:54:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00fe000700 1 -- 172.21.15.81:0/43541553 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e00057e0 con 0x7f0100159920 2024-09-13T18:54:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00f6000700 1 -- 172.21.15.81:0/43541553 >> v1:172.21.15.178:6789/0 conn(0x7f01000cd730 legacy=0x7f01000cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00f6000700 1 -- 172.21.15.81:0/43541553 >> v1:172.21.15.81:6789/0 conn(0x7f0100159920 legacy=0x7f01000b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.994+0000 7f00f6000700 1 -- 172.21.15.81:0/43541553 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01000b3580 con 0x7f010006c960 2024-09-13T18:54:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00f6000700 1 --2- 172.21.15.81:0/43541553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f010006cd80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009880 tx=0x7f00e8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=725f791aea93905e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00fe000700 1 -- 172.21.15.81:0/43541553 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8011830 con 0x7f010006c960 2024-09-13T18:54:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00fe000700 1 -- 172.21.15.81:0/43541553 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8011990 con 0x7f010006c960 2024-09-13T18:54:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00fe000700 1 -- 172.21.15.81:0/43541553 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8011d20 con 0x7f010006c960 2024-09-13T18:54:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 -- 172.21.15.81:0/43541553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 msgr2=0x7f010006cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 --2- 172.21.15.81:0/43541553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f010006cd80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009880 tx=0x7f00e8009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 -- 172.21.15.81:0/43541553 shutdown_connections 2024-09-13T18:54:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 --2- 172.21.15.81:0/43541553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f010006cd80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 -- 172.21.15.81:0/43541553 >> 172.21.15.81:0/43541553 conn(0x7f010006a390 msgr2=0x7f010006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 -- 172.21.15.81:0/43541553 shutdown_connections 2024-09-13T18:54:10.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:09.998+0000 7f00ffe00700 1 -- 172.21.15.81:0/43541553 wait complete. 2024-09-13T18:54:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 Processor -- start 2024-09-13T18:54:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 -- start start 2024-09-13T18:54:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f0100149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 0x7f010014a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0100153920 0x7f01001545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001543a0 con 0x7f01000cd730 2024-09-13T18:54:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01000c7da0 con 0x7f0100153920 2024-09-13T18:54:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ffe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01000c8080 con 0x7f010006c960 2024-09-13T18:54:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 0x7f010014a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 0x7f010014a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33958/0 (socket says 172.21.15.81:33958) 2024-09-13T18:54:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 -- 172.21.15.81:0/1443595356 learned_addr learned my addr 172.21.15.81:0/1443595356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ff400700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0100153920 0x7f01001545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00fea00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f0100149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 -- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 msgr2=0x7f0100149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f0100149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 -- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0100153920 msgr2=0x7f01001545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0100153920 0x7f01001545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 -- 172.21.15.81:0/1443595356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e80094b0 con 0x7f01000cd730 2024-09-13T18:54:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00ff400700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0100153920 0x7f01001545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f6000700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 0x7f010014a6b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f00e8013040 tx=0x7f00e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.002+0000 7f00f7400700 1 -- 172.21.15.81:0/1443595356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e80038c0 con 0x7f01000cd730 2024-09-13T18:54:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.006+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01000c8360 con 0x7f01000cd730 2024-09-13T18:54:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.006+0000 7f00f7400700 1 -- 172.21.15.81:0/1443595356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8003a40 con 0x7f01000cd730 2024-09-13T18:54:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.006+0000 7f00f7400700 1 -- 172.21.15.81:0/1443595356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8003df0 con 0x7f01000cd730 2024-09-13T18:54:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.006+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010014a3f0 con 0x7f01000cd730 2024-09-13T18:54:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.006+0000 7f00f7400700 1 -- 172.21.15.81:0/1443595356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f00e801b400 con 0x7f01000cd730 2024-09-13T18:54:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00f7400700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00dc066730 0x7f00dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00f7400700 1 -- 172.21.15.81:0/1443595356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f00e8085b60 con 0x7f01000cd730 2024-09-13T18:54:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00fea00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00dc066730 0x7f00dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00fea00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00dc066730 0x7f00dc068bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f00f00011e0 tx=0x7f00f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 Processor -- start 2024-09-13T18:54:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 -- start start 2024-09-13T18:54:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14b3d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 0x14b65520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b87170 0x14b87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14ace010 con 0x14b3c310 2024-09-13T18:54:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14a5bf40 con 0x14b86d90 2024-09-13T18:54:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14aaee30 con 0x14b87170 2024-09-13T18:54:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00f6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 0x14b65520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00f6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 0x14b65520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33974/0 (socket says 172.21.15.81:33974) 2024-09-13T18:54:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00f6000700 1 -- 172.21.15.81:0/2548640571 learned_addr learned my addr 172.21.15.81:0/2548640571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00ff400700 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b87170 0x14b87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.010+0000 7f00fea00700 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14b3d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00f6000700 1 -- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b87170 msgr2=0x14b87550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00f6000700 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b87170 0x14b87550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00f6000700 1 -- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 msgr2=0x14b3d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00f6000700 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14b3d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00f6000700 1 -- 172.21.15.81:0/2548640571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1491aa40 con 0x14b3c310 2024-09-13T18:54:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00f6000700 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 0x14b65520 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f00e8052f60 tx=0x7f00e80566a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3eb0e0eaa263105 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00ef400700 1 -- 172.21.15.81:0/2548640571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e805a890 con 0x14b3c310 2024-09-13T18:54:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00ef400700 1 -- 172.21.15.81:0/2548640571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e805ee50 con 0x14b3c310 2024-09-13T18:54:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f00ef400700 1 -- 172.21.15.81:0/2548640571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8056cc0 con 0x14b3c310 2024-09-13T18:54:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 -- 172.21.15.81:0/2548640571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 msgr2=0x14b65520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 0x14b65520 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f00e8052f60 tx=0x7f00e80566a0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 -- 172.21.15.81:0/2548640571 shutdown_connections 2024-09-13T18:54:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b87170 0x14b87550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b3c310 0x14b65520 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2548640571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14b3d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 -- 172.21.15.81:0/2548640571 >> 172.21.15.81:0/2548640571 conn(0x148cf5b0 msgr2=0x14b40b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 -- 172.21.15.81:0/2548640571 shutdown_connections 2024-09-13T18:54:10.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 -- 172.21.15.81:0/2548640571 wait complete. 2024-09-13T18:54:10.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 -- start start 2024-09-13T18:54:10.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.014+0000 7f0108cd3740 1 Processor -- start 2024-09-13T18:54:10.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b86d90 0x14b67940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 0x14b67e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14aaa150 con 0x14b87170 2024-09-13T18:54:10.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14aa7eb0 con 0x14b3c310 2024-09-13T18:54:10.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14a658e0 con 0x14b86d90 2024-09-13T18:54:10.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 10 client.0 _ll_register_callbacks cb 0x14a44670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 0x14b67e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 0x14b67e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33988/0 (socket says 172.21.15.81:33988) 2024-09-13T18:54:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 -- 172.21.15.81:0/2644226576 learned_addr learned my addr 172.21.15.81:0/2644226576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00fea00700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00f6000700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b86d90 0x14b67940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 -- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b86d90 msgr2=0x14b67940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b86d90 0x14b67940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 -- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 msgr2=0x14b63af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 -- 172.21.15.81:0/2644226576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010014a3f0 con 0x14b87170 2024-09-13T18:54:10.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00ff400700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 0x14b67e80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f00f8005330 tx=0x7f00f8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa19714550798b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00e7e00700 1 -- 172.21.15.81:0/2644226576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8013570 con 0x14b87170 2024-09-13T18:54:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00e7e00700 1 -- 172.21.15.81:0/2644226576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f00f80136d0 con 0x14b87170 2024-09-13T18:54:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x148dc2c0 con 0x14b87170 2024-09-13T18:54:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00e7e00700 1 -- 172.21.15.81:0/2644226576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00f8013890 con 0x14b87170 2024-09-13T18:54:10.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 10 client.8511 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x14a6e290 con 0x14b87170 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00e7e00700 1 -- 172.21.15.81:0/2644226576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x148dc2c0 con 0x14b87170 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f00e7e00700 1 -- 172.21.15.81:0/2644226576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f00f80139f0 con 0x14b87170 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 10 client.8511 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 10 client.8511 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 20 client.8511 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b85af0 0x14b65eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 4 client.8511 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.018+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14926540 con 0x14b85af0 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f00fea00700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b85af0 0x14b65eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f00fea00700 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b85af0 0x14b65eb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93e38a1c2f74a355 server_cookie=41a8b2714e14b19c in_seq=0 out_seq=0 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f00e7e00700 10 client.8511 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f00e7e00700 1 -- 172.21.15.81:0/2644226576 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x14926540 con 0x14b85af0 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f00e7e00700 10 client.8511 handle_command_reply: tid=0 2024-09-13T18:54:10.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 client.8511 shutdown 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 msgr2=0x14b67e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 0x14b67e80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f00f8005330 tx=0x7f00f8005640 comp rx=0 tx=0).stop 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 shutdown_connections 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b85af0 0x14b65eb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b87170 0x14b67e80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b86d90 0x14b67940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2644226576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f00e7e00700 0 client.8511 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 >> 172.21.15.81:0/2644226576 conn(0x148cf5b0 msgr2=0x14b654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 shutdown_connections 2024-09-13T18:54:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 1 -- 172.21.15.81:0/2644226576 wait complete. 2024-09-13T18:54:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.022+0000 7f0108cd3740 20 client.8511 trim_cache size 0 max 16384 2024-09-13T18:54:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.042+0000 7f0108cd3740 1 Processor -- start 2024-09-13T18:54:10.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.042+0000 7f0108cd3740 1 -- start start 2024-09-13T18:54:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x148cf5b0 0x14b63220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b86d90 0x14b66510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14953b80 con 0x14b86d90 2024-09-13T18:54:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14aa56c0 con 0x14b3c310 2024-09-13T18:54:10.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14b40250 con 0x148cf5b0 2024-09-13T18:54:10.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b86d90 0x14b66510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00ff400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b86d90 0x14b66510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33992/0 (socket says 172.21.15.81:33992) 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x148cf5b0 0x14b63220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00ff400700 1 -- 172.21.15.81:0/272558001 learned_addr learned my addr 172.21.15.81:0/272558001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00f6000700 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 -- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 msgr2=0x14b63760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 -- 172.21.15.81:0/272558001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b86d90 msgr2=0x14b66510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b86d90 0x14b66510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 -- 172.21.15.81:0/272558001 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14b3cc60 con 0x148cf5b0 2024-09-13T18:54:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00fea00700 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x148cf5b0 0x14b63220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x14b66480 tx=0x7f00f0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c816d3f78537eef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00efe00700 1 -- 172.21.15.81:0/272558001 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0025070 con 0x148cf5b0 2024-09-13T18:54:10.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00efe00700 1 -- 172.21.15.81:0/272558001 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f00251d0 con 0x148cf5b0 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f00efe00700 1 -- 172.21.15.81:0/272558001 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0025360 con 0x148cf5b0 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 -- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x148cf5b0 msgr2=0x14b63220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x148cf5b0 0x14b63220 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x14b66480 tx=0x7f00f0012000 comp rx=0 tx=0).stop 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 -- 172.21.15.81:0/272558001 shutdown_connections 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x14b86d90 0x14b66510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b3c310 0x14b63760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.046+0000 7f0108cd3740 1 --2- 172.21.15.81:0/272558001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x148cf5b0 0x14b63220 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- 172.21.15.81:0/272558001 >> 172.21.15.81:0/272558001 conn(0x14b40f10 msgr2=0x14b967e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- 172.21.15.81:0/272558001 shutdown_connections 2024-09-13T18:54:10.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- 172.21.15.81:0/272558001 wait complete. 2024-09-13T18:54:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- start start 2024-09-13T18:54:10.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 Processor -- start 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 0x14be82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b3c310 0x14be8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14be93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14a78c00 con 0x148cf5b0 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14a46620 con 0x14b86d90 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14a31a50 con 0x14b3c310 2024-09-13T18:54:10.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f0108cd3740 10 client.0 _ll_register_callbacks cb 0x14aa6610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:10.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f00fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 0x14be82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f00fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 0x14be82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34008/0 (socket says 172.21.15.81:34008) 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f00fea00700 1 -- 172.21.15.81:0/2973003386 learned_addr learned my addr 172.21.15.81:0/2973003386 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f00f6000700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b3c310 0x14be8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.050+0000 7f00ff400700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14be93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00fea00700 1 -- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b3c310 msgr2=0x14be8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00fea00700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b3c310 0x14be8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00fea00700 1 -- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 msgr2=0x14be93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00fea00700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14be93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00fea00700 1 -- 172.21.15.81:0/2973003386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f001d040 con 0x148cf5b0 2024-09-13T18:54:10.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00ff400700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14be93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:10.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00fea00700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 0x14be82b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f00f0007040 tx=0x7f00f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff1bd09ef9ff78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 1 -- 172.21.15.81:0/2973003386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0005c60 con 0x148cf5b0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 1 -- 172.21.15.81:0/2973003386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f00f0025550 con 0x148cf5b0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00e805ee50 con 0x148cf5b0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 1 -- 172.21.15.81:0/2973003386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00f0025710 con 0x148cf5b0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 10 client.8517 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x14a544c0 con 0x148cf5b0 2024-09-13T18:54:10.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 1 -- 172.21.15.81:0/2973003386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e805ee50 con 0x148cf5b0 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 1 -- 172.21.15.81:0/2973003386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f00f0004890 con 0x148cf5b0 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 10 client.8517 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 10 client.8517 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 20 client.8517 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b87170 0x14be9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 4 client.8517 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1494b2c0 con 0x14b87170 2024-09-13T18:54:10.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00f6000700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b87170 0x14be9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00e7e00700 10 client.8517 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.054+0000 7f00f6000700 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b87170 0x14be9900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=695b373b21a2dc5e server_cookie=e1b645238414e06c in_seq=0 out_seq=0 2024-09-13T18:54:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00e7e00700 1 -- 172.21.15.81:0/2973003386 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x1494b2c0 con 0x14b87170 2024-09-13T18:54:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00e7e00700 10 client.8517 handle_command_reply: tid=0 2024-09-13T18:54:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 client.8517 shutdown 2024-09-13T18:54:10.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 msgr2=0x14be82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 0x14be82b0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f00f0007040 tx=0x7f00f0000ed0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 shutdown_connections 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x14b87170 0x14be9900 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14b86d90 0x14be93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14b3c310 0x14be8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 --2- 172.21.15.81:0/2973003386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x148cf5b0 0x14be82b0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 >> 172.21.15.81:0/2973003386 conn(0x14b40f10 msgr2=0x14b67fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00e7e00700 0 client.8517 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 shutdown_connections 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 1 -- 172.21.15.81:0/2973003386 wait complete. 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f0108cd3740 20 client.8517 trim_cache size 0 max 16384 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:54:10.071 INFO:teuthology.orchestra.run.smithi081.stdout: "044c02c8-eb41-4dc3-8bfc-c50acb7b1630": { 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00dc066730 msgr2=0x7f00dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00dc066730 0x7f00dc068bf0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f00f00011e0 tx=0x7f00f0009040 comp rx=0 tx=0).stop 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 msgr2=0x7f010014a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 0x7f010014a6b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f00e8013040 tx=0x7f00e8004770 comp rx=0 tx=0).stop 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 shutdown_connections 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f00dc066730 0x7f00dc068bf0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0100153920 0x7f01001545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01000cd730 0x7f010014a6b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 --2- 172.21.15.81:0/1443595356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f010006c960 0x7f0100149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 >> 172.21.15.81:0/1443595356 conn(0x7f010006a390 msgr2=0x7f0100156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 shutdown_connections 2024-09-13T18:54:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.058+0000 7f00ffe00700 1 -- 172.21.15.81:0/1443595356 wait complete. 2024-09-13T18:54:10.092 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:54:10.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-13T18:54:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.262+0000 7ff32be00700 1 Processor -- start 2024-09-13T18:54:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.262+0000 7ff32be00700 1 -- start start 2024-09-13T18:54:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c1657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0b1980 con 0x7ff32c06d620 2024-09-13T18:54:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0b2500 con 0x7ff32c143b70 2024-09-13T18:54:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0b1bd0 con 0x7ff32c06d070 2024-09-13T18:54:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32a000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff32c06d620 0x7ff32c06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52442/0 (socket says 172.21.15.81:52442) 2024-09-13T18:54:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32a000700 1 -- 172.21.15.81:0/2165075360 learned_addr learned my addr 172.21.15.81:0/2165075360 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32b400700 1 --2- 172.21.15.81:0/2165075360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c1657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32b400700 1 -- 172.21.15.81:0/2165075360 >> v1:172.21.15.178:6789/0 conn(0x7ff32c143b70 legacy=0x7ff32c0cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32b400700 1 -- 172.21.15.81:0/2165075360 >> v1:172.21.15.81:6789/0 conn(0x7ff32c06d620 legacy=0x7ff32c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32b400700 1 -- 172.21.15.81:0/2165075360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0b1eb0 con 0x7ff32c06d070 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff329600700 1 -- 172.21.15.81:0/2165075360 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188934419 0 0) 0x7ff32c0b1980 con 0x7ff32c06d620 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff32b400700 1 --2- 172.21.15.81:0/2165075360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c1657b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff324009dc0 tx=0x7ff32400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f8efa73a97ed817 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff329600700 1 -- 172.21.15.81:0/2165075360 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32400e070 con 0x7ff32c06d070 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff329600700 1 -- 172.21.15.81:0/2165075360 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32400bbd0 con 0x7ff32c06d070 2024-09-13T18:54:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.266+0000 7ff329600700 1 -- 172.21.15.81:0/2165075360 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324012430 con 0x7ff32c06d070 2024-09-13T18:54:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 -- 172.21.15.81:0/2165075360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 msgr2=0x7ff32c1657b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 --2- 172.21.15.81:0/2165075360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c1657b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff324009dc0 tx=0x7ff32400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 -- 172.21.15.81:0/2165075360 shutdown_connections 2024-09-13T18:54:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 --2- 172.21.15.81:0/2165075360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c1657b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 -- 172.21.15.81:0/2165075360 >> 172.21.15.81:0/2165075360 conn(0x7ff32c06a390 msgr2=0x7ff32c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 -- 172.21.15.81:0/2165075360 shutdown_connections 2024-09-13T18:54:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 -- 172.21.15.81:0/2165075360 wait complete. 2024-09-13T18:54:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 Processor -- start 2024-09-13T18:54:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.270+0000 7ff32be00700 1 -- start start 2024-09-13T18:54:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c06d620 0x7ff32c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 0x7ff32c0a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0aa760 con 0x7ff32c143b70 2024-09-13T18:54:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0aa150 con 0x7ff32c06d620 2024-09-13T18:54:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c13cd80 con 0x7ff32c06d070 2024-09-13T18:54:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 0x7ff32c0a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 0x7ff32c0a89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34024/0 (socket says 172.21.15.81:34024) 2024-09-13T18:54:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 -- 172.21.15.81:0/3559817108 learned_addr learned my addr 172.21.15.81:0/3559817108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32a000700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c06d620 0x7ff32c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32aa00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 -- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 msgr2=0x7ff32c15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 -- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c06d620 msgr2=0x7ff32c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c06d620 0x7ff32c0a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 -- 172.21.15.81:0/3559817108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009a70 con 0x7ff32c143b70 2024-09-13T18:54:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32b400700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 0x7ff32c0a89c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff324014040 tx=0x7ff324004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff322a00700 1 -- 172.21.15.81:0/3559817108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32401b810 con 0x7ff32c143b70 2024-09-13T18:54:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff322a00700 1 -- 172.21.15.81:0/3559817108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff324020070 con 0x7ff32c143b70 2024-09-13T18:54:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c0aa3f0 con 0x7ff32c143b70 2024-09-13T18:54:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff322a00700 1 -- 172.21.15.81:0/3559817108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32401bbd0 con 0x7ff32c143b70 2024-09-13T18:54:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.274+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c13d060 con 0x7ff32c143b70 2024-09-13T18:54:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.278+0000 7ff322a00700 1 -- 172.21.15.81:0/3559817108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff32401bd30 con 0x7ff32c143b70 2024-09-13T18:54:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.278+0000 7ff322a00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff30c066730 0x7ff30c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff322a00700 1 -- 172.21.15.81:0/3559817108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff324022070 con 0x7ff32c143b70 2024-09-13T18:54:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff32aa00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff30c066730 0x7ff30c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff32aa00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff30c066730 0x7ff30c068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff32c13b960 tx=0x7ff31c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 Processor -- start 2024-09-13T18:54:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 -- start start 2024-09-13T18:54:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b3e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 0x7b1f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7af49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7a84010 con 0x7b3e6c0 2024-09-13T18:54:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7a11f40 con 0x7b1b420 2024-09-13T18:54:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.282+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7a64e30 con 0x7b1b800 2024-09-13T18:54:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 0x7b1f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 0x7b1f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34038/0 (socket says 172.21.15.81:34038) 2024-09-13T18:54:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 -- 172.21.15.81:0/1592491985 learned_addr learned my addr 172.21.15.81:0/1592491985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32aa00700 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b3e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32b400700 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7af49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 -- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 msgr2=0x7af49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7af49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 -- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 msgr2=0x7b3e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b3e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 -- 172.21.15.81:0/1592491985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x78d0a40 con 0x7b3e6c0 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff32a000700 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 0x7b1f210 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ff318004ec0 tx=0x7ff318007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1306a411e5e3ca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff317400700 1 -- 172.21.15.81:0/1592491985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318001560 con 0x7b3e6c0 2024-09-13T18:54:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff317400700 1 -- 172.21.15.81:0/1592491985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3180016c0 con 0x7b3e6c0 2024-09-13T18:54:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff317400700 1 -- 172.21.15.81:0/1592491985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318001a30 con 0x7b3e6c0 2024-09-13T18:54:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 -- 172.21.15.81:0/1592491985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 msgr2=0x7b1f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 0x7b1f210 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ff318004ec0 tx=0x7ff318007340 comp rx=0 tx=0).stop 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 -- 172.21.15.81:0/1592491985 shutdown_connections 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7af49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b3e6c0 0x7b1f210 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 --2- 172.21.15.81:0/1592491985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b3e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 -- 172.21.15.81:0/1592491985 >> 172.21.15.81:0/1592491985 conn(0x78855b0 msgr2=0x7af6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 -- 172.21.15.81:0/1592491985 shutdown_connections 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 -- 172.21.15.81:0/1592491985 wait complete. 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 -- start start 2024-09-13T18:54:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.286+0000 7ff334f50740 1 Processor -- start 2024-09-13T18:54:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b1e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b4a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b3e6c0 0x7b19aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7a60150 con 0x7b1b420 2024-09-13T18:54:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7a5deb0 con 0x7b3e6c0 2024-09-13T18:54:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7a1b8e0 con 0x7b1b800 2024-09-13T18:54:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 10 client.0 _ll_register_callbacks cb 0x79fa670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b1e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b1e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34044/0 (socket says 172.21.15.81:34044) 2024-09-13T18:54:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 -- 172.21.15.81:0/1853020265 learned_addr learned my addr 172.21.15.81:0/1853020265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32b400700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b3e6c0 0x7b19aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32a000700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b4a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 -- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 msgr2=0x7b4a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b4a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 -- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b3e6c0 msgr2=0x7b19aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b3e6c0 0x7b19aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 -- 172.21.15.81:0/1853020265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff318004b70 con 0x7b1b420 2024-09-13T18:54:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32b400700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b3e6c0 0x7b19aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32aa00700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b1e6b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7ff31c010010 tx=0x7ff31c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e2a70444ff6221 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff30be00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff30be00700 1 -- 172.21.15.81:0/1853020265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c014c50 con 0x7b1b420 2024-09-13T18:54:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff30be00700 1 -- 172.21.15.81:0/1853020265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff31c01c040 con 0x7b1b420 2024-09-13T18:54:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x78922c0 con 0x7b1b420 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff30be00700 1 -- 172.21.15.81:0/1853020265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff31c014db0 con 0x7b1b420 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 10 client.8529 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x7a24290 con 0x7b1b420 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff30be00700 1 -- 172.21.15.81:0/1853020265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x78922c0 con 0x7b1b420 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff30be00700 1 -- 172.21.15.81:0/1853020265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff31c02a3f0 con 0x7b1b420 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 10 client.8529 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 10 client.8529 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 20 client.8529 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b1beb0 0x7b1c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 4 client.8529 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x78dc540 con 0x7b1beb0 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.290+0000 7ff32a000700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b1beb0 0x7b1c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff32a000700 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b1beb0 0x7b1c2c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f26980920f4decb server_cookie=20361cb00052ff37 in_seq=0 out_seq=0 2024-09-13T18:54:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff30be00700 10 client.8529 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff30be00700 1 -- 172.21.15.81:0/1853020265 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x78dc540 con 0x7b1beb0 2024-09-13T18:54:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff30be00700 10 client.8529 handle_command_reply: tid=0 2024-09-13T18:54:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 client.8529 shutdown 2024-09-13T18:54:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 msgr2=0x7b1e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b1e6b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7ff31c010010 tx=0x7ff31c001080 comp rx=0 tx=0).stop 2024-09-13T18:54:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 shutdown_connections 2024-09-13T18:54:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b1beb0 0x7b1c2c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b3e6c0 0x7b19aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b4a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 --2- 172.21.15.81:0/1853020265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b1e6b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff30be00700 0 client.8529 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 >> 172.21.15.81:0/1853020265 conn(0x78855b0 msgr2=0x7b3dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 shutdown_connections 2024-09-13T18:54:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 1 -- 172.21.15.81:0/1853020265 wait complete. 2024-09-13T18:54:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.294+0000 7ff334f50740 20 client.8529 trim_cache size 0 max 16384 2024-09-13T18:54:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.314+0000 7ff334f50740 1 Processor -- start 2024-09-13T18:54:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.314+0000 7ff334f50740 1 -- start start 2024-09-13T18:54:10.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x78855b0 0x7b59020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b19630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7909b80 con 0x7b1b420 2024-09-13T18:54:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7a2ec00 con 0x78855b0 2024-09-13T18:54:10.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7a61720 con 0x7b1b800 2024-09-13T18:54:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b190f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34060/0 (socket says 172.21.15.81:34060) 2024-09-13T18:54:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 -- 172.21.15.81:0/171827897 learned_addr learned my addr 172.21.15.81:0/171827897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32aa00700 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x78855b0 0x7b59020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32b400700 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b19630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 -- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 msgr2=0x7b19630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b19630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 -- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x78855b0 msgr2=0x7b59020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x78855b0 0x7b59020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 -- 172.21.15.81:0/171827897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7a0a4c0 con 0x7b1b420 2024-09-13T18:54:10.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff32a000700 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b190f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff318004e60 tx=0x7ff31800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bb2c2703b40873 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff317e00700 1 -- 172.21.15.81:0/171827897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318007a80 con 0x7b1b420 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff317e00700 1 -- 172.21.15.81:0/171827897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800b040 con 0x7b1b420 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff317e00700 1 -- 172.21.15.81:0/171827897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318004890 con 0x7b1b420 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- 172.21.15.81:0/171827897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 msgr2=0x7b190f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b190f0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff318004e60 tx=0x7ff31800c000 comp rx=0 tx=0).stop 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- 172.21.15.81:0/171827897 shutdown_connections 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7b1b800 0x7b19630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b420 0x7b190f0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 --2- 172.21.15.81:0/171827897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x78855b0 0x7b59020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- 172.21.15.81:0/171827897 >> 172.21.15.81:0/171827897 conn(0x7af6f10 msgr2=0x7b189e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- 172.21.15.81:0/171827897 shutdown_connections 2024-09-13T18:54:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.318+0000 7ff334f50740 1 -- 172.21.15.81:0/171827897 wait complete. 2024-09-13T18:54:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 -- start start 2024-09-13T18:54:10.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 Processor -- start 2024-09-13T18:54:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x78855b0 0x7b586e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b57b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 0x7ba2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7b491f0 con 0x7b1b800 2024-09-13T18:54:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7b1de40 con 0x7b1b420 2024-09-13T18:54:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7b49420 con 0x78855b0 2024-09-13T18:54:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.322+0000 7ff334f50740 10 client.0 _ll_register_callbacks cb 0x7a5c610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 0x7ba2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 0x7ba2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34076/0 (socket says 172.21.15.81:34076) 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 -- 172.21.15.81:0/2021100053 learned_addr learned my addr 172.21.15.81:0/2021100053 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32aa00700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x78855b0 0x7b586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32a000700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b57b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 -- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x78855b0 msgr2=0x7b586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x78855b0 0x7b586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 -- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 msgr2=0x7b57b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b57b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 -- 172.21.15.81:0/2021100053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x78d0a40 con 0x7b1b800 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32a000700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b57b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32b400700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 0x7ba2050 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff324009d90 tx=0x7ff32405d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3269a429a18b6781 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 1 -- 172.21.15.81:0/2021100053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324057240 con 0x7b1b800 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 1 -- 172.21.15.81:0/2021100053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff32405b070 con 0x7b1b800 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3180016c0 con 0x7b1b800 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 1 -- 172.21.15.81:0/2021100053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff32405f630 con 0x7b1b800 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 10 client.8535 fetch_fsmap learned FSMap version 94 2024-09-13T18:54:10.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) v3 -- 0x79fe790 con 0x7b1b800 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 1 -- 172.21.15.81:0/2021100053 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3180016c0 con 0x7b1b800 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 1 -- 172.21.15.81:0/2021100053 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 94) v1 ==== 3154+0+0 (secure 0 0 0) 0x7ff324084260 con 0x7b1b800 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 10 client.8535 fetch_fsmap finished waiting for FSMap version 94 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 10 client.8535 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 20 client.8535 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b3e6c0 0x7ba2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 4 client.8535 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x79012c0 con 0x7b3e6c0 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32aa00700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b3e6c0 0x7ba2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff32aa00700 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b3e6c0 0x7ba2590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2bb58a9888a6a5 server_cookie=a4030c64f83bf99f in_seq=0 out_seq=0 2024-09-13T18:54:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.326+0000 7ff30be00700 10 client.8535 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff30be00700 1 -- 172.21.15.81:0/2021100053 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x79012c0 con 0x7b3e6c0 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff30be00700 10 client.8535 handle_command_reply: tid=0 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 client.8535 shutdown 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 msgr2=0x7ba2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 0x7ba2050 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff324009d90 tx=0x7ff32405d040 comp rx=0 tx=0).stop 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 shutdown_connections 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x7b3e6c0 0x7ba2590 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7b1b800 0x7ba2050 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7b1b420 0x7b57b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 --2- 172.21.15.81:0/2021100053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x78855b0 0x7b586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 >> 172.21.15.81:0/2021100053 conn(0x7af6f10 msgr2=0x7b485d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff30be00700 0 client.8535 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 shutdown_connections 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 1 -- 172.21.15.81:0/2021100053 wait complete. 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff334f50740 20 client.8535 trim_cache size 0 max 16384 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stdout: "044c02c8-eb41-4dc3-8bfc-c50acb7b1630": { 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:54:10.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:10.347 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:54:10.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:10.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:10.347 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:10.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff30c066730 msgr2=0x7ff30c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff30c066730 0x7ff30c068bf0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff32c13b960 tx=0x7ff31c009040 comp rx=0 tx=0).stop 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 msgr2=0x7ff32c0a89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 0x7ff32c0a89c0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff324014040 tx=0x7ff324004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 shutdown_connections 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff30c066730 0x7ff30c068bf0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff32c143b70 0x7ff32c0a89c0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff32c06d620 0x7ff32c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 --2- 172.21.15.81:0/3559817108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff32c06d070 0x7ff32c15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 >> 172.21.15.81:0/3559817108 conn(0x7ff32c06a390 msgr2=0x7ff32c15d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 shutdown_connections 2024-09-13T18:54:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.330+0000 7ff32be00700 1 -- 172.21.15.81:0/3559817108 wait complete. 2024-09-13T18:54:10.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:54:10.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.522+0000 7f06cd600700 1 Processor -- start 2024-09-13T18:54:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.522+0000 7f06cd600700 1 -- start start 2024-09-13T18:54:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06cd600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06c80b3a70 0x7f06c80cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06cd600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 0x7f06c80d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06cd600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80b4d10 con 0x7f06c81446c0 2024-09-13T18:54:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06cd600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80b3eb0 con 0x7f06c80cc650 2024-09-13T18:54:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06cd600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c8144aa0 con 0x7f06c80b3a70 2024-09-13T18:54:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06c7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 0x7f06c80d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06c80b3a70 0x7f06c80cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06c7400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 0x7f06c80d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34090/0 (socket says 172.21.15.81:34090) 2024-09-13T18:54:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06c80b3a70 0x7f06c80cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:50652/0 (socket says 172.21.15.81:50652) 2024-09-13T18:54:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06c7400700 1 -- 172.21.15.81:0/1991891816 learned_addr learned my addr 172.21.15.81:0/1991891816 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06c6a00700 1 --1- 172.21.15.81:0/1991891816 >> v1:172.21.15.178:6789/0 conn(0x7f06c81446c0 0x7f06c80cfcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:59058/0 (socket says 172.21.15.81:59058) 2024-09-13T18:54:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 -- 172.21.15.81:0/1991891816 >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 msgr2=0x7f06c80d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 --2- 172.21.15.81:0/1991891816 >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 0x7f06c80d0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 -- 172.21.15.81:0/1991891816 >> v1:172.21.15.178:6789/0 conn(0x7f06c81446c0 legacy=0x7f06c80cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 -- 172.21.15.81:0/1991891816 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80b4100 con 0x7f06c80b3a70 2024-09-13T18:54:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06c7400700 1 --2- 172.21.15.81:0/1991891816 >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 0x7f06c80d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.526+0000 7f06bfe00700 1 --2- 172.21.15.81:0/1991891816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c80b3a70 0x7f06c80cc110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f06c815e7d0 tx=0x7f06b0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2abeb001ef5b276 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06c6000700 1 -- 172.21.15.81:0/1991891816 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011830 con 0x7f06c80b3a70 2024-09-13T18:54:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06c6000700 1 -- 172.21.15.81:0/1991891816 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0011990 con 0x7f06c80b3a70 2024-09-13T18:54:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06c6000700 1 -- 172.21.15.81:0/1991891816 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0011d20 con 0x7f06c80b3a70 2024-09-13T18:54:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 -- 172.21.15.81:0/1991891816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c80b3a70 msgr2=0x7f06c80cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 --2- 172.21.15.81:0/1991891816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c80b3a70 0x7f06c80cc110 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f06c815e7d0 tx=0x7f06b0009b30 comp rx=0 tx=0).stop 2024-09-13T18:54:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 -- 172.21.15.81:0/1991891816 shutdown_connections 2024-09-13T18:54:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 --2- 172.21.15.81:0/1991891816 >> v2:172.21.15.81:3300/0 conn(0x7f06c80cc650 0x7f06c80d0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 --2- 172.21.15.81:0/1991891816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c80b3a70 0x7f06c80cc110 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 -- 172.21.15.81:0/1991891816 >> 172.21.15.81:0/1991891816 conn(0x7f06c80726d0 msgr2=0x7f06c806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 -- 172.21.15.81:0/1991891816 shutdown_connections 2024-09-13T18:54:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 -- 172.21.15.81:0/1991891816 wait complete. 2024-09-13T18:54:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.530+0000 7f06cd600700 1 Processor -- start 2024-09-13T18:54:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 -- start start 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c80b3a70 0x7f06c806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 0x7f06c81e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c81446c0 0x7f06c8140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81e72e0 con 0x7f06c80cc650 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c806ae40 con 0x7f06c81446c0 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c806b120 con 0x7f06c80b3a70 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 0x7f06c81e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 0x7f06c81e6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34092/0 (socket says 172.21.15.81:34092) 2024-09-13T18:54:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 -- 172.21.15.81:0/1235850142 learned_addr learned my addr 172.21.15.81:0/1235850142 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06c7400700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c81446c0 0x7f06c8140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06c6a00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c80b3a70 0x7f06c806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 -- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c80b3a70 msgr2=0x7f06c806bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c80b3a70 0x7f06c806bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 -- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c81446c0 msgr2=0x7f06c8140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c81446c0 0x7f06c8140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 -- 172.21.15.81:0/1235850142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0009b30 con 0x7f06c80cc650 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bfe00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 0x7f06c81e6da0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009b70 tx=0x7f06b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0004480 con 0x7f06c80cc650 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b001f070 con 0x7f06c80cc650 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b00094b0 con 0x7f06c80cc650 2024-09-13T18:54:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b00038e0 con 0x7f06c80cc650 2024-09-13T18:54:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.534+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c806b6e0 con 0x7f06c80cc650 2024-09-13T18:54:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.538+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c80d1360 con 0x7f06c80cc650 2024-09-13T18:54:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.538+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06b0021030 con 0x7f06c80cc650 2024-09-13T18:54:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.542+0000 7f06bea00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066730 0x7f06a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.542+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f06b0085690 con 0x7f06c80cc650 2024-09-13T18:54:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.542+0000 7f06c6a00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066730 0x7f06a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.542+0000 7f06c6a00700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066730 0x7f06a4068bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f06b8000f60 tx=0x7f06b8007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.550+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06b0052970 con 0x7f06c80cc650 2024-09-13T18:54:10.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.778+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06c8067730 con 0x7f06c80cc650 2024-09-13T18:54:10.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.778+0000 7f06bea00700 1 -- 172.21.15.81:0/1235850142 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4773 (secure 0 0 0) 0x7f06b0055f90 con 0x7f06c80cc650 2024-09-13T18:54:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:10.789 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:08.614954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":7,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066730 msgr2=0x7f06a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066730 0x7f06a4068bf0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f06b8000f60 tx=0x7f06b8007d30 comp rx=0 tx=0).stop 2024-09-13T18:54:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 msgr2=0x7f06c81e6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 0x7f06c81e6da0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009b70 tx=0x7f06b0004770 comp rx=0 tx=0).stop 2024-09-13T18:54:10.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 shutdown_connections 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f06a4066730 0x7f06a4068bf0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06c81446c0 0x7f06c8140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06c80cc650 0x7f06c81e6da0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 --2- 172.21.15.81:0/1235850142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06c80b3a70 0x7f06c806bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 >> 172.21.15.81:0/1235850142 conn(0x7f06c80726d0 msgr2=0x7f06c80cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 shutdown_connections 2024-09-13T18:54:10.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.782+0000 7f06cd600700 1 -- 172.21.15.81:0/1235850142 wait complete. 2024-09-13T18:54:10.794 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 94 2024-09-13T18:54:10.817 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:10.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.978+0000 7fe4ba400700 1 Processor -- start 2024-09-13T18:54:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4ba400700 1 -- start start 2024-09-13T18:54:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4ba400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b415a000 0x7fe4b40b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4ba400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4b40b1ec0 0x7fe4b4070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4ba400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b406d560 con 0x7fe4b41590a0 2024-09-13T18:54:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4ba400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b40b2310 con 0x7fe4b40b1ec0 2024-09-13T18:54:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4ba400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4159480 con 0x7fe4b415a000 2024-09-13T18:54:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.982+0000 7fe4b9a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4b40b1ec0 0x7fe4b4070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4b40b1ec0 0x7fe4b4070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34102/0 (socket says 172.21.15.81:34102) 2024-09-13T18:54:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 -- 172.21.15.81:0/4133451160 learned_addr learned my addr 172.21.15.81:0/4133451160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:10.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4abe00700 1 --2- 172.21.15.81:0/4133451160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b415a000 0x7fe4b40b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 -- 172.21.15.81:0/4133451160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b415a000 msgr2=0x7fe4b40b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 --2- 172.21.15.81:0/4133451160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b415a000 0x7fe4b40b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 -- 172.21.15.81:0/4133451160 >> v1:172.21.15.178:6789/0 conn(0x7fe4b41590a0 legacy=0x7fe4b40ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 -- 172.21.15.81:0/4133451160 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b406d840 con 0x7fe4b40b1ec0 2024-09-13T18:54:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b9a00700 1 --2- 172.21.15.81:0/4133451160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b4070f50 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00d150 tx=0x7fe4ac00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c761dc6836164b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b3e00700 1 -- 172.21.15.81:0/4133451160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac010070 con 0x7fe4b40b1ec0 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b3e00700 1 -- 172.21.15.81:0/4133451160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac00dbb0 con 0x7fe4b40b1ec0 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4b3e00700 1 -- 172.21.15.81:0/4133451160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac016400 con 0x7fe4b40b1ec0 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 -- 172.21.15.81:0/4133451160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 msgr2=0x7fe4b4070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 --2- 172.21.15.81:0/4133451160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b4070f50 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac00d150 tx=0x7fe4ac00d460 comp rx=0 tx=0).stop 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 -- 172.21.15.81:0/4133451160 shutdown_connections 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 --2- 172.21.15.81:0/4133451160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b4070f50 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 --2- 172.21.15.81:0/4133451160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b415a000 0x7fe4b40b1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 -- 172.21.15.81:0/4133451160 >> 172.21.15.81:0/4133451160 conn(0x7fe4b406a390 msgr2=0x7fe4b406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 -- 172.21.15.81:0/4133451160 shutdown_connections 2024-09-13T18:54:10.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.986+0000 7fe4ba400700 1 -- 172.21.15.81:0/4133451160 wait complete. 2024-09-13T18:54:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.990+0000 7fe4ba400700 1 Processor -- start 2024-09-13T18:54:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.990+0000 7fe4ba400700 1 -- start start 2024-09-13T18:54:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b414d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b41590a0 0x7fe4b40c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b415a000 0x7fe4b40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4152d40 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b4152990 con 0x7fe4b415a000 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b41f7c10 con 0x7fe4b41590a0 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b414d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b414d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34114/0 (socket says 172.21.15.81:34114) 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 -- 172.21.15.81:0/992072969 learned_addr learned my addr 172.21.15.81:0/992072969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9a00700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b415a000 0x7fe4b40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4abe00700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b41590a0 0x7fe4b40c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 -- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b41590a0 msgr2=0x7fe4b40c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:11.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b41590a0 0x7fe4b40c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 -- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b415a000 msgr2=0x7fe4b40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b415a000 0x7fe4b40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 -- 172.21.15.81:0/992072969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac00bd40 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4abe00700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b41590a0 0x7fe4b40c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b9000700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b414d140 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c500 tx=0x7fe4a400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40052d0 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a4005430 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40055a0 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b4152f90 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.994+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b4153550 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.998+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b40ce270 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.998+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4a40038e0 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.998+0000 7fe4b1600700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe490066730 0x7fe490068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:11.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:10.998+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fe4a4083840 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.002+0000 7fe4abe00700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe490066730 0x7fe490068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:11.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.002+0000 7fe4abe00700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe490066730 0x7fe490068bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40b2a90 tx=0x7fe49c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:11.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.006+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4a4050950 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.246+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe4b4150960 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4b1600700 1 -- 172.21.15.81:0/992072969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1338 (secure 0 0 0) 0x7fe4a4053f70 con 0x7fe4b40b1ec0 2024-09-13T18:54:11.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:11.259 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":440,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694371,"bytes_used":265797632,"bytes_avail":772828315648,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":11697,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":94,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-13T18:53:21.093715+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe490066730 msgr2=0x7fe490068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe490066730 0x7fe490068bf0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40b2a90 tx=0x7fe49c008040 comp rx=0 tx=0).stop 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 msgr2=0x7fe4b414d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b414d140 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400c500 tx=0x7fe4a400c810 comp rx=0 tx=0).stop 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 shutdown_connections 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe490066730 0x7fe490068bf0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4b415a000 0x7fe4b40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4b41590a0 0x7fe4b40c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 --2- 172.21.15.81:0/992072969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4b40b1ec0 0x7fe4b414d140 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:11.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.250+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 >> 172.21.15.81:0/992072969 conn(0x7fe4b406a390 msgr2=0x7fe4b40b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:11.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.254+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 shutdown_connections 2024-09-13T18:54:11.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:11.254+0000 7fe4ba400700 1 -- 172.21.15.81:0/992072969 wait complete. 2024-09-13T18:54:11.285 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:54:12.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:12.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 Processor -- start 2024-09-13T18:54:12.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 -- start start 2024-09-13T18:54:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11141610b0 0x7f11140719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f111406aaa0 0x7f111406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140b2670 0x7f11140b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1114070b30 con 0x7f111406aaa0 2024-09-13T18:54:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111406b450 con 0x7f11141610b0 2024-09-13T18:54:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1113200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11140b3040 con 0x7f11140b2670 2024-09-13T18:54:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.462+0000 7f1109400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f111406aaa0 0x7f111406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f111406aaa0 0x7f111406af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34122/0 (socket says 172.21.15.81:34122) 2024-09-13T18:54:12.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 -- 172.21.15.81:0/2010451890 learned_addr learned my addr 172.21.15.81:0/2010451890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:12.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1112800700 1 --2- 172.21.15.81:0/2010451890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140b2670 0x7f11140b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1111e00700 1 --2- 172.21.15.81:0/2010451890 >> v2:172.21.15.178:3300/0 conn(0x7f11141610b0 0x7f11140719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 -- 172.21.15.81:0/2010451890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140b2670 msgr2=0x7f11140b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 --2- 172.21.15.81:0/2010451890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140b2670 0x7f11140b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 -- 172.21.15.81:0/2010451890 >> v2:172.21.15.178:3300/0 conn(0x7f11141610b0 msgr2=0x7f11140719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 --2- 172.21.15.81:0/2010451890 >> v2:172.21.15.178:3300/0 conn(0x7f11141610b0 0x7f11140719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 -- 172.21.15.81:0/2010451890 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140b3560 con 0x7f111406aaa0 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1109400700 1 --2- 172.21.15.81:0/2010451890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f111406aaa0 0x7f111406af10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009940 tx=0x7f10fc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b97de1d50a64c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1111400700 1 -- 172.21.15.81:0/2010451890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc011830 con 0x7f111406aaa0 2024-09-13T18:54:12.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1111400700 1 -- 172.21.15.81:0/2010451890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc011990 con 0x7f111406aaa0 2024-09-13T18:54:12.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1111400700 1 -- 172.21.15.81:0/2010451890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc011d20 con 0x7f111406aaa0 2024-09-13T18:54:12.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 -- 172.21.15.81:0/2010451890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f111406aaa0 msgr2=0x7f111406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 --2- 172.21.15.81:0/2010451890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f111406aaa0 0x7f111406af10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009940 tx=0x7f10fc009c50 comp rx=0 tx=0).stop 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 -- 172.21.15.81:0/2010451890 shutdown_connections 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 --2- 172.21.15.81:0/2010451890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140b2670 0x7f11140b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 --2- 172.21.15.81:0/2010451890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f111406aaa0 0x7f111406af10 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 --2- 172.21.15.81:0/2010451890 >> v2:172.21.15.178:3300/0 conn(0x7f11141610b0 0x7f11140719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 -- 172.21.15.81:0/2010451890 >> 172.21.15.81:0/2010451890 conn(0x7f11140b0c40 msgr2=0x7f111406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 -- 172.21.15.81:0/2010451890 shutdown_connections 2024-09-13T18:54:12.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.466+0000 7f1113200700 1 -- 172.21.15.81:0/2010451890 wait complete. 2024-09-13T18:54:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.470+0000 7f1113200700 1 Processor -- start 2024-09-13T18:54:12.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.470+0000 7f1113200700 1 -- start start 2024-09-13T18:54:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f111406aaa0 0x7f11141624e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 0x7f1114156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11141610b0 0x7f11141568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114163c20 con 0x7f11140b2670 2024-09-13T18:54:12.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141464b0 con 0x7f111406aaa0 2024-09-13T18:54:12.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1114162fa0 con 0x7f11141610b0 2024-09-13T18:54:12.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 0x7f1114156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 0x7f1114156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34126/0 (socket says 172.21.15.81:34126) 2024-09-13T18:54:12.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 -- 172.21.15.81:0/3414183020 learned_addr learned my addr 172.21.15.81:0/3414183020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:12.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1112800700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11141610b0 0x7f11141568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1111e00700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f111406aaa0 0x7f11141624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 -- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11141610b0 msgr2=0x7f11141568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11141610b0 0x7f11141568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 -- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f111406aaa0 msgr2=0x7f11141624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f111406aaa0 0x7f11141624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 -- 172.21.15.81:0/3414183020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc009570 con 0x7f11140b2670 2024-09-13T18:54:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1111e00700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f111406aaa0 0x7f11141624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1109400700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 0x7f1114156380 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000c00 tx=0x7f10fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004510 con 0x7f11140b2670 2024-09-13T18:54:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc01e070 con 0x7f11140b2670 2024-09-13T18:54:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc003900 con 0x7f11140b2670 2024-09-13T18:54:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114163280 con 0x7f11140b2670 2024-09-13T18:54:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.474+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1114163840 con 0x7f11140b2670 2024-09-13T18:54:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.478+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1114163d60 con 0x7f11140b2670 2024-09-13T18:54:12.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.478+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10fc003a60 con 0x7f11140b2670 2024-09-13T18:54:12.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.482+0000 7f110aa00700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10f0066730 0x7f10f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.482+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f10fc084d70 con 0x7f11140b2670 2024-09-13T18:54:12.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.482+0000 7f1111e00700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10f0066730 0x7f10f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.482+0000 7f1111e00700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10f0066730 0x7f10f0068bf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1104009bc0 tx=0x7f1104008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.486+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10fc052030 con 0x7f11140b2670 2024-09-13T18:54:12.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.718+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11140673f0 con 0x7f11140b2670 2024-09-13T18:54:12.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.718+0000 7f110aa00700 1 -- 172.21.15.81:0/3414183020 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4773 (secure 0 0 0) 0x7f10fc015090 con 0x7f11140b2670 2024-09-13T18:54:12.728 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:12.728 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":94,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:08.614954+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":7,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10f0066730 msgr2=0x7f10f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10f0066730 0x7f10f0068bf0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1104009bc0 tx=0x7f1104008040 comp rx=0 tx=0).stop 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 msgr2=0x7f1114156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 0x7f1114156380 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f10fc000c00 tx=0x7f10fc004770 comp rx=0 tx=0).stop 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 shutdown_connections 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f10f0066730 0x7f10f0068bf0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11141610b0 0x7f11141568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11140b2670 0x7f1114156380 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 --2- 172.21.15.81:0/3414183020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f111406aaa0 0x7f11141624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 >> 172.21.15.81:0/3414183020 conn(0x7f11140b0c40 msgr2=0x7f11140b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 shutdown_connections 2024-09-13T18:54:12.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.722+0000 7f1113200700 1 -- 172.21.15.81:0/3414183020 wait complete. 2024-09-13T18:54:12.733 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 94 2024-09-13T18:54:12.752 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:12.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.910+0000 7f2f64200700 1 Processor -- start 2024-09-13T18:54:12.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f64200700 1 -- start start 2024-09-13T18:54:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f64200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f5c0b0b10 0x7f2f5c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f64200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c1645e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f64200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5c071030 con 0x7f2f5c0ccda0 2024-09-13T18:54:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f64200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5c06cd10 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f64200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c15bf40 con 0x7f2f5c15baf0 2024-09-13T18:54:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f5c0b0b10 0x7f2f5c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f5c0b0b10 0x7f2f5c06fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34130/0 (socket says 172.21.15.81:34130) 2024-09-13T18:54:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 -- 172.21.15.81:0/1259934315 learned_addr learned my addr 172.21.15.81:0/1259934315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:12.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f62200700 1 --2- 172.21.15.81:0/1259934315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c1645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 -- 172.21.15.81:0/1259934315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 msgr2=0x7f2f5c1645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 --2- 172.21.15.81:0/1259934315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c1645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 -- 172.21.15.81:0/1259934315 >> v1:172.21.15.178:6789/0 conn(0x7f2f5c0ccda0 legacy=0x7f2f5c0b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.914+0000 7f2f61800700 1 -- 172.21.15.81:0/1259934315 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5c0704b0 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f61800700 1 --2- 172.21.15.81:0/1259934315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c06fdb0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c06ceb0 tx=0x7f2f4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaebc5b88e5853f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:12.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f5be00700 1 -- 172.21.15.81:0/1259934315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c004230 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f5be00700 1 -- 172.21.15.81:0/1259934315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c004390 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f5be00700 1 -- 172.21.15.81:0/1259934315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c0036c0 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 -- 172.21.15.81:0/1259934315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 msgr2=0x7f2f5c06fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 --2- 172.21.15.81:0/1259934315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c06fdb0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c06ceb0 tx=0x7f2f4c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 -- 172.21.15.81:0/1259934315 shutdown_connections 2024-09-13T18:54:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 --2- 172.21.15.81:0/1259934315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c1645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 --2- 172.21.15.81:0/1259934315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c06fdb0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 -- 172.21.15.81:0/1259934315 >> 172.21.15.81:0/1259934315 conn(0x7f2f5c06a7b0 msgr2=0x7f2f5c06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 -- 172.21.15.81:0/1259934315 shutdown_connections 2024-09-13T18:54:12.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.918+0000 7f2f64200700 1 -- 172.21.15.81:0/1259934315 wait complete. 2024-09-13T18:54:12.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 Processor -- start 2024-09-13T18:54:12.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 -- start start 2024-09-13T18:54:12.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f5c0ce3f0 0x7f2f5c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c148900 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c14c1d0 con 0x7f2f5c0ce3f0 2024-09-13T18:54:12.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f64200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c14c4b0 con 0x7f2f5c15baf0 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f61800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f61800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c14bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34140/0 (socket says 172.21.15.81:34140) 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.922+0000 7f2f61800700 1 -- 172.21.15.81:0/1114421278 learned_addr learned my addr 172.21.15.81:0/1114421278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f60e00700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f62200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f5c0ce3f0 0x7f2f5c155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f61800700 1 -- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 msgr2=0x7f2f5c159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f61800700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f61800700 1 -- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f5c0ce3f0 msgr2=0x7f2f5c155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:12.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f61800700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f5c0ce3f0 0x7f2f5c155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f61800700 1 -- 172.21.15.81:0/1114421278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c009570 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f61800700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c14bb40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000c00 tx=0x7f2f4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:12.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00b8a0 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4c00ba40 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c148520 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00bdf0 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c14a450 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.926+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c06fdb0 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.930+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f4c021070 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.930+0000 7f2f59600700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2f3c066730 0x7f2f3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:12.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.930+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2f4c085ef0 con 0x7f2f5c0b0b10 2024-09-13T18:54:12.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.930+0000 7f2f60e00700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2f3c066730 0x7f2f3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:12.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.934+0000 7f2f60e00700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2f3c066730 0x7f2f3c068bf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c154550 tx=0x7f2f48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:12.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:12.938+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f4c0531b0 con 0x7f2f5c0b0b10 2024-09-13T18:54:13.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.186+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2f5c154a60 con 0x7f2f5c0b0b10 2024-09-13T18:54:13.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f59600700 1 -- 172.21.15.81:0/1114421278 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1338 (secure 0 0 0) 0x7f2f4c0567d0 con 0x7f2f5c0b0b10 2024-09-13T18:54:13.199 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:13.199 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":442,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694371,"bytes_used":265797632,"bytes_avail":772828315648,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":10597,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":94,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-13T18:53:21.093715+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:54:13.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2f3c066730 msgr2=0x7f2f3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:13.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2f3c066730 0x7f2f3c068bf0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c154550 tx=0x7f2f48009040 comp rx=0 tx=0).stop 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 msgr2=0x7f2f5c14bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c14bb40 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000c00 tx=0x7f2f4c004770 comp rx=0 tx=0).stop 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 shutdown_connections 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2f3c066730 0x7f2f3c068bf0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f5c0ce3f0 0x7f2f5c155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5c15baf0 0x7f2f5c159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 --2- 172.21.15.81:0/1114421278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f5c0b0b10 0x7f2f5c14bb40 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 >> 172.21.15.81:0/1114421278 conn(0x7f2f5c06a7b0 msgr2=0x7f2f5c1590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.190+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 shutdown_connections 2024-09-13T18:54:13.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:13.194+0000 7f2f64200700 1 -- 172.21.15.81:0/1114421278 wait complete. 2024-09-13T18:54:13.224 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:54:13.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:54:13.599 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:54:13.658 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:54:13.646+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:54:14.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:14.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 Processor -- start 2024-09-13T18:54:14.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 -- start start 2024-09-13T18:54:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0670071d20 0x7f06700b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06700cd610 0x7f067006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06700ce140 con 0x7f067006a5d0 2024-09-13T18:54:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06700cde60 con 0x7f06700cd610 2024-09-13T18:54:14.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f0675400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067006c3b0 con 0x7f0670071d20 2024-09-13T18:54:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f066e800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f067006a5d0 0x7f067006a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52444/0 (socket says 172.21.15.81:52444) 2024-09-13T18:54:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f066e800700 1 -- 172.21.15.81:0/2240261664 learned_addr learned my addr 172.21.15.81:0/2240261664 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f066de00700 1 --2- 172.21.15.81:0/2240261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0670071d20 0x7f06700b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.394+0000 7f066f200700 1 --2- 172.21.15.81:0/2240261664 >> v2:172.21.15.178:3300/0 conn(0x7f06700cd610 0x7f067006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066d400700 1 -- 172.21.15.81:0/2240261664 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053703079 0 0) 0x7f06700ce140 con 0x7f067006a5d0 2024-09-13T18:54:14.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066de00700 1 -- 172.21.15.81:0/2240261664 >> v2:172.21.15.178:3300/0 conn(0x7f06700cd610 msgr2=0x7f067006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:14.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066de00700 1 --2- 172.21.15.81:0/2240261664 >> v2:172.21.15.178:3300/0 conn(0x7f06700cd610 0x7f067006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066de00700 1 -- 172.21.15.81:0/2240261664 >> v1:172.21.15.81:6789/0 conn(0x7f067006a5d0 legacy=0x7f067006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066de00700 1 -- 172.21.15.81:0/2240261664 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067006c690 con 0x7f0670071d20 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066de00700 1 --2- 172.21.15.81:0/2240261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0670071d20 0x7f06700b19f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0658009850 tx=0x7f0658009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=785fb679c60cf0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066d400700 1 -- 172.21.15.81:0/2240261664 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658011830 con 0x7f0670071d20 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066d400700 1 -- 172.21.15.81:0/2240261664 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0658011990 con 0x7f0670071d20 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f066d400700 1 -- 172.21.15.81:0/2240261664 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658011d40 con 0x7f0670071d20 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 -- 172.21.15.81:0/2240261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0670071d20 msgr2=0x7f06700b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 --2- 172.21.15.81:0/2240261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0670071d20 0x7f06700b19f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0658009850 tx=0x7f0658009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 -- 172.21.15.81:0/2240261664 shutdown_connections 2024-09-13T18:54:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 --2- 172.21.15.81:0/2240261664 >> v2:172.21.15.178:3300/0 conn(0x7f06700cd610 0x7f067006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 --2- 172.21.15.81:0/2240261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0670071d20 0x7f06700b19f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 -- 172.21.15.81:0/2240261664 >> 172.21.15.81:0/2240261664 conn(0x7f06700b08d0 msgr2=0x7f06700b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 -- 172.21.15.81:0/2240261664 shutdown_connections 2024-09-13T18:54:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.398+0000 7f0675400700 1 -- 172.21.15.81:0/2240261664 wait complete. 2024-09-13T18:54:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 Processor -- start 2024-09-13T18:54:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 -- start start 2024-09-13T18:54:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f067006a5d0 0x7f067015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 0x7f067015dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06700cd610 0x7f0670144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067015ed40 con 0x7f0670071d20 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06701430f0 con 0x7f067006a5d0 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f0675400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06701433d0 con 0x7f06700cd610 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 0x7f067015dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 0x7f067015dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34148/0 (socket says 172.21.15.81:34148) 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 -- 172.21.15.81:0/297778706 learned_addr learned my addr 172.21.15.81:0/297778706 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066f200700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06700cd610 0x7f0670144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066e800700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f067006a5d0 0x7f067015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 -- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06700cd610 msgr2=0x7f0670144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06700cd610 0x7f0670144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 -- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f067006a5d0 msgr2=0x7f067015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f067006a5d0 0x7f067015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066de00700 1 -- 172.21.15.81:0/297778706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580094b0 con 0x7f0670071d20 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.402+0000 7f066e800700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f067006a5d0 0x7f067015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f066de00700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 0x7f067015dc40 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0658000c00 tx=0x7f0658004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065801aa10 con 0x7f0670071d20 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065801f070 con 0x7f0670071d20 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065801adb0 con 0x7f0670071d20 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067015ef90 con 0x7f0670071d20 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0670142540 con 0x7f0670071d20 2024-09-13T18:54:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06700709a0 con 0x7f0670071d20 2024-09-13T18:54:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.406+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f065801b430 con 0x7f0670071d20 2024-09-13T18:54:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.410+0000 7f0666a00700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f064c066730 0x7f064c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.410+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f06580854a0 con 0x7f0670071d20 2024-09-13T18:54:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.410+0000 7f066e800700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f064c066730 0x7f064c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.410+0000 7f066e800700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f064c066730 0x7f064c068bf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f0660007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.414+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06580525c0 con 0x7f0670071d20 2024-09-13T18:54:14.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.642+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06700680d0 con 0x7f0670071d20 2024-09-13T18:54:14.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.642+0000 7f0666a00700 1 -- 172.21.15.81:0/297778706 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4774 (secure 0 0 0) 0x7f0658055be0 con 0x7f0670071d20 2024-09-13T18:54:14.652 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:14.652 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:13.652707+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":7,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":6,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:14.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.642+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f064c066730 msgr2=0x7f064c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.642+0000 7f0675400700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f064c066730 0x7f064c068bf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f0660007cc0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.642+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 msgr2=0x7f067015dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.642+0000 7f0675400700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 0x7f067015dc40 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f0658000c00 tx=0x7f0658004770 comp rx=0 tx=0).stop 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 shutdown_connections 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f064c066730 0x7f064c068bf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06700cd610 0x7f0670144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0670071d20 0x7f067015dc40 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 --2- 172.21.15.81:0/297778706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f067006a5d0 0x7f067015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 >> 172.21.15.81:0/297778706 conn(0x7f06700b08d0 msgr2=0x7f06700ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 shutdown_connections 2024-09-13T18:54:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.646+0000 7f0675400700 1 -- 172.21.15.81:0/297778706 wait complete. 2024-09-13T18:54:14.657 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 95 2024-09-13T18:54:14.675 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:14.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.838+0000 7f6758a00700 1 Processor -- start 2024-09-13T18:54:14.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.838+0000 7f6758a00700 1 -- start start 2024-09-13T18:54:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6758a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f67541584a0 0x7f67540ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6758a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f675415ae20 0x7f675415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6758a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67540cf050 con 0x7f675406c5a0 2024-09-13T18:54:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6758a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67540b38b0 con 0x7f675415ae20 2024-09-13T18:54:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6758a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6754158880 con 0x7f67541584a0 2024-09-13T18:54:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6753e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f675406c5a0 0x7f67540b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52460/0 (socket says 172.21.15.81:52460) 2024-09-13T18:54:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6753e00700 1 -- 172.21.15.81:0/2917254934 learned_addr learned my addr 172.21.15.81:0/2917254934 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752a00700 1 --2- 172.21.15.81:0/2917254934 >> v2:172.21.15.178:3300/0 conn(0x7f675415ae20 0x7f675415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6753400700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f67541584a0 0x7f67540ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752000700 1 -- 172.21.15.81:0/2917254934 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370496996 0 0) 0x7f67540cf050 con 0x7f675406c5a0 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752000700 1 -- 172.21.15.81:0/2917254934 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67380035d0 con 0x7f675406c5a0 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752a00700 1 -- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f67541584a0 msgr2=0x7f67540ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752a00700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f67541584a0 0x7f67540ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752a00700 1 -- 172.21.15.81:0/2917254934 >> v1:172.21.15.81:6789/0 conn(0x7f675406c5a0 legacy=0x7f67540b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752a00700 1 -- 172.21.15.81:0/2917254934 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675415b930 con 0x7f675415ae20 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6753400700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f67541584a0 0x7f67540ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752a00700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f675415b260 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6740009850 tx=0x7f6740009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c786e70db8a3a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752000700 1 -- 172.21.15.81:0/2917254934 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740011830 con 0x7f675415ae20 2024-09-13T18:54:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752000700 1 -- 172.21.15.81:0/2917254934 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6740011990 con 0x7f675415ae20 2024-09-13T18:54:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.842+0000 7f6752000700 1 -- 172.21.15.81:0/2917254934 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740011d40 con 0x7f675415ae20 2024-09-13T18:54:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 -- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 msgr2=0x7f675415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f675415b260 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6740009850 tx=0x7f6740009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 -- 172.21.15.81:0/2917254934 shutdown_connections 2024-09-13T18:54:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f675415b260 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 --2- 172.21.15.81:0/2917254934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f67541584a0 0x7f67540ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 -- 172.21.15.81:0/2917254934 >> 172.21.15.81:0/2917254934 conn(0x7f67540b5fb0 msgr2=0x7f67540b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 -- 172.21.15.81:0/2917254934 shutdown_connections 2024-09-13T18:54:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 -- 172.21.15.81:0/2917254934 wait complete. 2024-09-13T18:54:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 Processor -- start 2024-09-13T18:54:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.846+0000 7f6758a00700 1 -- start start 2024-09-13T18:54:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f675406c5a0 0x7f67541509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 0x7f675413d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f67541529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67541535c0 con 0x7f67541584a0 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f675413d850 con 0x7f675415ae20 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6754152ee0 con 0x7f675406c5a0 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 0x7f675413d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 0x7f675413d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34160/0 (socket says 172.21.15.81:34160) 2024-09-13T18:54:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 -- 172.21.15.81:0/3906078942 learned_addr learned my addr 172.21.15.81:0/3906078942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6753e00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f67541529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6753400700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f675406c5a0 0x7f67541509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 -- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f675406c5a0 msgr2=0x7f67541509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f675406c5a0 0x7f67541509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 -- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 msgr2=0x7f67541529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f67541529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 -- 172.21.15.81:0/3906078942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6744009a70 con 0x7f67541584a0 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6752a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 0x7f675413d310 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f67400090b0 tx=0x7f6740004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740004520 con 0x7f67541584a0 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67400094b0 con 0x7f67541584a0 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674001f070 con 0x7f67541584a0 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740003900 con 0x7f67541584a0 2024-09-13T18:54:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.850+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6754151270 con 0x7f67541584a0 2024-09-13T18:54:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.854+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f675415b260 con 0x7f67541584a0 2024-09-13T18:54:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.854+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6740003a60 con 0x7f67541584a0 2024-09-13T18:54:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.854+0000 7f674b400700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6734066730 0x7f6734068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.854+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f6740021070 con 0x7f67541584a0 2024-09-13T18:54:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.858+0000 7f6753400700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6734066730 0x7f6734068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.858+0000 7f6753400700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6734066730 0x7f6734068bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6744007600 tx=0x7f674400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:14.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:14.862+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6740052ab0 con 0x7f67541584a0 2024-09-13T18:54:15.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.102+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f67540b5650 con 0x7f67541584a0 2024-09-13T18:54:15.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.102+0000 7f674b400700 1 -- 172.21.15.81:0/3906078942 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1455 (secure 0 0 0) 0x7f67400155c0 con 0x7f67541584a0 2024-09-13T18:54:15.114 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:15.114 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":444,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694371,"bytes_used":265797632,"bytes_avail":772828315648,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9383,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":95,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2024-09-13T18:53:21.093715+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6734066730 msgr2=0x7f6734068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6734066730 0x7f6734068bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6744007600 tx=0x7f674400b040 comp rx=0 tx=0).stop 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 msgr2=0x7f675413d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 0x7f675413d310 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f67400090b0 tx=0x7f6740004770 comp rx=0 tx=0).stop 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 shutdown_connections 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6734066730 0x7f6734068bf0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f675415ae20 0x7f67541529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:15.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67541584a0 0x7f675413d310 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:15.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 --2- 172.21.15.81:0/3906078942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f675406c5a0 0x7f67541509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:15.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 >> 172.21.15.81:0/3906078942 conn(0x7f67540b5fb0 msgr2=0x7f67540cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:15.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 shutdown_connections 2024-09-13T18:54:15.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:15.110+0000 7f6758a00700 1 -- 172.21.15.81:0/3906078942 wait complete. 2024-09-13T18:54:15.145 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:54:16.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.310+0000 7faddf200700 1 Processor -- start 2024-09-13T18:54:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.310+0000 7faddf200700 1 -- start start 2024-09-13T18:54:16.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7faddf200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7faddf200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fade00b2670 0x7fade00b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7faddf200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade00b3040 con 0x7fade01610b0 2024-09-13T18:54:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7faddf200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade0070b30 con 0x7fade00b2670 2024-09-13T18:54:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7faddf200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade00b3560 con 0x7fade006aaa0 2024-09-13T18:54:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7fadde800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fade00b2670 0x7fade00b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7fadde800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fade00b2670 0x7fade00b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34176/0 (socket says 172.21.15.81:34176) 2024-09-13T18:54:16.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7fadde800700 1 -- 172.21.15.81:0/1839107002 learned_addr learned my addr 172.21.15.81:0/1839107002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.314+0000 7fadd7e00700 1 --2- 172.21.15.81:0/1839107002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7fadde800700 1 -- 172.21.15.81:0/1839107002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 msgr2=0x7fade006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7fadde800700 1 --2- 172.21.15.81:0/1839107002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7fadde800700 1 -- 172.21.15.81:0/1839107002 >> v1:172.21.15.178:6789/0 conn(0x7fade01610b0 legacy=0x7fade00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7fadde800700 1 -- 172.21.15.81:0/1839107002 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade006b420 con 0x7fade00b2670 2024-09-13T18:54:16.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7fadde800700 1 --2- 172.21.15.81:0/1839107002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade00b2b00 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e50 tx=0x7fadd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5db85b346f90a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:16.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddd400700 1 -- 172.21.15.81:0/1839107002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800e070 con 0x7fade00b2670 2024-09-13T18:54:16.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddd400700 1 -- 172.21.15.81:0/1839107002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd800b9c0 con 0x7fade00b2670 2024-09-13T18:54:16.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddd400700 1 -- 172.21.15.81:0/1839107002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800bd70 con 0x7fade00b2670 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 -- 172.21.15.81:0/1839107002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 msgr2=0x7fade00b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 --2- 172.21.15.81:0/1839107002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade00b2b00 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009e50 tx=0x7fadd800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 -- 172.21.15.81:0/1839107002 shutdown_connections 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 --2- 172.21.15.81:0/1839107002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade00b2b00 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 --2- 172.21.15.81:0/1839107002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 -- 172.21.15.81:0/1839107002 >> 172.21.15.81:0/1839107002 conn(0x7fade00b0c40 msgr2=0x7fade006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 -- 172.21.15.81:0/1839107002 shutdown_connections 2024-09-13T18:54:16.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.318+0000 7faddf200700 1 -- 172.21.15.81:0/1839107002 wait complete. 2024-09-13T18:54:16.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 Processor -- start 2024-09-13T18:54:16.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 -- start start 2024-09-13T18:54:16.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade0159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade01f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade01610b0 0x7fade01f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01620e0 con 0x7fade00b2670 2024-09-13T18:54:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0164320 con 0x7fade01610b0 2024-09-13T18:54:16.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddf200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade0159ad0 con 0x7fade006aaa0 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade01f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade01f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34192/0 (socket says 172.21.15.81:34192) 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 -- 172.21.15.81:0/3799775212 learned_addr learned my addr 172.21.15.81:0/3799775212 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadde800700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade01610b0 0x7fade01f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7faddde00700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade0159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 -- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 msgr2=0x7fade0159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade0159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 -- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade01610b0 msgr2=0x7fade01f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade01610b0 0x7fade01f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.322+0000 7fadd7e00700 1 -- 172.21.15.81:0/3799775212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8009b30 con 0x7fade00b2670 2024-09-13T18:54:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7fadd7e00700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade01f6510 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e790 tx=0x7fadc800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800c070 con 0x7fade00b2670 2024-09-13T18:54:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc8013610 con 0x7fade00b2670 2024-09-13T18:54:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade0161740 con 0x7fade00b2670 2024-09-13T18:54:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8013980 con 0x7fade00b2670 2024-09-13T18:54:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade0161d00 con 0x7fade00b2670 2024-09-13T18:54:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade0161490 con 0x7fade00b2670 2024-09-13T18:54:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.326+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadc8013ae0 con 0x7fade00b2670 2024-09-13T18:54:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.330+0000 7fadd6000700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fadbc066730 0x7fadbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.330+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fadc8084120 con 0x7fade00b2670 2024-09-13T18:54:16.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.330+0000 7faddde00700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fadbc066730 0x7fadbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.330+0000 7faddde00700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fadbc066730 0x7fadbc068bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000f60 tx=0x7fadd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.338+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fadc80512c0 con 0x7fade00b2670 2024-09-13T18:54:16.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.562+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fade00b2af0 con 0x7fade00b2670 2024-09-13T18:54:16.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7fadd6000700 1 -- 172.21.15.81:0/3799775212 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4775 (secure 0 0 0) 0x7fadc80548e0 con 0x7fade00b2670 2024-09-13T18:54:16.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:16.575 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":96,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:15.664079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":7,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fadbc066730 msgr2=0x7fadbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fadbc066730 0x7fadbc068bf0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000f60 tx=0x7fadd0009040 comp rx=0 tx=0).stop 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 msgr2=0x7fade01f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade01f6510 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e790 tx=0x7fadc800eaa0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 shutdown_connections 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fadbc066730 0x7fadbc068bf0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fade01610b0 0x7fade01f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade00b2670 0x7fade01f6510 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 --2- 172.21.15.81:0/3799775212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fade006aaa0 0x7fade0159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 >> 172.21.15.81:0/3799775212 conn(0x7fade00b0c40 msgr2=0x7fade00af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 shutdown_connections 2024-09-13T18:54:16.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.566+0000 7faddf200700 1 -- 172.21.15.81:0/3799775212 wait complete. 2024-09-13T18:54:16.582 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 96 2024-09-13T18:54:16.599 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:16.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:16.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.754+0000 7f38c9400700 1 Processor -- start 2024-09-13T18:54:16.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.754+0000 7f38c9400700 1 -- start start 2024-09-13T18:54:16.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.758+0000 7f38c9400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38c41584a0 0x7f38c40ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.758+0000 7f38c9400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38c406ccb0 0x7f38c415b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.758+0000 7f38c9400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c40cf050 con 0x7f38c415ae20 2024-09-13T18:54:16.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.758+0000 7f38c9400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c40b38b0 con 0x7f38c406ccb0 2024-09-13T18:54:16.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.758+0000 7f38c9400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c4158880 con 0x7f38c41584a0 2024-09-13T18:54:16.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.758+0000 7f38c8a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38c406ccb0 0x7f38c415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f38c406ccb0 0x7f38c415b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50934/0 (socket says 172.21.15.81:50934) 2024-09-13T18:54:16.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38c41584a0 0x7f38c40ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c3400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f38c415ae20 0x7f38c406c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:53846/0 (socket says 172.21.15.81:53846) 2024-09-13T18:54:16.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 -- 172.21.15.81:0/2925183689 learned_addr learned my addr 172.21.15.81:0/2925183689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 -- 172.21.15.81:0/2925183689 >> v2:172.21.15.178:3300/0 conn(0x7f38c41584a0 msgr2=0x7f38c40ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 --2- 172.21.15.81:0/2925183689 >> v2:172.21.15.178:3300/0 conn(0x7f38c41584a0 0x7f38c40ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 -- 172.21.15.81:0/2925183689 >> v1:172.21.15.178:6789/0 conn(0x7f38c415ae20 legacy=0x7f38c406c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 -- 172.21.15.81:0/2925183689 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c415b930 con 0x7f38c406ccb0 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c2a00700 1 -- 172.21.15.81:0/2925183689 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285074570 0 0) 0x7f38c40cf050 con 0x7f38c415ae20 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c8a00700 1 --2- 172.21.15.81:0/2925183689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c415b290 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b6b70 tx=0x7f38bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bd97168b218e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c2a00700 1 -- 172.21.15.81:0/2925183689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00e070 con 0x7f38c406ccb0 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c2a00700 1 -- 172.21.15.81:0/2925183689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00b910 con 0x7f38c406ccb0 2024-09-13T18:54:16.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c2a00700 1 -- 172.21.15.81:0/2925183689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00bcc0 con 0x7f38c406ccb0 2024-09-13T18:54:16.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 -- 172.21.15.81:0/2925183689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 msgr2=0x7f38c415b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 --2- 172.21.15.81:0/2925183689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c415b290 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f38c40b6b70 tx=0x7f38bc00b330 comp rx=0 tx=0).stop 2024-09-13T18:54:16.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 -- 172.21.15.81:0/2925183689 shutdown_connections 2024-09-13T18:54:16.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 --2- 172.21.15.81:0/2925183689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c415b290 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 --2- 172.21.15.81:0/2925183689 >> v2:172.21.15.178:3300/0 conn(0x7f38c41584a0 0x7f38c40ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 -- 172.21.15.81:0/2925183689 >> 172.21.15.81:0/2925183689 conn(0x7f38c40b5fb0 msgr2=0x7f38c40b6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:16.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 -- 172.21.15.81:0/2925183689 shutdown_connections 2024-09-13T18:54:16.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.762+0000 7f38c9400700 1 -- 172.21.15.81:0/2925183689 wait complete. 2024-09-13T18:54:16.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.766+0000 7f38c9400700 1 Processor -- start 2024-09-13T18:54:16.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.766+0000 7f38c9400700 1 -- start start 2024-09-13T18:54:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38c41584a0 0x7f38c414e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c415ae20 0x7f38c406b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c40cb640 con 0x7f38c406ccb0 2024-09-13T18:54:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41f2fa0 con 0x7f38c415ae20 2024-09-13T18:54:16.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c41f3280 con 0x7f38c41584a0 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c40cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50942/0 (socket says 172.21.15.81:50942) 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 -- 172.21.15.81:0/3258298813 learned_addr learned my addr 172.21.15.81:0/3258298813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c8a00700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c415ae20 0x7f38c406b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38c41584a0 0x7f38c414e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 -- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38c41584a0 msgr2=0x7f38c414e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38c41584a0 0x7f38c414e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 -- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c415ae20 msgr2=0x7f38c406b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c415ae20 0x7f38c406b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 -- 172.21.15.81:0/3258298813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009b30 con 0x7f38c406ccb0 2024-09-13T18:54:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c3e00700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c40cb100 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f38b400e9d0 tx=0x7f38b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4009720 con 0x7f38c406ccb0 2024-09-13T18:54:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b400c850 con 0x7f38c406ccb0 2024-09-13T18:54:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c41f3560 con 0x7f38c406ccb0 2024-09-13T18:54:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400cbc0 con 0x7f38c406ccb0 2024-09-13T18:54:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.770+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c41f3b20 con 0x7f38c406ccb0 2024-09-13T18:54:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.774+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c414c0f0 con 0x7f38c406ccb0 2024-09-13T18:54:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.774+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38b400cd20 con 0x7f38c406ccb0 2024-09-13T18:54:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.778+0000 7f38bbe00700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38a4066730 0x7f38a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.778+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f38b40844a0 con 0x7f38c406ccb0 2024-09-13T18:54:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.778+0000 7f38c3400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38a4066730 0x7f38a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.778+0000 7f38c3400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38a4066730 0x7f38a4068bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f38c41569f0 tx=0x7f38b0007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:16.782+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38b40515b0 con 0x7f38c406ccb0 2024-09-13T18:54:17.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.038+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f38c415b290 con 0x7f38c406ccb0 2024-09-13T18:54:17.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.038+0000 7f38bbe00700 1 -- 172.21.15.81:0/3258298813 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1965 (secure 0 0 0) 0x7f38b4054bd0 con 0x7f38c406ccb0 2024-09-13T18:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:17.049 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":446,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694945,"bytes_used":265797632,"bytes_avail":772828315648,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9553,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":97,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-13T18:54:15.113083+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:54:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38a4066730 msgr2=0x7f38a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38a4066730 0x7f38a4068bf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f38c41569f0 tx=0x7f38b0007cb0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 msgr2=0x7f38c40cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c40cb100 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f38b400e9d0 tx=0x7f38b400ece0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 shutdown_connections 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f38a4066730 0x7f38a4068bf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c415ae20 0x7f38c406b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38c41584a0 0x7f38c414e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 --2- 172.21.15.81:0/3258298813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38c406ccb0 0x7f38c40cb100 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 >> 172.21.15.81:0/3258298813 conn(0x7f38c40b5fb0 msgr2=0x7f38c406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 shutdown_connections 2024-09-13T18:54:17.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.042+0000 7f38c9400700 1 -- 172.21.15.81:0/3258298813 wait complete. 2024-09-13T18:54:17.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:54:17.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub resume 2024-09-13T18:54:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.230+0000 7f12c0c00700 1 Processor -- start 2024-09-13T18:54:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12c0c00700 1 -- start start 2024-09-13T18:54:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12c0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc159920 0x7f12bc0b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12c0c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12bc0b30d0 0x7f12bc06c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12c0c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc0ce740 con 0x7f12bc06cea0 2024-09-13T18:54:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12c0c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0cd2a0 con 0x7f12bc0b30d0 2024-09-13T18:54:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12c0c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc06d2d0 con 0x7f12bc159920 2024-09-13T18:54:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.234+0000 7f12b2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12bc0b30d0 0x7f12bc06c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f12bc0b30d0 0x7f12bc06c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50950/0 (socket says 172.21.15.81:50950) 2024-09-13T18:54:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 -- 172.21.15.81:0/1837609002 learned_addr learned my addr 172.21.15.81:0/1837609002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12bb400700 1 --2- 172.21.15.81:0/1837609002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc159920 0x7f12bc0b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 -- 172.21.15.81:0/1837609002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc159920 msgr2=0x7f12bc0b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 --2- 172.21.15.81:0/1837609002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc159920 0x7f12bc0b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 -- 172.21.15.81:0/1837609002 >> v1:172.21.15.178:6789/0 conn(0x7f12bc06cea0 legacy=0x7f12bc06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12baa00700 1 -- 172.21.15.81:0/1837609002 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565103975 0 0) 0x7f12bc0ce740 con 0x7f12bc06cea0 2024-09-13T18:54:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 -- 172.21.15.81:0/1837609002 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0ccc90 con 0x7f12bc0b30d0 2024-09-13T18:54:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12b2a00700 1 --2- 172.21.15.81:0/1837609002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc0b30d0 0x7f12bc06c960 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f12a400bbb0 tx=0x7f12a400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a73cdf027dc5847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12baa00700 1 -- 172.21.15.81:0/1837609002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400dd30 con 0x7f12bc0b30d0 2024-09-13T18:54:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12baa00700 1 -- 172.21.15.81:0/1837609002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a400de90 con 0x7f12bc0b30d0 2024-09-13T18:54:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12baa00700 1 -- 172.21.15.81:0/1837609002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4010690 con 0x7f12bc0b30d0 2024-09-13T18:54:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 -- 172.21.15.81:0/1837609002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc0b30d0 msgr2=0x7f12bc06c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 --2- 172.21.15.81:0/1837609002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc0b30d0 0x7f12bc06c960 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f12a400bbb0 tx=0x7f12a400bec0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 -- 172.21.15.81:0/1837609002 shutdown_connections 2024-09-13T18:54:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 --2- 172.21.15.81:0/1837609002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc0b30d0 0x7f12bc06c960 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 --2- 172.21.15.81:0/1837609002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc159920 0x7f12bc0b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 -- 172.21.15.81:0/1837609002 >> 172.21.15.81:0/1837609002 conn(0x7f12bc06a390 msgr2=0x7f12bc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 -- 172.21.15.81:0/1837609002 shutdown_connections 2024-09-13T18:54:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.238+0000 7f12c0c00700 1 -- 172.21.15.81:0/1837609002 wait complete. 2024-09-13T18:54:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.242+0000 7f12c0c00700 1 Processor -- start 2024-09-13T18:54:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.242+0000 7f12c0c00700 1 -- start start 2024-09-13T18:54:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 0x7f12bc141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12bc0b30d0 0x7f12bc14e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc06bf80 0x7f12bc06c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc06c970 con 0x7f12bc06cea0 2024-09-13T18:54:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc145850 con 0x7f12bc0b30d0 2024-09-13T18:54:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc14dad0 con 0x7f12bc06bf80 2024-09-13T18:54:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 0x7f12bc141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 0x7f12bc141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50960/0 (socket says 172.21.15.81:50960) 2024-09-13T18:54:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 -- 172.21.15.81:0/3109051207 learned_addr learned my addr 172.21.15.81:0/3109051207 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12b2a00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12bc0b30d0 0x7f12bc14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bbe00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc06bf80 0x7f12bc06c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 -- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc06bf80 msgr2=0x7f12bc06c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc06bf80 0x7f12bc06c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 -- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12bc0b30d0 msgr2=0x7f12bc14e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12bc0b30d0 0x7f12bc14e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 -- 172.21.15.81:0/3109051207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a400b810 con 0x7f12bc06cea0 2024-09-13T18:54:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bbe00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc06bf80 0x7f12bc06c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12bb400700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 0x7f12bc141fc0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00efc0 tx=0x7f12ac00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12b3e00700 1 -- 172.21.15.81:0/3109051207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00cc00 con 0x7f12bc06cea0 2024-09-13T18:54:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12b3e00700 1 -- 172.21.15.81:0/3109051207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac00f040 con 0x7f12bc06cea0 2024-09-13T18:54:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12b3e00700 1 -- 172.21.15.81:0/3109051207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac014480 con 0x7f12bc06cea0 2024-09-13T18:54:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc142500 con 0x7f12bc06cea0 2024-09-13T18:54:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.246+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc14dd50 con 0x7f12bc06cea0 2024-09-13T18:54:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.250+0000 7f12b3e00700 1 -- 172.21.15.81:0/3109051207 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f12ac0145e0 con 0x7f12bc06cea0 2024-09-13T18:54:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12b3e00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1298066730 0x7f1298068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12b3e00700 1 -- 172.21.15.81:0/3109051207 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f12ac084e40 con 0x7f12bc06cea0 2024-09-13T18:54:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12b2a00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1298066730 0x7f1298068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12b2a00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1298066730 0x7f1298068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0cc6b0 tx=0x7f12a401b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 Processor -- start 2024-09-13T18:54:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 -- start start 2024-09-13T18:54:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751ad90 0x174d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174f9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x1751b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x17462010 con 0x1751b170 2024-09-13T18:54:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x173eff40 con 0x1751ad90 2024-09-13T18:54:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.254+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x17442e30 con 0x174d0310 2024-09-13T18:54:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x1751b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x1751b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50962/0 (socket says 172.21.15.81:50962) 2024-09-13T18:54:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 -- 172.21.15.81:0/4179321796 learned_addr learned my addr 172.21.15.81:0/4179321796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12b2a00700 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bb400700 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751ad90 0x174d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 -- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 msgr2=0x174f9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174f9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 -- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751ad90 msgr2=0x174d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751ad90 0x174d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 -- 172.21.15.81:0/4179321796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x172aea40 con 0x1751b170 2024-09-13T18:54:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bb400700 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751ad90 0x174d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12bbe00700 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x1751b550 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f12b4001730 tx=0x7f12b4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b986c723992068 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12ab400700 1 -- 172.21.15.81:0/4179321796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40052e0 con 0x1751b170 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12ab400700 1 -- 172.21.15.81:0/4179321796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4005440 con 0x1751b170 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12ab400700 1 -- 172.21.15.81:0/4179321796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40038c0 con 0x1751b170 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 -- 172.21.15.81:0/4179321796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 msgr2=0x1751b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x1751b550 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f12b4001730 tx=0x7f12b4001a40 comp rx=0 tx=0).stop 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 -- 172.21.15.81:0/4179321796 shutdown_connections 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x1751b550 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174f9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4179321796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751ad90 0x174d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 -- 172.21.15.81:0/4179321796 >> 172.21.15.81:0/4179321796 conn(0x172635b0 msgr2=0x174d4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 -- 172.21.15.81:0/4179321796 shutdown_connections 2024-09-13T18:54:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.258+0000 7f12c55ec740 1 -- 172.21.15.81:0/4179321796 wait complete. 2024-09-13T18:54:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 -- start start 2024-09-13T18:54:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 Processor -- start 2024-09-13T18:54:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x174d0310 0x174f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1751ad90 0x174f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x17524960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1743e150 con 0x1751b170 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1743beb0 con 0x174d0310 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x173f98e0 con 0x1751ad90 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12c55ec740 10 client.0 _ll_register_callbacks cb 0x173d8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x17524960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x17524960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50974/0 (socket says 172.21.15.81:50974) 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 -- 172.21.15.81:0/4153378705 learned_addr learned my addr 172.21.15.81:0/4153378705 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12b2a00700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1751ad90 0x174f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bb400700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x174d0310 0x174f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 -- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1751ad90 msgr2=0x174f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1751ad90 0x174f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 -- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x174d0310 msgr2=0x174f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x174d0310 0x174f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bbe00700 1 -- 172.21.15.81:0/4153378705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b400f040 con 0x1751b170 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.262+0000 7f12bb400700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x174d0310 0x174f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12bbe00700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x17524960 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x1740cfa0 tx=0x7f12b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1150bcc5552bbf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 1 -- 172.21.15.81:0/4153378705 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40052e0 con 0x1751b170 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x172702c0 con 0x1751b170 2024-09-13T18:54:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 1 -- 172.21.15.81:0/4153378705 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f12b4003c10 con 0x1751b170 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 1 -- 172.21.15.81:0/4153378705 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12b4003dd0 con 0x1751b170 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 10 client.8595 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x17402290 con 0x1751b170 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 1 -- 172.21.15.81:0/4153378705 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x172702c0 con 0x1751b170 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 1 -- 172.21.15.81:0/4153378705 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f12b4006860 con 0x1751b170 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 10 client.8595 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 10 client.8595 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 20 client.8595 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x17525390 0x174f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 4 client.8595 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x172ba540 con 0x17525390 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12bb400700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x17525390 0x174f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12bb400700 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x17525390 0x174f2d40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c70b57b458673f server_cookie=8de8b4221973d4ef in_seq=0 out_seq=0 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 10 client.8595 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 1 -- 172.21.15.81:0/4153378705 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x172ba540 con 0x17525390 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f129fe00700 10 client.8595 handle_command_reply: tid=0 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.266+0000 7f12c55ec740 1 client.8595 shutdown 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 msgr2=0x17524960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x17524960 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x1740cfa0 tx=0x7f12b4000ed0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 shutdown_connections 2024-09-13T18:54:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x17525390 0x174f2d40 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751b170 0x17524960 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1751ad90 0x174f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 --2- 172.21.15.81:0/4153378705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x174d0310 0x174f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f129fe00700 0 client.8595 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 >> 172.21.15.81:0/4153378705 conn(0x172635b0 msgr2=0x174f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 shutdown_connections 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 1 -- 172.21.15.81:0/4153378705 wait complete. 2024-09-13T18:54:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.270+0000 7f12c55ec740 20 client.8595 trim_cache size 0 max 16384 2024-09-13T18:54:17.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.290+0000 7f12c55ec740 1 Processor -- start 2024-09-13T18:54:17.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.290+0000 7f12c55ec740 1 -- start start 2024-09-13T18:54:17.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x174d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17523590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x172e7b80 con 0x1751ad90 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1743c760 con 0x1751b170 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x173e0bd0 con 0x174d0310 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x174d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x174d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50980/0 (socket says 172.21.15.81:50980) 2024-09-13T18:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 -- 172.21.15.81:0/692990615 learned_addr learned my addr 172.21.15.81:0/692990615 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12bbe00700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17523590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12bb400700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 -- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 msgr2=0x174d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 -- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 msgr2=0x17523590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17523590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 -- 172.21.15.81:0/692990615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x173e84c0 con 0x1751ad90 2024-09-13T18:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12bb400700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12bbe00700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17523590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12b2a00700 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x174d17a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f12a4015000 tx=0x7f12a4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9550bc3cf9ac0556 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12abe00700 1 -- 172.21.15.81:0/692990615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a401e040 con 0x1751ad90 2024-09-13T18:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12abe00700 1 -- 172.21.15.81:0/692990615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a402c040 con 0x1751ad90 2024-09-13T18:54:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12abe00700 1 -- 172.21.15.81:0/692990615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003ac0 con 0x1751ad90 2024-09-13T18:54:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 -- 172.21.15.81:0/692990615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 msgr2=0x174d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.294+0000 7f12c55ec740 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x174d17a0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f12a4015000 tx=0x7f12a4012000 comp rx=0 tx=0).stop 2024-09-13T18:54:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- 172.21.15.81:0/692990615 shutdown_connections 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17523590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x174d17a0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 --2- 172.21.15.81:0/692990615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x174d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- 172.21.15.81:0/692990615 >> 172.21.15.81:0/692990615 conn(0x172635b0 msgr2=0x174f7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- 172.21.15.81:0/692990615 shutdown_connections 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- 172.21.15.81:0/692990615 wait complete. 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- start start 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 Processor -- start 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x1757bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x175382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17538830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1753a260 con 0x1751ad90 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x174c9a40 con 0x1751b170 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x17524bd0 con 0x174d0310 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12c55ec740 10 client.0 _ll_register_callbacks cb 0x1743a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x175382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x175382f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50984/0 (socket says 172.21.15.81:50984) 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12b2a00700 1 -- 172.21.15.81:0/219773558 learned_addr learned my addr 172.21.15.81:0/219773558 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12bb400700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x1757bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.298+0000 7f12bbe00700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17538830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12b2a00700 1 -- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 msgr2=0x1757bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12b2a00700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x1757bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12b2a00700 1 -- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 msgr2=0x17538830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12b2a00700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17538830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12b2a00700 1 -- 172.21.15.81:0/219773558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc0ccc90 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12bb400700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x1757bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12b2a00700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x175382f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f12a400de60 tx=0x7f12a40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f96a790794c25cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 1 -- 172.21.15.81:0/219773558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a401e040 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 1 -- 172.21.15.81:0/219773558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f12a4032890 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12b4005440 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 1 -- 172.21.15.81:0/219773558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12a4032a50 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 10 client.8601 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x173dc790 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 1 -- 172.21.15.81:0/219773558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4005440 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 1 -- 172.21.15.81:0/219773558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f12a4032bb0 con 0x1751ad90 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 10 client.8601 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 10 client.8601 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 20 client.8601 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1757c040 0x17529b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 4 client.8601 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x172df2c0 con 0x1757c040 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12bb400700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1757c040 0x17529b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f12bb400700 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1757c040 0x17529b70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5c7306959635d2 server_cookie=65528f360927b7c9 in_seq=0 out_seq=0 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 10 client.8601 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.302+0000 7f129fe00700 1 -- 172.21.15.81:0/219773558 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x172df2c0 con 0x1757c040 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f129fe00700 10 client.8601 handle_command_reply: tid=0 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 client.8601 shutdown 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 msgr2=0x175382f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x175382f0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f12a400de60 tx=0x7f12a40047e0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 shutdown_connections 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1757c040 0x17529b70 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1751b170 0x17538830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1751ad90 0x175382f0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 --2- 172.21.15.81:0/219773558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x174d0310 0x1757bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f129fe00700 0 client.8601 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 >> 172.21.15.81:0/219773558 conn(0x172635b0 msgr2=0x174f7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 shutdown_connections 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 1 -- 172.21.15.81:0/219773558 wait complete. 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c55ec740 20 client.8601 trim_cache size 0 max 16384 2024-09-13T18:54:17.321 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:17.322 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:54:17.322 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1298066730 msgr2=0x7f1298068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1298066730 0x7f1298068bf0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0cc6b0 tx=0x7f12a401b040 comp rx=0 tx=0).stop 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 msgr2=0x7f12bc141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 0x7f12bc141fc0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00efc0 tx=0x7f12ac00c0c0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 shutdown_connections 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1298066730 0x7f1298068bf0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12bc06bf80 0x7f12bc06c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12bc0b30d0 0x7f12bc14e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 --2- 172.21.15.81:0/3109051207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc06cea0 0x7f12bc141fc0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 >> 172.21.15.81:0/3109051207 conn(0x7f12bc06a390 msgr2=0x7f12bc0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 shutdown_connections 2024-09-13T18:54:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.306+0000 7f12c0c00700 1 -- 172.21.15.81:0/3109051207 wait complete. 2024-09-13T18:54:17.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 scrub status 2024-09-13T18:54:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.502+0000 7f0e5fc00700 1 Processor -- start 2024-09-13T18:54:17.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.502+0000 7f0e5fc00700 1 -- start start 2024-09-13T18:54:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5fc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e58144330 0x7f0e580cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5fc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0e5806d760 0x7f0e580b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5fc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144710 0x7f0e580b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5fc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e580cce10 con 0x7f0e58144330 2024-09-13T18:54:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5fc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5806bcf0 con 0x7f0e5806d760 2024-09-13T18:54:17.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5fc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5806cb50 con 0x7f0e58144710 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e58144330 0x7f0e580cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0e58144330 0x7f0e580cef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50998/0 (socket says 172.21.15.81:50998) 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 -- 172.21.15.81:0/452085853 learned_addr learned my addr 172.21.15.81:0/452085853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/452085853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144710 0x7f0e580b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e57e00700 1 --2- 172.21.15.81:0/452085853 >> v2:172.21.15.178:3300/0 conn(0x7f0e5806d760 0x7f0e580b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 -- 172.21.15.81:0/452085853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144710 msgr2=0x7f0e580b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 --2- 172.21.15.81:0/452085853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144710 0x7f0e580b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 -- 172.21.15.81:0/452085853 >> v2:172.21.15.178:3300/0 conn(0x7f0e5806d760 msgr2=0x7f0e580b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 --2- 172.21.15.81:0/452085853 >> v2:172.21.15.178:3300/0 conn(0x7f0e5806d760 0x7f0e580b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 -- 172.21.15.81:0/452085853 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e580cf4b0 con 0x7f0e58144330 2024-09-13T18:54:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e57e00700 1 --2- 172.21.15.81:0/452085853 >> v2:172.21.15.178:3300/0 conn(0x7f0e5806d760 0x7f0e580b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e5d200700 1 --2- 172.21.15.81:0/452085853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e58144330 0x7f0e580cef70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f0e580ce900 tx=0x7f0e4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb099d07dc3f1f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e57400700 1 -- 172.21.15.81:0/452085853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00b8a0 con 0x7f0e58144330 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e57400700 1 -- 172.21.15.81:0/452085853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c00ba00 con 0x7f0e58144330 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.506+0000 7f0e57400700 1 -- 172.21.15.81:0/452085853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00bd90 con 0x7f0e58144330 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 -- 172.21.15.81:0/452085853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e58144330 msgr2=0x7f0e580cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/452085853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e58144330 0x7f0e580cef70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f0e580ce900 tx=0x7f0e4c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 -- 172.21.15.81:0/452085853 shutdown_connections 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/452085853 >> v2:172.21.15.178:3300/0 conn(0x7f0e5806d760 0x7f0e580b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/452085853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144710 0x7f0e580b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/452085853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e58144330 0x7f0e580cef70 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 -- 172.21.15.81:0/452085853 >> 172.21.15.81:0/452085853 conn(0x7f0e5806a570 msgr2=0x7f0e5806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 -- 172.21.15.81:0/452085853 shutdown_connections 2024-09-13T18:54:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 -- 172.21.15.81:0/452085853 wait complete. 2024-09-13T18:54:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 Processor -- start 2024-09-13T18:54:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.510+0000 7f0e5fc00700 1 -- start start 2024-09-13T18:54:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 0x7f0e58137530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144330 0x7f0e58071790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58136d60 0x7f0e581f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58137d80 con 0x7f0e5806d760 2024-09-13T18:54:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e580709d0 con 0x7f0e58136d60 2024-09-13T18:54:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58070cb0 con 0x7f0e58144330 2024-09-13T18:54:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 0x7f0e58137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 0x7f0e58137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51004/0 (socket says 172.21.15.81:51004) 2024-09-13T18:54:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 -- 172.21.15.81:0/1799279522 learned_addr learned my addr 172.21.15.81:0/1799279522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58136d60 0x7f0e581f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144330 0x7f0e58071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 -- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144330 msgr2=0x7f0e58071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144330 0x7f0e58071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 -- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58136d60 msgr2=0x7f0e581f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58136d60 0x7f0e581f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 -- 172.21.15.81:0/1799279522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c009570 con 0x7f0e5806d760 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58136d60 0x7f0e581f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144330 0x7f0e58071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 0x7f0e58137530 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0e5806b360 tx=0x7f0e4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e54c00700 1 -- 172.21.15.81:0/1799279522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0036c0 con 0x7f0e5806d760 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e54c00700 1 -- 172.21.15.81:0/1799279522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c01f070 con 0x7f0e5806d760 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e58070f90 con 0x7f0e5806d760 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e54c00700 1 -- 172.21.15.81:0/1799279522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c003a80 con 0x7f0e5806d760 2024-09-13T18:54:17.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.514+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e58137a70 con 0x7f0e5806d760 2024-09-13T18:54:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.518+0000 7f0e54c00700 1 -- 172.21.15.81:0/1799279522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e4c021030 con 0x7f0e5806d760 2024-09-13T18:54:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.518+0000 7f0e54c00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e38066730 0x7f0e38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.518+0000 7f0e54c00700 1 -- 172.21.15.81:0/1799279522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0e4c0859c0 con 0x7f0e5806d760 2024-09-13T18:54:17.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.518+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e38066730 0x7f0e38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e38066730 0x7f0e38068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0e5815aaf0 tx=0x7f0e44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 Processor -- start 2024-09-13T18:54:17.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 -- start start 2024-09-13T18:54:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60a950 0x1e5e9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e5e8d00 0x1e60ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e552010 con 0x1e60b270 2024-09-13T18:54:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e4dff40 con 0x1e5e8d00 2024-09-13T18:54:17.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.522+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e532e30 con 0x1e60a950 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5be5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51020/0 (socket says 172.21.15.81:51020) 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 -- 172.21.15.81:0/2315188217 learned_addr learned my addr 172.21.15.81:0/2315188217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e57e00700 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e5e8d00 0x1e60ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5d200700 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60a950 0x1e5e9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 -- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60a950 msgr2=0x1e5e9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60a950 0x1e5e9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 -- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e5e8d00 msgr2=0x1e60ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e5e8d00 0x1e60ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 -- 172.21.15.81:0/2315188217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e39ea40 con 0x1e60b270 2024-09-13T18:54:17.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5be5d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009f60 tx=0x7f0e50009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a5c738f8de78ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e49600700 1 -- 172.21.15.81:0/2315188217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003a40 con 0x1e60b270 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e49600700 1 -- 172.21.15.81:0/2315188217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000f050 con 0x1e60b270 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e49600700 1 -- 172.21.15.81:0/2315188217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003dc0 con 0x1e60b270 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 -- 172.21.15.81:0/2315188217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 msgr2=0x1e5be5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5be5d0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009f60 tx=0x7f0e50009f90 comp rx=0 tx=0).stop 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 -- 172.21.15.81:0/2315188217 shutdown_connections 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5be5d0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e5e8d00 0x1e60ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/2315188217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60a950 0x1e5e9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 -- 172.21.15.81:0/2315188217 >> 172.21.15.81:0/2315188217 conn(0x1e3535b0 msgr2=0x1e5c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 -- 172.21.15.81:0/2315188217 shutdown_connections 2024-09-13T18:54:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.526+0000 7f0e62f4d740 1 -- 172.21.15.81:0/2315188217 wait complete. 2024-09-13T18:54:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 -- start start 2024-09-13T18:54:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 Processor -- start 2024-09-13T18:54:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 0x1e5d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e606540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60b270 0x1e5d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e52e150 con 0x1e5e8d00 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e52beb0 con 0x1e60a950 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e4e98e0 con 0x1e60b270 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 10 client.0 _ll_register_callbacks cb 0x1e4c8670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 0x1e5d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 0x1e5d3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51026/0 (socket says 172.21.15.81:51026) 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 -- 172.21.15.81:0/1006712828 learned_addr learned my addr 172.21.15.81:0/1006712828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60b270 0x1e5d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e606540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 -- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60b270 msgr2=0x1e5d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60b270 0x1e5d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 -- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 msgr2=0x1e606540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e606540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 -- 172.21.15.81:0/1006712828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e50009b90 con 0x1e5e8d00 2024-09-13T18:54:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 0x1e5d3680 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c05e6e0 tx=0x7f0e4c0568d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ca7b41939d81d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e3e000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e3e000700 1 -- 172.21.15.81:0/1006712828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c05ec10 con 0x1e5e8d00 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e3e000700 1 -- 172.21.15.81:0/1006712828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0e4c054bc0 con 0x1e5e8d00 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.530+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e3602c0 con 0x1e5e8d00 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 1 -- 172.21.15.81:0/1006712828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e4c003be0 con 0x1e5e8d00 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 10 client.8613 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x1e4f2290 con 0x1e5e8d00 2024-09-13T18:54:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 1 -- 172.21.15.81:0/1006712828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e3602c0 con 0x1e5e8d00 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 1 -- 172.21.15.81:0/1006712828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f0e4c056a80 con 0x1e5e8d00 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 10 client.8613 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 10 client.8613 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 20 client.8613 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e5d2240 0x1e5d4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 4 client.8613 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e3aa540 con 0x1e5d2240 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e5d2240 0x1e5d4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e5d2240 0x1e5d4280 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15558b43f0fe6531 server_cookie=d50fe01936473ee9 in_seq=0 out_seq=0 2024-09-13T18:54:17.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 10 client.8613 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 1 -- 172.21.15.81:0/1006712828 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1e3aa540 con 0x1e5d2240 2024-09-13T18:54:17.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 10 client.8613 handle_command_reply: tid=0 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 client.8613 shutdown 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 msgr2=0x1e5d3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 0x1e5d3680 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c05e6e0 tx=0x7f0e4c0568d0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 shutdown_connections 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e5d2240 0x1e5d4280 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e60b270 0x1e5d1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e606540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e3e000700 0 client.8613 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1006712828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e5e8d00 0x1e5d3680 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.534+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 >> 172.21.15.81:0/1006712828 conn(0x1e3535b0 msgr2=0x1e5bddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.538+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 shutdown_connections 2024-09-13T18:54:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.538+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1006712828 wait complete. 2024-09-13T18:54:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.538+0000 7f0e62f4d740 20 client.8613 trim_cache size 0 max 16384 2024-09-13T18:54:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 Processor -- start 2024-09-13T18:54:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 -- start start 2024-09-13T18:54:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e5c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5d7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e3d7b80 con 0x1e60b270 2024-09-13T18:54:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e4fcc00 con 0x1e60a950 2024-09-13T18:54:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e4b5a50 con 0x1e5e8d00 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5d7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5d7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51040/0 (socket says 172.21.15.81:51040) 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1153994912 learned_addr learned my addr 172.21.15.81:0/1153994912 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e5c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 msgr2=0x1e5c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e5c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 msgr2=0x1e5d7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5d7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1153994912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e4d84c0 con 0x1e60b270 2024-09-13T18:54:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5d7950 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x1e3d9ab0 tx=0x7f0e5000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9e033737546da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.558+0000 7f0e4a000700 1 -- 172.21.15.81:0/1153994912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50009600 con 0x1e60b270 2024-09-13T18:54:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e4a000700 1 -- 172.21.15.81:0/1153994912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50003a40 con 0x1e60b270 2024-09-13T18:54:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e4a000700 1 -- 172.21.15.81:0/1153994912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50003db0 con 0x1e60b270 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1153994912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 msgr2=0x1e5d7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5d7950 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x1e3d9ab0 tx=0x7f0e5000d000 comp rx=0 tx=0).stop 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1153994912 shutdown_connections 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5d7950 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5d7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1153994912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e5c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1153994912 >> 172.21.15.81:0/1153994912 conn(0x1e3535b0 msgr2=0x1e5c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1153994912 shutdown_connections 2024-09-13T18:54:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1153994912 wait complete. 2024-09-13T18:54:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 -- start start 2024-09-13T18:54:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.562+0000 7f0e62f4d740 1 Processor -- start 2024-09-13T18:54:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e66b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5ebe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e629f90 con 0x1e60b270 2024-09-13T18:54:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e5d18c0 con 0x1e60a950 2024-09-13T18:54:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e623eb0 con 0x1e5e8d00 2024-09-13T18:54:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e62f4d740 10 client.0 _ll_register_callbacks cb 0x1e4fb8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e66b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5ec3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51046/0 (socket says 172.21.15.81:51046) 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1534837714 learned_addr learned my addr 172.21.15.81:0/1534837714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e57e00700 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5ebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 msgr2=0x1e66b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e66b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 msgr2=0x1e5ebe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5ebe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 -- 172.21.15.81:0/1534837714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e39ea40 con 0x1e60b270 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e5dc00700 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5ec3d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0e500078f0 tx=0x7f0e50004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a236170e918c331 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e3e000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.566+0000 7f0e3e000700 1 -- 172.21.15.81:0/1534837714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50004540 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 1 -- 172.21.15.81:0/1534837714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0e50032c70 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e5000f050 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 1 -- 172.21.15.81:0/1534837714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e50032e70 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 10 client.8619 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x1e4cc790 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 1 -- 172.21.15.81:0/1534837714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000f050 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 1 -- 172.21.15.81:0/1534837714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f0e5002f070 con 0x1e60b270 2024-09-13T18:54:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 10 client.8619 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 10 client.8619 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 20 client.8619 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e66bd00 0x1e621ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 4 client.8619 mds_command: new command op to 8073 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 --> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1e3cf2c0 con 0x1e66bd00 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e66bd00 0x1e621ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e5d200700 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e66bd00 0x1e621ee0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c058484ac6865ad2 server_cookie=bd49c5b37781117 in_seq=0 out_seq=0 2024-09-13T18:54:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 10 client.8619 ms_handle_connect on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 1 -- 172.21.15.81:0/1534837714 <== mds.1 v2:172.21.15.81:6834/548467778 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x1e3cf2c0 con 0x1e66bd00 2024-09-13T18:54:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 10 client.8619 handle_command_reply: tid=0 2024-09-13T18:54:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 client.8619 shutdown 2024-09-13T18:54:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 msgr2=0x1e5ec3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5ec3d0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0e500078f0 tx=0x7f0e50004b60 comp rx=0 tx=0).stop 2024-09-13T18:54:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 shutdown_connections 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:6834/548467778,v1:172.21.15.81:6836/548467778] conn(0x1e66bd00 0x1e621ee0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1e60b270 0x1e5ec3d0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1e60a950 0x1e5ebe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e3e000700 0 client.8619 ms_handle_reset on v2:172.21.15.81:6834/548467778 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 --2- 172.21.15.81:0/1534837714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1e5e8d00 0x1e66b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 >> 172.21.15.81:0/1534837714 conn(0x1e3535b0 msgr2=0x1e5e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 shutdown_connections 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 1 -- 172.21.15.81:0/1534837714 wait complete. 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.570+0000 7f0e62f4d740 20 client.8619 trim_cache size 0 max 16384 2024-09-13T18:54:17.583 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "044c02c8-eb41-4dc3-8bfc-c50acb7b1630": { 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:17.584 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e38066730 msgr2=0x7f0e38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e38066730 0x7f0e38068bf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0e5815aaf0 tx=0x7f0e44008040 comp rx=0 tx=0).stop 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 msgr2=0x7f0e58137530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 0x7f0e58137530 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f0e5806b360 tx=0x7f0e4c004770 comp rx=0 tx=0).stop 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 shutdown_connections 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e38066730 0x7f0e38068bf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e58136d60 0x7f0e581f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e58144330 0x7f0e58071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 --2- 172.21.15.81:0/1799279522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e5806d760 0x7f0e58137530 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 >> 172.21.15.81:0/1799279522 conn(0x7f0e5806a570 msgr2=0x7f0e5815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 shutdown_connections 2024-09-13T18:54:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.574+0000 7f0e5fc00700 1 -- 172.21.15.81:0/1799279522 wait complete. 2024-09-13T18:54:17.605 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:54:17.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 scrub status 2024-09-13T18:54:17.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.782+0000 7f4aed600700 1 Processor -- start 2024-09-13T18:54:17.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.782+0000 7f4aed600700 1 -- start start 2024-09-13T18:54:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4aed600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 0x7f4ae8164690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4aed600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae815df90 con 0x7f4ae80cf3b0 2024-09-13T18:54:17.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4aed600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae815aea0 con 0x7f4ae80ce280 2024-09-13T18:54:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4aed600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae815e420 con 0x7f4ae815a880 2024-09-13T18:54:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ae80cf3b0 0x7f4ae815a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59114/0 (socket says 172.21.15.81:59114) 2024-09-13T18:54:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 -- 172.21.15.81:0/2945663354 learned_addr learned my addr 172.21.15.81:0/2945663354 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:17.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae7400700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 0x7f4ae8164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924492898 0 0) 0x7f4ae815df90 con 0x7f4ae80cf3b0 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4acc0035d0 con 0x7f4ae80cf3b0 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3249232870 0 0) 0x7f4acc0035d0 con 0x7f4ae80cf3b0 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 msgr2=0x7f4ae8164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 0x7f4ae8164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 >> v1:172.21.15.178:6789/0 conn(0x7f4ae80ce280 legacy=0x7f4ae80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae815d660 con 0x7f4ae80cf3b0 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f4ad4001670 con 0x7f4ae80cf3b0 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 >> v1:172.21.15.81:6789/0 conn(0x7f4ae80cf3b0 legacy=0x7f4ae815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 0x7f4acc003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4acc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4acc004db0 0x7f4acc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae815e420 con 0x7f4acc003f90 2024-09-13T18:54:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc00bb40 con 0x7f4acc004db0 2024-09-13T18:54:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4acc00bd00 con 0x7f4ae815a880 2024-09-13T18:54:17.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4acc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 0x7f4acc003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae7400700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4acc004db0 0x7f4acc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 -- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 msgr2=0x7f4acc003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae815a880 0x7f4acc003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 -- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4acc004db0 msgr2=0x7f4acc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4acc004db0 0x7f4acc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.786+0000 7f4ae6000700 1 -- 172.21.15.81:0/2945663354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0035d0 con 0x7f4acc003f90 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4ae6000700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4acc004870 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c2f0 tx=0x7f4acc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e281497f21fef62f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400cd70 con 0x7f4acc003f90 2024-09-13T18:54:17.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4007bc0 con 0x7f4acc003f90 2024-09-13T18:54:17.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4ae5600700 1 -- 172.21.15.81:0/2945663354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4005bc0 con 0x7f4acc003f90 2024-09-13T18:54:17.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4aed600700 1 -- 172.21.15.81:0/2945663354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 msgr2=0x7f4acc004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4aed600700 1 --2- 172.21.15.81:0/2945663354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4acc004870 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c2f0 tx=0x7f4acc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4ae7400700 1 -- 172.21.15.81:0/2945663354 reap_dead start 2024-09-13T18:54:17.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4aed600700 1 -- 172.21.15.81:0/2945663354 shutdown_connections 2024-09-13T18:54:17.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4aed600700 1 -- 172.21.15.81:0/2945663354 >> 172.21.15.81:0/2945663354 conn(0x7f4ae806a570 msgr2=0x7f4ae806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4aed600700 1 -- 172.21.15.81:0/2945663354 shutdown_connections 2024-09-13T18:54:17.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.790+0000 7f4aed600700 1 -- 172.21.15.81:0/2945663354 wait complete. 2024-09-13T18:54:17.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 Processor -- start 2024-09-13T18:54:17.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 -- start start 2024-09-13T18:54:17.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4ae8148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae8153c50 0x7f4ae8149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae81495f0 0x7f4ae814e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8152890 con 0x7f4acc003f90 2024-09-13T18:54:17.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae80b0040 con 0x7f4ae8153c50 2024-09-13T18:54:17.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae8154110 con 0x7f4ae81495f0 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4ae8148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4ae8148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51072/0 (socket says 172.21.15.81:51072) 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 -- 172.21.15.81:0/737000049 learned_addr learned my addr 172.21.15.81:0/737000049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6000700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae8153c50 0x7f4ae8149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae7400700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae81495f0 0x7f4ae814e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 -- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae81495f0 msgr2=0x7f4ae814e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae81495f0 0x7f4ae814e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 -- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae8153c50 msgr2=0x7f4ae8149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae8153c50 0x7f4ae8149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 -- 172.21.15.81:0/737000049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae80afa80 con 0x7f4acc003f90 2024-09-13T18:54:17.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae7400700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae81495f0 0x7f4ae814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4ae8148a70 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e920 tx=0x7f4ad800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4adea00700 1 -- 172.21.15.81:0/737000049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad800b070 con 0x7f4acc003f90 2024-09-13T18:54:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4adea00700 1 -- 172.21.15.81:0/737000049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad80054e0 con 0x7f4acc003f90 2024-09-13T18:54:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae80afd60 con 0x7f4acc003f90 2024-09-13T18:54:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4adea00700 1 -- 172.21.15.81:0/737000049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80038e0 con 0x7f4acc003f90 2024-09-13T18:54:17.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.794+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae814a340 con 0x7f4acc003f90 2024-09-13T18:54:17.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.798+0000 7f4adea00700 1 -- 172.21.15.81:0/737000049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ad8003a40 con 0x7f4acc003f90 2024-09-13T18:54:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.798+0000 7f4adea00700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ac8066760 0x7f4ac8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4adea00700 1 -- 172.21.15.81:0/737000049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4ad8084530 con 0x7f4acc003f90 2024-09-13T18:54:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4ae6000700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ac8066760 0x7f4ac8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4ae6000700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ac8066760 0x7f4ac8068c20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4007d70 tx=0x7f4ad4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 Processor -- start 2024-09-13T18:54:17.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 -- start start 2024-09-13T18:54:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a59950 0x23a38240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a37d00 0x23a59d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a0d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x239a1010 con 0x23a5a270 2024-09-13T18:54:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2392ef40 con 0x23a59950 2024-09-13T18:54:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x23981e30 con 0x23a37d00 2024-09-13T18:54:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.802+0000 7f4ae7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a0d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a0d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51074/0 (socket says 172.21.15.81:51074) 2024-09-13T18:54:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 -- 172.21.15.81:0/1643134760 learned_addr learned my addr 172.21.15.81:0/1643134760 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae6000700 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a37d00 0x23a59d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a59950 0x23a38240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 -- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a37d00 msgr2=0x23a59d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a37d00 0x23a59d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 -- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a59950 msgr2=0x23a38240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a59950 0x23a38240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 -- 172.21.15.81:0/1643134760 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x237eda40 con 0x23a5a270 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae6000700 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a37d00 0x23a59d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ae7400700 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a0d5d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8150f80 tx=0x7f4ae0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbffa13aa7689a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ad3000700 1 -- 172.21.15.81:0/1643134760 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae000e030 con 0x23a5a270 2024-09-13T18:54:17.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ad3000700 1 -- 172.21.15.81:0/1643134760 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0004690 con 0x23a5a270 2024-09-13T18:54:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4ad3000700 1 -- 172.21.15.81:0/1643134760 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0016460 con 0x23a5a270 2024-09-13T18:54:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 -- 172.21.15.81:0/1643134760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 msgr2=0x23a0d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a0d5d0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8150f80 tx=0x7f4ae0009750 comp rx=0 tx=0).stop 2024-09-13T18:54:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 -- 172.21.15.81:0/1643134760 shutdown_connections 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a0d5d0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a37d00 0x23a59d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 --2- 172.21.15.81:0/1643134760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a59950 0x23a38240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 -- 172.21.15.81:0/1643134760 >> 172.21.15.81:0/1643134760 conn(0x237a25b0 msgr2=0x23a139b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 -- 172.21.15.81:0/1643134760 shutdown_connections 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 -- 172.21.15.81:0/1643134760 wait complete. 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.806+0000 7f4af09de740 1 -- start start 2024-09-13T18:54:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 Processor -- start 2024-09-13T18:54:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a226f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a22ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a20d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2397d150 con 0x23a5a270 2024-09-13T18:54:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2397aeb0 con 0x23a37d00 2024-09-13T18:54:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x239388e0 con 0x23a59950 2024-09-13T18:54:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 10 client.0 _ll_register_callbacks cb 0x23917670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a20d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a20d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51086/0 (socket says 172.21.15.81:51086) 2024-09-13T18:54:17.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 -- 172.21.15.81:0/442438888 learned_addr learned my addr 172.21.15.81:0/442438888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae6000700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a22ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 -- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 msgr2=0x23a22ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a22ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 -- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 msgr2=0x23a226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 -- 172.21.15.81:0/442438888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae0009d10 con 0x23a5a270 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ae7400700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a20d70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x23828ab0 tx=0x7f4ae0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4859d988e5fba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ac7400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ac7400700 1 -- 172.21.15.81:0/442438888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0024070 con 0x23a5a270 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ac7400700 1 -- 172.21.15.81:0/442438888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4ae000f070 con 0x23a5a270 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x237af2c0 con 0x23a5a270 2024-09-13T18:54:17.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ac7400700 1 -- 172.21.15.81:0/442438888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ae0007000 con 0x23a5a270 2024-09-13T18:54:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 10 client.8631 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x23941290 con 0x23a5a270 2024-09-13T18:54:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ac7400700 1 -- 172.21.15.81:0/442438888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x237af2c0 con 0x23a5a270 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.810+0000 7f4ac7400700 1 -- 172.21.15.81:0/442438888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f4ae0014040 con 0x23a5a270 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 10 client.8631 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 10 client.8631 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 20 client.8631 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23a21300 0x23a55760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 4 client.8631 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x237f9540 con 0x23a21300 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23a21300 0x23a55760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23a21300 0x23a55760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=842f2157d3b1bcec server_cookie=4d3c30342012e78 in_seq=0 out_seq=0 2024-09-13T18:54:17.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4ac7400700 10 client.8631 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:17.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4ac7400700 1 -- 172.21.15.81:0/442438888 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x237f9540 con 0x23a21300 2024-09-13T18:54:17.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4ac7400700 10 client.8631 handle_command_reply: tid=0 2024-09-13T18:54:17.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 1 client.8631 shutdown 2024-09-13T18:54:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 msgr2=0x23a20d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.814+0000 7f4af09de740 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a20d70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x23828ab0 tx=0x7f4ae0004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 shutdown_connections 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23a21300 0x23a55760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a20d70 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a22ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 --2- 172.21.15.81:0/442438888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 >> 172.21.15.81:0/442438888 conn(0x237a25b0 msgr2=0x23a0edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4ac7400700 0 client.8631 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 shutdown_connections 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 1 -- 172.21.15.81:0/442438888 wait complete. 2024-09-13T18:54:17.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.818+0000 7f4af09de740 20 client.8631 trim_cache size 0 max 16384 2024-09-13T18:54:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.834+0000 7f4af09de740 1 Processor -- start 2024-09-13T18:54:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 -- start start 2024-09-13T18:54:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a6cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a6d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a6d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x23826b80 con 0x23a5a270 2024-09-13T18:54:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x23919620 con 0x23a37d00 2024-09-13T18:54:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x23904a50 con 0x23a59950 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a6d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a6d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a6d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:54460/0 (socket says 172.21.15.81:54460) 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 -- 172.21.15.81:0/3786543885 learned_addr learned my addr 172.21.15.81:0/3786543885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a6cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 -- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 msgr2=0x23a6cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a6cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 -- 172.21.15.81:0/3786543885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 msgr2=0x23a6d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a6d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 -- 172.21.15.81:0/3786543885 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x239274c0 con 0x23a59950 2024-09-13T18:54:17.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ae6000700 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a6d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4011000 tx=0x7f4ad400a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f843a02c622e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ad3a00700 1 -- 172.21.15.81:0/3786543885 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4004890 con 0x23a59950 2024-09-13T18:54:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ad3a00700 1 -- 172.21.15.81:0/3786543885 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad40049f0 con 0x23a59950 2024-09-13T18:54:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.838+0000 7f4ad3a00700 1 -- 172.21.15.81:0/3786543885 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4004b80 con 0x23a59950 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 msgr2=0x23a6d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a6d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4011000 tx=0x7f4ad400a000 comp rx=0 tx=0).stop 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- 172.21.15.81:0/3786543885 shutdown_connections 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a6d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a6d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- 172.21.15.81:0/3786543885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23a6cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- 172.21.15.81:0/3786543885 >> 172.21.15.81:0/3786543885 conn(0x237a25b0 msgr2=0x23a26300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- 172.21.15.81:0/3786543885 shutdown_connections 2024-09-13T18:54:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- 172.21.15.81:0/3786543885 wait complete. 2024-09-13T18:54:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- start start 2024-09-13T18:54:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 Processor -- start 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23ac4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a80960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a80ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x239786c0 con 0x23a5a270 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2394bc00 con 0x23a37d00 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x23a817d0 con 0x23a59950 2024-09-13T18:54:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4af09de740 10 client.0 _ll_register_callbacks cb 0x2394a8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4ae6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23ac4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4ae6a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23ac4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:38486/0 (socket says 172.21.15.81:38486) 2024-09-13T18:54:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4ae6a00700 1 -- 172.21.15.81:0/1497710748 learned_addr learned my addr 172.21.15.81:0/1497710748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4ae7400700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a80ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.842+0000 7f4ae6000700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a80960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6a00700 1 -- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 msgr2=0x23a80960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a80960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6a00700 1 -- 172.21.15.81:0/1497710748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 msgr2=0x23a80ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a80ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6a00700 1 -- 172.21.15.81:0/1497710748 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad4024040 con 0x23a37d00 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6a00700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23ac4030 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80553c0 tx=0x7f4ad80518a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54a13c7ff8925a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ac7400700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ac7400700 1 -- 172.21.15.81:0/1497710748 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8055b30 con 0x23a37d00 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ac7400700 1 -- 172.21.15.81:0/1497710748 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4ad8055430 con 0x23a37d00 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ae0004690 con 0x23a37d00 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ac7400700 1 -- 172.21.15.81:0/1497710748 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ad8059260 con 0x23a37d00 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 10 client.8182 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x2391b790 con 0x23a37d00 2024-09-13T18:54:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ac7400700 1 -- 172.21.15.81:0/1497710748 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae0004690 con 0x23a37d00 2024-09-13T18:54:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ac7400700 1 -- 172.21.15.81:0/1497710748 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f4ad8073250 con 0x23a37d00 2024-09-13T18:54:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 10 client.8182 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 10 client.8182 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-13T18:54:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 20 client.8182 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:17.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23ac4570 0x23a70500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 4 client.8182 mds_command: new command op to 7675 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:54:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 --> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2381e2c0 con 0x23ac4570 2024-09-13T18:54:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.846+0000 7f4ae6000700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23ac4570 0x23a70500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:17.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4ac7400700 10 client.8182 ms_handle_connect on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4ae6000700 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23ac4570 0x23a70500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6ab9e9d5fc9deb7 server_cookie=19ace77ee67143b3 in_seq=0 out_seq=0 2024-09-13T18:54:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4ac7400700 1 -- 172.21.15.81:0/1497710748 <== mds.2 v2:172.21.15.178:6832/3980969466 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x2381e2c0 con 0x23ac4570 2024-09-13T18:54:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4ac7400700 10 client.8182 handle_command_reply: tid=0 2024-09-13T18:54:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 client.8182 shutdown 2024-09-13T18:54:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 msgr2=0x23ac4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23ac4030 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80553c0 tx=0x7f4ad80518a0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 shutdown_connections 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:6832/3980969466,v1:172.21.15.178:6834/3980969466] conn(0x23ac4570 0x23a70500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x23a5a270 0x23a80ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23a59950 0x23a80960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4ac7400700 0 client.8182 ms_handle_reset on v2:172.21.15.178:6832/3980969466 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 --2- 172.21.15.81:0/1497710748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a37d00 0x23ac4030 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 >> 172.21.15.81:0/1497710748 conn(0x237a25b0 msgr2=0x23a72d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 shutdown_connections 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 1 -- 172.21.15.81:0/1497710748 wait complete. 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4af09de740 20 client.8182 trim_cache size 0 max 16384 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout: "044c02c8-eb41-4dc3-8bfc-c50acb7b1630": { 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:17.861 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:54:17.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:17.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:17.862 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ac8066760 msgr2=0x7f4ac8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ac8066760 0x7f4ac8068c20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4007d70 tx=0x7f4ad4007000 comp rx=0 tx=0).stop 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 msgr2=0x7f4ae8148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4ae8148a70 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f4ad800e920 tx=0x7f4ad800ec30 comp rx=0 tx=0).stop 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 shutdown_connections 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ac8066760 0x7f4ac8068c20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ae81495f0 0x7f4ae814e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ae8153c50 0x7f4ae8149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 --2- 172.21.15.81:0/737000049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4acc003f90 0x7f4ae8148a70 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 >> 172.21.15.81:0/737000049 conn(0x7f4ae806a570 msgr2=0x7f4ae8070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 shutdown_connections 2024-09-13T18:54:17.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:17.850+0000 7f4aed600700 1 -- 172.21.15.81:0/737000049 wait complete. 2024-09-13T18:54:17.886 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:54:17.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-13T18:54:18.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.042+0000 7f3136200700 1 Processor -- start 2024-09-13T18:54:18.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.042+0000 7f3136200700 1 -- start start 2024-09-13T18:54:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3136200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3130161110 0x7f313006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3136200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f313006b170 0x7f31300b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3136200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313006b5c0 con 0x7f3130160d30 2024-09-13T18:54:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3136200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31300b0020 con 0x7f3130161110 2024-09-13T18:54:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3136200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300d1770 con 0x7f313006b170 2024-09-13T18:54:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3134e00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3130160d30 0x7f313006cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:53874/0 (socket says 172.21.15.81:53874) 2024-09-13T18:54:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3134e00700 1 -- 172.21.15.81:0/55335872 learned_addr learned my addr 172.21.15.81:0/55335872 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3135800700 1 --2- 172.21.15.81:0/55335872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f313006b170 0x7f31300b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312fe00700 1 --2- 172.21.15.81:0/55335872 >> v2:172.21.15.178:3300/0 conn(0x7f3130161110 0x7f313006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312f400700 1 -- 172.21.15.81:0/55335872 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785840415 0 0) 0x7f3124001110 con 0x7f3130160d30 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312f400700 1 -- 172.21.15.81:0/55335872 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31180035d0 con 0x7f3130160d30 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3135800700 1 -- 172.21.15.81:0/55335872 >> v2:172.21.15.178:3300/0 conn(0x7f3130161110 msgr2=0x7f313006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3135800700 1 --2- 172.21.15.81:0/55335872 >> v2:172.21.15.178:3300/0 conn(0x7f3130161110 0x7f313006ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3135800700 1 -- 172.21.15.81:0/55335872 >> v1:172.21.15.178:6789/0 conn(0x7f3130160d30 legacy=0x7f313006cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3135800700 1 -- 172.21.15.81:0/55335872 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300d03f0 con 0x7f313006b170 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312fe00700 1 --2- 172.21.15.81:0/55335872 >> v2:172.21.15.178:3300/0 conn(0x7f3130161110 0x7f313006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f3135800700 1 --2- 172.21.15.81:0/55335872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f313006b170 0x7f31300b3ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3128009d90 tx=0x7f312800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc07b2ac8aab5d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312f400700 1 -- 172.21.15.81:0/55335872 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800e070 con 0x7f313006b170 2024-09-13T18:54:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312f400700 1 -- 172.21.15.81:0/55335872 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312800bb20 con 0x7f313006b170 2024-09-13T18:54:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.046+0000 7f312f400700 1 -- 172.21.15.81:0/55335872 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128012430 con 0x7f313006b170 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 -- 172.21.15.81:0/55335872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f313006b170 msgr2=0x7f31300b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 --2- 172.21.15.81:0/55335872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f313006b170 0x7f31300b3ca0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3128009d90 tx=0x7f312800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 -- 172.21.15.81:0/55335872 shutdown_connections 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 --2- 172.21.15.81:0/55335872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f313006b170 0x7f31300b3ca0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 --2- 172.21.15.81:0/55335872 >> v2:172.21.15.178:3300/0 conn(0x7f3130161110 0x7f313006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 -- 172.21.15.81:0/55335872 >> 172.21.15.81:0/55335872 conn(0x7f3130071d20 msgr2=0x7f3130072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 -- 172.21.15.81:0/55335872 shutdown_connections 2024-09-13T18:54:18.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.050+0000 7f3136200700 1 -- 172.21.15.81:0/55335872 wait complete. 2024-09-13T18:54:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 Processor -- start 2024-09-13T18:54:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 -- start start 2024-09-13T18:54:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 0x7f31301f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3130160d30 0x7f3130156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3130161110 0x7f31300a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300a89c0 con 0x7f313006b170 2024-09-13T18:54:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313015caa0 con 0x7f3130160d30 2024-09-13T18:54:18.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3136200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3130159fd0 con 0x7f3130161110 2024-09-13T18:54:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 0x7f31301f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 0x7f31301f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51112/0 (socket says 172.21.15.81:51112) 2024-09-13T18:54:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 -- 172.21.15.81:0/3390589428 learned_addr learned my addr 172.21.15.81:0/3390589428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f312fe00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3130160d30 0x7f3130156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3135800700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3130161110 0x7f31300a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 -- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3130161110 msgr2=0x7f31300a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3130161110 0x7f31300a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 -- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3130160d30 msgr2=0x7f3130156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3130160d30 0x7f3130156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 -- 172.21.15.81:0/3390589428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0094b0 con 0x7f313006b170 2024-09-13T18:54:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.054+0000 7f3134e00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 0x7f31301f6600 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f3124001270 tx=0x7f312400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.058+0000 7f312cc00700 1 -- 172.21.15.81:0/3390589428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124005d90 con 0x7f313006b170 2024-09-13T18:54:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.058+0000 7f312cc00700 1 -- 172.21.15.81:0/3390589428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31240070d0 con 0x7f313006b170 2024-09-13T18:54:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.058+0000 7f312cc00700 1 -- 172.21.15.81:0/3390589428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124007480 con 0x7f313006b170 2024-09-13T18:54:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.058+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3128009a70 con 0x7f313006b170 2024-09-13T18:54:18.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.058+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313015a590 con 0x7f313006b170 2024-09-13T18:54:18.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.058+0000 7f312cc00700 1 -- 172.21.15.81:0/3390589428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f31240075e0 con 0x7f313006b170 2024-09-13T18:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.062+0000 7f312cc00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3110066730 0x7f3110068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.062+0000 7f312cc00700 1 -- 172.21.15.81:0/3390589428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f3124083640 con 0x7f313006b170 2024-09-13T18:54:18.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.062+0000 7f312fe00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3110066730 0x7f3110068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.062+0000 7f312fe00700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3110066730 0x7f3110068bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f31301f9b20 tx=0x7f311c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.062+0000 7f313aae4740 1 Processor -- start 2024-09-13T18:54:18.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- start start 2024-09-13T18:54:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x110e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11108520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x1112a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x11071010 con 0x110df310 2024-09-13T18:54:18.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10ffef40 con 0x1112a170 2024-09-13T18:54:18.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11051e30 con 0x11129d90 2024-09-13T18:54:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11108520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11108520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51114/0 (socket says 172.21.15.81:51114) 2024-09-13T18:54:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 -- 172.21.15.81:0/575679796 learned_addr learned my addr 172.21.15.81:0/575679796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f3134e00700 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x110e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f3135800700 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x1112a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 -- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 msgr2=0x110e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x110e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 -- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 msgr2=0x1112a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x1112a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 -- 172.21.15.81:0/575679796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10ebda40 con 0x110df310 2024-09-13T18:54:18.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f312fe00700 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11108520 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f311c011e90 tx=0x7f311c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2425cb2ac9e42229 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f3121600700 1 -- 172.21.15.81:0/575679796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c009ea0 con 0x110df310 2024-09-13T18:54:18.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f3121600700 1 -- 172.21.15.81:0/575679796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c011ec0 con 0x110df310 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f3121600700 1 -- 172.21.15.81:0/575679796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c0215f0 con 0x110df310 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- 172.21.15.81:0/575679796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 msgr2=0x11108520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11108520 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f311c011e90 tx=0x7f311c014000 comp rx=0 tx=0).stop 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- 172.21.15.81:0/575679796 shutdown_connections 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x1112a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11108520 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 --2- 172.21.15.81:0/575679796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x110e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.066+0000 7f313aae4740 1 -- 172.21.15.81:0/575679796 >> 172.21.15.81:0/575679796 conn(0x10e725b0 msgr2=0x110e3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 -- 172.21.15.81:0/575679796 shutdown_connections 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 -- 172.21.15.81:0/575679796 wait complete. 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 -- start start 2024-09-13T18:54:18.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 Processor -- start 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111032a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x1112a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x11107030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1104d150 con 0x110df310 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1104aeb0 con 0x1112a170 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x110088e0 con 0x11129d90 2024-09-13T18:54:18.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f313aae4740 10 client.0 _ll_register_callbacks cb 0x10fe7670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111032a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111032a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51120/0 (socket says 172.21.15.81:51120) 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 -- 172.21.15.81:0/2012843092 learned_addr learned my addr 172.21.15.81:0/2012843092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3135800700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x11107030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 -- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 msgr2=0x1112a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f312fe00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x1112a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x1112a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 -- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 msgr2=0x11107030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x11107030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 -- 172.21.15.81:0/2012843092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c011b40 con 0x110df310 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3135800700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x11107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f312fe00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x1112a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:18.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3134e00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111032a0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f312400cde0 tx=0x7f31240549e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19330bd1e7ce3c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3116000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.070+0000 7f3116000700 1 -- 172.21.15.81:0/2012843092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312405c600 con 0x110df310 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 1 -- 172.21.15.81:0/2012843092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f31240582d0 con 0x110df310 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10ec9540 con 0x110df310 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 1 -- 172.21.15.81:0/2012843092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f312405c890 con 0x110df310 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 10 client.8646 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x11011290 con 0x110df310 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 1 -- 172.21.15.81:0/2012843092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10ec9540 con 0x110df310 2024-09-13T18:54:18.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 1 -- 172.21.15.81:0/2012843092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f312405a260 con 0x110df310 2024-09-13T18:54:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 10 client.8646 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 10 client.8646 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 20 client.8646 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x11104d90 0x11101880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 4 client.8646 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:18.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10eee2c0 con 0x11104d90 2024-09-13T18:54:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f312fe00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x11104d90 0x11101880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 10 client.8646 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f312fe00700 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x11104d90 0x11101880 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff329114a519bd3 server_cookie=b9282d2594ba0874 in_seq=0 out_seq=0 2024-09-13T18:54:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 1 -- 172.21.15.81:0/2012843092 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x10eee2c0 con 0x11104d90 2024-09-13T18:54:18.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 10 client.8646 handle_command_reply: tid=0 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 client.8646 shutdown 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 msgr2=0x111032a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111032a0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f312400cde0 tx=0x7f31240549e0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 shutdown_connections 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x11104d90 0x11101880 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1112a170 0x11107030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x1112a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f3116000700 0 client.8646 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 --2- 172.21.15.81:0/2012843092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111032a0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.074+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 >> 172.21.15.81:0/2012843092 conn(0x10e725b0 msgr2=0x111084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.078+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 shutdown_connections 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.078+0000 7f313aae4740 1 -- 172.21.15.81:0/2012843092 wait complete. 2024-09-13T18:54:18.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.078+0000 7f313aae4740 20 client.8646 trim_cache size 0 max 16384 2024-09-13T18:54:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.094+0000 7f313aae4740 1 Processor -- start 2024-09-13T18:54:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.094+0000 7f313aae4740 1 -- start start 2024-09-13T18:54:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10e725b0 0x11127a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111265a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x11126ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x10ef6b80 con 0x110df310 2024-09-13T18:54:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x110482b0 con 0x10e725b0 2024-09-13T18:54:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10fe9620 con 0x11129d90 2024-09-13T18:54:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111265a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111265a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51134/0 (socket says 172.21.15.81:51134) 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 -- 172.21.15.81:0/2674967511 learned_addr learned my addr 172.21.15.81:0/2674967511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f3134e00700 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10e725b0 0x11127a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f3135800700 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x11126ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 -- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 msgr2=0x11126ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x11126ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 -- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10e725b0 msgr2=0x11127a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10e725b0 0x11127a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 -- 172.21.15.81:0/2674967511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x110e48d0 con 0x110df310 2024-09-13T18:54:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f312fe00700 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111265a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f311c009ac0 tx=0x7f311c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b609ba77193d9350 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f3122000700 1 -- 172.21.15.81:0/2674967511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c02f040 con 0x110df310 2024-09-13T18:54:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f3122000700 1 -- 172.21.15.81:0/2674967511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311c0345a0 con 0x110df310 2024-09-13T18:54:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f3122000700 1 -- 172.21.15.81:0/2674967511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c034910 con 0x110df310 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- 172.21.15.81:0/2674967511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 msgr2=0x111265a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111265a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f311c009ac0 tx=0x7f311c020000 comp rx=0 tx=0).stop 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- 172.21.15.81:0/2674967511 shutdown_connections 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11129d90 0x11126ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x111265a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 --2- 172.21.15.81:0/2674967511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10e725b0 0x11127a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- 172.21.15.81:0/2674967511 >> 172.21.15.81:0/2674967511 conn(0x110e3f10 msgr2=0x11139680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- 172.21.15.81:0/2674967511 shutdown_connections 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.098+0000 7f313aae4740 1 -- 172.21.15.81:0/2674967511 wait complete. 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 -- start start 2024-09-13T18:54:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 Processor -- start 2024-09-13T18:54:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10e725b0 0x1118aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11146e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11129d90 0x111473a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x10fd4a50 con 0x110df310 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x110e3dd0 con 0x11129d90 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x110486c0 con 0x10e725b0 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 10 client.0 _ll_register_callbacks cb 0x11049610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51150/0 (socket says 172.21.15.81:51150) 2024-09-13T18:54:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 -- 172.21.15.81:0/3597258465 learned_addr learned my addr 172.21.15.81:0/3597258465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3135800700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11129d90 0x111473a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3134e00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10e725b0 0x1118aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 -- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10e725b0 msgr2=0x1118aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10e725b0 0x1118aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 -- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11129d90 msgr2=0x111473a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11129d90 0x111473a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 -- 172.21.15.81:0/3597258465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10ebda40 con 0x110df310 2024-09-13T18:54:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3134e00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10e725b0 0x1118aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3135800700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11129d90 0x111473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f312fe00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11146e60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f311c011930 tx=0x7f311c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d09df2b121148c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3116000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3116000700 1 -- 172.21.15.81:0/3597258465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311c02f040 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f3116000700 1 -- 172.21.15.81:0/3597258465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f311c01c040 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.102+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10e7f2c0 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 1 -- 172.21.15.81:0/3597258465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=97) v2 ==== 24+0+0 (secure 0 0 0) 0x7f311c034910 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 10 client.8652 fetch_fsmap learned FSMap version 97 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=97,monmap=2+}) v3 -- 0x10ff74c0 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 1 -- 172.21.15.81:0/3597258465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10e7f2c0 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 1 -- 172.21.15.81:0/3597258465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 97) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f311c004070 con 0x110df310 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 10 client.8652 fetch_fsmap finished waiting for FSMap version 97 2024-09-13T18:54:18.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 10 client.8652 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-13T18:54:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 20 client.8652 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1112a170 0x11140070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 4 client.8652 mds_command: new command op to 8076 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:54:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 --> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1112aab0 con 0x1112a170 2024-09-13T18:54:18.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3134e00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1112a170 0x11140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3134e00700 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1112a170 0x11140070 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a66017f94416c8e server_cookie=95f87d81820ff14f in_seq=0 out_seq=0 2024-09-13T18:54:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 10 client.8652 ms_handle_connect on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 1 -- 172.21.15.81:0/3597258465 <== mds.0 v2:172.21.15.81:6835/2448579226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x1112aab0 con 0x1112a170 2024-09-13T18:54:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 10 client.8652 handle_command_reply: tid=0 2024-09-13T18:54:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 client.8652 shutdown 2024-09-13T18:54:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 msgr2=0x11146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11146e60 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f311c011930 tx=0x7f311c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 shutdown_connections 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:6835/2448579226,v1:172.21.15.81:6837/2448579226] conn(0x1112a170 0x11140070 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11129d90 0x111473a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x110df310 0x11146e60 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3116000700 0 client.8652 ms_handle_reset on v2:172.21.15.81:6835/2448579226 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 --2- 172.21.15.81:0/3597258465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10e725b0 0x1118aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 >> 172.21.15.81:0/3597258465 conn(0x110e3f10 msgr2=0x11126ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 shutdown_connections 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 1 -- 172.21.15.81:0/3597258465 wait complete. 2024-09-13T18:54:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f313aae4740 20 client.8652 trim_cache size 0 max 16384 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "044c02c8-eb41-4dc3-8bfc-c50acb7b1630": { 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "044c02c8-eb41-4dc3-8bfc-c50acb7b1630", 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:18.120 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3110066730 msgr2=0x7f3110068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3110066730 0x7f3110068bf0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f31301f9b20 tx=0x7f311c009240 comp rx=0 tx=0).stop 2024-09-13T18:54:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 msgr2=0x7f31301f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 0x7f31301f6600 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f3124001270 tx=0x7f312400c9e0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 shutdown_connections 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3110066730 0x7f3110068bf0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3130161110 0x7f31300a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3130160d30 0x7f3130156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 --2- 172.21.15.81:0/3390589428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f313006b170 0x7f31301f6600 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.106+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 >> 172.21.15.81:0/3390589428 conn(0x7f3130071d20 msgr2=0x7f31301615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.110+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 shutdown_connections 2024-09-13T18:54:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.110+0000 7f3136200700 1 -- 172.21.15.81:0/3390589428 wait complete. 2024-09-13T18:54:18.140 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:54:18.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.298+0000 7f2d4c600700 1 Processor -- start 2024-09-13T18:54:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.298+0000 7f2d4c600700 1 -- start start 2024-09-13T18:54:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4c600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d4406c460 0x7f2d4406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4c600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406a5d0 0x7f2d4406aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4c600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440cdd90 con 0x7f2d4415b700 2024-09-13T18:54:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4c600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4406ce10 con 0x7f2d4406c460 2024-09-13T18:54:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4c600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4406af50 con 0x7f2d4406a5d0 2024-09-13T18:54:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d49c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d4415b700 0x7f2d4415bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59130/0 (socket says 172.21.15.81:59130) 2024-09-13T18:54:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d49c00700 1 -- 172.21.15.81:0/24704505 learned_addr learned my addr 172.21.15.81:0/24704505 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4a600700 1 --2- 172.21.15.81:0/24704505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406a5d0 0x7f2d4406aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d49200700 1 --2- 172.21.15.81:0/24704505 >> v2:172.21.15.178:3300/0 conn(0x7f2d4406c460 0x7f2d4406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d43e00700 1 -- 172.21.15.81:0/24704505 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339137393 0 0) 0x7f2d440cdd90 con 0x7f2d4415b700 2024-09-13T18:54:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d43e00700 1 -- 172.21.15.81:0/24704505 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d2c0035d0 con 0x7f2d4415b700 2024-09-13T18:54:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4a600700 1 -- 172.21.15.81:0/24704505 >> v2:172.21.15.178:3300/0 conn(0x7f2d4406c460 msgr2=0x7f2d4406d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4a600700 1 --2- 172.21.15.81:0/24704505 >> v2:172.21.15.178:3300/0 conn(0x7f2d4406c460 0x7f2d4406d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4a600700 1 -- 172.21.15.81:0/24704505 >> v1:172.21.15.81:6789/0 conn(0x7f2d4415b700 legacy=0x7f2d4415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.302+0000 7f2d4a600700 1 -- 172.21.15.81:0/24704505 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4406d7e0 con 0x7f2d4406a5d0 2024-09-13T18:54:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4a600700 1 --2- 172.21.15.81:0/24704505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406a5d0 0x7f2d4406aa10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009d90 tx=0x7f2d3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=337f545c8afa705c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d43e00700 1 -- 172.21.15.81:0/24704505 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00e070 con 0x7f2d4406a5d0 2024-09-13T18:54:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d43e00700 1 -- 172.21.15.81:0/24704505 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00bb20 con 0x7f2d4406a5d0 2024-09-13T18:54:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d43e00700 1 -- 172.21.15.81:0/24704505 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c012430 con 0x7f2d4406a5d0 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 -- 172.21.15.81:0/24704505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406a5d0 msgr2=0x7f2d4406aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 --2- 172.21.15.81:0/24704505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406a5d0 0x7f2d4406aa10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009d90 tx=0x7f2d3c00b330 comp rx=0 tx=0).stop 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 -- 172.21.15.81:0/24704505 shutdown_connections 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 --2- 172.21.15.81:0/24704505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406a5d0 0x7f2d4406aa10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 --2- 172.21.15.81:0/24704505 >> v2:172.21.15.178:3300/0 conn(0x7f2d4406c460 0x7f2d4406d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 -- 172.21.15.81:0/24704505 >> 172.21.15.81:0/24704505 conn(0x7f2d440b08d0 msgr2=0x7f2d440b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 -- 172.21.15.81:0/24704505 shutdown_connections 2024-09-13T18:54:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.306+0000 7f2d4c600700 1 -- 172.21.15.81:0/24704505 wait complete. 2024-09-13T18:54:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 Processor -- start 2024-09-13T18:54:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 -- start start 2024-09-13T18:54:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 0x7f2d4414dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406c460 0x7f2d44146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d4415b700 0x7f2d440ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441594e0 con 0x7f2d4406a5d0 2024-09-13T18:54:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44159670 con 0x7f2d4415b700 2024-09-13T18:54:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4c600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44146990 con 0x7f2d4406c460 2024-09-13T18:54:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 0x7f2d4414dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 0x7f2d4414dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51156/0 (socket says 172.21.15.81:51156) 2024-09-13T18:54:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406c460 0x7f2d44146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 -- 172.21.15.81:0/4137260135 learned_addr learned my addr 172.21.15.81:0/4137260135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d4a600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d4415b700 0x7f2d440ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 -- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406c460 msgr2=0x7f2d44146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406c460 0x7f2d44146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 -- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d4415b700 msgr2=0x7f2d440ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d4415b700 0x7f2d440ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 -- 172.21.15.81:0/4137260135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009a70 con 0x7f2d4406a5d0 2024-09-13T18:54:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.310+0000 7f2d49c00700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 0x7f2d4414dc50 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c4d0 tx=0x7f2d3800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.314+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38005d90 con 0x7f2d4406a5d0 2024-09-13T18:54:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.314+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d380070d0 con 0x7f2d4406a5d0 2024-09-13T18:54:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.314+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d44158890 con 0x7f2d4406a5d0 2024-09-13T18:54:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.314+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38007480 con 0x7f2d4406a5d0 2024-09-13T18:54:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.314+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4414e350 con 0x7f2d4406a5d0 2024-09-13T18:54:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.314+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4406aa10 con 0x7f2d4406a5d0 2024-09-13T18:54:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.318+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d380075e0 con 0x7f2d4406a5d0 2024-09-13T18:54:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.318+0000 7f2d41600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d24066730 0x7f2d24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.318+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2d38083750 con 0x7f2d4406a5d0 2024-09-13T18:54:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.318+0000 7f2d49200700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d24066730 0x7f2d24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.318+0000 7f2d49200700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d24066730 0x7f2d24068bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2d44158c10 tx=0x7f2d30009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.322+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d380508f0 con 0x7f2d4406a5d0 2024-09-13T18:54:18.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.558+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d4406c240 con 0x7f2d4406a5d0 2024-09-13T18:54:18.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.562+0000 7f2d41600700 1 -- 172.21.15.81:0/4137260135 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f2d38053f10 con 0x7f2d4406a5d0 2024-09-13T18:54:18.571 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:18.572 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d24066730 msgr2=0x7f2d24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d24066730 0x7f2d24068bf0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2d44158c10 tx=0x7f2d30009240 comp rx=0 tx=0).stop 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 msgr2=0x7f2d4414dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 0x7f2d4414dc50 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c4d0 tx=0x7f2d3800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 shutdown_connections 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d24066730 0x7f2d24068bf0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d4415b700 0x7f2d440ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d4406c460 0x7f2d44146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 --2- 172.21.15.81:0/4137260135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d4406a5d0 0x7f2d4414dc50 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 >> 172.21.15.81:0/4137260135 conn(0x7f2d440b08d0 msgr2=0x7f2d440b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 shutdown_connections 2024-09-13T18:54:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.566+0000 7f2d4c600700 1 -- 172.21.15.81:0/4137260135 wait complete. 2024-09-13T18:54:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:18.599 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:18.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 Processor -- start 2024-09-13T18:54:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 -- start start 2024-09-13T18:54:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068009ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f20680eb420 0x7f206804ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 0x7f206804f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206801cfa0 con 0x7f2068007260 2024-09-13T18:54:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206801c670 con 0x7f20680eb420 2024-09-13T18:54:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.762+0000 7f2076a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206801c950 con 0x7f2068033ac0 2024-09-13T18:54:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2076000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 0x7f206804f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f20680eb420 0x7f206804ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2075600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068009ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2076000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 0x7f206804f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51172/0 (socket says 172.21.15.81:51172) 2024-09-13T18:54:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2076000700 1 -- 172.21.15.81:0/3828221843 learned_addr learned my addr 172.21.15.81:0/3828221843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 -- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 msgr2=0x7f2068009ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 --2- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068009ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 -- 172.21.15.81:0/3828221843 >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 msgr2=0x7f206804f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 --2- 172.21.15.81:0/3828221843 >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 0x7f206804f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 -- 172.21.15.81:0/3828221843 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206801cc30 con 0x7f20680eb420 2024-09-13T18:54:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2076000700 1 --2- 172.21.15.81:0/3828221843 >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 0x7f206804f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:18.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f2074c00700 1 --2- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680eb420 0x7f206804ec10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2068022590 tx=0x7f205c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a10b515bd7ea0954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f206fe00700 1 -- 172.21.15.81:0/3828221843 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c011830 con 0x7f20680eb420 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f206fe00700 1 -- 172.21.15.81:0/3828221843 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205c011990 con 0x7f20680eb420 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.766+0000 7f206fe00700 1 -- 172.21.15.81:0/3828221843 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c011d20 con 0x7f20680eb420 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 -- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680eb420 msgr2=0x7f206804ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 --2- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680eb420 0x7f206804ec10 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2068022590 tx=0x7f205c009b30 comp rx=0 tx=0).stop 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 -- 172.21.15.81:0/3828221843 shutdown_connections 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 --2- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680eb420 0x7f206804ec10 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 --2- 172.21.15.81:0/3828221843 >> v2:172.21.15.81:3300/0 conn(0x7f2068007260 0x7f206804f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 --2- 172.21.15.81:0/3828221843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068009ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 -- 172.21.15.81:0/3828221843 >> 172.21.15.81:0/3828221843 conn(0x7f2068036140 msgr2=0x7f2068036550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 -- 172.21.15.81:0/3828221843 shutdown_connections 2024-09-13T18:54:18.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 -- 172.21.15.81:0/3828221843 wait complete. 2024-09-13T18:54:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 Processor -- start 2024-09-13T18:54:18.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.770+0000 7f2076a00700 1 -- start start 2024-09-13T18:54:18.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 0x7f20680dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068039e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680e61f0 0x7f2068032850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2068038db0 con 0x7f2068007260 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2068039090 con 0x7f20680e61f0 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2068039370 con 0x7f2068033ac0 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 0x7f20680dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 0x7f20680dbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51180/0 (socket says 172.21.15.81:51180) 2024-09-13T18:54:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 -- 172.21.15.81:0/3393984045 learned_addr learned my addr 172.21.15.81:0/3393984045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2074c00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068039e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076000700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680e61f0 0x7f2068032850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 -- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 msgr2=0x7f2068039e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068039e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 -- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680e61f0 msgr2=0x7f2068032850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680e61f0 0x7f2068032850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 -- 172.21.15.81:0/3393984045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0094b0 con 0x7f2068007260 2024-09-13T18:54:18.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2075600700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 0x7f20680dbb60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f206400e930 tx=0x7f206400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064009690 con 0x7f2068007260 2024-09-13T18:54:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064013680 con 0x7f2068007260 2024-09-13T18:54:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064013a10 con 0x7f2068007260 2024-09-13T18:54:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2068039650 con 0x7f2068007260 2024-09-13T18:54:18.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.774+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206803a390 con 0x7f2068007260 2024-09-13T18:54:18.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.778+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2068009ba0 con 0x7f2068007260 2024-09-13T18:54:18.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.778+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2064013b70 con 0x7f2068007260 2024-09-13T18:54:18.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.778+0000 7f206d600700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2050066730 0x7f2050068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.778+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2064084580 con 0x7f2068007260 2024-09-13T18:54:18.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.778+0000 7f2074c00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2050066730 0x7f2050068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:18.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.782+0000 7f2074c00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2050066730 0x7f2050068bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f206803a6e0 tx=0x7f205c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:18.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:18.786+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f20640516a0 con 0x7f2068007260 2024-09-13T18:54:19.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.026+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f206801dd50 con 0x7f2068007260 2024-09-13T18:54:19.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.026+0000 7f206d600700 1 -- 172.21.15.81:0/3393984045 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1965 (secure 0 0 0) 0x7f2064054cc0 con 0x7f2068007260 2024-09-13T18:54:19.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:19.038 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":448,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694945,"bytes_used":265797632,"bytes_avail":772828315648,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6482,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":97,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2024-09-13T18:54:15.113083+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2050066730 msgr2=0x7f2050068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2050066730 0x7f2050068bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f206803a6e0 tx=0x7f205c008030 comp rx=0 tx=0).stop 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 msgr2=0x7f20680dbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 0x7f20680dbb60 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f206400e930 tx=0x7f206400ec40 comp rx=0 tx=0).stop 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 shutdown_connections 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2050066730 0x7f2050068bf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20680e61f0 0x7f2068032850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2068033ac0 0x7f2068039e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 --2- 172.21.15.81:0/3393984045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2068007260 0x7f20680dbb60 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 >> 172.21.15.81:0/3393984045 conn(0x7f2068036140 msgr2=0x7f20680ea1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:19.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 shutdown_connections 2024-09-13T18:54:19.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:19.030+0000 7f2076a00700 1 -- 172.21.15.81:0/3393984045 wait complete. 2024-09-13T18:54:19.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:54:20.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:20.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.234+0000 7fd795400700 1 Processor -- start 2024-09-13T18:54:20.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.234+0000 7fd795400700 1 -- start start 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd795400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd79006a5d0 0x7fd790071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd795400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd7900b19f0 0x7fd79006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd795400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7900cd610 0x7fd79006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd795400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900ce140 con 0x7fd79006a5d0 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd795400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7900b1e60 con 0x7fd7900b19f0 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd795400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79006aef0 con 0x7fd7900cd610 2024-09-13T18:54:20.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd79006a5d0 0x7fd790071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd79006a5d0 0x7fd790071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51194/0 (socket says 172.21.15.81:51194) 2024-09-13T18:54:20.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 -- 172.21.15.81:0/1184718669 learned_addr learned my addr 172.21.15.81:0/1184718669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:20.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78f200700 1 --2- 172.21.15.81:0/1184718669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7900cd610 0x7fd79006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd787e00700 1 --2- 172.21.15.81:0/1184718669 >> v2:172.21.15.178:3300/0 conn(0x7fd7900b19f0 0x7fd79006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 -- 172.21.15.81:0/1184718669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7900cd610 msgr2=0x7fd79006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:20.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 --2- 172.21.15.81:0/1184718669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7900cd610 0x7fd79006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 -- 172.21.15.81:0/1184718669 >> v2:172.21.15.178:3300/0 conn(0x7fd7900b19f0 msgr2=0x7fd79006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 --2- 172.21.15.81:0/1184718669 >> v2:172.21.15.178:3300/0 conn(0x7fd7900b19f0 0x7fd79006a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 -- 172.21.15.81:0/1184718669 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900cde60 con 0x7fd79006a5d0 2024-09-13T18:54:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.238+0000 7fd78e800700 1 --2- 172.21.15.81:0/1184718669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd79006a5d0 0x7fd790071d20 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fd790070290 tx=0x7fd780009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77971112df696b68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd78de00700 1 -- 172.21.15.81:0/1184718669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000b8a0 con 0x7fd79006a5d0 2024-09-13T18:54:20.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd78de00700 1 -- 172.21.15.81:0/1184718669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78000ba00 con 0x7fd79006a5d0 2024-09-13T18:54:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd78de00700 1 -- 172.21.15.81:0/1184718669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78000bd90 con 0x7fd79006a5d0 2024-09-13T18:54:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 -- 172.21.15.81:0/1184718669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd79006a5d0 msgr2=0x7fd790071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 --2- 172.21.15.81:0/1184718669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd79006a5d0 0x7fd790071d20 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fd790070290 tx=0x7fd780009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 -- 172.21.15.81:0/1184718669 shutdown_connections 2024-09-13T18:54:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 --2- 172.21.15.81:0/1184718669 >> v2:172.21.15.178:3300/0 conn(0x7fd7900b19f0 0x7fd79006a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 --2- 172.21.15.81:0/1184718669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7900cd610 0x7fd79006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 --2- 172.21.15.81:0/1184718669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd79006a5d0 0x7fd790071d20 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 -- 172.21.15.81:0/1184718669 >> 172.21.15.81:0/1184718669 conn(0x7fd7900b08d0 msgr2=0x7fd7900b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 -- 172.21.15.81:0/1184718669 shutdown_connections 2024-09-13T18:54:20.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 -- 172.21.15.81:0/1184718669 wait complete. 2024-09-13T18:54:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.242+0000 7fd795400700 1 Processor -- start 2024-09-13T18:54:20.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 -- start start 2024-09-13T18:54:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79006a5d0 0x7fd7901f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 0x7fd790144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7900cd610 0x7fd790162cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901425e0 con 0x7fd7900b19f0 2024-09-13T18:54:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901438c0 con 0x7fd7900cd610 2024-09-13T18:54:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd795400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd790143ba0 con 0x7fd79006a5d0 2024-09-13T18:54:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 0x7fd790144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 0x7fd790144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51202/0 (socket says 172.21.15.81:51202) 2024-09-13T18:54:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 -- 172.21.15.81:0/142988043 learned_addr learned my addr 172.21.15.81:0/142988043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:20.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd78e800700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79006a5d0 0x7fd7901f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd78f200700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7900cd610 0x7fd790162cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 -- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79006a5d0 msgr2=0x7fd7901f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79006a5d0 0x7fd7901f7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 -- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7900cd610 msgr2=0x7fd790162cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7900cd610 0x7fd790162cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 -- 172.21.15.81:0/142988043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780009570 con 0x7fd7900b19f0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd787e00700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 0x7fd790144960 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fd77800d800 tx=0x7fd77800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.246+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7780125f0 con 0x7fd7900b19f0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd778012750 con 0x7fd7900b19f0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd790143e80 con 0x7fd7900b19f0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778012ac0 con 0x7fd7900b19f0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd790144440 con 0x7fd7900b19f0 2024-09-13T18:54:20.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd79006b100 con 0x7fd7900b19f0 2024-09-13T18:54:20.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd778012c20 con 0x7fd7900b19f0 2024-09-13T18:54:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd786a00700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd76c066730 0x7fd76c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.250+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd778084360 con 0x7fd7900b19f0 2024-09-13T18:54:20.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.254+0000 7fd78e800700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd76c066730 0x7fd76c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.254+0000 7fd78e800700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd76c066730 0x7fd76c068bf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd780000c00 tx=0x7fd780008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:20.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.258+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7780515a0 con 0x7fd7900b19f0 2024-09-13T18:54:20.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:54:20.470+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:54:20.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.482+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7900b0470 con 0x7fd7900b19f0 2024-09-13T18:54:20.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd786a00700 1 -- 172.21.15.81:0/142988043 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7fd778054bc0 con 0x7fd7900b19f0 2024-09-13T18:54:20.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:20.495 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:20.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd76c066730 msgr2=0x7fd76c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd76c066730 0x7fd76c068bf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd780000c00 tx=0x7fd780008030 comp rx=0 tx=0).stop 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 msgr2=0x7fd790144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 0x7fd790144960 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fd77800d800 tx=0x7fd77800db10 comp rx=0 tx=0).stop 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 shutdown_connections 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd76c066730 0x7fd76c068bf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7900cd610 0x7fd790162cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7900b19f0 0x7fd790144960 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 --2- 172.21.15.81:0/142988043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd79006a5d0 0x7fd7901f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 >> 172.21.15.81:0/142988043 conn(0x7fd7900b08d0 msgr2=0x7fd7900b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 shutdown_connections 2024-09-13T18:54:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.486+0000 7fd795400700 1 -- 172.21.15.81:0/142988043 wait complete. 2024-09-13T18:54:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:20.518 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:20.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.674+0000 7fddbe600700 1 Processor -- start 2024-09-13T18:54:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddbe600700 1 -- start start 2024-09-13T18:54:20.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddbe600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fddb806ac80 0x7fddb806a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddbe600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb806d440 con 0x7fddb806cf80 2024-09-13T18:54:20.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddbe600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb80b4b90 con 0x7fddb80b5670 2024-09-13T18:54:20.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddbe600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80b4980 con 0x7fddb806ac80 2024-09-13T18:54:20.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddb6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fddb806cf80 0x7fddb806b060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59136/0 (socket says 172.21.15.81:59136) 2024-09-13T18:54:20.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddb6a00700 1 -- 172.21.15.81:0/728339962 learned_addr learned my addr 172.21.15.81:0/728339962 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.678+0000 7fddb7400700 1 --2- 172.21.15.81:0/728339962 >> v2:172.21.15.178:3300/0 conn(0x7fddb806ac80 0x7fddb806a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009225024 0 0) 0x7fddb806d440 con 0x7fddb806cf80 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd9c0035d0 con 0x7fddb806cf80 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081682065 0 0) 0x7fddb80b4b90 con 0x7fddb80b5670 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb806d440 con 0x7fddb80b5670 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb7400700 1 -- 172.21.15.81:0/728339962 >> v1:172.21.15.178:6789/0 conn(0x7fddb80b5670 legacy=0x7fddb806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb7400700 1 -- 172.21.15.81:0/728339962 >> v1:172.21.15.81:6789/0 conn(0x7fddb806cf80 legacy=0x7fddb806b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb7400700 1 -- 172.21.15.81:0/728339962 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80b4e70 con 0x7fddb806ac80 2024-09-13T18:54:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb7400700 1 --2- 172.21.15.81:0/728339962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb806a470 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009880 tx=0x7fdda8009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7244c046364523b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011830 con 0x7fddb806ac80 2024-09-13T18:54:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8011990 con 0x7fddb806ac80 2024-09-13T18:54:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddb6000700 1 -- 172.21.15.81:0/728339962 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8011d20 con 0x7fddb806ac80 2024-09-13T18:54:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 -- 172.21.15.81:0/728339962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 msgr2=0x7fddb806a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 --2- 172.21.15.81:0/728339962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb806a470 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009880 tx=0x7fdda8009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 -- 172.21.15.81:0/728339962 shutdown_connections 2024-09-13T18:54:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 --2- 172.21.15.81:0/728339962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb806a470 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 -- 172.21.15.81:0/728339962 >> 172.21.15.81:0/728339962 conn(0x7fddb80b2700 msgr2=0x7fddb80b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 -- 172.21.15.81:0/728339962 shutdown_connections 2024-09-13T18:54:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.682+0000 7fddbe600700 1 -- 172.21.15.81:0/728339962 wait complete. 2024-09-13T18:54:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 Processor -- start 2024-09-13T18:54:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 -- start start 2024-09-13T18:54:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb813f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb806cf80 0x7fddb8156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 0x7fddb81f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8157980 con 0x7fddb80b5670 2024-09-13T18:54:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8156d70 con 0x7fddb806ac80 2024-09-13T18:54:20.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddbe600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8157050 con 0x7fddb806cf80 2024-09-13T18:54:20.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 0x7fddb81f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 0x7fddb81f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51204/0 (socket says 172.21.15.81:51204) 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 -- 172.21.15.81:0/4163796416 learned_addr learned my addr 172.21.15.81:0/4163796416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7400700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb813f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb6a00700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb806cf80 0x7fddb8156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 -- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb806cf80 msgr2=0x7fddb8156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb806cf80 0x7fddb8156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 -- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 msgr2=0x7fddb813f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb813f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.686+0000 7fddb7e00700 1 -- 172.21.15.81:0/4163796416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80094b0 con 0x7fddb80b5670 2024-09-13T18:54:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddb7e00700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 0x7fddb81f6390 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fddb000cc20 tx=0x7fddb000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0003c20 con 0x7fddb80b5670 2024-09-13T18:54:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb0003d80 con 0x7fddb80b5670 2024-09-13T18:54:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb8157330 con 0x7fddb80b5670 2024-09-13T18:54:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000ab90 con 0x7fddb80b5670 2024-09-13T18:54:20.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb8156a60 con 0x7fddb80b5670 2024-09-13T18:54:20.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.690+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb8067790 con 0x7fddb80b5670 2024-09-13T18:54:20.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.694+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fddb000acf0 con 0x7fddb80b5670 2024-09-13T18:54:20.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.694+0000 7fddaf400700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdd98066730 0x7fdd98068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:20.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.694+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fddb0084580 con 0x7fddb80b5670 2024-09-13T18:54:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.694+0000 7fddb7400700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdd98066730 0x7fdd98068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.694+0000 7fddb7400700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdd98066730 0x7fdd98068bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdda80090b0 tx=0x7fdda801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:20.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.698+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fddb0051600 con 0x7fddb80b5670 2024-09-13T18:54:20.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.938+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fddb80b5ac0 con 0x7fddb80b5670 2024-09-13T18:54:20.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.938+0000 7fddaf400700 1 -- 172.21.15.81:0/4163796416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1983 (secure 0 0 0) 0x7fddb0054c20 con 0x7fddb80b5670 2024-09-13T18:54:20.950 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:20.950 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":450,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":265805824,"bytes_avail":772828307456,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7165,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":97,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-13T18:54:19.114802+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:54:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdd98066730 msgr2=0x7fdd98068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdd98066730 0x7fdd98068bf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fdda80090b0 tx=0x7fdda801c040 comp rx=0 tx=0).stop 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 msgr2=0x7fddb81f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 0x7fddb81f6390 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fddb000cc20 tx=0x7fddb000cf30 comp rx=0 tx=0).stop 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 shutdown_connections 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdd98066730 0x7fdd98068bf0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddb80b5670 0x7fddb81f6390 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fddb806cf80 0x7fddb8156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 --2- 172.21.15.81:0/4163796416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fddb806ac80 0x7fddb813f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 >> 172.21.15.81:0/4163796416 conn(0x7fddb80b2700 msgr2=0x7fddb806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 shutdown_connections 2024-09-13T18:54:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:20.942+0000 7fddbe600700 1 -- 172.21.15.81:0/4163796416 wait complete. 2024-09-13T18:54:20.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:54:21.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 Processor -- start 2024-09-13T18:54:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 -- start start 2024-09-13T18:54:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a240b3f30 0x7f5a2406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a2406a390 0x7f5a240cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2406a890 con 0x7f5a241599f0 2024-09-13T18:54:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2406ab70 con 0x7f5a2406a390 2024-09-13T18:54:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.146+0000 7f5a29800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2406ae50 con 0x7f5a240b3f30 2024-09-13T18:54:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a22a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5a241599f0 0x7f5a240b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59152/0 (socket says 172.21.15.81:59152) 2024-09-13T18:54:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a22a00700 1 -- 172.21.15.81:0/4206526879 learned_addr learned my addr 172.21.15.81:0/4206526879 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a23400700 1 --2- 172.21.15.81:0/4206526879 >> v2:172.21.15.81:3300/0 conn(0x7f5a2406a390 0x7f5a240cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a22000700 1 --2- 172.21.15.81:0/4206526879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a240b3f30 0x7f5a2406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a21600700 1 -- 172.21.15.81:0/4206526879 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1350873228 0 0) 0x7f5a2406a890 con 0x7f5a241599f0 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a21600700 1 -- 172.21.15.81:0/4206526879 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a080035d0 con 0x7f5a241599f0 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a23400700 1 -- 172.21.15.81:0/4206526879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a240b3f30 msgr2=0x7f5a2406b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a23400700 1 --2- 172.21.15.81:0/4206526879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a240b3f30 0x7f5a2406b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a23400700 1 -- 172.21.15.81:0/4206526879 >> v1:172.21.15.81:6789/0 conn(0x7f5a241599f0 legacy=0x7f5a240b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a23400700 1 -- 172.21.15.81:0/4206526879 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2406b130 con 0x7f5a2406a390 2024-09-13T18:54:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a23400700 1 --2- 172.21.15.81:0/4206526879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2406a390 0x7f5a240cce00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009d90 tx=0x7f5a1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25779ae509142a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a21600700 1 -- 172.21.15.81:0/4206526879 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c00e070 con 0x7f5a2406a390 2024-09-13T18:54:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a21600700 1 -- 172.21.15.81:0/4206526879 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1c00bb20 con 0x7f5a2406a390 2024-09-13T18:54:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a21600700 1 -- 172.21.15.81:0/4206526879 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1c012430 con 0x7f5a2406a390 2024-09-13T18:54:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a29800700 1 -- 172.21.15.81:0/4206526879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2406a390 msgr2=0x7f5a240cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a29800700 1 --2- 172.21.15.81:0/4206526879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2406a390 0x7f5a240cce00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c009d90 tx=0x7f5a1c00b330 comp rx=0 tx=0).stop 2024-09-13T18:54:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a29800700 1 -- 172.21.15.81:0/4206526879 shutdown_connections 2024-09-13T18:54:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a29800700 1 --2- 172.21.15.81:0/4206526879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a2406a390 0x7f5a240cce00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a29800700 1 --2- 172.21.15.81:0/4206526879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a240b3f30 0x7f5a2406b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.150+0000 7f5a29800700 1 -- 172.21.15.81:0/4206526879 >> 172.21.15.81:0/4206526879 conn(0x7f5a240b1e00 msgr2=0x7f5a240cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:22.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 -- 172.21.15.81:0/4206526879 shutdown_connections 2024-09-13T18:54:22.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 -- 172.21.15.81:0/4206526879 wait complete. 2024-09-13T18:54:22.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 Processor -- start 2024-09-13T18:54:22.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 -- start start 2024-09-13T18:54:22.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a2406a390 0x7f5a2413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 0x7f5a240cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a241599f0 0x7f5a240cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240cffd0 con 0x7f5a240b3f30 2024-09-13T18:54:22.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241e3220 con 0x7f5a241599f0 2024-09-13T18:54:22.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a29800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a240cf730 con 0x7f5a2406a390 2024-09-13T18:54:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.154+0000 7f5a22000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 0x7f5a240cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 0x7f5a240cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51216/0 (socket says 172.21.15.81:51216) 2024-09-13T18:54:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 -- 172.21.15.81:0/1517071063 learned_addr learned my addr 172.21.15.81:0/1517071063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a23400700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a241599f0 0x7f5a240cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22a00700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a2406a390 0x7f5a2413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 -- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a2406a390 msgr2=0x7f5a2413fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a2406a390 0x7f5a2413fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 -- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a241599f0 msgr2=0x7f5a240cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a241599f0 0x7f5a240cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 -- 172.21.15.81:0/1517071063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c009a70 con 0x7f5a240b3f30 2024-09-13T18:54:22.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a22000700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 0x7f5a240cec70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000e9d0 tx=0x7f5a1000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10009720 con 0x7f5a240b3f30 2024-09-13T18:54:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1000c850 con 0x7f5a240b3f30 2024-09-13T18:54:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000cbc0 con 0x7f5a240b3f30 2024-09-13T18:54:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a240cfa10 con 0x7f5a240b3f30 2024-09-13T18:54:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a241401e0 con 0x7f5a240b3f30 2024-09-13T18:54:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.158+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a241e2ff0 con 0x7f5a240b3f30 2024-09-13T18:54:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.162+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5a1000cd20 con 0x7f5a240b3f30 2024-09-13T18:54:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.162+0000 7f5a1aa00700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a04066730 0x7f5a04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.162+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f5a10084460 con 0x7f5a240b3f30 2024-09-13T18:54:22.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.162+0000 7f5a22a00700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a04066730 0x7f5a04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.162+0000 7f5a22a00700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a04066730 0x7f5a04068bf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5a140011e0 tx=0x7f5a14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.170+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5a241e2ff0 con 0x7f5a240b3f30 2024-09-13T18:54:22.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.394+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a241e2ff0 con 0x7f5a240b3f30 2024-09-13T18:54:22.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.398+0000 7f5a1aa00700 1 -- 172.21.15.81:0/1517071063 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f5a241e2ff0 con 0x7f5a240b3f30 2024-09-13T18:54:22.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:22.407 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a04066730 msgr2=0x7f5a04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a04066730 0x7f5a04068bf0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5a140011e0 tx=0x7f5a14009040 comp rx=0 tx=0).stop 2024-09-13T18:54:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 msgr2=0x7f5a240cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 0x7f5a240cec70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000e9d0 tx=0x7f5a1000ed90 comp rx=0 tx=0).stop 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 shutdown_connections 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5a04066730 0x7f5a04068bf0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a241599f0 0x7f5a240cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a240b3f30 0x7f5a240cec70 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 --2- 172.21.15.81:0/1517071063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a2406a390 0x7f5a2413fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 >> 172.21.15.81:0/1517071063 conn(0x7f5a240b1e00 msgr2=0x7f5a2406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 shutdown_connections 2024-09-13T18:54:22.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.402+0000 7f5a29800700 1 -- 172.21.15.81:0/1517071063 wait complete. 2024-09-13T18:54:22.414 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:22.433 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:22.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1cee400700 1 Processor -- start 2024-09-13T18:54:22.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1cee400700 1 -- start start 2024-09-13T18:54:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1cee400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ce80ce4f0 0x7f1ce80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1cee400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce81620e0 con 0x7f1ce8147050 2024-09-13T18:54:22.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1cee400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce8147670 con 0x7f1ce80b1050 2024-09-13T18:54:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1cee400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce8144440 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1ce7e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1ce8147050 0x7f1ce8144680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59162/0 (socket says 172.21.15.81:59162) 2024-09-13T18:54:22.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1ce7e00700 1 -- 172.21.15.81:0/3652452257 learned_addr learned my addr 172.21.15.81:0/3652452257 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.590+0000 7f1ce7400700 1 --2- 172.21.15.81:0/3652452257 >> v2:172.21.15.178:3300/0 conn(0x7f1ce80ce4f0 0x7f1ce80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485855022 0 0) 0x7f1ce81620e0 con 0x7f1ce8147050 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ccc0035d0 con 0x7f1ce8147050 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103589608 0 0) 0x7f1ce8147670 con 0x7f1ce80b1050 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce81620e0 con 0x7f1ce80b1050 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce7400700 1 -- 172.21.15.81:0/3652452257 >> v1:172.21.15.178:6789/0 conn(0x7f1ce80b1050 legacy=0x7f1ce8146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce7400700 1 -- 172.21.15.81:0/3652452257 >> v1:172.21.15.81:6789/0 conn(0x7f1ce8147050 legacy=0x7f1ce8144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce7400700 1 -- 172.21.15.81:0/3652452257 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce8162570 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce7400700 1 --2- 172.21.15.81:0/3652452257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce80b0b10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009850 tx=0x7f1cd8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1726c3758777858 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011830 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8011990 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1ce6000700 1 -- 172.21.15.81:0/3652452257 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8011d40 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 -- 172.21.15.81:0/3652452257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80ce4f0 msgr2=0x7f1ce80b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 --2- 172.21.15.81:0/3652452257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce80b0b10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009850 tx=0x7f1cd8009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 -- 172.21.15.81:0/3652452257 shutdown_connections 2024-09-13T18:54:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 --2- 172.21.15.81:0/3652452257 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce80b0b10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 -- 172.21.15.81:0/3652452257 >> 172.21.15.81:0/3652452257 conn(0x7f1ce806a7b0 msgr2=0x7f1ce806abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 -- 172.21.15.81:0/3652452257 shutdown_connections 2024-09-13T18:54:22.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.594+0000 7f1cee400700 1 -- 172.21.15.81:0/3652452257 wait complete. 2024-09-13T18:54:22.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 Processor -- start 2024-09-13T18:54:22.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 -- start start 2024-09-13T18:54:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80b1050 0x7f1ce80af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce8134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce8147050 0x7f1ce81550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce81615d0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8154c10 con 0x7f1ce80b1050 2024-09-13T18:54:22.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1cee400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce8137390 con 0x7f1ce8147050 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.598+0000 7f1ce6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce8134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce8134790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51220/0 (socket says 172.21.15.81:51220) 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 -- 172.21.15.81:0/2498004632 learned_addr learned my addr 172.21.15.81:0/2498004632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce7400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80b1050 0x7f1ce80af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce7e00700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce8147050 0x7f1ce81550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 -- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce8147050 msgr2=0x7f1ce81550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce8147050 0x7f1ce81550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 -- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80b1050 msgr2=0x7f1ce80af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80b1050 0x7f1ce80af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 -- 172.21.15.81:0/2498004632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80094b0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1ce6a00700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce8134790 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c730 tx=0x7f1cd400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:22.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40052d0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd4005450 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce8137670 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40038e0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce8143ae0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.602+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8154dc0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.606+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1cd4003a40 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.606+0000 7f1cdf400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc8066760 0x7f1cc8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:22.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.606+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1cd4083790 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.606+0000 7f1ce7400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc8066760 0x7f1cc8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:22.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.610+0000 7f1ce7400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc8066760 0x7f1cc8068c20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80090b0 tx=0x7f1cd8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:22.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.614+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1ce8154dc0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.861+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1ce8154d80 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.861+0000 7f1cdf400700 1 -- 172.21.15.81:0/2498004632 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1963 (secure 0 0 0) 0x7f1cd40508a0 con 0x7f1ce80ce4f0 2024-09-13T18:54:22.873 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:22.873 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":452,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":265805824,"bytes_avail":772828307456,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":97,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-13T18:54:19.114802+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:54:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc8066760 msgr2=0x7f1cc8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc8066760 0x7f1cc8068c20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80090b0 tx=0x7f1cd8008030 comp rx=0 tx=0).stop 2024-09-13T18:54:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 msgr2=0x7f1ce8134790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce8134790 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c730 tx=0x7f1cd400ca40 comp rx=0 tx=0).stop 2024-09-13T18:54:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 shutdown_connections 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1cc8066760 0x7f1cc8068c20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ce8147050 0x7f1ce81550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce80ce4f0 0x7f1ce8134790 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 --2- 172.21.15.81:0/2498004632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ce80b1050 0x7f1ce80af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 >> 172.21.15.81:0/2498004632 conn(0x7f1ce806a7b0 msgr2=0x7f1ce80b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 shutdown_connections 2024-09-13T18:54:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:22.865+0000 7f1cee400700 1 -- 172.21.15.81:0/2498004632 wait complete. 2024-09-13T18:54:22.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:54:23.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.057+0000 7f1c55400700 1 Processor -- start 2024-09-13T18:54:24.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.057+0000 7f1c55400700 1 -- start start 2024-09-13T18:54:24.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c55400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5015b700 0x7f1c5015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c55400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c500cdd90 con 0x7f1c5006c460 2024-09-13T18:54:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c55400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5006ce10 con 0x7f1c5006a5d0 2024-09-13T18:54:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c55400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5015c020 con 0x7f1c5015b700 2024-09-13T18:54:24.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4de00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c5006c460 0x7f1c5006d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59178/0 (socket says 172.21.15.81:59178) 2024-09-13T18:54:24.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4de00700 1 -- 172.21.15.81:0/1480470565 learned_addr learned my addr 172.21.15.81:0/1480470565 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4e800700 1 --2- 172.21.15.81:0/1480470565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5015b700 0x7f1c5015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017220395 0 0) 0x7f1c500cdd90 con 0x7f1c5006c460 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c340035d0 con 0x7f1c5006c460 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365183442 0 0) 0x7f1c5006ce10 con 0x7f1c5006a5d0 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c500cdd90 con 0x7f1c5006a5d0 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4e800700 1 -- 172.21.15.81:0/1480470565 >> v1:172.21.15.178:6789/0 conn(0x7f1c5006a5d0 legacy=0x7f1c500b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4e800700 1 -- 172.21.15.81:0/1480470565 >> v1:172.21.15.81:6789/0 conn(0x7f1c5006c460 legacy=0x7f1c5006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.061+0000 7f1c4e800700 1 -- 172.21.15.81:0/1480470565 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500cd4f0 con 0x7f1c5015b700 2024-09-13T18:54:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c4e800700 1 --2- 172.21.15.81:0/1480470565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5015b700 0x7f1c5015bae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009880 tx=0x7f1c40009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9f9778e4a711d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011830 con 0x7f1c5015b700 2024-09-13T18:54:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c40011990 con 0x7f1c5015b700 2024-09-13T18:54:24.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c4d400700 1 -- 172.21.15.81:0/1480470565 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40011d20 con 0x7f1c5015b700 2024-09-13T18:54:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 -- 172.21.15.81:0/1480470565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5015b700 msgr2=0x7f1c5015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 --2- 172.21.15.81:0/1480470565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5015b700 0x7f1c5015bae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009880 tx=0x7f1c40009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:24.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 -- 172.21.15.81:0/1480470565 shutdown_connections 2024-09-13T18:54:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 --2- 172.21.15.81:0/1480470565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5015b700 0x7f1c5015bae0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 -- 172.21.15.81:0/1480470565 >> 172.21.15.81:0/1480470565 conn(0x7f1c500b08d0 msgr2=0x7f1c500b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 -- 172.21.15.81:0/1480470565 shutdown_connections 2024-09-13T18:54:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.065+0000 7f1c55400700 1 -- 172.21.15.81:0/1480470565 wait complete. 2024-09-13T18:54:24.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.069+0000 7f1c55400700 1 Processor -- start 2024-09-13T18:54:24.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.069+0000 7f1c55400700 1 -- start start 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c5006a5d0 0x7f1c500710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006c460 0x7f1c5015a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 0x7f1c5014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50152270 con 0x7f1c5015b700 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50152550 con 0x7f1c5006a5d0 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50152830 con 0x7f1c5006c460 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 0x7f1c5014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 0x7f1c5014f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51222/0 (socket says 172.21.15.81:51222) 2024-09-13T18:54:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 -- 172.21.15.81:0/2003619538 learned_addr learned my addr 172.21.15.81:0/2003619538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4de00700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006c460 0x7f1c5015a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4e800700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c5006a5d0 0x7f1c500710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 -- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006c460 msgr2=0x7f1c5015a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006c460 0x7f1c5015a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 -- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c5006a5d0 msgr2=0x7f1c500710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c5006a5d0 0x7f1c500710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 -- 172.21.15.81:0/2003619538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400094b0 con 0x7f1c5015b700 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c4f200700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 0x7f1c5014f8c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800cc20 tx=0x7f1c4800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c48003c20 con 0x7f1c5015b700 2024-09-13T18:54:24.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c48003d80 con 0x7f1c5015b700 2024-09-13T18:54:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50152b10 con 0x7f1c5015b700 2024-09-13T18:54:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800ac40 con 0x7f1c5015b700 2024-09-13T18:54:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.073+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50071620 con 0x7f1c5015b700 2024-09-13T18:54:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.077+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c500ae3d0 con 0x7f1c5015b700 2024-09-13T18:54:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.077+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c480050d0 con 0x7f1c5015b700 2024-09-13T18:54:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.077+0000 7f1c46a00700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.077+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1c48084490 con 0x7f1c5015b700 2024-09-13T18:54:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.077+0000 7f1c4e800700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.081+0000 7f1c4e800700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1c400090b0 tx=0x7f1c4001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:24.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.085+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c48051630 con 0x7f1c5015b700 2024-09-13T18:54:24.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.309+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c500717e0 con 0x7f1c5015b700 2024-09-13T18:54:24.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c46a00700 1 -- 172.21.15.81:0/2003619538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f1c48054c50 con 0x7f1c5015b700 2024-09-13T18:54:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:24.323 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 msgr2=0x7f1c30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1c400090b0 tx=0x7f1c4001c040 comp rx=0 tx=0).stop 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 msgr2=0x7f1c5014f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 0x7f1c5014f8c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f1c4800cc20 tx=0x7f1c4800a060 comp rx=0 tx=0).stop 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 shutdown_connections 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c5015b700 0x7f1c5014f8c0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006c460 0x7f1c5015a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 --2- 172.21.15.81:0/2003619538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c5006a5d0 0x7f1c500710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.313+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 >> 172.21.15.81:0/2003619538 conn(0x7f1c500b08d0 msgr2=0x7f1c5006d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.317+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 shutdown_connections 2024-09-13T18:54:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.317+0000 7f1c55400700 1 -- 172.21.15.81:0/2003619538 wait complete. 2024-09-13T18:54:24.327 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:24.346 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:24.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.509+0000 7fa262e00700 1 Processor -- start 2024-09-13T18:54:24.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.509+0000 7fa262e00700 1 -- start start 2024-09-13T18:54:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa262e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa25c06ad80 0x7fa25c06b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa262e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0b4980 con 0x7fa25c06d3e0 2024-09-13T18:54:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa262e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c161600 con 0x7fa25c06cf80 2024-09-13T18:54:24.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa262e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c06b6a0 con 0x7fa25c06ad80 2024-09-13T18:54:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa260e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa25c06d3e0 0x7fa25c160ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59184/0 (socket says 172.21.15.81:59184) 2024-09-13T18:54:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa260e00700 1 -- 172.21.15.81:0/768585608 learned_addr learned my addr 172.21.15.81:0/768585608 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25be00700 1 --2- 172.21.15.81:0/768585608 >> v2:172.21.15.178:3300/0 conn(0x7fa25c06ad80 0x7fa25c06b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706360180 0 0) 0x7fa25c0b4980 con 0x7fa25c06d3e0 2024-09-13T18:54:24.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2400035d0 con 0x7fa25c06d3e0 2024-09-13T18:54:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853256559 0 0) 0x7fa2400035d0 con 0x7fa25c06d3e0 2024-09-13T18:54:24.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 >> v2:172.21.15.178:3300/0 conn(0x7fa25c06ad80 msgr2=0x7fa25c06b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 --2- 172.21.15.81:0/768585608 >> v2:172.21.15.178:3300/0 conn(0x7fa25c06ad80 0x7fa25c06b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 >> v1:172.21.15.178:6789/0 conn(0x7fa25c06cf80 legacy=0x7fa25c1607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0b4bd0 con 0x7fa25c06d3e0 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fa2540019f0 con 0x7fa25c06d3e0 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 >> v1:172.21.15.81:6789/0 conn(0x7fa25c06d3e0 legacy=0x7fa25c160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240003a20 0x7fa240003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa240004870 0x7fa240004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240005230 0x7fa24000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c06b6a0 con 0x7fa240005230 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24000c0d0 con 0x7fa240003a20 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.513+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24000c290 con 0x7fa240004870 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240005230 0x7fa24000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa25be00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240003a20 0x7fa240003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa25b400700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa240004870 0x7fa240004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 -- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa240004870 msgr2=0x7fa240004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa240004870 0x7fa240004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 -- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240003a20 msgr2=0x7fa240003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240003a20 0x7fa240003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 -- 172.21.15.81:0/768585608 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400035d0 con 0x7fa240005230 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa25be00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240003a20 0x7fa240003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:24.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 -- 172.21.15.81:0/768585608 reap_dead start 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa260e00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240005230 0x7fa24000ba30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa25400a800 tx=0x7fa2400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822222039547f08a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400a2f0 con 0x7fa240005230 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540072f0 con 0x7fa240005230 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa25aa00700 1 -- 172.21.15.81:0/768585608 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2540076a0 con 0x7fa240005230 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 -- 172.21.15.81:0/768585608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240005230 msgr2=0x7fa24000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240005230 0x7fa24000ba30 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fa25400a800 tx=0x7fa2400058a0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 -- 172.21.15.81:0/768585608 shutdown_connections 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 --2- 172.21.15.81:0/768585608 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240005230 0x7fa24000ba30 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 -- 172.21.15.81:0/768585608 >> 172.21.15.81:0/768585608 conn(0x7fa25c0b2700 msgr2=0x7fa25c0b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 -- 172.21.15.81:0/768585608 shutdown_connections 2024-09-13T18:54:24.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.517+0000 7fa262e00700 1 -- 172.21.15.81:0/768585608 wait complete. 2024-09-13T18:54:24.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 Processor -- start 2024-09-13T18:54:24.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 -- start start 2024-09-13T18:54:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240005230 0x7fa25c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 0x7fa25c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c14b280 0x7fa25c14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c1601d0 con 0x7fa25c1485f0 2024-09-13T18:54:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c14bc20 con 0x7fa240005230 2024-09-13T18:54:24.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa262e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c148430 con 0x7fa25c14b280 2024-09-13T18:54:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 0x7fa25c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 0x7fa25c147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51246/0 (socket says 172.21.15.81:51246) 2024-09-13T18:54:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 -- 172.21.15.81:0/1916218994 learned_addr learned my addr 172.21.15.81:0/1916218994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25be00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240005230 0x7fa25c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa260e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c14b280 0x7fa25c14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 -- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c14b280 msgr2=0x7fa25c14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c14b280 0x7fa25c14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 -- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240005230 msgr2=0x7fa25c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240005230 0x7fa25c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 -- 172.21.15.81:0/1916218994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c153ba0 con 0x7fa25c1485f0 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa260e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c14b280 0x7fa25c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:24.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa25b400700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 0x7fa25c147ef0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa24800e5b0 tx=0x7fa24800e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.521+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480052e0 con 0x7fa25c1485f0 2024-09-13T18:54:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.525+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa248005440 con 0x7fa25c1485f0 2024-09-13T18:54:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.525+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2480038c0 con 0x7fa25c1485f0 2024-09-13T18:54:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.525+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c14e780 con 0x7fa25c1485f0 2024-09-13T18:54:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.525+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c15fc10 con 0x7fa25c1485f0 2024-09-13T18:54:24.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.525+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c067790 con 0x7fa25c1485f0 2024-09-13T18:54:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.525+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa248003a20 con 0x7fa25c1485f0 2024-09-13T18:54:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.529+0000 7fa253e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa23c066730 0x7fa23c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.529+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa248083880 con 0x7fa25c1485f0 2024-09-13T18:54:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.529+0000 7fa25be00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa23c066730 0x7fa23c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:24.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.529+0000 7fa25be00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa23c066730 0x7fa23c068bf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009b50 tx=0x7fa24c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:24.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.533+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa248050c30 con 0x7fa25c1485f0 2024-09-13T18:54:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.781+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa25c0b5c70 con 0x7fa25c1485f0 2024-09-13T18:54:24.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa253e00700 1 -- 172.21.15.81:0/1916218994 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1963 (secure 0 0 0) 0x7fa248019080 con 0x7fa25c1485f0 2024-09-13T18:54:24.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:24.795 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":454,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":265805824,"bytes_avail":772828307456,"bytes_total":773094113280,"write_bytes_sec":938,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":97,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-13T18:54:19.114802+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:54:24.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa23c066730 msgr2=0x7fa23c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa23c066730 0x7fa23c068bf0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009b50 tx=0x7fa24c008040 comp rx=0 tx=0).stop 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 msgr2=0x7fa25c147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 0x7fa25c147ef0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fa24800e5b0 tx=0x7fa24800e8c0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 shutdown_connections 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa23c066730 0x7fa23c068bf0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c14b280 0x7fa25c14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa25c1485f0 0x7fa25c147ef0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 --2- 172.21.15.81:0/1916218994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa240005230 0x7fa25c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 >> 172.21.15.81:0/1916218994 conn(0x7fa25c0b2700 msgr2=0x7fa25c152390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 shutdown_connections 2024-09-13T18:54:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:24.785+0000 7fa262e00700 1 -- 172.21.15.81:0/1916218994 wait complete. 2024-09-13T18:54:24.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:54:25.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:25.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.981+0000 7f63f2400700 1 Processor -- start 2024-09-13T18:54:25.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f2400700 1 -- start start 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f2400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f2400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63ec06aaa0 0x7f63ec06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f2400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0b2ad0 con 0x7f63ec0cb020 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f2400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec06b450 con 0x7f63ec06aaa0 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f2400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0ccb10 con 0x7f63ec0cc6f0 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f1000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f63ec0cb020 0x7f63ec15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59186/0 (socket says 172.21.15.81:59186) 2024-09-13T18:54:25.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f1000700 1 -- 172.21.15.81:0/3601039304 learned_addr learned my addr 172.21.15.81:0/3601039304 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.985+0000 7f63f1a00700 1 --2- 172.21.15.81:0/3601039304 >> v2:172.21.15.81:3300/0 conn(0x7f63ec06aaa0 0x7f63ec06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63e3e00700 1 --2- 172.21.15.81:0/3601039304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63ebe00700 1 -- 172.21.15.81:0/3601039304 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288389585 0 0) 0x7f63ec0b2ad0 con 0x7f63ec0cb020 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63ebe00700 1 -- 172.21.15.81:0/3601039304 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63d00035d0 con 0x7f63ec0cb020 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f1a00700 1 -- 172.21.15.81:0/3601039304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 msgr2=0x7f63ec15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f1a00700 1 --2- 172.21.15.81:0/3601039304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:25.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f1a00700 1 -- 172.21.15.81:0/3601039304 >> v1:172.21.15.81:6789/0 conn(0x7f63ec0cb020 legacy=0x7f63ec15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f1a00700 1 -- 172.21.15.81:0/3601039304 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec15b960 con 0x7f63ec06aaa0 2024-09-13T18:54:26.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f1a00700 1 --2- 172.21.15.81:0/3601039304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec06af10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009850 tx=0x7f63e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54eae0c8bd16bde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:26.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63ebe00700 1 -- 172.21.15.81:0/3601039304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4011830 con 0x7f63ec06aaa0 2024-09-13T18:54:26.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63ebe00700 1 -- 172.21.15.81:0/3601039304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e4011990 con 0x7f63ec06aaa0 2024-09-13T18:54:26.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63ebe00700 1 -- 172.21.15.81:0/3601039304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4011d40 con 0x7f63ec06aaa0 2024-09-13T18:54:26.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 -- 172.21.15.81:0/3601039304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 msgr2=0x7f63ec06af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 --2- 172.21.15.81:0/3601039304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec06af10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009850 tx=0x7f63e4009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 -- 172.21.15.81:0/3601039304 shutdown_connections 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 --2- 172.21.15.81:0/3601039304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec06af10 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 --2- 172.21.15.81:0/3601039304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 -- 172.21.15.81:0/3601039304 >> 172.21.15.81:0/3601039304 conn(0x7f63ec0b0c40 msgr2=0x7f63ec06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 -- 172.21.15.81:0/3601039304 shutdown_connections 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.989+0000 7f63f2400700 1 -- 172.21.15.81:0/3601039304 wait complete. 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 Processor -- start 2024-09-13T18:54:26.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 -- start start 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec1e3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ec0cb020 0x7f63ec13d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec1e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1e7b80 con 0x7f63ec06aaa0 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15aeb0 con 0x7f63ec0cb020 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f2400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec1e3a00 con 0x7f63ec0cc6f0 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec1e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec1e3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51262/0 (socket says 172.21.15.81:51262) 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 -- 172.21.15.81:0/2580885302 learned_addr learned my addr 172.21.15.81:0/2580885302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1a00700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec1e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63e3e00700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ec0cb020 0x7f63ec13d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 -- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 msgr2=0x7f63ec1e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec1e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 -- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ec0cb020 msgr2=0x7f63ec13d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ec0cb020 0x7f63ec13d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.993+0000 7f63f1000700 1 -- 172.21.15.81:0/2580885302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e40094b0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63f1000700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec1e3370 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00cbf0 tx=0x7f63dc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00a9a0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc00ab00 con 0x7f63ec06aaa0 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc00ae90 con 0x7f63ec06aaa0 2024-09-13T18:54:26.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec13e1f0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec13e7b0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0cb400 con 0x7f63ec06aaa0 2024-09-13T18:54:26.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:25.997+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63dc01b3b0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.001+0000 7f63e9600700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f63c8066730 0x7f63c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.001+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f63dc083ec0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.001+0000 7f63e3e00700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f63c8066730 0x7f63c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.001+0000 7f63e3e00700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f63c8066730 0x7f63c8068bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0caa30 tx=0x7f63d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:26.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.005+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63dc051060 con 0x7f63ec06aaa0 2024-09-13T18:54:26.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.237+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63ec15e3d0 con 0x7f63ec06aaa0 2024-09-13T18:54:26.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.237+0000 7f63e9600700 1 -- 172.21.15.81:0/2580885302 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f63dc017090 con 0x7f63ec06aaa0 2024-09-13T18:54:26.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:26.250 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f63c8066730 msgr2=0x7f63c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f63c8066730 0x7f63c8068bf0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0caa30 tx=0x7f63d4008040 comp rx=0 tx=0).stop 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 msgr2=0x7f63ec1e3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec1e3370 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f63dc00cbf0 tx=0x7f63dc00ccd0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 shutdown_connections 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f63c8066730 0x7f63c8068bf0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63ec0cc6f0 0x7f63ec1e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63ec0cb020 0x7f63ec13d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 --2- 172.21.15.81:0/2580885302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec06aaa0 0x7f63ec1e3370 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 >> 172.21.15.81:0/2580885302 conn(0x7f63ec0b0c40 msgr2=0x7f63ec15d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:26.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 shutdown_connections 2024-09-13T18:54:26.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.241+0000 7f63f2400700 1 -- 172.21.15.81:0/2580885302 wait complete. 2024-09-13T18:54:26.255 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:26.275 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:54:26.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:54:26.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.429+0000 7fa322a00700 1 Processor -- start 2024-09-13T18:54:26.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.429+0000 7fa322a00700 1 -- start start 2024-09-13T18:54:26.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa322a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa31c06fdb0 0x7fa31c15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa322a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c071030 con 0x7fa31c0ccda0 2024-09-13T18:54:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa322a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c06cd10 con 0x7fa31c0b0b10 2024-09-13T18:54:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa322a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c070220 con 0x7fa31c06fdb0 2024-09-13T18:54:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa31b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa31c0ccda0 0x7fa31c1625d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59190/0 (socket says 172.21.15.81:59190) 2024-09-13T18:54:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa31b400700 1 -- 172.21.15.81:0/1201447475 learned_addr learned my addr 172.21.15.81:0/1201447475 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa320a00700 1 --2- 172.21.15.81:0/1201447475 >> v2:172.21.15.178:3300/0 conn(0x7fa31c06fdb0 0x7fa31c15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592242927 0 0) 0x7fa31c071030 con 0x7fa31c0ccda0 2024-09-13T18:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3000035d0 con 0x7fa31c0ccda0 2024-09-13T18:54:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.433+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251874317 0 0) 0x7fa31c06cd10 con 0x7fa31c0b0b10 2024-09-13T18:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c071030 con 0x7fa31c0b0b10 2024-09-13T18:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa320a00700 1 -- 172.21.15.81:0/1201447475 >> v1:172.21.15.178:6789/0 conn(0x7fa31c0b0b10 legacy=0x7fa31c0b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa320a00700 1 -- 172.21.15.81:0/1201447475 >> v1:172.21.15.81:6789/0 conn(0x7fa31c0ccda0 legacy=0x7fa31c1625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa320a00700 1 -- 172.21.15.81:0/1201447475 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0704b0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa320a00700 1 --2- 172.21.15.81:0/1201447475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c06fdb0 0x7fa31c15baf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa314009850 tx=0x7fa314009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19dc6d4b45a59681 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011830 con 0x7fa31c06fdb0 2024-09-13T18:54:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314011990 con 0x7fa31c06fdb0 2024-09-13T18:54:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa31aa00700 1 -- 172.21.15.81:0/1201447475 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011d40 con 0x7fa31c06fdb0 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 -- 172.21.15.81:0/1201447475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c06fdb0 msgr2=0x7fa31c15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 --2- 172.21.15.81:0/1201447475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c06fdb0 0x7fa31c15baf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa314009850 tx=0x7fa314009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 -- 172.21.15.81:0/1201447475 shutdown_connections 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 --2- 172.21.15.81:0/1201447475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c06fdb0 0x7fa31c15baf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 -- 172.21.15.81:0/1201447475 >> 172.21.15.81:0/1201447475 conn(0x7fa31c06a7b0 msgr2=0x7fa31c06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 -- 172.21.15.81:0/1201447475 shutdown_connections 2024-09-13T18:54:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.437+0000 7fa322a00700 1 -- 172.21.15.81:0/1201447475 wait complete. 2024-09-13T18:54:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.441+0000 7fa322a00700 1 Processor -- start 2024-09-13T18:54:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.441+0000 7fa322a00700 1 -- start start 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.441+0000 7fa322a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 0x7fa31c14e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.441+0000 7fa322a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0b10 0x7fa31c13c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c15cd50 0x7fa31c146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c14ec00 con 0x7fa31c06fdb0 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c14e230 con 0x7fa31c0b0b10 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c15d9d0 con 0x7fa31c15cd50 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 0x7fa31c14e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 0x7fa31c14e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51272/0 (socket says 172.21.15.81:51272) 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 -- 172.21.15.81:0/1914977546 learned_addr learned my addr 172.21.15.81:0/1914977546 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31b400700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0b10 0x7fa31c13c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa320a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c15cd50 0x7fa31c146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 -- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c15cd50 msgr2=0x7fa31c146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c15cd50 0x7fa31c146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 -- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0b10 msgr2=0x7fa31c13c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0b10 0x7fa31c13c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 -- 172.21.15.81:0/1914977546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3140094b0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa31be00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 0x7fa31c14e6c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa30c001f30 tx=0x7fa30c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00ada0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c003a20 con 0x7fa31c06fdb0 2024-09-13T18:54:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c15d6f0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c003dd0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c14dec0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.445+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c15baf0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.449+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa30c0050d0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.449+0000 7fa313e00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2fc066730 0x7fa2fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.449+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa30c084500 con 0x7fa31c06fdb0 2024-09-13T18:54:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.449+0000 7fa31b400700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2fc066730 0x7fa2fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.449+0000 7fa31b400700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2fc066730 0x7fa2fc068bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa31c1468c0 tx=0x7fa308009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:26.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.457+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa30c0516c0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.697+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa31c0cdf20 con 0x7fa31c06fdb0 2024-09-13T18:54:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa313e00700 1 -- 172.21.15.81:0/1914977546 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1869 (secure 0 0 0) 0x7fa30c054ce0 con 0x7fa31c06fdb0 2024-09-13T18:54:26.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:26.711 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":456,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":265805824,"bytes_avail":772828307456,"bytes_total":773094113280,"write_bytes_sec":853,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":97,"id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":7675},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":8073},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":8076}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-13T18:54:25.116979+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2fc066730 msgr2=0x7fa2fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2fc066730 0x7fa2fc068bf0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa31c1468c0 tx=0x7fa308009040 comp rx=0 tx=0).stop 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 msgr2=0x7fa31c14e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 0x7fa31c14e6c0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa30c001f30 tx=0x7fa30c00a340 comp rx=0 tx=0).stop 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 shutdown_connections 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2fc066730 0x7fa2fc068bf0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa31c15cd50 0x7fa31c146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa31c0b0b10 0x7fa31c13c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 --2- 172.21.15.81:0/1914977546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa31c06fdb0 0x7fa31c14e6c0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 >> 172.21.15.81:0/1914977546 conn(0x7fa31c06a7b0 msgr2=0x7fa31c0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 shutdown_connections 2024-09-13T18:54:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:26.701+0000 7fa322a00700 1 -- 172.21.15.81:0/1914977546 wait complete. 2024-09-13T18:54:26.734 INFO:tasks.cephfs.filesystem.ceph_manager:{'d': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:54:26.734 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:54:26.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:54:26.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:54:26.821 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:54:26.821 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:54:26.821 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:26.841 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:54:26.841 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:26.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 Processor -- start 2024-09-13T18:54:27.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 -- start start 2024-09-13T18:54:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f958815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f958815e9f0 0x7f958815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958815e560 con 0x7f95880b3980 2024-09-13T18:54:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95880adf90 con 0x7f958815e9f0 2024-09-13T18:54:27.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958815d920 con 0x7f958806aaa0 2024-09-13T18:54:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958cc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f958815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.105+0000 7f958d600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f958815e9f0 0x7f958815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f958815e9f0 0x7f958815eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44514/0 (socket says 172.21.15.81:44514) 2024-09-13T18:54:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958cc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f958815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:58854/0 (socket says 172.21.15.81:58854) 2024-09-13T18:54:27.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 -- 172.21.15.81:0/453109580 learned_addr learned my addr 172.21.15.81:0/453109580 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 -- 172.21.15.81:0/453109580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 msgr2=0x7f958815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 --2- 172.21.15.81:0/453109580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f958815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 -- 172.21.15.81:0/453109580 >> v1:172.21.15.81:6789/0 conn(0x7f95880b3980 legacy=0x7f958806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 -- 172.21.15.81:0/453109580 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958815dc00 con 0x7f958815e9f0 2024-09-13T18:54:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958d600700 1 --2- 172.21.15.81:0/453109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958815e9f0 0x7f958815eea0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9580009e80 tx=0x7f958000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893f236afb625641 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f9587400700 1 -- 172.21.15.81:0/453109580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000e070 con 0x7f958815e9f0 2024-09-13T18:54:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f9587400700 1 -- 172.21.15.81:0/453109580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958000b8d0 con 0x7f958815e9f0 2024-09-13T18:54:27.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f9587400700 1 -- 172.21.15.81:0/453109580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958000bc80 con 0x7f958815e9f0 2024-09-13T18:54:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 -- 172.21.15.81:0/453109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958815e9f0 msgr2=0x7f958815eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 --2- 172.21.15.81:0/453109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958815e9f0 0x7f958815eea0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f9580009e80 tx=0x7f958000b330 comp rx=0 tx=0).stop 2024-09-13T18:54:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 -- 172.21.15.81:0/453109580 shutdown_connections 2024-09-13T18:54:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 --2- 172.21.15.81:0/453109580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958815e9f0 0x7f958815eea0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 --2- 172.21.15.81:0/453109580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f958815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 -- 172.21.15.81:0/453109580 >> 172.21.15.81:0/453109580 conn(0x7f95880b0c40 msgr2=0x7f958806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 -- 172.21.15.81:0/453109580 shutdown_connections 2024-09-13T18:54:27.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.109+0000 7f958e000700 1 -- 172.21.15.81:0/453109580 wait complete. 2024-09-13T18:54:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 Processor -- start 2024-09-13T18:54:27.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 -- start start 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f9588140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 0x7f95880cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f958815e9f0 0x7f958813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880ce2a0 con 0x7f95880b3980 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9588140fc0 con 0x7f958815e9f0 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f958e000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9588141e00 con 0x7f958806aaa0 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f9587e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 0x7f95880cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f9587e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 0x7f95880cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44518/0 (socket says 172.21.15.81:44518) 2024-09-13T18:54:27.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.113+0000 7f9587e00700 1 -- 172.21.15.81:0/1399996681 learned_addr learned my addr 172.21.15.81:0/1399996681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f958cc00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f9588140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f958d600700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f958815e9f0 0x7f958813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9587e00700 1 -- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 msgr2=0x7f9588140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9587e00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f9588140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9587e00700 1 -- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f958815e9f0 msgr2=0x7f958813ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9587e00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f958815e9f0 0x7f958813ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9587e00700 1 -- 172.21.15.81:0/1399996681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9580009b30 con 0x7f95880b3980 2024-09-13T18:54:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9587e00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 0x7f95880cd720 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f957800c500 tx=0x7f957800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780052d0 con 0x7f95880b3980 2024-09-13T18:54:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9578005430 con 0x7f95880b3980 2024-09-13T18:54:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95780055a0 con 0x7f95880b3980 2024-09-13T18:54:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95881411f0 con 0x7f95880b3980 2024-09-13T18:54:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95881417b0 con 0x7f95880b3980 2024-09-13T18:54:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.117+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9588141f90 con 0x7f95880b3980 2024-09-13T18:54:27.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.121+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95780038c0 con 0x7f95880b3980 2024-09-13T18:54:27.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.121+0000 7f9584c00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f956c066760 0x7f956c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.121+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9578083780 con 0x7f95880b3980 2024-09-13T18:54:27.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.121+0000 7f958cc00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f956c066760 0x7f956c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.125+0000 7f958cc00700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f956c066760 0x7f956c068c20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f957c009b50 tx=0x7f957c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.129+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9578050890 con 0x7f95880b3980 2024-09-13T18:54:27.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.313+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f958815d310 con 0x7f95880b3980 2024-09-13T18:54:27.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.317+0000 7f9584c00700 1 -- 172.21.15.81:0/1399996681 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16911 (secure 0 0 0) 0x7f9578053eb0 con 0x7f95880b3980 2024-09-13T18:54:27.329 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:27.330 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:00.567923+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:27.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f956c066760 msgr2=0x7f956c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f956c066760 0x7f956c068c20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f957c009b50 tx=0x7f957c009240 comp rx=0 tx=0).stop 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 msgr2=0x7f95880cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 0x7f95880cd720 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f957800c500 tx=0x7f957800c810 comp rx=0 tx=0).stop 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 shutdown_connections 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f956c066760 0x7f956c068c20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f958815e9f0 0x7f958813ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95880b3980 0x7f95880cd720 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 --2- 172.21.15.81:0/1399996681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f958806aaa0 0x7f9588140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 >> 172.21.15.81:0/1399996681 conn(0x7f95880b0c40 msgr2=0x7f95880ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 shutdown_connections 2024-09-13T18:54:27.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.321+0000 7f958e000700 1 -- 172.21.15.81:0/1399996681 wait complete. 2024-09-13T18:54:27.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:53:31.421608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:53:32.402698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:54:27.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:54:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.525+0000 7fec74a00700 1 Processor -- start 2024-09-13T18:54:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.525+0000 7fec74a00700 1 -- start start 2024-09-13T18:54:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec74a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec7006cd80 0x7fec700b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec74a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fec7006ada0 0x7fec7006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec74a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7006b710 con 0x7fec7015ca20 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec74a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec70160680 con 0x7fec7006cd80 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec74a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7015d670 con 0x7fec7006ada0 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec7006cd80 0x7fec700b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fec7006ada0 0x7fec7006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec7006cd80 0x7fec700b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44530/0 (socket says 172.21.15.81:44530) 2024-09-13T18:54:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 -- 172.21.15.81:0/2720766196 learned_addr learned my addr 172.21.15.81:0/2720766196 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 -- 172.21.15.81:0/2720766196 >> v2:172.21.15.178:3300/0 conn(0x7fec7006ada0 msgr2=0x7fec7006b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 --2- 172.21.15.81:0/2720766196 >> v2:172.21.15.178:3300/0 conn(0x7fec7006ada0 0x7fec7006b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 -- 172.21.15.81:0/2720766196 >> v1:172.21.15.178:6789/0 conn(0x7fec7015ca20 legacy=0x7fec7015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 -- 172.21.15.81:0/2720766196 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7015d950 con 0x7fec7006cd80 2024-09-13T18:54:27.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6de00700 1 --2- 172.21.15.81:0/2720766196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700b4310 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fec700b3290 tx=0x7fec5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7d25ba527ed86d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6d400700 1 -- 172.21.15.81:0/2720766196 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011830 con 0x7fec7006cd80 2024-09-13T18:54:27.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6d400700 1 -- 172.21.15.81:0/2720766196 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c011990 con 0x7fec7006cd80 2024-09-13T18:54:27.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.529+0000 7fec6d400700 1 -- 172.21.15.81:0/2720766196 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011d20 con 0x7fec7006cd80 2024-09-13T18:54:27.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 -- 172.21.15.81:0/2720766196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 msgr2=0x7fec700b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 --2- 172.21.15.81:0/2720766196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700b4310 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fec700b3290 tx=0x7fec5c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 -- 172.21.15.81:0/2720766196 shutdown_connections 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 --2- 172.21.15.81:0/2720766196 >> v2:172.21.15.178:3300/0 conn(0x7fec7006ada0 0x7fec7006b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 --2- 172.21.15.81:0/2720766196 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700b4310 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 -- 172.21.15.81:0/2720766196 >> 172.21.15.81:0/2720766196 conn(0x7fec70071d20 msgr2=0x7fec70072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 -- 172.21.15.81:0/2720766196 shutdown_connections 2024-09-13T18:54:27.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 -- 172.21.15.81:0/2720766196 wait complete. 2024-09-13T18:54:27.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 Processor -- start 2024-09-13T18:54:27.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.533+0000 7fec74a00700 1 -- start start 2024-09-13T18:54:27.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec7006ada0 0x7fec701f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec7015ca20 0x7fec701f17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70153510 con 0x7fec7006cd80 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70153ad0 con 0x7fec7006ada0 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec701f68d0 con 0x7fec7015ca20 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44536/0 (socket says 172.21.15.81:44536) 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 -- 172.21.15.81:0/3771555925 learned_addr learned my addr 172.21.15.81:0/3771555925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6e800700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec7006ada0 0x7fec701f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6f200700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec7015ca20 0x7fec701f17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 -- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec7015ca20 msgr2=0x7fec701f17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec7015ca20 0x7fec701f17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 -- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec7006ada0 msgr2=0x7fec701f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec7006ada0 0x7fec701f6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 -- 172.21.15.81:0/3771555925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c009570 con 0x7fec7006cd80 2024-09-13T18:54:27.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6e800700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec7006ada0 0x7fec701f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec6de00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700cfa40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009f40 tx=0x7fec5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c004550 con 0x7fec7006cd80 2024-09-13T18:54:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c01f070 con 0x7fec7006cd80 2024-09-13T18:54:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec700cc040 con 0x7fec7006cd80 2024-09-13T18:54:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c003900 con 0x7fec7006cd80 2024-09-13T18:54:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.537+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec70153760 con 0x7fec7006cd80 2024-09-13T18:54:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.541+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70153c40 con 0x7fec7006cd80 2024-09-13T18:54:27.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.541+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fec5c003a60 con 0x7fec7006cd80 2024-09-13T18:54:27.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.541+0000 7fec66a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fec50066760 0x7fec50068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.545+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fec5c021070 con 0x7fec7006cd80 2024-09-13T18:54:27.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.545+0000 7fec6e800700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fec50066760 0x7fec50068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.545+0000 7fec6e800700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fec50066760 0x7fec50068c20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fec60000f60 tx=0x7fec60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.549+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fec5c052a40 con 0x7fec7006cd80 2024-09-13T18:54:27.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.725+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec7006d1c0 con 0x7fec7006cd80 2024-09-13T18:54:27.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.729+0000 7fec66a00700 1 -- 172.21.15.81:0/3771555925 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec5c056060 con 0x7fec7006cd80 2024-09-13T18:54:27.739 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fec50066760 msgr2=0x7fec50068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fec50066760 0x7fec50068c20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fec60000f60 tx=0x7fec60009040 comp rx=0 tx=0).stop 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 msgr2=0x7fec700cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700cfa40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009f40 tx=0x7fec5c004770 comp rx=0 tx=0).stop 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 shutdown_connections 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fec50066760 0x7fec50068c20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fec7015ca20 0x7fec701f17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7006cd80 0x7fec700cfa40 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 --2- 172.21.15.81:0/3771555925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fec7006ada0 0x7fec701f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 >> 172.21.15.81:0/3771555925 conn(0x7fec70071d20 msgr2=0x7fec70072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:27.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 shutdown_connections 2024-09-13T18:54:27.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.733+0000 7fec74a00700 1 -- 172.21.15.81:0/3771555925 wait complete. 2024-09-13T18:54:27.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:54:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 Processor -- start 2024-09-13T18:54:27.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 -- start start 2024-09-13T18:54:27.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe000143b70 0x7fe0000cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe00006d620 0x7fe00006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe00006cea0 0x7fe00015e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000b1980 con 0x7fe00006d620 2024-09-13T18:54:27.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0000b2500 con 0x7fe000143b70 2024-09-13T18:54:27.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe006400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00006d2f0 con 0x7fe00006cea0 2024-09-13T18:54:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe00006d620 0x7fe00006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe00006d620 0x7fe00006c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44550/0 (socket says 172.21.15.81:44550) 2024-09-13T18:54:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 -- 172.21.15.81:0/628889934 learned_addr learned my addr 172.21.15.81:0/628889934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe005000700 1 --2- 172.21.15.81:0/628889934 >> v2:172.21.15.178:3300/0 conn(0x7fe000143b70 0x7fe0000cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 -- 172.21.15.81:0/628889934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe00006cea0 msgr2=0x7fe00015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:27.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe005a00700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe00006cea0 0x7fe00015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe00006cea0 0x7fe00015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 -- 172.21.15.81:0/628889934 >> v2:172.21.15.178:3300/0 conn(0x7fe000143b70 msgr2=0x7fe0000cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 --2- 172.21.15.81:0/628889934 >> v2:172.21.15.178:3300/0 conn(0x7fe000143b70 0x7fe0000cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fdfffe00700 1 -- 172.21.15.81:0/628889934 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0000b1bd0 con 0x7fe00006d620 2024-09-13T18:54:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe005000700 1 --2- 172.21.15.81:0/628889934 >> v2:172.21.15.178:3300/0 conn(0x7fe000143b70 0x7fe0000cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:27.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.929+0000 7fe005a00700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe00006cea0 0x7fe00015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:27.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fdfffe00700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe00006c960 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fe0000725d0 tx=0x7fdfec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5069068cfce924b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fdfff400700 1 -- 172.21.15.81:0/628889934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec00b8a0 con 0x7fe00006d620 2024-09-13T18:54:27.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fdfff400700 1 -- 172.21.15.81:0/628889934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec00ba00 con 0x7fe00006d620 2024-09-13T18:54:27.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fdfff400700 1 -- 172.21.15.81:0/628889934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec00bd90 con 0x7fe00006d620 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 -- 172.21.15.81:0/628889934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 msgr2=0x7fe00006c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe00006c960 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fe0000725d0 tx=0x7fdfec009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 -- 172.21.15.81:0/628889934 shutdown_connections 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe00006cea0 0x7fe00015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 --2- 172.21.15.81:0/628889934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe00006c960 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 --2- 172.21.15.81:0/628889934 >> v2:172.21.15.178:3300/0 conn(0x7fe000143b70 0x7fe0000cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 -- 172.21.15.81:0/628889934 >> 172.21.15.81:0/628889934 conn(0x7fe00006a390 msgr2=0x7fe00006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 -- 172.21.15.81:0/628889934 shutdown_connections 2024-09-13T18:54:27.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 -- 172.21.15.81:0/628889934 wait complete. 2024-09-13T18:54:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 Processor -- start 2024-09-13T18:54:27.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.933+0000 7fe006400700 1 -- start start 2024-09-13T18:54:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe00006cea0 0x7fe0001583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe000136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe000143b70 0x7fe000157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0000a9ad0 con 0x7fe00006d620 2024-09-13T18:54:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0001599d0 con 0x7fe00006cea0 2024-09-13T18:54:27.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe000158910 con 0x7fe000143b70 2024-09-13T18:54:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe000136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe000136020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44566/0 (socket says 172.21.15.81:44566) 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 -- 172.21.15.81:0/1442360087 learned_addr learned my addr 172.21.15.81:0/1442360087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe005000700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe00006cea0 0x7fe0001583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe005a00700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe000143b70 0x7fe000157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 -- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe000143b70 msgr2=0x7fe000157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe000143b70 0x7fe000157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 -- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe00006cea0 msgr2=0x7fe0001583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe00006cea0 0x7fe0001583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 -- 172.21.15.81:0/1442360087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec009570 con 0x7fe00006d620 2024-09-13T18:54:27.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdfffe00700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe000136020 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe0000742f0 tx=0x7fdfec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec0038c0 con 0x7fe00006d620 2024-09-13T18:54:27.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe000136560 con 0x7fe00006d620 2024-09-13T18:54:27.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfec01f070 con 0x7fe00006d620 2024-09-13T18:54:27.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfec003c80 con 0x7fe00006d620 2024-09-13T18:54:27.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.937+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe000158e90 con 0x7fe00006d620 2024-09-13T18:54:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.941+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe000143fe0 con 0x7fe00006d620 2024-09-13T18:54:27.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.941+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfec01a430 con 0x7fe00006d620 2024-09-13T18:54:27.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.941+0000 7fdffcc00700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfe0066760 0x7fdfe0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:27.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.941+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fdfec021070 con 0x7fe00006d620 2024-09-13T18:54:27.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.941+0000 7fe005000700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfe0066760 0x7fdfe0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:27.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.941+0000 7fe005000700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfe0066760 0x7fdfe0068c20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdff4006fd0 tx=0x7fdff4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:27.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:27.945+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfec053170 con 0x7fe00006d620 2024-09-13T18:54:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.125+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe000071f60 con 0x7fe00006d620 2024-09-13T18:54:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.125+0000 7fdffcc00700 1 -- 172.21.15.81:0/1442360087 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfec056790 con 0x7fe00006d620 2024-09-13T18:54:28.136 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:54:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfe0066760 msgr2=0x7fdfe0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfe0066760 0x7fdfe0068c20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdff4006fd0 tx=0x7fdff4008040 comp rx=0 tx=0).stop 2024-09-13T18:54:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 msgr2=0x7fe000136020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe000136020 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fe0000742f0 tx=0x7fdfec004770 comp rx=0 tx=0).stop 2024-09-13T18:54:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 shutdown_connections 2024-09-13T18:54:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdfe0066760 0x7fdfe0068c20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe000143b70 0x7fe000157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe00006d620 0x7fe000136020 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 --2- 172.21.15.81:0/1442360087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe00006cea0 0x7fe0001583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 >> 172.21.15.81:0/1442360087 conn(0x7fe00006a390 msgr2=0x7fe000141270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:28.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 shutdown_connections 2024-09-13T18:54:28.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.129+0000 7fe006400700 1 -- 172.21.15.81:0/1442360087 wait complete. 2024-09-13T18:54:28.163 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:54:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.325+0000 7f9f96e00700 1 Processor -- start 2024-09-13T18:54:28.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.325+0000 7f9f96e00700 1 -- start start 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f9006cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f9006b340 0x7f9f900b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900b0020 con 0x7f9f9006d150 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f900d1770 con 0x7f9f9006b340 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900d03f0 con 0x7f9f90160d30 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9f9006d150 0x7f9f9006ac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38566/0 (socket says 172.21.15.81:38566) 2024-09-13T18:54:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95000700 1 -- 172.21.15.81:0/2324496454 learned_addr learned my addr 172.21.15.81:0/2324496454 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96400700 1 --2- 172.21.15.81:0/2324496454 >> v2:172.21.15.178:3300/0 conn(0x7f9f9006b340 0x7f9f900b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95a00700 1 --2- 172.21.15.81:0/2324496454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f9006cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f8fe00700 1 -- 172.21.15.81:0/2324496454 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860747524 0 0) 0x7f9f900b0020 con 0x7f9f9006d150 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f8fe00700 1 -- 172.21.15.81:0/2324496454 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f780035d0 con 0x7f9f9006d150 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95a00700 1 -- 172.21.15.81:0/2324496454 >> v2:172.21.15.178:3300/0 conn(0x7f9f9006b340 msgr2=0x7f9f900b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95a00700 1 --2- 172.21.15.81:0/2324496454 >> v2:172.21.15.178:3300/0 conn(0x7f9f9006b340 0x7f9f900b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95a00700 1 -- 172.21.15.81:0/2324496454 >> v1:172.21.15.81:6789/0 conn(0x7f9f9006d150 legacy=0x7f9f9006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f8fe00700 1 -- 172.21.15.81:0/2324496454 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870780885 0 0) 0x7f9f780035d0 con 0x7f9f9006d150 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f95a00700 1 -- 172.21.15.81:0/2324496454 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900d06d0 con 0x7f9f90160d30 2024-09-13T18:54:28.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.329+0000 7f9f96400700 1 --2- 172.21.15.81:0/2324496454 >> v2:172.21.15.178:3300/0 conn(0x7f9f9006b340 0x7f9f900b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:28.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f95a00700 1 --2- 172.21.15.81:0/2324496454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f9006cc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009850 tx=0x7f9f84009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31a8d125be0c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:28.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f8fe00700 1 -- 172.21.15.81:0/2324496454 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c001670 con 0x7f9f90160d30 2024-09-13T18:54:28.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f8fe00700 1 -- 172.21.15.81:0/2324496454 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84004030 con 0x7f9f90160d30 2024-09-13T18:54:28.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f8fe00700 1 -- 172.21.15.81:0/2324496454 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840043e0 con 0x7f9f90160d30 2024-09-13T18:54:28.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 -- 172.21.15.81:0/2324496454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 msgr2=0x7f9f9006cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 --2- 172.21.15.81:0/2324496454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f9006cc10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009850 tx=0x7f9f84009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 -- 172.21.15.81:0/2324496454 shutdown_connections 2024-09-13T18:54:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 --2- 172.21.15.81:0/2324496454 >> v2:172.21.15.178:3300/0 conn(0x7f9f9006b340 0x7f9f900b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 --2- 172.21.15.81:0/2324496454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f9006cc10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 -- 172.21.15.81:0/2324496454 >> 172.21.15.81:0/2324496454 conn(0x7f9f90071d20 msgr2=0x7f9f90072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 -- 172.21.15.81:0/2324496454 shutdown_connections 2024-09-13T18:54:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.333+0000 7f9f96e00700 1 -- 172.21.15.81:0/2324496454 wait complete. 2024-09-13T18:54:28.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 Processor -- start 2024-09-13T18:54:28.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 -- start start 2024-09-13T18:54:28.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9006b340 0x7f9f900afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 0x7f9f900a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f900a89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f901474f0 con 0x7f9f9006d150 2024-09-13T18:54:28.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f90159360 con 0x7f9f9006b340 2024-09-13T18:54:28.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f90159080 con 0x7f9f90160d30 2024-09-13T18:54:28.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 0x7f9f900a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 0x7f9f900a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44568/0 (socket says 172.21.15.81:44568) 2024-09-13T18:54:28.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 -- 172.21.15.81:0/3719017337 learned_addr learned my addr 172.21.15.81:0/3719017337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95a00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9006b340 0x7f9f900afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f96400700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f900a89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 -- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 msgr2=0x7f9f900a89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f900a89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 -- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9006b340 msgr2=0x7f9f900afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9006b340 0x7f9f900afca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.337+0000 7f9f95000700 1 -- 172.21.15.81:0/3719017337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009a70 con 0x7f9f9006d150 2024-09-13T18:54:28.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f95000700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 0x7f9f900a8480 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c4e0 tx=0x7f9f7c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c004ca0 con 0x7f9f9006d150 2024-09-13T18:54:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c004e00 con 0x7f9f9006d150 2024-09-13T18:54:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f840094b0 con 0x7f9f9006d150 2024-09-13T18:54:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c0072f0 con 0x7f9f9006d150 2024-09-13T18:54:28.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f90147bc0 con 0x7f9f9006d150 2024-09-13T18:54:28.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.341+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f90161110 con 0x7f9f9006d150 2024-09-13T18:54:28.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.345+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9f7c007450 con 0x7f9f9006d150 2024-09-13T18:54:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.345+0000 7f9f8d600700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f70066730 0x7f9f70068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.345+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9f7c083f70 con 0x7f9f9006d150 2024-09-13T18:54:28.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.345+0000 7f9f95a00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f70066730 0x7f9f70068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.345+0000 7f9f95a00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f70066730 0x7f9f70068bf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000c00 tx=0x7f9f84008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:28.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.353+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9f7c051110 con 0x7f9f9006d150 2024-09-13T18:54:28.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.533+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f90160320 con 0x7f9f9006d150 2024-09-13T18:54:28.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.533+0000 7f9f8d600700 1 -- 172.21.15.81:0/3719017337 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f7c054730 con 0x7f9f9006d150 2024-09-13T18:54:28.545 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:54:28.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f70066730 msgr2=0x7f9f70068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f70066730 0x7f9f70068bf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9f84000c00 tx=0x7f9f84008030 comp rx=0 tx=0).stop 2024-09-13T18:54:28.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 msgr2=0x7f9f900a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 0x7f9f900a8480 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c4e0 tx=0x7f9f7c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 shutdown_connections 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f70066730 0x7f9f70068bf0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f90160d30 0x7f9f900a89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f9006d150 0x7f9f900a8480 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 --2- 172.21.15.81:0/3719017337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f9006b340 0x7f9f900afca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 >> 172.21.15.81:0/3719017337 conn(0x7f9f90071d20 msgr2=0x7f9f90161520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 shutdown_connections 2024-09-13T18:54:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.537+0000 7f9f96e00700 1 -- 172.21.15.81:0/3719017337 wait complete. 2024-09-13T18:54:28.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:54:28.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 Processor -- start 2024-09-13T18:54:28.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 -- start start 2024-09-13T18:54:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd39015e070 0x7fd3900cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3900cd970 con 0x7fd3900d10f0 2024-09-13T18:54:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39015e450 con 0x7fd39015e070 2024-09-13T18:54:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.729+0000 7fd38f200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900d0050 con 0x7fd3900b2c50 2024-09-13T18:54:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd39015e070 0x7fd3900cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd39015e070 0x7fd3900cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44578/0 (socket says 172.21.15.81:44578) 2024-09-13T18:54:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 -- 172.21.15.81:0/3897995308 learned_addr learned my addr 172.21.15.81:0/3897995308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38d400700 1 --1- 172.21.15.81:0/3897995308 >> v1:172.21.15.178:6789/0 conn(0x7fd3900d10f0 0x7fd3900b2540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:48270/0 (socket says 172.21.15.81:48270) 2024-09-13T18:54:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38e800700 1 --2- 172.21.15.81:0/3897995308 >> v2:172.21.15.178:3300/0 conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38ca00700 1 -- 172.21.15.81:0/3897995308 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888843088 0 0) 0x7fd37c001110 con 0x7fd3900d10f0 2024-09-13T18:54:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38ca00700 1 -- 172.21.15.81:0/3897995308 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3740035d0 con 0x7fd3900d10f0 2024-09-13T18:54:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 -- 172.21.15.81:0/3897995308 >> v2:172.21.15.178:3300/0 conn(0x7fd3900b2c50 msgr2=0x7fd3900b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 --2- 172.21.15.81:0/3897995308 >> v2:172.21.15.178:3300/0 conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 -- 172.21.15.81:0/3897995308 >> v1:172.21.15.178:6789/0 conn(0x7fd3900d10f0 legacy=0x7fd3900b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 -- 172.21.15.81:0/3897995308 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900d0330 con 0x7fd39015e070 2024-09-13T18:54:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38de00700 1 --2- 172.21.15.81:0/3897995308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3900cd430 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cfb10 tx=0x7fd380009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5275634de7f85dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38ca00700 1 -- 172.21.15.81:0/3897995308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380011830 con 0x7fd39015e070 2024-09-13T18:54:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38ca00700 1 -- 172.21.15.81:0/3897995308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380011990 con 0x7fd39015e070 2024-09-13T18:54:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38ca00700 1 -- 172.21.15.81:0/3897995308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380011d20 con 0x7fd39015e070 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 -- 172.21.15.81:0/3897995308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 msgr2=0x7fd3900cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 --2- 172.21.15.81:0/3897995308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3900cd430 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fd3900cfb10 tx=0x7fd380009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 -- 172.21.15.81:0/3897995308 shutdown_connections 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 --2- 172.21.15.81:0/3897995308 >> v2:172.21.15.178:3300/0 conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 --2- 172.21.15.81:0/3897995308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3900cd430 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 -- 172.21.15.81:0/3897995308 >> 172.21.15.81:0/3897995308 conn(0x7fd390071f00 msgr2=0x7fd3900722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.733+0000 7fd38f200700 1 -- 172.21.15.81:0/3897995308 shutdown_connections 2024-09-13T18:54:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.737+0000 7fd38f200700 1 -- 172.21.15.81:0/3897995308 wait complete. 2024-09-13T18:54:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.737+0000 7fd38f200700 1 Processor -- start 2024-09-13T18:54:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.737+0000 7fd38f200700 1 -- start start 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900d10f0 0x7fd390154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3901f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b69b0 con 0x7fd39015e070 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900c49b0 con 0x7fd3900d10f0 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900b3df0 con 0x7fd3900b2c50 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3901f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3901f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44580/0 (socket says 172.21.15.81:44580) 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 -- 172.21.15.81:0/3374180431 learned_addr learned my addr 172.21.15.81:0/3374180431 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:28.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38de00700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38d400700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900d10f0 0x7fd390154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 -- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2c50 msgr2=0x7fd3900b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 -- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900d10f0 msgr2=0x7fd390154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900d10f0 0x7fd390154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 -- 172.21.15.81:0/3374180431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009570 con 0x7fd39015e070 2024-09-13T18:54:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38d400700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900d10f0 0x7fd390154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38e800700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3901f62b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd388009d30 tx=0x7fd38800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:28.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388009ba0 con 0x7fd39015e070 2024-09-13T18:54:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd390154ff0 con 0x7fd39015e070 2024-09-13T18:54:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800f040 con 0x7fd39015e070 2024-09-13T18:54:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388014480 con 0x7fd39015e070 2024-09-13T18:54:28.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3900b63f0 con 0x7fd39015e070 2024-09-13T18:54:28.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.741+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3900cb330 con 0x7fd39015e070 2024-09-13T18:54:28.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.745+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3880145e0 con 0x7fd39015e070 2024-09-13T18:54:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.745+0000 7fd386000700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.745+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd388084f50 con 0x7fd39015e070 2024-09-13T18:54:28.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.749+0000 7fd38de00700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:28.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.749+0000 7fd38de00700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd380000c00 tx=0x7fd380008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:28.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.753+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3880520f0 con 0x7fd39015e070 2024-09-13T18:54:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.945+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3900cf1c0 con 0x7fd39015e070 2024-09-13T18:54:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd386000700 1 -- 172.21.15.81:0/3374180431 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd388018080 con 0x7fd39015e070 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 msgr2=0x7fd370068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd380000c00 tx=0x7fd380008030 comp rx=0 tx=0).stop 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 msgr2=0x7fd3901f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3901f62b0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fd388009d30 tx=0x7fd38800c3a0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 shutdown_connections 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd39015e070 0x7fd3901f62b0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900d10f0 0x7fd390154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 --2- 172.21.15.81:0/3374180431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2c50 0x7fd3900b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 >> 172.21.15.81:0/3374180431 conn(0x7fd390071f00 msgr2=0x7fd3900ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 shutdown_connections 2024-09-13T18:54:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:28.949+0000 7fd38f200700 1 -- 172.21.15.81:0/3374180431 wait complete. 2024-09-13T18:54:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:54:28.984 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:54:28.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:28.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:54:29.025 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:54:29.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:29.025 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:54:29.085 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:54:29.086 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:29.105 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:54:29.105 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:54:29.105 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:29.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:54:29.144 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:54:29.144 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:29.160 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:54:29.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:29.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.349+0000 7f4956e00700 1 Processor -- start 2024-09-13T18:54:29.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.349+0000 7f4956e00700 1 -- start start 2024-09-13T18:54:29.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4950159bd0 0x7f49500cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4950071870 0x7f495006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49500707d0 con 0x7f495006afe0 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495006b490 con 0x7f4950159bd0 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49500720a0 con 0x7f4950071870 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f495006afe0 0x7f49500b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38572/0 (socket says 172.21.15.81:38572) 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4956400700 1 -- 172.21.15.81:0/3590176789 learned_addr learned my addr 172.21.15.81:0/3590176789 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4955a00700 1 --2- 172.21.15.81:0/3590176789 >> v2:172.21.15.178:3300/0 conn(0x7f4950159bd0 0x7f49500cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f4955000700 1 --2- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4950071870 0x7f495006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f494fe00700 1 -- 172.21.15.81:0/3590176789 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222142008 0 0) 0x7f49500707d0 con 0x7f495006afe0 2024-09-13T18:54:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.353+0000 7f494fe00700 1 -- 172.21.15.81:0/3590176789 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49380035d0 con 0x7f495006afe0 2024-09-13T18:54:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4955a00700 1 -- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4950071870 msgr2=0x7f495006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4955a00700 1 --2- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4950071870 0x7f495006aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4955a00700 1 -- 172.21.15.81:0/3590176789 >> v1:172.21.15.81:6789/0 conn(0x7f495006afe0 legacy=0x7f49500b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4955a00700 1 -- 172.21.15.81:0/3590176789 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495006fee0 con 0x7f4950159bd0 2024-09-13T18:54:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4955a00700 1 --2- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49500cb700 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4944009880 tx=0x7f4944009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab1cf1b64610bd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f494fe00700 1 -- 172.21.15.81:0/3590176789 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944011830 con 0x7f4950159bd0 2024-09-13T18:54:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f494fe00700 1 -- 172.21.15.81:0/3590176789 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4944011990 con 0x7f4950159bd0 2024-09-13T18:54:29.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f494fe00700 1 -- 172.21.15.81:0/3590176789 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944011d20 con 0x7f4950159bd0 2024-09-13T18:54:29.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 -- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 msgr2=0x7f49500cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 --2- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49500cb700 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4944009880 tx=0x7f4944009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:29.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 -- 172.21.15.81:0/3590176789 shutdown_connections 2024-09-13T18:54:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 --2- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4950071870 0x7f495006aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 --2- 172.21.15.81:0/3590176789 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49500cb700 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 -- 172.21.15.81:0/3590176789 >> 172.21.15.81:0/3590176789 conn(0x7f49500b0c40 msgr2=0x7f495006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 -- 172.21.15.81:0/3590176789 shutdown_connections 2024-09-13T18:54:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.357+0000 7f4956e00700 1 -- 172.21.15.81:0/3590176789 wait complete. 2024-09-13T18:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 Processor -- start 2024-09-13T18:54:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 -- start start 2024-09-13T18:54:29.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f495006afe0 0x7f49501f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 0x7f49501e3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49501529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501f6e10 con 0x7f4950071870 2024-09-13T18:54:29.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49501e2460 con 0x7f4950159bd0 2024-09-13T18:54:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49501e3c90 con 0x7f495006afe0 2024-09-13T18:54:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 0x7f49501e3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 0x7f49501e3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44596/0 (socket says 172.21.15.81:44596) 2024-09-13T18:54:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955000700 1 -- 172.21.15.81:0/511275150 learned_addr learned my addr 172.21.15.81:0/511275150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955a00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f495006afe0 0x7f49501f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4956400700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49501529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955a00700 1 -- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 msgr2=0x7f49501529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955a00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49501529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955a00700 1 -- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 msgr2=0x7f49501e3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955a00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 0x7f49501e3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955a00700 1 -- 172.21.15.81:0/511275150 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440094b0 con 0x7f495006afe0 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.361+0000 7f4955000700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 0x7f49501e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f4955a00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f495006afe0 0x7f49501f68d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4944016000 tx=0x7f4944004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944004590 con 0x7f495006afe0 2024-09-13T18:54:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494401e070 con 0x7f495006afe0 2024-09-13T18:54:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49501e26b0 con 0x7f495006afe0 2024-09-13T18:54:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944003900 con 0x7f495006afe0 2024-09-13T18:54:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49501e2a40 con 0x7f495006afe0 2024-09-13T18:54:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.365+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49501571d0 con 0x7f495006afe0 2024-09-13T18:54:29.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.369+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4944003a60 con 0x7f495006afe0 2024-09-13T18:54:29.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.369+0000 7f494d600700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4930066730 0x7f4930068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.369+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4944085870 con 0x7f495006afe0 2024-09-13T18:54:29.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.369+0000 7f4955000700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4930066730 0x7f4930068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.369+0000 7f4955000700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4930066730 0x7f4930068bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f49500ce7b0 tx=0x7f493c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:29.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.377+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4944052a10 con 0x7f495006afe0 2024-09-13T18:54:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.621+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4950158ae0 con 0x7f495006afe0 2024-09-13T18:54:29.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.621+0000 7f494d600700 1 -- 172.21.15.81:0/511275150 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7f4944056030 con 0x7f495006afe0 2024-09-13T18:54:29.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:29.634 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4930066730 msgr2=0x7f4930068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4930066730 0x7f4930068bf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f49500ce7b0 tx=0x7f493c009240 comp rx=0 tx=0).stop 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f495006afe0 msgr2=0x7f49501f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f495006afe0 0x7f49501f68d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4944016000 tx=0x7f4944004770 comp rx=0 tx=0).stop 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 shutdown_connections 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4930066730 0x7f4930068bf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4950159bd0 0x7f49501529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4950071870 0x7f49501e3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 --2- 172.21.15.81:0/511275150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f495006afe0 0x7f49501f68d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 >> 172.21.15.81:0/511275150 conn(0x7f49500b0c40 msgr2=0x7f49501574f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 shutdown_connections 2024-09-13T18:54:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.625+0000 7f4956e00700 1 -- 172.21.15.81:0/511275150 wait complete. 2024-09-13T18:54:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:29.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.813+0000 7f0a80800700 1 Processor -- start 2024-09-13T18:54:29.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a80800700 1 -- start start 2024-09-13T18:54:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a80800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a7815b700 0x7f0a7815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a80800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a7806a5d0 0x7f0a7806aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a80800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a780cdd90 con 0x7f0a7806c460 2024-09-13T18:54:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a80800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7806afa0 con 0x7f0a7806a5d0 2024-09-13T18:54:29.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a80800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a7806ce10 con 0x7f0a7815b700 2024-09-13T18:54:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7e800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a7806a5d0 0x7f0a7806aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7de00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a7815b700 0x7f0a7815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7d400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0a7806c460 0x7f0a7806d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:48284/0 (socket says 172.21.15.81:48284) 2024-09-13T18:54:29.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7d400700 1 -- 172.21.15.81:0/2409453039 learned_addr learned my addr 172.21.15.81:0/2409453039 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7ca00700 1 -- 172.21.15.81:0/2409453039 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662570123 0 0) 0x7f0a780cdd90 con 0x7f0a7806c460 2024-09-13T18:54:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7ca00700 1 -- 172.21.15.81:0/2409453039 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a600035d0 con 0x7f0a7806c460 2024-09-13T18:54:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7e800700 1 -- 172.21.15.81:0/2409453039 >> v2:172.21.15.178:3300/0 conn(0x7f0a7815b700 msgr2=0x7f0a7815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7e800700 1 --2- 172.21.15.81:0/2409453039 >> v2:172.21.15.178:3300/0 conn(0x7f0a7815b700 0x7f0a7815bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7e800700 1 -- 172.21.15.81:0/2409453039 >> v1:172.21.15.178:6789/0 conn(0x7f0a7806c460 legacy=0x7f0a7806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.817+0000 7f0a7e800700 1 -- 172.21.15.81:0/2409453039 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7815c020 con 0x7f0a7806a5d0 2024-09-13T18:54:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a7e800700 1 --2- 172.21.15.81:0/2409453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7806a5d0 0x7f0a7806aa60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f0a7806def0 tx=0x7f0a7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b57e1bb401ed05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a7ca00700 1 -- 172.21.15.81:0/2409453039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400e070 con 0x7f0a7806a5d0 2024-09-13T18:54:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a7ca00700 1 -- 172.21.15.81:0/2409453039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7400bb20 con 0x7f0a7806a5d0 2024-09-13T18:54:29.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a7ca00700 1 -- 172.21.15.81:0/2409453039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400be90 con 0x7f0a7806a5d0 2024-09-13T18:54:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 -- 172.21.15.81:0/2409453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7806a5d0 msgr2=0x7f0a7806aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 --2- 172.21.15.81:0/2409453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7806a5d0 0x7f0a7806aa60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f0a7806def0 tx=0x7f0a7400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 -- 172.21.15.81:0/2409453039 shutdown_connections 2024-09-13T18:54:29.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 --2- 172.21.15.81:0/2409453039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7806a5d0 0x7f0a7806aa60 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 --2- 172.21.15.81:0/2409453039 >> v2:172.21.15.178:3300/0 conn(0x7f0a7815b700 0x7f0a7815bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 -- 172.21.15.81:0/2409453039 >> 172.21.15.81:0/2409453039 conn(0x7f0a780b08d0 msgr2=0x7f0a780b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 -- 172.21.15.81:0/2409453039 shutdown_connections 2024-09-13T18:54:29.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.821+0000 7f0a80800700 1 -- 172.21.15.81:0/2409453039 wait complete. 2024-09-13T18:54:29.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 Processor -- start 2024-09-13T18:54:29.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 -- start start 2024-09-13T18:54:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7806a5d0 0x7f0a7814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7806c460 0x7f0a78151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 0x7f0a781f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78150e10 con 0x7f0a7815b700 2024-09-13T18:54:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78150190 con 0x7f0a7806a5d0 2024-09-13T18:54:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.825+0000 7f0a80800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a78150470 con 0x7f0a7806c460 2024-09-13T18:54:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 0x7f0a781f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 0x7f0a781f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44618/0 (socket says 172.21.15.81:44618) 2024-09-13T18:54:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 -- 172.21.15.81:0/77601707 learned_addr learned my addr 172.21.15.81:0/77601707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7de00700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7806a5d0 0x7f0a7814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7d400700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7806c460 0x7f0a78151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 -- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7806c460 msgr2=0x7f0a78151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7806c460 0x7f0a78151230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 -- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7806a5d0 msgr2=0x7f0a7814fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7806a5d0 0x7f0a7814fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 -- 172.21.15.81:0/77601707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74009a70 con 0x7f0a7815b700 2024-09-13T18:54:29.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a7e800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 0x7f0a781f2d20 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400b370 tx=0x7f0a74004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74007000 con 0x7f0a7815b700 2024-09-13T18:54:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74012650 con 0x7f0a7815b700 2024-09-13T18:54:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74012a00 con 0x7f0a7815b700 2024-09-13T18:54:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a78150750 con 0x7f0a7815b700 2024-09-13T18:54:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a78151770 con 0x7f0a7815b700 2024-09-13T18:54:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.829+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a7815c1b0 con 0x7f0a7815b700 2024-09-13T18:54:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.833+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a74012b60 con 0x7f0a7815b700 2024-09-13T18:54:29.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.833+0000 7f0a72000700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a5c066730 0x7f0a5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:29.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.833+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f0a74085fd0 con 0x7f0a7815b700 2024-09-13T18:54:29.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.837+0000 7f0a7de00700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a5c066730 0x7f0a5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:29.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.837+0000 7f0a7de00700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a5c066730 0x7f0a5c068bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0a781f6250 tx=0x7f0a6c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:29.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:29.837+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a74053220 con 0x7f0a7815b700 2024-09-13T18:54:30.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.025+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a7806aa60 con 0x7f0a7815b700 2024-09-13T18:54:30.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.029+0000 7f0a72000700 1 -- 172.21.15.81:0/77601707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16911 (secure 0 0 0) 0x7f0a74056840 con 0x7f0a7815b700 2024-09-13T18:54:30.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:30.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:00.567923+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a5c066730 msgr2=0x7f0a5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a5c066730 0x7f0a5c068bf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0a781f6250 tx=0x7f0a6c009240 comp rx=0 tx=0).stop 2024-09-13T18:54:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 msgr2=0x7f0a781f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 0x7f0a781f2d20 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400b370 tx=0x7f0a74004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 shutdown_connections 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a5c066730 0x7f0a5c068bf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7815b700 0x7f0a781f2d20 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a7806c460 0x7f0a78151230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 --2- 172.21.15.81:0/77601707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a7806a5d0 0x7f0a7814fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 >> 172.21.15.81:0/77601707 conn(0x7f0a780b08d0 msgr2=0x7f0a780b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 shutdown_connections 2024-09-13T18:54:30.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.033+0000 7f0a80800700 1 -- 172.21.15.81:0/77601707 wait complete. 2024-09-13T18:54:30.068 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:53:31.421608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:53:32.402698+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:54:30.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:54:30.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.229+0000 7fee6d400700 1 Processor -- start 2024-09-13T18:54:30.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.229+0000 7fee6d400700 1 -- start start 2024-09-13T18:54:30.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee6d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee68160fc0 0x7fee6806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee6d400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6806d000 con 0x7fee680b3990 2024-09-13T18:54:30.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee6d400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6806c3f0 con 0x7fee680cf280 2024-09-13T18:54:30.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee6d400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6806c6d0 con 0x7fee68160fc0 2024-09-13T18:54:30.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee66800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fee68160fc0 0x7fee6806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee65e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fee680b3990 0x7fee680ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38588/0 (socket says 172.21.15.81:38588) 2024-09-13T18:54:30.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee65e00700 1 -- 172.21.15.81:0/1112968870 learned_addr learned my addr 172.21.15.81:0/1112968870 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee66800700 1 -- 172.21.15.81:0/1112968870 >> v1:172.21.15.178:6789/0 conn(0x7fee680cf280 legacy=0x7fee681618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee66800700 1 -- 172.21.15.81:0/1112968870 >> v1:172.21.15.81:6789/0 conn(0x7fee680b3990 legacy=0x7fee680ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee65400700 1 -- 172.21.15.81:0/1112968870 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488271335 0 0) 0x7fee6806d000 con 0x7fee680b3990 2024-09-13T18:54:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee66800700 1 -- 172.21.15.81:0/1112968870 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6806c9b0 con 0x7fee68160fc0 2024-09-13T18:54:30.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee66800700 1 --2- 172.21.15.81:0/1112968870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee6806be10 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fee58009850 tx=0x7fee58009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f691ad1051af4753 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee65400700 1 -- 172.21.15.81:0/1112968870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011830 con 0x7fee68160fc0 2024-09-13T18:54:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee65400700 1 -- 172.21.15.81:0/1112968870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee58011990 con 0x7fee68160fc0 2024-09-13T18:54:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.233+0000 7fee65400700 1 -- 172.21.15.81:0/1112968870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58011d20 con 0x7fee68160fc0 2024-09-13T18:54:30.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 -- 172.21.15.81:0/1112968870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 msgr2=0x7fee6806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 --2- 172.21.15.81:0/1112968870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee6806be10 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fee58009850 tx=0x7fee58009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 -- 172.21.15.81:0/1112968870 shutdown_connections 2024-09-13T18:54:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 --2- 172.21.15.81:0/1112968870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee6806be10 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 -- 172.21.15.81:0/1112968870 >> 172.21.15.81:0/1112968870 conn(0x7fee6806a570 msgr2=0x7fee6806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 -- 172.21.15.81:0/1112968870 shutdown_connections 2024-09-13T18:54:30.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 -- 172.21.15.81:0/1112968870 wait complete. 2024-09-13T18:54:30.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 Processor -- start 2024-09-13T18:54:30.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.237+0000 7fee6d400700 1 -- start start 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680b3990 0x7fee680cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee680cf280 0x7fee681faa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee681525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681faf40 con 0x7fee68160fc0 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68159a40 con 0x7fee680cf280 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee681f6b50 con 0x7fee680b3990 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee681525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee681525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44644/0 (socket says 172.21.15.81:44644) 2024-09-13T18:54:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 -- 172.21.15.81:0/2310177271 learned_addr learned my addr 172.21.15.81:0/2310177271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 -- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680b3990 msgr2=0x7fee680cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680b3990 0x7fee680cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 -- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee680cf280 msgr2=0x7fee681faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee65e00700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee680cf280 0x7fee681faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee680cf280 0x7fee681faa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 -- 172.21.15.81:0/2310177271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580094b0 con 0x7fee68160fc0 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee65e00700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee680cf280 0x7fee681faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee67200700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee681525c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cb70 tx=0x7fee6000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60003c20 con 0x7fee68160fc0 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee60003d80 con 0x7fee68160fc0 2024-09-13T18:54:30.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680b3f50 con 0x7fee68160fc0 2024-09-13T18:54:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000ab50 con 0x7fee68160fc0 2024-09-13T18:54:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.241+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee681f6e70 con 0x7fee68160fc0 2024-09-13T18:54:30.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.245+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6806be10 con 0x7fee68160fc0 2024-09-13T18:54:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.245+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee6000acb0 con 0x7fee68160fc0 2024-09-13T18:54:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.245+0000 7fee5ea00700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee48066730 0x7fee48068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.245+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fee60084410 con 0x7fee68160fc0 2024-09-13T18:54:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.245+0000 7fee66800700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee48066730 0x7fee48068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.249+0000 7fee66800700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee48066730 0x7fee48068bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee58014040 tx=0x7fee58010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.253+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee60051520 con 0x7fee68160fc0 2024-09-13T18:54:30.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.433+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee680b2010 con 0x7fee68160fc0 2024-09-13T18:54:30.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.433+0000 7fee5ea00700 1 -- 172.21.15.81:0/2310177271 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee60054b40 con 0x7fee68160fc0 2024-09-13T18:54:30.444 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:54:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee48066730 msgr2=0x7fee48068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee48066730 0x7fee48068bf0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee58014040 tx=0x7fee58010000 comp rx=0 tx=0).stop 2024-09-13T18:54:30.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 msgr2=0x7fee681525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee681525c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cb70 tx=0x7fee6000cf30 comp rx=0 tx=0).stop 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 shutdown_connections 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fee48066730 0x7fee48068bf0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee68160fc0 0x7fee681525c0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee680cf280 0x7fee681faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 --2- 172.21.15.81:0/2310177271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee680b3990 0x7fee680cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 >> 172.21.15.81:0/2310177271 conn(0x7fee6806a570 msgr2=0x7fee680ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 shutdown_connections 2024-09-13T18:54:30.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.437+0000 7fee6d400700 1 -- 172.21.15.81:0/2310177271 wait complete. 2024-09-13T18:54:30.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:54:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.621+0000 7ffb76800700 1 Processor -- start 2024-09-13T18:54:30.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.621+0000 7ffb76800700 1 -- start start 2024-09-13T18:54:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb76800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7015ca20 0x7ffb7015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb76800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffb7006ada0 0x7ffb7006b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb76800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb70160680 con 0x7ffb7006cd80 2024-09-13T18:54:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb76800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7006b790 con 0x7ffb7006ada0 2024-09-13T18:54:30.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb76800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700b4a20 con 0x7ffb7015ca20 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffb7006ada0 0x7ffb7006b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7015ca20 0x7ffb7015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffb7006ada0 0x7ffb7006b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:33778/0 (socket says 172.21.15.81:33778) 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 -- 172.21.15.81:0/2501476766 learned_addr learned my addr 172.21.15.81:0/2501476766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 -- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7015ca20 msgr2=0x7ffb7015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 --2- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7015ca20 0x7ffb7015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 -- 172.21.15.81:0/2501476766 >> v1:172.21.15.178:6789/0 conn(0x7ffb7006cd80 legacy=0x7ffb700b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 -- 172.21.15.81:0/2501476766 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7015d670 con 0x7ffb7006ada0 2024-09-13T18:54:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb75e00700 1 --2- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb7006b250 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009e80 tx=0x7ffb6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=310bbd7a2f5ae8df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:30.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb6fe00700 1 -- 172.21.15.81:0/2501476766 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800e070 con 0x7ffb7006ada0 2024-09-13T18:54:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb6fe00700 1 -- 172.21.15.81:0/2501476766 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800b8d0 con 0x7ffb7006ada0 2024-09-13T18:54:30.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.625+0000 7ffb6fe00700 1 -- 172.21.15.81:0/2501476766 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800bc80 con 0x7ffb7006ada0 2024-09-13T18:54:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 -- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 msgr2=0x7ffb7006b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 --2- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb7006b250 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009e80 tx=0x7ffb6800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 -- 172.21.15.81:0/2501476766 shutdown_connections 2024-09-13T18:54:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 --2- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb7006b250 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 --2- 172.21.15.81:0/2501476766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7015ca20 0x7ffb7015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 -- 172.21.15.81:0/2501476766 >> 172.21.15.81:0/2501476766 conn(0x7ffb70071d20 msgr2=0x7ffb70072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 -- 172.21.15.81:0/2501476766 shutdown_connections 2024-09-13T18:54:30.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.629+0000 7ffb76800700 1 -- 172.21.15.81:0/2501476766 wait complete. 2024-09-13T18:54:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 Processor -- start 2024-09-13T18:54:30.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 -- start start 2024-09-13T18:54:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb700cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7006cd80 0x7ffb700cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 0x7ffb700cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701f21d0 con 0x7ffb7015ca20 2024-09-13T18:54:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb70150130 con 0x7ffb7006ada0 2024-09-13T18:54:30.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb76800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb700cb3d0 con 0x7ffb7006cd80 2024-09-13T18:54:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb75e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 0x7ffb700cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb75e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 0x7ffb700cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44652/0 (socket says 172.21.15.81:44652) 2024-09-13T18:54:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb75e00700 1 -- 172.21.15.81:0/961176074 learned_addr learned my addr 172.21.15.81:0/961176074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb74a00700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7006cd80 0x7ffb700cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.633+0000 7ffb75400700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb700cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb75e00700 1 -- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7006cd80 msgr2=0x7ffb700cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb75e00700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7006cd80 0x7ffb700cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb75e00700 1 -- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 msgr2=0x7ffb700cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb75e00700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb700cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb75e00700 1 -- 172.21.15.81:0/961176074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009b30 con 0x7ffb7015ca20 2024-09-13T18:54:30.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb75e00700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 0x7ffb700cfbf0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ffb700d1a40 tx=0x7ffb68004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004800 con 0x7ffb7015ca20 2024-09-13T18:54:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb680099b0 con 0x7ffb7015ca20 2024-09-13T18:54:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb700cb6b0 con 0x7ffb7015ca20 2024-09-13T18:54:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6801c680 con 0x7ffb7015ca20 2024-09-13T18:54:30.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb700cba40 con 0x7ffb7015ca20 2024-09-13T18:54:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.637+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7006d1c0 con 0x7ffb7015ca20 2024-09-13T18:54:30.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.641+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb6801c7e0 con 0x7ffb7015ca20 2024-09-13T18:54:30.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.641+0000 7ffb6d600700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb50066730 0x7ffb50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:30.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.641+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ffb68085c40 con 0x7ffb7015ca20 2024-09-13T18:54:30.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.641+0000 7ffb75400700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb50066730 0x7ffb50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:30.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.645+0000 7ffb75400700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb50066730 0x7ffb50068bf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009b50 tx=0x7ffb64009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:30.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.649+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb68052d50 con 0x7ffb7015ca20 2024-09-13T18:54:30.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.833+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb7006ab80 con 0x7ffb7015ca20 2024-09-13T18:54:30.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb6d600700 1 -- 172.21.15.81:0/961176074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb68056370 con 0x7ffb7015ca20 2024-09-13T18:54:30.846 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:54:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb50066730 msgr2=0x7ffb50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb50066730 0x7ffb50068bf0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ffb64009b50 tx=0x7ffb64009240 comp rx=0 tx=0).stop 2024-09-13T18:54:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 msgr2=0x7ffb700cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 0x7ffb700cfbf0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ffb700d1a40 tx=0x7ffb68004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 shutdown_connections 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ffb50066730 0x7ffb50068bf0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb7015ca20 0x7ffb700cfbf0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb7006cd80 0x7ffb700cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 --2- 172.21.15.81:0/961176074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb7006ada0 0x7ffb700cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 >> 172.21.15.81:0/961176074 conn(0x7ffb70071d20 msgr2=0x7ffb70156080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 shutdown_connections 2024-09-13T18:54:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:30.837+0000 7ffb76800700 1 -- 172.21.15.81:0/961176074 wait complete. 2024-09-13T18:54:30.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:54:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.041+0000 7f3aaca00700 1 Processor -- start 2024-09-13T18:54:31.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.041+0000 7f3aaca00700 1 -- start start 2024-09-13T18:54:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aaca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3aa8161110 0x7f3aa806ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aaca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa806b170 0x7f3aa80b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aaca00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa806b5c0 con 0x7f3aa8160d30 2024-09-13T18:54:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aaca00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa80b0020 con 0x7f3aa8161110 2024-09-13T18:54:31.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aaca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80d1770 con 0x7f3aa806b170 2024-09-13T18:54:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa7400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3aa8160d30 0x7f3aa806cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38600/0 (socket says 172.21.15.81:38600) 2024-09-13T18:54:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa7400700 1 -- 172.21.15.81:0/4141167572 learned_addr learned my addr 172.21.15.81:0/4141167572 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6a00700 1 --2- 172.21.15.81:0/4141167572 >> v2:172.21.15.178:3300/0 conn(0x7f3aa8161110 0x7f3aa806ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa7e00700 1 --2- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa806b170 0x7f3aa80b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6000700 1 -- 172.21.15.81:0/4141167572 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683192035 0 0) 0x7f3a98001110 con 0x7f3aa8160d30 2024-09-13T18:54:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6000700 1 -- 172.21.15.81:0/4141167572 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a8c0035d0 con 0x7f3aa8160d30 2024-09-13T18:54:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6a00700 1 -- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa806b170 msgr2=0x7f3aa80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6a00700 1 --2- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa806b170 0x7f3aa80b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6a00700 1 -- 172.21.15.81:0/4141167572 >> v1:172.21.15.81:6789/0 conn(0x7f3aa8160d30 legacy=0x7f3aa806cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6a00700 1 -- 172.21.15.81:0/4141167572 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa80d03f0 con 0x7f3aa8161110 2024-09-13T18:54:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6a00700 1 --2- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa806ac30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009850 tx=0x7f3a94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7747216fe380a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6000700 1 -- 172.21.15.81:0/4141167572 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94011830 con 0x7f3aa8161110 2024-09-13T18:54:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6000700 1 -- 172.21.15.81:0/4141167572 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a94011990 con 0x7f3aa8161110 2024-09-13T18:54:31.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.045+0000 7f3aa6000700 1 -- 172.21.15.81:0/4141167572 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a94011d00 con 0x7f3aa8161110 2024-09-13T18:54:31.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 -- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 msgr2=0x7f3aa806ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 --2- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa806ac30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3a94009850 tx=0x7f3a94009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:31.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 -- 172.21.15.81:0/4141167572 shutdown_connections 2024-09-13T18:54:31.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 --2- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa806b170 0x7f3aa80b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 --2- 172.21.15.81:0/4141167572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa806ac30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 -- 172.21.15.81:0/4141167572 >> 172.21.15.81:0/4141167572 conn(0x7f3aa8071d20 msgr2=0x7f3aa8072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:31.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 -- 172.21.15.81:0/4141167572 shutdown_connections 2024-09-13T18:54:31.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.049+0000 7f3aaca00700 1 -- 172.21.15.81:0/4141167572 wait complete. 2024-09-13T18:54:31.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 Processor -- start 2024-09-13T18:54:31.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 -- start start 2024-09-13T18:54:31.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 0x7f3aa8156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa8160d30 0x7f3aa8159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa81f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa815a910 con 0x7f3aa806b170 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8159d00 con 0x7f3aa8161110 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aaca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa8159fe0 con 0x7f3aa8160d30 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aa7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 0x7f3aa8156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aa7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 0x7f3aa8156db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44660/0 (socket says 172.21.15.81:44660) 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aa7400700 1 -- 172.21.15.81:0/2658300202 learned_addr learned my addr 172.21.15.81:0/2658300202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aa6a00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa8160d30 0x7f3aa8159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.053+0000 7f3aa7e00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa81f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aa7400700 1 -- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa8160d30 msgr2=0x7f3aa8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aa7400700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa8160d30 0x7f3aa8159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aa7400700 1 -- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 msgr2=0x7f3aa81f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aa7400700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa81f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aa7400700 1 -- 172.21.15.81:0/2658300202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940094b0 con 0x7f3aa806b170 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aa7400700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 0x7f3aa8156db0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c4f0 tx=0x7f3a9800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98005d90 con 0x7f3aa806b170 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a980070d0 con 0x7f3aa806b170 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98007480 con 0x7f3aa806b170 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa815a2c0 con 0x7f3aa806b170 2024-09-13T18:54:31.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa80a90a0 con 0x7f3aa806b170 2024-09-13T18:54:31.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.057+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa80a9230 con 0x7f3aa806b170 2024-09-13T18:54:31.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.061+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a980075e0 con 0x7f3aa806b170 2024-09-13T18:54:31.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.061+0000 7f3a9f400700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a88066730 0x7f3a88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.061+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f3a98083600 con 0x7f3aa806b170 2024-09-13T18:54:31.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.061+0000 7f3aa6a00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a88066730 0x7f3a88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.065+0000 7f3aa6a00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a88066730 0x7f3a88068bf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3a940090b0 tx=0x7f3a94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.069+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a980507a0 con 0x7f3aa806b170 2024-09-13T18:54:31.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.253+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3aa806b5c0 con 0x7f3aa806b170 2024-09-13T18:54:31.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.253+0000 7f3a9f400700 1 -- 172.21.15.81:0/2658300202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a98017020 con 0x7f3aa806b170 2024-09-13T18:54:31.266 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:54:31.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a88066730 msgr2=0x7f3a88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a88066730 0x7f3a88068bf0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f3a940090b0 tx=0x7f3a94008030 comp rx=0 tx=0).stop 2024-09-13T18:54:31.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 msgr2=0x7f3aa8156db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 0x7f3aa8156db0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c4f0 tx=0x7f3a9800c800 comp rx=0 tx=0).stop 2024-09-13T18:54:31.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 shutdown_connections 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3a88066730 0x7f3a88068bf0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3aa8161110 0x7f3aa81f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3aa8160d30 0x7f3aa8159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 --2- 172.21.15.81:0/2658300202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aa806b170 0x7f3aa8156db0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 >> 172.21.15.81:0/2658300202 conn(0x7f3aa8071d20 msgr2=0x7f3aa80b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 shutdown_connections 2024-09-13T18:54:31.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.261+0000 7f3aaca00700 1 -- 172.21.15.81:0/2658300202 wait complete. 2024-09-13T18:54:31.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:31.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.445+0000 7ff5d4a00700 1 Processor -- start 2024-09-13T18:54:31.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.445+0000 7ff5d4a00700 1 -- start start 2024-09-13T18:54:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5d4a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5d006cbb0 0x7ff5d006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5d4a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5d00b2140 0x7ff5d00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5d4a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00cd190 con 0x7ff5d01593f0 2024-09-13T18:54:31.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5d4a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d01597d0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5d4a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d006d530 con 0x7ff5d00b2140 2024-09-13T18:54:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5d006cbb0 0x7ff5d006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cfe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5d00b2140 0x7ff5d00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5d006cbb0 0x7ff5d006cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44672/0 (socket says 172.21.15.81:44672) 2024-09-13T18:54:31.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 -- 172.21.15.81:0/407041815 learned_addr learned my addr 172.21.15.81:0/407041815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 -- 172.21.15.81:0/407041815 >> v2:172.21.15.178:3300/0 conn(0x7ff5d00b2140 msgr2=0x7ff5d00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 --2- 172.21.15.81:0/407041815 >> v2:172.21.15.178:3300/0 conn(0x7ff5d00b2140 0x7ff5d00b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 -- 172.21.15.81:0/407041815 >> v1:172.21.15.178:6789/0 conn(0x7ff5d01593f0 legacy=0x7ff5d00718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 -- 172.21.15.81:0/407041815 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00b19b0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5cea00700 1 --2- 172.21.15.81:0/407041815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d006cff0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00cb2f0 tx=0x7ff5bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6187746c81bd5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5ce000700 1 -- 172.21.15.81:0/407041815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011830 con 0x7ff5d006cbb0 2024-09-13T18:54:31.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5ce000700 1 -- 172.21.15.81:0/407041815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc011990 con 0x7ff5d006cbb0 2024-09-13T18:54:31.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.449+0000 7ff5ce000700 1 -- 172.21.15.81:0/407041815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011d20 con 0x7ff5d006cbb0 2024-09-13T18:54:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 -- 172.21.15.81:0/407041815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 msgr2=0x7ff5d006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/407041815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d006cff0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00cb2f0 tx=0x7ff5bc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 -- 172.21.15.81:0/407041815 shutdown_connections 2024-09-13T18:54:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/407041815 >> v2:172.21.15.178:3300/0 conn(0x7ff5d00b2140 0x7ff5d00b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/407041815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d006cff0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 -- 172.21.15.81:0/407041815 >> 172.21.15.81:0/407041815 conn(0x7ff5d00b0c40 msgr2=0x7ff5d006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 -- 172.21.15.81:0/407041815 shutdown_connections 2024-09-13T18:54:31.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 -- 172.21.15.81:0/407041815 wait complete. 2024-09-13T18:54:31.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 Processor -- start 2024-09-13T18:54:31.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.453+0000 7ff5d4a00700 1 -- start start 2024-09-13T18:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d00b2140 0x7ff5d0147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d01593f0 0x7ff5d01486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0151ed0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d01484f0 con 0x7ff5d01593f0 2024-09-13T18:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d01f5d30 con 0x7ff5d00b2140 2024-09-13T18:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44674/0 (socket says 172.21.15.81:44674) 2024-09-13T18:54:31.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 -- 172.21.15.81:0/2081938614 learned_addr learned my addr 172.21.15.81:0/2081938614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cfe00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d01593f0 0x7ff5d01486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cea00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d00b2140 0x7ff5d0147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 -- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d00b2140 msgr2=0x7ff5d0147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d00b2140 0x7ff5d0147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 -- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d01593f0 msgr2=0x7ff5d01486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d01593f0 0x7ff5d01486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 -- 172.21.15.81:0/2081938614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc009570 con 0x7ff5d006cbb0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5cf400700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d015a320 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c500 tx=0x7ff5c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00052d0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c0005430 con 0x7ff5d006cbb0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00055a0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d015aa20 con 0x7ff5d006cbb0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.457+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d015c440 con 0x7ff5d006cbb0 2024-09-13T18:54:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.461+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d01f5ea0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.461+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5c00038e0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.461+0000 7ff5c7400700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff5b0066730 0x7ff5b0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.461+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff5c00837a0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.465+0000 7ff5cea00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff5b0066730 0x7ff5b0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.465+0000 7ff5cea00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff5b0066730 0x7ff5b0068bf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc000c00 tx=0x7ff5bc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.469+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5c00508b0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.693+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d00cd9a0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5c7400700 1 -- 172.21.15.81:0/2081938614 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7ff5c0053ed0 con 0x7ff5d006cbb0 2024-09-13T18:54:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:31.707 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff5b0066730 msgr2=0x7ff5b0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff5b0066730 0x7ff5b0068bf0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc000c00 tx=0x7ff5bc008030 comp rx=0 tx=0).stop 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 msgr2=0x7ff5d015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d015a320 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7ff5c000c500 tx=0x7ff5c000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 shutdown_connections 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff5b0066730 0x7ff5b0068bf0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d01593f0 0x7ff5d01486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d00b2140 0x7ff5d0147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 --2- 172.21.15.81:0/2081938614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5d006cbb0 0x7ff5d015a320 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 >> 172.21.15.81:0/2081938614 conn(0x7ff5d00b0c40 msgr2=0x7ff5d0070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 shutdown_connections 2024-09-13T18:54:31.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.697+0000 7ff5d4a00700 1 -- 172.21.15.81:0/2081938614 wait complete. 2024-09-13T18:54:31.712 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:31.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:31.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.893+0000 7ff2dae00700 1 Processor -- start 2024-09-13T18:54:31.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.893+0000 7ff2dae00700 1 -- start start 2024-09-13T18:54:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2dae00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2d406cbb0 0x7ff2d406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2dae00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40b2140 0x7ff2d40b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2dae00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d40cd190 con 0x7ff2d41593f0 2024-09-13T18:54:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2dae00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d41597d0 con 0x7ff2d406cbb0 2024-09-13T18:54:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2dae00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d406d530 con 0x7ff2d40b2140 2024-09-13T18:54:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2d406cbb0 0x7ff2d406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff2d406cbb0 0x7ff2d406cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44688/0 (socket says 172.21.15.81:44688) 2024-09-13T18:54:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 -- 172.21.15.81:0/121090199 learned_addr learned my addr 172.21.15.81:0/121090199 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2da400700 1 --2- 172.21.15.81:0/121090199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40b2140 0x7ff2d40b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 -- 172.21.15.81:0/121090199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40b2140 msgr2=0x7ff2d40b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 --2- 172.21.15.81:0/121090199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40b2140 0x7ff2d40b25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 -- 172.21.15.81:0/121090199 >> v1:172.21.15.178:6789/0 conn(0x7ff2d41593f0 legacy=0x7ff2d40718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 -- 172.21.15.81:0/121090199 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40b19b0 con 0x7ff2d406cbb0 2024-09-13T18:54:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.897+0000 7ff2d9000700 1 --2- 172.21.15.81:0/121090199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d406cbb0 0x7ff2d406cff0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009910 tx=0x7ff2c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562bb8d6c83ad223 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2d3e00700 1 -- 172.21.15.81:0/121090199 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000ba60 con 0x7ff2d406cbb0 2024-09-13T18:54:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2d3e00700 1 -- 172.21.15.81:0/121090199 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000bbc0 con 0x7ff2d406cbb0 2024-09-13T18:54:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2d3e00700 1 -- 172.21.15.81:0/121090199 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0009e60 con 0x7ff2d406cbb0 2024-09-13T18:54:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 -- 172.21.15.81:0/121090199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d406cbb0 msgr2=0x7ff2d406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 --2- 172.21.15.81:0/121090199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d406cbb0 0x7ff2d406cff0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009910 tx=0x7ff2c0009c20 comp rx=0 tx=0).stop 2024-09-13T18:54:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 -- 172.21.15.81:0/121090199 shutdown_connections 2024-09-13T18:54:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 --2- 172.21.15.81:0/121090199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40b2140 0x7ff2d40b25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 --2- 172.21.15.81:0/121090199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d406cbb0 0x7ff2d406cff0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 -- 172.21.15.81:0/121090199 >> 172.21.15.81:0/121090199 conn(0x7ff2d40b0c40 msgr2=0x7ff2d406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 -- 172.21.15.81:0/121090199 shutdown_connections 2024-09-13T18:54:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 -- 172.21.15.81:0/121090199 wait complete. 2024-09-13T18:54:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 Processor -- start 2024-09-13T18:54:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.901+0000 7ff2dae00700 1 -- start start 2024-09-13T18:54:31.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d406cbb0 0x7ff2d41f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40b2140 0x7ff2d4157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 0x7ff2d41507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4159910 con 0x7ff2d41593f0 2024-09-13T18:54:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d41f3050 con 0x7ff2d40b2140 2024-09-13T18:54:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d41f3330 con 0x7ff2d406cbb0 2024-09-13T18:54:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 0x7ff2d41507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2d9a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d406cbb0 0x7ff2d41f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 0x7ff2d41507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44698/0 (socket says 172.21.15.81:44698) 2024-09-13T18:54:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 -- 172.21.15.81:0/588415825 learned_addr learned my addr 172.21.15.81:0/588415825 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2d9000700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40b2140 0x7ff2d4157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 -- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d406cbb0 msgr2=0x7ff2d41f2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d406cbb0 0x7ff2d41f2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 -- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40b2140 msgr2=0x7ff2d4157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40b2140 0x7ff2d4157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 -- 172.21.15.81:0/588415825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0009570 con 0x7ff2d41593f0 2024-09-13T18:54:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2d9000700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40b2140 0x7ff2d4157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:31.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2da400700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 0x7ff2d41507b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc007b80 tx=0x7ff2cc007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00f040 con 0x7ff2d41593f0 2024-09-13T18:54:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d41f3610 con 0x7ff2d41593f0 2024-09-13T18:54:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00db50 con 0x7ff2d41593f0 2024-09-13T18:54:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc013400 con 0x7ff2d41593f0 2024-09-13T18:54:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d4158370 con 0x7ff2d41593f0 2024-09-13T18:54:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.905+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d4159ae0 con 0x7ff2d41593f0 2024-09-13T18:54:31.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.909+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2cc013560 con 0x7ff2d41593f0 2024-09-13T18:54:31.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.909+0000 7ff2d1600700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2b4066730 0x7ff2b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:31.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.909+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff2cc084cc0 con 0x7ff2d41593f0 2024-09-13T18:54:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.909+0000 7ff2d9a00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2b4066730 0x7ff2b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.913+0000 7ff2d9a00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2b4066730 0x7ff2b4068bf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8000f60 tx=0x7ff2c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:31.917+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2cc08b080 con 0x7ff2d41593f0 2024-09-13T18:54:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.101+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2d40cd9a0 con 0x7ff2d41593f0 2024-09-13T18:54:32.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2d1600700 1 -- 172.21.15.81:0/588415825 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16911 (secure 0 0 0) 0x7ff2cc017090 con 0x7ff2d41593f0 2024-09-13T18:54:32.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:32.115 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:00.567923+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2b4066730 msgr2=0x7ff2b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2b4066730 0x7ff2b4068bf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8000f60 tx=0x7ff2c8009040 comp rx=0 tx=0).stop 2024-09-13T18:54:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 msgr2=0x7ff2d41507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 0x7ff2d41507b0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc007b80 tx=0x7ff2cc007e90 comp rx=0 tx=0).stop 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 shutdown_connections 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff2b4066730 0x7ff2b4068bf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2d41593f0 0x7ff2d41507b0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40b2140 0x7ff2d4157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 --2- 172.21.15.81:0/588415825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d406cbb0 0x7ff2d41f2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 >> 172.21.15.81:0/588415825 conn(0x7ff2d40b0c40 msgr2=0x7ff2d41e58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 shutdown_connections 2024-09-13T18:54:32.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.105+0000 7ff2dae00700 1 -- 172.21.15.81:0/588415825 wait complete. 2024-09-13T18:54:32.143 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:54:32.143 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:32.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.301+0000 7fd383200700 1 Processor -- start 2024-09-13T18:54:32.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.301+0000 7fd383200700 1 -- start start 2024-09-13T18:54:32.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd383200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06a5d0 0x7fd37c06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd383200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0cdd90 con 0x7fd37c06c460 2024-09-13T18:54:32.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd383200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c06ce10 con 0x7fd37c15b700 2024-09-13T18:54:32.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd383200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c06afa0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd37c06c460 0x7fd37c06d2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38612/0 (socket says 172.21.15.81:38612) 2024-09-13T18:54:32.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37b400700 1 -- 172.21.15.81:0/2213743067 learned_addr learned my addr 172.21.15.81:0/2213743067 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd381200700 1 --2- 172.21.15.81:0/2213743067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06a5d0 0x7fd37c06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824426453 0 0) 0x7fd37c0cdd90 con 0x7fd37c06c460 2024-09-13T18:54:32.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3600035d0 con 0x7fd37c06c460 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096656625 0 0) 0x7fd37c06ce10 con 0x7fd37c15b700 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd37c0cdd90 con 0x7fd37c15b700 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd381200700 1 -- 172.21.15.81:0/2213743067 >> v1:172.21.15.178:6789/0 conn(0x7fd37c15b700 legacy=0x7fd37c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3893215690 0 0) 0x7fd3600035d0 con 0x7fd37c06c460 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd381200700 1 -- 172.21.15.81:0/2213743067 >> v1:172.21.15.81:6789/0 conn(0x7fd37c06c460 legacy=0x7fd37c06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.305+0000 7fd381200700 1 -- 172.21.15.81:0/2213743067 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0cd4f0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd381200700 1 --2- 172.21.15.81:0/2213743067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06a5d0 0x7fd37c06aa60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd374009dc0 tx=0x7fd37400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb3d67440b9b7980 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400e070 con 0x7fd37c06a5d0 2024-09-13T18:54:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374003a40 con 0x7fd37c06a5d0 2024-09-13T18:54:32.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd37aa00700 1 -- 172.21.15.81:0/2213743067 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd368001670 con 0x7fd37c06a5d0 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 -- 172.21.15.81:0/2213743067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06a5d0 msgr2=0x7fd37c06aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 --2- 172.21.15.81:0/2213743067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06a5d0 0x7fd37c06aa60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd374009dc0 tx=0x7fd37400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 -- 172.21.15.81:0/2213743067 shutdown_connections 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 --2- 172.21.15.81:0/2213743067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06a5d0 0x7fd37c06aa60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 -- 172.21.15.81:0/2213743067 >> 172.21.15.81:0/2213743067 conn(0x7fd37c0b08d0 msgr2=0x7fd37c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 -- 172.21.15.81:0/2213743067 shutdown_connections 2024-09-13T18:54:32.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.309+0000 7fd383200700 1 -- 172.21.15.81:0/2213743067 wait complete. 2024-09-13T18:54:32.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 Processor -- start 2024-09-13T18:54:32.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 -- start start 2024-09-13T18:54:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 0x7fd37c144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06c460 0x7fd37c1e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c15b700 0x7fd37c155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c151bf0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c159fc0 con 0x7fd37c15b700 2024-09-13T18:54:32.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd383200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1593b0 con 0x7fd37c06c460 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 0x7fd37c144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 0x7fd37c144270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44706/0 (socket says 172.21.15.81:44706) 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 -- 172.21.15.81:0/172653736 learned_addr learned my addr 172.21.15.81:0/172653736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37b400700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06c460 0x7fd37c1e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd381200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c15b700 0x7fd37c155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 -- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06c460 msgr2=0x7fd37c1e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06c460 0x7fd37c1e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 -- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c15b700 msgr2=0x7fd37c155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c15b700 0x7fd37c155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 -- 172.21.15.81:0/172653736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd374009a70 con 0x7fd37c06a5d0 2024-09-13T18:54:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.313+0000 7fd37be00700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 0x7fd37c144270 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c490 tx=0x7fd36c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00cea0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0052f0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0036a0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c159690 con 0x7fd37c06a5d0 2024-09-13T18:54:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c159c50 con 0x7fd37c06a5d0 2024-09-13T18:54:32.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c0acfa0 con 0x7fd37c06a5d0 2024-09-13T18:54:32.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.317+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd36c003800 con 0x7fd37c06a5d0 2024-09-13T18:54:32.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.321+0000 7fd373e00700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd35c066730 0x7fd35c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.321+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fd36c083770 con 0x7fd37c06a5d0 2024-09-13T18:54:32.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.321+0000 7fd37b400700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd35c066730 0x7fd35c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.321+0000 7fd37b400700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd35c066730 0x7fd35c068bf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd37c1556e0 tx=0x7fd368000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.329+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd36c050880 con 0x7fd37c06a5d0 2024-09-13T18:54:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.561+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd37c06aa60 con 0x7fd37c06a5d0 2024-09-13T18:54:32.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.561+0000 7fd373e00700 1 -- 172.21.15.81:0/172653736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7fd36c081e60 con 0x7fd37c06a5d0 2024-09-13T18:54:32.572 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:32.572 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.561+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd35c066730 msgr2=0x7fd35c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.561+0000 7fd383200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd35c066730 0x7fd35c068bf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd37c1556e0 tx=0x7fd368000ed0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.561+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 msgr2=0x7fd37c144270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.561+0000 7fd383200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 0x7fd37c144270 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c490 tx=0x7fd36c00c7a0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 shutdown_connections 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd35c066730 0x7fd35c068bf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd37c15b700 0x7fd37c155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd37c06c460 0x7fd37c1e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 --2- 172.21.15.81:0/172653736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37c06a5d0 0x7fd37c144270 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 >> 172.21.15.81:0/172653736 conn(0x7fd37c0b08d0 msgr2=0x7fd37c0ac890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 shutdown_connections 2024-09-13T18:54:32.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.565+0000 7fd383200700 1 -- 172.21.15.81:0/172653736 wait complete. 2024-09-13T18:54:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:32.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:32.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.757+0000 7fa252600700 1 Processor -- start 2024-09-13T18:54:32.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa252600700 1 -- start start 2024-09-13T18:54:32.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa252600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0cb700 0x7fa24c06aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa252600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa24c06afe0 0x7fa24c1636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa252600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa24c0707d0 con 0x7fa24c159bd0 2024-09-13T18:54:32.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa252600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24c06b490 con 0x7fa24c06afe0 2024-09-13T18:54:32.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa252600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c0720a0 con 0x7fa24c0cb700 2024-09-13T18:54:32.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa24c06afe0 0x7fa24c1636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa24c159bd0 0x7fa24c071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38618/0 (socket says 172.21.15.81:38618) 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251200700 1 -- 172.21.15.81:0/2092381059 learned_addr learned my addr 172.21.15.81:0/2092381059 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa24be00700 1 --2- 172.21.15.81:0/2092381059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0cb700 0x7fa24c06aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa24b400700 1 -- 172.21.15.81:0/2092381059 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3213641532 0 0) 0x7fa24c0707d0 con 0x7fa24c159bd0 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa24b400700 1 -- 172.21.15.81:0/2092381059 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2340035d0 con 0x7fa24c159bd0 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251c00700 1 -- 172.21.15.81:0/2092381059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0cb700 msgr2=0x7fa24c06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251c00700 1 --2- 172.21.15.81:0/2092381059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0cb700 0x7fa24c06aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251c00700 1 -- 172.21.15.81:0/2092381059 >> v1:172.21.15.81:6789/0 conn(0x7fa24c159bd0 legacy=0x7fa24c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.761+0000 7fa251c00700 1 -- 172.21.15.81:0/2092381059 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c06fee0 con 0x7fa24c06afe0 2024-09-13T18:54:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa251c00700 1 --2- 172.21.15.81:0/2092381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c06afe0 0x7fa24c1636b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa244009dc0 tx=0x7fa24400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b1419785d137fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa24b400700 1 -- 172.21.15.81:0/2092381059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400e070 con 0x7fa24c06afe0 2024-09-13T18:54:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa24b400700 1 -- 172.21.15.81:0/2092381059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400bae0 con 0x7fa24c06afe0 2024-09-13T18:54:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa24b400700 1 -- 172.21.15.81:0/2092381059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400be50 con 0x7fa24c06afe0 2024-09-13T18:54:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 -- 172.21.15.81:0/2092381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c06afe0 msgr2=0x7fa24c1636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 --2- 172.21.15.81:0/2092381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c06afe0 0x7fa24c1636b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa244009dc0 tx=0x7fa24400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 -- 172.21.15.81:0/2092381059 shutdown_connections 2024-09-13T18:54:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 --2- 172.21.15.81:0/2092381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c06afe0 0x7fa24c1636b0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 --2- 172.21.15.81:0/2092381059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c0cb700 0x7fa24c06aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 -- 172.21.15.81:0/2092381059 >> 172.21.15.81:0/2092381059 conn(0x7fa24c0b0c40 msgr2=0x7fa24c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:32.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 -- 172.21.15.81:0/2092381059 shutdown_connections 2024-09-13T18:54:32.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.765+0000 7fa252600700 1 -- 172.21.15.81:0/2092381059 wait complete. 2024-09-13T18:54:32.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 Processor -- start 2024-09-13T18:54:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 -- start start 2024-09-13T18:54:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c06afe0 0x7fa24c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c0cb700 0x7fa24c0ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 0x7fa24c1ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c144ca0 con 0x7fa24c159bd0 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c06c1f0 con 0x7fa24c0cb700 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa252600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c06c4c0 con 0x7fa24c06afe0 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 0x7fa24c1ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 0x7fa24c1ed530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44738/0 (socket says 172.21.15.81:44738) 2024-09-13T18:54:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 -- 172.21.15.81:0/191784639 learned_addr learned my addr 172.21.15.81:0/191784639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251200700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c06afe0 0x7fa24c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa24be00700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c0cb700 0x7fa24c0ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 -- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c06afe0 msgr2=0x7fa24c06bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c06afe0 0x7fa24c06bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 -- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c0cb700 msgr2=0x7fa24c0ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c0cb700 0x7fa24c0ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 -- 172.21.15.81:0/191784639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009a70 con 0x7fa24c159bd0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.769+0000 7fa251c00700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 0x7fa24c1ed530 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fa244014040 tx=0x7fa244004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244004960 con 0x7fa24c159bd0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244020070 con 0x7fa24c159bd0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c06c7a0 con 0x7fa24c159bd0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440276a0 con 0x7fa24c159bd0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c06cd60 con 0x7fa24c159bd0 2024-09-13T18:54:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c06aaa0 con 0x7fa24c159bd0 2024-09-13T18:54:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.773+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa244027800 con 0x7fa24c159bd0 2024-09-13T18:54:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.777+0000 7fa248c00700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa22c066730 0x7fa22c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.777+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fa244022070 con 0x7fa24c159bd0 2024-09-13T18:54:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.777+0000 7fa251200700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa22c066730 0x7fa22c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.777+0000 7fa251200700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa22c066730 0x7fa22c068bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa240005930 tx=0x7fa240009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:32.785+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa244053570 con 0x7fa24c159bd0 2024-09-13T18:54:33.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.013+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa24c156ef0 con 0x7fa24c159bd0 2024-09-13T18:54:33.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.013+0000 7fa248c00700 1 -- 172.21.15.81:0/191784639 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+4776 (secure 0 0 0) 0x7fa244056b90 con 0x7fa24c159bd0 2024-09-13T18:54:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:33.025 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":97,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":97,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:53:33.403058+0000","modified":"2024-09-13T18:54:16.675690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8076,"mds_1":8073,"mds_2":7675},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7675":{"gid":7675,"name":"d","rank":2,"incarnation":90,"state":"up:active","state_seq":14,"addr":"172.21.15.178:6834/3980969466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":3980969466},{"type":"v1","addr":"172.21.15.178:6834","nonce":3980969466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8073":{"gid":8073,"name":"c","rank":1,"incarnation":88,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6836/548467778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":548467778},{"type":"v1","addr":"172.21.15.81:6836","nonce":548467778}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8076":{"gid":8076,"name":"a","rank":0,"incarnation":82,"state":"up:active","state_seq":13,"addr":"172.21.15.81:6837/2448579226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2448579226},{"type":"v1","addr":"172.21.15.81:6837","nonce":2448579226}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:54:33.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa22c066730 msgr2=0x7fa22c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa22c066730 0x7fa22c068bf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa240005930 tx=0x7fa240009040 comp rx=0 tx=0).stop 2024-09-13T18:54:33.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 msgr2=0x7fa24c1ed530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 0x7fa24c1ed530 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fa244014040 tx=0x7fa244004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 shutdown_connections 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa22c066730 0x7fa22c068bf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24c159bd0 0x7fa24c1ed530 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa24c0cb700 0x7fa24c0ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 --2- 172.21.15.81:0/191784639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa24c06afe0 0x7fa24c06bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 >> 172.21.15.81:0/191784639 conn(0x7fa24c0b0c40 msgr2=0x7fa24c0ae450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 shutdown_connections 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.017+0000 7fa252600700 1 -- 172.21.15.81:0/191784639 wait complete. 2024-09-13T18:54:33.030 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 97 2024-09-13T18:54:33.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:33.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 Processor -- start 2024-09-13T18:54:33.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 -- start start 2024-09-13T18:54:33.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf7415ab80 0x7fcf7415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 0x7fcf7415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7415f0a0 con 0x7fcf7415e650 2024-09-13T18:54:33.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7415f380 con 0x7fcf7415ab80 2024-09-13T18:54:33.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf7a400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415b320 con 0x7fcf740cfa00 2024-09-13T18:54:33.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf79a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 0x7fcf7415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf79000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf7415ab80 0x7fcf7415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf79a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 0x7fcf7415ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:59090/0 (socket says 172.21.15.81:59090) 2024-09-13T18:54:33.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.213+0000 7fcf79a00700 1 -- 172.21.15.81:0/2053324728 learned_addr learned my addr 172.21.15.81:0/2053324728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:33.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf79a00700 1 -- 172.21.15.81:0/2053324728 >> v2:172.21.15.178:3300/0 conn(0x7fcf7415ab80 msgr2=0x7fcf7415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:33.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf79a00700 1 --2- 172.21.15.81:0/2053324728 >> v2:172.21.15.178:3300/0 conn(0x7fcf7415ab80 0x7fcf7415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf79a00700 1 -- 172.21.15.81:0/2053324728 >> v1:172.21.15.178:6789/0 conn(0x7fcf7415e650 legacy=0x7fcf740cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf79a00700 1 -- 172.21.15.81:0/2053324728 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7415b600 con 0x7fcf740cfa00 2024-09-13T18:54:33.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf79000700 1 --2- 172.21.15.81:0/2053324728 >> v2:172.21.15.178:3300/0 conn(0x7fcf7415ab80 0x7fcf7415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:33.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf79a00700 1 --2- 172.21.15.81:0/2053324728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 0x7fcf7415ea90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009e50 tx=0x7fcf6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad9e9e995b052427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:33.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf73400700 1 -- 172.21.15.81:0/2053324728 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00e070 con 0x7fcf740cfa00 2024-09-13T18:54:33.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf73400700 1 -- 172.21.15.81:0/2053324728 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00b910 con 0x7fcf740cfa00 2024-09-13T18:54:33.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf73400700 1 -- 172.21.15.81:0/2053324728 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00bcc0 con 0x7fcf740cfa00 2024-09-13T18:54:33.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 -- 172.21.15.81:0/2053324728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 msgr2=0x7fcf7415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2053324728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 0x7fcf7415ea90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009e50 tx=0x7fcf6c00b330 comp rx=0 tx=0).stop 2024-09-13T18:54:33.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 -- 172.21.15.81:0/2053324728 shutdown_connections 2024-09-13T18:54:33.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2053324728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf740cfa00 0x7fcf7415ea90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2053324728 >> v2:172.21.15.178:3300/0 conn(0x7fcf7415ab80 0x7fcf7415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 -- 172.21.15.81:0/2053324728 >> 172.21.15.81:0/2053324728 conn(0x7fcf74071d90 msgr2=0x7fcf74072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:33.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 -- 172.21.15.81:0/2053324728 shutdown_connections 2024-09-13T18:54:33.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.217+0000 7fcf7a400700 1 -- 172.21.15.81:0/2053324728 wait complete. 2024-09-13T18:54:33.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.221+0000 7fcf7a400700 1 Processor -- start 2024-09-13T18:54:33.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.221+0000 7fcf7a400700 1 -- start start 2024-09-13T18:54:33.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf740cfa00 0x7fcf7413b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 0x7fcf7413ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7415e650 0x7fcf74141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741f00f0 con 0x7fcf7415ab80 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7413b290 con 0x7fcf740cfa00 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7413d9a0 con 0x7fcf7415e650 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 0x7fcf7413ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 0x7fcf7413ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44746/0 (socket says 172.21.15.81:44746) 2024-09-13T18:54:33.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 -- 172.21.15.81:0/2872021301 learned_addr learned my addr 172.21.15.81:0/2872021301 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf79000700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf740cfa00 0x7fcf7413b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf79a00700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7415e650 0x7fcf74141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 -- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7415e650 msgr2=0x7fcf74141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7415e650 0x7fcf74141160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 -- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf740cfa00 msgr2=0x7fcf7413b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf740cfa00 0x7fcf7413b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 -- 172.21.15.81:0/2872021301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680094b0 con 0x7fcf7415ab80 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf79a00700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7415e650 0x7fcf74141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:33.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf73e00700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 0x7fcf7413ad50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000c500 tx=0x7fcf6000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600052d0 con 0x7fcf7415ab80 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf60005430 con 0x7fcf7415ab80 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c009b30 con 0x7fcf7415ab80 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf600055a0 con 0x7fcf7415ab80 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.225+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7413df60 con 0x7fcf7415ab80 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.229+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74151fd0 con 0x7fcf7415ab80 2024-09-13T18:54:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.229+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf600038e0 con 0x7fcf7415ab80 2024-09-13T18:54:33.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.229+0000 7fcf70c00700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf54066730 0x7fcf54068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.229+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7fcf60083820 con 0x7fcf7415ab80 2024-09-13T18:54:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.229+0000 7fcf79000700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf54066730 0x7fcf54068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.233+0000 7fcf79000700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf54066730 0x7fcf54068bf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009d80 tx=0x7fcf68009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:33.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.233+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf600508a0 con 0x7fcf7415ab80 2024-09-13T18:54:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.425+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf7415ea90 con 0x7fcf7415ab80 2024-09-13T18:54:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf70c00700 1 -- 172.21.15.81:0/2872021301 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+16911 (secure 0 0 0) 0x7fcf60053ec0 con 0x7fcf7415ab80 2024-09-13T18:54:33.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:33.439 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:00.567923+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:53:31.421608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-09-13T18:53:32.402698+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.31","mappings":[{"from":1,"to":5}]},{"pgid":"14.36","mappings":[{"from":1,"to":7}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf54066730 msgr2=0x7fcf54068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf54066730 0x7fcf54068bf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcf68009d80 tx=0x7fcf68009240 comp rx=0 tx=0).stop 2024-09-13T18:54:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 msgr2=0x7fcf7413ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 0x7fcf7413ad50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000c500 tx=0x7fcf6000c810 comp rx=0 tx=0).stop 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 shutdown_connections 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcf54066730 0x7fcf54068bf0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf7415e650 0x7fcf74141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcf7415ab80 0x7fcf7413ad50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 --2- 172.21.15.81:0/2872021301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf740cfa00 0x7fcf7413b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 >> 172.21.15.81:0/2872021301 conn(0x7fcf74071d90 msgr2=0x7fcf74155770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 shutdown_connections 2024-09-13T18:54:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.429+0000 7fcf7a400700 1 -- 172.21.15.81:0/2872021301 wait complete. 2024-09-13T18:54:33.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:54:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.625+0000 7f4eecc00700 1 Processor -- start 2024-09-13T18:54:33.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.625+0000 7f4eecc00700 1 -- start start 2024-09-13T18:54:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4eecc00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ee80b4a00 0x7f4ee80cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4eecc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee815d530 con 0x7f4ee80ccb40 2024-09-13T18:54:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4eecc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee815d810 con 0x7f4ee8159690 2024-09-13T18:54:33.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4eecc00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee815daf0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4ee80ccb40 0x7f4ee80ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38632/0 (socket says 172.21.15.81:38632) 2024-09-13T18:54:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6a00700 1 -- 172.21.15.81:0/1061777357 learned_addr learned my addr 172.21.15.81:0/1061777357 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee7e00700 1 --2- 172.21.15.81:0/1061777357 >> v2:172.21.15.178:3300/0 conn(0x7f4ee80b4a00 0x7f4ee80cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267462372 0 0) 0x7f4ee815d530 con 0x7f4ee80ccb40 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ecc0057e0 con 0x7f4ee80ccb40 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282532780 0 0) 0x7f4ee815d810 con 0x7f4ee8159690 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee815d530 con 0x7f4ee8159690 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee7e00700 1 -- 172.21.15.81:0/1061777357 >> v1:172.21.15.178:6789/0 conn(0x7f4ee8159690 legacy=0x7f4ee80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987136941 0 0) 0x7f4ecc0057e0 con 0x7f4ee80ccb40 2024-09-13T18:54:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee7e00700 1 -- 172.21.15.81:0/1061777357 >> v1:172.21.15.81:6789/0 conn(0x7f4ee80ccb40 legacy=0x7f4ee80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee7e00700 1 -- 172.21.15.81:0/1061777357 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee815ddd0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee7e00700 1 --2- 172.21.15.81:0/1061777357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80b4a00 0x7f4ee80cecb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009dc0 tx=0x7f4ee000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7707a2e750cdc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000e070 con 0x7f4ee80b4a00 2024-09-13T18:54:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0003a40 con 0x7f4ee80b4a00 2024-09-13T18:54:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.629+0000 7f4ee6000700 1 -- 172.21.15.81:0/1061777357 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4001670 con 0x7f4ee80b4a00 2024-09-13T18:54:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 -- 172.21.15.81:0/1061777357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80b4a00 msgr2=0x7f4ee80cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 --2- 172.21.15.81:0/1061777357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80b4a00 0x7f4ee80cecb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009dc0 tx=0x7f4ee000b330 comp rx=0 tx=0).stop 2024-09-13T18:54:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 -- 172.21.15.81:0/1061777357 shutdown_connections 2024-09-13T18:54:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 --2- 172.21.15.81:0/1061777357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee80b4a00 0x7f4ee80cecb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 -- 172.21.15.81:0/1061777357 >> 172.21.15.81:0/1061777357 conn(0x7f4ee806ca10 msgr2=0x7f4ee806cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 -- 172.21.15.81:0/1061777357 shutdown_connections 2024-09-13T18:54:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 -- 172.21.15.81:0/1061777357 wait complete. 2024-09-13T18:54:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 Processor -- start 2024-09-13T18:54:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 -- start start 2024-09-13T18:54:33.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 0x7f4ee8147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80ccb40 0x7f4ee8147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.633+0000 7f4eecc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee8159690 0x7f4ee815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4eecc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8147bd0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4eecc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8148550 con 0x7f4ee8159690 2024-09-13T18:54:33.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4eecc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8148830 con 0x7f4ee80ccb40 2024-09-13T18:54:33.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 0x7f4ee8147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 0x7f4ee8147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44758/0 (socket says 172.21.15.81:44758) 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 -- 172.21.15.81:0/3010222081 learned_addr learned my addr 172.21.15.81:0/3010222081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee6a00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80ccb40 0x7f4ee8147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7e00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee8159690 0x7f4ee815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 -- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80ccb40 msgr2=0x7f4ee8147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80ccb40 0x7f4ee8147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 -- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee8159690 msgr2=0x7f4ee815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee8159690 0x7f4ee815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 -- 172.21.15.81:0/3010222081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0009a70 con 0x7f4ee80b4a00 2024-09-13T18:54:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4ee7400700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 0x7f4ee8147f70 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800c490 tx=0x7f4ed800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80052d0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8005450 con 0x7f4ee80b4a00 2024-09-13T18:54:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8148b10 con 0x7f4ee80b4a00 2024-09-13T18:54:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80038e0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee81490d0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.637+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee81492f0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.641+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ed8003a40 con 0x7f4ee80b4a00 2024-09-13T18:54:33.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.641+0000 7f4edf400700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ec8066730 0x7f4ec8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:33.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.641+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4ed80838e0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.641+0000 7f4ee6a00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ec8066730 0x7f4ec8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:33.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.645+0000 7f4ee6a00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ec8066730 0x7f4ec8068bf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4001eb0 tx=0x7f4ed4001c40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:33.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.649+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ed80509f0 con 0x7f4ee80b4a00 2024-09-13T18:54:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.869+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4ee80cc430 con 0x7f4ee80b4a00 2024-09-13T18:54:33.881 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:54:33.869+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:54:33.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.881+0000 7f4edf400700 1 -- 172.21.15.81:0/3010222081 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v98) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ed8017090 con 0x7f4ee80b4a00 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ec8066730 msgr2=0x7f4ec8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ec8066730 0x7f4ec8068bf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4001eb0 tx=0x7f4ed4001c40 comp rx=0 tx=0).stop 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 msgr2=0x7f4ee8147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 0x7f4ee8147f70 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800c490 tx=0x7f4ed800c850 comp rx=0 tx=0).stop 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 shutdown_connections 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4ec8066730 0x7f4ec8068bf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ee8159690 0x7f4ee815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ee80ccb40 0x7f4ee8147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 --2- 172.21.15.81:0/3010222081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ee80b4a00 0x7f4ee8147f70 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 >> 172.21.15.81:0/3010222081 conn(0x7f4ee806ca10 msgr2=0x7f4ee8159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 shutdown_connections 2024-09-13T18:54:33.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:33.889+0000 7f4eecc00700 1 -- 172.21.15.81:0/3010222081 wait complete. 2024-09-13T18:54:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:54:33.910 INFO:tasks.ceph.mds.d.smithi178.stderr: -1077> 2024-09-13T18:54:09.257+0000 7f3cf5200700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1) n(v0 rc2024-09-13T18:53:51.554641+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8259 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55cf13a14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.554641+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:53:51.554641+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:54:33.911 INFO:tasks.ceph.mds.d.smithi178.stderr: -1056> 2024-09-13T18:54:09.257+0000 7f3cf5200700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/AsLsXsFsx@2},l=8259 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55cf13a15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:54:33.911 INFO:tasks.ceph.mds.c.smithi081.stderr: -1183> 2024-09-13T18:54:09.250+0000 7fc071400700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1) n(v2 rc2024-09-13T18:53:51.822636+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8259 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x556fb49bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.822636+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:53:51.822636+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:54:33.911 INFO:tasks.ceph.mds.c.smithi081.stderr: -1052> 2024-09-13T18:54:09.254+0000 7fc078c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1) n(v1 rc2024-09-13T18:53:51.822636+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={8259=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x556fb4a56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.554641+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.554641+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:53:51.822636+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:54:33.913 INFO:tasks.ceph.mds.a.smithi081.stderr: -7129> 2024-09-13T18:53:53.906+0000 7fe88d800700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:54:33.919 INFO:tasks.ceph.mds.a.smithi081.stderr: -2742> 2024-09-13T18:54:09.250+0000 7fe889200700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1) n(v3 rc2024-09-13T18:53:51.822636+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={8259=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8259 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55a179fc0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.822636+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:53:51.822636+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:54:33.919 INFO:tasks.ceph.mds.a.smithi081.stderr: -2633> 2024-09-13T18:54:09.250+0000 7fe890a00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1) n(v4 rc2024-09-13T18:53:51.822636+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={8259=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55a179fc0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:53:51.822636+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:53:51.550641+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:53:51.822636+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:54:33.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:54:33.962 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:54:33.966 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:54:33.973 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:54:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 Processor -- start 2024-09-13T18:54:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 -- start start 2024-09-13T18:54:34.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a5415a7e0 0x7f2a540b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:34.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a5415abc0 0x7f2a540b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:34.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540ceb90 con 0x7f2a540cf360 2024-09-13T18:54:34.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5406b940 con 0x7f2a5415abc0 2024-09-13T18:54:34.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a53200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5415e6b0 con 0x7f2a5415a7e0 2024-09-13T18:54:34.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a51400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a5415abc0 0x7f2a540b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:34.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a51400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a5415abc0 0x7f2a540b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44796/0 (socket says 172.21.15.81:44796) 2024-09-13T18:54:34.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a51400700 1 -- 172.21.15.81:0/2018303489 learned_addr learned my addr 172.21.15.81:0/2018303489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:34.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.081+0000 7f2a51e00700 1 --2- 172.21.15.81:0/2018303489 >> v2:172.21.15.178:3300/0 conn(0x7f2a5415a7e0 0x7f2a540b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a51400700 1 -- 172.21.15.81:0/2018303489 >> v2:172.21.15.178:3300/0 conn(0x7f2a5415a7e0 msgr2=0x7f2a540b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a51400700 1 --2- 172.21.15.81:0/2018303489 >> v2:172.21.15.178:3300/0 conn(0x7f2a5415a7e0 0x7f2a540b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a51400700 1 -- 172.21.15.81:0/2018303489 >> v1:172.21.15.178:6789/0 conn(0x7f2a540cf360 legacy=0x7f2a54066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a51400700 1 -- 172.21.15.81:0/2018303489 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5415e990 con 0x7f2a5415abc0 2024-09-13T18:54:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a51400700 1 --2- 172.21.15.81:0/2018303489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415abc0 0x7f2a540b1d80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2a540670d0 tx=0x7f2a40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf6a78f4d0c42e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:34.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a50a00700 1 -- 172.21.15.81:0/2018303489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40004230 con 0x7f2a5415abc0 2024-09-13T18:54:34.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a50a00700 1 -- 172.21.15.81:0/2018303489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40004390 con 0x7f2a5415abc0 2024-09-13T18:54:34.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a50a00700 1 -- 172.21.15.81:0/2018303489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400036c0 con 0x7f2a5415abc0 2024-09-13T18:54:34.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 -- 172.21.15.81:0/2018303489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415abc0 msgr2=0x7f2a540b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:34.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 --2- 172.21.15.81:0/2018303489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415abc0 0x7f2a540b1d80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f2a540670d0 tx=0x7f2a40009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 -- 172.21.15.81:0/2018303489 shutdown_connections 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 --2- 172.21.15.81:0/2018303489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415abc0 0x7f2a540b1d80 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 --2- 172.21.15.81:0/2018303489 >> v2:172.21.15.178:3300/0 conn(0x7f2a5415a7e0 0x7f2a540b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 -- 172.21.15.81:0/2018303489 >> 172.21.15.81:0/2018303489 conn(0x7f2a5406cb90 msgr2=0x7f2a5406cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 -- 172.21.15.81:0/2018303489 shutdown_connections 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.085+0000 7f2a53200700 1 -- 172.21.15.81:0/2018303489 wait complete. 2024-09-13T18:54:34.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 Processor -- start 2024-09-13T18:54:34.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 -- start start 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a540cf360 0x7f2a54066300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 0x7f2a540b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a5415abc0 0x7f2a5414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b2aa0 con 0x7f2a5415a7e0 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b2d80 con 0x7f2a5415abc0 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a53200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540b3060 con 0x7f2a540cf360 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 0x7f2a540b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 0x7f2a540b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44808/0 (socket says 172.21.15.81:44808) 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 -- 172.21.15.81:0/3777691894 learned_addr learned my addr 172.21.15.81:0/3777691894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:34.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51e00700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a540cf360 0x7f2a54066300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:34.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a52800700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a5415abc0 0x7f2a5414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 -- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a540cf360 msgr2=0x7f2a54066300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a540cf360 0x7f2a54066300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 -- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a5415abc0 msgr2=0x7f2a5414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a5415abc0 0x7f2a5414ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 -- 172.21.15.81:0/3777691894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40009570 con 0x7f2a5415a7e0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.089+0000 7f2a51400700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 0x7f2a540b42c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2a40004000 tx=0x7f2a40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40003e50 con 0x7f2a5415a7e0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000b660 con 0x7f2a5415a7e0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000b9f0 con 0x7f2a5415a7e0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a540b3340 con 0x7f2a5415a7e0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a54066840 con 0x7f2a5415a7e0 2024-09-13T18:54:34.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a540b3860 con 0x7f2a5415a7e0 2024-09-13T18:54:34.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.093+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a40021070 con 0x7f2a5415a7e0 2024-09-13T18:54:34.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.097+0000 7f2a4a000700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a34066730 0x7f2a34068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.097+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6403+0+0 (secure 0 0 0) 0x7f2a40085bb0 con 0x7f2a5415a7e0 2024-09-13T18:54:34.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.097+0000 7f2a51e00700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a34066730 0x7f2a34068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:34.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.097+0000 7f2a51e00700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a34066730 0x7f2a34068bf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2a541f55d0 tx=0x7f2a44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:34.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.101+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a540b3860 con 0x7f2a5415a7e0 2024-09-13T18:54:34.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.321+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a540b3860 con 0x7f2a5415a7e0 2024-09-13T18:54:34.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.889+0000 7f2a4a000700 1 -- 172.21.15.81:0/3777691894 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v99) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a540b3860 con 0x7f2a5415a7e0 2024-09-13T18:54:34.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a34066730 msgr2=0x7f2a34068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:34.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a34066730 0x7f2a34068bf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2a541f55d0 tx=0x7f2a44008040 comp rx=0 tx=0).stop 2024-09-13T18:54:34.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 msgr2=0x7f2a540b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 0x7f2a540b42c0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f2a40004000 tx=0x7f2a40004770 comp rx=0 tx=0).stop 2024-09-13T18:54:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 shutdown_connections 2024-09-13T18:54:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2a34066730 0x7f2a34068bf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a5415abc0 0x7f2a5414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a5415a7e0 0x7f2a540b42c0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 --2- 172.21.15.81:0/3777691894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a540cf360 0x7f2a54066300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 >> 172.21.15.81:0/3777691894 conn(0x7f2a5406cb90 msgr2=0x7f2a54070b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 shutdown_connections 2024-09-13T18:54:34.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:34.893+0000 7f2a53200700 1 -- 172.21.15.81:0/3777691894 wait complete. 2024-09-13T18:54:34.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:54:35.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.145+0000 7f845fe00700 1 Processor -- start 2024-09-13T18:54:35.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.145+0000 7f845fe00700 1 -- start start 2024-09-13T18:54:35.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f845815e340 0x7f84580d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:35.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84580d0fb0 0x7f84580b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:35.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845fe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580b4830 con 0x7f845815cda0 2024-09-13T18:54:35.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84580d1440 con 0x7f84580d0fb0 2024-09-13T18:54:35.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845815e120 con 0x7f845815e340 2024-09-13T18:54:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845de00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84580d0fb0 0x7f84580b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f845815cda0 0x7f845815d180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38654/0 (socket says 172.21.15.81:38654) 2024-09-13T18:54:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845d400700 1 -- 172.21.15.81:0/67772927 learned_addr learned my addr 172.21.15.81:0/67772927 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:35.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845ca00700 1 --2- 172.21.15.81:0/67772927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f845815e340 0x7f84580d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f8457e00700 1 -- 172.21.15.81:0/67772927 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571915074 0 0) 0x7f84580b4830 con 0x7f845815cda0 2024-09-13T18:54:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f8457e00700 1 -- 172.21.15.81:0/67772927 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84400035d0 con 0x7f845815cda0 2024-09-13T18:54:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845de00700 1 -- 172.21.15.81:0/67772927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f845815e340 msgr2=0x7f84580d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845de00700 1 --2- 172.21.15.81:0/67772927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f845815e340 0x7f84580d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845de00700 1 -- 172.21.15.81:0/67772927 >> v1:172.21.15.81:6789/0 conn(0x7f845815cda0 legacy=0x7f845815d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.149+0000 7f845de00700 1 -- 172.21.15.81:0/67772927 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845815d890 con 0x7f84580d0fb0 2024-09-13T18:54:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845de00700 1 --2- 172.21.15.81:0/67772927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84580d0fb0 0x7f84580b4cc0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8450009d90 tx=0x7f845000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee065ddf0fe405c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f8457e00700 1 -- 172.21.15.81:0/67772927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000e070 con 0x7f84580d0fb0 2024-09-13T18:54:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f8457e00700 1 -- 172.21.15.81:0/67772927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845000bb20 con 0x7f84580d0fb0 2024-09-13T18:54:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f8457e00700 1 -- 172.21.15.81:0/67772927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450012430 con 0x7f84580d0fb0 2024-09-13T18:54:35.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 -- 172.21.15.81:0/67772927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84580d0fb0 msgr2=0x7f84580b4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:35.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 --2- 172.21.15.81:0/67772927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84580d0fb0 0x7f84580b4cc0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8450009d90 tx=0x7f845000b330 comp rx=0 tx=0).stop 2024-09-13T18:54:35.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 -- 172.21.15.81:0/67772927 shutdown_connections 2024-09-13T18:54:35.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 --2- 172.21.15.81:0/67772927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84580d0fb0 0x7f84580b4cc0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 --2- 172.21.15.81:0/67772927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f845815e340 0x7f84580d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 -- 172.21.15.81:0/67772927 >> 172.21.15.81:0/67772927 conn(0x7f845806e660 msgr2=0x7f845806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 -- 172.21.15.81:0/67772927 shutdown_connections 2024-09-13T18:54:35.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.153+0000 7f845fe00700 1 -- 172.21.15.81:0/67772927 wait complete. 2024-09-13T18:54:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 Processor -- start 2024-09-13T18:54:35.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 -- start start 2024-09-13T18:54:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84580d0fb0 0x7f8458144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 0x7f8458148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f845815e340 0x7f845814a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458149130 con 0x7f845815cda0 2024-09-13T18:54:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458149f70 con 0x7f845815e340 2024-09-13T18:54:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8458149360 con 0x7f84580d0fb0 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 0x7f8458148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 0x7f8458148bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44824/0 (socket says 172.21.15.81:44824) 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 -- 172.21.15.81:0/913304242 learned_addr learned my addr 172.21.15.81:0/913304242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845de00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f845815e340 0x7f845814a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845d400700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84580d0fb0 0x7f8458144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 -- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84580d0fb0 msgr2=0x7f8458144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84580d0fb0 0x7f8458144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 -- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f845815e340 msgr2=0x7f845814a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f845815e340 0x7f845814a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.157+0000 7f845ca00700 1 -- 172.21.15.81:0/913304242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450009a70 con 0x7f845815cda0 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f845ca00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 0x7f8458148bf0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8444009fd0 tx=0x7f844400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84440095a0 con 0x7f845815cda0 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8444013680 con 0x7f845815cda0 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444013a30 con 0x7f845815cda0 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8458149640 con 0x7f845815cda0 2024-09-13T18:54:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8458149c00 con 0x7f845815cda0 2024-09-13T18:54:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.161+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8458067a20 con 0x7f845815cda0 2024-09-13T18:54:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.165+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8444013b90 con 0x7f845815cda0 2024-09-13T18:54:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.165+0000 7f8455600700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8438066730 0x7f8438068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.165+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6403+0+0 (secure 0 0 0) 0x7f84440846c0 con 0x7f845815cda0 2024-09-13T18:54:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.165+0000 7f845d400700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8438066730 0x7f8438068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.165+0000 7f845d400700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8438066730 0x7f8438068bf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f844c0011e0 tx=0x7f844c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.173+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8444051760 con 0x7f845815cda0 2024-09-13T18:54:35.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.365+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84580d0a70 con 0x7f845815cda0 2024-09-13T18:54:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.901+0000 7f8455600700 1 -- 172.21.15.81:0/913304242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f844405b070 con 0x7f845815cda0 2024-09-13T18:54:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.905+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8438066730 msgr2=0x7f8438068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.905+0000 7f845fe00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8438066730 0x7f8438068bf0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f844c0011e0 tx=0x7f844c009040 comp rx=0 tx=0).stop 2024-09-13T18:54:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 msgr2=0x7f8458148bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 0x7f8458148bf0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8444009fd0 tx=0x7f844400ebd0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 shutdown_connections 2024-09-13T18:54:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8438066730 0x7f8438068bf0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f845815e340 0x7f845814a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f845815cda0 0x7f8458148bf0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 --2- 172.21.15.81:0/913304242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84580d0fb0 0x7f8458144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 >> 172.21.15.81:0/913304242 conn(0x7f845806e660 msgr2=0x7f845806f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:35.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 shutdown_connections 2024-09-13T18:54:35.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:35.909+0000 7f845fe00700 1 -- 172.21.15.81:0/913304242 wait complete. 2024-09-13T18:54:35.923 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:54:35.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:54:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.109+0000 7fc802800700 1 Processor -- start 2024-09-13T18:54:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.109+0000 7fc802800700 1 -- start start 2024-09-13T18:54:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7fc159760 0x7fc7fc0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0cdfa0 0x7fc7fc159b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7fc0ce3c0 0x7fc7fc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc071be0 con 0x7fc7fc159760 2024-09-13T18:54:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc15a5c0 con 0x7fc7fc0ce3c0 2024-09-13T18:54:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc06ce00 con 0x7fc7fc0cdfa0 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7fc159760 0x7fc7fc0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc7fc159760 0x7fc7fc0b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44840/0 (socket says 172.21.15.81:44840) 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 -- 172.21.15.81:0/3988429746 learned_addr learned my addr 172.21.15.81:0/3988429746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7faa00700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0cdfa0 0x7fc7fc159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fbe00700 1 --2- 172.21.15.81:0/3988429746 >> v2:172.21.15.178:3300/0 conn(0x7fc7fc0ce3c0 0x7fc7fc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 -- 172.21.15.81:0/3988429746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0cdfa0 msgr2=0x7fc7fc159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0cdfa0 0x7fc7fc159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 -- 172.21.15.81:0/3988429746 >> v2:172.21.15.178:3300/0 conn(0x7fc7fc0ce3c0 msgr2=0x7fc7fc15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 --2- 172.21.15.81:0/3988429746 >> v2:172.21.15.178:3300/0 conn(0x7fc7fc0ce3c0 0x7fc7fc15a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 -- 172.21.15.81:0/3988429746 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc0712b0 con 0x7fc7fc159760 2024-09-13T18:54:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fbe00700 1 --2- 172.21.15.81:0/3988429746 >> v2:172.21.15.178:3300/0 conn(0x7fc7fc0ce3c0 0x7fc7fc15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7faa00700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0cdfa0 0x7fc7fc159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fb400700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0b28b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc06e0d0 tx=0x7fc7ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a339de1fcba7ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fa000700 1 -- 172.21.15.81:0/3988429746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec00ba20 con 0x7fc7fc159760 2024-09-13T18:54:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fa000700 1 -- 172.21.15.81:0/3988429746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec00bb80 con 0x7fc7fc159760 2024-09-13T18:54:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc7fa000700 1 -- 172.21.15.81:0/3988429746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec009e60 con 0x7fc7fc159760 2024-09-13T18:54:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 -- 172.21.15.81:0/3988429746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 msgr2=0x7fc7fc0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.113+0000 7fc802800700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0b28b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc06e0d0 tx=0x7fc7ec009c20 comp rx=0 tx=0).stop 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 -- 172.21.15.81:0/3988429746 shutdown_connections 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 --2- 172.21.15.81:0/3988429746 >> v2:172.21.15.178:3300/0 conn(0x7fc7fc0ce3c0 0x7fc7fc15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0cdfa0 0x7fc7fc159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 --2- 172.21.15.81:0/3988429746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0b28b0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 -- 172.21.15.81:0/3988429746 >> 172.21.15.81:0/3988429746 conn(0x7fc7fc06a570 msgr2=0x7fc7fc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 -- 172.21.15.81:0/3988429746 shutdown_connections 2024-09-13T18:54:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 -- 172.21.15.81:0/3988429746 wait complete. 2024-09-13T18:54:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.117+0000 7fc802800700 1 Processor -- start 2024-09-13T18:54:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 -- start start 2024-09-13T18:54:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7fc0cdfa0 0x7fc7fc14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0ce3c0 0x7fc7fc150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc151e10 con 0x7fc7fc159760 2024-09-13T18:54:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc151850 con 0x7fc7fc0cdfa0 2024-09-13T18:54:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc802800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc151b30 con 0x7fc7fc0ce3c0 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0cb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44844/0 (socket says 172.21.15.81:44844) 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 -- 172.21.15.81:0/2419788626 learned_addr learned my addr 172.21.15.81:0/2419788626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fb400700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7fc0cdfa0 0x7fc7fc14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7faa00700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0ce3c0 0x7fc7fc150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 -- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0ce3c0 msgr2=0x7fc7fc150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0ce3c0 0x7fc7fc150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 -- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7fc0cdfa0 msgr2=0x7fc7fc14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7fc0cdfa0 0x7fc7fc14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.121+0000 7fc7fbe00700 1 -- 172.21.15.81:0/2419788626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec009570 con 0x7fc7fc159760 2024-09-13T18:54:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc7fbe00700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0cb4d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4007d80 tx=0x7fc7f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f400dd20 con 0x7fc7fc159760 2024-09-13T18:54:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f400f040 con 0x7fc7fc159760 2024-09-13T18:54:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4003c80 con 0x7fc7fc159760 2024-09-13T18:54:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc154ff0 con 0x7fc7fc159760 2024-09-13T18:54:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc151420 con 0x7fc7fc159760 2024-09-13T18:54:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.125+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc154e50 con 0x7fc7fc159760 2024-09-13T18:54:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.129+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7f4004030 con 0x7fc7fc159760 2024-09-13T18:54:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.129+0000 7fc7f3400700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7dc066730 0x7fc7dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.129+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5965+0+0 (secure 0 0 0) 0x7fc7f40842c0 con 0x7fc7fc159760 2024-09-13T18:54:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.129+0000 7fc7fb400700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7dc066730 0x7fc7dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.129+0000 7fc7fb400700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7dc066730 0x7fc7dc068bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.133+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7fc154e50 con 0x7fc7fc159760 2024-09-13T18:54:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.317+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc7fc072050 con 0x7fc7fc159760 2024-09-13T18:54:36.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.905+0000 7fc7f3400700 1 -- 172.21.15.81:0/2419788626 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7fc072050 con 0x7fc7fc159760 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7dc066730 msgr2=0x7fc7dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7dc066730 0x7fc7dc068bf0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec008030 comp rx=0 tx=0).stop 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 msgr2=0x7fc7fc0cb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0cb4d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4007d80 tx=0x7fc7f400d3b0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 shutdown_connections 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc7dc066730 0x7fc7dc068bf0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7fc159760 0x7fc7fc0cb4d0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7fc0ce3c0 0x7fc7fc150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 --2- 172.21.15.81:0/2419788626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7fc0cdfa0 0x7fc7fc14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:36.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 >> 172.21.15.81:0/2419788626 conn(0x7fc7fc06a570 msgr2=0x7fc7fc153450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 shutdown_connections 2024-09-13T18:54:36.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:36.921+0000 7fc802800700 1 -- 172.21.15.81:0/2419788626 wait complete. 2024-09-13T18:54:36.936 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:54:36.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:54:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.117+0000 7f831ac00700 1 Processor -- start 2024-09-13T18:54:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.117+0000 7f831ac00700 1 -- start start 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f831ac00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f831415abc0 0x7f83140ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f831ac00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8314073660 0x7f8314072190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f831ac00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140726d0 con 0x7f831415e6e0 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f831ac00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831415afa0 con 0x7f8314073660 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f831ac00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8314073be0 con 0x7f831415abc0 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8314073660 0x7f8314072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8314073660 0x7f8314072190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55030/0 (socket says 172.21.15.81:55030) 2024-09-13T18:54:37.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 -- 172.21.15.81:0/75326438 learned_addr learned my addr 172.21.15.81:0/75326438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313e00700 1 --2- 172.21.15.81:0/75326438 >> v2:172.21.15.178:3300/0 conn(0x7f831415abc0 0x7f83140ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 -- 172.21.15.81:0/75326438 >> v2:172.21.15.178:3300/0 conn(0x7f831415abc0 msgr2=0x7f83140ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 --2- 172.21.15.81:0/75326438 >> v2:172.21.15.178:3300/0 conn(0x7f831415abc0 0x7f83140ae6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 -- 172.21.15.81:0/75326438 >> v1:172.21.15.178:6789/0 conn(0x7f831415e6e0 legacy=0x7f83140b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.121+0000 7f8313400700 1 -- 172.21.15.81:0/75326438 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140b3df0 con 0x7f8314073660 2024-09-13T18:54:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f8313400700 1 --2- 172.21.15.81:0/75326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8314073660 0x7f8314072190 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8314066d10 tx=0x7f8300009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617ea455fcb52f1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f8312a00700 1 -- 172.21.15.81:0/75326438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000b8a0 con 0x7f8314073660 2024-09-13T18:54:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f8312a00700 1 -- 172.21.15.81:0/75326438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000ba00 con 0x7f8314073660 2024-09-13T18:54:37.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f8312a00700 1 -- 172.21.15.81:0/75326438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000bd90 con 0x7f8314073660 2024-09-13T18:54:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 -- 172.21.15.81:0/75326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8314073660 msgr2=0x7f8314072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 --2- 172.21.15.81:0/75326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8314073660 0x7f8314072190 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f8314066d10 tx=0x7f8300009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 -- 172.21.15.81:0/75326438 shutdown_connections 2024-09-13T18:54:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 --2- 172.21.15.81:0/75326438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8314073660 0x7f8314072190 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 --2- 172.21.15.81:0/75326438 >> v2:172.21.15.178:3300/0 conn(0x7f831415abc0 0x7f83140ae6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 -- 172.21.15.81:0/75326438 >> 172.21.15.81:0/75326438 conn(0x7f83140b47e0 msgr2=0x7f8314071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 -- 172.21.15.81:0/75326438 shutdown_connections 2024-09-13T18:54:37.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 -- 172.21.15.81:0/75326438 wait complete. 2024-09-13T18:54:37.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.125+0000 7f831ac00700 1 Processor -- start 2024-09-13T18:54:37.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 -- start start 2024-09-13T18:54:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314073660 0x7f83140cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 0x7f83141f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831415e6e0 0x7f831406d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831415bf60 con 0x7f831415abc0 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140cd580 con 0x7f831415e6e0 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83141f3980 con 0x7f8314073660 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 0x7f83141f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 0x7f83141f3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55044/0 (socket says 172.21.15.81:55044) 2024-09-13T18:54:37.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 -- 172.21.15.81:0/1317530307 learned_addr learned my addr 172.21.15.81:0/1317530307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:37.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8318c00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831415e6e0 0x7f831406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313e00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314073660 0x7f83140cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 -- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314073660 msgr2=0x7f83140cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314073660 0x7f83140cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 -- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831415e6e0 msgr2=0x7f831406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831415e6e0 0x7f831406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 -- 172.21.15.81:0/1317530307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009570 con 0x7f831415abc0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f8313400700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 0x7f83141f3440 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f831406eef0 tx=0x7f8300004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83000038c0 con 0x7f831415abc0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831415b2e0 con 0x7f831415abc0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830001f070 con 0x7f831415abc0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8300003c60 con 0x7f831415abc0 2024-09-13T18:54:37.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.129+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831415b8a0 con 0x7f831415abc0 2024-09-13T18:54:37.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.133+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314073050 con 0x7f831415abc0 2024-09-13T18:54:37.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.133+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8300026480 con 0x7f831415abc0 2024-09-13T18:54:37.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.133+0000 7f830be00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f4066730 0x7f82f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.133+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8300021070 con 0x7f831415abc0 2024-09-13T18:54:37.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.137+0000 7f8313e00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f4066730 0x7f82f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.137+0000 7f8313e00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f4066730 0x7f82f4068bf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8304009950 tx=0x7f8304008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:37.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.141+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8300053070 con 0x7f831415abc0 2024-09-13T18:54:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.321+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f831415efb0 con 0x7f831415abc0 2024-09-13T18:54:37.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f830be00700 1 -- 172.21.15.81:0/1317530307 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8300056690 con 0x7f831415abc0 2024-09-13T18:54:37.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f4066730 msgr2=0x7f82f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f4066730 0x7f82f4068bf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8304009950 tx=0x7f8304008040 comp rx=0 tx=0).stop 2024-09-13T18:54:37.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 msgr2=0x7f83141f3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 0x7f83141f3440 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f831406eef0 tx=0x7f8300004770 comp rx=0 tx=0).stop 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 shutdown_connections 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f82f4066730 0x7f82f4068bf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f831415e6e0 0x7f831406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f831415abc0 0x7f83141f3440 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 --2- 172.21.15.81:0/1317530307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8314073660 0x7f83140cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.329+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 >> 172.21.15.81:0/1317530307 conn(0x7f83140b47e0 msgr2=0x7f83140ad7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.333+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 shutdown_connections 2024-09-13T18:54:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.333+0000 7f831ac00700 1 -- 172.21.15.81:0/1317530307 wait complete. 2024-09-13T18:54:37.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2024-09-13T18:54:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.517+0000 7f8c43200700 1 Processor -- start 2024-09-13T18:54:37.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 -- start start 2024-09-13T18:54:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c3c0cb020 0x7f8c3c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c15c2a0 0x7f8c3c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c3c06aaa0 0x7f8c3c06af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c06b450 con 0x7f8c3c0cb020 2024-09-13T18:54:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3c0b2ad0 con 0x7f8c3c06aaa0 2024-09-13T18:54:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c43200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c15b960 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c3c0cb020 0x7f8c3c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8c3c0cb020 0x7f8c3c0cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55048/0 (socket says 172.21.15.81:55048) 2024-09-13T18:54:37.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 -- 172.21.15.81:0/600321955 learned_addr learned my addr 172.21.15.81:0/600321955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:37.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 -- 172.21.15.81:0/600321955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c15c2a0 msgr2=0x7f8c3c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c42800700 1 --2- 172.21.15.81:0/600321955 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c06aaa0 0x7f8c3c06af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41400700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c15c2a0 0x7f8c3c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c15c2a0 0x7f8c3c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 -- 172.21.15.81:0/600321955 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c06aaa0 msgr2=0x7f8c3c06af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:37.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 --2- 172.21.15.81:0/600321955 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c06aaa0 0x7f8c3c06af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 -- 172.21.15.81:0/600321955 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c15bc40 con 0x7f8c3c0cb020 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c42800700 1 --2- 172.21.15.81:0/600321955 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c06aaa0 0x7f8c3c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41400700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c15c2a0 0x7f8c3c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c41e00700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cb020 0x7f8c3c0cc6f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c158cb0 tx=0x7f8c30009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dd26814aa321f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.521+0000 7f8c40a00700 1 -- 172.21.15.81:0/600321955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000b8a0 con 0x7f8c3c0cb020 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c40a00700 1 -- 172.21.15.81:0/600321955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000ba00 con 0x7f8c3c0cb020 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c40a00700 1 -- 172.21.15.81:0/600321955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000bd90 con 0x7f8c3c0cb020 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 -- 172.21.15.81:0/600321955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cb020 msgr2=0x7f8c3c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cb020 0x7f8c3c0cc6f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c158cb0 tx=0x7f8c30009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 -- 172.21.15.81:0/600321955 shutdown_connections 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 --2- 172.21.15.81:0/600321955 >> v2:172.21.15.178:3300/0 conn(0x7f8c3c06aaa0 0x7f8c3c06af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c15c2a0 0x7f8c3c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 --2- 172.21.15.81:0/600321955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c0cb020 0x7f8c3c0cc6f0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 -- 172.21.15.81:0/600321955 >> 172.21.15.81:0/600321955 conn(0x7f8c3c0b0c40 msgr2=0x7f8c3c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 -- 172.21.15.81:0/600321955 shutdown_connections 2024-09-13T18:54:37.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 -- 172.21.15.81:0/600321955 wait complete. 2024-09-13T18:54:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 Processor -- start 2024-09-13T18:54:37.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.525+0000 7f8c43200700 1 -- start start 2024-09-13T18:54:37.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c06aaa0 0x7f8c3c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c0cb020 0x7f8c3c157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 0x7f8c3c13dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c13ba30 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c154bc0 con 0x7f8c3c06aaa0 2024-09-13T18:54:37.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c13b750 con 0x7f8c3c0cb020 2024-09-13T18:54:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 0x7f8c3c13dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 0x7f8c3c13dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55054/0 (socket says 172.21.15.81:55054) 2024-09-13T18:54:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 -- 172.21.15.81:0/3018627686 learned_addr learned my addr 172.21.15.81:0/3018627686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c41e00700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c06aaa0 0x7f8c3c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c41400700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c0cb020 0x7f8c3c157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 -- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c0cb020 msgr2=0x7f8c3c157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c0cb020 0x7f8c3c157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 -- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c06aaa0 msgr2=0x7f8c3c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c06aaa0 0x7f8c3c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 -- 172.21.15.81:0/3018627686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30009570 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c42800700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 0x7f8c3c13dd70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800cd10 tx=0x7f8c3800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800ce60 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800f480 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c156990 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800f810 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.529+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c156f50 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.533+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c157170 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.533+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8c3800b040 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.533+0000 7f8c36000700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c20066730 0x7f8c20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.533+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8c38084680 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.537+0000 7f8c41e00700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c20066730 0x7f8c20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:37.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.537+0000 7f8c41e00700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c20066730 0x7f8c20068bf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8c30000c00 tx=0x7f8c30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:37.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.541+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c38051af0 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.793+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) v1 -- 0x7f8c3c15c6c0 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.917+0000 7f8c36000700 1 -- 172.21.15.81:0/3018627686 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v387) v1 ==== 154+0+0 (secure 0 0 0) 0x7f8c38055110 con 0x7f8c3c15c2a0 2024-09-13T18:54:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c20066730 msgr2=0x7f8c20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c20066730 0x7f8c20068bf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8c30000c00 tx=0x7f8c30008030 comp rx=0 tx=0).stop 2024-09-13T18:54:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 msgr2=0x7f8c3c13dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 0x7f8c3c13dd70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f8c3800cd10 tx=0x7f8c3800a560 comp rx=0 tx=0).stop 2024-09-13T18:54:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 shutdown_connections 2024-09-13T18:54:37.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8c20066730 0x7f8c20068bf0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c3c15c2a0 0x7f8c3c13dd70 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c3c0cb020 0x7f8c3c157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 --2- 172.21.15.81:0/3018627686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c3c06aaa0 0x7f8c3c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 >> 172.21.15.81:0/3018627686 conn(0x7f8c3c0b0c40 msgr2=0x7f8c3c15d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 shutdown_connections 2024-09-13T18:54:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:37.921+0000 7f8c43200700 1 -- 172.21.15.81:0/3018627686 wait complete. 2024-09-13T18:54:37.955 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-13T18:54:37.955 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-13T18:54:37.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.121+0000 7f2d33e00700 1 Processor -- start 2024-09-13T18:54:38.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.121+0000 7f2d33e00700 1 -- start start 2024-09-13T18:54:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d341610b0 0x7f2d340719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d340b2d80 0x7f2d3406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340b3560 con 0x7f2d3406aaa0 2024-09-13T18:54:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34070b30 con 0x7f2d340b2d80 2024-09-13T18:54:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3406b450 con 0x7f2d341610b0 2024-09-13T18:54:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2d340b2d80 0x7f2d3406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d2a000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d3406aaa0 0x7f2d340b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41064/0 (socket says 172.21.15.81:41064) 2024-09-13T18:54:38.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d2a000700 1 -- 172.21.15.81:0/2316417200 learned_addr learned my addr 172.21.15.81:0/2316417200 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:38.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d32a00700 1 --2- 172.21.15.81:0/2316417200 >> v2:172.21.15.178:3300/0 conn(0x7f2d341610b0 0x7f2d340719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33400700 1 -- 172.21.15.81:0/2316417200 >> v2:172.21.15.178:3300/0 conn(0x7f2d341610b0 msgr2=0x7f2d340719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:38.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33400700 1 --2- 172.21.15.81:0/2316417200 >> v2:172.21.15.178:3300/0 conn(0x7f2d341610b0 0x7f2d340719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d32000700 1 -- 172.21.15.81:0/2316417200 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227658520 0 0) 0x7f2d340b3560 con 0x7f2d3406aaa0 2024-09-13T18:54:38.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33400700 1 -- 172.21.15.81:0/2316417200 >> v1:172.21.15.81:6789/0 conn(0x7f2d3406aaa0 legacy=0x7f2d340b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33400700 1 -- 172.21.15.81:0/2316417200 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340b3280 con 0x7f2d340b2d80 2024-09-13T18:54:38.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33400700 1 --2- 172.21.15.81:0/2316417200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d340b2d80 0x7f2d3406af10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009880 tx=0x7f2d2c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a19d0a00139f3bd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d32000700 1 -- 172.21.15.81:0/2316417200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c011830 con 0x7f2d340b2d80 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d32000700 1 -- 172.21.15.81:0/2316417200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c011990 con 0x7f2d340b2d80 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d32000700 1 -- 172.21.15.81:0/2316417200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c011d20 con 0x7f2d340b2d80 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- 172.21.15.81:0/2316417200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d340b2d80 msgr2=0x7f2d3406af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2316417200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d340b2d80 0x7f2d3406af10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009880 tx=0x7f2d2c009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- 172.21.15.81:0/2316417200 shutdown_connections 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2316417200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d340b2d80 0x7f2d3406af10 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2316417200 >> v2:172.21.15.178:3300/0 conn(0x7f2d341610b0 0x7f2d340719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- 172.21.15.81:0/2316417200 >> 172.21.15.81:0/2316417200 conn(0x7f2d340b0c40 msgr2=0x7f2d3406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.125+0000 7f2d33e00700 1 -- 172.21.15.81:0/2316417200 shutdown_connections 2024-09-13T18:54:38.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.129+0000 7f2d33e00700 1 -- 172.21.15.81:0/2316417200 wait complete. 2024-09-13T18:54:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.129+0000 7f2d33e00700 1 Processor -- start 2024-09-13T18:54:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.129+0000 7f2d33e00700 1 -- start start 2024-09-13T18:54:38.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3406aaa0 0x7f2d34151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d340b2d80 0x7f2d34163c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 0x7f2d340aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340ad880 con 0x7f2d341610b0 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340acfe0 con 0x7f2d3406aaa0 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340ad2c0 con 0x7f2d340b2d80 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 0x7f2d340aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 0x7f2d340aa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55070/0 (socket says 172.21.15.81:55070) 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 -- 172.21.15.81:0/2647645651 learned_addr learned my addr 172.21.15.81:0/2647645651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d32a00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3406aaa0 0x7f2d34151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d2a000700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d340b2d80 0x7f2d34163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 -- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d340b2d80 msgr2=0x7f2d34163c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d340b2d80 0x7f2d34163c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 -- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3406aaa0 msgr2=0x7f2d34151990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3406aaa0 0x7f2d34151990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 -- 172.21.15.81:0/2647645651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c0094b0 con 0x7f2d341610b0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d32a00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3406aaa0 0x7f2d34151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33400700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 0x7f2d340aa1b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0090b0 tx=0x7f2d2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0036c0 con 0x7f2d341610b0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c003840 con 0x7f2d341610b0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003bf0 con 0x7f2d341610b0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d340ad5a0 con 0x7f2d341610b0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.133+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d34151ed0 con 0x7f2d341610b0 2024-09-13T18:54:38.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.137+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d340ad400 con 0x7f2d341610b0 2024-09-13T18:54:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.137+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d2c003d50 con 0x7f2d341610b0 2024-09-13T18:54:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.137+0000 7f2d2b400700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d10066760 0x7f2d10068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.137+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2d2c0856a0 con 0x7f2d341610b0 2024-09-13T18:54:38.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.137+0000 7f2d32a00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d10066760 0x7f2d10068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.137+0000 7f2d32a00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d10066760 0x7f2d10068c20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009fd0 tx=0x7f2d2400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.145+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2d340ad400 con 0x7f2d341610b0 2024-09-13T18:54:38.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.329+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d34161a80 con 0x7f2d341610b0 2024-09-13T18:54:38.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.329+0000 7f2d2b400700 1 -- 172.21.15.81:0/2647645651 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+13452 (secure 0 0 0) 0x7f2d34161a80 con 0x7f2d341610b0 2024-09-13T18:54:38.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:38.342 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":98,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:36.900044+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.178:6834/3980969466":"2024-09-14T18:54:33.875331+0000","172.21.15.178:6832/3980969466":"2024-09-14T18:54:33.875331+0000","172.21.15.81:6837/2448579226":"2024-09-14T18:54:33.875384+0000","172.21.15.81:6835/2448579226":"2024-09-14T18:54:33.875384+0000","172.21.15.81:6836/548467778":"2024-09-14T18:54:33.875364+0000","172.21.15.81:6834/548467778":"2024-09-14T18:54:33.875364+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d10066760 msgr2=0x7f2d10068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d10066760 0x7f2d10068c20 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009fd0 tx=0x7f2d2400b040 comp rx=0 tx=0).stop 2024-09-13T18:54:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 msgr2=0x7f2d340aa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 0x7f2d340aa1b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0090b0 tx=0x7f2d2c004770 comp rx=0 tx=0).stop 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 shutdown_connections 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2d10066760 0x7f2d10068c20 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d341610b0 0x7f2d340aa1b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d340b2d80 0x7f2d34163c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 --2- 172.21.15.81:0/2647645651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d3406aaa0 0x7f2d34151990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 >> 172.21.15.81:0/2647645651 conn(0x7f2d340b0c40 msgr2=0x7f2d3406bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 shutdown_connections 2024-09-13T18:54:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.333+0000 7f2d33e00700 1 -- 172.21.15.81:0/2647645651 wait complete. 2024-09-13T18:54:38.366 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:54:38.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:54:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.533+0000 7f59b7200700 1 Processor -- start 2024-09-13T18:54:38.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.533+0000 7f59b7200700 1 -- start start 2024-09-13T18:54:38.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b7200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59b8159920 0x7f59b80b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b806d070 0x7f59b80cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b80cd2a0 con 0x7f59b80b30d0 2024-09-13T18:54:38.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b7200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b80ccc90 con 0x7f59b8159920 2024-09-13T18:54:38.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80b3580 con 0x7f59b806d070 2024-09-13T18:54:38.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b5400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f59b80b30d0 0x7f59b806c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:40262/0 (socket says 172.21.15.81:40262) 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b5400700 1 -- 172.21.15.81:0/1640624814 learned_addr learned my addr 172.21.15.81:0/1640624814 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.537+0000 7f59b6800700 1 --2- 172.21.15.81:0/1640624814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b806d070 0x7f59b80cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b5e00700 1 --2- 172.21.15.81:0/1640624814 >> v2:172.21.15.178:3300/0 conn(0x7f59b8159920 0x7f59b80b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b4a00700 1 -- 172.21.15.81:0/1640624814 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962187191 0 0) 0x7f59b80cd2a0 con 0x7f59b80b30d0 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b4a00700 1 -- 172.21.15.81:0/1640624814 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599c0035d0 con 0x7f59b80b30d0 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b6800700 1 -- 172.21.15.81:0/1640624814 >> v2:172.21.15.178:3300/0 conn(0x7f59b8159920 msgr2=0x7f59b80b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b6800700 1 --2- 172.21.15.81:0/1640624814 >> v2:172.21.15.178:3300/0 conn(0x7f59b8159920 0x7f59b80b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b6800700 1 -- 172.21.15.81:0/1640624814 >> v1:172.21.15.178:6789/0 conn(0x7f59b80b30d0 legacy=0x7f59b806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b6800700 1 -- 172.21.15.81:0/1640624814 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80b3860 con 0x7f59b806d070 2024-09-13T18:54:38.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b6800700 1 --2- 172.21.15.81:0/1640624814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b806d070 0x7f59b80cd730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d90 tx=0x7f59b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a01eb0f4fd6ef59b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b4a00700 1 -- 172.21.15.81:0/1640624814 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000e070 con 0x7f59b806d070 2024-09-13T18:54:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b4a00700 1 -- 172.21.15.81:0/1640624814 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000bb20 con 0x7f59b806d070 2024-09-13T18:54:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b4a00700 1 -- 172.21.15.81:0/1640624814 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0012430 con 0x7f59b806d070 2024-09-13T18:54:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 -- 172.21.15.81:0/1640624814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b806d070 msgr2=0x7f59b80cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 --2- 172.21.15.81:0/1640624814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b806d070 0x7f59b80cd730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59b0009d90 tx=0x7f59b000b330 comp rx=0 tx=0).stop 2024-09-13T18:54:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 -- 172.21.15.81:0/1640624814 shutdown_connections 2024-09-13T18:54:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 --2- 172.21.15.81:0/1640624814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b806d070 0x7f59b80cd730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 --2- 172.21.15.81:0/1640624814 >> v2:172.21.15.178:3300/0 conn(0x7f59b8159920 0x7f59b80b2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 -- 172.21.15.81:0/1640624814 >> 172.21.15.81:0/1640624814 conn(0x7f59b806a390 msgr2=0x7f59b806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 -- 172.21.15.81:0/1640624814 shutdown_connections 2024-09-13T18:54:38.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.541+0000 7f59b7200700 1 -- 172.21.15.81:0/1640624814 wait complete. 2024-09-13T18:54:38.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.545+0000 7f59b7200700 1 Processor -- start 2024-09-13T18:54:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.545+0000 7f59b7200700 1 -- start start 2024-09-13T18:54:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 0x7f59b8150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b80b30d0 0x7f59b80a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b8155980 0x7f59b8152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81550d0 con 0x7f59b806d070 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b81f2730 con 0x7f59b80b30d0 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80a97e0 con 0x7f59b8155980 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 0x7f59b8150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 0x7f59b8150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55080/0 (socket says 172.21.15.81:55080) 2024-09-13T18:54:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 -- 172.21.15.81:0/3447059040 learned_addr learned my addr 172.21.15.81:0/3447059040 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5400700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b80b30d0 0x7f59b80a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b6800700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b8155980 0x7f59b8152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 -- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b8155980 msgr2=0x7f59b8152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b8155980 0x7f59b8152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 -- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b80b30d0 msgr2=0x7f59b80a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b80b30d0 0x7f59b80a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 -- 172.21.15.81:0/3447059040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009a70 con 0x7f59b806d070 2024-09-13T18:54:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b5e00700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 0x7f59b8150e90 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f59a800e840 tx=0x7f59a800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80095a0 con 0x7f59b806d070 2024-09-13T18:54:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8013680 con 0x7f59b806d070 2024-09-13T18:54:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80a89c0 con 0x7f59b806d070 2024-09-13T18:54:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80139f0 con 0x7f59b806d070 2024-09-13T18:54:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.549+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b80a8f40 con 0x7f59b806d070 2024-09-13T18:54:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.553+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b806c960 con 0x7f59b806d070 2024-09-13T18:54:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.553+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f59a8013b50 con 0x7f59b806d070 2024-09-13T18:54:38.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.557+0000 7f59ae000700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5998066730 0x7f5998068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.557+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f59a8083f30 con 0x7f59b806d070 2024-09-13T18:54:38.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.557+0000 7f59b5400700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5998066730 0x7f5998068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.557+0000 7f59b5400700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5998066730 0x7f5998068bf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f59b8155910 tx=0x7f59a4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.565+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59a8051310 con 0x7f59b806d070 2024-09-13T18:54:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.741+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59b80ce390 con 0x7f59b806d070 2024-09-13T18:54:38.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.745+0000 7f59ae000700 1 -- 172.21.15.81:0/3447059040 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59a8054930 con 0x7f59b806d070 2024-09-13T18:54:38.755 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:54:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5998066730 msgr2=0x7f5998068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5998066730 0x7f5998068bf0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f59b8155910 tx=0x7f59a4007de0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 msgr2=0x7f59b8150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 0x7f59b8150e90 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f59a800e840 tx=0x7f59a800eb50 comp rx=0 tx=0).stop 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 shutdown_connections 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5998066730 0x7f5998068bf0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b8155980 0x7f59b8152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b80b30d0 0x7f59b80a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 --2- 172.21.15.81:0/3447059040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59b806d070 0x7f59b8150e90 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 >> 172.21.15.81:0/3447059040 conn(0x7f59b806a390 msgr2=0x7f59b80ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:38.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 shutdown_connections 2024-09-13T18:54:38.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.749+0000 7f59b7200700 1 -- 172.21.15.81:0/3447059040 wait complete. 2024-09-13T18:54:38.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2024-09-13T18:54:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.945+0000 7f45e5000700 1 Processor -- start 2024-09-13T18:54:38.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.945+0000 7f45e5000700 1 -- start start 2024-09-13T18:54:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45e5000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45e00cb020 0x7f45e00cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45e5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45e5000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00b2ad0 con 0x7f45e006aaa0 2024-09-13T18:54:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45e5000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e015b960 con 0x7f45e00cb020 2024-09-13T18:54:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45e5000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e015bc40 con 0x7f45e015c2a0 2024-09-13T18:54:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45dfe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45e006aaa0 0x7f45e00b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41076/0 (socket says 172.21.15.81:41076) 2024-09-13T18:54:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45dfe00700 1 -- 172.21.15.81:0/3854387158 learned_addr learned my addr 172.21.15.81:0/3854387158 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45dea00700 1 --2- 172.21.15.81:0/3854387158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45df400700 1 --2- 172.21.15.81:0/3854387158 >> v2:172.21.15.178:3300/0 conn(0x7f45e00cb020 0x7f45e00cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45de000700 1 -- 172.21.15.81:0/3854387158 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591023132 0 0) 0x7f45e00b2ad0 con 0x7f45e006aaa0 2024-09-13T18:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.949+0000 7f45de000700 1 -- 172.21.15.81:0/3854387158 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45c40035d0 con 0x7f45e006aaa0 2024-09-13T18:54:38.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45dea00700 1 -- 172.21.15.81:0/3854387158 >> v2:172.21.15.178:3300/0 conn(0x7f45e00cb020 msgr2=0x7f45e00cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45dea00700 1 --2- 172.21.15.81:0/3854387158 >> v2:172.21.15.178:3300/0 conn(0x7f45e00cb020 0x7f45e00cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45dea00700 1 -- 172.21.15.81:0/3854387158 >> v1:172.21.15.81:6789/0 conn(0x7f45e006aaa0 legacy=0x7f45e00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45dea00700 1 -- 172.21.15.81:0/3854387158 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e015bf20 con 0x7f45e015c2a0 2024-09-13T18:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45dea00700 1 --2- 172.21.15.81:0/3854387158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e015b0e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009850 tx=0x7f45cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=223a2f4aab057171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45de000700 1 -- 172.21.15.81:0/3854387158 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011830 con 0x7f45e015c2a0 2024-09-13T18:54:38.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45de000700 1 -- 172.21.15.81:0/3854387158 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc011990 con 0x7f45e015c2a0 2024-09-13T18:54:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45de000700 1 -- 172.21.15.81:0/3854387158 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc011d40 con 0x7f45e015c2a0 2024-09-13T18:54:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 -- 172.21.15.81:0/3854387158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 msgr2=0x7f45e015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 --2- 172.21.15.81:0/3854387158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e015b0e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009850 tx=0x7f45cc009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:38.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 -- 172.21.15.81:0/3854387158 shutdown_connections 2024-09-13T18:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 --2- 172.21.15.81:0/3854387158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e015b0e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 --2- 172.21.15.81:0/3854387158 >> v2:172.21.15.178:3300/0 conn(0x7f45e00cb020 0x7f45e00cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 -- 172.21.15.81:0/3854387158 >> 172.21.15.81:0/3854387158 conn(0x7f45e00b0c40 msgr2=0x7f45e006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 -- 172.21.15.81:0/3854387158 shutdown_connections 2024-09-13T18:54:38.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.953+0000 7f45e5000700 1 -- 172.21.15.81:0/3854387158 wait complete. 2024-09-13T18:54:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 Processor -- start 2024-09-13T18:54:38.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 -- start start 2024-09-13T18:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 0x7f45e0154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e00cb020 0x7f45e0070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e00c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e01568f0 con 0x7f45e006aaa0 2024-09-13T18:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0155410 con 0x7f45e00cb020 2024-09-13T18:54:38.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45e5000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00713d0 con 0x7f45e015c2a0 2024-09-13T18:54:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 0x7f45e0154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 0x7f45e0154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55084/0 (socket says 172.21.15.81:55084) 2024-09-13T18:54:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 -- 172.21.15.81:0/2401257108 learned_addr learned my addr 172.21.15.81:0/2401257108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45dea00700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e00cb020 0x7f45e0070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45dfe00700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e00c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 -- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 msgr2=0x7f45e00c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e00c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 -- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e00cb020 msgr2=0x7f45e0070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e00cb020 0x7f45e0070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 -- 172.21.15.81:0/2401257108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0094b0 con 0x7f45e006aaa0 2024-09-13T18:54:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45df400700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 0x7f45e0154ed0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f45d000efc0 tx=0x7f45d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.957+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000cd10 con 0x7f45e006aaa0 2024-09-13T18:54:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.961+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000f040 con 0x7f45e006aaa0 2024-09-13T18:54:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.961+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d00146a0 con 0x7f45e006aaa0 2024-09-13T18:54:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.961+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00716b0 con 0x7f45e006aaa0 2024-09-13T18:54:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.961+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e0071c70 con 0x7f45e006aaa0 2024-09-13T18:54:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.961+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e00cc6f0 con 0x7f45e006aaa0 2024-09-13T18:54:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.961+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f45d0014800 con 0x7f45e006aaa0 2024-09-13T18:54:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.965+0000 7f45d7400700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f45c0066730 0x7f45c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.965+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f45d0084850 con 0x7f45e006aaa0 2024-09-13T18:54:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.965+0000 7f45dea00700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f45c0066730 0x7f45c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.965+0000 7f45dea00700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f45c0066730 0x7f45c0068bf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009850 tx=0x7f45cc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:38.969+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45d0051cd0 con 0x7f45e006aaa0 2024-09-13T18:54:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.217+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) v1 -- 0x7f45e015b2f0 con 0x7f45e006aaa0 2024-09-13T18:54:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.929+0000 7f45d7400700 1 -- 172.21.15.81:0/2401257108 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v389) v1 ==== 168+0+0 (secure 0 0 0) 0x7f45d00552f0 con 0x7f45e006aaa0 2024-09-13T18:54:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f45c0066730 msgr2=0x7f45c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f45c0066730 0x7f45c0068bf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009850 tx=0x7f45cc01c040 comp rx=0 tx=0).stop 2024-09-13T18:54:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 msgr2=0x7f45e0154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 0x7f45e0154ed0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f45d000efc0 tx=0x7f45d000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:54:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 shutdown_connections 2024-09-13T18:54:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f45c0066730 0x7f45c0068bf0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e015c2a0 0x7f45e00c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e00cb020 0x7f45e0070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 --2- 172.21.15.81:0/2401257108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45e006aaa0 0x7f45e0154ed0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 >> 172.21.15.81:0/2401257108 conn(0x7f45e00b0c40 msgr2=0x7f45e006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 shutdown_connections 2024-09-13T18:54:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:39.933+0000 7f45e5000700 1 -- 172.21.15.81:0/2401257108 wait complete. 2024-09-13T18:54:39.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:54:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.133+0000 7fe193000700 1 Processor -- start 2024-09-13T18:54:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.133+0000 7fe193000700 1 -- start start 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe193000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe18c06cd80 0x7fe18c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe193000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe18c06ada0 0x7fe18c06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe193000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c06b710 con 0x7fe18c15ca20 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe193000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c160680 con 0x7fe18c06cd80 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe193000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c15d670 con 0x7fe18c06ada0 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe191200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe18c06cd80 0x7fe18c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe191200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe18c06cd80 0x7fe18c0b4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55100/0 (socket says 172.21.15.81:55100) 2024-09-13T18:54:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.137+0000 7fe191200700 1 -- 172.21.15.81:0/1527010866 learned_addr learned my addr 172.21.15.81:0/1527010866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe192600700 1 --2- 172.21.15.81:0/1527010866 >> v2:172.21.15.178:3300/0 conn(0x7fe18c06ada0 0x7fe18c06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe191200700 1 -- 172.21.15.81:0/1527010866 >> v2:172.21.15.178:3300/0 conn(0x7fe18c06ada0 msgr2=0x7fe18c06b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe191200700 1 --2- 172.21.15.81:0/1527010866 >> v2:172.21.15.178:3300/0 conn(0x7fe18c06ada0 0x7fe18c06b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe191200700 1 -- 172.21.15.81:0/1527010866 >> v1:172.21.15.178:6789/0 conn(0x7fe18c15ca20 legacy=0x7fe18c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe191200700 1 -- 172.21.15.81:0/1527010866 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c15d950 con 0x7fe18c06cd80 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe191200700 1 --2- 172.21.15.81:0/1527010866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06cd80 0x7fe18c0b4310 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0b3290 tx=0x7fe178009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3a49e7c6ad81e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe18be00700 1 -- 172.21.15.81:0/1527010866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800b8a0 con 0x7fe18c06cd80 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe18be00700 1 -- 172.21.15.81:0/1527010866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800ba00 con 0x7fe18c06cd80 2024-09-13T18:54:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe18be00700 1 -- 172.21.15.81:0/1527010866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800bd90 con 0x7fe18c06cd80 2024-09-13T18:54:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 -- 172.21.15.81:0/1527010866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06cd80 msgr2=0x7fe18c0b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 --2- 172.21.15.81:0/1527010866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06cd80 0x7fe18c0b4310 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0b3290 tx=0x7fe178009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 -- 172.21.15.81:0/1527010866 shutdown_connections 2024-09-13T18:54:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 --2- 172.21.15.81:0/1527010866 >> v2:172.21.15.178:3300/0 conn(0x7fe18c06ada0 0x7fe18c06b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 --2- 172.21.15.81:0/1527010866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06cd80 0x7fe18c0b4310 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 -- 172.21.15.81:0/1527010866 >> 172.21.15.81:0/1527010866 conn(0x7fe18c071d20 msgr2=0x7fe18c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 -- 172.21.15.81:0/1527010866 shutdown_connections 2024-09-13T18:54:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.141+0000 7fe193000700 1 -- 172.21.15.81:0/1527010866 wait complete. 2024-09-13T18:54:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 Processor -- start 2024-09-13T18:54:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 -- start start 2024-09-13T18:54:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 0x7fe18c0cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18c06cd80 0x7fe18c148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18c15ca20 0x7fe18c0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0ccd50 con 0x7fe18c06ada0 2024-09-13T18:54:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c148850 con 0x7fe18c06cd80 2024-09-13T18:54:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0cc140 con 0x7fe18c15ca20 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 0x7fe18c0cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 0x7fe18c0cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55114/0 (socket says 172.21.15.81:55114) 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 -- 172.21.15.81:0/284392856 learned_addr learned my addr 172.21.15.81:0/284392856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe192600700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18c15ca20 0x7fe18c0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191200700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18c06cd80 0x7fe18c148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 -- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18c15ca20 msgr2=0x7fe18c0cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18c15ca20 0x7fe18c0cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 -- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18c06cd80 msgr2=0x7fe18c148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18c06cd80 0x7fe18c148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 -- 172.21.15.81:0/284392856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178009570 con 0x7fe18c06ada0 2024-09-13T18:54:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191200700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18c06cd80 0x7fe18c148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe191c00700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 0x7fe18c0cbb60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fe18000c4d0 tx=0x7fe18000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800052d0 con 0x7fe18c06ada0 2024-09-13T18:54:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180005430 con 0x7fe18c06ada0 2024-09-13T18:54:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c0cc420 con 0x7fe18c06ada0 2024-09-13T18:54:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800055a0 con 0x7fe18c06ada0 2024-09-13T18:54:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.145+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c0cc9e0 con 0x7fe18c06ada0 2024-09-13T18:54:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.149+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c06d1c0 con 0x7fe18c06ada0 2024-09-13T18:54:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.149+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe1800038a0 con 0x7fe18c06ada0 2024-09-13T18:54:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.153+0000 7fe189600700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe16c066730 0x7fe16c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.153+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe180083520 con 0x7fe18c06ada0 2024-09-13T18:54:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.153+0000 7fe191200700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe16c066730 0x7fe16c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.153+0000 7fe191200700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe16c066730 0x7fe16c068bf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe18c152c40 tx=0x7fe178008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.157+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe180050920 con 0x7fe18c06ada0 2024-09-13T18:54:40.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.341+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe18c06ab80 con 0x7fe18c06ada0 2024-09-13T18:54:40.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.349+0000 7fe189600700 1 -- 172.21.15.81:0/284392856 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe180053f40 con 0x7fe18c06ada0 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe16c066730 msgr2=0x7fe16c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe16c066730 0x7fe16c068bf0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fe18c152c40 tx=0x7fe178008030 comp rx=0 tx=0).stop 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 msgr2=0x7fe18c0cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 0x7fe18c0cbb60 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fe18000c4d0 tx=0x7fe18000c890 comp rx=0 tx=0).stop 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 shutdown_connections 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe16c066730 0x7fe16c068bf0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe18c15ca20 0x7fe18c0cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe18c06cd80 0x7fe18c148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 --2- 172.21.15.81:0/284392856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18c06ada0 0x7fe18c0cbb60 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 >> 172.21.15.81:0/284392856 conn(0x7fe18c071d20 msgr2=0x7fe18c15b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 shutdown_connections 2024-09-13T18:54:40.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.353+0000 7fe193000700 1 -- 172.21.15.81:0/284392856 wait complete. 2024-09-13T18:54:40.388 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:54:40.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:54:40.428 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:54:40.470 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:54:40.470 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:54:40.470 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:40.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:54:40.490 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:54:40.490 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:40.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:54:40.528 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:54:40.529 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:40.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:54:40.550 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:54:40.550 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:40.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:54:40.585 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:54:40.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.745+0000 7f2240e00700 1 Processor -- start 2024-09-13T18:54:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.745+0000 7f2240e00700 1 -- start start 2024-09-13T18:54:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.745+0000 7f2240e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f223c0cc6f0 0x7f223c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.745+0000 7f2240e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0ccb40 con 0x7f223c0cb020 2024-09-13T18:54:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.745+0000 7f2240e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c0b2ad0 con 0x7f223c06aaa0 2024-09-13T18:54:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.745+0000 7f2240e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c15b960 con 0x7f223c0cc6f0 2024-09-13T18:54:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f223b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f223c0cb020 0x7f223c15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41082/0 (socket says 172.21.15.81:41082) 2024-09-13T18:54:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f223b400700 1 -- 172.21.15.81:0/278488058 learned_addr learned my addr 172.21.15.81:0/278488058 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2232a00700 1 --2- 172.21.15.81:0/278488058 >> v2:172.21.15.81:3300/0 conn(0x7f223c0cc6f0 0x7f223c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2232a00700 1 -- 172.21.15.81:0/278488058 >> v1:172.21.15.178:6789/0 conn(0x7f223c06aaa0 legacy=0x7f223c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2232a00700 1 -- 172.21.15.81:0/278488058 >> v1:172.21.15.81:6789/0 conn(0x7f223c0cb020 legacy=0x7f223c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2232a00700 1 -- 172.21.15.81:0/278488058 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c15bc40 con 0x7f223c0cc6f0 2024-09-13T18:54:40.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f223aa00700 1 -- 172.21.15.81:0/278488058 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291849358 0 0) 0x7f223c0ccb40 con 0x7f223c0cb020 2024-09-13T18:54:40.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2232a00700 1 --2- 172.21.15.81:0/278488058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c0cc6f0 0x7f223c15b0e0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2224009850 tx=0x7f2224009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18475996077801ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:40.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f223aa00700 1 -- 172.21.15.81:0/278488058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224011830 con 0x7f223c0cc6f0 2024-09-13T18:54:40.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f223aa00700 1 -- 172.21.15.81:0/278488058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2224011990 con 0x7f223c0cc6f0 2024-09-13T18:54:40.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f223aa00700 1 -- 172.21.15.81:0/278488058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224011d20 con 0x7f223c0cc6f0 2024-09-13T18:54:40.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 -- 172.21.15.81:0/278488058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c0cc6f0 msgr2=0x7f223c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 --2- 172.21.15.81:0/278488058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c0cc6f0 0x7f223c15b0e0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f2224009850 tx=0x7f2224009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:40.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 -- 172.21.15.81:0/278488058 shutdown_connections 2024-09-13T18:54:40.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 --2- 172.21.15.81:0/278488058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c0cc6f0 0x7f223c15b0e0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 -- 172.21.15.81:0/278488058 >> 172.21.15.81:0/278488058 conn(0x7f223c0b0c40 msgr2=0x7f223c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:40.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 -- 172.21.15.81:0/278488058 shutdown_connections 2024-09-13T18:54:40.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.749+0000 7f2240e00700 1 -- 172.21.15.81:0/278488058 wait complete. 2024-09-13T18:54:40.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 Processor -- start 2024-09-13T18:54:40.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 -- start start 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 0x7f223c14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223c0cb020 0x7f223c146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f223c0cc6f0 0x7f223c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c155fc0 con 0x7f223c06aaa0 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c155760 con 0x7f223c0cb020 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2240e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c155a00 con 0x7f223c0cc6f0 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 0x7f223c14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 0x7f223c14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55140/0 (socket says 172.21.15.81:55140) 2024-09-13T18:54:40.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 -- 172.21.15.81:0/4229876880 learned_addr learned my addr 172.21.15.81:0/4229876880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:40.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223be00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f223c0cc6f0 0x7f223c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 -- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f223c0cc6f0 msgr2=0x7f223c156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2232a00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223c0cb020 0x7f223c146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f223c0cc6f0 0x7f223c156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 -- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223c0cb020 msgr2=0x7f223c146d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223c0cb020 0x7f223c146d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223b400700 1 -- 172.21.15.81:0/4229876880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22240094b0 con 0x7f223c06aaa0 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f223be00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f223c0cc6f0 0x7f223c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.753+0000 7f2232a00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223c0cb020 0x7f223c146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:40.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f223b400700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 0x7f223c14d0a0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f222c00cc80 tx=0x7f222c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c00ade0 con 0x7f223c06aaa0 2024-09-13T18:54:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c00ce80 con 0x7f223c06aaa0 2024-09-13T18:54:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c155ce0 con 0x7f223c06aaa0 2024-09-13T18:54:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c007310 con 0x7f223c06aaa0 2024-09-13T18:54:40.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c156690 con 0x7f223c06aaa0 2024-09-13T18:54:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c14bba0 con 0x7f223c06aaa0 2024-09-13T18:54:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.757+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f222c007470 con 0x7f223c06aaa0 2024-09-13T18:54:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.761+0000 7f2233e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2218066730 0x7f2218068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.761+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f222c084060 con 0x7f223c06aaa0 2024-09-13T18:54:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.761+0000 7f2232a00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2218066730 0x7f2218068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.761+0000 7f2232a00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2218066730 0x7f2218068bf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f223c14cea0 tx=0x7f2224008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.765+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f222c0b5db0 con 0x7f223c06aaa0 2024-09-13T18:54:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.989+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f223c15b0e0 con 0x7f223c06aaa0 2024-09-13T18:54:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.989+0000 7f2233e00700 1 -- 172.21.15.81:0/4229876880 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f222c018090 con 0x7f223c06aaa0 2024-09-13T18:54:41.000 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:41.000 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":99,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6923,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3917935586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":3917935586},{"type":"v1","addr":"172.21.15.178:6835","nonce":3917935586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8823,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3915785309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3915785309},{"type":"v1","addr":"172.21.15.81:6835","nonce":3915785309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8829,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/1253028956","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":1253028956},{"type":"v1","addr":"172.21.15.178:6834","nonce":1253028956}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99},{"gid":8832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3948270056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":3948270056},{"type":"v1","addr":"172.21.15.81:6837","nonce":3948270056}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":99}],"filesystems":[]} 2024-09-13T18:54:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2218066730 msgr2=0x7f2218068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2218066730 0x7f2218068bf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f223c14cea0 tx=0x7f2224008030 comp rx=0 tx=0).stop 2024-09-13T18:54:41.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 msgr2=0x7f223c14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 0x7f223c14d0a0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f222c00cc80 tx=0x7f222c00a340 comp rx=0 tx=0).stop 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 shutdown_connections 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2218066730 0x7f2218068bf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f223c0cc6f0 0x7f223c156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f223c0cb020 0x7f223c146d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 --2- 172.21.15.81:0/4229876880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f223c06aaa0 0x7f223c14d0a0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 >> 172.21.15.81:0/4229876880 conn(0x7f223c0b0c40 msgr2=0x7f223c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 shutdown_connections 2024-09-13T18:54:41.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:40.993+0000 7f2240e00700 1 -- 172.21.15.81:0/4229876880 wait complete. 2024-09-13T18:54:41.007 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 99 2024-09-13T18:54:41.026 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:54:41.026 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:54:41.027 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:54:41.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:54:41.027 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:54:41.027 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:54:41.027 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:54:41.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:54:41.027 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:54:41.028 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:54:41.028 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:54:41.028 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:54:41.028 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:54:41.028 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:54:41.029 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:54:41.029 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:54:41.049 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:54:41.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:54:41.052 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:54:41.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:54:41.054 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:54:41.054 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:54:41.055 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:54:41.056 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:54:41.102 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:54:41.102 DEBUG:teuthology.parallel:result is None 2024-09-13T18:54:41.105 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:54:41.106 DEBUG:teuthology.parallel:result is None 2024-09-13T18:54:41.106 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:54:41.106 DEBUG:teuthology.parallel:result is None 2024-09-13T18:54:41.110 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:54:41.110 DEBUG:teuthology.parallel:result is None 2024-09-13T18:54:41.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:54:41.214 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:54:41.214 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:54:41.231 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-09-13T18:54:41.231 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:54:41.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.277+0000 7fb661000700 1 Processor -- start 2024-09-13T18:54:41.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.277+0000 7fb661000700 1 -- start start 2024-09-13T18:54:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.277+0000 7fb661000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb65c0cf510 0x7fb65c066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.277+0000 7fb661000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65c162490 con 0x7fb65c161e70 2024-09-13T18:54:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.277+0000 7fb661000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65c0b3750 con 0x7fb65c0665d0 2024-09-13T18:54:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.277+0000 7fb661000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65c066a60 con 0x7fb65c0cf510 2024-09-13T18:54:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb65c161e70 0x7fb65c06abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41086/0 (socket says 172.21.15.81:41086) 2024-09-13T18:54:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65be00700 1 -- 172.21.15.81:0/1177984222 learned_addr learned my addr 172.21.15.81:0/1177984222 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65b400700 1 --2- 172.21.15.81:0/1177984222 >> v2:172.21.15.178:3300/0 conn(0x7fb65c0cf510 0x7fb65c066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65a000700 1 -- 172.21.15.81:0/1177984222 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164259344 0 0) 0x7fb65c162490 con 0x7fb65c161e70 2024-09-13T18:54:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65a000700 1 -- 172.21.15.81:0/1177984222 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6400035d0 con 0x7fb65c161e70 2024-09-13T18:54:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65b400700 1 -- 172.21.15.81:0/1177984222 >> v1:172.21.15.178:6789/0 conn(0x7fb65c0665d0 legacy=0x7fb65c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65b400700 1 -- 172.21.15.81:0/1177984222 >> v1:172.21.15.81:6789/0 conn(0x7fb65c161e70 legacy=0x7fb65c06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65a000700 1 -- 172.21.15.81:0/1177984222 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1270148577 0 0) 0x7fb6400035d0 con 0x7fb65c161e70 2024-09-13T18:54:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65b400700 1 -- 172.21.15.81:0/1177984222 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0b3a30 con 0x7fb65c0cf510 2024-09-13T18:54:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65b400700 1 --2- 172.21.15.81:0/1177984222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c0cf510 0x7fb65c066090 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009850 tx=0x7fb64c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71010699b0ae3107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65a000700 1 -- 172.21.15.81:0/1177984222 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540019f0 con 0x7fb65c0cf510 2024-09-13T18:54:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65a000700 1 -- 172.21.15.81:0/1177984222 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c004030 con 0x7fb65c0cf510 2024-09-13T18:54:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb65a000700 1 -- 172.21.15.81:0/1177984222 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c0043c0 con 0x7fb65c0cf510 2024-09-13T18:54:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb661000700 1 -- 172.21.15.81:0/1177984222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c0cf510 msgr2=0x7fb65c066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb661000700 1 --2- 172.21.15.81:0/1177984222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c0cf510 0x7fb65c066090 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb64c009850 tx=0x7fb64c009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb661000700 1 -- 172.21.15.81:0/1177984222 shutdown_connections 2024-09-13T18:54:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb661000700 1 --2- 172.21.15.81:0/1177984222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c0cf510 0x7fb65c066090 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.281+0000 7fb661000700 1 -- 172.21.15.81:0/1177984222 >> 172.21.15.81:0/1177984222 conn(0x7fb65c06e660 msgr2=0x7fb65c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 -- 172.21.15.81:0/1177984222 shutdown_connections 2024-09-13T18:54:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 -- 172.21.15.81:0/1177984222 wait complete. 2024-09-13T18:54:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 Processor -- start 2024-09-13T18:54:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 -- start start 2024-09-13T18:54:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 0x7fb65c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0cf510 0x7fb65c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c161e70 0x7fb65c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c154020 con 0x7fb65c0665d0 2024-09-13T18:54:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c154300 con 0x7fb65c161e70 2024-09-13T18:54:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb661000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65c1545e0 con 0x7fb65c0cf510 2024-09-13T18:54:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 0x7fb65c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 0x7fb65c151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55180/0 (socket says 172.21.15.81:55180) 2024-09-13T18:54:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 -- 172.21.15.81:0/3164231330 learned_addr learned my addr 172.21.15.81:0/3164231330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65be00700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c161e70 0x7fb65c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65aa00700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0cf510 0x7fb65c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 -- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0cf510 msgr2=0x7fb65c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0cf510 0x7fb65c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 -- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c161e70 msgr2=0x7fb65c15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c161e70 0x7fb65c15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65b400700 1 -- 172.21.15.81:0/3164231330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c0094b0 con 0x7fb65c0665d0 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65be00700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c161e70 0x7fb65c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.285+0000 7fb65aa00700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0cf510 0x7fb65c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb65b400700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 0x7fb65c151c10 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb65c066e70 tx=0x7fb64c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c011830 con 0x7fb65c0665d0 2024-09-13T18:54:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb64c01f070 con 0x7fb65c0665d0 2024-09-13T18:54:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65c1548c0 con 0x7fb65c0665d0 2024-09-13T18:54:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64c011bd0 con 0x7fb65c0665d0 2024-09-13T18:54:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65c15c780 con 0x7fb65c0665d0 2024-09-13T18:54:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65c154de0 con 0x7fb65c0665d0 2024-09-13T18:54:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.289+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb64c011d30 con 0x7fb65c0665d0 2024-09-13T18:54:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.293+0000 7fb653400700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb63c066730 0x7fb63c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.293+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fb64c021070 con 0x7fb65c0665d0 2024-09-13T18:54:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.293+0000 7fb65aa00700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb63c066730 0x7fb63c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:41.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.293+0000 7fb65aa00700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb63c066730 0x7fb63c068bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb65c153470 tx=0x7fb648009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.297+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb64c052e50 con 0x7fb65c0665d0 2024-09-13T18:54:41.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:41.493+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb65c0b4510 con 0x7fb65c0665d0 2024-09-13T18:54:42.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.257+0000 7fb653400700 1 -- 172.21.15.81:0/3164231330 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb64c056470 con 0x7fb65c0665d0 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb63c066730 msgr2=0x7fb63c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb63c066730 0x7fb63c068bf0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb65c153470 tx=0x7fb648009040 comp rx=0 tx=0).stop 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 msgr2=0x7fb65c151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 0x7fb65c151c10 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fb65c066e70 tx=0x7fb64c004770 comp rx=0 tx=0).stop 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 shutdown_connections 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb63c066730 0x7fb63c068bf0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb65c161e70 0x7fb65c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb65c0cf510 0x7fb65c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 --2- 172.21.15.81:0/3164231330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb65c0665d0 0x7fb65c151c10 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 >> 172.21.15.81:0/3164231330 conn(0x7fb65c06e660 msgr2=0x7fb65c161070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 shutdown_connections 2024-09-13T18:54:42.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.261+0000 7fb661000700 1 -- 172.21.15.81:0/3164231330 wait complete. 2024-09-13T18:54:42.274 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-13T18:54:42.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:54:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbd0e00700 1 Processor -- start 2024-09-13T18:54:42.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbd0e00700 1 -- start start 2024-09-13T18:54:42.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbd0e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdbcc06c460 0x7fdbcc06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbd0e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0cdd90 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbd0e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc06ce10 con 0x7fdbcc15b700 2024-09-13T18:54:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbd0e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc06d7e0 con 0x7fdbcc06c460 2024-09-13T18:54:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbca800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdbcc06a5d0 0x7fdbcc0b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41094/0 (socket says 172.21.15.81:41094) 2024-09-13T18:54:42.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbca800700 1 -- 172.21.15.81:0/677895927 learned_addr learned my addr 172.21.15.81:0/677895927 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbc1400700 1 --2- 172.21.15.81:0/677895927 >> v2:172.21.15.81:3300/0 conn(0x7fdbcc06c460 0x7fdbcc06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbc9400700 1 -- 172.21.15.81:0/677895927 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605412725 0 0) 0x7fdbcc0cdd90 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbc9400700 1 -- 172.21.15.81:0/677895927 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb00035d0 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbc1400700 1 -- 172.21.15.81:0/677895927 >> v1:172.21.15.178:6789/0 conn(0x7fdbcc15b700 legacy=0x7fdbcc15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbc1400700 1 -- 172.21.15.81:0/677895927 >> v1:172.21.15.81:6789/0 conn(0x7fdbcc06a5d0 legacy=0x7fdbcc0b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.461+0000 7fdbc1400700 1 -- 172.21.15.81:0/677895927 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc0cd4f0 con 0x7fdbcc06c460 2024-09-13T18:54:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbc1400700 1 --2- 172.21.15.81:0/677895927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06c460 0x7fdbcc06d2a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009850 tx=0x7fdbb4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677a63070a0ee769 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbc9400700 1 -- 172.21.15.81:0/677895927 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4011830 con 0x7fdbcc06c460 2024-09-13T18:54:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbc9400700 1 -- 172.21.15.81:0/677895927 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4011990 con 0x7fdbcc06c460 2024-09-13T18:54:42.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbc9400700 1 -- 172.21.15.81:0/677895927 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4011d40 con 0x7fdbcc06c460 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 -- 172.21.15.81:0/677895927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06c460 msgr2=0x7fdbcc06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/677895927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06c460 0x7fdbcc06d2a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009850 tx=0x7fdbb4009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 -- 172.21.15.81:0/677895927 shutdown_connections 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/677895927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06c460 0x7fdbcc06d2a0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 -- 172.21.15.81:0/677895927 >> 172.21.15.81:0/677895927 conn(0x7fdbcc0b08d0 msgr2=0x7fdbcc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 -- 172.21.15.81:0/677895927 shutdown_connections 2024-09-13T18:54:42.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 -- 172.21.15.81:0/677895927 wait complete. 2024-09-13T18:54:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.465+0000 7fdbd0e00700 1 Processor -- start 2024-09-13T18:54:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 -- start start 2024-09-13T18:54:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 0x7fdbcc143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbcc06c460 0x7fdbcc15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbcc15b700 0x7fdbcc15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc143940 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc1e5640 con 0x7fdbcc06c460 2024-09-13T18:54:42.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbd0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc1e5890 con 0x7fdbcc15b700 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 0x7fdbcc143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 0x7fdbcc143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55196/0 (socket says 172.21.15.81:55196) 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 -- 172.21.15.81:0/1324815623 learned_addr learned my addr 172.21.15.81:0/1324815623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc1400700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbcc06c460 0x7fdbcc15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbca800700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbcc15b700 0x7fdbcc15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 -- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbcc15b700 msgr2=0x7fdbcc15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbcc15b700 0x7fdbcc15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 -- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbcc06c460 msgr2=0x7fdbcc15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbcc06c460 0x7fdbcc15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 -- 172.21.15.81:0/1324815623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40094b0 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc9e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 0x7fdbcc143400 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c500 tx=0x7fdbbc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:42.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0052d0 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.469+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc005430 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.473+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc1e5b70 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.473+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0055a0 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.473+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc1e6130 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.473+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc06ade0 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.473+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdbbc0038e0 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.477+0000 7fdbc2a00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdba8066730 0x7fdba8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.477+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdbbc083380 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.477+0000 7fdbc1400700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdba8066730 0x7fdba8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.477+0000 7fdbc1400700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdba8066730 0x7fdba8068bf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40090b0 tx=0x7fdbb4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:42.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.481+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdbbc050910 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdbcc0b3d60 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbc2a00700 1 -- 172.21.15.81:0/1324815623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdbbc053f30 con 0x7fdbcc06a5d0 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORm/NwpDhAAqvdYZ1YoGBQj10oRTNw8aw==", 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmGEypIRAAywL/4dNbWbCIkkH7McCFjw==", 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-13T18:54:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmdmJhGRAAy7XepVgukkS79oX+JxxF5Q==", 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmqS8RLBAA1GEFoichYMtl+MvO+7AU9g==", 2024-09-13T18:54:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB7iORm+mlPEhAAjQqPlx9hqvm7SBVZC6ws3g==", 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB+iORmWNhZIxAARQdSHICfz9MSFVyiscz8pw==", 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCBiORmQQ9AMxAAFw2MX/1qygfc+8pGtCWDdA==", 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCFiORmJYwbCBAAE+5IrfFQ3vkCFtXIDvplJg==", 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCJiORmPZpYJBAAPldfqFXyOydWdHCG6fGGCw==", 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCMiORmipMDNRAAzo5pTygcHIXJT3WfRrPtTw==", 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCQiORmJOi/CBAApUruqP3c1kKNxtasOUC77A==", 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-13T18:54:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQCTiORmoUrJGRAAEocOCYPzzHGZ3Xvnys+k7Q==", 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-13T18:54:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmRFvBMhAAIKegAE/M3YTI4he1P98ifQ==", 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmVLjmAhAAgejGsy8i5sLDIn9JgLLaXg==", 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmjXaHOBAAnRMEs1VXHe+5M7GXyw4kEg==", 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB4iORmvDWNCBAAXyzeENlr/c1wemNdky2+Ng==", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-13T18:54:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB2iORm9hwhIRAASJc+x3PH9tdxfNlBIxr8ZA==", 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmLa1jBxAAW1n5NonKjYDoEyoBrZV4TA==", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQB3iORmT47sABAAcO1uGDZb1FLRZ3Z/ek3v7g==", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-13T18:54:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-13T18:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-13T18:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-13T18:54:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdba8066730 msgr2=0x7fdba8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdba8066730 0x7fdba8068bf0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40090b0 tx=0x7fdbb4008030 comp rx=0 tx=0).stop 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 msgr2=0x7fdbcc143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 0x7fdbcc143400 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c500 tx=0x7fdbbc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.741+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 shutdown_connections 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdba8066730 0x7fdba8068bf0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdbcc15b700 0x7fdbcc15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdbcc06c460 0x7fdbcc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 --2- 172.21.15.81:0/1324815623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc06a5d0 0x7fdbcc143400 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 >> 172.21.15.81:0/1324815623 conn(0x7fdbcc0b08d0 msgr2=0x7fdbcc0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:42.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 shutdown_connections 2024-09-13T18:54:42.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.745+0000 7fdbd0e00700 1 -- 172.21.15.81:0/1324815623 wait complete. 2024-09-13T18:54:42.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:42.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.929+0000 7f6321000700 1 Processor -- start 2024-09-13T18:54:42.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.929+0000 7f6321000700 1 -- start start 2024-09-13T18:54:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.929+0000 7f6321000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f631c0cb020 0x7f631c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.929+0000 7f6321000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f631c15c2a0 0x7f631c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c0b2ad0 con 0x7f631c06aaa0 2024-09-13T18:54:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c15b960 con 0x7f631c0cb020 2024-09-13T18:54:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c15bc40 con 0x7f631c15c2a0 2024-09-13T18:54:42.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f631c0cb020 0x7f631c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f631c06aaa0 0x7f631c0b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41110/0 (socket says 172.21.15.81:41110) 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631be00700 1 -- 172.21.15.81:0/1369896959 learned_addr learned my addr 172.21.15.81:0/1369896959 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6312a00700 1 --2- 172.21.15.81:0/1369896959 >> v2:172.21.15.178:3300/0 conn(0x7f631c15c2a0 0x7f631c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631b400700 1 -- 172.21.15.81:0/1369896959 >> v2:172.21.15.178:3300/0 conn(0x7f631c15c2a0 msgr2=0x7f631c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631b400700 1 --2- 172.21.15.81:0/1369896959 >> v2:172.21.15.178:3300/0 conn(0x7f631c15c2a0 0x7f631c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631b400700 1 -- 172.21.15.81:0/1369896959 >> v1:172.21.15.81:6789/0 conn(0x7f631c06aaa0 legacy=0x7f631c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631b400700 1 -- 172.21.15.81:0/1369896959 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c15bf20 con 0x7f631c0cb020 2024-09-13T18:54:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631b400700 1 --2- 172.21.15.81:0/1369896959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0cb020 0x7f631c0cc6f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f631c15e630 tx=0x7f630c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad8edd9449099a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631aa00700 1 -- 172.21.15.81:0/1369896959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c011830 con 0x7f631c0cb020 2024-09-13T18:54:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631aa00700 1 -- 172.21.15.81:0/1369896959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c011990 con 0x7f631c0cb020 2024-09-13T18:54:42.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f631aa00700 1 -- 172.21.15.81:0/1369896959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c011d20 con 0x7f631c0cb020 2024-09-13T18:54:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- 172.21.15.81:0/1369896959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0cb020 msgr2=0x7f631c0cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 --2- 172.21.15.81:0/1369896959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0cb020 0x7f631c0cc6f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f631c15e630 tx=0x7f630c009b30 comp rx=0 tx=0).stop 2024-09-13T18:54:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- 172.21.15.81:0/1369896959 shutdown_connections 2024-09-13T18:54:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 --2- 172.21.15.81:0/1369896959 >> v2:172.21.15.178:3300/0 conn(0x7f631c15c2a0 0x7f631c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 --2- 172.21.15.81:0/1369896959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c0cb020 0x7f631c0cc6f0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- 172.21.15.81:0/1369896959 >> 172.21.15.81:0/1369896959 conn(0x7f631c0b0c40 msgr2=0x7f631c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.933+0000 7f6321000700 1 -- 172.21.15.81:0/1369896959 shutdown_connections 2024-09-13T18:54:42.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.937+0000 7f6321000700 1 -- 172.21.15.81:0/1369896959 wait complete. 2024-09-13T18:54:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.937+0000 7f6321000700 1 Processor -- start 2024-09-13T18:54:42.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 -- start start 2024-09-13T18:54:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631c06aaa0 0x7f631c13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f631c0cb020 0x7f631c15da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 0x7f631c15df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c157e40 con 0x7f631c15c2a0 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c156de0 con 0x7f631c0cb020 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c13f2d0 con 0x7f631c06aaa0 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 0x7f631c15df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 0x7f631c15df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55206/0 (socket says 172.21.15.81:55206) 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 -- 172.21.15.81:0/3795747531 learned_addr learned my addr 172.21.15.81:0/3795747531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631b400700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631c06aaa0 0x7f631c13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6312a00700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f631c0cb020 0x7f631c15da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 -- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631c06aaa0 msgr2=0x7f631c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631c06aaa0 0x7f631c13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 -- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f631c0cb020 msgr2=0x7f631c15da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:42.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f631c0cb020 0x7f631c15da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:42.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 -- 172.21.15.81:0/3795747531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0094b0 con 0x7f631c15c2a0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f631be00700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 0x7f631c15df70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f631400cbc0 tx=0x7f631400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400a9e0 con 0x7f631c15c2a0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631400ab40 con 0x7f631c15c2a0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400ce80 con 0x7f631c15c2a0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c157080 con 0x7f631c15c2a0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.941+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c157640 con 0x7f631c15c2a0 2024-09-13T18:54:42.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.945+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c0cc6f0 con 0x7f631c15c2a0 2024-09-13T18:54:42.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.945+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f631401b3b0 con 0x7f631c15c2a0 2024-09-13T18:54:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.949+0000 7f6313e00700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066760 0x7f62f8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.949+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6314083c90 con 0x7f631c15c2a0 2024-09-13T18:54:42.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.949+0000 7f631b400700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066760 0x7f62f8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:42.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.949+0000 7f631b400700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066760 0x7f62f8068c20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f630c000c00 tx=0x7f630c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:42.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:42.953+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63140513a0 con 0x7f631c15c2a0 2024-09-13T18:54:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.145+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f631c158590 con 0x7f631c15c2a0 2024-09-13T18:54:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.145+0000 7f6313e00700 1 -- 172.21.15.81:0/3795747531 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+13064 (secure 0 0 0) 0x7f63140549c0 con 0x7f631c15c2a0 2024-09-13T18:54:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":103,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:42.254168+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066760 msgr2=0x7f62f8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066760 0x7f62f8068c20 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f630c000c00 tx=0x7f630c008030 comp rx=0 tx=0).stop 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 msgr2=0x7f631c15df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 0x7f631c15df70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f631400cbc0 tx=0x7f631400cca0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 shutdown_connections 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066760 0x7f62f8068c20 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631c15c2a0 0x7f631c15df70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f631c0cb020 0x7f631c15da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 --2- 172.21.15.81:0/3795747531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631c06aaa0 0x7f631c13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 >> 172.21.15.81:0/3795747531 conn(0x7f631c0b0c40 msgr2=0x7f631c06d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 shutdown_connections 2024-09-13T18:54:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.149+0000 7f6321000700 1 -- 172.21.15.81:0/3795747531 wait complete. 2024-09-13T18:54:43.181 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:54:43.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:54:43.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.337+0000 7f930b200700 1 Processor -- start 2024-09-13T18:54:43.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.337+0000 7f930b200700 1 -- start start 2024-09-13T18:54:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f930b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 0x7f930c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f930b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f930c06d070 0x7f930c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f930b200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0b1980 con 0x7f930c06d620 2024-09-13T18:54:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f930b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c0b2500 con 0x7f930c06d070 2024-09-13T18:54:43.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f930b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0b1bd0 con 0x7f930c143b70 2024-09-13T18:54:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 0x7f930c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 0x7f930c0cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:33912/0 (socket says 172.21.15.81:33912) 2024-09-13T18:54:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 -- 172.21.15.81:0/4253388938 learned_addr learned my addr 172.21.15.81:0/4253388938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f930a800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f930c06d070 0x7f930c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9301400700 1 --1- 172.21.15.81:0/4253388938 >> v1:172.21.15.178:6789/0 conn(0x7f930c06d620 0x7f930c06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:40324/0 (socket says 172.21.15.81:40324) 2024-09-13T18:54:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 -- 172.21.15.81:0/4253388938 >> v2:172.21.15.178:3300/0 conn(0x7f930c06d070 msgr2=0x7f930c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 --2- 172.21.15.81:0/4253388938 >> v2:172.21.15.178:3300/0 conn(0x7f930c06d070 0x7f930c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 -- 172.21.15.81:0/4253388938 >> v1:172.21.15.178:6789/0 conn(0x7f930c06d620 legacy=0x7f930c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 -- 172.21.15.81:0/4253388938 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c0b1eb0 con 0x7f930c143b70 2024-09-13T18:54:43.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.341+0000 7f9309e00700 1 --2- 172.21.15.81:0/4253388938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 0x7f930c0cde20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009910 tx=0x7f92fc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f69648582e90934 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f9309400700 1 -- 172.21.15.81:0/4253388938 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc011830 con 0x7f930c143b70 2024-09-13T18:54:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f9309400700 1 -- 172.21.15.81:0/4253388938 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc011990 con 0x7f930c143b70 2024-09-13T18:54:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f9309400700 1 -- 172.21.15.81:0/4253388938 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc011d40 con 0x7f930c143b70 2024-09-13T18:54:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 -- 172.21.15.81:0/4253388938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 msgr2=0x7f930c0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 --2- 172.21.15.81:0/4253388938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 0x7f930c0cde20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009910 tx=0x7f92fc009c20 comp rx=0 tx=0).stop 2024-09-13T18:54:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 -- 172.21.15.81:0/4253388938 shutdown_connections 2024-09-13T18:54:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 --2- 172.21.15.81:0/4253388938 >> v2:172.21.15.178:3300/0 conn(0x7f930c06d070 0x7f930c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 --2- 172.21.15.81:0/4253388938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c143b70 0x7f930c0cde20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 -- 172.21.15.81:0/4253388938 >> 172.21.15.81:0/4253388938 conn(0x7f930c06a390 msgr2=0x7f930c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 -- 172.21.15.81:0/4253388938 shutdown_connections 2024-09-13T18:54:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 -- 172.21.15.81:0/4253388938 wait complete. 2024-09-13T18:54:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 Processor -- start 2024-09-13T18:54:43.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.345+0000 7f930b200700 1 -- start start 2024-09-13T18:54:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c06d070 0x7f930c13f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f930c06d620 0x7f930c1e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 0x7f930c157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1598d0 con 0x7f930c143b70 2024-09-13T18:54:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1e5c80 con 0x7f930c06d620 2024-09-13T18:54:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1e56c0 con 0x7f930c06d070 2024-09-13T18:54:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 0x7f930c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 0x7f930c157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55220/0 (socket says 172.21.15.81:55220) 2024-09-13T18:54:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 -- 172.21.15.81:0/1875693032 learned_addr learned my addr 172.21.15.81:0/1875693032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f9309e00700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c06d070 0x7f930c13f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f9301400700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f930c06d620 0x7f930c1e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 -- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c06d070 msgr2=0x7f930c13f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c06d070 0x7f930c13f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 -- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f930c06d620 msgr2=0x7f930c1e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f930c06d620 0x7f930c1e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 -- 172.21.15.81:0/1875693032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc009570 con 0x7f930c143b70 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f9301400700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f930c06d620 0x7f930c1e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930a800700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 0x7f930c157020 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f930400efc0 tx=0x7f930400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:43.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304009ea0 con 0x7f930c143b70 2024-09-13T18:54:43.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930400f040 con 0x7f930c143b70 2024-09-13T18:54:43.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c1e59a0 con 0x7f930c143b70 2024-09-13T18:54:43.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304014480 con 0x7f930c143b70 2024-09-13T18:54:43.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.349+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c13f800 con 0x7f930c143b70 2024-09-13T18:54:43.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.353+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c159a80 con 0x7f930c143b70 2024-09-13T18:54:43.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.353+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93040145e0 con 0x7f930c143b70 2024-09-13T18:54:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.353+0000 7f9302a00700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f92e8066760 0x7f92e8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.353+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9304084ba0 con 0x7f930c143b70 2024-09-13T18:54:43.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.353+0000 7f9309e00700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f92e8066760 0x7f92e8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.357+0000 7f9309e00700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f92e8066760 0x7f92e8068c20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f92fc000c00 tx=0x7f92fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:43.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.361+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f930c159a80 con 0x7f930c143b70 2024-09-13T18:54:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.541+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f930c0cde20 con 0x7f930c143b70 2024-09-13T18:54:43.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.541+0000 7f9302a00700 1 -- 172.21.15.81:0/1875693032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9304018020 con 0x7f930c143b70 2024-09-13T18:54:43.553 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f92e8066760 msgr2=0x7f92e8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f92e8066760 0x7f92e8068c20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f92fc000c00 tx=0x7f92fc008030 comp rx=0 tx=0).stop 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 msgr2=0x7f930c157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 0x7f930c157020 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f930400efc0 tx=0x7f930400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 shutdown_connections 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f92e8066760 0x7f92e8068c20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f930c143b70 0x7f930c157020 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f930c06d620 0x7f930c1e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 --2- 172.21.15.81:0/1875693032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f930c06d070 0x7f930c13f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 >> 172.21.15.81:0/1875693032 conn(0x7f930c06a390 msgr2=0x7f930c0b31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 shutdown_connections 2024-09-13T18:54:43.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.545+0000 7f930b200700 1 -- 172.21.15.81:0/1875693032 wait complete. 2024-09-13T18:54:43.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:54:43.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:54:43.696 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:54:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.729+0000 7fd929e00700 1 Processor -- start 2024-09-13T18:54:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.729+0000 7fd929e00700 1 -- start start 2024-09-13T18:54:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd929e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9240b2d80 0x7fd92406af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd929e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9240b3560 con 0x7fd9241610b0 2024-09-13T18:54:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd929e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9240b3280 con 0x7fd92406aaa0 2024-09-13T18:54:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd929e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd924070b30 con 0x7fd9240b2d80 2024-09-13T18:54:43.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd928a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd9241610b0 0x7fd9240719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41116/0 (socket says 172.21.15.81:41116) 2024-09-13T18:54:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd928a00700 1 -- 172.21.15.81:0/279825551 learned_addr learned my addr 172.21.15.81:0/279825551 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd929400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9240b2d80 0x7fd92406af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784957799 0 0) 0x7fd9240b3560 con 0x7fd9241610b0 2024-09-13T18:54:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c0035d0 con 0x7fd9241610b0 2024-09-13T18:54:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1006908613 0 0) 0x7fd9240b3280 con 0x7fd92406aaa0 2024-09-13T18:54:43.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9240b3560 con 0x7fd92406aaa0 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1117078951 0 0) 0x7fd90c0035d0 con 0x7fd9241610b0 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9240b2d80 msgr2=0x7fd92406af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9240b2d80 0x7fd92406af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 >> v1:172.21.15.178:6789/0 conn(0x7fd92406aaa0 legacy=0x7fd9240b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd924070ee0 con 0x7fd9241610b0 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fd918001670 con 0x7fd9241610b0 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd929400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9240b2d80 0x7fd92406af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.733+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 >> v1:172.21.15.81:6789/0 conn(0x7fd9241610b0 legacy=0x7fd9240719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c003c80 0x7fd90c004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c004870 0x7fd90c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c005230 0x7fd90c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910001230 con 0x7fd90c003c80 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924070b30 con 0x7fd90c005230 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c00c180 con 0x7fd90c004870 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c003c80 0x7fd90c004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c005230 0x7fd90c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923e00700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c004870 0x7fd90c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 -- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c004870 msgr2=0x7fd90c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c004870 0x7fd90c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 -- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c005230 msgr2=0x7fd90c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c005230 0x7fd90c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 -- 172.21.15.81:0/279825551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0035d0 con 0x7fd90c003c80 2024-09-13T18:54:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929400700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd90c005230 0x7fd90c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd928a00700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c003c80 0x7fd90c004060 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd918007fd0 tx=0x7fd90c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c723a45ccd82012 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:43.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800cd80 con 0x7fd90c003c80 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918005980 con 0x7fd90c003c80 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd923400700 1 -- 172.21.15.81:0/279825551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918005d30 con 0x7fd90c003c80 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929e00700 1 -- 172.21.15.81:0/279825551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c003c80 msgr2=0x7fd90c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929e00700 1 --2- 172.21.15.81:0/279825551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd90c003c80 0x7fd90c004060 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fd918007fd0 tx=0x7fd90c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929400700 1 -- 172.21.15.81:0/279825551 reap_dead start 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929e00700 1 -- 172.21.15.81:0/279825551 shutdown_connections 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929e00700 1 -- 172.21.15.81:0/279825551 >> 172.21.15.81:0/279825551 conn(0x7fd9240b0c40 msgr2=0x7fd92406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929e00700 1 -- 172.21.15.81:0/279825551 shutdown_connections 2024-09-13T18:54:43.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.737+0000 7fd929e00700 1 -- 172.21.15.81:0/279825551 wait complete. 2024-09-13T18:54:43.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 Processor -- start 2024-09-13T18:54:43.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 -- start start 2024-09-13T18:54:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c003c80 0x7fd924156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 0x7fd924158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924158c80 0x7fd9240aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9241572c0 con 0x7fd9241629b0 2024-09-13T18:54:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd924162e40 con 0x7fd924158c80 2024-09-13T18:54:43.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.741+0000 7fd929e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd924163120 con 0x7fd90c003c80 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 0x7fd924158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 0x7fd924158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55230/0 (socket says 172.21.15.81:55230) 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 -- 172.21.15.81:0/2336732297 learned_addr learned my addr 172.21.15.81:0/2336732297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd928a00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c003c80 0x7fd924156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd929400700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924158c80 0x7fd9240aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 -- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c003c80 msgr2=0x7fd924156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c003c80 0x7fd924156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 -- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924158c80 msgr2=0x7fd9240aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924158c80 0x7fd9240aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 -- 172.21.15.81:0/2336732297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd924163400 con 0x7fd9241629b0 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd929400700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924158c80 0x7fd9240aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd923e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 0x7fd924158740 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e880 tx=0x7fd91000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100052e0 con 0x7fd9241629b0 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910005440 con 0x7fd9241629b0 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9241636e0 con 0x7fd9241629b0 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100038c0 con 0x7fd9241629b0 2024-09-13T18:54:43.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd924162020 con 0x7fd9241629b0 2024-09-13T18:54:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.745+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92406af10 con 0x7fd9241629b0 2024-09-13T18:54:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.749+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd910003a20 con 0x7fd9241629b0 2024-09-13T18:54:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.749+0000 7fd920c00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd904066760 0x7fd904068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.749+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd910083e70 con 0x7fd9241629b0 2024-09-13T18:54:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.749+0000 7fd928a00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd904066760 0x7fd904068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.749+0000 7fd928a00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd904066760 0x7fd904068c20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd918015040 tx=0x7fd91800a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.753+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd910051410 con 0x7fd9241629b0 2024-09-13T18:54:43.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.949+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd924162790 con 0x7fd9241629b0 2024-09-13T18:54:43.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd920c00700 1 -- 172.21.15.81:0/2336732297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd910054a30 con 0x7fd9241629b0 2024-09-13T18:54:43.963 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:43.963 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-13T18:54:43.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-13T18:54:43.964 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-13T18:54:43.964 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-13T18:54:43.964 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:54:43.964 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd904066760 msgr2=0x7fd904068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd904066760 0x7fd904068c20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd918015040 tx=0x7fd91800a000 comp rx=0 tx=0).stop 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 msgr2=0x7fd924158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 0x7fd924158740 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e880 tx=0x7fd91000eb90 comp rx=0 tx=0).stop 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 shutdown_connections 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd904066760 0x7fd904068c20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd924158c80 0x7fd9240aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9241629b0 0x7fd924158740 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 --2- 172.21.15.81:0/2336732297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd90c003c80 0x7fd924156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.953+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 >> 172.21.15.81:0/2336732297 conn(0x7fd9240b0c40 msgr2=0x7fd92406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.957+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 shutdown_connections 2024-09-13T18:54:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:43.957+0000 7fd929e00700 1 -- 172.21.15.81:0/2336732297 wait complete. 2024-09-13T18:54:43.987 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:54:43.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:54:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.157+0000 7f0c96600700 1 Processor -- start 2024-09-13T18:54:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.157+0000 7f0c96600700 1 -- start start 2024-09-13T18:54:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c96600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c900cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c96600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900d1620 con 0x7f0c900cfd90 2024-09-13T18:54:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c96600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c900d1900 con 0x7f0c9015cd50 2024-09-13T18:54:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c96600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900b5be0 con 0x7f0c900b73f0 2024-09-13T18:54:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c8fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c900cfd90 0x7f0c900cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41120/0 (socket says 172.21.15.81:41120) 2024-09-13T18:54:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c8fe00700 1 -- 172.21.15.81:0/918240402 learned_addr learned my addr 172.21.15.81:0/918240402 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c95c00700 1 --2- 172.21.15.81:0/918240402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c900cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c8f400700 1 -- 172.21.15.81:0/918240402 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707931049 0 0) 0x7f0c900d1620 con 0x7f0c900cfd90 2024-09-13T18:54:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c8f400700 1 -- 172.21.15.81:0/918240402 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c780035d0 con 0x7f0c900cfd90 2024-09-13T18:54:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c95c00700 1 -- 172.21.15.81:0/918240402 >> v1:172.21.15.178:6789/0 conn(0x7f0c9015cd50 legacy=0x7f0c900cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c8f400700 1 -- 172.21.15.81:0/918240402 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097788085 0 0) 0x7f0c900d1900 con 0x7f0c9015cd50 2024-09-13T18:54:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c95c00700 1 -- 172.21.15.81:0/918240402 >> v1:172.21.15.81:6789/0 conn(0x7f0c900cfd90 legacy=0x7f0c900cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c95c00700 1 -- 172.21.15.81:0/918240402 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900b5ec0 con 0x7f0c900b73f0 2024-09-13T18:54:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.161+0000 7f0c95c00700 1 --2- 172.21.15.81:0/918240402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c900cded0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009dc0 tx=0x7f0c8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=113f83317c7e9427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c8f400700 1 -- 172.21.15.81:0/918240402 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8800e070 con 0x7f0c900b73f0 2024-09-13T18:54:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c8f400700 1 -- 172.21.15.81:0/918240402 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88003a40 con 0x7f0c900b73f0 2024-09-13T18:54:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c8f400700 1 -- 172.21.15.81:0/918240402 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c001670 con 0x7f0c900b73f0 2024-09-13T18:54:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 -- 172.21.15.81:0/918240402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 msgr2=0x7f0c900cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 --2- 172.21.15.81:0/918240402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c900cded0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009dc0 tx=0x7f0c8800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 -- 172.21.15.81:0/918240402 shutdown_connections 2024-09-13T18:54:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 --2- 172.21.15.81:0/918240402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c900cded0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 -- 172.21.15.81:0/918240402 >> 172.21.15.81:0/918240402 conn(0x7f0c900d2cf0 msgr2=0x7f0c900d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:44.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 -- 172.21.15.81:0/918240402 shutdown_connections 2024-09-13T18:54:44.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.165+0000 7f0c96600700 1 -- 172.21.15.81:0/918240402 wait complete. 2024-09-13T18:54:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 Processor -- start 2024-09-13T18:54:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 -- start start 2024-09-13T18:54:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c9015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c900cfd90 0x7f0c9014af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 0x7f0c9014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900cc710 con 0x7f0c9015cd50 2024-09-13T18:54:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c90148990 con 0x7f0c900cfd90 2024-09-13T18:54:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c96600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c900cbb00 con 0x7f0c900b73f0 2024-09-13T18:54:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 0x7f0c9014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 0x7f0c9014b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55242/0 (socket says 172.21.15.81:55242) 2024-09-13T18:54:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 -- 172.21.15.81:0/2270268785 learned_addr learned my addr 172.21.15.81:0/2270268785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95200700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c9015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c8fe00700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c900cfd90 0x7f0c9014af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 -- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 msgr2=0x7f0c9015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c9015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 -- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c900cfd90 msgr2=0x7f0c9014af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c900cfd90 0x7f0c9014af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 -- 172.21.15.81:0/2270268785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88009a70 con 0x7f0c9015cd50 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95200700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c9015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c8fe00700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c900cfd90 0x7f0c9014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.169+0000 7f0c95c00700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 0x7f0c9014b490 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0c88015040 tx=0x7f0c88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88004600 con 0x7f0c9015cd50 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c88004760 con 0x7f0c9015cd50 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c900cbde0 con 0x7f0c9015cd50 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88012450 con 0x7f0c9015cd50 2024-09-13T18:54:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c900cc3a0 con 0x7f0c9015cd50 2024-09-13T18:54:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c900c8050 con 0x7f0c9015cd50 2024-09-13T18:54:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.173+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c880125b0 con 0x7f0c9015cd50 2024-09-13T18:54:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.177+0000 7f0c8cc00700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c70066760 0x7f0c70068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.177+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0c88085810 con 0x7f0c9015cd50 2024-09-13T18:54:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.177+0000 7f0c95200700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c70066760 0x7f0c70068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.177+0000 7f0c95200700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c70066760 0x7f0c70068c20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000f60 tx=0x7f0c84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.181+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0c880568b0 con 0x7f0c9015cd50 2024-09-13T18:54:44.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.369+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0c900d3810 con 0x7f0c9015cd50 2024-09-13T18:54:44.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.973+0000 7f0c8cc00700 1 -- 172.21.15.81:0/2270268785 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c88056440 con 0x7f0c9015cd50 2024-09-13T18:54:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c70066760 msgr2=0x7f0c70068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c70066760 0x7f0c70068c20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000f60 tx=0x7f0c84009040 comp rx=0 tx=0).stop 2024-09-13T18:54:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 msgr2=0x7f0c9014b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 0x7f0c9014b490 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f0c88015040 tx=0x7f0c88004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 shutdown_connections 2024-09-13T18:54:44.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c70066760 0x7f0c70068c20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c9015cd50 0x7f0c9014b490 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c900cfd90 0x7f0c9014af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 --2- 172.21.15.81:0/2270268785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c900b73f0 0x7f0c9015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 >> 172.21.15.81:0/2270268785 conn(0x7f0c900d2cf0 msgr2=0x7f0c900d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.977+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 shutdown_connections 2024-09-13T18:54:44.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:44.981+0000 7f0c96600700 1 -- 172.21.15.81:0/2270268785 wait complete. 2024-09-13T18:54:44.993 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-13T18:54:45.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:54:45.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.173+0000 7f0693e00700 1 Processor -- start 2024-09-13T18:54:45.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.173+0000 7f0693e00700 1 -- start start 2024-09-13T18:54:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06940cfb50 0x7f069415b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940cc630 con 0x7f0694071090 2024-09-13T18:54:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06940714a0 con 0x7f06940cfb50 2024-09-13T18:54:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0694071730 con 0x7f06940cff30 2024-09-13T18:54:45.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06940cfb50 0x7f069415b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0694071090 0x7f0694066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:40340/0 (socket says 172.21.15.81:40340) 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06940cfb50 0x7f069415b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55254/0 (socket says 172.21.15.81:55254) 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0693400700 1 -- 172.21.15.81:0/1105190303 learned_addr learned my addr 172.21.15.81:0/1105190303 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692000700 1 --2- 172.21.15.81:0/1105190303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 -- 172.21.15.81:0/1105190303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 msgr2=0x7f0694070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 --2- 172.21.15.81:0/1105190303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:45.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 -- 172.21.15.81:0/1105190303 >> v1:172.21.15.178:6789/0 conn(0x7f0694071090 legacy=0x7f0694066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 -- 172.21.15.81:0/1105190303 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694071a10 con 0x7f06940cfb50 2024-09-13T18:54:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0691600700 1 -- 172.21.15.81:0/1105190303 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684287006 0 0) 0x7f06940cc630 con 0x7f0694071090 2024-09-13T18:54:45.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0692a00700 1 --2- 172.21.15.81:0/1105190303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06940cfb50 0x7f069415b9b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0684009850 tx=0x7f0684009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89768e456740a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0691600700 1 -- 172.21.15.81:0/1105190303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011830 con 0x7f06940cfb50 2024-09-13T18:54:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0691600700 1 -- 172.21.15.81:0/1105190303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684011990 con 0x7f06940cfb50 2024-09-13T18:54:45.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.177+0000 7f0691600700 1 -- 172.21.15.81:0/1105190303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011d40 con 0x7f06940cfb50 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 -- 172.21.15.81:0/1105190303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06940cfb50 msgr2=0x7f069415b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 --2- 172.21.15.81:0/1105190303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06940cfb50 0x7f069415b9b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f0684009850 tx=0x7f0684009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 -- 172.21.15.81:0/1105190303 shutdown_connections 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 --2- 172.21.15.81:0/1105190303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 --2- 172.21.15.81:0/1105190303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06940cfb50 0x7f069415b9b0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 -- 172.21.15.81:0/1105190303 >> 172.21.15.81:0/1105190303 conn(0x7f069406cbf0 msgr2=0x7f069406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:45.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 -- 172.21.15.81:0/1105190303 shutdown_connections 2024-09-13T18:54:45.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 -- 172.21.15.81:0/1105190303 wait complete. 2024-09-13T18:54:45.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 Processor -- start 2024-09-13T18:54:45.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.181+0000 7f0693e00700 1 -- start start 2024-09-13T18:54:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 0x7f069415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0694157840 0x7f0694159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069415b950 con 0x7f0694071090 2024-09-13T18:54:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069415bc30 con 0x7f0694157840 2024-09-13T18:54:45.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069415bf10 con 0x7f06940cff30 2024-09-13T18:54:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 0x7f069415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:45.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 0x7f069415c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55256/0 (socket says 172.21.15.81:55256) 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 -- 172.21.15.81:0/444775631 learned_addr learned my addr 172.21.15.81:0/444775631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692000700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693400700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0694157840 0x7f0694159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 -- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 msgr2=0x7f0694149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 -- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0694157840 msgr2=0x7f0694159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0694157840 0x7f0694159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 -- 172.21.15.81:0/444775631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840094b0 con 0x7f0694071090 2024-09-13T18:54:45.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693400700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0694157840 0x7f0694159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0692a00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 0x7f069415c9f0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f06840090b0 tx=0x7f0684004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840045d0 con 0x7f0694071090 2024-09-13T18:54:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068401f070 con 0x7f0694071090 2024-09-13T18:54:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069415c1f0 con 0x7f0694071090 2024-09-13T18:54:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840038e0 con 0x7f0694071090 2024-09-13T18:54:45.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.185+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0694149780 con 0x7f0694071090 2024-09-13T18:54:45.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.189+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069415c710 con 0x7f0694071090 2024-09-13T18:54:45.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.189+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0684003a40 con 0x7f0694071090 2024-09-13T18:54:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.193+0000 7f068aa00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0674066730 0x7f0674068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:45.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.193+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f0684021070 con 0x7f0694071090 2024-09-13T18:54:45.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.193+0000 7f0692000700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0674066730 0x7f0674068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:45.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.193+0000 7f0692000700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0674066730 0x7f0674068bf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f069415d2b0 tx=0x7f0680009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:45.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.201+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0684052c70 con 0x7f0694071090 2024-09-13T18:54:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.381+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f06940d03a0 con 0x7f0694071090 2024-09-13T18:54:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:45.993+0000 7f068aa00700 1 -- 172.21.15.81:0/444775631 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0684056290 con 0x7f0694071090 2024-09-13T18:54:46.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.001+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0674066730 msgr2=0x7f0674068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.001+0000 7f0693e00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0674066730 0x7f0674068bf0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f069415d2b0 tx=0x7f0680009240 comp rx=0 tx=0).stop 2024-09-13T18:54:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.001+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 msgr2=0x7f069415c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.001+0000 7f0693e00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 0x7f069415c9f0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f06840090b0 tx=0x7f0684004770 comp rx=0 tx=0).stop 2024-09-13T18:54:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 shutdown_connections 2024-09-13T18:54:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0674066730 0x7f0674068bf0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0694157840 0x7f0694159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06940cff30 0x7f0694149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 --2- 172.21.15.81:0/444775631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0694071090 0x7f069415c9f0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 >> 172.21.15.81:0/444775631 conn(0x7f069406cbf0 msgr2=0x7f06940af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 shutdown_connections 2024-09-13T18:54:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.005+0000 7f0693e00700 1 -- 172.21.15.81:0/444775631 wait complete. 2024-09-13T18:54:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-13T18:54:46.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:54:46.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 Processor -- start 2024-09-13T18:54:46.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 -- start start 2024-09-13T18:54:46.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb1000b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1000b1980 0x7fb100162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1000b2280 con 0x7fb10006c960 2024-09-13T18:54:46.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1000b2560 con 0x7fb1000b1980 2024-09-13T18:54:46.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.201+0000 7fb0ffe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1000b2840 con 0x7fb100161e00 2024-09-13T18:54:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fea00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb10006c960 0x7fb10006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41128/0 (socket says 172.21.15.81:41128) 2024-09-13T18:54:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fea00700 1 -- 172.21.15.81:0/3583508167 learned_addr learned my addr 172.21.15.81:0/3583508167 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fe000700 1 --2- 172.21.15.81:0/3583508167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb1000b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0ff400700 1 --2- 172.21.15.81:0/3583508167 >> v2:172.21.15.178:3300/0 conn(0x7fb1000b1980 0x7fb100162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fd600700 1 -- 172.21.15.81:0/3583508167 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060085536 0 0) 0x7fb1000b2280 con 0x7fb10006c960 2024-09-13T18:54:46.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fd600700 1 -- 172.21.15.81:0/3583508167 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e40035d0 con 0x7fb10006c960 2024-09-13T18:54:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fe000700 1 -- 172.21.15.81:0/3583508167 >> v2:172.21.15.178:3300/0 conn(0x7fb1000b1980 msgr2=0x7fb100162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fe000700 1 --2- 172.21.15.81:0/3583508167 >> v2:172.21.15.178:3300/0 conn(0x7fb1000b1980 0x7fb100162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fe000700 1 -- 172.21.15.81:0/3583508167 >> v1:172.21.15.81:6789/0 conn(0x7fb10006c960 legacy=0x7fb10006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fe000700 1 -- 172.21.15.81:0/3583508167 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1000b2b20 con 0x7fb100161e00 2024-09-13T18:54:46.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0ff400700 1 --2- 172.21.15.81:0/3583508167 >> v2:172.21.15.178:3300/0 conn(0x7fb1000b1980 0x7fb100162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fe000700 1 --2- 172.21.15.81:0/3583508167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb1000b3320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009850 tx=0x7fb0ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c63b422fa00bc5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fd600700 1 -- 172.21.15.81:0/3583508167 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec011830 con 0x7fb100161e00 2024-09-13T18:54:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fd600700 1 -- 172.21.15.81:0/3583508167 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec011990 con 0x7fb100161e00 2024-09-13T18:54:46.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.205+0000 7fb0fd600700 1 -- 172.21.15.81:0/3583508167 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec011d00 con 0x7fb100161e00 2024-09-13T18:54:46.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 -- 172.21.15.81:0/3583508167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 msgr2=0x7fb1000b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/3583508167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb1000b3320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009850 tx=0x7fb0ec009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 -- 172.21.15.81:0/3583508167 shutdown_connections 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/3583508167 >> v2:172.21.15.178:3300/0 conn(0x7fb1000b1980 0x7fb100162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/3583508167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb1000b3320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 -- 172.21.15.81:0/3583508167 >> 172.21.15.81:0/3583508167 conn(0x7fb10006a390 msgr2=0x7fb10006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 -- 172.21.15.81:0/3583508167 shutdown_connections 2024-09-13T18:54:46.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 -- 172.21.15.81:0/3583508167 wait complete. 2024-09-13T18:54:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 Processor -- start 2024-09-13T18:54:46.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.209+0000 7fb0ffe00700 1 -- start start 2024-09-13T18:54:46.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 0x7fb10014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1000b1980 0x7fb100154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb100070600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1001588a0 con 0x7fb10006c960 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb100158b80 con 0x7fb1000b1980 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb100158e60 con 0x7fb100161e00 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 0x7fb10014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 0x7fb10014bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55262/0 (socket says 172.21.15.81:55262) 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 -- 172.21.15.81:0/2345367080 learned_addr learned my addr 172.21.15.81:0/2345367080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:46.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fe000700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1000b1980 0x7fb100154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ff400700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb100070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 -- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 msgr2=0x7fb100070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb100070600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 -- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1000b1980 msgr2=0x7fb100154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1000b1980 0x7fb100154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 -- 172.21.15.81:0/2345367080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f8009a70 con 0x7fb10006c960 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fe000700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1000b1980 0x7fb100154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:46.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0fea00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 0x7fb10014bda0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00010e0 tx=0x7fb0f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0005d90 con 0x7fb10006c960 2024-09-13T18:54:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f00070d0 con 0x7fb10006c960 2024-09-13T18:54:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec0094b0 con 0x7fb10006c960 2024-09-13T18:54:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0007480 con 0x7fb10006c960 2024-09-13T18:54:46.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.213+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10014c2e0 con 0x7fb10006c960 2024-09-13T18:54:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.217+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10015c3e0 con 0x7fb10006c960 2024-09-13T18:54:46.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.217+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0f00075e0 con 0x7fb10006c960 2024-09-13T18:54:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.217+0000 7fb0f7400700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb0e0066730 0x7fb0e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.217+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fb0f0083780 con 0x7fb10006c960 2024-09-13T18:54:46.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.217+0000 7fb0fe000700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb0e0066730 0x7fb0e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.221+0000 7fb0fe000700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb0e0066730 0x7fb0e0068bf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0090b0 tx=0x7fb0ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:46.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.225+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb10015c3e0 con 0x7fb10006c960 2024-09-13T18:54:46.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.445+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb10015c3e0 con 0x7fb10006c960 2024-09-13T18:54:46.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.465+0000 7fb0f7400700 1 -- 172.21.15.81:0/2345367080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v101) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb10015c3e0 con 0x7fb10006c960 2024-09-13T18:54:46.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb0e0066730 msgr2=0x7fb0e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb0e0066730 0x7fb0e0068bf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0090b0 tx=0x7fb0ec008030 comp rx=0 tx=0).stop 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 msgr2=0x7fb10014bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 0x7fb10014bda0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00010e0 tx=0x7fb0f000c860 comp rx=0 tx=0).stop 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 shutdown_connections 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb0e0066730 0x7fb0e0068bf0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb100161e00 0x7fb100070600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1000b1980 0x7fb100154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 --2- 172.21.15.81:0/2345367080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10006c960 0x7fb10014bda0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.473+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 >> 172.21.15.81:0/2345367080 conn(0x7fb10006a390 msgr2=0x7fb1000cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:46.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.477+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 shutdown_connections 2024-09-13T18:54:46.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.477+0000 7fb0ffe00700 1 -- 172.21.15.81:0/2345367080 wait complete. 2024-09-13T18:54:46.498 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 15 and data pool 16 2024-09-13T18:54:46.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:46.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464be00700 1 Processor -- start 2024-09-13T18:54:46.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464be00700 1 -- start start 2024-09-13T18:54:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f464c06b1b0 0x7f464c1646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0707d0 con 0x7f464c159bd0 2024-09-13T18:54:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c06fee0 con 0x7f464c0cb700 2024-09-13T18:54:46.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464be00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c0720a0 con 0x7f464c06b1b0 2024-09-13T18:54:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f464c159bd0 0x7f464c071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33816/0 (socket says 172.21.15.81:33816) 2024-09-13T18:54:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464aa00700 1 -- 172.21.15.81:0/415629845 learned_addr learned my addr 172.21.15.81:0/415629845 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f464b400700 1 --2- 172.21.15.81:0/415629845 >> v2:172.21.15.81:3300/0 conn(0x7f464c06b1b0 0x7f464c1646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f4649600700 1 -- 172.21.15.81:0/415629845 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50464364 0 0) 0x7f464c0707d0 con 0x7f464c159bd0 2024-09-13T18:54:46.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.673+0000 7f4649600700 1 -- 172.21.15.81:0/415629845 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46300035d0 con 0x7f464c159bd0 2024-09-13T18:54:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464b400700 1 -- 172.21.15.81:0/415629845 >> v1:172.21.15.178:6789/0 conn(0x7f464c0cb700 legacy=0x7f464c06aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464b400700 1 -- 172.21.15.81:0/415629845 >> v1:172.21.15.81:6789/0 conn(0x7f464c159bd0 legacy=0x7f464c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464b400700 1 -- 172.21.15.81:0/415629845 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0b2ef0 con 0x7f464c06b1b0 2024-09-13T18:54:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464b400700 1 --2- 172.21.15.81:0/415629845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c06b1b0 0x7f464c1646c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f4644009dc0 tx=0x7f464400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ea691f578edb34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f4649600700 1 -- 172.21.15.81:0/415629845 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400e070 con 0x7f464c06b1b0 2024-09-13T18:54:46.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f4649600700 1 -- 172.21.15.81:0/415629845 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464400baa0 con 0x7f464c06b1b0 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f4649600700 1 -- 172.21.15.81:0/415629845 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400be50 con 0x7f464c06b1b0 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 -- 172.21.15.81:0/415629845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c06b1b0 msgr2=0x7f464c1646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 --2- 172.21.15.81:0/415629845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c06b1b0 0x7f464c1646c0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f4644009dc0 tx=0x7f464400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 -- 172.21.15.81:0/415629845 shutdown_connections 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 --2- 172.21.15.81:0/415629845 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c06b1b0 0x7f464c1646c0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 -- 172.21.15.81:0/415629845 >> 172.21.15.81:0/415629845 conn(0x7f464c0b0c40 msgr2=0x7f464c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 -- 172.21.15.81:0/415629845 shutdown_connections 2024-09-13T18:54:46.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.677+0000 7f464be00700 1 -- 172.21.15.81:0/415629845 wait complete. 2024-09-13T18:54:46.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 Processor -- start 2024-09-13T18:54:46.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 -- start start 2024-09-13T18:54:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f464c06b1b0 0x7f464c1f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f464c0cb700 0x7f464c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 0x7f464c1563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0cdfc0 con 0x7f464c159bd0 2024-09-13T18:54:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c3bd0 con 0x7f464c0cb700 2024-09-13T18:54:46.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1f1420 con 0x7f464c06b1b0 2024-09-13T18:54:46.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 0x7f464c1563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 0x7f464c1563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52680/0 (socket says 172.21.15.81:52680) 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464b400700 1 -- 172.21.15.81:0/3031097555 learned_addr learned my addr 172.21.15.81:0/3031097555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464aa00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f464c06b1b0 0x7f464c1f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.681+0000 7f464a000700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f464c0cb700 0x7f464c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464b400700 1 -- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f464c06b1b0 msgr2=0x7f464c1f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464b400700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f464c06b1b0 0x7f464c1f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464b400700 1 -- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f464c0cb700 msgr2=0x7f464c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464b400700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f464c0cb700 0x7f464c155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464b400700 1 -- 172.21.15.81:0/3031097555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009a70 con 0x7f464c159bd0 2024-09-13T18:54:46.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464a000700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f464c0cb700 0x7f464c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464b400700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 0x7f464c1563a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f464400d010 tx=0x7f4644004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440048a0 con 0x7f464c159bd0 2024-09-13T18:54:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644026460 con 0x7f464c159bd0 2024-09-13T18:54:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0cd340 con 0x7f464c159bd0 2024-09-13T18:54:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644026810 con 0x7f464c159bd0 2024-09-13T18:54:46.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0cd900 con 0x7f464c159bd0 2024-09-13T18:54:46.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.685+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c06aaa0 con 0x7f464c159bd0 2024-09-13T18:54:46.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.689+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4644026970 con 0x7f464c159bd0 2024-09-13T18:54:46.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.689+0000 7f4643400700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f462c066730 0x7f462c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:46.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.689+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4644086520 con 0x7f464c159bd0 2024-09-13T18:54:46.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.689+0000 7f464aa00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f462c066730 0x7f462c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:46.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.689+0000 7f464aa00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f462c066730 0x7f462c068bf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f463c007fd0 tx=0x7f463c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:46.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.697+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f46440537e0 con 0x7f464c159bd0 2024-09-13T18:54:46.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.885+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f464c1577b0 con 0x7f464c159bd0 2024-09-13T18:54:46.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.889+0000 7f4643400700 1 -- 172.21.15.81:0/3031097555 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f4644056e00 con 0x7f464c159bd0 2024-09-13T18:54:46.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:46.899 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":106,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:46.453917+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.889+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f462c066730 msgr2=0x7f462c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.889+0000 7f464be00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f462c066730 0x7f462c068bf0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f463c007fd0 tx=0x7f463c009040 comp rx=0 tx=0).stop 2024-09-13T18:54:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.889+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 msgr2=0x7f464c1563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:46.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.889+0000 7f464be00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 0x7f464c1563a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f464400d010 tx=0x7f4644004af0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 shutdown_connections 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f462c066730 0x7f462c068bf0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c159bd0 0x7f464c1563a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f464c0cb700 0x7f464c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 --2- 172.21.15.81:0/3031097555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f464c06b1b0 0x7f464c1f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 >> 172.21.15.81:0/3031097555 conn(0x7f464c0b0c40 msgr2=0x7f464c14cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 shutdown_connections 2024-09-13T18:54:46.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:46.893+0000 7f464be00700 1 -- 172.21.15.81:0/3031097555 wait complete. 2024-09-13T18:54:46.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.109+0000 7f9d61000700 1 Processor -- start 2024-09-13T18:54:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.109+0000 7f9d61000700 1 -- start start 2024-09-13T18:54:47.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d61000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d5c0b3f30 0x7f9d5c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d61000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c06a890 con 0x7f9d5c1599f0 2024-09-13T18:54:47.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d61000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c06ab70 con 0x7f9d5c06a390 2024-09-13T18:54:47.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d61000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c06ae50 con 0x7f9d5c0b3f30 2024-09-13T18:54:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d53e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9d5c0b3f30 0x7f9d5c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d59e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d5c1599f0 0x7f9d5c0b3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33830/0 (socket says 172.21.15.81:33830) 2024-09-13T18:54:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d59e00700 1 -- 172.21.15.81:0/3750839522 learned_addr learned my addr 172.21.15.81:0/3750839522 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:47.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d59400700 1 -- 172.21.15.81:0/3750839522 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097463485 0 0) 0x7f9d5c06a890 con 0x7f9d5c1599f0 2024-09-13T18:54:47.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d59400700 1 -- 172.21.15.81:0/3750839522 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d400035d0 con 0x7f9d5c1599f0 2024-09-13T18:54:47.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d53e00700 1 -- 172.21.15.81:0/3750839522 >> v1:172.21.15.178:6789/0 conn(0x7f9d5c06a390 legacy=0x7f9d5c0cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d53e00700 1 -- 172.21.15.81:0/3750839522 >> v1:172.21.15.81:6789/0 conn(0x7f9d5c1599f0 legacy=0x7f9d5c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.113+0000 7f9d53e00700 1 -- 172.21.15.81:0/3750839522 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c06b130 con 0x7f9d5c0b3f30 2024-09-13T18:54:47.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d53e00700 1 --2- 172.21.15.81:0/3750839522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c06b930 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009850 tx=0x7f9d44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d85f731163a35ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d59400700 1 -- 172.21.15.81:0/3750839522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011830 con 0x7f9d5c0b3f30 2024-09-13T18:54:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d59400700 1 -- 172.21.15.81:0/3750839522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44011990 con 0x7f9d5c0b3f30 2024-09-13T18:54:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d59400700 1 -- 172.21.15.81:0/3750839522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011d40 con 0x7f9d5c0b3f30 2024-09-13T18:54:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 -- 172.21.15.81:0/3750839522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0b3f30 msgr2=0x7f9d5c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 --2- 172.21.15.81:0/3750839522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c06b930 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009850 tx=0x7f9d44009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 -- 172.21.15.81:0/3750839522 shutdown_connections 2024-09-13T18:54:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 --2- 172.21.15.81:0/3750839522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c06b930 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 -- 172.21.15.81:0/3750839522 >> 172.21.15.81:0/3750839522 conn(0x7f9d5c0b1e00 msgr2=0x7f9d5c0cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 -- 172.21.15.81:0/3750839522 shutdown_connections 2024-09-13T18:54:47.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.117+0000 7f9d61000700 1 -- 172.21.15.81:0/3750839522 wait complete. 2024-09-13T18:54:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 Processor -- start 2024-09-13T18:54:47.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 -- start start 2024-09-13T18:54:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 0x7f9d5c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c0cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d5c1599f0 0x7f9d5c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0ccdc0 con 0x7f9d5c06a390 2024-09-13T18:54:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0ccff0 con 0x7f9d5c0b3f30 2024-09-13T18:54:47.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0cd2d0 con 0x7f9d5c1599f0 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 0x7f9d5c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 0x7f9d5c158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52698/0 (socket says 172.21.15.81:52698) 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 -- 172.21.15.81:0/1074285429 learned_addr learned my addr 172.21.15.81:0/1074285429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d53e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c0cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 -- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d5c1599f0 msgr2=0x7f9d5c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d5a800700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d5c1599f0 0x7f9d5c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d5c1599f0 0x7f9d5c150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 -- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d5c0b3f30 msgr2=0x7f9d5c0cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c0cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 -- 172.21.15.81:0/1074285429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440094b0 con 0x7f9d5c06a390 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d53e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c0cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d59e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 0x7f9d5c158620 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c700 tx=0x7f9d4c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c005d90 con 0x7f9d5c06a390 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4c0070d0 con 0x7f9d5c06a390 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c007480 con 0x7f9d5c06a390 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.121+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0cd5b0 con 0x7f9d5c06a390 2024-09-13T18:54:47.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.125+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0cdb70 con 0x7f9d5c06a390 2024-09-13T18:54:47.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.125+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c0726a0 con 0x7f9d5c06a390 2024-09-13T18:54:47.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.125+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d4c0075e0 con 0x7f9d5c06a390 2024-09-13T18:54:47.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.129+0000 7f9d52000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d38066730 0x7f9d38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.129+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d4c083980 con 0x7f9d5c06a390 2024-09-13T18:54:47.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.129+0000 7f9d53e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d38066730 0x7f9d38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.129+0000 7f9d53e00700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d38066730 0x7f9d38068bf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d440090b0 tx=0x7f9d44008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:47.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.133+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d4c050b20 con 0x7f9d5c06a390 2024-09-13T18:54:47.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.333+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d5c067730 con 0x7f9d5c06a390 2024-09-13T18:54:47.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.333+0000 7f9d52000700 1 -- 172.21.15.81:0/1074285429 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16729 (secure 0 0 0) 0x7f9d4c054140 con 0x7f9d5c06a390 2024-09-13T18:54:47.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:47.347 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":106,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:46.453917+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d38066730 msgr2=0x7f9d38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d38066730 0x7f9d38068bf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d440090b0 tx=0x7f9d44008030 comp rx=0 tx=0).stop 2024-09-13T18:54:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 msgr2=0x7f9d5c158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 0x7f9d5c158620 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c00c700 tx=0x7f9d4c00cac0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 shutdown_connections 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d38066730 0x7f9d38068bf0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d5c1599f0 0x7f9d5c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d5c0b3f30 0x7f9d5c0cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 --2- 172.21.15.81:0/1074285429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d5c06a390 0x7f9d5c158620 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 >> 172.21.15.81:0/1074285429 conn(0x7f9d5c0b1e00 msgr2=0x7f9d5c14f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 shutdown_connections 2024-09-13T18:54:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.337+0000 7f9d61000700 1 -- 172.21.15.81:0/1074285429 wait complete. 2024-09-13T18:54:47.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:54:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c56e00700 1 Processor -- start 2024-09-13T18:54:47.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c56e00700 1 -- start start 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c56e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c500cf280 0x7f1c5016bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c56e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5006d000 con 0x7f1c50160fc0 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c56e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5006c3f0 con 0x7f1c5006be10 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c56e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5006c6d0 con 0x7f1c500cf280 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c4fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1c50160fc0 0x7f1c500b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33842/0 (socket says 172.21.15.81:33842) 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c4fe00700 1 -- 172.21.15.81:0/1256306219 learned_addr learned my addr 172.21.15.81:0/1256306219 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:47.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.541+0000 7f1c54e00700 1 --2- 172.21.15.81:0/1256306219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c500cf280 0x7f1c5016bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504954681 0 0) 0x7f1c5006d000 con 0x7f1c50160fc0 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c340035d0 con 0x7f1c50160fc0 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672036442 0 0) 0x7f1c5006c3f0 con 0x7f1c5006be10 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c5006d000 con 0x7f1c5006be10 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c54e00700 1 -- 172.21.15.81:0/1256306219 >> v1:172.21.15.178:6789/0 conn(0x7f1c5006be10 legacy=0x7f1c500ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c54e00700 1 -- 172.21.15.81:0/1256306219 >> v1:172.21.15.81:6789/0 conn(0x7f1c50160fc0 legacy=0x7f1c500b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386181191 0 0) 0x7f1c340035d0 con 0x7f1c50160fc0 2024-09-13T18:54:47.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c54e00700 1 -- 172.21.15.81:0/1256306219 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5006c9b0 con 0x7f1c500cf280 2024-09-13T18:54:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c54e00700 1 --2- 172.21.15.81:0/1256306219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c500cf280 0x7f1c5016bbc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009dc0 tx=0x7f1c4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5a8d4286760d4bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:47.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4800e070 con 0x7f1c500cf280 2024-09-13T18:54:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c48003a40 con 0x7f1c500cf280 2024-09-13T18:54:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c4ea00700 1 -- 172.21.15.81:0/1256306219 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40001670 con 0x7f1c500cf280 2024-09-13T18:54:47.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 -- 172.21.15.81:0/1256306219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c500cf280 msgr2=0x7f1c5016bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 --2- 172.21.15.81:0/1256306219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c500cf280 0x7f1c5016bbc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009dc0 tx=0x7f1c4800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 -- 172.21.15.81:0/1256306219 shutdown_connections 2024-09-13T18:54:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 --2- 172.21.15.81:0/1256306219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c500cf280 0x7f1c5016bbc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 -- 172.21.15.81:0/1256306219 >> 172.21.15.81:0/1256306219 conn(0x7f1c5006a570 msgr2=0x7f1c5006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 -- 172.21.15.81:0/1256306219 shutdown_connections 2024-09-13T18:54:47.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.545+0000 7f1c56e00700 1 -- 172.21.15.81:0/1256306219 wait complete. 2024-09-13T18:54:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.549+0000 7f1c56e00700 1 Processor -- start 2024-09-13T18:54:47.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.549+0000 7f1c56e00700 1 -- start start 2024-09-13T18:54:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.549+0000 7f1c56e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006be10 0x7f1c500a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.549+0000 7f1c56e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 0x7f1c5015f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c56e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c50160fc0 0x7f1c500ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c56e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5014ead0 con 0x7f1c500cf280 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c56e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500a8d80 con 0x7f1c50160fc0 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c56e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500a9060 con 0x7f1c5006be10 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 0x7f1c5015f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 0x7f1c5015f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52710/0 (socket says 172.21.15.81:52710) 2024-09-13T18:54:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 -- 172.21.15.81:0/3350610916 learned_addr learned my addr 172.21.15.81:0/3350610916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c54e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c50160fc0 0x7f1c500ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4fe00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006be10 0x7f1c500a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 -- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006be10 msgr2=0x7f1c500a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006be10 0x7f1c500a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 -- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c50160fc0 msgr2=0x7f1c500ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c50160fc0 0x7f1c500ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 -- 172.21.15.81:0/3350610916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48009a70 con 0x7f1c500cf280 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c4f400700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 0x7f1c5015f6e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c730 tx=0x7f1c3c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0052d0 con 0x7f1c500cf280 2024-09-13T18:54:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c500a9340 con 0x7f1c500cf280 2024-09-13T18:54:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c005450 con 0x7f1c500cf280 2024-09-13T18:54:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0038e0 con 0x7f1c500cf280 2024-09-13T18:54:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.553+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c500a89c0 con 0x7f1c500cf280 2024-09-13T18:54:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.557+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5014ec10 con 0x7f1c500cf280 2024-09-13T18:54:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.557+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c3c003a40 con 0x7f1c500cf280 2024-09-13T18:54:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.557+0000 7f1c47e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.557+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1c3c0836d0 con 0x7f1c500cf280 2024-09-13T18:54:47.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.557+0000 7f1c4fe00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:47.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.561+0000 7f1c4fe00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1c40007fd0 tx=0x7f1c40007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:47.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.565+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c5014ec10 con 0x7f1c500cf280 2024-09-13T18:54:47.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:47.781+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1c5014ec10 con 0x7f1c500cf280 2024-09-13T18:54:48.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.473+0000 7f1c47e00700 1 -- 172.21.15.81:0/3350610916 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v104) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1c5014ec10 con 0x7f1c500cf280 2024-09-13T18:54:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 msgr2=0x7f1c30068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1c40007fd0 tx=0x7f1c40007df0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 msgr2=0x7f1c5015f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 0x7f1c5015f6e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00c730 tx=0x7f1c3c00ca40 comp rx=0 tx=0).stop 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 shutdown_connections 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1c30066730 0x7f1c30068bf0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c50160fc0 0x7f1c500ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c500cf280 0x7f1c5015f6e0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 --2- 172.21.15.81:0/3350610916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c5006be10 0x7f1c500a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 >> 172.21.15.81:0/3350610916 conn(0x7f1c5006a570 msgr2=0x7f1c50163f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 shutdown_connections 2024-09-13T18:54:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.477+0000 7f1c56e00700 1 -- 172.21.15.81:0/3350610916 wait complete. 2024-09-13T18:54:48.510 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:54:48.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:54:48.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 Processor -- start 2024-09-13T18:54:48.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 -- start start 2024-09-13T18:54:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee415b460 0x7fdee406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdee406ada0 0x7fdee406b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee406b740 con 0x7fdee406f880 2024-09-13T18:54:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee4165980 con 0x7fdee406ada0 2024-09-13T18:54:48.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee9e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee406d5b0 con 0x7fdee415b460 2024-09-13T18:54:48.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.677+0000 7fdee3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdee406ada0 0x7fdee406b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:48.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdee406f880 0x7fdee406fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33858/0 (socket says 172.21.15.81:33858) 2024-09-13T18:54:48.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9400700 1 -- 172.21.15.81:0/2029440774 learned_addr learned my addr 172.21.15.81:0/2029440774 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:48.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee8a00700 1 --2- 172.21.15.81:0/2029440774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee415b460 0x7fdee406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:48.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3400700 1 -- 172.21.15.81:0/2029440774 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007486479 0 0) 0x7fdee406b740 con 0x7fdee406f880 2024-09-13T18:54:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3400700 1 -- 172.21.15.81:0/2029440774 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0035d0 con 0x7fdee406f880 2024-09-13T18:54:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3e00700 1 -- 172.21.15.81:0/2029440774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee415b460 msgr2=0x7fdee406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3e00700 1 --2- 172.21.15.81:0/2029440774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee415b460 0x7fdee406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3e00700 1 -- 172.21.15.81:0/2029440774 >> v1:172.21.15.81:6789/0 conn(0x7fdee406f880 legacy=0x7fdee406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:48.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3e00700 1 -- 172.21.15.81:0/2029440774 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee4164e00 con 0x7fdee406ada0 2024-09-13T18:54:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3e00700 1 --2- 172.21.15.81:0/2029440774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406ada0 0x7fdee406b200 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fded0009850 tx=0x7fded0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d0e40a0116d20b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3400700 1 -- 172.21.15.81:0/2029440774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0011830 con 0x7fdee406ada0 2024-09-13T18:54:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3400700 1 -- 172.21.15.81:0/2029440774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0011990 con 0x7fdee406ada0 2024-09-13T18:54:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee3400700 1 -- 172.21.15.81:0/2029440774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0011d40 con 0x7fdee406ada0 2024-09-13T18:54:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 -- 172.21.15.81:0/2029440774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406ada0 msgr2=0x7fdee406b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:48.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 --2- 172.21.15.81:0/2029440774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406ada0 0x7fdee406b200 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fded0009850 tx=0x7fded0009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 -- 172.21.15.81:0/2029440774 shutdown_connections 2024-09-13T18:54:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 --2- 172.21.15.81:0/2029440774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee406ada0 0x7fdee406b200 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 --2- 172.21.15.81:0/2029440774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee415b460 0x7fdee406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 -- 172.21.15.81:0/2029440774 >> 172.21.15.81:0/2029440774 conn(0x7fdee4072630 msgr2=0x7fdee406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 -- 172.21.15.81:0/2029440774 shutdown_connections 2024-09-13T18:54:48.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.681+0000 7fdee9e00700 1 -- 172.21.15.81:0/2029440774 wait complete. 2024-09-13T18:54:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 Processor -- start 2024-09-13T18:54:48.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 -- start start 2024-09-13T18:54:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee406ada0 0x7fdee414d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:48.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406f880 0x7fdee415e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 0x7fdee41f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee415df70 con 0x7fdee415b460 2024-09-13T18:54:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee415e8d0 con 0x7fdee406f880 2024-09-13T18:54:48.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee415d2b0 con 0x7fdee406ada0 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 0x7fdee41f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 0x7fdee41f7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52724/0 (socket says 172.21.15.81:52724) 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.685+0000 7fdee9400700 1 -- 172.21.15.81:0/768701205 learned_addr learned my addr 172.21.15.81:0/768701205 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee3e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406f880 0x7fdee415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee8a00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee406ada0 0x7fdee414d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9400700 1 -- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee406ada0 msgr2=0x7fdee414d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9400700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee406ada0 0x7fdee414d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9400700 1 -- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406f880 msgr2=0x7fdee415e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9400700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406f880 0x7fdee415e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9400700 1 -- 172.21.15.81:0/768701205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded00094b0 con 0x7fdee415b460 2024-09-13T18:54:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee8a00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee406ada0 0x7fdee414d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9400700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 0x7fdee41f7c10 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00cb70 tx=0x7fdedc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00a7b0 con 0x7fdee415b460 2024-09-13T18:54:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00a910 con 0x7fdee415b460 2024-09-13T18:54:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee415d8b0 con 0x7fdee415b460 2024-09-13T18:54:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00aca0 con 0x7fdee415b460 2024-09-13T18:54:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee41f8150 con 0x7fdee415b460 2024-09-13T18:54:48.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.689+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee415d710 con 0x7fdee415b460 2024-09-13T18:54:48.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.693+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdedc01b3b0 con 0x7fdee415b460 2024-09-13T18:54:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.693+0000 7fdee0c00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.693+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdedc083d60 con 0x7fdee415b460 2024-09-13T18:54:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.693+0000 7fdee8a00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.693+0000 7fdee8a00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fded8009a10 tx=0x7fded8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:48.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.697+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdee415d710 con 0x7fdee415b460 2024-09-13T18:54:48.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:48.925+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdee415d710 con 0x7fdee415b460 2024-09-13T18:54:49.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.473+0000 7fdee0c00700 1 -- 172.21.15.81:0/768701205 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v105) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdee415d710 con 0x7fdee415b460 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 msgr2=0x7fdec4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fded8009a10 tx=0x7fded8008040 comp rx=0 tx=0).stop 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 msgr2=0x7fdee41f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 0x7fdee41f7c10 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00cb70 tx=0x7fdedc00cba0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 shutdown_connections 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fdec4066730 0x7fdec4068bf0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee415b460 0x7fdee41f7c10 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee406f880 0x7fdee415e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 --2- 172.21.15.81:0/768701205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee406ada0 0x7fdee414d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 >> 172.21.15.81:0/768701205 conn(0x7fdee4072630 msgr2=0x7fdee4163bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 shutdown_connections 2024-09-13T18:54:49.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.481+0000 7fdee9e00700 1 -- 172.21.15.81:0/768701205 wait complete. 2024-09-13T18:54:49.517 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:54:49.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.677+0000 7ff5a5600700 1 Processor -- start 2024-09-13T18:54:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff5a5600700 1 -- start start 2024-09-13T18:54:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff5a5600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5a006c460 0x7ff5a006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff5a5600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5a006a5d0 0x7ff5a006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff5a5600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00cdd90 con 0x7ff5a015b700 2024-09-13T18:54:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff5a5600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a006ce10 con 0x7ff5a006c460 2024-09-13T18:54:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff5a5600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a006af50 con 0x7ff5a006a5d0 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5a006c460 0x7ff5a006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff5a006c460 0x7ff5a006d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52726/0 (socket says 172.21.15.81:52726) 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 -- 172.21.15.81:0/3893471710 learned_addr learned my addr 172.21.15.81:0/3893471710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59f400700 1 --2- 172.21.15.81:0/3893471710 >> v2:172.21.15.178:3300/0 conn(0x7ff5a006a5d0 0x7ff5a006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 -- 172.21.15.81:0/3893471710 >> v2:172.21.15.178:3300/0 conn(0x7ff5a006a5d0 msgr2=0x7ff5a006aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 --2- 172.21.15.81:0/3893471710 >> v2:172.21.15.178:3300/0 conn(0x7ff5a006a5d0 0x7ff5a006aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 -- 172.21.15.81:0/3893471710 >> v1:172.21.15.178:6789/0 conn(0x7ff5a015b700 legacy=0x7ff5a015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59e000700 1 -- 172.21.15.81:0/3893471710 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a006d7e0 con 0x7ff5a006c460 2024-09-13T18:54:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.681+0000 7ff59f400700 1 --2- 172.21.15.81:0/3893471710 >> v2:172.21.15.178:3300/0 conn(0x7ff5a006a5d0 0x7ff5a006aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff59e000700 1 --2- 172.21.15.81:0/3893471710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a006d2a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00722a0 tx=0x7ff58c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aa477a6dcfb842 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff59d600700 1 -- 172.21.15.81:0/3893471710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00b8a0 con 0x7ff5a006c460 2024-09-13T18:54:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff59d600700 1 -- 172.21.15.81:0/3893471710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00ba00 con 0x7ff5a006c460 2024-09-13T18:54:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff59d600700 1 -- 172.21.15.81:0/3893471710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00bd90 con 0x7ff5a006c460 2024-09-13T18:54:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 -- 172.21.15.81:0/3893471710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 msgr2=0x7ff5a006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3893471710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a006d2a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00722a0 tx=0x7ff58c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 -- 172.21.15.81:0/3893471710 shutdown_connections 2024-09-13T18:54:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3893471710 >> v2:172.21.15.178:3300/0 conn(0x7ff5a006a5d0 0x7ff5a006aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3893471710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a006d2a0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 -- 172.21.15.81:0/3893471710 >> 172.21.15.81:0/3893471710 conn(0x7ff5a00b08d0 msgr2=0x7ff5a00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 -- 172.21.15.81:0/3893471710 shutdown_connections 2024-09-13T18:54:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.685+0000 7ff5a5600700 1 -- 172.21.15.81:0/3893471710 wait complete. 2024-09-13T18:54:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 Processor -- start 2024-09-13T18:54:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 -- start start 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a006a5d0 0x7ff5a0150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a015b700 0x7ff5a01e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a015d550 con 0x7ff5a006c460 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a015c940 con 0x7ff5a015b700 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff5a5600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a015cc20 con 0x7ff5a006a5d0 2024-09-13T18:54:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:49.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a015d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52730/0 (socket says 172.21.15.81:52730) 2024-09-13T18:54:49.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 -- 172.21.15.81:0/3870005665 learned_addr learned my addr 172.21.15.81:0/3870005665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:49.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59ea00700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a006a5d0 0x7ff5a0150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59f400700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a015b700 0x7ff5a01e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 -- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a006a5d0 msgr2=0x7ff5a0150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a006a5d0 0x7ff5a0150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 -- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a015b700 msgr2=0x7ff5a01e73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a015b700 0x7ff5a01e73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.689+0000 7ff59e000700 1 -- 172.21.15.81:0/3870005665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c009570 con 0x7ff5a006c460 2024-09-13T18:54:49.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff59e000700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a015d9e0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00721e0 tx=0x7ff58c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:49.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0038c0 con 0x7ff5a006c460 2024-09-13T18:54:49.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c01f070 con 0x7ff5a006c460 2024-09-13T18:54:49.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c003c60 con 0x7ff5a006c460 2024-09-13T18:54:49.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a015cf00 con 0x7ff5a006c460 2024-09-13T18:54:49.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a0150ff0 con 0x7ff5a006c460 2024-09-13T18:54:49.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.693+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a015d700 con 0x7ff5a006c460 2024-09-13T18:54:49.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.697+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff58c026480 con 0x7ff5a006c460 2024-09-13T18:54:49.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.697+0000 7ff596a00700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff580066730 0x7ff580068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:49.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.697+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff58c021070 con 0x7ff5a006c460 2024-09-13T18:54:49.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.697+0000 7ff59ea00700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff580066730 0x7ff580068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:49.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.697+0000 7ff59ea00700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff580066730 0x7ff580068bf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00b3cc0 tx=0x7ff590009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.705+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5a015d700 con 0x7ff5a006c460 2024-09-13T18:54:49.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.937+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5a006aa10 con 0x7ff5a006c460 2024-09-13T18:54:49.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.937+0000 7ff596a00700 1 -- 172.21.15.81:0/3870005665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4745 (secure 0 0 0) 0x7ff58c053000 con 0x7ff5a006c460 2024-09-13T18:54:49.948 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:49.948 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":105,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":7550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":8907,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:54:49.472998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8910},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff580066730 msgr2=0x7ff580068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff580066730 0x7ff580068bf0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00b3cc0 tx=0x7ff590009040 comp rx=0 tx=0).stop 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 msgr2=0x7ff5a015d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a015d9e0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00721e0 tx=0x7ff58c004770 comp rx=0 tx=0).stop 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 shutdown_connections 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff580066730 0x7ff580068bf0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5a015b700 0x7ff5a01e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5a006c460 0x7ff5a015d9e0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 --2- 172.21.15.81:0/3870005665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5a006a5d0 0x7ff5a0150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:49.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 >> 172.21.15.81:0/3870005665 conn(0x7ff5a00b08d0 msgr2=0x7ff5a00aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 shutdown_connections 2024-09-13T18:54:49.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:49.941+0000 7ff5a5600700 1 -- 172.21.15.81:0/3870005665 wait complete. 2024-09-13T18:54:49.955 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 105 2024-09-13T18:54:49.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:54:50.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.137+0000 7fde4b000700 1 Processor -- start 2024-09-13T18:54:50.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.137+0000 7fde4b000700 1 -- start start 2024-09-13T18:54:50.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde4b000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fde440cb020 0x7fde440cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde4b000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde440b2ad0 con 0x7fde4406aaa0 2024-09-13T18:54:50.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde4b000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4415b960 con 0x7fde4415c2a0 2024-09-13T18:54:50.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde4b000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde4415bc40 con 0x7fde440cb020 2024-09-13T18:54:50.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde4a600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fde4406aaa0 0x7fde440b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33874/0 (socket says 172.21.15.81:33874) 2024-09-13T18:54:50.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde4a600700 1 -- 172.21.15.81:0/2653582542 learned_addr learned my addr 172.21.15.81:0/2653582542 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:50.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde49c00700 1 --2- 172.21.15.81:0/2653582542 >> v2:172.21.15.81:3300/0 conn(0x7fde440cb020 0x7fde440cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde43e00700 1 -- 172.21.15.81:0/2653582542 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712220352 0 0) 0x7fde440b2ad0 con 0x7fde4406aaa0 2024-09-13T18:54:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde49c00700 1 -- 172.21.15.81:0/2653582542 >> v1:172.21.15.178:6789/0 conn(0x7fde4415c2a0 legacy=0x7fde4415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde49c00700 1 -- 172.21.15.81:0/2653582542 >> v1:172.21.15.81:6789/0 conn(0x7fde4406aaa0 legacy=0x7fde440b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde49c00700 1 -- 172.21.15.81:0/2653582542 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4415bf20 con 0x7fde440cb020 2024-09-13T18:54:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde49c00700 1 --2- 172.21.15.81:0/2653582542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde440cb020 0x7fde440cc6f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fde38009d90 tx=0x7fde3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f04f0da7ee2a3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:50.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde43e00700 1 -- 172.21.15.81:0/2653582542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3800e070 con 0x7fde440cb020 2024-09-13T18:54:50.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde43e00700 1 -- 172.21.15.81:0/2653582542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3800bad0 con 0x7fde440cb020 2024-09-13T18:54:50.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.141+0000 7fde43e00700 1 -- 172.21.15.81:0/2653582542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3800be80 con 0x7fde440cb020 2024-09-13T18:54:50.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 -- 172.21.15.81:0/2653582542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde440cb020 msgr2=0x7fde440cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 --2- 172.21.15.81:0/2653582542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde440cb020 0x7fde440cc6f0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fde38009d90 tx=0x7fde3800b330 comp rx=0 tx=0).stop 2024-09-13T18:54:50.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 -- 172.21.15.81:0/2653582542 shutdown_connections 2024-09-13T18:54:50.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 --2- 172.21.15.81:0/2653582542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde440cb020 0x7fde440cc6f0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 -- 172.21.15.81:0/2653582542 >> 172.21.15.81:0/2653582542 conn(0x7fde440b0c40 msgr2=0x7fde4406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:50.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 -- 172.21.15.81:0/2653582542 shutdown_connections 2024-09-13T18:54:50.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.145+0000 7fde4b000700 1 -- 172.21.15.81:0/2653582542 wait complete. 2024-09-13T18:54:50.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 Processor -- start 2024-09-13T18:54:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 -- start start 2024-09-13T18:54:50.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde4406aaa0 0x7fde440c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde440cb020 0x7fde440c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 0x7fde44143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440c4ae0 con 0x7fde4415c2a0 2024-09-13T18:54:50.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440c3e60 con 0x7fde4406aaa0 2024-09-13T18:54:50.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4b000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440c4140 con 0x7fde440cb020 2024-09-13T18:54:50.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 0x7fde44143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 0x7fde44143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52746/0 (socket says 172.21.15.81:52746) 2024-09-13T18:54:50.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 -- 172.21.15.81:0/2282715149 learned_addr learned my addr 172.21.15.81:0/2282715149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde49c00700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde4406aaa0 0x7fde440c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde49200700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde440cb020 0x7fde440c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 -- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde440cb020 msgr2=0x7fde440c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde440cb020 0x7fde440c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 -- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde4406aaa0 msgr2=0x7fde440c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde4406aaa0 0x7fde440c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 -- 172.21.15.81:0/2282715149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde38009a70 con 0x7fde4415c2a0 2024-09-13T18:54:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.149+0000 7fde4a600700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 0x7fde44143540 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c550 tx=0x7fde3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c004ca0 con 0x7fde4415c2a0 2024-09-13T18:54:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c004e40 con 0x7fde4415c2a0 2024-09-13T18:54:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c007310 con 0x7fde4415c2a0 2024-09-13T18:54:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde440c4420 con 0x7fde4415c2a0 2024-09-13T18:54:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde44144520 con 0x7fde4415c2a0 2024-09-13T18:54:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde440c4c20 con 0x7fde4415c2a0 2024-09-13T18:54:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.153+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fde3c007470 con 0x7fde4415c2a0 2024-09-13T18:54:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.157+0000 7fde41600700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.157+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde3c083ec0 con 0x7fde4415c2a0 2024-09-13T18:54:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.157+0000 7fde49c00700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.157+0000 7fde49c00700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fde38000f80 tx=0x7fde38011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:50.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.161+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fde440c4c20 con 0x7fde4415c2a0 2024-09-13T18:54:50.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.345+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde440b3ce0 con 0x7fde4415c2a0 2024-09-13T18:54:50.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.349+0000 7fde41600700 1 -- 172.21.15.81:0/2282715149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16716 (secure 0 0 0) 0x7fde3c0510e0 con 0x7fde4415c2a0 2024-09-13T18:54:50.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:50.362 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":107,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:54:47.459578+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 msgr2=0x7fde24068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fde38000f80 tx=0x7fde38011000 comp rx=0 tx=0).stop 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 msgr2=0x7fde44143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 0x7fde44143540 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c550 tx=0x7fde3c00c860 comp rx=0 tx=0).stop 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 shutdown_connections 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fde24066730 0x7fde24068bf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde4415c2a0 0x7fde44143540 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fde440cb020 0x7fde440c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 --2- 172.21.15.81:0/2282715149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fde4406aaa0 0x7fde440c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 >> 172.21.15.81:0/2282715149 conn(0x7fde440b0c40 msgr2=0x7fde44158f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 shutdown_connections 2024-09-13T18:54:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.353+0000 7fde4b000700 1 -- 172.21.15.81:0/2282715149 wait complete. 2024-09-13T18:54:50.386 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:54:50.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:54:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.553+0000 7f78aa600700 1 Processor -- start 2024-09-13T18:54:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.553+0000 7f78aa600700 1 -- start start 2024-09-13T18:54:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78aa600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78a41573b0 0x7f78a40cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78aa600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f78a40ce2f0 0x7f78a406a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78aa600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a406af60 con 0x7f78a406ab10 2024-09-13T18:54:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78aa600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a40ad480 con 0x7f78a41573b0 2024-09-13T18:54:50.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78aa600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a4157790 con 0x7f78a40ce2f0 2024-09-13T18:54:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78a3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f78a41573b0 0x7f78a40cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78a3e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f78a406ab10 0x7f78a4160890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33884/0 (socket says 172.21.15.81:33884) 2024-09-13T18:54:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78a3e00700 1 -- 172.21.15.81:0/1046056858 learned_addr learned my addr 172.21.15.81:0/1046056858 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:50.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f789aa00700 1 --2- 172.21.15.81:0/1046056858 >> v2:172.21.15.178:3300/0 conn(0x7f78a40ce2f0 0x7f78a406a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.557+0000 7f78a2a00700 1 -- 172.21.15.81:0/1046056858 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320136541 0 0) 0x7f789c001490 con 0x7f78a406ab10 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a2a00700 1 -- 172.21.15.81:0/1046056858 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78880035d0 con 0x7f78a406ab10 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a3400700 1 -- 172.21.15.81:0/1046056858 >> v2:172.21.15.178:3300/0 conn(0x7f78a40ce2f0 msgr2=0x7f78a406a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a3400700 1 --2- 172.21.15.81:0/1046056858 >> v2:172.21.15.178:3300/0 conn(0x7f78a40ce2f0 0x7f78a406a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a3400700 1 -- 172.21.15.81:0/1046056858 >> v1:172.21.15.81:6789/0 conn(0x7f78a406ab10 legacy=0x7f78a4160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a3400700 1 -- 172.21.15.81:0/1046056858 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40ad6d0 con 0x7f78a41573b0 2024-09-13T18:54:50.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f789aa00700 1 --2- 172.21.15.81:0/1046056858 >> v2:172.21.15.178:3300/0 conn(0x7f78a40ce2f0 0x7f78a406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:50.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a3400700 1 --2- 172.21.15.81:0/1046056858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a41573b0 0x7f78a40cddb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f78a40acd40 tx=0x7f7894009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ece16919d59f48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:50.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a2a00700 1 -- 172.21.15.81:0/1046056858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894011830 con 0x7f78a41573b0 2024-09-13T18:54:50.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a2a00700 1 -- 172.21.15.81:0/1046056858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894011990 con 0x7f78a41573b0 2024-09-13T18:54:50.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78a2a00700 1 -- 172.21.15.81:0/1046056858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894011d20 con 0x7f78a41573b0 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 -- 172.21.15.81:0/1046056858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a41573b0 msgr2=0x7f78a40cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 --2- 172.21.15.81:0/1046056858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a41573b0 0x7f78a40cddb0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f78a40acd40 tx=0x7f7894009b30 comp rx=0 tx=0).stop 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 -- 172.21.15.81:0/1046056858 shutdown_connections 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 --2- 172.21.15.81:0/1046056858 >> v2:172.21.15.178:3300/0 conn(0x7f78a40ce2f0 0x7f78a406a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 --2- 172.21.15.81:0/1046056858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a41573b0 0x7f78a40cddb0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 -- 172.21.15.81:0/1046056858 >> 172.21.15.81:0/1046056858 conn(0x7f78a40b08d0 msgr2=0x7f78a40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 -- 172.21.15.81:0/1046056858 shutdown_connections 2024-09-13T18:54:50.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.561+0000 7f78aa600700 1 -- 172.21.15.81:0/1046056858 wait complete. 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 Processor -- start 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 -- start start 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a406ab10 0x7f78a414cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 0x7f78a41555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a41573b0 0x7f78a40b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41f6510 con 0x7f78a40ce2f0 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41f67b0 con 0x7f78a41573b0 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78aa600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a41f6a90 con 0x7f78a406ab10 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 0x7f78a41555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 0x7f78a41555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52766/0 (socket says 172.21.15.81:52766) 2024-09-13T18:54:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 -- 172.21.15.81:0/1433146626 learned_addr learned my addr 172.21.15.81:0/1433146626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78a3e00700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a41573b0 0x7f78a40b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f78a3400700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a406ab10 0x7f78a414cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 -- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a406ab10 msgr2=0x7f78a414cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a406ab10 0x7f78a414cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 -- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a41573b0 msgr2=0x7f78a40b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a41573b0 0x7f78a40b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 -- 172.21.15.81:0/1433146626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788c0094b0 con 0x7f78a40ce2f0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789aa00700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 0x7f78a41555d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f788c00ebe0 tx=0x7f788c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.565+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00c910 con 0x7f78a40ce2f0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.569+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788c00ca70 con 0x7f78a40ce2f0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.569+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788c00ce00 con 0x7f78a40ce2f0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.569+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940094b0 con 0x7f78a40ce2f0 2024-09-13T18:54:50.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.569+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a41f7050 con 0x7f78a40ce2f0 2024-09-13T18:54:50.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.569+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a406a5d0 con 0x7f78a40ce2f0 2024-09-13T18:54:50.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.569+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f788c013470 con 0x7f78a40ce2f0 2024-09-13T18:54:50.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.573+0000 7f789be00700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7880066730 0x7f7880068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:50.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.573+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f788c084510 con 0x7f78a40ce2f0 2024-09-13T18:54:50.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.573+0000 7f78a3400700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7880066730 0x7f7880068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:50.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.573+0000 7f78a3400700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7880066730 0x7f7880068bf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7894000c00 tx=0x7f7894008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.581+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f788c051730 con 0x7f78a40ce2f0 2024-09-13T18:54:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.769+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78a40adf70 con 0x7f7880066730 2024-09-13T18:54:50.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.785+0000 7f789be00700 1 -- 172.21.15.81:0/1433146626 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287303 (secure 0 0 0) 0x7f7894011b80 con 0x7f7880066730 2024-09-13T18:54:50.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7880066730 msgr2=0x7f7880068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7880066730 0x7f7880068bf0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7894000c00 tx=0x7f7894008030 comp rx=0 tx=0).stop 2024-09-13T18:54:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 msgr2=0x7f78a41555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 0x7f78a41555d0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f788c00ebe0 tx=0x7f788c009ed0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 shutdown_connections 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7880066730 0x7f7880068bf0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78a41573b0 0x7f78a40b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78a40ce2f0 0x7f78a41555d0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 --2- 172.21.15.81:0/1433146626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78a406ab10 0x7f78a414cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 >> 172.21.15.81:0/1433146626 conn(0x7f78a40b08d0 msgr2=0x7f78a40aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 shutdown_connections 2024-09-13T18:54:50.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:50.793+0000 7f78aa600700 1 -- 172.21.15.81:0/1433146626 wait complete. 2024-09-13T18:54:50.807 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:54:50.829 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-13T18:54:49.124026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260476,"kb_used_data":11496,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714244,"statfs":{"total":773094113280,"available":772827385856,"internally_reserved":0,"allocated":11771904,"data_stored":6054748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.147498"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474289+0000","last_change":"2024-09-13T18:54:46.482791+0000","last_active":"2024-09-13T18:54:47.474289+0000","last_peered":"2024-09-13T18:54:47.474289+0000","last_clean":"2024-09-13T18:54:47.474289+0000","last_became_active":"2024-09-13T18:54:46.481408+0000","last_became_peered":"2024-09-13T18:54:46.481408+0000","last_unstale":"2024-09-13T18:54:47.474289+0000","last_undegraded":"2024-09-13T18:54:47.474289+0000","last_fullsized":"2024-09-13T18:54:47.474289+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:22.577797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498757+0000","last_change":"2024-09-13T18:54:46.490006+0000","last_active":"2024-09-13T18:54:46.498757+0000","last_peered":"2024-09-13T18:54:46.498757+0000","last_clean":"2024-09-13T18:54:46.498757+0000","last_became_active":"2024-09-13T18:54:46.489311+0000","last_became_peered":"2024-09-13T18:54:46.489311+0000","last_unstale":"2024-09-13T18:54:46.498757+0000","last_undegraded":"2024-09-13T18:54:46.498757+0000","last_fullsized":"2024-09-13T18:54:46.498757+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:16.676485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474132+0000","last_change":"2024-09-13T18:54:46.487354+0000","last_active":"2024-09-13T18:54:47.474132+0000","last_peered":"2024-09-13T18:54:47.474132+0000","last_clean":"2024-09-13T18:54:47.474132+0000","last_became_active":"2024-09-13T18:54:46.487145+0000","last_became_peered":"2024-09-13T18:54:46.487145+0000","last_unstale":"2024-09-13T18:54:47.474132+0000","last_undegraded":"2024-09-13T18:54:47.474132+0000","last_fullsized":"2024-09-13T18:54:47.474132+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:37.391368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500981+0000","last_change":"2024-09-13T18:54:46.497327+0000","last_active":"2024-09-13T18:54:46.500981+0000","last_peered":"2024-09-13T18:54:46.500981+0000","last_clean":"2024-09-13T18:54:46.500981+0000","last_became_active":"2024-09-13T18:54:46.497067+0000","last_became_peered":"2024-09-13T18:54:46.497067+0000","last_unstale":"2024-09-13T18:54:46.500981+0000","last_undegraded":"2024-09-13T18:54:46.500981+0000","last_fullsized":"2024-09-13T18:54:46.500981+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:31.048017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473104+0000","last_change":"2024-09-13T18:54:46.499213+0000","last_active":"2024-09-13T18:54:47.473104+0000","last_peered":"2024-09-13T18:54:47.473104+0000","last_clean":"2024-09-13T18:54:47.473104+0000","last_became_active":"2024-09-13T18:54:46.498977+0000","last_became_peered":"2024-09-13T18:54:46.498977+0000","last_unstale":"2024-09-13T18:54:47.473104+0000","last_undegraded":"2024-09-13T18:54:47.473104+0000","last_fullsized":"2024-09-13T18:54:47.473104+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:27.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500333+0000","last_change":"2024-09-13T18:54:46.497187+0000","last_active":"2024-09-13T18:54:46.500333+0000","last_peered":"2024-09-13T18:54:46.500333+0000","last_clean":"2024-09-13T18:54:46.500333+0000","last_became_active":"2024-09-13T18:54:46.496901+0000","last_became_peered":"2024-09-13T18:54:46.496901+0000","last_unstale":"2024-09-13T18:54:46.500333+0000","last_undegraded":"2024-09-13T18:54:46.500333+0000","last_fullsized":"2024-09-13T18:54:46.500333+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:44.935877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.501040+0000","last_change":"2024-09-13T18:54:46.498452+0000","last_active":"2024-09-13T18:54:46.501040+0000","last_peered":"2024-09-13T18:54:46.501040+0000","last_clean":"2024-09-13T18:54:46.501040+0000","last_became_active":"2024-09-13T18:54:46.498185+0000","last_became_peered":"2024-09-13T18:54:46.498185+0000","last_unstale":"2024-09-13T18:54:46.501040+0000","last_undegraded":"2024-09-13T18:54:46.501040+0000","last_fullsized":"2024-09-13T18:54:46.501040+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:17.875596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499671+0000","last_change":"2024-09-13T18:54:46.492730+0000","last_active":"2024-09-13T18:54:46.499671+0000","last_peered":"2024-09-13T18:54:46.499671+0000","last_clean":"2024-09-13T18:54:46.499671+0000","last_became_active":"2024-09-13T18:54:46.492456+0000","last_became_peered":"2024-09-13T18:54:46.492456+0000","last_unstale":"2024-09-13T18:54:46.499671+0000","last_undegraded":"2024-09-13T18:54:46.499671+0000","last_fullsized":"2024-09-13T18:54:46.499671+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:27.855986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500204+0000","last_change":"2024-09-13T18:54:46.494667+0000","last_active":"2024-09-13T18:54:46.500204+0000","last_peered":"2024-09-13T18:54:46.500204+0000","last_clean":"2024-09-13T18:54:46.500204+0000","last_became_active":"2024-09-13T18:54:46.494419+0000","last_became_peered":"2024-09-13T18:54:46.494419+0000","last_unstale":"2024-09-13T18:54:46.500204+0000","last_undegraded":"2024-09-13T18:54:46.500204+0000","last_fullsized":"2024-09-13T18:54:46.500204+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473705+0000","last_change":"2024-09-13T18:54:46.495906+0000","last_active":"2024-09-13T18:54:47.473705+0000","last_peered":"2024-09-13T18:54:47.473705+0000","last_clean":"2024-09-13T18:54:47.473705+0000","last_became_active":"2024-09-13T18:54:46.494088+0000","last_became_peered":"2024-09-13T18:54:46.494088+0000","last_unstale":"2024-09-13T18:54:47.473705+0000","last_undegraded":"2024-09-13T18:54:47.473705+0000","last_fullsized":"2024-09-13T18:54:47.473705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:52.353965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.491633+0000","last_change":"2024-09-13T18:54:46.490246+0000","last_active":"2024-09-13T18:54:46.491633+0000","last_peered":"2024-09-13T18:54:46.491633+0000","last_clean":"2024-09-13T18:54:46.491633+0000","last_became_active":"2024-09-13T18:54:46.489950+0000","last_became_peered":"2024-09-13T18:54:46.489950+0000","last_unstale":"2024-09-13T18:54:46.491633+0000","last_undegraded":"2024-09-13T18:54:46.491633+0000","last_fullsized":"2024-09-13T18:54:46.491633+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:57.391073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476119+0000","last_change":"2024-09-13T18:54:46.494982+0000","last_active":"2024-09-13T18:54:47.476119+0000","last_peered":"2024-09-13T18:54:47.476119+0000","last_clean":"2024-09-13T18:54:47.476119+0000","last_became_active":"2024-09-13T18:54:46.494583+0000","last_became_peered":"2024-09-13T18:54:46.494583+0000","last_unstale":"2024-09-13T18:54:47.476119+0000","last_undegraded":"2024-09-13T18:54:47.476119+0000","last_fullsized":"2024-09-13T18:54:47.476119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:24.725559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.490292+0000","last_change":"2024-09-13T18:54:46.487664+0000","last_active":"2024-09-13T18:54:46.490292+0000","last_peered":"2024-09-13T18:54:46.490292+0000","last_clean":"2024-09-13T18:54:46.490292+0000","last_became_active":"2024-09-13T18:54:46.487413+0000","last_became_peered":"2024-09-13T18:54:46.487413+0000","last_unstale":"2024-09-13T18:54:46.490292+0000","last_undegraded":"2024-09-13T18:54:46.490292+0000","last_fullsized":"2024-09-13T18:54:46.490292+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:07.711722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941748+0000","last_change":"2024-09-13T18:54:46.487184+0000","last_active":"2024-09-13T18:54:47.941748+0000","last_peered":"2024-09-13T18:54:47.941748+0000","last_clean":"2024-09-13T18:54:47.941748+0000","last_became_active":"2024-09-13T18:54:46.486878+0000","last_became_peered":"2024-09-13T18:54:46.486878+0000","last_unstale":"2024-09-13T18:54:47.941748+0000","last_undegraded":"2024-09-13T18:54:47.941748+0000","last_fullsized":"2024-09-13T18:54:47.941748+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:31.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941836+0000","last_change":"2024-09-13T18:54:46.490446+0000","last_active":"2024-09-13T18:54:47.941836+0000","last_peered":"2024-09-13T18:54:47.941836+0000","last_clean":"2024-09-13T18:54:47.941836+0000","last_became_active":"2024-09-13T18:54:46.490164+0000","last_became_peered":"2024-09-13T18:54:46.490164+0000","last_unstale":"2024-09-13T18:54:47.941836+0000","last_undegraded":"2024-09-13T18:54:47.941836+0000","last_fullsized":"2024-09-13T18:54:47.941836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:23.010960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941627+0000","last_change":"2024-09-13T18:54:46.493014+0000","last_active":"2024-09-13T18:54:47.941627+0000","last_peered":"2024-09-13T18:54:47.941627+0000","last_clean":"2024-09-13T18:54:47.941627+0000","last_became_active":"2024-09-13T18:54:46.492726+0000","last_became_peered":"2024-09-13T18:54:46.492726+0000","last_unstale":"2024-09-13T18:54:47.941627+0000","last_undegraded":"2024-09-13T18:54:47.941627+0000","last_fullsized":"2024-09-13T18:54:47.941627+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:11.620025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474410+0000","last_change":"2024-09-13T18:54:46.488886+0000","last_active":"2024-09-13T18:54:47.474410+0000","last_peered":"2024-09-13T18:54:47.474410+0000","last_clean":"2024-09-13T18:54:47.474410+0000","last_became_active":"2024-09-13T18:54:46.488588+0000","last_became_peered":"2024-09-13T18:54:46.488588+0000","last_unstale":"2024-09-13T18:54:47.474410+0000","last_undegraded":"2024-09-13T18:54:47.474410+0000","last_fullsized":"2024-09-13T18:54:47.474410+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:25.254017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500399+0000","last_change":"2024-09-13T18:54:46.496261+0000","last_active":"2024-09-13T18:54:46.500399+0000","last_peered":"2024-09-13T18:54:46.500399+0000","last_clean":"2024-09-13T18:54:46.500399+0000","last_became_active":"2024-09-13T18:54:46.495990+0000","last_became_peered":"2024-09-13T18:54:46.495990+0000","last_unstale":"2024-09-13T18:54:46.500399+0000","last_undegraded":"2024-09-13T18:54:46.500399+0000","last_fullsized":"2024-09-13T18:54:46.500399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:24.725559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474364+0000","last_change":"2024-09-13T18:54:46.485558+0000","last_active":"2024-09-13T18:54:47.474364+0000","last_peered":"2024-09-13T18:54:47.474364+0000","last_clean":"2024-09-13T18:54:47.474364+0000","last_became_active":"2024-09-13T18:54:46.485311+0000","last_became_peered":"2024-09-13T18:54:46.485311+0000","last_unstale":"2024-09-13T18:54:47.474364+0000","last_undegraded":"2024-09-13T18:54:47.474364+0000","last_fullsized":"2024-09-13T18:54:47.474364+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:16.142239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476304+0000","last_change":"2024-09-13T18:54:46.497800+0000","last_active":"2024-09-13T18:54:47.476304+0000","last_peered":"2024-09-13T18:54:47.476304+0000","last_clean":"2024-09-13T18:54:47.476304+0000","last_became_active":"2024-09-13T18:54:46.487906+0000","last_became_peered":"2024-09-13T18:54:46.487906+0000","last_unstale":"2024-09-13T18:54:47.476304+0000","last_undegraded":"2024-09-13T18:54:47.476304+0000","last_fullsized":"2024-09-13T18:54:47.476304+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:16.676485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499533+0000","last_change":"2024-09-13T18:54:46.491127+0000","last_active":"2024-09-13T18:54:46.499533+0000","last_peered":"2024-09-13T18:54:46.499533+0000","last_clean":"2024-09-13T18:54:46.499533+0000","last_became_active":"2024-09-13T18:54:46.490852+0000","last_became_peered":"2024-09-13T18:54:46.490852+0000","last_unstale":"2024-09-13T18:54:46.499533+0000","last_undegraded":"2024-09-13T18:54:46.499533+0000","last_fullsized":"2024-09-13T18:54:46.499533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:57.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473206+0000","last_change":"2024-09-13T18:54:46.477637+0000","last_active":"2024-09-13T18:54:47.473206+0000","last_peered":"2024-09-13T18:54:47.473206+0000","last_clean":"2024-09-13T18:54:47.473206+0000","last_became_active":"2024-09-13T18:54:46.477349+0000","last_became_peered":"2024-09-13T18:54:46.477349+0000","last_unstale":"2024-09-13T18:54:47.473206+0000","last_undegraded":"2024-09-13T18:54:47.473206+0000","last_fullsized":"2024-09-13T18:54:47.473206+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:36.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473653+0000","last_change":"2024-09-13T18:54:46.495457+0000","last_active":"2024-09-13T18:54:47.473653+0000","last_peered":"2024-09-13T18:54:47.473653+0000","last_clean":"2024-09-13T18:54:47.473653+0000","last_became_active":"2024-09-13T18:54:46.494528+0000","last_became_peered":"2024-09-13T18:54:46.494528+0000","last_unstale":"2024-09-13T18:54:47.473653+0000","last_undegraded":"2024-09-13T18:54:47.473653+0000","last_fullsized":"2024-09-13T18:54:47.473653+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:25.559722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.472983+0000","last_change":"2024-09-13T18:54:46.480293+0000","last_active":"2024-09-13T18:54:47.472983+0000","last_peered":"2024-09-13T18:54:47.472983+0000","last_clean":"2024-09-13T18:54:47.472983+0000","last_became_active":"2024-09-13T18:54:46.477957+0000","last_became_peered":"2024-09-13T18:54:46.477957+0000","last_unstale":"2024-09-13T18:54:47.472983+0000","last_undegraded":"2024-09-13T18:54:47.472983+0000","last_fullsized":"2024-09-13T18:54:47.472983+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.266107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476384+0000","last_change":"2024-09-13T18:54:46.499327+0000","last_active":"2024-09-13T18:54:47.476384+0000","last_peered":"2024-09-13T18:54:47.476384+0000","last_clean":"2024-09-13T18:54:47.476384+0000","last_became_active":"2024-09-13T18:54:46.495549+0000","last_became_peered":"2024-09-13T18:54:46.495549+0000","last_unstale":"2024-09-13T18:54:47.476384+0000","last_undegraded":"2024-09-13T18:54:47.476384+0000","last_fullsized":"2024-09-13T18:54:47.476384+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:44.935877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476295+0000","last_change":"2024-09-13T18:54:46.501248+0000","last_active":"2024-09-13T18:54:47.476295+0000","last_peered":"2024-09-13T18:54:47.476295+0000","last_clean":"2024-09-13T18:54:47.476295+0000","last_became_active":"2024-09-13T18:54:46.500996+0000","last_became_peered":"2024-09-13T18:54:46.500996+0000","last_unstale":"2024-09-13T18:54:47.476295+0000","last_undegraded":"2024-09-13T18:54:47.476295+0000","last_fullsized":"2024-09-13T18:54:47.476295+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:36.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.491615+0000","last_change":"2024-09-13T18:54:46.486973+0000","last_active":"2024-09-13T18:54:46.491615+0000","last_peered":"2024-09-13T18:54:46.491615+0000","last_clean":"2024-09-13T18:54:46.491615+0000","last_became_active":"2024-09-13T18:54:46.484826+0000","last_became_peered":"2024-09-13T18:54:46.484826+0000","last_unstale":"2024-09-13T18:54:46.491615+0000","last_undegraded":"2024-09-13T18:54:46.491615+0000","last_fullsized":"2024-09-13T18:54:46.491615+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.951197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500148+0000","last_change":"2024-09-13T18:54:46.493947+0000","last_active":"2024-09-13T18:54:46.500148+0000","last_peered":"2024-09-13T18:54:46.500148+0000","last_clean":"2024-09-13T18:54:46.500148+0000","last_became_active":"2024-09-13T18:54:46.493718+0000","last_became_peered":"2024-09-13T18:54:46.493718+0000","last_unstale":"2024-09-13T18:54:46.500148+0000","last_undegraded":"2024-09-13T18:54:46.500148+0000","last_fullsized":"2024-09-13T18:54:46.500148+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:04.416730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499514+0000","last_change":"2024-09-13T18:54:46.491038+0000","last_active":"2024-09-13T18:54:46.499514+0000","last_peered":"2024-09-13T18:54:46.499514+0000","last_clean":"2024-09-13T18:54:46.499514+0000","last_became_active":"2024-09-13T18:54:46.490654+0000","last_became_peered":"2024-09-13T18:54:46.490654+0000","last_unstale":"2024-09-13T18:54:46.499514+0000","last_undegraded":"2024-09-13T18:54:46.499514+0000","last_fullsized":"2024-09-13T18:54:46.499514+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:35.623920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475927+0000","last_change":"2024-09-13T18:54:46.497429+0000","last_active":"2024-09-13T18:54:47.475927+0000","last_peered":"2024-09-13T18:54:47.475927+0000","last_clean":"2024-09-13T18:54:47.475927+0000","last_became_active":"2024-09-13T18:54:46.497017+0000","last_became_peered":"2024-09-13T18:54:46.497017+0000","last_unstale":"2024-09-13T18:54:47.475927+0000","last_undegraded":"2024-09-13T18:54:47.475927+0000","last_fullsized":"2024-09-13T18:54:47.475927+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.228277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499089+0000","last_change":"2024-09-13T18:54:46.489285+0000","last_active":"2024-09-13T18:54:46.499089+0000","last_peered":"2024-09-13T18:54:46.499089+0000","last_clean":"2024-09-13T18:54:46.499089+0000","last_became_active":"2024-09-13T18:54:46.486364+0000","last_became_peered":"2024-09-13T18:54:46.486364+0000","last_unstale":"2024-09-13T18:54:46.499089+0000","last_undegraded":"2024-09-13T18:54:46.499089+0000","last_fullsized":"2024-09-13T18:54:46.499089+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:36.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498885+0000","last_change":"2024-09-13T18:54:46.489331+0000","last_active":"2024-09-13T18:54:46.498885+0000","last_peered":"2024-09-13T18:54:46.498885+0000","last_clean":"2024-09-13T18:54:46.498885+0000","last_became_active":"2024-09-13T18:54:46.489092+0000","last_became_peered":"2024-09-13T18:54:46.489092+0000","last_unstale":"2024-09-13T18:54:46.498885+0000","last_undegraded":"2024-09-13T18:54:46.498885+0000","last_fullsized":"2024-09-13T18:54:46.498885+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:37.168399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473795+0000","last_change":"2024-09-13T18:54:46.485800+0000","last_active":"2024-09-13T18:54:47.473795+0000","last_peered":"2024-09-13T18:54:47.473795+0000","last_clean":"2024-09-13T18:54:47.473795+0000","last_became_active":"2024-09-13T18:54:46.485529+0000","last_became_peered":"2024-09-13T18:54:46.485529+0000","last_unstale":"2024-09-13T18:54:47.473795+0000","last_undegraded":"2024-09-13T18:54:47.473795+0000","last_fullsized":"2024-09-13T18:54:47.473795+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:09.713149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.495294+0000","last_change":"2024-09-13T18:54:46.016839+0000","last_active":"2024-09-13T18:54:46.495294+0000","last_peered":"2024-09-13T18:54:46.495294+0000","last_clean":"2024-09-13T18:54:46.495294+0000","last_became_active":"2024-09-13T18:54:46.016585+0000","last_became_peered":"2024-09-13T18:54:46.016585+0000","last_unstale":"2024-09-13T18:54:46.495294+0000","last_undegraded":"2024-09-13T18:54:46.495294+0000","last_fullsized":"2024-09-13T18:54:46.495294+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:27.250068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499347+0000","last_change":"2024-09-13T18:54:46.490305+0000","last_active":"2024-09-13T18:54:46.499347+0000","last_peered":"2024-09-13T18:54:46.499347+0000","last_clean":"2024-09-13T18:54:46.499347+0000","last_became_active":"2024-09-13T18:54:46.490093+0000","last_became_peered":"2024-09-13T18:54:46.490093+0000","last_unstale":"2024-09-13T18:54:46.499347+0000","last_undegraded":"2024-09-13T18:54:46.499347+0000","last_fullsized":"2024-09-13T18:54:46.499347+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:14.967944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498636+0000","last_change":"2024-09-13T18:54:46.019512+0000","last_active":"2024-09-13T18:54:46.498636+0000","last_peered":"2024-09-13T18:54:46.498636+0000","last_clean":"2024-09-13T18:54:46.498636+0000","last_became_active":"2024-09-13T18:54:46.019228+0000","last_became_peered":"2024-09-13T18:54:46.019228+0000","last_unstale":"2024-09-13T18:54:46.498636+0000","last_undegraded":"2024-09-13T18:54:46.498636+0000","last_fullsized":"2024-09-13T18:54:46.498636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:16.392734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476170+0000","last_change":"2024-09-13T18:54:46.501601+0000","last_active":"2024-09-13T18:54:47.476170+0000","last_peered":"2024-09-13T18:54:47.476170+0000","last_clean":"2024-09-13T18:54:47.476170+0000","last_became_active":"2024-09-13T18:54:46.501339+0000","last_became_peered":"2024-09-13T18:54:46.501339+0000","last_unstale":"2024-09-13T18:54:47.476170+0000","last_undegraded":"2024-09-13T18:54:47.476170+0000","last_fullsized":"2024-09-13T18:54:47.476170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476236+0000","last_change":"2024-09-13T18:54:46.015831+0000","last_active":"2024-09-13T18:54:47.476236+0000","last_peered":"2024-09-13T18:54:47.476236+0000","last_clean":"2024-09-13T18:54:47.476236+0000","last_became_active":"2024-09-13T18:54:46.015508+0000","last_became_peered":"2024-09-13T18:54:46.015508+0000","last_unstale":"2024-09-13T18:54:47.476236+0000","last_undegraded":"2024-09-13T18:54:47.476236+0000","last_fullsized":"2024-09-13T18:54:47.476236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:39.595023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.506041+0000","last_change":"2024-09-13T18:54:46.504572+0000","last_active":"2024-09-13T18:54:46.506041+0000","last_peered":"2024-09-13T18:54:46.506041+0000","last_clean":"2024-09-13T18:54:46.506041+0000","last_became_active":"2024-09-13T18:54:46.504183+0000","last_became_peered":"2024-09-13T18:54:46.504183+0000","last_unstale":"2024-09-13T18:54:46.506041+0000","last_undegraded":"2024-09-13T18:54:46.506041+0000","last_fullsized":"2024-09-13T18:54:46.506041+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:41.252117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473508+0000","last_change":"2024-09-13T18:54:46.007830+0000","last_active":"2024-09-13T18:54:47.473508+0000","last_peered":"2024-09-13T18:54:47.473508+0000","last_clean":"2024-09-13T18:54:47.473508+0000","last_became_active":"2024-09-13T18:54:46.007591+0000","last_became_peered":"2024-09-13T18:54:46.007591+0000","last_unstale":"2024-09-13T18:54:47.473508+0000","last_undegraded":"2024-09-13T18:54:47.473508+0000","last_fullsized":"2024-09-13T18:54:47.473508+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:14.796834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.487962+0000","last_change":"2024-09-13T18:54:46.484191+0000","last_active":"2024-09-13T18:54:46.487962+0000","last_peered":"2024-09-13T18:54:46.487962+0000","last_clean":"2024-09-13T18:54:46.487962+0000","last_became_active":"2024-09-13T18:54:46.483958+0000","last_became_peered":"2024-09-13T18:54:46.483958+0000","last_unstale":"2024-09-13T18:54:46.487962+0000","last_undegraded":"2024-09-13T18:54:46.487962+0000","last_fullsized":"2024-09-13T18:54:46.487962+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:27.604715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"106'1","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941972+0000","last_change":"2024-09-13T18:54:46.015493+0000","last_active":"2024-09-13T18:54:47.941972+0000","last_peered":"2024-09-13T18:54:47.941972+0000","last_clean":"2024-09-13T18:54:47.941972+0000","last_became_active":"2024-09-13T18:54:46.015244+0000","last_became_peered":"2024-09-13T18:54:46.015244+0000","last_unstale":"2024-09-13T18:54:47.941972+0000","last_undegraded":"2024-09-13T18:54:47.941972+0000","last_fullsized":"2024-09-13T18:54:47.941972+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:35.668467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474327+0000","last_change":"2024-09-13T18:54:46.485136+0000","last_active":"2024-09-13T18:54:47.474327+0000","last_peered":"2024-09-13T18:54:47.474327+0000","last_clean":"2024-09-13T18:54:47.474327+0000","last_became_active":"2024-09-13T18:54:46.484455+0000","last_became_peered":"2024-09-13T18:54:46.484455+0000","last_unstale":"2024-09-13T18:54:47.474327+0000","last_undegraded":"2024-09-13T18:54:47.474327+0000","last_fullsized":"2024-09-13T18:54:47.474327+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:38.105928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.503458+0000","last_change":"2024-09-13T18:54:46.023159+0000","last_active":"2024-09-13T18:54:46.503458+0000","last_peered":"2024-09-13T18:54:46.503458+0000","last_clean":"2024-09-13T18:54:46.503458+0000","last_became_active":"2024-09-13T18:54:46.022847+0000","last_became_peered":"2024-09-13T18:54:46.022847+0000","last_unstale":"2024-09-13T18:54:46.503458+0000","last_undegraded":"2024-09-13T18:54:46.503458+0000","last_fullsized":"2024-09-13T18:54:46.503458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:43.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498940+0000","last_change":"2024-09-13T18:54:46.491848+0000","last_active":"2024-09-13T18:54:46.498940+0000","last_peered":"2024-09-13T18:54:46.498940+0000","last_clean":"2024-09-13T18:54:46.498940+0000","last_became_active":"2024-09-13T18:54:46.491521+0000","last_became_peered":"2024-09-13T18:54:46.491521+0000","last_unstale":"2024-09-13T18:54:46.498940+0000","last_undegraded":"2024-09-13T18:54:46.498940+0000","last_fullsized":"2024-09-13T18:54:46.498940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:53.567211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475823+0000","last_change":"2024-09-13T18:54:46.024025+0000","last_active":"2024-09-13T18:54:47.475823+0000","last_peered":"2024-09-13T18:54:47.475823+0000","last_clean":"2024-09-13T18:54:47.475823+0000","last_became_active":"2024-09-13T18:54:46.023771+0000","last_became_peered":"2024-09-13T18:54:46.023771+0000","last_unstale":"2024-09-13T18:54:47.475823+0000","last_undegraded":"2024-09-13T18:54:47.475823+0000","last_fullsized":"2024-09-13T18:54:47.475823+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:50.756834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.478609+0000","last_change":"2024-09-13T18:54:46.476401+0000","last_active":"2024-09-13T18:54:46.478609+0000","last_peered":"2024-09-13T18:54:46.478609+0000","last_clean":"2024-09-13T18:54:46.478609+0000","last_became_active":"2024-09-13T18:54:46.476157+0000","last_became_peered":"2024-09-13T18:54:46.476157+0000","last_unstale":"2024-09-13T18:54:46.478609+0000","last_undegraded":"2024-09-13T18:54:46.478609+0000","last_fullsized":"2024-09-13T18:54:46.478609+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:30.677709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.466485+0000","last_change":"2024-09-13T18:54:46.013107+0000","last_active":"2024-09-13T18:54:46.466485+0000","last_peered":"2024-09-13T18:54:46.466485+0000","last_clean":"2024-09-13T18:54:46.466485+0000","last_became_active":"2024-09-13T18:54:46.012814+0000","last_became_peered":"2024-09-13T18:54:46.012814+0000","last_unstale":"2024-09-13T18:54:46.466485+0000","last_undegraded":"2024-09-13T18:54:46.466485+0000","last_fullsized":"2024-09-13T18:54:46.466485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:08.920659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473669+0000","last_change":"2024-09-13T18:54:46.491407+0000","last_active":"2024-09-13T18:54:47.473669+0000","last_peered":"2024-09-13T18:54:47.473669+0000","last_clean":"2024-09-13T18:54:47.473669+0000","last_became_active":"2024-09-13T18:54:46.491163+0000","last_became_peered":"2024-09-13T18:54:46.491163+0000","last_unstale":"2024-09-13T18:54:47.473669+0000","last_undegraded":"2024-09-13T18:54:47.473669+0000","last_fullsized":"2024-09-13T18:54:47.473669+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:00.843001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476346+0000","last_change":"2024-09-13T18:54:46.015851+0000","last_active":"2024-09-13T18:54:47.476346+0000","last_peered":"2024-09-13T18:54:47.476346+0000","last_clean":"2024-09-13T18:54:47.476346+0000","last_became_active":"2024-09-13T18:54:46.015523+0000","last_became_peered":"2024-09-13T18:54:46.015523+0000","last_unstale":"2024-09-13T18:54:47.476346+0000","last_undegraded":"2024-09-13T18:54:47.476346+0000","last_fullsized":"2024-09-13T18:54:47.476346+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:14.796834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473156+0000","last_change":"2024-09-13T18:54:46.491769+0000","last_active":"2024-09-13T18:54:47.473156+0000","last_peered":"2024-09-13T18:54:47.473156+0000","last_clean":"2024-09-13T18:54:47.473156+0000","last_became_active":"2024-09-13T18:54:46.488044+0000","last_became_peered":"2024-09-13T18:54:46.488044+0000","last_unstale":"2024-09-13T18:54:47.473156+0000","last_undegraded":"2024-09-13T18:54:47.473156+0000","last_fullsized":"2024-09-13T18:54:47.473156+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474273+0000","last_change":"2024-09-13T18:54:46.009532+0000","last_active":"2024-09-13T18:54:47.474273+0000","last_peered":"2024-09-13T18:54:47.474273+0000","last_clean":"2024-09-13T18:54:47.474273+0000","last_became_active":"2024-09-13T18:54:46.009276+0000","last_became_peered":"2024-09-13T18:54:46.009276+0000","last_unstale":"2024-09-13T18:54:47.474273+0000","last_undegraded":"2024-09-13T18:54:47.474273+0000","last_fullsized":"2024-09-13T18:54:47.474273+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:29.997172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499413+0000","last_change":"2024-09-13T18:54:46.490813+0000","last_active":"2024-09-13T18:54:46.499413+0000","last_peered":"2024-09-13T18:54:46.499413+0000","last_clean":"2024-09-13T18:54:46.499413+0000","last_became_active":"2024-09-13T18:54:46.490550+0000","last_became_peered":"2024-09-13T18:54:46.490550+0000","last_unstale":"2024-09-13T18:54:46.499413+0000","last_undegraded":"2024-09-13T18:54:46.499413+0000","last_fullsized":"2024-09-13T18:54:46.499413+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:53.501930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"106'3","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.942015+0000","last_change":"2024-09-13T18:54:46.014826+0000","last_active":"2024-09-13T18:54:47.942015+0000","last_peered":"2024-09-13T18:54:47.942015+0000","last_clean":"2024-09-13T18:54:47.942015+0000","last_became_active":"2024-09-13T18:54:46.014332+0000","last_became_peered":"2024-09-13T18:54:46.014332+0000","last_unstale":"2024-09-13T18:54:47.942015+0000","last_undegraded":"2024-09-13T18:54:47.942015+0000","last_fullsized":"2024-09-13T18:54:47.942015+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:24.652058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473283+0000","last_change":"2024-09-13T18:54:46.489066+0000","last_active":"2024-09-13T18:54:47.473283+0000","last_peered":"2024-09-13T18:54:47.473283+0000","last_clean":"2024-09-13T18:54:47.473283+0000","last_became_active":"2024-09-13T18:54:46.488607+0000","last_became_peered":"2024-09-13T18:54:46.488607+0000","last_unstale":"2024-09-13T18:54:47.473283+0000","last_undegraded":"2024-09-13T18:54:47.473283+0000","last_fullsized":"2024-09-13T18:54:47.473283+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:16.676485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"106'6","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.505765+0000","last_change":"2024-09-13T18:54:46.017537+0000","last_active":"2024-09-13T18:54:46.505765+0000","last_peered":"2024-09-13T18:54:46.505765+0000","last_clean":"2024-09-13T18:54:46.505765+0000","last_became_active":"2024-09-13T18:54:46.017267+0000","last_became_peered":"2024-09-13T18:54:46.017267+0000","last_unstale":"2024-09-13T18:54:46.505765+0000","last_undegraded":"2024-09-13T18:54:46.505765+0000","last_fullsized":"2024-09-13T18:54:46.505765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:21.994921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.505034+0000","last_change":"2024-09-13T18:54:46.496287+0000","last_active":"2024-09-13T18:54:46.505034+0000","last_peered":"2024-09-13T18:54:46.505034+0000","last_clean":"2024-09-13T18:54:46.505034+0000","last_became_active":"2024-09-13T18:54:46.496031+0000","last_became_peered":"2024-09-13T18:54:46.496031+0000","last_unstale":"2024-09-13T18:54:46.505034+0000","last_undegraded":"2024-09-13T18:54:46.505034+0000","last_fullsized":"2024-09-13T18:54:46.505034+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:46.283120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473384+0000","last_change":"2024-09-13T18:54:46.017174+0000","last_active":"2024-09-13T18:54:47.473384+0000","last_peered":"2024-09-13T18:54:47.473384+0000","last_clean":"2024-09-13T18:54:47.473384+0000","last_became_active":"2024-09-13T18:54:46.016926+0000","last_became_peered":"2024-09-13T18:54:46.016926+0000","last_unstale":"2024-09-13T18:54:47.473384+0000","last_undegraded":"2024-09-13T18:54:47.473384+0000","last_fullsized":"2024-09-13T18:54:47.473384+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:10.603986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498848+0000","last_change":"2024-09-13T18:54:46.486687+0000","last_active":"2024-09-13T18:54:46.498848+0000","last_peered":"2024-09-13T18:54:46.498848+0000","last_clean":"2024-09-13T18:54:46.498848+0000","last_became_active":"2024-09-13T18:54:46.486303+0000","last_became_peered":"2024-09-13T18:54:46.486303+0000","last_unstale":"2024-09-13T18:54:46.498848+0000","last_undegraded":"2024-09-13T18:54:46.498848+0000","last_fullsized":"2024-09-13T18:54:46.498848+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.266107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.466831+0000","last_change":"2024-09-13T18:54:46.020838+0000","last_active":"2024-09-13T18:54:46.466831+0000","last_peered":"2024-09-13T18:54:46.466831+0000","last_clean":"2024-09-13T18:54:46.466831+0000","last_became_active":"2024-09-13T18:54:46.020595+0000","last_became_peered":"2024-09-13T18:54:46.020595+0000","last_unstale":"2024-09-13T18:54:46.466831+0000","last_undegraded":"2024-09-13T18:54:46.466831+0000","last_fullsized":"2024-09-13T18:54:46.466831+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:15.660445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499695+0000","last_change":"2024-09-13T18:54:46.493801+0000","last_active":"2024-09-13T18:54:46.499695+0000","last_peered":"2024-09-13T18:54:46.499695+0000","last_clean":"2024-09-13T18:54:46.499695+0000","last_became_active":"2024-09-13T18:54:46.493449+0000","last_became_peered":"2024-09-13T18:54:46.493449+0000","last_unstale":"2024-09-13T18:54:46.499695+0000","last_undegraded":"2024-09-13T18:54:46.499695+0000","last_fullsized":"2024-09-13T18:54:46.499695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:45.900463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480298+0000","last_change":"2024-09-13T18:54:46.017479+0000","last_active":"2024-09-13T18:54:46.480298+0000","last_peered":"2024-09-13T18:54:46.480298+0000","last_clean":"2024-09-13T18:54:46.480298+0000","last_became_active":"2024-09-13T18:54:46.017227+0000","last_became_peered":"2024-09-13T18:54:46.017227+0000","last_unstale":"2024-09-13T18:54:46.480298+0000","last_undegraded":"2024-09-13T18:54:46.480298+0000","last_fullsized":"2024-09-13T18:54:46.480298+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.339566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474451+0000","last_change":"2024-09-13T18:54:46.485546+0000","last_active":"2024-09-13T18:54:47.474451+0000","last_peered":"2024-09-13T18:54:47.474451+0000","last_clean":"2024-09-13T18:54:47.474451+0000","last_became_active":"2024-09-13T18:54:46.485155+0000","last_became_peered":"2024-09-13T18:54:46.485155+0000","last_unstale":"2024-09-13T18:54:47.474451+0000","last_undegraded":"2024-09-13T18:54:47.474451+0000","last_fullsized":"2024-09-13T18:54:47.474451+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:03.225646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"106'8","reported_seq":19,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475895+0000","last_change":"2024-09-13T18:54:46.016627+0000","last_active":"2024-09-13T18:54:47.475895+0000","last_peered":"2024-09-13T18:54:47.475895+0000","last_clean":"2024-09-13T18:54:47.475895+0000","last_became_active":"2024-09-13T18:54:46.016363+0000","last_became_peered":"2024-09-13T18:54:46.016363+0000","last_unstale":"2024-09-13T18:54:47.475895+0000","last_undegraded":"2024-09-13T18:54:47.475895+0000","last_fullsized":"2024-09-13T18:54:47.475895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:37.935157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.495159+0000","last_change":"2024-09-13T18:54:46.484224+0000","last_active":"2024-09-13T18:54:46.495159+0000","last_peered":"2024-09-13T18:54:46.495159+0000","last_clean":"2024-09-13T18:54:46.495159+0000","last_became_active":"2024-09-13T18:54:46.483983+0000","last_became_peered":"2024-09-13T18:54:46.483983+0000","last_unstale":"2024-09-13T18:54:46.495159+0000","last_undegraded":"2024-09-13T18:54:46.495159+0000","last_fullsized":"2024-09-13T18:54:46.495159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:43.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.505817+0000","last_change":"2024-09-13T18:54:46.017600+0000","last_active":"2024-09-13T18:54:46.505817+0000","last_peered":"2024-09-13T18:54:46.505817+0000","last_clean":"2024-09-13T18:54:46.505817+0000","last_became_active":"2024-09-13T18:54:46.017359+0000","last_became_peered":"2024-09-13T18:54:46.017359+0000","last_unstale":"2024-09-13T18:54:46.505817+0000","last_undegraded":"2024-09-13T18:54:46.505817+0000","last_fullsized":"2024-09-13T18:54:46.505817+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:03.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498838+0000","last_change":"2024-09-13T18:54:46.485767+0000","last_active":"2024-09-13T18:54:46.498838+0000","last_peered":"2024-09-13T18:54:46.498838+0000","last_clean":"2024-09-13T18:54:46.498838+0000","last_became_active":"2024-09-13T18:54:46.485442+0000","last_became_peered":"2024-09-13T18:54:46.485442+0000","last_unstale":"2024-09-13T18:54:46.498838+0000","last_undegraded":"2024-09-13T18:54:46.498838+0000","last_fullsized":"2024-09-13T18:54:46.498838+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.228277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"106'1","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.942064+0000","last_change":"2024-09-13T18:54:46.016073+0000","last_active":"2024-09-13T18:54:47.942064+0000","last_peered":"2024-09-13T18:54:47.942064+0000","last_clean":"2024-09-13T18:54:47.942064+0000","last_became_active":"2024-09-13T18:54:46.015822+0000","last_became_peered":"2024-09-13T18:54:46.015822+0000","last_unstale":"2024-09-13T18:54:47.942064+0000","last_undegraded":"2024-09-13T18:54:47.942064+0000","last_fullsized":"2024-09-13T18:54:47.942064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:25.890980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473199+0000","last_change":"2024-09-13T18:54:46.489083+0000","last_active":"2024-09-13T18:54:47.473199+0000","last_peered":"2024-09-13T18:54:47.473199+0000","last_clean":"2024-09-13T18:54:47.473199+0000","last_became_active":"2024-09-13T18:54:46.488779+0000","last_became_peered":"2024-09-13T18:54:46.488779+0000","last_unstale":"2024-09-13T18:54:47.473199+0000","last_undegraded":"2024-09-13T18:54:47.473199+0000","last_fullsized":"2024-09-13T18:54:47.473199+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:22.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.478977+0000","last_change":"2024-09-13T18:54:46.021219+0000","last_active":"2024-09-13T18:54:46.478977+0000","last_peered":"2024-09-13T18:54:46.478977+0000","last_clean":"2024-09-13T18:54:46.478977+0000","last_became_active":"2024-09-13T18:54:46.020947+0000","last_became_peered":"2024-09-13T18:54:46.020947+0000","last_unstale":"2024-09-13T18:54:46.478977+0000","last_undegraded":"2024-09-13T18:54:46.478977+0000","last_fullsized":"2024-09-13T18:54:46.478977+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:08.148893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474124+0000","last_change":"2024-09-13T18:54:46.476783+0000","last_active":"2024-09-13T18:54:47.474124+0000","last_peered":"2024-09-13T18:54:47.474124+0000","last_clean":"2024-09-13T18:54:47.474124+0000","last_became_active":"2024-09-13T18:54:46.476558+0000","last_became_peered":"2024-09-13T18:54:46.476558+0000","last_unstale":"2024-09-13T18:54:47.474124+0000","last_undegraded":"2024-09-13T18:54:47.474124+0000","last_fullsized":"2024-09-13T18:54:47.474124+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:54.784220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499678+0000","last_change":"2024-09-13T18:54:46.018897+0000","last_active":"2024-09-13T18:54:46.499678+0000","last_peered":"2024-09-13T18:54:46.499678+0000","last_clean":"2024-09-13T18:54:46.499678+0000","last_became_active":"2024-09-13T18:54:46.018649+0000","last_became_peered":"2024-09-13T18:54:46.018649+0000","last_unstale":"2024-09-13T18:54:46.499678+0000","last_undegraded":"2024-09-13T18:54:46.499678+0000","last_fullsized":"2024-09-13T18:54:46.499678+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:08.144872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474232+0000","last_change":"2024-09-13T18:54:46.486325+0000","last_active":"2024-09-13T18:54:47.474232+0000","last_peered":"2024-09-13T18:54:47.474232+0000","last_clean":"2024-09-13T18:54:47.474232+0000","last_became_active":"2024-09-13T18:54:46.486092+0000","last_became_peered":"2024-09-13T18:54:46.486092+0000","last_unstale":"2024-09-13T18:54:47.474232+0000","last_undegraded":"2024-09-13T18:54:47.474232+0000","last_fullsized":"2024-09-13T18:54:47.474232+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:19.733736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480173+0000","last_change":"2024-09-13T18:54:46.016317+0000","last_active":"2024-09-13T18:54:46.480173+0000","last_peered":"2024-09-13T18:54:46.480173+0000","last_clean":"2024-09-13T18:54:46.480173+0000","last_became_active":"2024-09-13T18:54:46.015594+0000","last_became_peered":"2024-09-13T18:54:46.015594+0000","last_unstale":"2024-09-13T18:54:46.480173+0000","last_undegraded":"2024-09-13T18:54:46.480173+0000","last_fullsized":"2024-09-13T18:54:46.480173+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:19.380206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.495874+0000","last_change":"2024-09-13T18:54:46.494314+0000","last_active":"2024-09-13T18:54:46.495874+0000","last_peered":"2024-09-13T18:54:46.495874+0000","last_clean":"2024-09-13T18:54:46.495874+0000","last_became_active":"2024-09-13T18:54:46.493957+0000","last_became_peered":"2024-09-13T18:54:46.493957+0000","last_unstale":"2024-09-13T18:54:46.495874+0000","last_undegraded":"2024-09-13T18:54:46.495874+0000","last_fullsized":"2024-09-13T18:54:46.495874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:41.984213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.481473+0000","last_change":"2024-09-13T18:54:46.013735+0000","last_active":"2024-09-13T18:54:46.481473+0000","last_peered":"2024-09-13T18:54:46.481473+0000","last_clean":"2024-09-13T18:54:46.481473+0000","last_became_active":"2024-09-13T18:54:46.013439+0000","last_became_peered":"2024-09-13T18:54:46.013439+0000","last_unstale":"2024-09-13T18:54:46.481473+0000","last_undegraded":"2024-09-13T18:54:46.481473+0000","last_fullsized":"2024-09-13T18:54:46.481473+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:14.796834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499223+0000","last_change":"2024-09-13T18:54:46.489834+0000","last_active":"2024-09-13T18:54:46.499223+0000","last_peered":"2024-09-13T18:54:46.499223+0000","last_clean":"2024-09-13T18:54:46.499223+0000","last_became_active":"2024-09-13T18:54:46.489597+0000","last_became_peered":"2024-09-13T18:54:46.489597+0000","last_unstale":"2024-09-13T18:54:46.499223+0000","last_undegraded":"2024-09-13T18:54:46.499223+0000","last_fullsized":"2024-09-13T18:54:46.499223+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480774+0000","last_change":"2024-09-13T18:54:46.019010+0000","last_active":"2024-09-13T18:54:46.480774+0000","last_peered":"2024-09-13T18:54:46.480774+0000","last_clean":"2024-09-13T18:54:46.480774+0000","last_became_active":"2024-09-13T18:54:46.018813+0000","last_became_peered":"2024-09-13T18:54:46.018813+0000","last_unstale":"2024-09-13T18:54:46.480774+0000","last_undegraded":"2024-09-13T18:54:46.480774+0000","last_fullsized":"2024-09-13T18:54:46.480774+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:47.254008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473538+0000","last_change":"2024-09-13T18:54:46.480110+0000","last_active":"2024-09-13T18:54:47.473538+0000","last_peered":"2024-09-13T18:54:47.473538+0000","last_clean":"2024-09-13T18:54:47.473538+0000","last_became_active":"2024-09-13T18:54:46.479831+0000","last_became_peered":"2024-09-13T18:54:46.479831+0000","last_unstale":"2024-09-13T18:54:47.473538+0000","last_undegraded":"2024-09-13T18:54:47.473538+0000","last_fullsized":"2024-09-13T18:54:47.473538+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:15.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473812+0000","last_change":"2024-09-13T18:54:46.018617+0000","last_active":"2024-09-13T18:54:47.473812+0000","last_peered":"2024-09-13T18:54:47.473812+0000","last_clean":"2024-09-13T18:54:47.473812+0000","last_became_active":"2024-09-13T18:54:46.018396+0000","last_became_peered":"2024-09-13T18:54:46.018396+0000","last_unstale":"2024-09-13T18:54:47.473812+0000","last_undegraded":"2024-09-13T18:54:47.473812+0000","last_fullsized":"2024-09-13T18:54:47.473812+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:03.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475803+0000","last_change":"2024-09-13T18:54:46.487610+0000","last_active":"2024-09-13T18:54:47.475803+0000","last_peered":"2024-09-13T18:54:47.475803+0000","last_clean":"2024-09-13T18:54:47.475803+0000","last_became_active":"2024-09-13T18:54:46.486314+0000","last_became_peered":"2024-09-13T18:54:46.486314+0000","last_unstale":"2024-09-13T18:54:47.475803+0000","last_undegraded":"2024-09-13T18:54:47.475803+0000","last_fullsized":"2024-09-13T18:54:47.475803+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:17.875596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474317+0000","last_change":"2024-09-13T18:54:46.015372+0000","last_active":"2024-09-13T18:54:47.474317+0000","last_peered":"2024-09-13T18:54:47.474317+0000","last_clean":"2024-09-13T18:54:47.474317+0000","last_became_active":"2024-09-13T18:54:46.015074+0000","last_became_peered":"2024-09-13T18:54:46.015074+0000","last_unstale":"2024-09-13T18:54:47.474317+0000","last_undegraded":"2024-09-13T18:54:47.474317+0000","last_fullsized":"2024-09-13T18:54:47.474317+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:56.002491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.489170+0000","last_change":"2024-09-13T18:54:46.485212+0000","last_active":"2024-09-13T18:54:46.489170+0000","last_peered":"2024-09-13T18:54:46.489170+0000","last_clean":"2024-09-13T18:54:46.489170+0000","last_became_active":"2024-09-13T18:54:46.484958+0000","last_became_peered":"2024-09-13T18:54:46.484958+0000","last_unstale":"2024-09-13T18:54:46.489170+0000","last_undegraded":"2024-09-13T18:54:46.489170+0000","last_fullsized":"2024-09-13T18:54:46.489170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:43.168461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.481327+0000","last_change":"2024-09-13T18:54:46.013306+0000","last_active":"2024-09-13T18:54:46.481327+0000","last_peered":"2024-09-13T18:54:46.481327+0000","last_clean":"2024-09-13T18:54:46.481327+0000","last_became_active":"2024-09-13T18:54:46.013047+0000","last_became_peered":"2024-09-13T18:54:46.013047+0000","last_unstale":"2024-09-13T18:54:46.481327+0000","last_undegraded":"2024-09-13T18:54:46.481327+0000","last_fullsized":"2024-09-13T18:54:46.481327+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:30.359614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.489494+0000","last_change":"2024-09-13T18:54:46.488853+0000","last_active":"2024-09-13T18:54:46.489494+0000","last_peered":"2024-09-13T18:54:46.489494+0000","last_clean":"2024-09-13T18:54:46.489494+0000","last_became_active":"2024-09-13T18:54:46.488560+0000","last_became_peered":"2024-09-13T18:54:46.488560+0000","last_unstale":"2024-09-13T18:54:46.489494+0000","last_undegraded":"2024-09-13T18:54:46.489494+0000","last_fullsized":"2024-09-13T18:54:46.489494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:50.250247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473616+0000","last_change":"2024-09-13T18:54:46.018087+0000","last_active":"2024-09-13T18:54:47.473616+0000","last_peered":"2024-09-13T18:54:47.473616+0000","last_clean":"2024-09-13T18:54:47.473616+0000","last_became_active":"2024-09-13T18:54:46.017843+0000","last_became_peered":"2024-09-13T18:54:46.017843+0000","last_unstale":"2024-09-13T18:54:47.473616+0000","last_undegraded":"2024-09-13T18:54:47.473616+0000","last_fullsized":"2024-09-13T18:54:47.473616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:30.359614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499640+0000","last_change":"2024-09-13T18:54:46.492606+0000","last_active":"2024-09-13T18:54:46.499640+0000","last_peered":"2024-09-13T18:54:46.499640+0000","last_clean":"2024-09-13T18:54:46.499640+0000","last_became_active":"2024-09-13T18:54:46.492364+0000","last_became_peered":"2024-09-13T18:54:46.492364+0000","last_unstale":"2024-09-13T18:54:46.499640+0000","last_undegraded":"2024-09-13T18:54:46.499640+0000","last_fullsized":"2024-09-13T18:54:46.499640+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:30.414147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476302+0000","last_change":"2024-09-13T18:54:46.019402+0000","last_active":"2024-09-13T18:54:47.476302+0000","last_peered":"2024-09-13T18:54:47.476302+0000","last_clean":"2024-09-13T18:54:47.476302+0000","last_became_active":"2024-09-13T18:54:46.018265+0000","last_became_peered":"2024-09-13T18:54:46.018265+0000","last_unstale":"2024-09-13T18:54:47.476302+0000","last_undegraded":"2024-09-13T18:54:47.476302+0000","last_fullsized":"2024-09-13T18:54:47.476302+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:40.236078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499288+0000","last_change":"2024-09-13T18:54:46.489848+0000","last_active":"2024-09-13T18:54:46.499288+0000","last_peered":"2024-09-13T18:54:46.499288+0000","last_clean":"2024-09-13T18:54:46.499288+0000","last_became_active":"2024-09-13T18:54:46.489626+0000","last_became_peered":"2024-09-13T18:54:46.489626+0000","last_unstale":"2024-09-13T18:54:46.499288+0000","last_undegraded":"2024-09-13T18:54:46.499288+0000","last_fullsized":"2024-09-13T18:54:46.499288+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:40.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480468+0000","last_change":"2024-09-13T18:54:46.015435+0000","last_active":"2024-09-13T18:54:46.480468+0000","last_peered":"2024-09-13T18:54:46.480468+0000","last_clean":"2024-09-13T18:54:46.480468+0000","last_became_active":"2024-09-13T18:54:46.015197+0000","last_became_peered":"2024-09-13T18:54:46.015197+0000","last_unstale":"2024-09-13T18:54:46.480468+0000","last_undegraded":"2024-09-13T18:54:46.480468+0000","last_fullsized":"2024-09-13T18:54:46.480468+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:36.483667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.942278+0000","last_change":"2024-09-13T18:54:46.489077+0000","last_active":"2024-09-13T18:54:47.942278+0000","last_peered":"2024-09-13T18:54:47.942278+0000","last_clean":"2024-09-13T18:54:47.942278+0000","last_became_active":"2024-09-13T18:54:46.488739+0000","last_became_peered":"2024-09-13T18:54:46.488739+0000","last_unstale":"2024-09-13T18:54:47.942278+0000","last_undegraded":"2024-09-13T18:54:47.942278+0000","last_fullsized":"2024-09-13T18:54:47.942278+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:00.356405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.481574+0000","last_change":"2024-09-13T18:54:46.013248+0000","last_active":"2024-09-13T18:54:46.481574+0000","last_peered":"2024-09-13T18:54:46.481574+0000","last_clean":"2024-09-13T18:54:46.481574+0000","last_became_active":"2024-09-13T18:54:46.012946+0000","last_became_peered":"2024-09-13T18:54:46.012946+0000","last_unstale":"2024-09-13T18:54:46.481574+0000","last_undegraded":"2024-09-13T18:54:46.481574+0000","last_fullsized":"2024-09-13T18:54:46.481574+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:10.603986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.489296+0000","last_change":"2024-09-13T18:54:46.487466+0000","last_active":"2024-09-13T18:54:46.489296+0000","last_peered":"2024-09-13T18:54:46.489296+0000","last_clean":"2024-09-13T18:54:46.489296+0000","last_became_active":"2024-09-13T18:54:46.487194+0000","last_became_peered":"2024-09-13T18:54:46.487194+0000","last_unstale":"2024-09-13T18:54:46.489296+0000","last_undegraded":"2024-09-13T18:54:46.489296+0000","last_fullsized":"2024-09-13T18:54:46.489296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:40.611063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480882+0000","last_change":"2024-09-13T18:54:46.018667+0000","last_active":"2024-09-13T18:54:46.480882+0000","last_peered":"2024-09-13T18:54:46.480882+0000","last_clean":"2024-09-13T18:54:46.480882+0000","last_became_active":"2024-09-13T18:54:46.018378+0000","last_became_peered":"2024-09-13T18:54:46.018378+0000","last_unstale":"2024-09-13T18:54:46.480882+0000","last_undegraded":"2024-09-13T18:54:46.480882+0000","last_fullsized":"2024-09-13T18:54:46.480882+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:16.610924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499398+0000","last_change":"2024-09-13T18:54:46.495233+0000","last_active":"2024-09-13T18:54:46.499398+0000","last_peered":"2024-09-13T18:54:46.499398+0000","last_clean":"2024-09-13T18:54:46.499398+0000","last_became_active":"2024-09-13T18:54:46.494869+0000","last_became_peered":"2024-09-13T18:54:46.494869+0000","last_unstale":"2024-09-13T18:54:46.499398+0000","last_undegraded":"2024-09-13T18:54:46.499398+0000","last_fullsized":"2024-09-13T18:54:46.499398+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:50.916859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.496668+0000","last_change":"2024-09-13T18:54:46.015281+0000","last_active":"2024-09-13T18:54:46.496668+0000","last_peered":"2024-09-13T18:54:46.496668+0000","last_clean":"2024-09-13T18:54:46.496668+0000","last_became_active":"2024-09-13T18:54:46.015020+0000","last_became_peered":"2024-09-13T18:54:46.015020+0000","last_unstale":"2024-09-13T18:54:46.496668+0000","last_undegraded":"2024-09-13T18:54:46.496668+0000","last_fullsized":"2024-09-13T18:54:46.496668+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:49.350836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.472454+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:54:46.472454+0000","last_peered":"2024-09-13T18:54:46.472454+0000","last_clean":"2024-09-13T18:54:46.472454+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:54:46.472454+0000","last_undegraded":"2024-09-13T18:54:46.472454+0000","last_fullsized":"2024-09-13T18:54:46.472454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1916928,"data_stored":1199189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1140000000000001,"15min":1.099},"min":{"1min":0.76200000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.591},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.069,"15min":1.1160000000000001},"min":{"1min":0.753,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2210000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.145,"15min":1.1399999999999999},"min":{"1min":0.80300000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.589,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.51},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.145,"15min":1.206},"min":{"1min":0.82199999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.492,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.3779999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2669999999999999,"15min":1.3220000000000001},"min":{"1min":0.98099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6639999999999999,"5min":1.885,"15min":1.885},"last":1.548},{"interface":"front","average":{"1min":1.264,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.0209999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5369999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.2989999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.86199999999999999,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.536,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.008},{"interface":"front","average":{"1min":1.327,"5min":1.3340000000000001,"15min":1.417},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.548,"5min":1.861,"15min":2.2610000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.107,"15min":1.111},"min":{"1min":0.80300000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.456},{"interface":"front","average":{"1min":1.23,"5min":1.2310000000000001,"15min":1.1930000000000001},"min":{"1min":0.91700000000000004,"5min":0.751,"15min":0.63700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.258}]},{"osd":5,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.93899999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.573,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.224},"min":{"1min":0.96899999999999997,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.599,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.391,"15min":1.399},"min":{"1min":0.86199999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.7549999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.395,"15min":1.413},"min":{"1min":1.0800000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.71,"5min":1.845,"15min":1.845},"last":1.4179999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1335296,"data_stored":610829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.105,"15min":1.1359999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.371},"max":{"1min":1.5840000000000001,"5min":1.619,"15min":3.0369999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1000000000000001,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.2}]},{"osd":1,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.526,"5min":1.5589999999999999,"15min":1.7849999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.177,"5min":1.167,"15min":1.1899999999999999},"min":{"1min":0.92900000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5229999999999999,"5min":1.627,"15min":1.7470000000000001},"last":1.145}]},{"osd":2,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.151,"15min":1.3740000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.4330000000000001,"5min":1.47,"15min":3.7480000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.1879999999999999,"15min":1.417},"min":{"1min":0.90300000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5700000000000001,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.4570000000000001},"min":{"1min":0.94999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.573,"5min":1.6339999999999999,"15min":4.883},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.272,"15min":1.4710000000000001},"min":{"1min":1.0529999999999999,"5min":0.89200000000000002,"15min":0.55000000000000004},"max":{"1min":1.534,"5min":1.6879999999999999,"15min":4.8630000000000004},"last":1.165}]},{"osd":4,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.2749999999999999},"min":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.474,"5min":1.7370000000000001,"15min":2.7229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.2330000000000001,"15min":1.3169999999999999},"min":{"1min":0.85999999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.629,"15min":2.077},"last":1.03}]},{"osd":5,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2529999999999999,"15min":1.3819999999999999},"min":{"1min":0.85299999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.673,"5min":1.764,"15min":2.1699999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.375,"15min":1.46},"min":{"1min":1.1970000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6419999999999999,"5min":1.905,"15min":2.6030000000000002},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3560000000000001,"15min":1.4450000000000001},"min":{"1min":1.042,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.7110000000000001,"5min":1.839,"15min":2.2120000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.355,"15min":1.4930000000000001},"min":{"1min":0.96399999999999997,"5min":0.79600000000000004,"15min":0.63700000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":2.367},"last":1.23}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1314816,"data_stored":608661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.167},"min":{"1min":0.67700000000000005,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.4630000000000001,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":1.119},{"interface":"front","average":{"1min":1.073,"5min":1.119,"15min":1.149},"min":{"1min":0.77400000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.528,"5min":1.5900000000000001,"15min":2.278},"last":0.95399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1639999999999999,"15min":1.246},"min":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4970000000000001,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.248},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1319999999999999,"15min":1.1779999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.1970000000000001,"15min":1.2689999999999999},"min":{"1min":0.85599999999999998,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.5289999999999999,"5min":1.6799999999999999,"15min":1.9059999999999999},"last":1.617},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.121,"15min":1.228},"min":{"1min":0.78600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.393,"5min":1.6080000000000001,"15min":2.157},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2450000000000001,"15min":1.3460000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":1.492,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":1.159},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2929999999999999,"15min":1.407},"min":{"1min":0.90300000000000002,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.534}]},{"osd":4,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.077,"15min":1.1890000000000001},"min":{"1min":0.82599999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3600000000000001,"5min":1.579,"15min":1.8500000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.254},"min":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3069999999999999,"5min":1.742,"15min":1.974},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.286},"min":{"1min":0.95499999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.619,"5min":1.669,"15min":2.0219999999999998},"last":1.698},{"interface":"front","average":{"1min":1.262,"5min":1.2370000000000001,"15min":1.329},"min":{"1min":1.0249999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.595,"5min":1.694,"15min":2.1739999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3700000000000001,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":1.6100000000000001,"5min":1.7649999999999999,"15min":2.169},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4159999999999999,"15min":1.4910000000000001},"min":{"1min":0.995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":2.8140000000000001},"last":1.4490000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1323008,"data_stored":608753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1080000000000001,"15min":1.1220000000000001},"min":{"1min":0.70799999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.536,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.1419999999999999,"15min":1.1379999999999999},"min":{"1min":0.77100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5580000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2350000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2969999999999999,"15min":1.3480000000000001},"min":{"1min":0.89000000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.6930000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2410000000000001,"15min":1.3080000000000001},"min":{"1min":0.79900000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7669999999999999,"5min":1.806,"15min":2.423},"last":1.133}]},{"osd":2,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2250000000000001,"15min":1.2749999999999999},"min":{"1min":0.86499999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.99},"last":1.119},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.294,"15min":1.361},"min":{"1min":0.75900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6779999999999999,"5min":1.7370000000000001,"15min":2.335},"last":1.2}]},{"osd":3,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2090000000000001,"15min":1.288},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.6859999999999999,"5min":1.7689999999999999,"15min":2.621},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.2,"15min":1.2529999999999999},"min":{"1min":0.96599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1399999999999999,"15min":1.2709999999999999},"min":{"1min":0.82899999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6060000000000001,"5min":1.718,"15min":2.274},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.224,"15min":1.2989999999999999},"min":{"1min":0.878,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.266},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2210000000000001,"15min":1.3280000000000001},"min":{"1min":0.81799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.726,"5min":1.726,"15min":2.4710000000000001},"last":1.28},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3380000000000001,"15min":1.4330000000000001},"min":{"1min":0.93500000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.5},"last":1.335}]},{"osd":7,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.359,"15min":1.4430000000000001},"min":{"1min":1.038,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.395},"last":1.161},{"interface":"front","average":{"1min":1.458,"5min":1.3640000000000001,"15min":1.4510000000000001},"min":{"1min":1.1399999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8080000000000001,"5min":1.9059999999999999,"15min":2.415},"last":1.034}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1318912,"data_stored":609243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.877},"min":{"1min":0.48499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.329,"5min":1.331,"15min":1.4510000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.874},"min":{"1min":0.56499999999999995,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.444,"15min":1.444},"last":1.121}]},{"osd":1,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85199999999999998,"15min":0.86699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.069,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.93899999999999995,"15min":1.071},"min":{"1min":0.60199999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1200000000000001,"5min":1.464,"15min":4.0149999999999997},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.04,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.1479999999999999,"15min":1.159},"min":{"1min":0.65300000000000002,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.5609999999999999,"5min":1.569,"15min":2.4729999999999999},"last":0.999}]},{"osd":4,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.228},"min":{"1min":0.95199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.046},{"interface":"front","average":{"1min":1.119,"5min":1.151,"15min":1.2170000000000001},"min":{"1min":0.89000000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4470000000000001,"5min":1.554,"15min":1.8220000000000001},"last":1.151}]},{"osd":5,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.206,"15min":1.2909999999999999},"min":{"1min":0.89000000000000001,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.3959999999999999,"5min":1.613,"15min":2.0099999999999998},"last":1.2},{"interface":"front","average":{"1min":1.2,"5min":1.262,"15min":1.351},"min":{"1min":0.97699999999999998,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.4610000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.2949999999999999,"15min":1.403},"min":{"1min":1.181,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.4930000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.522,"5min":1.8520000000000001,"15min":2.52},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3029999999999999,"15min":1.47},"min":{"1min":1.0640000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6659999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3049999999999999,"15min":1.409},"min":{"1min":0.97299999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.536,"5min":1.6339999999999999,"15min":1.9810000000000001},"last":1.075}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1318912,"data_stored":608695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.93799999999999994},"min":{"1min":0.57999999999999996,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.81299999999999994,"15min":1.004},"min":{"1min":0.68000000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2370000000000001,"5min":1.54,"15min":4.6349999999999998},"last":1.286}]},{"osd":1,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85499999999999998,"15min":1.073},"min":{"1min":0.59999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0680000000000001,"15min":1.194},"min":{"1min":0.80100000000000005,"5min":0.60199999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.762,"15min":4.7009999999999996},"last":0.92900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1339999999999999,"15min":1.2769999999999999},"min":{"1min":0.79900000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3939999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.1859999999999999},"min":{"1min":0.81599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.51,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.5609999999999999},"min":{"1min":0.97199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.615,"5min":1.615,"15min":8.6989999999999998},"last":1.091},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.244,"15min":1.4079999999999999},"min":{"1min":0.998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6100000000000001,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":1.1599999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.29,"15min":1.466},"min":{"1min":1.0980000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.659,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.002},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.4370000000000001},"min":{"1min":0.90600000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.579,"5min":1.7370000000000001,"15min":4.335},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2809999999999999,"15min":1.4890000000000001},"min":{"1min":0.94799999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.536,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":1.22},{"interface":"front","average":{"1min":1.323,"5min":1.258,"15min":1.6559999999999999},"min":{"1min":1.0409999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.2509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.335,"15min":1.5169999999999999},"min":{"1min":1.129,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.5860000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.353},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3620000000000001,"15min":1.5649999999999999},"min":{"1min":1.0880000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.647,"5min":1.677,"15min":4.4050000000000002},"last":1.2769999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1318912,"data_stored":608695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.85499999999999998},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.996,"5min":1.377,"15min":2.2170000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81299999999999994,"15min":1.004},"min":{"1min":0.48799999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.2410000000000001,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.03,"15min":1.155},"min":{"1min":0.625,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4870000000000001,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.05},"min":{"1min":0.52200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.288,"5min":1.804,"15min":2.6219999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.131,"15min":1.2769999999999999},"min":{"1min":0.71999999999999997,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.748,"5min":1.748,"15min":6.0919999999999996},"last":1.028},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0580000000000001,"15min":1.3440000000000001},"min":{"1min":0.78600000000000003,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.339,"5min":1.768,"15min":10.368},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2310000000000001,"15min":1.3500000000000001},"min":{"1min":0.96499999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7689999999999999,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.254,"15min":1.341},"min":{"1min":0.96699999999999997,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":1.6919999999999999,"5min":1.958,"15min":2.911},"last":1.127}]},{"osd":5,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.242,"15min":1.637},"min":{"1min":1.0569999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5720000000000001,"5min":1.6499999999999999,"15min":10.214},"last":1.103},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.292,"15min":1.4410000000000001},"min":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.669,"5min":1.96,"15min":2.8849999999999998},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.2929999999999999,"15min":1.5229999999999999},"min":{"1min":0.90400000000000003,"5min":0.874,"15min":0.874},"max":{"1min":1.6279999999999999,"5min":1.915,"15min":6.032},"last":1.202},{"interface":"front","average":{"1min":1.353,"5min":1.298,"15min":1.6850000000000001},"min":{"1min":1.006,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":1.637,"5min":1.774,"15min":10.112},"last":1.381}]},{"osd":7,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.379,"15min":1.752},"min":{"1min":1.0880000000000001,"5min":0.97599999999999998,"15min":0.81299999999999994},"max":{"1min":1.6240000000000001,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.3520000000000001,"15min":1.5269999999999999},"min":{"1min":0.92400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.643,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.3560000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1925120,"data_stored":1200683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75,"15min":0.94999999999999996},"min":{"1min":0.54200000000000004,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90500000000000003,"5min":1.405,"15min":4.2039999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.97399999999999998},"min":{"1min":0.60699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0249999999999999,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.89900000000000002,"15min":1.1000000000000001},"min":{"1min":0.67200000000000004,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":1.165},"min":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.27,"5min":1.4410000000000001,"15min":3.5640000000000001},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":1.149},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":4.093},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.131,"15min":1.363},"min":{"1min":0.78600000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4339999999999999,"5min":1.5800000000000001,"15min":4.7439999999999998},"last":0.81399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2190000000000001,"15min":1.401},"min":{"1min":0.81000000000000005,"5min":0.745,"15min":0.745},"max":{"1min":1.4690000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.409},"min":{"1min":0.92100000000000004,"5min":0.84099999999999997,"15min":0.82099999999999995},"max":{"1min":1.881,"5min":1.881,"15min":4.5449999999999999},"last":1.381}]},{"osd":5,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.278,"15min":1.548},"min":{"1min":0.95699999999999996,"5min":0.753,"15min":0.753},"max":{"1min":1.627,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.246,"15min":1.482},"min":{"1min":0.86299999999999999,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6160000000000001,"5min":1.675,"15min":3.2290000000000001},"last":1.232}]},{"osd":6,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.83999999999999997},"max":{"1min":1.968,"5min":1.968,"15min":4.4569999999999999},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3129999999999999,"15min":1.6259999999999999},"min":{"1min":0.995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.627,"5min":1.631,"15min":4.8570000000000002},"last":1.4710000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3320000000000001,"15min":1.5449999999999999},"min":{"1min":0.98499999999999999,"5min":0.873,"15min":0.86099999999999999},"max":{"1min":1.651,"5min":1.756,"15min":3.056},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3120000000000001,"15min":1.5609999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.149,"5min":2.149,"15min":4.5019999999999998},"last":1.45}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:54:50.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:54:51.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 Processor -- start 2024-09-13T18:54:51.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 -- start start 2024-09-13T18:54:51.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa80ae100 0x7f1fa80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa8066090 0x7f1fa80664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80ae4e0 con 0x7f1fa80723f0 2024-09-13T18:54:51.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80b3040 con 0x7f1fa80ae100 2024-09-13T18:54:51.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1faec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa815d260 con 0x7f1fa8066090 2024-09-13T18:54:51.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1fa7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa80ae100 0x7f1fa80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1fa7e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1fa80ae100 0x7f1fa80b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52780/0 (socket says 172.21.15.81:52780) 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1fa7e00700 1 -- 172.21.15.81:0/3970904614 learned_addr learned my addr 172.21.15.81:0/3970904614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1facc00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa8066090 0x7f1fa80664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.049+0000 7f1fa7e00700 1 -- 172.21.15.81:0/3970904614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa8066090 msgr2=0x7f1fa80664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa7e00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa8066090 0x7f1fa80664b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa7e00700 1 -- 172.21.15.81:0/3970904614 >> v1:172.21.15.81:6789/0 conn(0x7f1fa80723f0 legacy=0x7f1fa815dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa7e00700 1 -- 172.21.15.81:0/3970904614 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80669f0 con 0x7f1fa80ae100 2024-09-13T18:54:51.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1facc00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa8066090 0x7f1fa80664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:51.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa7e00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa80ae100 0x7f1fa80b4740 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009910 tx=0x7f1f98009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bae12dbf410f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:51.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa6a00700 1 -- 172.21.15.81:0/3970904614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800ba60 con 0x7f1fa80ae100 2024-09-13T18:54:51.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa6a00700 1 -- 172.21.15.81:0/3970904614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9800bbc0 con 0x7f1fa80ae100 2024-09-13T18:54:51.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1fa6a00700 1 -- 172.21.15.81:0/3970904614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98009e60 con 0x7f1fa80ae100 2024-09-13T18:54:51.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 -- 172.21.15.81:0/3970904614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa80ae100 msgr2=0x7f1fa80b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa80ae100 0x7f1fa80b4740 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f1f98009910 tx=0x7f1f98009c20 comp rx=0 tx=0).stop 2024-09-13T18:54:51.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 -- 172.21.15.81:0/3970904614 shutdown_connections 2024-09-13T18:54:51.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa8066090 0x7f1fa80664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 --2- 172.21.15.81:0/3970904614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa80ae100 0x7f1fa80b4740 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 -- 172.21.15.81:0/3970904614 >> 172.21.15.81:0/3970904614 conn(0x7f1fa80b1e00 msgr2=0x7f1fa80cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:51.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 -- 172.21.15.81:0/3970904614 shutdown_connections 2024-09-13T18:54:51.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.053+0000 7f1faec00700 1 -- 172.21.15.81:0/3970904614 wait complete. 2024-09-13T18:54:51.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 Processor -- start 2024-09-13T18:54:51.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 -- start start 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 0x7f1fa80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa80723f0 0x7f1fa8150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ae100 0x7f1fa8132150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81528b0 con 0x7f1fa8066090 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8135120 con 0x7f1fa80ae100 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1faec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa81345a0 con 0x7f1fa80723f0 2024-09-13T18:54:51.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1fa7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 0x7f1fa80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1fa7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 0x7f1fa80b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52792/0 (socket says 172.21.15.81:52792) 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.057+0000 7f1fa7e00700 1 -- 172.21.15.81:0/2673172101 learned_addr learned my addr 172.21.15.81:0/2673172101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7400700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa80723f0 0x7f1fa8150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1facc00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ae100 0x7f1fa8132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7e00700 1 -- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa80723f0 msgr2=0x7f1fa8150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7e00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa80723f0 0x7f1fa8150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7e00700 1 -- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ae100 msgr2=0x7f1fa8132150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7e00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ae100 0x7f1fa8132150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7e00700 1 -- 172.21.15.81:0/2673172101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009570 con 0x7f1fa8066090 2024-09-13T18:54:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1fa7e00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 0x7f1fa80b1130 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80b4ee0 tx=0x7f1f98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98004510 con 0x7f1fa8066090 2024-09-13T18:54:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9801f070 con 0x7f1fa8066090 2024-09-13T18:54:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98003900 con 0x7f1fa8066090 2024-09-13T18:54:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa8134880 con 0x7f1fa8066090 2024-09-13T18:54:51.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.061+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa8134e40 con 0x7f1fa8066090 2024-09-13T18:54:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.065+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa8072880 con 0x7f1fa8066090 2024-09-13T18:54:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.065+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f98003a60 con 0x7f1fa8066090 2024-09-13T18:54:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.065+0000 7f1f9fe00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1f88066730 0x7f1f88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.065+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1f98021070 con 0x7f1fa8066090 2024-09-13T18:54:51.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.069+0000 7f1fa7400700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1f88066730 0x7f1f88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.069+0000 7f1fa7400700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1f88066730 0x7f1f88068bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80b1080 tx=0x7f1f94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:51.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.073+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f98052c40 con 0x7f1fa8066090 2024-09-13T18:54:51.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.261+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fa806e240 con 0x7f1f88066730 2024-09-13T18:54:51.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.281+0000 7f1f9fe00700 1 -- 172.21.15.81:0/2673172101 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287303 (secure 0 0 0) 0x7f1fa806e240 con 0x7f1f88066730 2024-09-13T18:54:51.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1f88066730 msgr2=0x7f1f88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1f88066730 0x7f1f88068bf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80b1080 tx=0x7f1f94009040 comp rx=0 tx=0).stop 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 msgr2=0x7f1fa80b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 0x7f1fa80b1130 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80b4ee0 tx=0x7f1f98004770 comp rx=0 tx=0).stop 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 shutdown_connections 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1f88066730 0x7f1f88068bf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fa80ae100 0x7f1fa8132150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fa80723f0 0x7f1fa8150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 --2- 172.21.15.81:0/2673172101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa8066090 0x7f1fa80b1130 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 >> 172.21.15.81:0/2673172101 conn(0x7f1fa80b1e00 msgr2=0x7f1fa8159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 shutdown_connections 2024-09-13T18:54:51.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.289+0000 7f1faec00700 1 -- 172.21.15.81:0/2673172101 wait complete. 2024-09-13T18:54:51.303 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:54:51.322 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-13T18:54:51.124809+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260476,"kb_used_data":11496,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714244,"statfs":{"total":773094113280,"available":772827385856,"internally_reserved":0,"allocated":11771904,"data_stored":6054748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001856"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474289+0000","last_change":"2024-09-13T18:54:46.482791+0000","last_active":"2024-09-13T18:54:47.474289+0000","last_peered":"2024-09-13T18:54:47.474289+0000","last_clean":"2024-09-13T18:54:47.474289+0000","last_became_active":"2024-09-13T18:54:46.481408+0000","last_became_peered":"2024-09-13T18:54:46.481408+0000","last_unstale":"2024-09-13T18:54:47.474289+0000","last_undegraded":"2024-09-13T18:54:47.474289+0000","last_fullsized":"2024-09-13T18:54:47.474289+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:22.577797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498757+0000","last_change":"2024-09-13T18:54:46.490006+0000","last_active":"2024-09-13T18:54:46.498757+0000","last_peered":"2024-09-13T18:54:46.498757+0000","last_clean":"2024-09-13T18:54:46.498757+0000","last_became_active":"2024-09-13T18:54:46.489311+0000","last_became_peered":"2024-09-13T18:54:46.489311+0000","last_unstale":"2024-09-13T18:54:46.498757+0000","last_undegraded":"2024-09-13T18:54:46.498757+0000","last_fullsized":"2024-09-13T18:54:46.498757+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:16.676485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474132+0000","last_change":"2024-09-13T18:54:46.487354+0000","last_active":"2024-09-13T18:54:47.474132+0000","last_peered":"2024-09-13T18:54:47.474132+0000","last_clean":"2024-09-13T18:54:47.474132+0000","last_became_active":"2024-09-13T18:54:46.487145+0000","last_became_peered":"2024-09-13T18:54:46.487145+0000","last_unstale":"2024-09-13T18:54:47.474132+0000","last_undegraded":"2024-09-13T18:54:47.474132+0000","last_fullsized":"2024-09-13T18:54:47.474132+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:37.391368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500981+0000","last_change":"2024-09-13T18:54:46.497327+0000","last_active":"2024-09-13T18:54:46.500981+0000","last_peered":"2024-09-13T18:54:46.500981+0000","last_clean":"2024-09-13T18:54:46.500981+0000","last_became_active":"2024-09-13T18:54:46.497067+0000","last_became_peered":"2024-09-13T18:54:46.497067+0000","last_unstale":"2024-09-13T18:54:46.500981+0000","last_undegraded":"2024-09-13T18:54:46.500981+0000","last_fullsized":"2024-09-13T18:54:46.500981+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:58:31.048017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473104+0000","last_change":"2024-09-13T18:54:46.499213+0000","last_active":"2024-09-13T18:54:47.473104+0000","last_peered":"2024-09-13T18:54:47.473104+0000","last_clean":"2024-09-13T18:54:47.473104+0000","last_became_active":"2024-09-13T18:54:46.498977+0000","last_became_peered":"2024-09-13T18:54:46.498977+0000","last_unstale":"2024-09-13T18:54:47.473104+0000","last_undegraded":"2024-09-13T18:54:47.473104+0000","last_fullsized":"2024-09-13T18:54:47.473104+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:27.648155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500333+0000","last_change":"2024-09-13T18:54:46.497187+0000","last_active":"2024-09-13T18:54:46.500333+0000","last_peered":"2024-09-13T18:54:46.500333+0000","last_clean":"2024-09-13T18:54:46.500333+0000","last_became_active":"2024-09-13T18:54:46.496901+0000","last_became_peered":"2024-09-13T18:54:46.496901+0000","last_unstale":"2024-09-13T18:54:46.500333+0000","last_undegraded":"2024-09-13T18:54:46.500333+0000","last_fullsized":"2024-09-13T18:54:46.500333+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:44.935877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.501040+0000","last_change":"2024-09-13T18:54:46.498452+0000","last_active":"2024-09-13T18:54:46.501040+0000","last_peered":"2024-09-13T18:54:46.501040+0000","last_clean":"2024-09-13T18:54:46.501040+0000","last_became_active":"2024-09-13T18:54:46.498185+0000","last_became_peered":"2024-09-13T18:54:46.498185+0000","last_unstale":"2024-09-13T18:54:46.501040+0000","last_undegraded":"2024-09-13T18:54:46.501040+0000","last_fullsized":"2024-09-13T18:54:46.501040+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:17.875596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499671+0000","last_change":"2024-09-13T18:54:46.492730+0000","last_active":"2024-09-13T18:54:46.499671+0000","last_peered":"2024-09-13T18:54:46.499671+0000","last_clean":"2024-09-13T18:54:46.499671+0000","last_became_active":"2024-09-13T18:54:46.492456+0000","last_became_peered":"2024-09-13T18:54:46.492456+0000","last_unstale":"2024-09-13T18:54:46.499671+0000","last_undegraded":"2024-09-13T18:54:46.499671+0000","last_fullsized":"2024-09-13T18:54:46.499671+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:27.855986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500204+0000","last_change":"2024-09-13T18:54:46.494667+0000","last_active":"2024-09-13T18:54:46.500204+0000","last_peered":"2024-09-13T18:54:46.500204+0000","last_clean":"2024-09-13T18:54:46.500204+0000","last_became_active":"2024-09-13T18:54:46.494419+0000","last_became_peered":"2024-09-13T18:54:46.494419+0000","last_unstale":"2024-09-13T18:54:46.500204+0000","last_undegraded":"2024-09-13T18:54:46.500204+0000","last_fullsized":"2024-09-13T18:54:46.500204+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473705+0000","last_change":"2024-09-13T18:54:46.495906+0000","last_active":"2024-09-13T18:54:47.473705+0000","last_peered":"2024-09-13T18:54:47.473705+0000","last_clean":"2024-09-13T18:54:47.473705+0000","last_became_active":"2024-09-13T18:54:46.494088+0000","last_became_peered":"2024-09-13T18:54:46.494088+0000","last_unstale":"2024-09-13T18:54:47.473705+0000","last_undegraded":"2024-09-13T18:54:47.473705+0000","last_fullsized":"2024-09-13T18:54:47.473705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:52.353965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.491633+0000","last_change":"2024-09-13T18:54:46.490246+0000","last_active":"2024-09-13T18:54:46.491633+0000","last_peered":"2024-09-13T18:54:46.491633+0000","last_clean":"2024-09-13T18:54:46.491633+0000","last_became_active":"2024-09-13T18:54:46.489950+0000","last_became_peered":"2024-09-13T18:54:46.489950+0000","last_unstale":"2024-09-13T18:54:46.491633+0000","last_undegraded":"2024-09-13T18:54:46.491633+0000","last_fullsized":"2024-09-13T18:54:46.491633+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:57.391073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476119+0000","last_change":"2024-09-13T18:54:46.494982+0000","last_active":"2024-09-13T18:54:47.476119+0000","last_peered":"2024-09-13T18:54:47.476119+0000","last_clean":"2024-09-13T18:54:47.476119+0000","last_became_active":"2024-09-13T18:54:46.494583+0000","last_became_peered":"2024-09-13T18:54:46.494583+0000","last_unstale":"2024-09-13T18:54:47.476119+0000","last_undegraded":"2024-09-13T18:54:47.476119+0000","last_fullsized":"2024-09-13T18:54:47.476119+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:24.725559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.490292+0000","last_change":"2024-09-13T18:54:46.487664+0000","last_active":"2024-09-13T18:54:46.490292+0000","last_peered":"2024-09-13T18:54:46.490292+0000","last_clean":"2024-09-13T18:54:46.490292+0000","last_became_active":"2024-09-13T18:54:46.487413+0000","last_became_peered":"2024-09-13T18:54:46.487413+0000","last_unstale":"2024-09-13T18:54:46.490292+0000","last_undegraded":"2024-09-13T18:54:46.490292+0000","last_fullsized":"2024-09-13T18:54:46.490292+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:07.711722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941748+0000","last_change":"2024-09-13T18:54:46.487184+0000","last_active":"2024-09-13T18:54:47.941748+0000","last_peered":"2024-09-13T18:54:47.941748+0000","last_clean":"2024-09-13T18:54:47.941748+0000","last_became_active":"2024-09-13T18:54:46.486878+0000","last_became_peered":"2024-09-13T18:54:46.486878+0000","last_unstale":"2024-09-13T18:54:47.941748+0000","last_undegraded":"2024-09-13T18:54:47.941748+0000","last_fullsized":"2024-09-13T18:54:47.941748+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:31.375654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941836+0000","last_change":"2024-09-13T18:54:46.490446+0000","last_active":"2024-09-13T18:54:47.941836+0000","last_peered":"2024-09-13T18:54:47.941836+0000","last_clean":"2024-09-13T18:54:47.941836+0000","last_became_active":"2024-09-13T18:54:46.490164+0000","last_became_peered":"2024-09-13T18:54:46.490164+0000","last_unstale":"2024-09-13T18:54:47.941836+0000","last_undegraded":"2024-09-13T18:54:47.941836+0000","last_fullsized":"2024-09-13T18:54:47.941836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:23.010960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941627+0000","last_change":"2024-09-13T18:54:46.493014+0000","last_active":"2024-09-13T18:54:47.941627+0000","last_peered":"2024-09-13T18:54:47.941627+0000","last_clean":"2024-09-13T18:54:47.941627+0000","last_became_active":"2024-09-13T18:54:46.492726+0000","last_became_peered":"2024-09-13T18:54:46.492726+0000","last_unstale":"2024-09-13T18:54:47.941627+0000","last_undegraded":"2024-09-13T18:54:47.941627+0000","last_fullsized":"2024-09-13T18:54:47.941627+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:11.620025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474410+0000","last_change":"2024-09-13T18:54:46.488886+0000","last_active":"2024-09-13T18:54:47.474410+0000","last_peered":"2024-09-13T18:54:47.474410+0000","last_clean":"2024-09-13T18:54:47.474410+0000","last_became_active":"2024-09-13T18:54:46.488588+0000","last_became_peered":"2024-09-13T18:54:46.488588+0000","last_unstale":"2024-09-13T18:54:47.474410+0000","last_undegraded":"2024-09-13T18:54:47.474410+0000","last_fullsized":"2024-09-13T18:54:47.474410+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:45:25.254017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500399+0000","last_change":"2024-09-13T18:54:46.496261+0000","last_active":"2024-09-13T18:54:46.500399+0000","last_peered":"2024-09-13T18:54:46.500399+0000","last_clean":"2024-09-13T18:54:46.500399+0000","last_became_active":"2024-09-13T18:54:46.495990+0000","last_became_peered":"2024-09-13T18:54:46.495990+0000","last_unstale":"2024-09-13T18:54:46.500399+0000","last_undegraded":"2024-09-13T18:54:46.500399+0000","last_fullsized":"2024-09-13T18:54:46.500399+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:24.725559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474364+0000","last_change":"2024-09-13T18:54:46.485558+0000","last_active":"2024-09-13T18:54:47.474364+0000","last_peered":"2024-09-13T18:54:47.474364+0000","last_clean":"2024-09-13T18:54:47.474364+0000","last_became_active":"2024-09-13T18:54:46.485311+0000","last_became_peered":"2024-09-13T18:54:46.485311+0000","last_unstale":"2024-09-13T18:54:47.474364+0000","last_undegraded":"2024-09-13T18:54:47.474364+0000","last_fullsized":"2024-09-13T18:54:47.474364+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:16.142239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476304+0000","last_change":"2024-09-13T18:54:46.497800+0000","last_active":"2024-09-13T18:54:47.476304+0000","last_peered":"2024-09-13T18:54:47.476304+0000","last_clean":"2024-09-13T18:54:47.476304+0000","last_became_active":"2024-09-13T18:54:46.487906+0000","last_became_peered":"2024-09-13T18:54:46.487906+0000","last_unstale":"2024-09-13T18:54:47.476304+0000","last_undegraded":"2024-09-13T18:54:47.476304+0000","last_fullsized":"2024-09-13T18:54:47.476304+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:16.676485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499533+0000","last_change":"2024-09-13T18:54:46.491127+0000","last_active":"2024-09-13T18:54:46.499533+0000","last_peered":"2024-09-13T18:54:46.499533+0000","last_clean":"2024-09-13T18:54:46.499533+0000","last_became_active":"2024-09-13T18:54:46.490852+0000","last_became_peered":"2024-09-13T18:54:46.490852+0000","last_unstale":"2024-09-13T18:54:46.499533+0000","last_undegraded":"2024-09-13T18:54:46.499533+0000","last_fullsized":"2024-09-13T18:54:46.499533+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:57.240547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473206+0000","last_change":"2024-09-13T18:54:46.477637+0000","last_active":"2024-09-13T18:54:47.473206+0000","last_peered":"2024-09-13T18:54:47.473206+0000","last_clean":"2024-09-13T18:54:47.473206+0000","last_became_active":"2024-09-13T18:54:46.477349+0000","last_became_peered":"2024-09-13T18:54:46.477349+0000","last_unstale":"2024-09-13T18:54:47.473206+0000","last_undegraded":"2024-09-13T18:54:47.473206+0000","last_fullsized":"2024-09-13T18:54:47.473206+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:36.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473653+0000","last_change":"2024-09-13T18:54:46.495457+0000","last_active":"2024-09-13T18:54:47.473653+0000","last_peered":"2024-09-13T18:54:47.473653+0000","last_clean":"2024-09-13T18:54:47.473653+0000","last_became_active":"2024-09-13T18:54:46.494528+0000","last_became_peered":"2024-09-13T18:54:46.494528+0000","last_unstale":"2024-09-13T18:54:47.473653+0000","last_undegraded":"2024-09-13T18:54:47.473653+0000","last_fullsized":"2024-09-13T18:54:47.473653+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:25.559722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.472983+0000","last_change":"2024-09-13T18:54:46.480293+0000","last_active":"2024-09-13T18:54:47.472983+0000","last_peered":"2024-09-13T18:54:47.472983+0000","last_clean":"2024-09-13T18:54:47.472983+0000","last_became_active":"2024-09-13T18:54:46.477957+0000","last_became_peered":"2024-09-13T18:54:46.477957+0000","last_unstale":"2024-09-13T18:54:47.472983+0000","last_undegraded":"2024-09-13T18:54:47.472983+0000","last_fullsized":"2024-09-13T18:54:47.472983+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.266107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476384+0000","last_change":"2024-09-13T18:54:46.499327+0000","last_active":"2024-09-13T18:54:47.476384+0000","last_peered":"2024-09-13T18:54:47.476384+0000","last_clean":"2024-09-13T18:54:47.476384+0000","last_became_active":"2024-09-13T18:54:46.495549+0000","last_became_peered":"2024-09-13T18:54:46.495549+0000","last_unstale":"2024-09-13T18:54:47.476384+0000","last_undegraded":"2024-09-13T18:54:47.476384+0000","last_fullsized":"2024-09-13T18:54:47.476384+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:44.935877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476295+0000","last_change":"2024-09-13T18:54:46.501248+0000","last_active":"2024-09-13T18:54:47.476295+0000","last_peered":"2024-09-13T18:54:47.476295+0000","last_clean":"2024-09-13T18:54:47.476295+0000","last_became_active":"2024-09-13T18:54:46.500996+0000","last_became_peered":"2024-09-13T18:54:46.500996+0000","last_unstale":"2024-09-13T18:54:47.476295+0000","last_undegraded":"2024-09-13T18:54:47.476295+0000","last_fullsized":"2024-09-13T18:54:47.476295+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:36.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.491615+0000","last_change":"2024-09-13T18:54:46.486973+0000","last_active":"2024-09-13T18:54:46.491615+0000","last_peered":"2024-09-13T18:54:46.491615+0000","last_clean":"2024-09-13T18:54:46.491615+0000","last_became_active":"2024-09-13T18:54:46.484826+0000","last_became_peered":"2024-09-13T18:54:46.484826+0000","last_unstale":"2024-09-13T18:54:46.491615+0000","last_undegraded":"2024-09-13T18:54:46.491615+0000","last_fullsized":"2024-09-13T18:54:46.491615+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.951197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.500148+0000","last_change":"2024-09-13T18:54:46.493947+0000","last_active":"2024-09-13T18:54:46.500148+0000","last_peered":"2024-09-13T18:54:46.500148+0000","last_clean":"2024-09-13T18:54:46.500148+0000","last_became_active":"2024-09-13T18:54:46.493718+0000","last_became_peered":"2024-09-13T18:54:46.493718+0000","last_unstale":"2024-09-13T18:54:46.500148+0000","last_undegraded":"2024-09-13T18:54:46.500148+0000","last_fullsized":"2024-09-13T18:54:46.500148+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:04.416730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499514+0000","last_change":"2024-09-13T18:54:46.491038+0000","last_active":"2024-09-13T18:54:46.499514+0000","last_peered":"2024-09-13T18:54:46.499514+0000","last_clean":"2024-09-13T18:54:46.499514+0000","last_became_active":"2024-09-13T18:54:46.490654+0000","last_became_peered":"2024-09-13T18:54:46.490654+0000","last_unstale":"2024-09-13T18:54:46.499514+0000","last_undegraded":"2024-09-13T18:54:46.499514+0000","last_fullsized":"2024-09-13T18:54:46.499514+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:35.623920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475927+0000","last_change":"2024-09-13T18:54:46.497429+0000","last_active":"2024-09-13T18:54:47.475927+0000","last_peered":"2024-09-13T18:54:47.475927+0000","last_clean":"2024-09-13T18:54:47.475927+0000","last_became_active":"2024-09-13T18:54:46.497017+0000","last_became_peered":"2024-09-13T18:54:46.497017+0000","last_unstale":"2024-09-13T18:54:47.475927+0000","last_undegraded":"2024-09-13T18:54:47.475927+0000","last_fullsized":"2024-09-13T18:54:47.475927+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.228277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499089+0000","last_change":"2024-09-13T18:54:46.489285+0000","last_active":"2024-09-13T18:54:46.499089+0000","last_peered":"2024-09-13T18:54:46.499089+0000","last_clean":"2024-09-13T18:54:46.499089+0000","last_became_active":"2024-09-13T18:54:46.486364+0000","last_became_peered":"2024-09-13T18:54:46.486364+0000","last_unstale":"2024-09-13T18:54:46.499089+0000","last_undegraded":"2024-09-13T18:54:46.499089+0000","last_fullsized":"2024-09-13T18:54:46.499089+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:12:36.945503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498885+0000","last_change":"2024-09-13T18:54:46.489331+0000","last_active":"2024-09-13T18:54:46.498885+0000","last_peered":"2024-09-13T18:54:46.498885+0000","last_clean":"2024-09-13T18:54:46.498885+0000","last_became_active":"2024-09-13T18:54:46.489092+0000","last_became_peered":"2024-09-13T18:54:46.489092+0000","last_unstale":"2024-09-13T18:54:46.498885+0000","last_undegraded":"2024-09-13T18:54:46.498885+0000","last_fullsized":"2024-09-13T18:54:46.498885+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:37.168399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473795+0000","last_change":"2024-09-13T18:54:46.485800+0000","last_active":"2024-09-13T18:54:47.473795+0000","last_peered":"2024-09-13T18:54:47.473795+0000","last_clean":"2024-09-13T18:54:47.473795+0000","last_became_active":"2024-09-13T18:54:46.485529+0000","last_became_peered":"2024-09-13T18:54:46.485529+0000","last_unstale":"2024-09-13T18:54:47.473795+0000","last_undegraded":"2024-09-13T18:54:47.473795+0000","last_fullsized":"2024-09-13T18:54:47.473795+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:09.713149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.495294+0000","last_change":"2024-09-13T18:54:46.016839+0000","last_active":"2024-09-13T18:54:46.495294+0000","last_peered":"2024-09-13T18:54:46.495294+0000","last_clean":"2024-09-13T18:54:46.495294+0000","last_became_active":"2024-09-13T18:54:46.016585+0000","last_became_peered":"2024-09-13T18:54:46.016585+0000","last_unstale":"2024-09-13T18:54:46.495294+0000","last_undegraded":"2024-09-13T18:54:46.495294+0000","last_fullsized":"2024-09-13T18:54:46.495294+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:27.250068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499347+0000","last_change":"2024-09-13T18:54:46.490305+0000","last_active":"2024-09-13T18:54:46.499347+0000","last_peered":"2024-09-13T18:54:46.499347+0000","last_clean":"2024-09-13T18:54:46.499347+0000","last_became_active":"2024-09-13T18:54:46.490093+0000","last_became_peered":"2024-09-13T18:54:46.490093+0000","last_unstale":"2024-09-13T18:54:46.499347+0000","last_undegraded":"2024-09-13T18:54:46.499347+0000","last_fullsized":"2024-09-13T18:54:46.499347+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:14.967944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498636+0000","last_change":"2024-09-13T18:54:46.019512+0000","last_active":"2024-09-13T18:54:46.498636+0000","last_peered":"2024-09-13T18:54:46.498636+0000","last_clean":"2024-09-13T18:54:46.498636+0000","last_became_active":"2024-09-13T18:54:46.019228+0000","last_became_peered":"2024-09-13T18:54:46.019228+0000","last_unstale":"2024-09-13T18:54:46.498636+0000","last_undegraded":"2024-09-13T18:54:46.498636+0000","last_fullsized":"2024-09-13T18:54:46.498636+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:16.392734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476170+0000","last_change":"2024-09-13T18:54:46.501601+0000","last_active":"2024-09-13T18:54:47.476170+0000","last_peered":"2024-09-13T18:54:47.476170+0000","last_clean":"2024-09-13T18:54:47.476170+0000","last_became_active":"2024-09-13T18:54:46.501339+0000","last_became_peered":"2024-09-13T18:54:46.501339+0000","last_unstale":"2024-09-13T18:54:47.476170+0000","last_undegraded":"2024-09-13T18:54:47.476170+0000","last_fullsized":"2024-09-13T18:54:47.476170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476236+0000","last_change":"2024-09-13T18:54:46.015831+0000","last_active":"2024-09-13T18:54:47.476236+0000","last_peered":"2024-09-13T18:54:47.476236+0000","last_clean":"2024-09-13T18:54:47.476236+0000","last_became_active":"2024-09-13T18:54:46.015508+0000","last_became_peered":"2024-09-13T18:54:46.015508+0000","last_unstale":"2024-09-13T18:54:47.476236+0000","last_undegraded":"2024-09-13T18:54:47.476236+0000","last_fullsized":"2024-09-13T18:54:47.476236+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:39.595023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.506041+0000","last_change":"2024-09-13T18:54:46.504572+0000","last_active":"2024-09-13T18:54:46.506041+0000","last_peered":"2024-09-13T18:54:46.506041+0000","last_clean":"2024-09-13T18:54:46.506041+0000","last_became_active":"2024-09-13T18:54:46.504183+0000","last_became_peered":"2024-09-13T18:54:46.504183+0000","last_unstale":"2024-09-13T18:54:46.506041+0000","last_undegraded":"2024-09-13T18:54:46.506041+0000","last_fullsized":"2024-09-13T18:54:46.506041+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:41.252117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473508+0000","last_change":"2024-09-13T18:54:46.007830+0000","last_active":"2024-09-13T18:54:47.473508+0000","last_peered":"2024-09-13T18:54:47.473508+0000","last_clean":"2024-09-13T18:54:47.473508+0000","last_became_active":"2024-09-13T18:54:46.007591+0000","last_became_peered":"2024-09-13T18:54:46.007591+0000","last_unstale":"2024-09-13T18:54:47.473508+0000","last_undegraded":"2024-09-13T18:54:47.473508+0000","last_fullsized":"2024-09-13T18:54:47.473508+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:14.796834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.487962+0000","last_change":"2024-09-13T18:54:46.484191+0000","last_active":"2024-09-13T18:54:46.487962+0000","last_peered":"2024-09-13T18:54:46.487962+0000","last_clean":"2024-09-13T18:54:46.487962+0000","last_became_active":"2024-09-13T18:54:46.483958+0000","last_became_peered":"2024-09-13T18:54:46.483958+0000","last_unstale":"2024-09-13T18:54:46.487962+0000","last_undegraded":"2024-09-13T18:54:46.487962+0000","last_fullsized":"2024-09-13T18:54:46.487962+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:27.604715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"106'1","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.941972+0000","last_change":"2024-09-13T18:54:46.015493+0000","last_active":"2024-09-13T18:54:47.941972+0000","last_peered":"2024-09-13T18:54:47.941972+0000","last_clean":"2024-09-13T18:54:47.941972+0000","last_became_active":"2024-09-13T18:54:46.015244+0000","last_became_peered":"2024-09-13T18:54:46.015244+0000","last_unstale":"2024-09-13T18:54:47.941972+0000","last_undegraded":"2024-09-13T18:54:47.941972+0000","last_fullsized":"2024-09-13T18:54:47.941972+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:35.668467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474327+0000","last_change":"2024-09-13T18:54:46.485136+0000","last_active":"2024-09-13T18:54:47.474327+0000","last_peered":"2024-09-13T18:54:47.474327+0000","last_clean":"2024-09-13T18:54:47.474327+0000","last_became_active":"2024-09-13T18:54:46.484455+0000","last_became_peered":"2024-09-13T18:54:46.484455+0000","last_unstale":"2024-09-13T18:54:47.474327+0000","last_undegraded":"2024-09-13T18:54:47.474327+0000","last_fullsized":"2024-09-13T18:54:47.474327+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:38.105928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.503458+0000","last_change":"2024-09-13T18:54:46.023159+0000","last_active":"2024-09-13T18:54:46.503458+0000","last_peered":"2024-09-13T18:54:46.503458+0000","last_clean":"2024-09-13T18:54:46.503458+0000","last_became_active":"2024-09-13T18:54:46.022847+0000","last_became_peered":"2024-09-13T18:54:46.022847+0000","last_unstale":"2024-09-13T18:54:46.503458+0000","last_undegraded":"2024-09-13T18:54:46.503458+0000","last_fullsized":"2024-09-13T18:54:46.503458+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:43.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498940+0000","last_change":"2024-09-13T18:54:46.491848+0000","last_active":"2024-09-13T18:54:46.498940+0000","last_peered":"2024-09-13T18:54:46.498940+0000","last_clean":"2024-09-13T18:54:46.498940+0000","last_became_active":"2024-09-13T18:54:46.491521+0000","last_became_peered":"2024-09-13T18:54:46.491521+0000","last_unstale":"2024-09-13T18:54:46.498940+0000","last_undegraded":"2024-09-13T18:54:46.498940+0000","last_fullsized":"2024-09-13T18:54:46.498940+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:29:53.567211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475823+0000","last_change":"2024-09-13T18:54:46.024025+0000","last_active":"2024-09-13T18:54:47.475823+0000","last_peered":"2024-09-13T18:54:47.475823+0000","last_clean":"2024-09-13T18:54:47.475823+0000","last_became_active":"2024-09-13T18:54:46.023771+0000","last_became_peered":"2024-09-13T18:54:46.023771+0000","last_unstale":"2024-09-13T18:54:47.475823+0000","last_undegraded":"2024-09-13T18:54:47.475823+0000","last_fullsized":"2024-09-13T18:54:47.475823+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:50.756834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.478609+0000","last_change":"2024-09-13T18:54:46.476401+0000","last_active":"2024-09-13T18:54:46.478609+0000","last_peered":"2024-09-13T18:54:46.478609+0000","last_clean":"2024-09-13T18:54:46.478609+0000","last_became_active":"2024-09-13T18:54:46.476157+0000","last_became_peered":"2024-09-13T18:54:46.476157+0000","last_unstale":"2024-09-13T18:54:46.478609+0000","last_undegraded":"2024-09-13T18:54:46.478609+0000","last_fullsized":"2024-09-13T18:54:46.478609+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:30.677709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.466485+0000","last_change":"2024-09-13T18:54:46.013107+0000","last_active":"2024-09-13T18:54:46.466485+0000","last_peered":"2024-09-13T18:54:46.466485+0000","last_clean":"2024-09-13T18:54:46.466485+0000","last_became_active":"2024-09-13T18:54:46.012814+0000","last_became_peered":"2024-09-13T18:54:46.012814+0000","last_unstale":"2024-09-13T18:54:46.466485+0000","last_undegraded":"2024-09-13T18:54:46.466485+0000","last_fullsized":"2024-09-13T18:54:46.466485+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:08.920659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473669+0000","last_change":"2024-09-13T18:54:46.491407+0000","last_active":"2024-09-13T18:54:47.473669+0000","last_peered":"2024-09-13T18:54:47.473669+0000","last_clean":"2024-09-13T18:54:47.473669+0000","last_became_active":"2024-09-13T18:54:46.491163+0000","last_became_peered":"2024-09-13T18:54:46.491163+0000","last_unstale":"2024-09-13T18:54:47.473669+0000","last_undegraded":"2024-09-13T18:54:47.473669+0000","last_fullsized":"2024-09-13T18:54:47.473669+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:00.843001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476346+0000","last_change":"2024-09-13T18:54:46.015851+0000","last_active":"2024-09-13T18:54:47.476346+0000","last_peered":"2024-09-13T18:54:47.476346+0000","last_clean":"2024-09-13T18:54:47.476346+0000","last_became_active":"2024-09-13T18:54:46.015523+0000","last_became_peered":"2024-09-13T18:54:46.015523+0000","last_unstale":"2024-09-13T18:54:47.476346+0000","last_undegraded":"2024-09-13T18:54:47.476346+0000","last_fullsized":"2024-09-13T18:54:47.476346+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:14.796834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473156+0000","last_change":"2024-09-13T18:54:46.491769+0000","last_active":"2024-09-13T18:54:47.473156+0000","last_peered":"2024-09-13T18:54:47.473156+0000","last_clean":"2024-09-13T18:54:47.473156+0000","last_became_active":"2024-09-13T18:54:46.488044+0000","last_became_peered":"2024-09-13T18:54:46.488044+0000","last_unstale":"2024-09-13T18:54:47.473156+0000","last_undegraded":"2024-09-13T18:54:47.473156+0000","last_fullsized":"2024-09-13T18:54:47.473156+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.936699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474273+0000","last_change":"2024-09-13T18:54:46.009532+0000","last_active":"2024-09-13T18:54:47.474273+0000","last_peered":"2024-09-13T18:54:47.474273+0000","last_clean":"2024-09-13T18:54:47.474273+0000","last_became_active":"2024-09-13T18:54:46.009276+0000","last_became_peered":"2024-09-13T18:54:46.009276+0000","last_unstale":"2024-09-13T18:54:47.474273+0000","last_undegraded":"2024-09-13T18:54:47.474273+0000","last_fullsized":"2024-09-13T18:54:47.474273+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:16:29.997172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499413+0000","last_change":"2024-09-13T18:54:46.490813+0000","last_active":"2024-09-13T18:54:46.499413+0000","last_peered":"2024-09-13T18:54:46.499413+0000","last_clean":"2024-09-13T18:54:46.499413+0000","last_became_active":"2024-09-13T18:54:46.490550+0000","last_became_peered":"2024-09-13T18:54:46.490550+0000","last_unstale":"2024-09-13T18:54:46.499413+0000","last_undegraded":"2024-09-13T18:54:46.499413+0000","last_fullsized":"2024-09-13T18:54:46.499413+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:53.501930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"106'3","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.942015+0000","last_change":"2024-09-13T18:54:46.014826+0000","last_active":"2024-09-13T18:54:47.942015+0000","last_peered":"2024-09-13T18:54:47.942015+0000","last_clean":"2024-09-13T18:54:47.942015+0000","last_became_active":"2024-09-13T18:54:46.014332+0000","last_became_peered":"2024-09-13T18:54:46.014332+0000","last_unstale":"2024-09-13T18:54:47.942015+0000","last_undegraded":"2024-09-13T18:54:47.942015+0000","last_fullsized":"2024-09-13T18:54:47.942015+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:24.652058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473283+0000","last_change":"2024-09-13T18:54:46.489066+0000","last_active":"2024-09-13T18:54:47.473283+0000","last_peered":"2024-09-13T18:54:47.473283+0000","last_clean":"2024-09-13T18:54:47.473283+0000","last_became_active":"2024-09-13T18:54:46.488607+0000","last_became_peered":"2024-09-13T18:54:46.488607+0000","last_unstale":"2024-09-13T18:54:47.473283+0000","last_undegraded":"2024-09-13T18:54:47.473283+0000","last_fullsized":"2024-09-13T18:54:47.473283+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:16.676485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"106'6","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.505765+0000","last_change":"2024-09-13T18:54:46.017537+0000","last_active":"2024-09-13T18:54:46.505765+0000","last_peered":"2024-09-13T18:54:46.505765+0000","last_clean":"2024-09-13T18:54:46.505765+0000","last_became_active":"2024-09-13T18:54:46.017267+0000","last_became_peered":"2024-09-13T18:54:46.017267+0000","last_unstale":"2024-09-13T18:54:46.505765+0000","last_undegraded":"2024-09-13T18:54:46.505765+0000","last_fullsized":"2024-09-13T18:54:46.505765+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:21.994921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.505034+0000","last_change":"2024-09-13T18:54:46.496287+0000","last_active":"2024-09-13T18:54:46.505034+0000","last_peered":"2024-09-13T18:54:46.505034+0000","last_clean":"2024-09-13T18:54:46.505034+0000","last_became_active":"2024-09-13T18:54:46.496031+0000","last_became_peered":"2024-09-13T18:54:46.496031+0000","last_unstale":"2024-09-13T18:54:46.505034+0000","last_undegraded":"2024-09-13T18:54:46.505034+0000","last_fullsized":"2024-09-13T18:54:46.505034+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:46.283120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473384+0000","last_change":"2024-09-13T18:54:46.017174+0000","last_active":"2024-09-13T18:54:47.473384+0000","last_peered":"2024-09-13T18:54:47.473384+0000","last_clean":"2024-09-13T18:54:47.473384+0000","last_became_active":"2024-09-13T18:54:46.016926+0000","last_became_peered":"2024-09-13T18:54:46.016926+0000","last_unstale":"2024-09-13T18:54:47.473384+0000","last_undegraded":"2024-09-13T18:54:47.473384+0000","last_fullsized":"2024-09-13T18:54:47.473384+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:10.603986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498848+0000","last_change":"2024-09-13T18:54:46.486687+0000","last_active":"2024-09-13T18:54:46.498848+0000","last_peered":"2024-09-13T18:54:46.498848+0000","last_clean":"2024-09-13T18:54:46.498848+0000","last_became_active":"2024-09-13T18:54:46.486303+0000","last_became_peered":"2024-09-13T18:54:46.486303+0000","last_unstale":"2024-09-13T18:54:46.498848+0000","last_undegraded":"2024-09-13T18:54:46.498848+0000","last_fullsized":"2024-09-13T18:54:46.498848+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:28.266107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.466831+0000","last_change":"2024-09-13T18:54:46.020838+0000","last_active":"2024-09-13T18:54:46.466831+0000","last_peered":"2024-09-13T18:54:46.466831+0000","last_clean":"2024-09-13T18:54:46.466831+0000","last_became_active":"2024-09-13T18:54:46.020595+0000","last_became_peered":"2024-09-13T18:54:46.020595+0000","last_unstale":"2024-09-13T18:54:46.466831+0000","last_undegraded":"2024-09-13T18:54:46.466831+0000","last_fullsized":"2024-09-13T18:54:46.466831+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:15.660445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499695+0000","last_change":"2024-09-13T18:54:46.493801+0000","last_active":"2024-09-13T18:54:46.499695+0000","last_peered":"2024-09-13T18:54:46.499695+0000","last_clean":"2024-09-13T18:54:46.499695+0000","last_became_active":"2024-09-13T18:54:46.493449+0000","last_became_peered":"2024-09-13T18:54:46.493449+0000","last_unstale":"2024-09-13T18:54:46.499695+0000","last_undegraded":"2024-09-13T18:54:46.499695+0000","last_fullsized":"2024-09-13T18:54:46.499695+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:45.900463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480298+0000","last_change":"2024-09-13T18:54:46.017479+0000","last_active":"2024-09-13T18:54:46.480298+0000","last_peered":"2024-09-13T18:54:46.480298+0000","last_clean":"2024-09-13T18:54:46.480298+0000","last_became_active":"2024-09-13T18:54:46.017227+0000","last_became_peered":"2024-09-13T18:54:46.017227+0000","last_unstale":"2024-09-13T18:54:46.480298+0000","last_undegraded":"2024-09-13T18:54:46.480298+0000","last_fullsized":"2024-09-13T18:54:46.480298+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.339566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474451+0000","last_change":"2024-09-13T18:54:46.485546+0000","last_active":"2024-09-13T18:54:47.474451+0000","last_peered":"2024-09-13T18:54:47.474451+0000","last_clean":"2024-09-13T18:54:47.474451+0000","last_became_active":"2024-09-13T18:54:46.485155+0000","last_became_peered":"2024-09-13T18:54:46.485155+0000","last_unstale":"2024-09-13T18:54:47.474451+0000","last_undegraded":"2024-09-13T18:54:47.474451+0000","last_fullsized":"2024-09-13T18:54:47.474451+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:03.225646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"106'8","reported_seq":19,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475895+0000","last_change":"2024-09-13T18:54:46.016627+0000","last_active":"2024-09-13T18:54:47.475895+0000","last_peered":"2024-09-13T18:54:47.475895+0000","last_clean":"2024-09-13T18:54:47.475895+0000","last_became_active":"2024-09-13T18:54:46.016363+0000","last_became_peered":"2024-09-13T18:54:46.016363+0000","last_unstale":"2024-09-13T18:54:47.475895+0000","last_undegraded":"2024-09-13T18:54:47.475895+0000","last_fullsized":"2024-09-13T18:54:47.475895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:37.935157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.495159+0000","last_change":"2024-09-13T18:54:46.484224+0000","last_active":"2024-09-13T18:54:46.495159+0000","last_peered":"2024-09-13T18:54:46.495159+0000","last_clean":"2024-09-13T18:54:46.495159+0000","last_became_active":"2024-09-13T18:54:46.483983+0000","last_became_peered":"2024-09-13T18:54:46.483983+0000","last_unstale":"2024-09-13T18:54:46.495159+0000","last_undegraded":"2024-09-13T18:54:46.495159+0000","last_fullsized":"2024-09-13T18:54:46.495159+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:43.496098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.505817+0000","last_change":"2024-09-13T18:54:46.017600+0000","last_active":"2024-09-13T18:54:46.505817+0000","last_peered":"2024-09-13T18:54:46.505817+0000","last_clean":"2024-09-13T18:54:46.505817+0000","last_became_active":"2024-09-13T18:54:46.017359+0000","last_became_peered":"2024-09-13T18:54:46.017359+0000","last_unstale":"2024-09-13T18:54:46.505817+0000","last_undegraded":"2024-09-13T18:54:46.505817+0000","last_fullsized":"2024-09-13T18:54:46.505817+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:03.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.498838+0000","last_change":"2024-09-13T18:54:46.485767+0000","last_active":"2024-09-13T18:54:46.498838+0000","last_peered":"2024-09-13T18:54:46.498838+0000","last_clean":"2024-09-13T18:54:46.498838+0000","last_became_active":"2024-09-13T18:54:46.485442+0000","last_became_peered":"2024-09-13T18:54:46.485442+0000","last_unstale":"2024-09-13T18:54:46.498838+0000","last_undegraded":"2024-09-13T18:54:46.498838+0000","last_fullsized":"2024-09-13T18:54:46.498838+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:54.228277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"106'1","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.942064+0000","last_change":"2024-09-13T18:54:46.016073+0000","last_active":"2024-09-13T18:54:47.942064+0000","last_peered":"2024-09-13T18:54:47.942064+0000","last_clean":"2024-09-13T18:54:47.942064+0000","last_became_active":"2024-09-13T18:54:46.015822+0000","last_became_peered":"2024-09-13T18:54:46.015822+0000","last_unstale":"2024-09-13T18:54:47.942064+0000","last_undegraded":"2024-09-13T18:54:47.942064+0000","last_fullsized":"2024-09-13T18:54:47.942064+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:25.890980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473199+0000","last_change":"2024-09-13T18:54:46.489083+0000","last_active":"2024-09-13T18:54:47.473199+0000","last_peered":"2024-09-13T18:54:47.473199+0000","last_clean":"2024-09-13T18:54:47.473199+0000","last_became_active":"2024-09-13T18:54:46.488779+0000","last_became_peered":"2024-09-13T18:54:46.488779+0000","last_unstale":"2024-09-13T18:54:47.473199+0000","last_undegraded":"2024-09-13T18:54:47.473199+0000","last_fullsized":"2024-09-13T18:54:47.473199+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:22.745950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.478977+0000","last_change":"2024-09-13T18:54:46.021219+0000","last_active":"2024-09-13T18:54:46.478977+0000","last_peered":"2024-09-13T18:54:46.478977+0000","last_clean":"2024-09-13T18:54:46.478977+0000","last_became_active":"2024-09-13T18:54:46.020947+0000","last_became_peered":"2024-09-13T18:54:46.020947+0000","last_unstale":"2024-09-13T18:54:46.478977+0000","last_undegraded":"2024-09-13T18:54:46.478977+0000","last_fullsized":"2024-09-13T18:54:46.478977+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:08.148893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474124+0000","last_change":"2024-09-13T18:54:46.476783+0000","last_active":"2024-09-13T18:54:47.474124+0000","last_peered":"2024-09-13T18:54:47.474124+0000","last_clean":"2024-09-13T18:54:47.474124+0000","last_became_active":"2024-09-13T18:54:46.476558+0000","last_became_peered":"2024-09-13T18:54:46.476558+0000","last_unstale":"2024-09-13T18:54:47.474124+0000","last_undegraded":"2024-09-13T18:54:47.474124+0000","last_fullsized":"2024-09-13T18:54:47.474124+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:54.784220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499678+0000","last_change":"2024-09-13T18:54:46.018897+0000","last_active":"2024-09-13T18:54:46.499678+0000","last_peered":"2024-09-13T18:54:46.499678+0000","last_clean":"2024-09-13T18:54:46.499678+0000","last_became_active":"2024-09-13T18:54:46.018649+0000","last_became_peered":"2024-09-13T18:54:46.018649+0000","last_unstale":"2024-09-13T18:54:46.499678+0000","last_undegraded":"2024-09-13T18:54:46.499678+0000","last_fullsized":"2024-09-13T18:54:46.499678+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:08.144872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474232+0000","last_change":"2024-09-13T18:54:46.486325+0000","last_active":"2024-09-13T18:54:47.474232+0000","last_peered":"2024-09-13T18:54:47.474232+0000","last_clean":"2024-09-13T18:54:47.474232+0000","last_became_active":"2024-09-13T18:54:46.486092+0000","last_became_peered":"2024-09-13T18:54:46.486092+0000","last_unstale":"2024-09-13T18:54:47.474232+0000","last_undegraded":"2024-09-13T18:54:47.474232+0000","last_fullsized":"2024-09-13T18:54:47.474232+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:09:19.733736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480173+0000","last_change":"2024-09-13T18:54:46.016317+0000","last_active":"2024-09-13T18:54:46.480173+0000","last_peered":"2024-09-13T18:54:46.480173+0000","last_clean":"2024-09-13T18:54:46.480173+0000","last_became_active":"2024-09-13T18:54:46.015594+0000","last_became_peered":"2024-09-13T18:54:46.015594+0000","last_unstale":"2024-09-13T18:54:46.480173+0000","last_undegraded":"2024-09-13T18:54:46.480173+0000","last_fullsized":"2024-09-13T18:54:46.480173+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:19.380206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.495874+0000","last_change":"2024-09-13T18:54:46.494314+0000","last_active":"2024-09-13T18:54:46.495874+0000","last_peered":"2024-09-13T18:54:46.495874+0000","last_clean":"2024-09-13T18:54:46.495874+0000","last_became_active":"2024-09-13T18:54:46.493957+0000","last_became_peered":"2024-09-13T18:54:46.493957+0000","last_unstale":"2024-09-13T18:54:46.495874+0000","last_undegraded":"2024-09-13T18:54:46.495874+0000","last_fullsized":"2024-09-13T18:54:46.495874+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:41.984213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.481473+0000","last_change":"2024-09-13T18:54:46.013735+0000","last_active":"2024-09-13T18:54:46.481473+0000","last_peered":"2024-09-13T18:54:46.481473+0000","last_clean":"2024-09-13T18:54:46.481473+0000","last_became_active":"2024-09-13T18:54:46.013439+0000","last_became_peered":"2024-09-13T18:54:46.013439+0000","last_unstale":"2024-09-13T18:54:46.481473+0000","last_undegraded":"2024-09-13T18:54:46.481473+0000","last_fullsized":"2024-09-13T18:54:46.481473+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:31:14.796834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499223+0000","last_change":"2024-09-13T18:54:46.489834+0000","last_active":"2024-09-13T18:54:46.499223+0000","last_peered":"2024-09-13T18:54:46.499223+0000","last_clean":"2024-09-13T18:54:46.499223+0000","last_became_active":"2024-09-13T18:54:46.489597+0000","last_became_peered":"2024-09-13T18:54:46.489597+0000","last_unstale":"2024-09-13T18:54:46.499223+0000","last_undegraded":"2024-09-13T18:54:46.499223+0000","last_fullsized":"2024-09-13T18:54:46.499223+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:20.038123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480774+0000","last_change":"2024-09-13T18:54:46.019010+0000","last_active":"2024-09-13T18:54:46.480774+0000","last_peered":"2024-09-13T18:54:46.480774+0000","last_clean":"2024-09-13T18:54:46.480774+0000","last_became_active":"2024-09-13T18:54:46.018813+0000","last_became_peered":"2024-09-13T18:54:46.018813+0000","last_unstale":"2024-09-13T18:54:46.480774+0000","last_undegraded":"2024-09-13T18:54:46.480774+0000","last_fullsized":"2024-09-13T18:54:46.480774+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:47.254008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473538+0000","last_change":"2024-09-13T18:54:46.480110+0000","last_active":"2024-09-13T18:54:47.473538+0000","last_peered":"2024-09-13T18:54:47.473538+0000","last_clean":"2024-09-13T18:54:47.473538+0000","last_became_active":"2024-09-13T18:54:46.479831+0000","last_became_peered":"2024-09-13T18:54:46.479831+0000","last_unstale":"2024-09-13T18:54:47.473538+0000","last_undegraded":"2024-09-13T18:54:47.473538+0000","last_fullsized":"2024-09-13T18:54:47.473538+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:15.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"106'2","reported_seq":13,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473812+0000","last_change":"2024-09-13T18:54:46.018617+0000","last_active":"2024-09-13T18:54:47.473812+0000","last_peered":"2024-09-13T18:54:47.473812+0000","last_clean":"2024-09-13T18:54:47.473812+0000","last_became_active":"2024-09-13T18:54:46.018396+0000","last_became_peered":"2024-09-13T18:54:46.018396+0000","last_unstale":"2024-09-13T18:54:47.473812+0000","last_undegraded":"2024-09-13T18:54:47.473812+0000","last_fullsized":"2024-09-13T18:54:47.473812+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:03.873960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.475803+0000","last_change":"2024-09-13T18:54:46.487610+0000","last_active":"2024-09-13T18:54:47.475803+0000","last_peered":"2024-09-13T18:54:47.475803+0000","last_clean":"2024-09-13T18:54:47.475803+0000","last_became_active":"2024-09-13T18:54:46.486314+0000","last_became_peered":"2024-09-13T18:54:46.486314+0000","last_unstale":"2024-09-13T18:54:47.475803+0000","last_undegraded":"2024-09-13T18:54:47.475803+0000","last_fullsized":"2024-09-13T18:54:47.475803+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:17.875596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.474317+0000","last_change":"2024-09-13T18:54:46.015372+0000","last_active":"2024-09-13T18:54:47.474317+0000","last_peered":"2024-09-13T18:54:47.474317+0000","last_clean":"2024-09-13T18:54:47.474317+0000","last_became_active":"2024-09-13T18:54:46.015074+0000","last_became_peered":"2024-09-13T18:54:46.015074+0000","last_unstale":"2024-09-13T18:54:47.474317+0000","last_undegraded":"2024-09-13T18:54:47.474317+0000","last_fullsized":"2024-09-13T18:54:47.474317+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:56.002491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.489170+0000","last_change":"2024-09-13T18:54:46.485212+0000","last_active":"2024-09-13T18:54:46.489170+0000","last_peered":"2024-09-13T18:54:46.489170+0000","last_clean":"2024-09-13T18:54:46.489170+0000","last_became_active":"2024-09-13T18:54:46.484958+0000","last_became_peered":"2024-09-13T18:54:46.484958+0000","last_unstale":"2024-09-13T18:54:46.489170+0000","last_undegraded":"2024-09-13T18:54:46.489170+0000","last_fullsized":"2024-09-13T18:54:46.489170+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:55:43.168461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.481327+0000","last_change":"2024-09-13T18:54:46.013306+0000","last_active":"2024-09-13T18:54:46.481327+0000","last_peered":"2024-09-13T18:54:46.481327+0000","last_clean":"2024-09-13T18:54:46.481327+0000","last_became_active":"2024-09-13T18:54:46.013047+0000","last_became_peered":"2024-09-13T18:54:46.013047+0000","last_unstale":"2024-09-13T18:54:46.481327+0000","last_undegraded":"2024-09-13T18:54:46.481327+0000","last_fullsized":"2024-09-13T18:54:46.481327+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:30.359614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.489494+0000","last_change":"2024-09-13T18:54:46.488853+0000","last_active":"2024-09-13T18:54:46.489494+0000","last_peered":"2024-09-13T18:54:46.489494+0000","last_clean":"2024-09-13T18:54:46.489494+0000","last_became_active":"2024-09-13T18:54:46.488560+0000","last_became_peered":"2024-09-13T18:54:46.488560+0000","last_unstale":"2024-09-13T18:54:46.489494+0000","last_undegraded":"2024-09-13T18:54:46.489494+0000","last_fullsized":"2024-09-13T18:54:46.489494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:50.250247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.473616+0000","last_change":"2024-09-13T18:54:46.018087+0000","last_active":"2024-09-13T18:54:47.473616+0000","last_peered":"2024-09-13T18:54:47.473616+0000","last_clean":"2024-09-13T18:54:47.473616+0000","last_became_active":"2024-09-13T18:54:46.017843+0000","last_became_peered":"2024-09-13T18:54:46.017843+0000","last_unstale":"2024-09-13T18:54:47.473616+0000","last_undegraded":"2024-09-13T18:54:47.473616+0000","last_fullsized":"2024-09-13T18:54:47.473616+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:30.359614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499640+0000","last_change":"2024-09-13T18:54:46.492606+0000","last_active":"2024-09-13T18:54:46.499640+0000","last_peered":"2024-09-13T18:54:46.499640+0000","last_clean":"2024-09-13T18:54:46.499640+0000","last_became_active":"2024-09-13T18:54:46.492364+0000","last_became_peered":"2024-09-13T18:54:46.492364+0000","last_unstale":"2024-09-13T18:54:46.499640+0000","last_undegraded":"2024-09-13T18:54:46.499640+0000","last_fullsized":"2024-09-13T18:54:46.499640+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:30.414147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.476302+0000","last_change":"2024-09-13T18:54:46.019402+0000","last_active":"2024-09-13T18:54:47.476302+0000","last_peered":"2024-09-13T18:54:47.476302+0000","last_clean":"2024-09-13T18:54:47.476302+0000","last_became_active":"2024-09-13T18:54:46.018265+0000","last_became_peered":"2024-09-13T18:54:46.018265+0000","last_unstale":"2024-09-13T18:54:47.476302+0000","last_undegraded":"2024-09-13T18:54:47.476302+0000","last_fullsized":"2024-09-13T18:54:47.476302+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:40.236078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499288+0000","last_change":"2024-09-13T18:54:46.489848+0000","last_active":"2024-09-13T18:54:46.499288+0000","last_peered":"2024-09-13T18:54:46.499288+0000","last_clean":"2024-09-13T18:54:46.499288+0000","last_became_active":"2024-09-13T18:54:46.489626+0000","last_became_peered":"2024-09-13T18:54:46.489626+0000","last_unstale":"2024-09-13T18:54:46.499288+0000","last_undegraded":"2024-09-13T18:54:46.499288+0000","last_fullsized":"2024-09-13T18:54:46.499288+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:40.738449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480468+0000","last_change":"2024-09-13T18:54:46.015435+0000","last_active":"2024-09-13T18:54:46.480468+0000","last_peered":"2024-09-13T18:54:46.480468+0000","last_clean":"2024-09-13T18:54:46.480468+0000","last_became_active":"2024-09-13T18:54:46.015197+0000","last_became_peered":"2024-09-13T18:54:46.015197+0000","last_unstale":"2024-09-13T18:54:46.480468+0000","last_undegraded":"2024-09-13T18:54:46.480468+0000","last_fullsized":"2024-09-13T18:54:46.480468+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:36.483667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":10,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-09-13T18:54:47.942278+0000","last_change":"2024-09-13T18:54:46.489077+0000","last_active":"2024-09-13T18:54:47.942278+0000","last_peered":"2024-09-13T18:54:47.942278+0000","last_clean":"2024-09-13T18:54:47.942278+0000","last_became_active":"2024-09-13T18:54:46.488739+0000","last_became_peered":"2024-09-13T18:54:46.488739+0000","last_unstale":"2024-09-13T18:54:47.942278+0000","last_undegraded":"2024-09-13T18:54:47.942278+0000","last_fullsized":"2024-09-13T18:54:47.942278+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:00.356405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.481574+0000","last_change":"2024-09-13T18:54:46.013248+0000","last_active":"2024-09-13T18:54:46.481574+0000","last_peered":"2024-09-13T18:54:46.481574+0000","last_clean":"2024-09-13T18:54:46.481574+0000","last_became_active":"2024-09-13T18:54:46.012946+0000","last_became_peered":"2024-09-13T18:54:46.012946+0000","last_unstale":"2024-09-13T18:54:46.481574+0000","last_undegraded":"2024-09-13T18:54:46.481574+0000","last_fullsized":"2024-09-13T18:54:46.481574+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:10.603986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.489296+0000","last_change":"2024-09-13T18:54:46.487466+0000","last_active":"2024-09-13T18:54:46.489296+0000","last_peered":"2024-09-13T18:54:46.489296+0000","last_clean":"2024-09-13T18:54:46.489296+0000","last_became_active":"2024-09-13T18:54:46.487194+0000","last_became_peered":"2024-09-13T18:54:46.487194+0000","last_unstale":"2024-09-13T18:54:46.489296+0000","last_undegraded":"2024-09-13T18:54:46.489296+0000","last_fullsized":"2024-09-13T18:54:46.489296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:49:40.611063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.480882+0000","last_change":"2024-09-13T18:54:46.018667+0000","last_active":"2024-09-13T18:54:46.480882+0000","last_peered":"2024-09-13T18:54:46.480882+0000","last_clean":"2024-09-13T18:54:46.480882+0000","last_became_active":"2024-09-13T18:54:46.018378+0000","last_became_peered":"2024-09-13T18:54:46.018378+0000","last_unstale":"2024-09-13T18:54:46.480882+0000","last_undegraded":"2024-09-13T18:54:46.480882+0000","last_fullsized":"2024-09-13T18:54:46.480882+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:16.610924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.499398+0000","last_change":"2024-09-13T18:54:46.495233+0000","last_active":"2024-09-13T18:54:46.499398+0000","last_peered":"2024-09-13T18:54:46.499398+0000","last_clean":"2024-09-13T18:54:46.499398+0000","last_became_active":"2024-09-13T18:54:46.494869+0000","last_became_peered":"2024-09-13T18:54:46.494869+0000","last_unstale":"2024-09-13T18:54:46.499398+0000","last_undegraded":"2024-09-13T18:54:46.499398+0000","last_fullsized":"2024-09-13T18:54:46.499398+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:45.976927+0000","last_clean_scrub_stamp":"2024-09-13T18:54:45.976927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:27:50.916859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.496668+0000","last_change":"2024-09-13T18:54:46.015281+0000","last_active":"2024-09-13T18:54:46.496668+0000","last_peered":"2024-09-13T18:54:46.496668+0000","last_clean":"2024-09-13T18:54:46.496668+0000","last_became_active":"2024-09-13T18:54:46.015020+0000","last_became_peered":"2024-09-13T18:54:46.015020+0000","last_unstale":"2024-09-13T18:54:46.496668+0000","last_undegraded":"2024-09-13T18:54:46.496668+0000","last_fullsized":"2024-09-13T18:54:46.496668+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:54:44.960887+0000","last_clean_scrub_stamp":"2024-09-13T18:54:44.960887+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:49.350836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-09-13T18:54:46.472454+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:54:46.472454+0000","last_peered":"2024-09-13T18:54:46.472454+0000","last_clean":"2024-09-13T18:54:46.472454+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:54:46.472454+0000","last_undegraded":"2024-09-13T18:54:46.472454+0000","last_fullsized":"2024-09-13T18:54:46.472454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574945,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32992,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338848,"statfs":{"total":96636764160,"available":96602980352,"internally_reserved":0,"allocated":1916928,"data_stored":1199189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.1140000000000001,"15min":1.099},"min":{"1min":0.76200000000000001,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.591},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.069,"15min":1.1160000000000001},"min":{"1min":0.753,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6160000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.2210000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.145,"15min":1.1399999999999999},"min":{"1min":0.80300000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.589,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.51},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.145,"15min":1.206},"min":{"1min":0.82199999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.492,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.3779999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.2669999999999999,"15min":1.3220000000000001},"min":{"1min":0.98099999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.6639999999999999,"5min":1.885,"15min":1.885},"last":1.548},{"interface":"front","average":{"1min":1.264,"5min":1.2110000000000001,"15min":1.2090000000000001},"min":{"1min":1.0209999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.5369999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.2989999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.274,"15min":1.2709999999999999},"min":{"1min":0.86199999999999999,"5min":0.80600000000000005,"15min":0.79000000000000004},"max":{"1min":1.536,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.008},{"interface":"front","average":{"1min":1.327,"5min":1.3340000000000001,"15min":1.417},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.548,"5min":1.861,"15min":2.2610000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.107,"15min":1.111},"min":{"1min":0.80300000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.456},{"interface":"front","average":{"1min":1.23,"5min":1.2310000000000001,"15min":1.1930000000000001},"min":{"1min":0.91700000000000004,"5min":0.751,"15min":0.63700000000000001},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":1.258}]},{"osd":5,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.93899999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.573,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.224},"min":{"1min":0.96899999999999997,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.599,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.1319999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:21 2024","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.391,"15min":1.399},"min":{"1min":0.86199999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":1.7549999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.395,"15min":1.413},"min":{"1min":1.0800000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.71,"5min":1.845,"15min":1.845},"last":1.4179999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1335296,"data_stored":610829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.105,"15min":1.1359999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.371},"max":{"1min":1.5840000000000001,"5min":1.619,"15min":3.0369999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.1000000000000001,"15min":1.1519999999999999},"min":{"1min":0.70999999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.2}]},{"osd":1,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.101,"15min":1.1120000000000001},"min":{"1min":0.754,"5min":0.68700000000000006,"15min":0.59799999999999998},"max":{"1min":1.526,"5min":1.5589999999999999,"15min":1.7849999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.177,"5min":1.167,"15min":1.1899999999999999},"min":{"1min":0.92900000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.5229999999999999,"5min":1.627,"15min":1.7470000000000001},"last":1.145}]},{"osd":2,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.151,"15min":1.3740000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.4330000000000001,"5min":1.47,"15min":3.7480000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.224,"5min":1.1879999999999999,"15min":1.417},"min":{"1min":0.90300000000000002,"5min":0.747,"15min":0.747},"max":{"1min":1.5700000000000001,"5min":1.5900000000000001,"15min":5.0490000000000004},"last":0.85799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.4570000000000001},"min":{"1min":0.94999999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.573,"5min":1.6339999999999999,"15min":4.883},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.272,"15min":1.4710000000000001},"min":{"1min":1.0529999999999999,"5min":0.89200000000000002,"15min":0.55000000000000004},"max":{"1min":1.534,"5min":1.6879999999999999,"15min":4.8630000000000004},"last":1.165}]},{"osd":4,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1539999999999999,"15min":1.2749999999999999},"min":{"1min":0.78000000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.474,"5min":1.7370000000000001,"15min":2.7229999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.23,"5min":1.2330000000000001,"15min":1.3169999999999999},"min":{"1min":0.85999999999999999,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4990000000000001,"5min":1.629,"15min":2.077},"last":1.03}]},{"osd":5,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2529999999999999,"15min":1.3819999999999999},"min":{"1min":0.85299999999999998,"5min":0.755,"15min":0.755},"max":{"1min":1.673,"5min":1.764,"15min":2.1699999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.375,"15min":1.46},"min":{"1min":1.1970000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6419999999999999,"5min":1.905,"15min":2.6030000000000002},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:54:18 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.3560000000000001,"15min":1.4450000000000001},"min":{"1min":1.042,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.7110000000000001,"5min":1.839,"15min":2.2120000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.355,"15min":1.4930000000000001},"min":{"1min":0.96399999999999997,"5min":0.79600000000000004,"15min":0.63700000000000001},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":2.367},"last":1.23}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1314816,"data_stored":608661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.0609999999999999,"15min":1.167},"min":{"1min":0.67700000000000005,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.4630000000000001,"5min":1.5209999999999999,"15min":2.0409999999999999},"last":1.119},{"interface":"front","average":{"1min":1.073,"5min":1.119,"15min":1.149},"min":{"1min":0.77400000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.528,"5min":1.5900000000000001,"15min":2.278},"last":0.95399999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.1639999999999999,"15min":1.246},"min":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4970000000000001,"5min":1.5589999999999999,"15min":1.9079999999999999},"last":1.248},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1319999999999999,"15min":1.1779999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":1.3420000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.1970000000000001,"15min":1.2689999999999999},"min":{"1min":0.85599999999999998,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.5289999999999999,"5min":1.6799999999999999,"15min":1.9059999999999999},"last":1.617},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.121,"15min":1.228},"min":{"1min":0.78600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.393,"5min":1.6080000000000001,"15min":2.157},"last":1.0109999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2450000000000001,"15min":1.3460000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":1.492,"5min":1.6160000000000001,"15min":2.0750000000000002},"last":1.159},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.2929999999999999,"15min":1.407},"min":{"1min":0.90300000000000002,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.534}]},{"osd":4,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.077,"15min":1.1890000000000001},"min":{"1min":0.82599999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3600000000000001,"5min":1.579,"15min":1.8500000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.107,"5min":1.1910000000000001,"15min":1.254},"min":{"1min":0.70099999999999996,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.3069999999999999,"5min":1.742,"15min":1.974},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.286},"min":{"1min":0.95499999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.619,"5min":1.669,"15min":2.0219999999999998},"last":1.698},{"interface":"front","average":{"1min":1.262,"5min":1.2370000000000001,"15min":1.329},"min":{"1min":1.0249999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.595,"5min":1.694,"15min":2.1739999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:54:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3700000000000001,"15min":1.415},"min":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":1.6100000000000001,"5min":1.7649999999999999,"15min":2.169},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4159999999999999,"15min":1.4910000000000001},"min":{"1min":0.995,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":2.8140000000000001},"last":1.4490000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1323008,"data_stored":608753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.1080000000000001,"15min":1.1220000000000001},"min":{"1min":0.70799999999999996,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.536,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.127,"5min":1.1419999999999999,"15min":1.1379999999999999},"min":{"1min":0.77100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.5580000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2350000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.2969999999999999,"15min":1.3480000000000001},"min":{"1min":0.89000000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.141,"5min":2.141,"15min":2.6930000000000001},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2410000000000001,"15min":1.3080000000000001},"min":{"1min":0.79900000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7669999999999999,"5min":1.806,"15min":2.423},"last":1.133}]},{"osd":2,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2250000000000001,"15min":1.2749999999999999},"min":{"1min":0.86499999999999999,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.99},"last":1.119},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.294,"15min":1.361},"min":{"1min":0.75900000000000001,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.6779999999999999,"5min":1.7370000000000001,"15min":2.335},"last":1.2}]},{"osd":3,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2090000000000001,"15min":1.288},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.6859999999999999,"5min":1.7689999999999999,"15min":2.621},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.2,"15min":1.2529999999999999},"min":{"1min":0.96599999999999997,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":0.91800000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1399999999999999,"15min":1.2709999999999999},"min":{"1min":0.82899999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6060000000000001,"5min":1.718,"15min":2.274},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.224,"15min":1.2989999999999999},"min":{"1min":0.878,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.266},"last":1.0860000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.2210000000000001,"15min":1.3280000000000001},"min":{"1min":0.81799999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.726,"5min":1.726,"15min":2.4710000000000001},"last":1.28},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3380000000000001,"15min":1.4330000000000001},"min":{"1min":0.93500000000000005,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":2.5},"last":1.335}]},{"osd":7,"last update":"Fri Sep 13 18:54:13 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.359,"15min":1.4430000000000001},"min":{"1min":1.038,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2360000000000002,"5min":2.2360000000000002,"15min":2.395},"last":1.161},{"interface":"front","average":{"1min":1.458,"5min":1.3640000000000001,"15min":1.4510000000000001},"min":{"1min":1.1399999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.8080000000000001,"5min":1.9059999999999999,"15min":2.415},"last":1.034}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1318912,"data_stored":609243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.877},"min":{"1min":0.48499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.329,"5min":1.331,"15min":1.4510000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.874},"min":{"1min":0.56499999999999995,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.264,"5min":1.444,"15min":1.444},"last":1.121}]},{"osd":1,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.85199999999999998,"15min":0.86699999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.069,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.93899999999999995,"15min":1.071},"min":{"1min":0.60199999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1200000000000001,"5min":1.464,"15min":4.0149999999999997},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.04,"15min":1.0069999999999999},"min":{"1min":0.50700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.1479999999999999,"15min":1.159},"min":{"1min":0.65300000000000002,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.5609999999999999,"5min":1.569,"15min":2.4729999999999999},"last":0.999}]},{"osd":4,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1859999999999999,"15min":1.228},"min":{"1min":0.95199999999999996,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4410000000000001,"5min":1.5329999999999999,"15min":1.6539999999999999},"last":1.046},{"interface":"front","average":{"1min":1.119,"5min":1.151,"15min":1.2170000000000001},"min":{"1min":0.89000000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.4470000000000001,"5min":1.554,"15min":1.8220000000000001},"last":1.151}]},{"osd":5,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.206,"15min":1.2909999999999999},"min":{"1min":0.89000000000000001,"5min":0.83899999999999997,"15min":0.81999999999999995},"max":{"1min":1.3959999999999999,"5min":1.613,"15min":2.0099999999999998},"last":1.2},{"interface":"front","average":{"1min":1.2,"5min":1.262,"15min":1.351},"min":{"1min":0.97699999999999998,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.4610000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.2949999999999999,"15min":1.403},"min":{"1min":1.181,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.4930000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.3700000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2729999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.522,"5min":1.8520000000000001,"15min":2.52},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.3029999999999999,"15min":1.47},"min":{"1min":1.0640000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6659999999999999,"5min":1.869,"15min":2.7799999999999998},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3049999999999999,"15min":1.409},"min":{"1min":0.97299999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.536,"5min":1.6339999999999999,"15min":1.9810000000000001},"last":1.075}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1318912,"data_stored":608695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.79100000000000004,"15min":0.93799999999999994},"min":{"1min":0.57999999999999996,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.872,"5min":0.81299999999999994,"15min":1.004},"min":{"1min":0.68000000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2370000000000001,"5min":1.54,"15min":4.6349999999999998},"last":1.286}]},{"osd":1,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.85499999999999998,"15min":1.073},"min":{"1min":0.59999999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.1819999999999999,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0680000000000001,"15min":1.194},"min":{"1min":0.80100000000000005,"5min":0.60199999999999998,"15min":0.59999999999999998},"max":{"1min":1.4399999999999999,"5min":1.762,"15min":4.7009999999999996},"last":0.92900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.1339999999999999,"15min":1.2769999999999999},"min":{"1min":0.79900000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.3939999999999999,"5min":1.7749999999999999,"15min":4.1920000000000002},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0369999999999999,"15min":1.1859999999999999},"min":{"1min":0.81599999999999995,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.51,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.68300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2070000000000001,"15min":1.5609999999999999},"min":{"1min":0.97199999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.615,"5min":1.615,"15min":8.6989999999999998},"last":1.091},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.244,"15min":1.4079999999999999},"min":{"1min":0.998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.6100000000000001,"5min":1.6739999999999999,"15min":4.7309999999999999},"last":1.1599999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.29,"15min":1.466},"min":{"1min":1.0980000000000001,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.659,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.002},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.24,"15min":1.4370000000000001},"min":{"1min":0.90600000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.579,"5min":1.7370000000000001,"15min":4.335},"last":1.1120000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.2809999999999999,"15min":1.4890000000000001},"min":{"1min":0.94799999999999995,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.536,"5min":1.5980000000000001,"15min":4.3730000000000002},"last":1.22},{"interface":"front","average":{"1min":1.323,"5min":1.258,"15min":1.6559999999999999},"min":{"1min":1.0409999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.2050000000000001,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.2509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:54:20 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.335,"15min":1.5169999999999999},"min":{"1min":1.129,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.5860000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.353},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3620000000000001,"15min":1.5649999999999999},"min":{"1min":1.0880000000000001,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.647,"5min":1.677,"15min":4.4050000000000002},"last":1.2769999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1318912,"data_stored":608695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.755,"15min":0.85499999999999998},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.996,"5min":1.377,"15min":2.2170000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81299999999999994,"15min":1.004},"min":{"1min":0.48799999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.2410000000000001,"5min":1.4630000000000001,"15min":6.1760000000000002},"last":0.84999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.03,"15min":1.155},"min":{"1min":0.625,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.4870000000000001,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.96899999999999997,"15min":1.05},"min":{"1min":0.52200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.288,"5min":1.804,"15min":2.6219999999999999},"last":0.78800000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.131,"15min":1.2769999999999999},"min":{"1min":0.71999999999999997,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.748,"5min":1.748,"15min":6.0919999999999996},"last":1.028},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0580000000000001,"15min":1.3440000000000001},"min":{"1min":0.78600000000000003,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.339,"5min":1.768,"15min":10.368},"last":0.90000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2310000000000001,"15min":1.3500000000000001},"min":{"1min":0.96499999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7689999999999999,"5min":1.8999999999999999,"15min":3.0739999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.254,"15min":1.341},"min":{"1min":0.96699999999999997,"5min":0.81399999999999995,"15min":0.80000000000000004},"max":{"1min":1.6919999999999999,"5min":1.958,"15min":2.911},"last":1.127}]},{"osd":5,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.242,"15min":1.637},"min":{"1min":1.0569999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5720000000000001,"5min":1.6499999999999999,"15min":10.214},"last":1.103},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.292,"15min":1.4410000000000001},"min":{"1min":0.85199999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.669,"5min":1.96,"15min":2.8849999999999998},"last":1.4059999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.2929999999999999,"15min":1.5229999999999999},"min":{"1min":0.90400000000000003,"5min":0.874,"15min":0.874},"max":{"1min":1.6279999999999999,"5min":1.915,"15min":6.032},"last":1.202},{"interface":"front","average":{"1min":1.353,"5min":1.298,"15min":1.6850000000000001},"min":{"1min":1.006,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":1.637,"5min":1.774,"15min":10.112},"last":1.381}]},{"osd":7,"last update":"Fri Sep 13 18:54:22 2024","interfaces":[{"interface":"back","average":{"1min":1.4370000000000001,"5min":1.379,"15min":1.752},"min":{"1min":1.0880000000000001,"5min":0.97599999999999998,"15min":0.81299999999999994},"max":{"1min":1.6240000000000001,"5min":1.7170000000000001,"15min":10.172000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.3520000000000001,"15min":1.5269999999999999},"min":{"1min":0.92400000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.643,"5min":1.8500000000000001,"15min":3.0299999999999998},"last":1.3560000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574943,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1925120,"data_stored":1200683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.75,"15min":0.94999999999999996},"min":{"1min":0.54200000000000004,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90500000000000003,"5min":1.405,"15min":4.2039999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.85999999999999999,"15min":0.97399999999999998},"min":{"1min":0.60699999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0249999999999999,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.89900000000000002,"15min":1.1000000000000001},"min":{"1min":0.67200000000000004,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.96699999999999997,"15min":1.165},"min":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.27,"5min":1.4410000000000001,"15min":3.5640000000000001},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.97199999999999998,"15min":1.149},"min":{"1min":0.56599999999999995,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":4.093},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.131,"15min":1.363},"min":{"1min":0.78600000000000003,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.4339999999999999,"5min":1.5800000000000001,"15min":4.7439999999999998},"last":0.81399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.2190000000000001,"15min":1.401},"min":{"1min":0.81000000000000005,"5min":0.745,"15min":0.745},"max":{"1min":1.4690000000000001,"5min":1.5640000000000001,"15min":3.4060000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.2250000000000001,"15min":1.409},"min":{"1min":0.92100000000000004,"5min":0.84099999999999997,"15min":0.82099999999999995},"max":{"1min":1.881,"5min":1.881,"15min":4.5449999999999999},"last":1.381}]},{"osd":5,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.278,"15min":1.548},"min":{"1min":0.95699999999999996,"5min":0.753,"15min":0.753},"max":{"1min":1.627,"5min":1.8029999999999999,"15min":4.9390000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.246,"15min":1.482},"min":{"1min":0.86299999999999999,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6160000000000001,"5min":1.675,"15min":3.2290000000000001},"last":1.232}]},{"osd":6,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2549999999999999,"15min":1.4930000000000001},"min":{"1min":0.86199999999999999,"5min":0.84499999999999997,"15min":0.83999999999999997},"max":{"1min":1.968,"5min":1.968,"15min":4.4569999999999999},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3129999999999999,"15min":1.6259999999999999},"min":{"1min":0.995,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.627,"5min":1.631,"15min":4.8570000000000002},"last":1.4710000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:54:16 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3320000000000001,"15min":1.5449999999999999},"min":{"1min":0.98499999999999999,"5min":0.873,"15min":0.86099999999999999},"max":{"1min":1.651,"5min":1.756,"15min":3.056},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3120000000000001,"15min":1.5609999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":2.149,"5min":2.149,"15min":4.5019999999999998},"last":1.45}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:54:51.327 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:54:51.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:54:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.537+0000 7f0d40a00700 1 Processor -- start 2024-09-13T18:54:51.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d40a00700 1 -- start start 2024-09-13T18:54:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d40a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c13f6e0 0x7f0d3c1644e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d40a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0ce8a0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d40a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0ceb80 con 0x7f0d3c0cc310 2024-09-13T18:54:51.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d40a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0cee60 con 0x7f0d3c13f6e0 2024-09-13T18:54:51.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d3aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0d3c0b2c10 0x7f0d3c13efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33904/0 (socket says 172.21.15.81:33904) 2024-09-13T18:54:51.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d3aa00700 1 -- 172.21.15.81:0/1396775390 learned_addr learned my addr 172.21.15.81:0/1396775390 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:51.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.541+0000 7f0d3be00700 1 --2- 172.21.15.81:0/1396775390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c13f6e0 0x7f0d3c1644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3a000700 1 -- 172.21.15.81:0/1396775390 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332632819 0 0) 0x7f0d3c0ce8a0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3a000700 1 -- 172.21.15.81:0/1396775390 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d200057e0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3be00700 1 -- 172.21.15.81:0/1396775390 >> v1:172.21.15.178:6789/0 conn(0x7f0d3c0cc310 legacy=0x7f0d3c0b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3a000700 1 -- 172.21.15.81:0/1396775390 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2108340694 0 0) 0x7f0d3c0ceb80 con 0x7f0d3c0cc310 2024-09-13T18:54:51.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3be00700 1 -- 172.21.15.81:0/1396775390 >> v1:172.21.15.81:6789/0 conn(0x7f0d3c0b2c10 legacy=0x7f0d3c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3be00700 1 -- 172.21.15.81:0/1396775390 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0cf140 con 0x7f0d3c13f6e0 2024-09-13T18:54:51.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3be00700 1 --2- 172.21.15.81:0/1396775390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c13f6e0 0x7f0d3c1644e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009dc0 tx=0x7f0d3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9984db535ca589a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3a000700 1 -- 172.21.15.81:0/1396775390 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400e070 con 0x7f0d3c13f6e0 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3a000700 1 -- 172.21.15.81:0/1396775390 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400bb20 con 0x7f0d3c13f6e0 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d3a000700 1 -- 172.21.15.81:0/1396775390 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400be90 con 0x7f0d3c13f6e0 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 -- 172.21.15.81:0/1396775390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c13f6e0 msgr2=0x7f0d3c1644e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1396775390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c13f6e0 0x7f0d3c1644e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0d34009dc0 tx=0x7f0d3400b330 comp rx=0 tx=0).stop 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 -- 172.21.15.81:0/1396775390 shutdown_connections 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1396775390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c13f6e0 0x7f0d3c1644e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 -- 172.21.15.81:0/1396775390 >> 172.21.15.81:0/1396775390 conn(0x7f0d3c06d750 msgr2=0x7f0d3c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 -- 172.21.15.81:0/1396775390 shutdown_connections 2024-09-13T18:54:51.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.545+0000 7f0d40a00700 1 -- 172.21.15.81:0/1396775390 wait complete. 2024-09-13T18:54:51.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 Processor -- start 2024-09-13T18:54:51.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 -- start start 2024-09-13T18:54:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 0x7f0d3c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c0cc310 0x7f0d3c13edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d3c13f6e0 0x7f0d3c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c15c600 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c13e030 con 0x7f0d3c13f6e0 2024-09-13T18:54:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c13e310 con 0x7f0d3c0cc310 2024-09-13T18:54:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 0x7f0d3c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 0x7f0d3c158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52804/0 (socket says 172.21.15.81:52804) 2024-09-13T18:54:51.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 -- 172.21.15.81:0/1706380410 learned_addr learned my addr 172.21.15.81:0/1706380410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3be00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d3c13f6e0 0x7f0d3c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3aa00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c0cc310 0x7f0d3c13edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 -- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c0cc310 msgr2=0x7f0d3c13edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c0cc310 0x7f0d3c13edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 -- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d3c13f6e0 msgr2=0x7f0d3c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d3c13f6e0 0x7f0d3c0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 -- 172.21.15.81:0/1706380410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d34009a70 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d3b400700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 0x7f0d3c158fc0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0011e0 tx=0x7f0d2c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0054e0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c0036a0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c13e5f0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.549+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c003a50 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.553+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c159500 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.553+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c0ceb80 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.553+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d2c003bb0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.557+0000 7f0d33400700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0d1c066760 0x7f0d1c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.557+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0d2c083840 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.557+0000 7f0d3aa00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0d1c066760 0x7f0d1c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:51.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.557+0000 7f0d3aa00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0d1c066760 0x7f0d1c068c20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c142ad0 tx=0x7f0d28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.561+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d2c0509d0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.797+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0d3c142820 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.805+0000 7f0d33400700 1 -- 172.21.15.81:0/1706380410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0d2c0170e0 con 0x7f0d3c0b2c10 2024-09-13T18:54:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0d1c066760 msgr2=0x7f0d1c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0d1c066760 0x7f0d1c068c20 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c142ad0 tx=0x7f0d28009040 comp rx=0 tx=0).stop 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 msgr2=0x7f0d3c158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 0x7f0d3c158fc0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c0011e0 tx=0x7f0d2c00cae0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 shutdown_connections 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0d1c066760 0x7f0d1c068c20 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d3c13f6e0 0x7f0d3c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d3c0cc310 0x7f0d3c13edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 --2- 172.21.15.81:0/1706380410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d3c0b2c10 0x7f0d3c158fc0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 >> 172.21.15.81:0/1706380410 conn(0x7f0d3c06d750 msgr2=0x7f0d3c0b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 shutdown_connections 2024-09-13T18:54:51.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:51.809+0000 7f0d40a00700 1 -- 172.21.15.81:0/1706380410 wait complete. 2024-09-13T18:54:51.823 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-13T18:54:51.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:51.962 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:54:51.949+0000 7fb8c9400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:54:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.001+0000 7f2640e00700 1 Processor -- start 2024-09-13T18:54:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.001+0000 7f2640e00700 1 -- start start 2024-09-13T18:54:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.001+0000 7f2640e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f263c15b500 0x7f263c06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2640e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c165a00 con 0x7f263c0b2620 2024-09-13T18:54:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2640e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c161940 con 0x7f263c0b5950 2024-09-13T18:54:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2640e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c161c20 con 0x7f263c15b500 2024-09-13T18:54:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2632a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f263c0b2620 0x7f263c164be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33906/0 (socket says 172.21.15.81:33906) 2024-09-13T18:54:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2632a00700 1 -- 172.21.15.81:0/3176714019 learned_addr learned my addr 172.21.15.81:0/3176714019 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:52.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263b400700 1 --2- 172.21.15.81:0/3176714019 >> v2:172.21.15.178:3300/0 conn(0x7f263c15b500 0x7f263c06cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263b400700 1 -- 172.21.15.81:0/3176714019 >> v1:172.21.15.178:6789/0 conn(0x7f263c0b5950 legacy=0x7f263c1652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263b400700 1 -- 172.21.15.81:0/3176714019 >> v1:172.21.15.81:6789/0 conn(0x7f263c0b2620 legacy=0x7f263c164be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263b400700 1 -- 172.21.15.81:0/3176714019 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c161f00 con 0x7f263c15b500 2024-09-13T18:54:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263aa00700 1 -- 172.21.15.81:0/3176714019 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503967223 0 0) 0x7f263c165a00 con 0x7f263c0b2620 2024-09-13T18:54:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263b400700 1 --2- 172.21.15.81:0/3176714019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c15b500 0x7f263c06cd90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f262c0097d0 tx=0x7f262c009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b90613e597f2fbd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263aa00700 1 -- 172.21.15.81:0/3176714019 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c004230 con 0x7f263c15b500 2024-09-13T18:54:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263aa00700 1 -- 172.21.15.81:0/3176714019 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262c004390 con 0x7f263c15b500 2024-09-13T18:54:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f263aa00700 1 -- 172.21.15.81:0/3176714019 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262c0036c0 con 0x7f263c15b500 2024-09-13T18:54:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2640e00700 1 -- 172.21.15.81:0/3176714019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c15b500 msgr2=0x7f263c06cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.005+0000 7f2640e00700 1 --2- 172.21.15.81:0/3176714019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c15b500 0x7f263c06cd90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f262c0097d0 tx=0x7f262c009ae0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 -- 172.21.15.81:0/3176714019 shutdown_connections 2024-09-13T18:54:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 --2- 172.21.15.81:0/3176714019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c15b500 0x7f263c06cd90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 -- 172.21.15.81:0/3176714019 >> 172.21.15.81:0/3176714019 conn(0x7f263c0b62a0 msgr2=0x7f263c071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 -- 172.21.15.81:0/3176714019 shutdown_connections 2024-09-13T18:54:52.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 -- 172.21.15.81:0/3176714019 wait complete. 2024-09-13T18:54:52.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 Processor -- start 2024-09-13T18:54:52.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.009+0000 7f2640e00700 1 -- start start 2024-09-13T18:54:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2640e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c0b2620 0x7f263c1f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2640e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 0x7f263c0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2640e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263c15b500 0x7f263c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2640e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1f6ef0 con 0x7f263c0b5950 2024-09-13T18:54:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2640e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1f7b20 con 0x7f263c0b2620 2024-09-13T18:54:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2640e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c154a40 con 0x7f263c15b500 2024-09-13T18:54:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 0x7f263c0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 0x7f263c0ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52808/0 (socket says 172.21.15.81:52808) 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 -- 172.21.15.81:0/2870677250 learned_addr learned my addr 172.21.15.81:0/2870677250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f263b400700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c0b2620 0x7f263c1f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f263be00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263c15b500 0x7f263c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 -- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263c15b500 msgr2=0x7f263c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263c15b500 0x7f263c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 -- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c0b2620 msgr2=0x7f263c1f75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c0b2620 0x7f263c1f75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 -- 172.21.15.81:0/2870677250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0094b0 con 0x7f263c0b5950 2024-09-13T18:54:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.013+0000 7f2632a00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 0x7f263c0ccdc0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f262400c580 tx=0x7f262400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624004ca0 con 0x7f263c0b5950 2024-09-13T18:54:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2624004e20 con 0x7f263c0b5950 2024-09-13T18:54:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624007310 con 0x7f263c0b5950 2024-09-13T18:54:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c154d20 con 0x7f263c0b5950 2024-09-13T18:54:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c1552e0 con 0x7f263c0b5950 2024-09-13T18:54:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c15b8e0 con 0x7f263c0b5950 2024-09-13T18:54:52.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.017+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2624007470 con 0x7f263c0b5950 2024-09-13T18:54:52.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.021+0000 7f2633e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2618066730 0x7f2618068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.021+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2624083f70 con 0x7f263c0b5950 2024-09-13T18:54:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.021+0000 7f263b400700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2618066730 0x7f2618068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.021+0000 7f263b400700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2618066730 0x7f2618068bf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f262c0097d0 tx=0x7f262c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.025+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2624051100 con 0x7f263c0b5950 2024-09-13T18:54:52.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.253+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f263c163460 con 0x7f263c0b5950 2024-09-13T18:54:52.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.257+0000 7f2633e00700 1 -- 172.21.15.81:0/2870677250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4745 (secure 0 0 0) 0x7f2624007720 con 0x7f263c0b5950 2024-09-13T18:54:52.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:52.267 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":105,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":7550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":8907,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:54:49.472998+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8910},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:54:52.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2618066730 msgr2=0x7f2618068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2618066730 0x7f2618068bf0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f262c0097d0 tx=0x7f262c010000 comp rx=0 tx=0).stop 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 msgr2=0x7f263c0ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 0x7f263c0ccdc0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f262400c580 tx=0x7f262400c890 comp rx=0 tx=0).stop 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 shutdown_connections 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2618066730 0x7f2618068bf0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263c15b500 0x7f263c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f263c0b5950 0x7f263c0ccdc0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 --2- 172.21.15.81:0/2870677250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f263c0b2620 0x7f263c1f75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 >> 172.21.15.81:0/2870677250 conn(0x7f263c0b62a0 msgr2=0x7f263c1608f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 shutdown_connections 2024-09-13T18:54:52.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.261+0000 7f2640e00700 1 -- 172.21.15.81:0/2870677250 wait complete. 2024-09-13T18:54:52.273 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 105 2024-09-13T18:54:52.699 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:54:46.454706+0000', 'modified': '2024-09-13T18:54:49.472998+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8910}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8910': {'gid': 8910, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2331750359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2331750359}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2331750359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:54:52.699 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:54:52.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:54:52.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 Processor -- start 2024-09-13T18:54:52.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 -- start start 2024-09-13T18:54:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e380b3a70 0x7f8e380cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e380d0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380b4d10 con 0x7f8e381446c0 2024-09-13T18:54:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380b3eb0 con 0x7f8e380b3a70 2024-09-13T18:54:52.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e40600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38144aa0 con 0x7f8e380cc650 2024-09-13T18:54:52.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e380d0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e380d0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:60850/0 (socket says 172.21.15.81:60850) 2024-09-13T18:54:52.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3d200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e380b3a70 0x7f8e380cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 -- 172.21.15.81:0/1578598947 learned_addr learned my addr 172.21.15.81:0/1578598947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 -- 172.21.15.81:0/1578598947 >> v2:172.21.15.178:3300/0 conn(0x7f8e380b3a70 msgr2=0x7f8e380cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e37e00700 1 -- 172.21.15.81:0/1578598947 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556936022 0 0) 0x7f8e380b4d10 con 0x7f8e381446c0 2024-09-13T18:54:52.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 --2- 172.21.15.81:0/1578598947 >> v2:172.21.15.178:3300/0 conn(0x7f8e380b3a70 0x7f8e380cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 -- 172.21.15.81:0/1578598947 >> v1:172.21.15.178:6789/0 conn(0x7f8e381446c0 legacy=0x7f8e380cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3e600700 1 -- 172.21.15.81:0/1578598947 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380b4100 con 0x7f8e380cc650 2024-09-13T18:54:52.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.869+0000 7f8e3d200700 1 --2- 172.21.15.81:0/1578598947 >> v2:172.21.15.178:3300/0 conn(0x7f8e380b3a70 0x7f8e380cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e3e600700 1 --2- 172.21.15.81:0/1578598947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e380d0af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009e50 tx=0x7f8e3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7490e4d3d86845 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e37e00700 1 -- 172.21.15.81:0/1578598947 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000e070 con 0x7f8e380cc650 2024-09-13T18:54:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e37e00700 1 -- 172.21.15.81:0/1578598947 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000b910 con 0x7f8e380cc650 2024-09-13T18:54:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e37e00700 1 -- 172.21.15.81:0/1578598947 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000bcc0 con 0x7f8e380cc650 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 -- 172.21.15.81:0/1578598947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 msgr2=0x7f8e380d0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 --2- 172.21.15.81:0/1578598947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e380d0af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8e30009e50 tx=0x7f8e3000b330 comp rx=0 tx=0).stop 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 -- 172.21.15.81:0/1578598947 shutdown_connections 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 --2- 172.21.15.81:0/1578598947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e380d0af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 --2- 172.21.15.81:0/1578598947 >> v2:172.21.15.178:3300/0 conn(0x7f8e380b3a70 0x7f8e380cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 -- 172.21.15.81:0/1578598947 >> 172.21.15.81:0/1578598947 conn(0x7f8e380726d0 msgr2=0x7f8e3806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 -- 172.21.15.81:0/1578598947 shutdown_connections 2024-09-13T18:54:52.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.873+0000 7f8e40600700 1 -- 172.21.15.81:0/1578598947 wait complete. 2024-09-13T18:54:52.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.877+0000 7f8e40600700 1 Processor -- start 2024-09-13T18:54:52.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.877+0000 7f8e40600700 1 -- start start 2024-09-13T18:54:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.877+0000 7f8e40600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 0x7f8e3813e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.877+0000 7f8e40600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e381f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.877+0000 7f8e40600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e381446c0 0x7f8e3815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.877+0000 7f8e40600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e381f6990 con 0x7f8e380b3a70 2024-09-13T18:54:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e40600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e381f6c70 con 0x7f8e381446c0 2024-09-13T18:54:52.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e40600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3815b300 con 0x7f8e380cc650 2024-09-13T18:54:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 0x7f8e3813e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e381f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 0x7f8e3813e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52814/0 (socket says 172.21.15.81:52814) 2024-09-13T18:54:52.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3dc00700 1 -- 172.21.15.81:0/1402342564 learned_addr learned my addr 172.21.15.81:0/1402342564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3e600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e381446c0 0x7f8e3815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 -- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e381446c0 msgr2=0x7f8e3815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e381446c0 0x7f8e3815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 -- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 msgr2=0x7f8e3813e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 0x7f8e3813e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 -- 172.21.15.81:0/1402342564 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240094b0 con 0x7f8e380cc650 2024-09-13T18:54:52.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 0x7f8e3813e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e3d200700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e381f6090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e9b0 tx=0x7f8e2400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e35600700 1 -- 172.21.15.81:0/1402342564 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400ee50 con 0x7f8e380cc650 2024-09-13T18:54:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e35600700 1 -- 172.21.15.81:0/1402342564 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400c850 con 0x7f8e380cc650 2024-09-13T18:54:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e30009b30 con 0x7f8e380cc650 2024-09-13T18:54:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e35600700 1 -- 172.21.15.81:0/1402342564 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400cc00 con 0x7f8e380cc650 2024-09-13T18:54:52.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.881+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e381f6f50 con 0x7f8e380cc650 2024-09-13T18:54:52.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.885+0000 7f8e35600700 1 -- 172.21.15.81:0/1402342564 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e24013470 con 0x7f8e380cc650 2024-09-13T18:54:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.885+0000 7f8e35600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e18066730 0x7f8e18068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.885+0000 7f8e35600700 1 -- 172.21.15.81:0/1402342564 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e240843a0 con 0x7f8e380cc650 2024-09-13T18:54:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.885+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e18066730 0x7f8e18068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e18066730 0x7f8e18068bf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c000f60 tx=0x7f8e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 Processor -- start 2024-09-13T18:54:52.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 -- start start 2024-09-13T18:54:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10150180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10118890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x101506c0 0x10118dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x10077d80 con 0x1014fda0 2024-09-13T18:54:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10075510 con 0x1012ed00 2024-09-13T18:54:52.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10070e00 con 0x101506c0 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52828/0 (socket says 172.21.15.81:52828) 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2748777926 learned_addr learned my addr 172.21.15.81:0/2748777926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e3d200700 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10118890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.889+0000 7f8e3e600700 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x101506c0 0x10118dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x101506c0 msgr2=0x10118dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x101506c0 0x10118dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 msgr2=0x10118890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10118890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2748777926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfee3960 con 0x1014fda0 2024-09-13T18:54:52.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3d200700 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10118890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:52.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10150180 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00fdb0 tx=0x7f8e2c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5f294705a40186 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e2a000700 1 -- 172.21.15.81:0/2748777926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0148e0 con 0x1014fda0 2024-09-13T18:54:52.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e2a000700 1 -- 172.21.15.81:0/2748777926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c014a40 con 0x1014fda0 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e2a000700 1 -- 172.21.15.81:0/2748777926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c014db0 con 0x1014fda0 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 -- 172.21.15.81:0/2748777926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 msgr2=0x10150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10150180 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00fdb0 tx=0x7f8e2c012000 comp rx=0 tx=0).stop 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 -- 172.21.15.81:0/2748777926 shutdown_connections 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x101506c0 0x10118dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10118890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2748777926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10150180 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 -- 172.21.15.81:0/2748777926 >> 172.21.15.81:0/2748777926 conn(0xfe984d0 msgr2=0x10131c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 -- 172.21.15.81:0/2748777926 shutdown_connections 2024-09-13T18:54:52.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 -- 172.21.15.81:0/2748777926 wait complete. 2024-09-13T18:54:52.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.893+0000 7f8e43a94740 1 -- start start 2024-09-13T18:54:52.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 Processor -- start 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10156290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1014fda0 0x10109400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 0x1014b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1002e730 con 0x101506c0 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x100345b0 con 0x1012ed00 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xff1caa0 con 0x1014fda0 2024-09-13T18:54:52.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 10 client.0 _ll_register_callbacks cb 0x1006a610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 0x1014b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 0x1014b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52842/0 (socket says 172.21.15.81:52842) 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 -- 172.21.15.81:0/1780344793 learned_addr learned my addr 172.21.15.81:0/1780344793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3d200700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1014fda0 0x10109400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 -- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1014fda0 msgr2=0x10109400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1014fda0 0x10109400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 -- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 msgr2=0x10156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 -- 172.21.15.81:0/1780344793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e381f6f50 con 0x101506c0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e3e600700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 0x1014b1b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f8e380d0ac0 tx=0x7f8e30004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454e814f34de1b86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e1ea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:52.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e1ea00700 1 -- 172.21.15.81:0/1780344793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30022070 con 0x101506c0 2024-09-13T18:54:52.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e1ea00700 1 -- 172.21.15.81:0/1780344793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e30028c10 con 0x101506c0 2024-09-13T18:54:52.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.897+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xfea51e0 con 0x101506c0 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e1ea00700 1 -- 172.21.15.81:0/1780344793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e30028dd0 con 0x101506c0 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 10 client.9054 fetch_fsmap learned FSMap version 105 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) v3 -- 0x7f8e2c00fa60 con 0x101506c0 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e1ea00700 1 -- 172.21.15.81:0/1780344793 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xfea51e0 con 0x101506c0 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e1ea00700 1 -- 172.21.15.81:0/1780344793 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 105) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8e30019070 con 0x101506c0 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 10 client.9054 fetch_fsmap finished waiting for FSMap version 105 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 10 client.9054 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 20 client.9054 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x10108340 0x10108720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 4 client.9054 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:52.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfeef460 con 0x10108340 2024-09-13T18:54:52.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x10108340 0x10108720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x10108340 0x10108720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3441c582c33fe82 server_cookie=4f5eaaa062aecbe8 in_seq=0 out_seq=0 2024-09-13T18:54:52.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e1ea00700 10 client.9054 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:52.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e1ea00700 1 -- 172.21.15.81:0/1780344793 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xfeef460 con 0x10108340 2024-09-13T18:54:52.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e1ea00700 10 client.9054 handle_command_reply: tid=0 2024-09-13T18:54:52.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 client.9054 shutdown 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 msgr2=0x1014b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 0x1014b1b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f8e380d0ac0 tx=0x7f8e30004b60 comp rx=0 tx=0).stop 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 shutdown_connections 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.901+0000 7f8e43a94740 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x10108340 0x10108720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x101506c0 0x1014b1b0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1014fda0 0x10109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e1ea00700 0 client.9054 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 1 --2- 172.21.15.81:0/1780344793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 >> 172.21.15.81:0/1780344793 conn(0xfe984d0 msgr2=0x1012b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 shutdown_connections 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 1 -- 172.21.15.81:0/1780344793 wait complete. 2024-09-13T18:54:52.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.905+0000 7f8e43a94740 20 client.9054 trim_cache size 0 max 16384 2024-09-13T18:54:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 Processor -- start 2024-09-13T18:54:52.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- start start 2024-09-13T18:54:52.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x10106900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x101498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10149e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1009fec0 con 0x1014fda0 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10032e90 con 0x1012ed00 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10017950 con 0xfe984d0 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x10106900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x10106900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:60894/0 (socket says 172.21.15.81:60894) 2024-09-13T18:54:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2384019421 learned_addr learned my addr 172.21.15.81:0/2384019421 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3d200700 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x101498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 msgr2=0x101498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x101498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2384019421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 msgr2=0x10149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 -- 172.21.15.81:0/2384019421 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1010ae20 con 0xfe984d0 2024-09-13T18:54:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x10106900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00fdb0 tx=0x7f8e2c015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291e82fe7fdb084 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e2aa00700 1 -- 172.21.15.81:0/2384019421 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c031d00 con 0xfe984d0 2024-09-13T18:54:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e2aa00700 1 -- 172.21.15.81:0/2384019421 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c031e60 con 0xfe984d0 2024-09-13T18:54:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e2aa00700 1 -- 172.21.15.81:0/2384019421 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c006a80 con 0xfe984d0 2024-09-13T18:54:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 msgr2=0x10106900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x10106900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00fdb0 tx=0x7f8e2c015000 comp rx=0 tx=0).stop 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- 172.21.15.81:0/2384019421 shutdown_connections 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x101498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 --2- 172.21.15.81:0/2384019421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x10106900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- 172.21.15.81:0/2384019421 >> 172.21.15.81:0/2384019421 conn(0x101593a0 msgr2=0x1014af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- 172.21.15.81:0/2384019421 shutdown_connections 2024-09-13T18:54:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.925+0000 7f8e43a94740 1 -- 172.21.15.81:0/2384019421 wait complete. 2024-09-13T18:54:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 -- start start 2024-09-13T18:54:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 Processor -- start 2024-09-13T18:54:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x101b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10109120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10109660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1010b330 con 0x1014fda0 2024-09-13T18:54:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1014c3a0 con 0x1012ed00 2024-09-13T18:54:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10100320 con 0xfe984d0 2024-09-13T18:54:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 10 client.0 _ll_register_callbacks cb 0x100c7710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x101b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3e600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52862/0 (socket says 172.21.15.81:52862) 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3e600700 1 -- 172.21.15.81:0/885328098 learned_addr learned my addr 172.21.15.81:0/885328098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3d200700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 -- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 msgr2=0x10109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10109120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 -- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 msgr2=0x10109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 -- 172.21.15.81:0/885328098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0xfee3960 con 0xfe984d0 2024-09-13T18:54:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3e600700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e3dc00700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x101b41c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02f000 tx=0x7f8e2c001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736653823851a9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e1ea00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2024-09-13T18:54:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e1ea00700 1 -- 172.21.15.81:0/885328098 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c006860 con 0xfe984d0 2024-09-13T18:54:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e1ea00700 1 -- 172.21.15.81:0/885328098 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e2c01c040 con 0xfe984d0 2024-09-13T18:54:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.929+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e2c014a40 con 0xfe984d0 2024-09-13T18:54:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 1 -- 172.21.15.81:0/885328098 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e2c031200 con 0xfe984d0 2024-09-13T18:54:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 10 client.7643 fetch_fsmap learned FSMap version 105 2024-09-13T18:54:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) v3 -- 0x10037220 con 0xfe984d0 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 1 -- 172.21.15.81:0/885328098 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c014a40 con 0xfe984d0 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 1 -- 172.21.15.81:0/885328098 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 105) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8e2c043020 con 0xfe984d0 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 10 client.7643 fetch_fsmap finished waiting for FSMap version 105 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 10 client.7643 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 20 client.7643 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x101506c0 0x10153b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 4 client.7643 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "status"}) v1 -- 0xff141e0 con 0x101506c0 2024-09-13T18:54:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e3d200700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x101506c0 0x10153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 10 client.7643 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e3d200700 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x101506c0 0x10153b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab24e3f75978714 server_cookie=806363dff8db1ce in_seq=0 out_seq=0 2024-09-13T18:54:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 1 -- 172.21.15.81:0/885328098 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0xff141e0 con 0x101506c0 2024-09-13T18:54:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 10 client.7643 handle_command_reply: tid=0 2024-09-13T18:54:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 client.7643 shutdown 2024-09-13T18:54:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 msgr2=0x101b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x101b41c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c02f000 tx=0x7f8e2c001080 comp rx=0 tx=0).stop 2024-09-13T18:54:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 shutdown_connections 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x101506c0 0x10153b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1014fda0 0x10109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e1ea00700 0 client.7643 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1012ed00 0x10109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 --2- 172.21.15.81:0/885328098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xfe984d0 0x101b41c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 >> 172.21.15.81:0/885328098 conn(0x101593a0 msgr2=0x1014e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 shutdown_connections 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 1 -- 172.21.15.81:0/885328098 wait complete. 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e43a94740 20 client.7643 trim_cache size 0 max 16384 2024-09-13T18:54:52.947 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8910, 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 6.4807526409999996, 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 105, 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 107, 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 11.727370034 2024-09-13T18:54:52.948 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e18066730 msgr2=0x7f8e18068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e18066730 0x7f8e18068bf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c000f60 tx=0x7f8e2c009040 comp rx=0 tx=0).stop 2024-09-13T18:54:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 msgr2=0x7f8e381f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e381f6090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400e9b0 tx=0x7f8e2400ecc0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 shutdown_connections 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8e18066730 0x7f8e18068bf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e381446c0 0x7f8e3815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380cc650 0x7f8e381f6090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 --2- 172.21.15.81:0/1402342564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e380b3a70 0x7f8e3813e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 >> 172.21.15.81:0/1402342564 conn(0x7f8e380726d0 msgr2=0x7f8e3806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 shutdown_connections 2024-09-13T18:54:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:52.937+0000 7f8e40600700 1 -- 172.21.15.81:0/1402342564 wait complete. 2024-09-13T18:54:52.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:54:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 Processor -- start 2024-09-13T18:54:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 -- start start 2024-09-13T18:54:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a3c1610b0 0x7f0a3c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c06aaa0 0x7f0a3c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3c0b3560 con 0x7f0a3c0b2670 2024-09-13T18:54:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3c070b30 con 0x7f0a3c1610b0 2024-09-13T18:54:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a42a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c06b420 con 0x7f0a3c06aaa0 2024-09-13T18:54:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a3c1610b0 0x7f0a3c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0a3c1610b0 0x7f0a3c0719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52876/0 (socket says 172.21.15.81:52876) 2024-09-13T18:54:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 -- 172.21.15.81:0/4047462469 learned_addr learned my addr 172.21.15.81:0/4047462469 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a40c00700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c06aaa0 0x7f0a3c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 -- 172.21.15.81:0/4047462469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c06aaa0 msgr2=0x7f0a3c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c06aaa0 0x7f0a3c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 -- 172.21.15.81:0/4047462469 >> v1:172.21.15.178:6789/0 conn(0x7f0a3c0b2670 legacy=0x7f0a3c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a41600700 1 -- 172.21.15.81:0/4047462469 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0b3280 con 0x7f0a3c1610b0 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.125+0000 7f0a40c00700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c06aaa0 0x7f0a3c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a41600700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c1610b0 0x7f0a3c0719c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009910 tx=0x7f0a30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a9e000aebdbbd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a3be00700 1 -- 172.21.15.81:0/4047462469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30004230 con 0x7f0a3c1610b0 2024-09-13T18:54:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a3be00700 1 -- 172.21.15.81:0/4047462469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a30004390 con 0x7f0a3c1610b0 2024-09-13T18:54:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a3be00700 1 -- 172.21.15.81:0/4047462469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30009e60 con 0x7f0a3c1610b0 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 -- 172.21.15.81:0/4047462469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c1610b0 msgr2=0x7f0a3c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c1610b0 0x7f0a3c0719c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009910 tx=0x7f0a30009c20 comp rx=0 tx=0).stop 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 -- 172.21.15.81:0/4047462469 shutdown_connections 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c06aaa0 0x7f0a3c06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 --2- 172.21.15.81:0/4047462469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c1610b0 0x7f0a3c0719c0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 -- 172.21.15.81:0/4047462469 >> 172.21.15.81:0/4047462469 conn(0x7f0a3c0b0c40 msgr2=0x7f0a3c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 -- 172.21.15.81:0/4047462469 shutdown_connections 2024-09-13T18:54:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.129+0000 7f0a42a00700 1 -- 172.21.15.81:0/4047462469 wait complete. 2024-09-13T18:54:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 Processor -- start 2024-09-13T18:54:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 -- start start 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a3c06aaa0 0x7f0a3c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 0x7f0a3c1f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c1610b0 0x7f0a3c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c0aac60 con 0x7f0a3c0b2670 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c1faea0 con 0x7f0a3c06aaa0 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3c15e070 con 0x7f0a3c1610b0 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a40c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 0x7f0a3c1f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a40c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 0x7f0a3c1f7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52884/0 (socket says 172.21.15.81:52884) 2024-09-13T18:54:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a40c00700 1 -- 172.21.15.81:0/1394556866 learned_addr learned my addr 172.21.15.81:0/1394556866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a41600700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a3c06aaa0 0x7f0a3c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.133+0000 7f0a42000700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c1610b0 0x7f0a3c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a40c00700 1 -- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c1610b0 msgr2=0x7f0a3c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a40c00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c1610b0 0x7f0a3c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a40c00700 1 -- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a3c06aaa0 msgr2=0x7f0a3c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a40c00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a3c06aaa0 0x7f0a3c15db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a40c00700 1 -- 172.21.15.81:0/1394556866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30009570 con 0x7f0a3c0b2670 2024-09-13T18:54:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a40c00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 0x7f0a3c1f7b40 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c7f0 tx=0x7f0a2800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28011800 con 0x7f0a3c0b2670 2024-09-13T18:54:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28011960 con 0x7f0a3c0b2670 2024-09-13T18:54:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28011cf0 con 0x7f0a3c0b2670 2024-09-13T18:54:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a3c0aa2c0 con 0x7f0a3c0b2670 2024-09-13T18:54:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3c0aa880 con 0x7f0a3c0b2670 2024-09-13T18:54:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.137+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3c161570 con 0x7f0a3c0b2670 2024-09-13T18:54:53.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.141+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a28021350 con 0x7f0a3c0b2670 2024-09-13T18:54:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.141+0000 7f0a39600700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a1c066730 0x7f0a1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:53.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.141+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a28084110 con 0x7f0a3c0b2670 2024-09-13T18:54:53.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.141+0000 7f0a41600700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a1c066730 0x7f0a1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:53.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.141+0000 7f0a41600700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a1c066730 0x7f0a1c068bf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009910 tx=0x7f0a30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:53.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.149+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a280512b0 con 0x7f0a3c0b2670 2024-09-13T18:54:53.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.377+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0a3c0ae080 con 0x7f0a3c0b2670 2024-09-13T18:54:53.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.377+0000 7f0a39600700 1 -- 172.21.15.81:0/1394556866 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v105) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0a280548d0 con 0x7f0a3c0b2670 2024-09-13T18:54:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a1c066730 msgr2=0x7f0a1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a1c066730 0x7f0a1c068bf0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009910 tx=0x7f0a30008030 comp rx=0 tx=0).stop 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 msgr2=0x7f0a3c1f7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 0x7f0a3c1f7b40 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c7f0 tx=0x7f0a2800cb00 comp rx=0 tx=0).stop 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 shutdown_connections 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0a1c066730 0x7f0a1c068bf0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a3c1610b0 0x7f0a3c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3c0b2670 0x7f0a3c1f7b40 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 --2- 172.21.15.81:0/1394556866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a3c06aaa0 0x7f0a3c15db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 >> 172.21.15.81:0/1394556866 conn(0x7f0a3c0b0c40 msgr2=0x7f0a3c163790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:53.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 shutdown_connections 2024-09-13T18:54:53.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:53.381+0000 7f0a42a00700 1 -- 172.21.15.81:0/1394556866 wait complete. 2024-09-13T18:54:53.413 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:54:53.413 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:54:53.413 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-13T18:54:53.413 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:54:53.413 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:54:53.413 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:54:53.414 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:54:53.414 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:54:53.414 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:54:53.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.414 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-13T18:54:53.429 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:54:53.429 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:54:53.430 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41999sec preferred_lft 41999sec 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 02:42:84:c7:1c:ec brd ff:ff:ff:ff:ff:ff 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.431 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c871:22ff:fea9:8fa0/64 scope link 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 72:64:ab:42:5b:46 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::7064:abff:fe42:5b46/64 scope link 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 32:69:26:fd:ea:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::3069:26ff:fefd:eadb/64 scope link 2024-09-13T18:54:53.432 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:54:53.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.433 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:54:53.507 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-13T18:54:53.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.511 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-13T18:54:53.578 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-13T18:54:53.578 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:54:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:54:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:54:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:54:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:54:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:54:53.579 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:54:53.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.580 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-09-13T18:54:53.580 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-13T18:54:53.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:54:53.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:54:53.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:54:53.581 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-13T18:54:53.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.722 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:54:53.737 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:54:53.737 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:54:53.738 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:54:53.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-13T18:54:53.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:54:53.821 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:54:53.881 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:54:53.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:54:53.881 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:54:53.938 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:54:53.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:53.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:54:54.094 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:54:54.095 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:54:54.095 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-09-13T18:54:54.095 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a8432ea3-e34b-45da-88c0-4120757fcc5d.cephfs=/ 2024-09-13T18:54:54.095 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.178:3300/172.21.15.178:3301" will pass to kernel 2024-09-13T18:54:54.102 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:54:54.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:54.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:54:54.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:54.133 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:54:54.209 INFO:teuthology.orchestra.run.smithi081.stdout:client8602 2024-09-13T18:54:54.209 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:54:54.209 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:54:54.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:54:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 Processor -- start 2024-09-13T18:54:54.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 -- start start 2024-09-13T18:54:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe77c15aa30 0x7fe77c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c071970 con 0x7fe77c0b1840 2024-09-13T18:54:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c06b4d0 con 0x7fe77c15aa30 2024-09-13T18:54:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c06b790 con 0x7fe77c071e00 2024-09-13T18:54:54.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe77c0b1840 0x7fe77c066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33914/0 (socket says 172.21.15.81:33914) 2024-09-13T18:54:54.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77b400700 1 -- 172.21.15.81:0/1067352250 learned_addr learned my addr 172.21.15.81:0/1067352250 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:54.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77aa00700 1 --2- 172.21.15.81:0/1067352250 >> v2:172.21.15.178:3300/0 conn(0x7fe77c15aa30 0x7fe77c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:54.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77a000700 1 --2- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe779600700 1 -- 172.21.15.81:0/1067352250 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292623548 0 0) 0x7fe77c071970 con 0x7fe77c0b1840 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe779600700 1 -- 172.21.15.81:0/1067352250 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7600035d0 con 0x7fe77c0b1840 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77aa00700 1 -- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 msgr2=0x7fe77c0722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77aa00700 1 --2- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77aa00700 1 -- 172.21.15.81:0/1067352250 >> v1:172.21.15.81:6789/0 conn(0x7fe77c0b1840 legacy=0x7fe77c066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77aa00700 1 -- 172.21.15.81:0/1067352250 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c071600 con 0x7fe77c15aa30 2024-09-13T18:54:54.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.489+0000 7fe77aa00700 1 --2- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c0cc430 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009850 tx=0x7fe76c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bff661ae91379baf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe779600700 1 -- 172.21.15.81:0/1067352250 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c011830 con 0x7fe77c15aa30 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe779600700 1 -- 172.21.15.81:0/1067352250 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c011990 con 0x7fe77c15aa30 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe779600700 1 -- 172.21.15.81:0/1067352250 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c011d00 con 0x7fe77c15aa30 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 -- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 msgr2=0x7fe77c0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 --2- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c0cc430 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009850 tx=0x7fe76c009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 -- 172.21.15.81:0/1067352250 shutdown_connections 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 --2- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:54.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 --2- 172.21.15.81:0/1067352250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c0cc430 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 -- 172.21.15.81:0/1067352250 >> 172.21.15.81:0/1067352250 conn(0x7fe77c06cb90 msgr2=0x7fe77c06cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 -- 172.21.15.81:0/1067352250 shutdown_connections 2024-09-13T18:54:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 -- 172.21.15.81:0/1067352250 wait complete. 2024-09-13T18:54:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 Processor -- start 2024-09-13T18:54:54.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.493+0000 7fe77be00700 1 -- start start 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 0x7fe77c149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c14a8c0 con 0x7fe77c0b1840 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0a92d0 con 0x7fe77c15aa30 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0a95b0 con 0x7fe77c071e00 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 0x7fe77c149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 0x7fe77c149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52888/0 (socket says 172.21.15.81:52888) 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 -- 172.21.15.81:0/2005694901 learned_addr learned my addr 172.21.15.81:0/2005694901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77aa00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77b400700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 -- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 msgr2=0x7fe77c0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 -- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 msgr2=0x7fe77c14a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c14a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 -- 172.21.15.81:0/2005694901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0094b0 con 0x7fe77c0b1840 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77b400700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77a000700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 0x7fe77c149e40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fe76800e9a0 tx=0x7fe76800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe768009720 con 0x7fe77c0b1840 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76800c850 con 0x7fe77c0b1840 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76800cbe0 con 0x7fe77c0b1840 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c0a9890 con 0x7fe77c0b1840 2024-09-13T18:54:54.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.497+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c0addd0 con 0x7fe77c0b1840 2024-09-13T18:54:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.501+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c0722a0 con 0x7fe77c0b1840 2024-09-13T18:54:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.501+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe76800cd40 con 0x7fe77c0b1840 2024-09-13T18:54:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.501+0000 7fe773400700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe75c066730 0x7fe75c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:54.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.501+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe7680843d0 con 0x7fe77c0b1840 2024-09-13T18:54:54.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.501+0000 7fe77aa00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe75c066730 0x7fe75c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:54.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.501+0000 7fe77aa00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe75c066730 0x7fe75c068bf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0090b0 tx=0x7fe76c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:54.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.509+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe768051560 con 0x7fe77c0b1840 2024-09-13T18:54:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:54.721+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fe77c1593a0 con 0x7fe77c0b1840 2024-09-13T18:54:55.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.493+0000 7fe773400700 1 -- 172.21.15.81:0/2005694901 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v106) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe768054b80 con 0x7fe77c0b1840 2024-09-13T18:54:55.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe75c066730 msgr2=0x7fe75c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe75c066730 0x7fe75c068bf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0090b0 tx=0x7fe76c01c040 comp rx=0 tx=0).stop 2024-09-13T18:54:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 msgr2=0x7fe77c149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 0x7fe77c149e40 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fe76800e9a0 tx=0x7fe76800ecb0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 shutdown_connections 2024-09-13T18:54:55.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe75c066730 0x7fe75c068bf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c15aa30 0x7fe77c14a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe77c0b1840 0x7fe77c149e40 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 --2- 172.21.15.81:0/2005694901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c071e00 0x7fe77c0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 >> 172.21.15.81:0/2005694901 conn(0x7fe77c06cb90 msgr2=0x7fe77c159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.501+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 shutdown_connections 2024-09-13T18:54:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.505+0000 7fe77be00700 1 -- 172.21.15.81:0/2005694901 wait complete. 2024-09-13T18:54:55.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:55.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.701+0000 7f2c46200700 1 Processor -- start 2024-09-13T18:54:55.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c46200700 1 -- start start 2024-09-13T18:54:55.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c46200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c401573b0 0x7f2c400cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:55.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c46200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c400ad480 con 0x7f2c4006ace0 2024-09-13T18:54:55.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c46200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c40157790 con 0x7f2c400ce2f0 2024-09-13T18:54:55.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c46200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c400ce750 con 0x7f2c401573b0 2024-09-13T18:54:55.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c4006ace0 0x7f2c4006ff60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33918/0 (socket says 172.21.15.81:33918) 2024-09-13T18:54:55.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3fe00700 1 -- 172.21.15.81:0/1545084526 learned_addr learned my addr 172.21.15.81:0/1545084526 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:55.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3f400700 1 --2- 172.21.15.81:0/1545084526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c401573b0 0x7f2c400cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910842866 0 0) 0x7f2c400ad480 con 0x7f2c4006ace0 2024-09-13T18:54:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c240035d0 con 0x7f2c4006ace0 2024-09-13T18:54:55.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163808294 0 0) 0x7f2c40157790 con 0x7f2c400ce2f0 2024-09-13T18:54:55.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c400ad480 con 0x7f2c400ce2f0 2024-09-13T18:54:55.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3f400700 1 -- 172.21.15.81:0/1545084526 >> v1:172.21.15.178:6789/0 conn(0x7f2c400ce2f0 legacy=0x7f2c4006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3f400700 1 -- 172.21.15.81:0/1545084526 >> v1:172.21.15.81:6789/0 conn(0x7f2c4006ace0 legacy=0x7f2c4006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.705+0000 7f2c3f400700 1 -- 172.21.15.81:0/1545084526 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400ad6d0 con 0x7f2c401573b0 2024-09-13T18:54:55.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c3f400700 1 --2- 172.21.15.81:0/1545084526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c401573b0 0x7f2c400cddb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009880 tx=0x7f2c30009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0297e9607ec335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:55.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30011830 con 0x7f2c401573b0 2024-09-13T18:54:55.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c30011990 con 0x7f2c401573b0 2024-09-13T18:54:55.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c3e000700 1 -- 172.21.15.81:0/1545084526 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30011d20 con 0x7f2c401573b0 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 -- 172.21.15.81:0/1545084526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c401573b0 msgr2=0x7f2c400cddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 --2- 172.21.15.81:0/1545084526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c401573b0 0x7f2c400cddb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009880 tx=0x7f2c30009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 -- 172.21.15.81:0/1545084526 shutdown_connections 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 --2- 172.21.15.81:0/1545084526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c401573b0 0x7f2c400cddb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 -- 172.21.15.81:0/1545084526 >> 172.21.15.81:0/1545084526 conn(0x7f2c400b08d0 msgr2=0x7f2c400b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 -- 172.21.15.81:0/1545084526 shutdown_connections 2024-09-13T18:54:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.709+0000 7f2c46200700 1 -- 172.21.15.81:0/1545084526 wait complete. 2024-09-13T18:54:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 Processor -- start 2024-09-13T18:54:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 -- start start 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4006ace0 0x7f2c40156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c400ce2f0 0x7f2c4014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 0x7f2c40157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4014d0d0 con 0x7f2c401573b0 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c401e86e0 con 0x7f2c400ce2f0 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c46200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c401e7e10 con 0x7f2c4006ace0 2024-09-13T18:54:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 0x7f2c40157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 0x7f2c40157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52904/0 (socket says 172.21.15.81:52904) 2024-09-13T18:54:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 -- 172.21.15.81:0/3239083270 learned_addr learned my addr 172.21.15.81:0/3239083270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3ea00700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c400ce2f0 0x7f2c4014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:55.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3f400700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4006ace0 0x7f2c40156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 -- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4006ace0 msgr2=0x7f2c40156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4006ace0 0x7f2c40156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 -- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c400ce2f0 msgr2=0x7f2c4014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c400ce2f0 0x7f2c4014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 -- 172.21.15.81:0/3239083270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300094b0 con 0x7f2c401573b0 2024-09-13T18:54:55.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.713+0000 7f2c3fe00700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 0x7f2c40157790 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800cb70 tx=0x7f2c3800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38007480 con 0x7f2c401573b0 2024-09-13T18:54:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c380075e0 con 0x7f2c401573b0 2024-09-13T18:54:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38007970 con 0x7f2c401573b0 2024-09-13T18:54:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c401e80f0 con 0x7f2c401573b0 2024-09-13T18:54:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c401e8c10 con 0x7f2c401573b0 2024-09-13T18:54:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c401e8e30 con 0x7f2c401573b0 2024-09-13T18:54:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.717+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2c3801b3b0 con 0x7f2c401573b0 2024-09-13T18:54:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.721+0000 7f2c37400700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c1c066730 0x7f2c1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.721+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c38083c80 con 0x7f2c401573b0 2024-09-13T18:54:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.721+0000 7f2c3f400700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c1c066730 0x7f2c1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:55.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.721+0000 7f2c3f400700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c1c066730 0x7f2c1c068bf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2c300090b0 tx=0x7f2c3001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.729+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c380548b0 con 0x7f2c401573b0 2024-09-13T18:54:55.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.961+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c400cddb0 con 0x7f2c401573b0 2024-09-13T18:54:55.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c37400700 1 -- 172.21.15.81:0/3239083270 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4761 (secure 0 0 0) 0x7f2c38054440 con 0x7f2c401573b0 2024-09-13T18:54:55.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:55.971 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":106,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":7550,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:54:55.485265+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":8910,"mds_1":8907},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:creating","state_seq":1,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:54:55.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c1c066730 msgr2=0x7f2c1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c1c066730 0x7f2c1c068bf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2c300090b0 tx=0x7f2c3001c040 comp rx=0 tx=0).stop 2024-09-13T18:54:55.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 msgr2=0x7f2c40157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:55.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 0x7f2c40157790 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800cb70 tx=0x7f2c3800cba0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 shutdown_connections 2024-09-13T18:54:55.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2c1c066730 0x7f2c1c068bf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c401573b0 0x7f2c40157790 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c400ce2f0 0x7f2c4014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 --2- 172.21.15.81:0/3239083270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c4006ace0 0x7f2c40156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:55.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 >> 172.21.15.81:0/3239083270 conn(0x7f2c400b08d0 msgr2=0x7f2c4006bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:55.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.965+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 shutdown_connections 2024-09-13T18:54:55.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:55.969+0000 7f2c46200700 1 -- 172.21.15.81:0/3239083270 wait complete. 2024-09-13T18:54:55.976 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 106 2024-09-13T18:54:56.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:54:46.454706+0000', 'modified': '2024-09-13T18:54:55.485265+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 8910, 'mds_1': 8907}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8907': {'gid': 8907, 'name': 'c', 'rank': 1, 'incarnation': 106, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.81:6836/4220647450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 4220647450}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 4220647450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8910': {'gid': 8910, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2331750359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2331750359}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2331750359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:54:56.398 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8907:up:creating 2024-09-13T18:54:56.963 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:54:56.957+0000 7fb8c9400700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T18:54:57.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.565+0000 7f42a4a00700 1 Processor -- start 2024-09-13T18:54:57.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.565+0000 7f42a4a00700 1 -- start start 2024-09-13T18:54:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f42a4a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a01593f0 0x7f42a00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:57.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f42a4a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00cd190 con 0x7f42a00b3150 2024-09-13T18:54:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f42a4a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a00b19b0 con 0x7f42a006cbb0 2024-09-13T18:54:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f42a4a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a01597d0 con 0x7f42a01593f0 2024-09-13T18:54:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f429fe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42a00b3150 0x7f42a0070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54568/0 (socket says 172.21.15.81:54568) 2024-09-13T18:54:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f429fe00700 1 -- 172.21.15.81:0/169999698 learned_addr learned my addr 172.21.15.81:0/169999698 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:57.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f429f400700 1 --2- 172.21.15.81:0/169999698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a01593f0 0x7f42a00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f429ea00700 1 -- 172.21.15.81:0/169999698 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553002268 0 0) 0x7f42a00cd190 con 0x7f42a00b3150 2024-09-13T18:54:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.569+0000 7f429ea00700 1 -- 172.21.15.81:0/169999698 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42840035d0 con 0x7f42a00b3150 2024-09-13T18:54:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429f400700 1 -- 172.21.15.81:0/169999698 >> v1:172.21.15.178:6789/0 conn(0x7f42a006cbb0 legacy=0x7f42a006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429f400700 1 -- 172.21.15.81:0/169999698 >> v1:172.21.15.81:6789/0 conn(0x7f42a00b3150 legacy=0x7f42a0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429ea00700 1 -- 172.21.15.81:0/169999698 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242078885 0 0) 0x7f42a00b19b0 con 0x7f42a006cbb0 2024-09-13T18:54:57.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429f400700 1 -- 172.21.15.81:0/169999698 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a0070b60 con 0x7f42a01593f0 2024-09-13T18:54:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429f400700 1 --2- 172.21.15.81:0/169999698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a01593f0 0x7f42a00718c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f429000aa20 tx=0x7f429000ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8dd3ecde71b007c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429ea00700 1 -- 172.21.15.81:0/169999698 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429000cb70 con 0x7f42a01593f0 2024-09-13T18:54:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429ea00700 1 -- 172.21.15.81:0/169999698 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429000ccd0 con 0x7f42a01593f0 2024-09-13T18:54:57.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f429ea00700 1 -- 172.21.15.81:0/169999698 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290018400 con 0x7f42a01593f0 2024-09-13T18:54:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 -- 172.21.15.81:0/169999698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a01593f0 msgr2=0x7f42a00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 --2- 172.21.15.81:0/169999698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a01593f0 0x7f42a00718c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f429000aa20 tx=0x7f429000ad30 comp rx=0 tx=0).stop 2024-09-13T18:54:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 -- 172.21.15.81:0/169999698 shutdown_connections 2024-09-13T18:54:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 --2- 172.21.15.81:0/169999698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a01593f0 0x7f42a00718c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 -- 172.21.15.81:0/169999698 >> 172.21.15.81:0/169999698 conn(0x7f42a00b0c40 msgr2=0x7f42a006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 -- 172.21.15.81:0/169999698 shutdown_connections 2024-09-13T18:54:57.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.573+0000 7f42a4a00700 1 -- 172.21.15.81:0/169999698 wait complete. 2024-09-13T18:54:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 Processor -- start 2024-09-13T18:54:57.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 -- start start 2024-09-13T18:54:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a006cbb0 0x7f42a014e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a00b3150 0x7f42a00ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 0x7f42a01515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a01522c0 con 0x7f42a01593f0 2024-09-13T18:54:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a00ad3c0 con 0x7f42a006cbb0 2024-09-13T18:54:57.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f42a4a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a014eb30 con 0x7f42a00b3150 2024-09-13T18:54:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 0x7f42a01515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 0x7f42a01515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40272/0 (socket says 172.21.15.81:40272) 2024-09-13T18:54:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 -- 172.21.15.81:0/2676341261 learned_addr learned my addr 172.21.15.81:0/2676341261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429f400700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a006cbb0 0x7f42a014e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:57.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f4296a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a00b3150 0x7f42a00ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 -- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a00b3150 msgr2=0x7f42a00ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a00b3150 0x7f42a00ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 -- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a006cbb0 msgr2=0x7f42a014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a006cbb0 0x7f42a014e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 -- 172.21.15.81:0/2676341261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429000a650 con 0x7f42a01593f0 2024-09-13T18:54:57.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.577+0000 7f429fe00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 0x7f42a01515c0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f429800cbe0 tx=0x7f429800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.581+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800a790 con 0x7f42a01593f0 2024-09-13T18:54:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.581+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429800a8f0 con 0x7f42a01593f0 2024-09-13T18:54:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.581+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800ac60 con 0x7f42a01593f0 2024-09-13T18:54:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.581+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a00ad0e0 con 0x7f42a01593f0 2024-09-13T18:54:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.581+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a015af00 con 0x7f42a01593f0 2024-09-13T18:54:57.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.581+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a015aa60 con 0x7f42a01593f0 2024-09-13T18:54:57.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.585+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f429801b3b0 con 0x7f42a01593f0 2024-09-13T18:54:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.585+0000 7f4297e00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f427c066730 0x7f427c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:57.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.585+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4298083b90 con 0x7f42a01593f0 2024-09-13T18:54:57.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.585+0000 7f429f400700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f427c066730 0x7f427c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:57.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.585+0000 7f429f400700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f427c066730 0x7f427c068bf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4290000c00 tx=0x7f429001b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:57.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.593+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4298050e60 con 0x7f42a01593f0 2024-09-13T18:54:57.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.809+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42a00718c0 con 0x7f42a01593f0 2024-09-13T18:54:57.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.809+0000 7f4297e00700 1 -- 172.21.15.81:0/2676341261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4773 (secure 0 0 0) 0x7f4298017090 con 0x7f42a01593f0 2024-09-13T18:54:57.818 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:57.818 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:54:57.520031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f427c066730 msgr2=0x7f427c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f427c066730 0x7f427c068bf0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4290000c00 tx=0x7f429001b040 comp rx=0 tx=0).stop 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 msgr2=0x7f42a01515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 0x7f42a01515c0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f429800cbe0 tx=0x7f429800cc10 comp rx=0 tx=0).stop 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 shutdown_connections 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f427c066730 0x7f427c068bf0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42a01593f0 0x7f42a01515c0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42a00b3150 0x7f42a00ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 --2- 172.21.15.81:0/2676341261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42a006cbb0 0x7f42a014e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:57.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 >> 172.21.15.81:0/2676341261 conn(0x7f42a00b0c40 msgr2=0x7f42a0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:57.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 shutdown_connections 2024-09-13T18:54:57.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:57.817+0000 7f42a4a00700 1 -- 172.21.15.81:0/2676341261 wait complete. 2024-09-13T18:54:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 109 2024-09-13T18:54:58.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:54:46.454706+0000', 'modified': '2024-09-13T18:54:57.520031+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 8910, 'mds_1': 8907, 'mds_2': 7550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7550': {'gid': 7550, 'name': 'd', 'rank': 2, 'incarnation': 108, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.178:6835/1735589745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6833', 'nonce': 1735589745}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 1735589745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8907': {'gid': 8907, 'name': 'c', 'rank': 1, 'incarnation': 106, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.81:6836/4220647450', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 4220647450}, {'type': 'v1', 'addr': '172.21.15.81:6836', 'nonce': 4220647450}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_8910': {'gid': 8910, 'name': 'a', 'rank': 0, 'incarnation': 101, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6837/2331750359', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6835', 'nonce': 2331750359}, {'type': 'v1', 'addr': '172.21.15.81:6837', 'nonce': 2331750359}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:54:58.248 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:54:58.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:54:58.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.429+0000 7fe74b200700 1 Processor -- start 2024-09-13T18:54:58.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.429+0000 7fe74b200700 1 -- start start 2024-09-13T18:54:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe74b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe74c06cba0 0x7fe74c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe74b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c0d1390 con 0x7fe74c15cd90 2024-09-13T18:54:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe74b200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c0d1670 con 0x7fe74c15d170 2024-09-13T18:54:58.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe74b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c0b2530 con 0x7fe74c06cba0 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe749e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe74c15cd90 0x7fe74c0cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54572/0 (socket says 172.21.15.81:54572) 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe749e00700 1 -- 172.21.15.81:0/2952106102 learned_addr learned my addr 172.21.15.81:0/2952106102 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe74a800700 1 --2- 172.21.15.81:0/2952106102 >> v2:172.21.15.178:3300/0 conn(0x7fe74c06cba0 0x7fe74c0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569064396 0 0) 0x7fe74c0d1390 con 0x7fe74c15cd90 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7300035d0 con 0x7fe74c15cd90 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194554363 0 0) 0x7fe74c0d1670 con 0x7fe74c15d170 2024-09-13T18:54:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c0d1390 con 0x7fe74c15d170 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1592313555 0 0) 0x7fe7300035d0 con 0x7fe74c15cd90 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 >> v2:172.21.15.178:3300/0 conn(0x7fe74c06cba0 msgr2=0x7fe74c0b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 --2- 172.21.15.81:0/2952106102 >> v2:172.21.15.178:3300/0 conn(0x7fe74c06cba0 0x7fe74c0b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 >> v1:172.21.15.178:6789/0 conn(0x7fe74c15d170 legacy=0x7fe74c0cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0d1950 con 0x7fe74c15cd90 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fe73c001670 con 0x7fe74c15cd90 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 >> v1:172.21.15.81:6789/0 conn(0x7fe74c15cd90 legacy=0x7fe74c0cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe730004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe730004870 0x7fe730004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe730005280 0x7fe73000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0b2530 con 0x7fe730003c20 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73000c1d0 con 0x7fe730005280 2024-09-13T18:54:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73000c390 con 0x7fe730004870 2024-09-13T18:54:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe749e00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe730004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe74a800700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe730005280 0x7fe73000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.433+0000 7fe749400700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe730004870 0x7fe730004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe749e00700 1 -- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe730004870 msgr2=0x7fe730004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe749e00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe730004870 0x7fe730004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe749e00700 1 -- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe730005280 msgr2=0x7fe73000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe749e00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe730005280 0x7fe73000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe749e00700 1 -- 172.21.15.81:0/2952106102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7300035d0 con 0x7fe730003c20 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74a800700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe730005280 0x7fe73000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74a800700 1 -- 172.21.15.81:0/2952106102 reap_dead start 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe749e00700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe730004020 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe73c001eb0 tx=0x7fe7300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a25f37a7a9173fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00cd50 con 0x7fe730003c20 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c005980 con 0x7fe730003c20 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe748a00700 1 -- 172.21.15.81:0/2952106102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c005d30 con 0x7fe730003c20 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 -- 172.21.15.81:0/2952106102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 msgr2=0x7fe730004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe730004020 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe73c001eb0 tx=0x7fe7300058a0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 -- 172.21.15.81:0/2952106102 shutdown_connections 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 --2- 172.21.15.81:0/2952106102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe730004020 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 -- 172.21.15.81:0/2952106102 >> 172.21.15.81:0/2952106102 conn(0x7fe74c0d2c10 msgr2=0x7fe74c0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 -- 172.21.15.81:0/2952106102 shutdown_connections 2024-09-13T18:54:58.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 -- 172.21.15.81:0/2952106102 wait complete. 2024-09-13T18:54:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.437+0000 7fe74b200700 1 Processor -- start 2024-09-13T18:54:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 -- start start 2024-09-13T18:54:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe74c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe74c1528c0 0x7fe74c0cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe74c0b4840 0x7fe74c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0b5230 con 0x7fe730003c20 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c1f27c0 con 0x7fe74c1528c0 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c15bd50 con 0x7fe74c0b4840 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe74c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe74c152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40294/0 (socket says 172.21.15.81:40294) 2024-09-13T18:54:58.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 -- 172.21.15.81:0/2718603649 learned_addr learned my addr 172.21.15.81:0/2718603649 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74a800700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe74c0b4840 0x7fe74c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 -- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe74c0b4840 msgr2=0x7fe74c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749400700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe74c1528c0 0x7fe74c0cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe74c0b4840 0x7fe74c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 -- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe74c1528c0 msgr2=0x7fe74c0cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe74c1528c0 0x7fe74c0cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 -- 172.21.15.81:0/2718603649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c15bfa0 con 0x7fe730003c20 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74a800700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe74c0b4840 0x7fe74c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749400700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe74c1528c0 0x7fe74c0cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe749e00700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe74c152df0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe73c007fd0 tx=0x7fe73c001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe742000700 1 -- 172.21.15.81:0/2718603649 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c005cf0 con 0x7fe730003c20 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe742000700 1 -- 172.21.15.81:0/2718603649 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c005e50 con 0x7fe730003c20 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c0c9ce0 con 0x7fe730003c20 2024-09-13T18:54:58.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe742000700 1 -- 172.21.15.81:0/2718603649 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c004ad0 con 0x7fe730003c20 2024-09-13T18:54:58.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.441+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c0ca2a0 con 0x7fe730003c20 2024-09-13T18:54:58.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.445+0000 7fe742000700 1 -- 172.21.15.81:0/2718603649 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe73c004c30 con 0x7fe730003c20 2024-09-13T18:54:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.445+0000 7fe742000700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe72c066760 0x7fe72c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.445+0000 7fe742000700 1 -- 172.21.15.81:0/2718603649 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe73c084ed0 con 0x7fe730003c20 2024-09-13T18:54:58.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.449+0000 7fe749400700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe72c066760 0x7fe72c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.449+0000 7fe749400700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe72c066760 0x7fe72c068c20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0c9a50 tx=0x7fe738009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.449+0000 7fe753d62740 1 Processor -- start 2024-09-13T18:54:58.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.449+0000 7fe753d62740 1 -- start start 2024-09-13T18:54:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859da0 0x1285a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12822890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1285a6c0 0x12822dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x12781d80 con 0x12838d00 2024-09-13T18:54:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1277f510 con 0x12859da0 2024-09-13T18:54:58.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1277ae00 con 0x1285a6c0 2024-09-13T18:54:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12822890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12822890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40306/0 (socket says 172.21.15.81:40306) 2024-09-13T18:54:58.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 -- 172.21.15.81:0/2655134765 learned_addr learned my addr 172.21.15.81:0/2655134765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749e00700 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859da0 0x1285a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe74a800700 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1285a6c0 0x12822dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 -- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1285a6c0 msgr2=0x12822dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1285a6c0 0x12822dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 -- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859da0 msgr2=0x1285a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859da0 0x1285a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 -- 172.21.15.81:0/2655134765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x125ed960 con 0x12838d00 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe74a800700 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1285a6c0 0x12822dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:58.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe749400700 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12822890 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe738014670 tx=0x7fe738012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446060331517347a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe736600700 1 -- 172.21.15.81:0/2655134765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738014d40 con 0x12838d00 2024-09-13T18:54:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe736600700 1 -- 172.21.15.81:0/2655134765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73800d050 con 0x12838d00 2024-09-13T18:54:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe736600700 1 -- 172.21.15.81:0/2655134765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738014ea0 con 0x12838d00 2024-09-13T18:54:58.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- 172.21.15.81:0/2655134765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 msgr2=0x12822890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12822890 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fe738014670 tx=0x7fe738012000 comp rx=0 tx=0).stop 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- 172.21.15.81:0/2655134765 shutdown_connections 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1285a6c0 0x12822dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12822890 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 --2- 172.21.15.81:0/2655134765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859da0 0x1285a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- 172.21.15.81:0/2655134765 >> 172.21.15.81:0/2655134765 conn(0x125a24d0 msgr2=0x1283bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- 172.21.15.81:0/2655134765 shutdown_connections 2024-09-13T18:54:58.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.453+0000 7fe753d62740 1 -- 172.21.15.81:0/2655134765 wait complete. 2024-09-13T18:54:58.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.457+0000 7fe753d62740 1 -- start start 2024-09-13T18:54:58.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.457+0000 7fe753d62740 1 Processor -- start 2024-09-13T18:54:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.457+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.457+0000 7fe753d62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 0x12815180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.457+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x12812d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x12738730 con 0x12859da0 2024-09-13T18:54:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1273e5b0 con 0x1285a6c0 2024-09-13T18:54:58.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12626aa0 con 0x12838d00 2024-09-13T18:54:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 10 client.0 _ll_register_callbacks cb 0x12774610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 0x12815180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 0x12815180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40318/0 (socket says 172.21.15.81:40318) 2024-09-13T18:54:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 -- 172.21.15.81:0/1195370022 learned_addr learned my addr 172.21.15.81:0/1195370022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749e00700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe74a800700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x12812d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 -- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 msgr2=0x1285a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 -- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 msgr2=0x12812d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x12812d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 -- 172.21.15.81:0/1195370022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c0d1390 con 0x12859da0 2024-09-13T18:54:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe749400700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 0x12815180 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe738007db0 tx=0x7fe7380012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d56bfc2ff37381 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe72aa00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe72aa00700 1 -- 172.21.15.81:0/1195370022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738020e40 con 0x12859da0 2024-09-13T18:54:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe72aa00700 1 -- 172.21.15.81:0/1195370022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe73801c040 con 0x12859da0 2024-09-13T18:54:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x125af1e0 con 0x12859da0 2024-09-13T18:54:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe72aa00700 1 -- 172.21.15.81:0/1195370022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73802a410 con 0x12859da0 2024-09-13T18:54:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 10 client.9096 fetch_fsmap learned FSMap version 109 2024-09-13T18:54:58.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x12741220 con 0x12859da0 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe72aa00700 1 -- 172.21.15.81:0/1195370022 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x125af1e0 con 0x12859da0 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.461+0000 7fe72aa00700 1 -- 172.21.15.81:0/1195370022 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 109) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fe73802a570 con 0x12859da0 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe753d62740 10 client.9096 fetch_fsmap finished waiting for FSMap version 109 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe753d62740 10 client.9096 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe753d62740 20 client.9096 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe753d62740 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x12812310 0x12834a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe753d62740 4 client.9096 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x125f9460 con 0x12812310 2024-09-13T18:54:58.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe749e00700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x12812310 0x12834a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe749e00700 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x12812310 0x12834a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbcc171dd8d66a35 server_cookie=e0afcb6c67ecc9d3 in_seq=0 out_seq=0 2024-09-13T18:54:58.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.465+0000 7fe72aa00700 10 client.9096 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:54:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe72aa00700 1 -- 172.21.15.81:0/1195370022 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x125f9460 con 0x12812310 2024-09-13T18:54:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe72aa00700 10 client.9096 handle_command_reply: tid=0 2024-09-13T18:54:58.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 client.9096 shutdown 2024-09-13T18:54:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 msgr2=0x12815180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 0x12815180 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fe738007db0 tx=0x7fe7380012d0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 shutdown_connections 2024-09-13T18:54:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x12812310 0x12834a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x12812d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12859da0 0x12815180 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 --2- 172.21.15.81:0/1195370022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 >> 172.21.15.81:0/1195370022 conn(0x125a24d0 msgr2=0x12835680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe72aa00700 0 client.9096 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 shutdown_connections 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 1 -- 172.21.15.81:0/1195370022 wait complete. 2024-09-13T18:54:58.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.469+0000 7fe753d62740 20 client.9096 trim_cache size 0 max 16384 2024-09-13T18:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 Processor -- start 2024-09-13T18:54:58.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 -- start start 2024-09-13T18:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 0x1285afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859720 0x1285b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1277a610 con 0x1285a6c0 2024-09-13T18:54:58.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x12723020 con 0x12859720 2024-09-13T18:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1277e670 con 0x12838d00 2024-09-13T18:54:58.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 0x1285afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 0x1285afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40320/0 (socket says 172.21.15.81:40320) 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 -- 172.21.15.81:0/3994295193 learned_addr learned my addr 172.21.15.81:0/3994295193 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe74a800700 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859720 0x1285b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749e00700 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 -- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 msgr2=0x1285aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 -- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859720 msgr2=0x1285b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859720 0x1285b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 -- 172.21.15.81:0/3994295193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12727450 con 0x1285a6c0 2024-09-13T18:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.501+0000 7fe749400700 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 0x1285afe0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fe738001140 tx=0x7fe73802a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1b6f90ea0633de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe737000700 1 -- 172.21.15.81:0/3994295193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738014980 con 0x1285a6c0 2024-09-13T18:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe737000700 1 -- 172.21.15.81:0/3994295193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73802aa80 con 0x1285a6c0 2024-09-13T18:54:58.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe737000700 1 -- 172.21.15.81:0/3994295193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73802a650 con 0x1285a6c0 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 -- 172.21.15.81:0/3994295193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 msgr2=0x1285afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 0x1285afe0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fe738001140 tx=0x7fe73802a000 comp rx=0 tx=0).stop 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 -- 172.21.15.81:0/3994295193 shutdown_connections 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12859720 0x1285b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1285a6c0 0x1285afe0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 --2- 172.21.15.81:0/3994295193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12838d00 0x1285aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 -- 172.21.15.81:0/3994295193 >> 172.21.15.81:0/3994295193 conn(0x125a24d0 msgr2=0x1286a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 -- 172.21.15.81:0/3994295193 shutdown_connections 2024-09-13T18:54:58.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 -- 172.21.15.81:0/3994295193 wait complete. 2024-09-13T18:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 -- start start 2024-09-13T18:54:58.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.505+0000 7fe753d62740 1 Processor -- start 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12879690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12859720 0x128bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x128bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x128787e0 con 0x12838d00 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x12855d90 con 0x1285a6c0 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12878a10 con 0x12859720 2024-09-13T18:54:58.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 10 client.0 _ll_register_callbacks cb 0x127d1710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12879690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12879690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40330/0 (socket says 172.21.15.81:40330) 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 -- 172.21.15.81:0/2489260556 learned_addr learned my addr 172.21.15.81:0/2489260556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749400700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12859720 0x128bb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe74a800700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x128bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 -- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12859720 msgr2=0x128bb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12859720 0x128bb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 -- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 msgr2=0x128bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x128bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 -- 172.21.15.81:0/2489260556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x12741220 con 0x12838d00 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe749e00700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12879690 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0832b0 tx=0x7fe73c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a8635f0f87b1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe72aa00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:58.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe72aa00700 1 -- 172.21.15.81:0/2489260556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c05e1a0 con 0x12838d00 2024-09-13T18:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe72aa00700 1 -- 172.21.15.81:0/2489260556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe73c007d50 con 0x12838d00 2024-09-13T18:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12811460 con 0x12838d00 2024-09-13T18:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe72aa00700 1 -- 172.21.15.81:0/2489260556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73c083330 con 0x12838d00 2024-09-13T18:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 10 client.9102 fetch_fsmap learned FSMap version 109 2024-09-13T18:54:58.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x1271b720 con 0x12838d00 2024-09-13T18:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.509+0000 7fe72aa00700 1 -- 172.21.15.81:0/2489260556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12811460 con 0x12838d00 2024-09-13T18:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe72aa00700 1 -- 172.21.15.81:0/2489260556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 109) v1 ==== 3138+0+0 (secure 0 0 0) 0x7fe73c00c210 con 0x12838d00 2024-09-13T18:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 10 client.9102 fetch_fsmap finished waiting for FSMap version 109 2024-09-13T18:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 10 client.9102 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:54:58.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 20 client.9102 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x128bce50 0x128bd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 4 client.9102 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe73800d050 con 0x128bce50 2024-09-13T18:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe749400700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x128bce50 0x128bd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe749400700 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x128bce50 0x128bd230 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a114a26e9f1831dc server_cookie=b99c788438e96f62 in_seq=0 out_seq=0 2024-09-13T18:54:58.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe72aa00700 10 client.9102 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe72aa00700 1 -- 172.21.15.81:0/2489260556 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x7fe73800d050 con 0x128bce50 2024-09-13T18:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe72aa00700 10 client.9102 handle_command_reply: tid=0 2024-09-13T18:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 client.9102 shutdown 2024-09-13T18:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 msgr2=0x12879690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12879690 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0832b0 tx=0x7fe73c007040 comp rx=0 tx=0).stop 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 shutdown_connections 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x128bce50 0x128bd230 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1285a6c0 0x128bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe72aa00700 0 client.9102 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12859720 0x128bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 --2- 172.21.15.81:0/2489260556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x12838d00 0x12879690 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 >> 172.21.15.81:0/2489260556 conn(0x125a24d0 msgr2=0x12838490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 shutdown_connections 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 1 -- 172.21.15.81:0/2489260556 wait complete. 2024-09-13T18:54:58.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.513+0000 7fe753d62740 20 client.9102 trim_cache size 0 max 16384 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7550, 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 1.9967300100000001, 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 109, 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 107, 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T18:54:58.524 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.284437162 2024-09-13T18:54:58.525 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe72c066760 msgr2=0x7fe72c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe72c066760 0x7fe72c068c20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0c9a50 tx=0x7fe738009040 comp rx=0 tx=0).stop 2024-09-13T18:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 msgr2=0x7fe74c152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe74c152df0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fe73c007fd0 tx=0x7fe73c001980 comp rx=0 tx=0).stop 2024-09-13T18:54:58.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 shutdown_connections 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe72c066760 0x7fe72c068c20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe74c0b4840 0x7fe74c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe74c1528c0 0x7fe74c0cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 --2- 172.21.15.81:0/2718603649 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe730003c20 0x7fe74c152df0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 >> 172.21.15.81:0/2718603649 conn(0x7fe74c0d2c10 msgr2=0x7fe74c0ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 shutdown_connections 2024-09-13T18:54:58.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.517+0000 7fe74b200700 1 -- 172.21.15.81:0/2718603649 wait complete. 2024-09-13T18:54:58.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:54:58.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.713+0000 7f9d28c00700 1 Processor -- start 2024-09-13T18:54:58.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.713+0000 7f9d28c00700 1 -- start start 2024-09-13T18:54:58.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d28c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cc6f0 0x7f9d2415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d28c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240b2ad0 con 0x7f9d240cb020 2024-09-13T18:54:58.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d28c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240ccb10 con 0x7f9d2406aaa0 2024-09-13T18:54:58.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d28c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2415b960 con 0x7f9d240cc6f0 2024-09-13T18:54:58.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d23400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9d240cb020 0x7f9d2415c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54582/0 (socket says 172.21.15.81:54582) 2024-09-13T18:54:58.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d23400700 1 -- 172.21.15.81:0/737407490 learned_addr learned my addr 172.21.15.81:0/737407490 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:58.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/737407490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cc6f0 0x7f9d2415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d1aa00700 1 -- 172.21.15.81:0/737407490 >> v1:172.21.15.178:6789/0 conn(0x7f9d2406aaa0 legacy=0x7f9d240b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d1aa00700 1 -- 172.21.15.81:0/737407490 >> v1:172.21.15.81:6789/0 conn(0x7f9d240cb020 legacy=0x7f9d2415c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d22a00700 1 -- 172.21.15.81:0/737407490 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456192783 0 0) 0x7f9d240b2ad0 con 0x7f9d240cb020 2024-09-13T18:54:58.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d1aa00700 1 -- 172.21.15.81:0/737407490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2415bc40 con 0x7f9d240cc6f0 2024-09-13T18:54:58.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/737407490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cc6f0 0x7f9d2415b0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009880 tx=0x7f9d0c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73f1a33aaa61dd95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d22a00700 1 -- 172.21.15.81:0/737407490 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c011830 con 0x7f9d240cc6f0 2024-09-13T18:54:58.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d22a00700 1 -- 172.21.15.81:0/737407490 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c011990 con 0x7f9d240cc6f0 2024-09-13T18:54:58.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.717+0000 7f9d22a00700 1 -- 172.21.15.81:0/737407490 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c011d20 con 0x7f9d240cc6f0 2024-09-13T18:54:58.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 -- 172.21.15.81:0/737407490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cc6f0 msgr2=0x7f9d2415b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 --2- 172.21.15.81:0/737407490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cc6f0 0x7f9d2415b0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009880 tx=0x7f9d0c009b90 comp rx=0 tx=0).stop 2024-09-13T18:54:58.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 -- 172.21.15.81:0/737407490 shutdown_connections 2024-09-13T18:54:58.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 --2- 172.21.15.81:0/737407490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cc6f0 0x7f9d2415b0e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 -- 172.21.15.81:0/737407490 >> 172.21.15.81:0/737407490 conn(0x7f9d240b0c40 msgr2=0x7f9d2406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 -- 172.21.15.81:0/737407490 shutdown_connections 2024-09-13T18:54:58.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.721+0000 7f9d28c00700 1 -- 172.21.15.81:0/737407490 wait complete. 2024-09-13T18:54:58.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 Processor -- start 2024-09-13T18:54:58.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 -- start start 2024-09-13T18:54:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d2406aaa0 0x7f9d2413c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cb020 0x7f9d241557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 0x7f9d2406c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2413c860 con 0x7f9d240cc6f0 2024-09-13T18:54:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24157ce0 con 0x7f9d2406aaa0 2024-09-13T18:54:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d28c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c8070 con 0x7f9d240cb020 2024-09-13T18:54:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 0x7f9d2406c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 0x7f9d2406c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40344/0 (socket says 172.21.15.81:40344) 2024-09-13T18:54:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.725+0000 7f9d23e00700 1 -- 172.21.15.81:0/2679225413 learned_addr learned my addr 172.21.15.81:0/2679225413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23400700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d2406aaa0 0x7f9d2413c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cb020 0x7f9d241557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23e00700 1 -- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cb020 msgr2=0x7f9d241557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23e00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cb020 0x7f9d241557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23e00700 1 -- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d2406aaa0 msgr2=0x7f9d2413c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23e00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d2406aaa0 0x7f9d2413c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23e00700 1 -- 172.21.15.81:0/2679225413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0094b0 con 0x7f9d240cc6f0 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23400700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d2406aaa0 0x7f9d2413c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:58.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d23e00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 0x7f9d2406c990 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c480 tx=0x7f9d1c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d1be00700 1 -- 172.21.15.81:0/2679225413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0052d0 con 0x7f9d240cc6f0 2024-09-13T18:54:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d1be00700 1 -- 172.21.15.81:0/2679225413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c005430 con 0x7f9d240cc6f0 2024-09-13T18:54:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d24157f20 con 0x7f9d240cc6f0 2024-09-13T18:54:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d1be00700 1 -- 172.21.15.81:0/2679225413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0055a0 con 0x7f9d240cc6f0 2024-09-13T18:54:58.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.729+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d241584e0 con 0x7f9d240cc6f0 2024-09-13T18:54:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d1be00700 1 -- 172.21.15.81:0/2679225413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d1c0038e0 con 0x7f9d240cc6f0 2024-09-13T18:54:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 Processor -- start 2024-09-13T18:54:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 -- start start 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d1be00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d00066730 0x7f9d00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 0x1fe36180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe14d00 0x1fdfe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe366c0 0x1fdfedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd5dd80 con 0x1fe35da0 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd5b510 con 0x1fe14d00 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fd56e00 con 0x1fe366c0 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.733+0000 7f9d1be00700 1 -- 172.21.15.81:0/2679225413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d1c0835e0 con 0x7f9d240cc6f0 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d00066730 0x7f9d00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 0x1fe36180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe366c0 0x1fdfedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 0x1fe36180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40346/0 (socket says 172.21.15.81:40346) 2024-09-13T18:54:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23400700 1 -- 172.21.15.81:0/4200527511 learned_addr learned my addr 172.21.15.81:0/4200527511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe14d00 0x1fdfe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 -- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe14d00 msgr2=0x1fdfe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe14d00 0x1fdfe890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 -- 172.21.15.81:0/4200527511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 msgr2=0x1fe36180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 0x1fe36180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 -- 172.21.15.81:0/4200527511 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fbc9960 con 0x1fe366c0 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23400700 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 0x1fe36180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe14d00 0x1fdfe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d00066730 0x7f9d00068bf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009880 tx=0x7f9d0c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d23e00700 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe366c0 0x1fdfedd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c081ab0 tx=0x7f9d1c053f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4784fcf3ba106ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d13400700 1 -- 172.21.15.81:0/4200527511 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c054620 con 0x1fe366c0 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d13400700 1 -- 172.21.15.81:0/4200527511 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c058450 con 0x1fe366c0 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d13400700 1 -- 172.21.15.81:0/4200527511 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c05ca10 con 0x1fe366c0 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 -- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe366c0 msgr2=0x1fdfedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe366c0 0x1fdfedd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c081ab0 tx=0x7f9d1c053f80 comp rx=0 tx=0).stop 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 -- 172.21.15.81:0/4200527511 shutdown_connections 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe366c0 0x1fdfedd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe14d00 0x1fdfe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 --2- 172.21.15.81:0/4200527511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe35da0 0x1fe36180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 -- 172.21.15.81:0/4200527511 >> 172.21.15.81:0/4200527511 conn(0x1fb7e4d0 msgr2=0x1fe17c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 -- 172.21.15.81:0/4200527511 shutdown_connections 2024-09-13T18:54:58.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.737+0000 7f9d2d517740 1 -- 172.21.15.81:0/4200527511 wait complete. 2024-09-13T18:54:58.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 -- start start 2024-09-13T18:54:58.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 Processor -- start 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe3c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe314d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fdef210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd14730 con 0x1fe366c0 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd1a5b0 con 0x1fe35da0 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fc02aa0 con 0x1fe14d00 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 10 client.0 _ll_register_callbacks cb 0x1fd50610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fdef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fdef210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40352/0 (socket says 172.21.15.81:40352) 2024-09-13T18:54:58.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 -- 172.21.15.81:0/1822882145 learned_addr learned my addr 172.21.15.81:0/1822882145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe314d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23400700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe3c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 -- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 msgr2=0x1fe3c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe3c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 -- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 msgr2=0x1fe314d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe314d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 -- 172.21.15.81:0/1822882145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1400f040 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d23e00700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fdef210 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c081a60 tx=0x7f9d1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e2e64dd77241d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d07e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d07e00700 1 -- 172.21.15.81:0/1822882145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c07f070 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d07e00700 1 -- 172.21.15.81:0/1822882145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d1c03f070 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.741+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1fb8b1e0 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 1 -- 172.21.15.81:0/1822882145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d1c05ca10 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 10 client.9114 fetch_fsmap learned FSMap version 109 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x7f9d241584e0 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 1 -- 172.21.15.81:0/1822882145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1fb8b1e0 con 0x1fe366c0 2024-09-13T18:54:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 1 -- 172.21.15.81:0/1822882145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 109) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9d1c054880 con 0x1fe366c0 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 10 client.9114 fetch_fsmap finished waiting for FSMap version 109 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 10 client.9114 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 20 client.9114 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fdee1b0 0x1fdee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 4 client.9114 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1fbd5460 con 0x1fdee1b0 2024-09-13T18:54:58.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d23400700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fdee1b0 0x1fdee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 10 client.9114 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d23400700 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fdee1b0 0x1fdee590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6134019c35dcf70b server_cookie=e2debc150ea4d7eb in_seq=0 out_seq=0 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 1 -- 172.21.15.81:0/1822882145 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1fbd5460 con 0x1fdee1b0 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 10 client.9114 handle_command_reply: tid=0 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 client.9114 shutdown 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 msgr2=0x1fdef210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fdef210 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c081a60 tx=0x7f9d1c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 shutdown_connections 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fdef210 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fdee1b0 0x1fdee590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe314d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1822882145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe3c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d07e00700 0 client.9114 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 >> 172.21.15.81:0/1822882145 conn(0x1fb7e4d0 msgr2=0x1fe11710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 shutdown_connections 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.745+0000 7f9d2d517740 1 -- 172.21.15.81:0/1822882145 wait complete. 2024-09-13T18:54:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.749+0000 7f9d2d517740 20 client.9114 trim_cache size 0 max 16384 2024-09-13T18:54:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.765+0000 7f9d2d517740 1 Processor -- start 2024-09-13T18:54:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.765+0000 7f9d2d517740 1 -- start start 2024-09-13T18:54:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe13680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe13bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fe14100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd85ec0 con 0x1fe366c0 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fd14730 con 0x1fe35da0 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fd1a5b0 con 0x1fe14d00 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fe14100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe13bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe13bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:45354/0 (socket says 172.21.15.81:45354) 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 -- 172.21.15.81:0/2115459592 learned_addr learned my addr 172.21.15.81:0/2115459592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d23e00700 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fe14100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40362/0 (socket says 172.21.15.81:40362) 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d23400700 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe13680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 -- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 msgr2=0x1fe13680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe13680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 -- 172.21.15.81:0/2115459592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 msgr2=0x1fe14100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fe14100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 -- 172.21.15.81:0/2115459592 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fd1d220 con 0x1fe35da0 2024-09-13T18:54:58.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe13bc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c000c00 tx=0x7f9d0c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311a1c750e1cce7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d13e00700 1 -- 172.21.15.81:0/2115459592 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c028650 con 0x1fe35da0 2024-09-13T18:54:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d13e00700 1 -- 172.21.15.81:0/2115459592 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0c020070 con 0x1fe35da0 2024-09-13T18:54:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d13e00700 1 -- 172.21.15.81:0/2115459592 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0c0289b0 con 0x1fe35da0 2024-09-13T18:54:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 msgr2=0x1fe13bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe13bc0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c000c00 tx=0x7f9d0c011000 comp rx=0 tx=0).stop 2024-09-13T18:54:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- 172.21.15.81:0/2115459592 shutdown_connections 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe366c0 0x1fe14100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe35da0 0x1fe13bc0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 --2- 172.21.15.81:0/2115459592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe14d00 0x1fe13680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- 172.21.15.81:0/2115459592 >> 172.21.15.81:0/2115459592 conn(0x1fb7e4d0 msgr2=0x1fe45870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.769+0000 7f9d2d517740 1 -- 172.21.15.81:0/2115459592 shutdown_connections 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- 172.21.15.81:0/2115459592 wait complete. 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- start start 2024-09-13T18:54:58.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 Processor -- start 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 0x1fe9f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe35da0 0x1fe5c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe366c0 0x1fe5ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fcf5470 con 0x1fe14d00 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fe5dce0 con 0x1fe366c0 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fe5d3d0 con 0x1fe35da0 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 10 client.0 _ll_register_callbacks cb 0x1fdad710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 0x1fe9f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 0x1fe9f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40370/0 (socket says 172.21.15.81:40370) 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 -- 172.21.15.81:0/1725042772 learned_addr learned my addr 172.21.15.81:0/1725042772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 -- 172.21.15.81:0/1725042772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe35da0 msgr2=0x1fe5c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe35da0 0x1fe5c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 -- 172.21.15.81:0/1725042772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe366c0 msgr2=0x1fe5ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe366c0 0x1fe5ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 -- 172.21.15.81:0/1725042772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2415bc40 con 0x1fe14d00 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d23400700 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 0x1fe9f760 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9d140018a0 tx=0x7f9d14007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73d2386c0dd232c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d07e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d07e00700 1 -- 172.21.15.81:0/1725042772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1401f070 con 0x1fe14d00 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d07e00700 1 -- 172.21.15.81:0/1725042772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9d1401a5f0 con 0x1fe14d00 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d1c058450 con 0x1fe14d00 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d07e00700 1 -- 172.21.15.81:0/1725042772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d1401a7b0 con 0x1fe14d00 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 10 client.9120 fetch_fsmap learned FSMap version 109 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x1fd03450 con 0x1fe14d00 2024-09-13T18:54:58.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.773+0000 7f9d07e00700 1 -- 172.21.15.81:0/1725042772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c058450 con 0x1fe14d00 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d07e00700 1 -- 172.21.15.81:0/1725042772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 109) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f9d14018440 con 0x1fe14d00 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 10 client.9120 fetch_fsmap finished waiting for FSMap version 109 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 10 client.9120 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 20 client.9120 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fe3a0d0 0x1fe3a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 4 client.9120 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1fbfa1e0 con 0x1fe3a0d0 2024-09-13T18:54:58.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fe3a0d0 0x1fe3a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d07e00700 10 client.9120 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:54:58.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d1aa00700 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fe3a0d0 0x1fe3a4b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=67b572fed44d2bb0 server_cookie=478d5a5604176eda in_seq=0 out_seq=0 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d07e00700 1 -- 172.21.15.81:0/1725042772 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x1fbfa1e0 con 0x1fe3a0d0 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d07e00700 10 client.9120 handle_command_reply: tid=0 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 client.9120 shutdown 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 msgr2=0x1fe9f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 0x1fe9f760 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9d140018a0 tx=0x7f9d14007950 comp rx=0 tx=0).stop 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 shutdown_connections 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1fe3a0d0 0x1fe3a4b0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1fe366c0 0x1fe5ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fe35da0 0x1fe5c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 --2- 172.21.15.81:0/1725042772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1fe14d00 0x1fe9f760 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d07e00700 0 client.9120 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 >> 172.21.15.81:0/1725042772 conn(0x1fb7e4d0 msgr2=0x1fe46090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 shutdown_connections 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 1 -- 172.21.15.81:0/1725042772 wait complete. 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.777+0000 7f9d2d517740 20 client.9120 trim_cache size 0 max 16384 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8907, 2024-09-13T18:54:58.788 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 3.288812149, 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 109, 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 107, 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.566966557000001 2024-09-13T18:54:58.789 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d00066730 msgr2=0x7f9d00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d00066730 0x7f9d00068bf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c009880 tx=0x7f9d0c010000 comp rx=0 tx=0).stop 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 msgr2=0x7f9d2406c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 0x7f9d2406c990 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c480 tx=0x7f9d1c00c790 comp rx=0 tx=0).stop 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 shutdown_connections 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9d00066730 0x7f9d00068bf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d240cc6f0 0x7f9d2406c990 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d240cb020 0x7f9d241557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 --2- 172.21.15.81:0/2679225413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d2406aaa0 0x7f9d2413c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 >> 172.21.15.81:0/2679225413 conn(0x7f9d240b0c40 msgr2=0x7f9d2406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 shutdown_connections 2024-09-13T18:54:58.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.781+0000 7f9d28c00700 1 -- 172.21.15.81:0/2679225413 wait complete. 2024-09-13T18:54:58.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:54:58.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.977+0000 7f84dee00700 1 Processor -- start 2024-09-13T18:54:58.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.977+0000 7f84dee00700 1 -- start start 2024-09-13T18:54:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84d80cc6f0 0x7f84d815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dee00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d80ccb40 con 0x7f84d806aaa0 2024-09-13T18:54:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dee00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d80b2ad0 con 0x7f84d80cb020 2024-09-13T18:54:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d815b960 con 0x7f84d80cc6f0 2024-09-13T18:54:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84de400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f84d806aaa0 0x7f84d80b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:54586/0 (socket says 172.21.15.81:54586) 2024-09-13T18:54:58.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84de400700 1 -- 172.21.15.81:0/3240540818 learned_addr learned my addr 172.21.15.81:0/3240540818 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dd000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f84d80cc6f0 0x7f84d815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84d7e00700 1 -- 172.21.15.81:0/3240540818 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527525970 0 0) 0x7f84d80ccb40 con 0x7f84d806aaa0 2024-09-13T18:54:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84d7e00700 1 -- 172.21.15.81:0/3240540818 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c00035d0 con 0x7f84d806aaa0 2024-09-13T18:54:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dd000700 1 -- 172.21.15.81:0/3240540818 >> v1:172.21.15.178:6789/0 conn(0x7f84d80cb020 legacy=0x7f84d815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84d7e00700 1 -- 172.21.15.81:0/3240540818 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957074901 0 0) 0x7f84d80b2ad0 con 0x7f84d80cb020 2024-09-13T18:54:58.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dd000700 1 -- 172.21.15.81:0/3240540818 >> v1:172.21.15.81:6789/0 conn(0x7f84d806aaa0 legacy=0x7f84d80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dd000700 1 -- 172.21.15.81:0/3240540818 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d815bc40 con 0x7f84d80cc6f0 2024-09-13T18:54:58.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84dd000700 1 --2- 172.21.15.81:0/3240540818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d80cc6f0 0x7f84d815b0e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009850 tx=0x7f84c4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9f8c6956f9f68d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84d7e00700 1 -- 172.21.15.81:0/3240540818 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4011830 con 0x7f84d80cc6f0 2024-09-13T18:54:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84d7e00700 1 -- 172.21.15.81:0/3240540818 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c4011990 con 0x7f84d80cc6f0 2024-09-13T18:54:58.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.981+0000 7f84d7e00700 1 -- 172.21.15.81:0/3240540818 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c4011d00 con 0x7f84d80cc6f0 2024-09-13T18:54:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 -- 172.21.15.81:0/3240540818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d80cc6f0 msgr2=0x7f84d815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 --2- 172.21.15.81:0/3240540818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d80cc6f0 0x7f84d815b0e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f84c4009850 tx=0x7f84c4009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 -- 172.21.15.81:0/3240540818 shutdown_connections 2024-09-13T18:54:58.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 --2- 172.21.15.81:0/3240540818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d80cc6f0 0x7f84d815b0e0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 -- 172.21.15.81:0/3240540818 >> 172.21.15.81:0/3240540818 conn(0x7f84d80b0c40 msgr2=0x7f84d806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 -- 172.21.15.81:0/3240540818 shutdown_connections 2024-09-13T18:54:58.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 -- 172.21.15.81:0/3240540818 wait complete. 2024-09-13T18:54:58.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 Processor -- start 2024-09-13T18:54:58.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.985+0000 7f84dee00700 1 -- start start 2024-09-13T18:54:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 0x7f84d813f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84d80cb020 0x7f84d8155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84d80cc6f0 0x7f84d8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d813f720 con 0x7f84d806aaa0 2024-09-13T18:54:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8156730 con 0x7f84d80cb020 2024-09-13T18:54:58.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d81499a0 con 0x7f84d80cc6f0 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 0x7f84d813f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 0x7f84d813f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40402/0 (socket says 172.21.15.81:40402) 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 -- 172.21.15.81:0/1201276558 learned_addr learned my addr 172.21.15.81:0/1201276558 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84de400700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84d80cc6f0 0x7f84d8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dd000700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84d80cb020 0x7f84d8155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 -- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84d80cc6f0 msgr2=0x7f84d8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84d80cc6f0 0x7f84d8156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 -- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84d80cb020 msgr2=0x7f84d8155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84d80cb020 0x7f84d8155ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:58.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 -- 172.21.15.81:0/1201276558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c40094b0 con 0x7f84d806aaa0 2024-09-13T18:54:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dda00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 0x7f84d813f1e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c520 tx=0x7f84cc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84d5600700 1 -- 172.21.15.81:0/1201276558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0054e0 con 0x7f84d806aaa0 2024-09-13T18:54:58.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84d5600700 1 -- 172.21.15.81:0/1201276558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc0036a0 con 0x7f84d806aaa0 2024-09-13T18:54:58.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84d5600700 1 -- 172.21.15.81:0/1201276558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc003a10 con 0x7f84d806aaa0 2024-09-13T18:54:58.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d814dac0 con 0x7f84d806aaa0 2024-09-13T18:54:58.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.989+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d814dff0 con 0x7f84d806aaa0 2024-09-13T18:54:59.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.993+0000 7f84d5600700 1 -- 172.21.15.81:0/1201276558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f84cc003b70 con 0x7f84d806aaa0 2024-09-13T18:54:59.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.997+0000 7f84d5600700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f84b8066730 0x7f84b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.997+0000 7f84d5600700 1 -- 172.21.15.81:0/1201276558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f84cc0835f0 con 0x7f84d806aaa0 2024-09-13T18:54:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.997+0000 7f84dd000700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f84b8066730 0x7f84b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.997+0000 7f84dd000700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f84b8066730 0x7f84b8068bf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f84c40090b0 tx=0x7f84c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.997+0000 7f84e36f6740 1 Processor -- start 2024-09-13T18:54:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:58.997+0000 7f84e36f6740 1 -- start start 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215fa180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x21521d80 con 0x215fa6c0 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2151f510 con 0x215f9da0 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2151ae00 con 0x215d8d00 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40404/0 (socket says 172.21.15.81:40404) 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 -- 172.21.15.81:0/3938352019 learned_addr learned my addr 172.21.15.81:0/3938352019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84dd000700 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84dda00700 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215fa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 -- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 msgr2=0x215c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 -- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 msgr2=0x215fa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215fa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 -- 172.21.15.81:0/3938352019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2138d960 con 0x215fa6c0 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84dda00700 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84de400700 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215c2dd0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f84d00021e0 tx=0x7f84d0007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4e074868498746 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84ca000700 1 -- 172.21.15.81:0/3938352019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00078c0 con 0x215fa6c0 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84ca000700 1 -- 172.21.15.81:0/3938352019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0007a20 con 0x215fa6c0 2024-09-13T18:54:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84ca000700 1 -- 172.21.15.81:0/3938352019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00135f0 con 0x215fa6c0 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- 172.21.15.81:0/3938352019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 msgr2=0x215c2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215c2dd0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f84d00021e0 tx=0x7f84d0007040 comp rx=0 tx=0).stop 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- 172.21.15.81:0/3938352019 shutdown_connections 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215c2dd0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 --2- 172.21.15.81:0/3938352019 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215fa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- 172.21.15.81:0/3938352019 >> 172.21.15.81:0/3938352019 conn(0x213424d0 msgr2=0x215dbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- 172.21.15.81:0/3938352019 shutdown_connections 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.001+0000 7f84e36f6740 1 -- 172.21.15.81:0/3938352019 wait complete. 2024-09-13T18:54:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- start start 2024-09-13T18:54:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 Processor -- start 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 0x215b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x215faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215fa6c0 0x215fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x214d8730 con 0x215d8d00 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x214de5b0 con 0x215fa6c0 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x213c6aa0 con 0x215f9da0 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 10 client.0 _ll_register_callbacks cb 0x21514610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 0x215b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 0x215b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40416/0 (socket says 172.21.15.81:40416) 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 -- 172.21.15.81:0/1980615747 learned_addr learned my addr 172.21.15.81:0/1980615747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84de400700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215fa6c0 0x215fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 -- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 msgr2=0x215faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dd000700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x215faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x215faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 -- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215fa6c0 msgr2=0x215fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215fa6c0 0x215fafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 -- 172.21.15.81:0/1980615747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c00035d0 con 0x215d8d00 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84de400700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215fa6c0 0x215fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dd000700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x215faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dda00700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 0x215b35e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0541f0 tx=0x7f84cc054a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3b077049e121c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84bea00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84bea00700 1 -- 172.21.15.81:0/1980615747 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc05c5a0 con 0x215d8d00 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84bea00700 1 -- 172.21.15.81:0/1980615747 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f84cc05a040 con 0x215d8d00 2024-09-13T18:54:59.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2134f1e0 con 0x215d8d00 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84bea00700 1 -- 172.21.15.81:0/1980615747 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84cc05c830 con 0x215d8d00 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 10 client.9135 fetch_fsmap learned FSMap version 109 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x214e1220 con 0x215d8d00 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84bea00700 1 -- 172.21.15.81:0/1980615747 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2134f1e0 con 0x215d8d00 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84bea00700 1 -- 172.21.15.81:0/1980615747 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 109) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f84cc05a200 con 0x215d8d00 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 10 client.9135 fetch_fsmap finished waiting for FSMap version 109 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 10 client.9135 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 20 client.9135 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x215b3f90 0x215b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 4 client.9135 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:54:59.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x21399460 con 0x215b3f90 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.005+0000 7f84dd000700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x215b3f90 0x215b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84bea00700 10 client.9135 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84dd000700 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x215b3f90 0x215b0030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca96000d51660b0c server_cookie=5e1e3f102f051369 in_seq=0 out_seq=0 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84bea00700 1 -- 172.21.15.81:0/1980615747 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x21399460 con 0x215b3f90 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84bea00700 10 client.9135 handle_command_reply: tid=0 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 client.9135 shutdown 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 msgr2=0x215b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 0x215b35e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0541f0 tx=0x7f84cc054a30 comp rx=0 tx=0).stop 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 shutdown_connections 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x215b3f90 0x215b0030 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215fa6c0 0x215fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x215faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84bea00700 0 client.9135 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 --2- 172.21.15.81:0/1980615747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215d8d00 0x215b35e0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 >> 172.21.15.81:0/1980615747 conn(0x213424d0 msgr2=0x215d5860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 shutdown_connections 2024-09-13T18:54:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 1 -- 172.21.15.81:0/1980615747 wait complete. 2024-09-13T18:54:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.009+0000 7f84e36f6740 20 client.9135 trim_cache size 0 max 16384 2024-09-13T18:54:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 Processor -- start 2024-09-13T18:54:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 -- start start 2024-09-13T18:54:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215d7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215d8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x215b2180 con 0x215fa6c0 2024-09-13T18:54:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21549ec0 con 0x215f9da0 2024-09-13T18:54:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.029+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x214dce90 con 0x215d8d00 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40420/0 (socket says 172.21.15.81:40420) 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215d7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dd000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215d8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84de400700 1 -- 172.21.15.81:0/2459471736 learned_addr learned my addr 172.21.15.81:0/2459471736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 -- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 msgr2=0x215d8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215d8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 -- 172.21.15.81:0/2459471736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 msgr2=0x215b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 -- 172.21.15.81:0/2459471736 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x214c7450 con 0x215d8d00 2024-09-13T18:54:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84dda00700 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215d7f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f84cc054b50 tx=0x7f84cc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f3c6a1051d16c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84caa00700 1 -- 172.21.15.81:0/2459471736 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc05c830 con 0x215d8d00 2024-09-13T18:54:59.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84caa00700 1 -- 172.21.15.81:0/2459471736 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc05c3a0 con 0x215d8d00 2024-09-13T18:54:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84caa00700 1 -- 172.21.15.81:0/2459471736 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc05a040 con 0x215d8d00 2024-09-13T18:54:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 -- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 msgr2=0x215d7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215d7f50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f84cc054b50 tx=0x7f84cc014000 comp rx=0 tx=0).stop 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 -- 172.21.15.81:0/2459471736 shutdown_connections 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x215b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215f9da0 0x215d8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2459471736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215d8d00 0x215d7f50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 -- 172.21.15.81:0/2459471736 >> 172.21.15.81:0/2459471736 conn(0x213424d0 msgr2=0x215d7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 -- 172.21.15.81:0/2459471736 shutdown_connections 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 -- 172.21.15.81:0/2459471736 wait complete. 2024-09-13T18:54:59.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.033+0000 7f84e36f6740 1 -- start start 2024-09-13T18:54:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 Processor -- start 2024-09-13T18:54:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215d8d00 0x21663a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x21611360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x21664b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x216221f0 con 0x215fa6c0 2024-09-13T18:54:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21663fd0 con 0x215d8d00 2024-09-13T18:54:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x216118a0 con 0x215f9da0 2024-09-13T18:54:59.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 10 client.0 _ll_register_callbacks cb 0x21571710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x21664b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84de400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x21664b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40436/0 (socket says 172.21.15.81:40436) 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84de400700 1 -- 172.21.15.81:0/2048279534 learned_addr learned my addr 172.21.15.81:0/2048279534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x21611360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dda00700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215d8d00 0x21663a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 -- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215d8d00 msgr2=0x21663a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215d8d00 0x21663a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 -- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 msgr2=0x21664b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x21664b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 -- 172.21.15.81:0/2048279534 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x214e1220 con 0x215f9da0 2024-09-13T18:54:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84dd000700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x21611360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f84c4016000 tx=0x7f84c40047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da57e9fb1a28c5a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84bea00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2024-09-13T18:54:59.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84bea00700 1 -- 172.21.15.81:0/2048279534 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c401f070 con 0x215f9da0 2024-09-13T18:54:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84bea00700 1 -- 172.21.15.81:0/2048279534 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f84c4032390 con 0x215f9da0 2024-09-13T18:54:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.037+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84d0007a20 con 0x215f9da0 2024-09-13T18:54:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 1 -- 172.21.15.81:0/2048279534 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c4032550 con 0x215f9da0 2024-09-13T18:54:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 10 client.7703 fetch_fsmap learned FSMap version 109 2024-09-13T18:54:59.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x214bb720 con 0x215f9da0 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 1 -- 172.21.15.81:0/2048279534 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0007a20 con 0x215f9da0 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 1 -- 172.21.15.81:0/2048279534 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 109) v1 ==== 3138+0+0 (secure 0 0 0) 0x7f84c40326b0 con 0x215f9da0 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 10 client.7703 fetch_fsmap finished waiting for FSMap version 109 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 10 client.7703 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 20 client.7703 populate_metadata read hostname 'smithi081' 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x216655e0 0x2160ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 4 client.7703 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:54:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "status"}) v1 -- 0x213be1e0 con 0x216655e0 2024-09-13T18:54:59.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84dda00700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x216655e0 0x2160ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 10 client.7703 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84dda00700 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x216655e0 0x2160ee30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa4cb36f9a358ca server_cookie=a75b224e02e88d67 in_seq=0 out_seq=0 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 1 -- 172.21.15.81:0/2048279534 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x213be1e0 con 0x216655e0 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 10 client.7703 handle_command_reply: tid=0 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 client.7703 shutdown 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 msgr2=0x21611360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x21611360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f84c4016000 tx=0x7f84c40047e0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 shutdown_connections 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x216655e0 0x2160ee30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x215fa6c0 0x21664b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x215f9da0 0x21611360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84bea00700 0 client.7703 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 --2- 172.21.15.81:0/2048279534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x215d8d00 0x21663a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 >> 172.21.15.81:0/2048279534 conn(0x213424d0 msgr2=0x215f9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 shutdown_connections 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 1 -- 172.21.15.81:0/2048279534 wait complete. 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.041+0000 7f84e36f6740 20 client.7703 trim_cache size 0 max 16384 2024-09-13T18:54:59.051 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a8432ea3-e34b-45da-88c0-4120757fcc5d", 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8910, 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 12.584571189, 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 109, 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 107, 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 107, 2024-09-13T18:54:59.052 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 17.831189036000001 2024-09-13T18:54:59.053 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:54:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f84b8066730 msgr2=0x7f84b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f84b8066730 0x7f84b8068bf0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f84c40090b0 tx=0x7f84c4008030 comp rx=0 tx=0).stop 2024-09-13T18:54:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 msgr2=0x7f84d813f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 0x7f84d813f1e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f84cc00c520 tx=0x7f84cc00c830 comp rx=0 tx=0).stop 2024-09-13T18:54:59.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 shutdown_connections 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f84b8066730 0x7f84b8068bf0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84d80cc6f0 0x7f84d8156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84d80cb020 0x7f84d8155ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 --2- 172.21.15.81:0/1201276558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d806aaa0 0x7f84d813f1e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 >> 172.21.15.81:0/1201276558 conn(0x7f84d80b0c40 msgr2=0x7f84d80b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 shutdown_connections 2024-09-13T18:54:59.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.045+0000 7f84dee00700 1 -- 172.21.15.81:0/1201276558 wait complete. 2024-09-13T18:54:59.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:54:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.233+0000 7f72d1c00700 1 Processor -- start 2024-09-13T18:54:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.233+0000 7f72d1c00700 1 -- start start 2024-09-13T18:54:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72cc0cc6f0 0x7f72cc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0ccb40 con 0x7f72cc0cb020 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc06b430 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0b2ad0 con 0x7f72cc06aaa0 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72cbe00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f72cc0cb020 0x7f72cc15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:51368/0 (socket says 172.21.15.81:51368) 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72cbe00700 1 -- 172.21.15.81:0/4212631196 learned_addr learned my addr 172.21.15.81:0/4212631196 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72cb400700 1 --2- 172.21.15.81:0/4212631196 >> v2:172.21.15.81:3300/0 conn(0x7f72cc0cc6f0 0x7f72cc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1200700 1 --2- 172.21.15.81:0/4212631196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72caa00700 1 -- 172.21.15.81:0/4212631196 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030462692 0 0) 0x7f72cc0ccb40 con 0x7f72cc0cb020 2024-09-13T18:54:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72caa00700 1 -- 172.21.15.81:0/4212631196 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b00035d0 con 0x7f72cc0cb020 2024-09-13T18:54:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1200700 1 -- 172.21.15.81:0/4212631196 >> v2:172.21.15.81:3300/0 conn(0x7f72cc0cc6f0 msgr2=0x7f72cc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:54:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1200700 1 --2- 172.21.15.81:0/4212631196 >> v2:172.21.15.81:3300/0 conn(0x7f72cc0cc6f0 0x7f72cc15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1200700 1 -- 172.21.15.81:0/4212631196 >> v1:172.21.15.178:6789/0 conn(0x7f72cc0cb020 legacy=0x7f72cc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1200700 1 -- 172.21.15.81:0/4212631196 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc15b960 con 0x7f72cc06aaa0 2024-09-13T18:54:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72cb400700 1 --2- 172.21.15.81:0/4212631196 >> v2:172.21.15.81:3300/0 conn(0x7f72cc0cc6f0 0x7f72cc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:54:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72d1200700 1 --2- 172.21.15.81:0/4212631196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc06aef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009850 tx=0x7f72c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d645280f53994be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72caa00700 1 -- 172.21.15.81:0/4212631196 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011830 con 0x7f72cc06aaa0 2024-09-13T18:54:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72caa00700 1 -- 172.21.15.81:0/4212631196 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4011990 con 0x7f72cc06aaa0 2024-09-13T18:54:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.237+0000 7f72caa00700 1 -- 172.21.15.81:0/4212631196 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011d40 con 0x7f72cc06aaa0 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 -- 172.21.15.81:0/4212631196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 msgr2=0x7f72cc06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 --2- 172.21.15.81:0/4212631196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc06aef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009850 tx=0x7f72c4009b60 comp rx=0 tx=0).stop 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 -- 172.21.15.81:0/4212631196 shutdown_connections 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 --2- 172.21.15.81:0/4212631196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc06aef0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 --2- 172.21.15.81:0/4212631196 >> v2:172.21.15.81:3300/0 conn(0x7f72cc0cc6f0 0x7f72cc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 -- 172.21.15.81:0/4212631196 >> 172.21.15.81:0/4212631196 conn(0x7f72cc0b0c40 msgr2=0x7f72cc06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 -- 172.21.15.81:0/4212631196 shutdown_connections 2024-09-13T18:54:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.241+0000 7f72d1c00700 1 -- 172.21.15.81:0/4212631196 wait complete. 2024-09-13T18:54:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 Processor -- start 2024-09-13T18:54:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 -- start start 2024-09-13T18:54:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc1498e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb020 0x7f72cc14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 0x7f72cc14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc14afa0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc14b220 con 0x7f72cc0cb020 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc14b500 con 0x7f72cc06aaa0 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 0x7f72cc14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 0x7f72cc14c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40450/0 (socket says 172.21.15.81:40450) 2024-09-13T18:54:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 -- 172.21.15.81:0/2357047120 learned_addr learned my addr 172.21.15.81:0/2357047120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:54:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72cbe00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc1498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72cb400700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb020 0x7f72cc14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 -- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 msgr2=0x7f72cc1498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc1498e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 -- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb020 msgr2=0x7f72cc14c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb020 0x7f72cc14c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 -- 172.21.15.81:0/2357047120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80094b0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72d1200700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 0x7f72cc14c800 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0b2c10 tx=0x7f72c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.245+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4004300 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c401f070 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c40094b0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40036c0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc14bac0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc0673f0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72c4021030 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.249+0000 7f72c3e00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72ac066730 0x7f72ac068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:54:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.253+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f72c40850e0 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.253+0000 7f72cbe00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72ac066730 0x7f72ac068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:54:59.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.253+0000 7f72cbe00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72ac066730 0x7f72ac068bf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001560 tx=0x7f72bc001a90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:54:59.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.257+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72c4052270 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.481+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72cc0cb400 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.485+0000 7f72c3e00700 1 -- 172.21.15.81:0/2357047120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4773 (secure 0 0 0) 0x7f72c4055890 con 0x7f72cc0cc6f0 2024-09-13T18:54:59.491 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:54:59.491 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:54:57.520031+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:54:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72ac066730 msgr2=0x7f72ac068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72ac066730 0x7f72ac068bf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f72bc001560 tx=0x7f72bc001a90 comp rx=0 tx=0).stop 2024-09-13T18:54:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 msgr2=0x7f72cc14c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:54:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 0x7f72cc14c800 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0b2c10 tx=0x7f72c4004770 comp rx=0 tx=0).stop 2024-09-13T18:54:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 shutdown_connections 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72ac066730 0x7f72ac068bf0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72cc0cc6f0 0x7f72cc14c800 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb020 0x7f72cc14c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 --2- 172.21.15.81:0/2357047120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc06aaa0 0x7f72cc1498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 >> 172.21.15.81:0/2357047120 conn(0x7f72cc0b0c40 msgr2=0x7f72cc1598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 shutdown_connections 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:54:59.489+0000 7f72d1c00700 1 -- 172.21.15.81:0/2357047120 wait complete. 2024-09-13T18:54:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 109 2024-09-13T18:54:59.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:59.517 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:54:59.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:59.553 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-13T18:54:59.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:59.629 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-13T18:54:59.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:59.691 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-13T18:54:59.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:54:59.756 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-13T18:54:59.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:55:00.038 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:55:00.038 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:00.038 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:55:01.963 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:55:01.957+0000 7fb8c9400700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:55:02.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:55:02.217 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:55:02.218 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:02.218 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:55:04.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:55:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-13T18:55:04.415 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:04.415 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:55:06.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:55:06.601 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-13T18:55:06.601 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:06.602 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:55:08.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-13T18:55:08.790 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}}] 2024-09-13T18:55:08.791 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:08.791 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-13T18:55:08.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:55:08.967 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:55:08.967 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:08.967 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:55:10.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:55:11.158 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:55:11.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:11.159 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:55:13.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-13T18:55:13.348 INFO:teuthology.orchestra.run.smithi081.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-13T18:55:13.348 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-13T18:55:13.348 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:55:13.349 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-13T18:55:13.538 INFO:teuthology.orchestra.run.smithi178.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-13T18:55:13.539 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-13T18:55:13.539 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-13T18:55:13.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 flush journal 2024-09-13T18:55:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.712+0000 7f0ca7200700 1 Processor -- start 2024-09-13T18:55:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.712+0000 7f0ca7200700 1 -- start start 2024-09-13T18:55:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca80b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca7200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0ca80b1980 0x7f0ca8162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80b2280 con 0x7f0ca806c960 2024-09-13T18:55:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca7200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80b2560 con 0x7f0ca80b1980 2024-09-13T18:55:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b2840 con 0x7f0ca8161e00 2024-09-13T18:55:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca80b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca6800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0ca80b1980 0x7f0ca8162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca80b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:43914/0 (socket says 172.21.15.81:43914) 2024-09-13T18:55:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 -- 172.21.15.81:0/3811938088 learned_addr learned my addr 172.21.15.81:0/3811938088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:13.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 -- 172.21.15.81:0/3811938088 >> v2:172.21.15.178:3300/0 conn(0x7f0ca80b1980 msgr2=0x7f0ca8162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 --2- 172.21.15.81:0/3811938088 >> v2:172.21.15.178:3300/0 conn(0x7f0ca80b1980 0x7f0ca8162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 -- 172.21.15.81:0/3811938088 >> v1:172.21.15.178:6789/0 conn(0x7f0ca806c960 legacy=0x7f0ca806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 -- 172.21.15.81:0/3811938088 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80b2b20 con 0x7f0ca8161e00 2024-09-13T18:55:13.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca4a00700 1 -- 172.21.15.81:0/3811938088 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718201260 0 0) 0x7f0ca80b2280 con 0x7f0ca806c960 2024-09-13T18:55:13.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca5400700 1 --2- 172.21.15.81:0/3811938088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca80b3320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009910 tx=0x7f0c94009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b78a45bbcfaa25cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.716+0000 7f0ca4a00700 1 -- 172.21.15.81:0/3811938088 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94011830 con 0x7f0ca8161e00 2024-09-13T18:55:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca4a00700 1 -- 172.21.15.81:0/3811938088 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94011990 con 0x7f0ca8161e00 2024-09-13T18:55:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca4a00700 1 -- 172.21.15.81:0/3811938088 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94011d40 con 0x7f0ca8161e00 2024-09-13T18:55:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 -- 172.21.15.81:0/3811938088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 msgr2=0x7f0ca80b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 --2- 172.21.15.81:0/3811938088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca80b3320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009910 tx=0x7f0c94009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 -- 172.21.15.81:0/3811938088 shutdown_connections 2024-09-13T18:55:13.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 --2- 172.21.15.81:0/3811938088 >> v2:172.21.15.178:3300/0 conn(0x7f0ca80b1980 0x7f0ca8162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 --2- 172.21.15.81:0/3811938088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca80b3320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 -- 172.21.15.81:0/3811938088 >> 172.21.15.81:0/3811938088 conn(0x7f0ca806a390 msgr2=0x7f0ca806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:13.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 -- 172.21.15.81:0/3811938088 shutdown_connections 2024-09-13T18:55:13.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.720+0000 7f0ca7200700 1 -- 172.21.15.81:0/3811938088 wait complete. 2024-09-13T18:55:13.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 Processor -- start 2024-09-13T18:55:13.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 -- start start 2024-09-13T18:55:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca806c960 0x7f0ca81f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 0x7f0ca814e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca8159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814edd0 con 0x7f0ca80b1980 2024-09-13T18:55:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81f7700 con 0x7f0ca806c960 2024-09-13T18:55:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca814eb30 con 0x7f0ca8161e00 2024-09-13T18:55:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 0x7f0ca814e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 0x7f0ca814e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36614/0 (socket says 172.21.15.81:36614) 2024-09-13T18:55:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 -- 172.21.15.81:0/1893053380 learned_addr learned my addr 172.21.15.81:0/1893053380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:13.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca806c960 0x7f0ca81f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca6800700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca8159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 -- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 msgr2=0x7f0ca8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca8159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 -- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca806c960 msgr2=0x7f0ca81f71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca806c960 0x7f0ca81f71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 -- 172.21.15.81:0/1893053380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c94009570 con 0x7f0ca80b1980 2024-09-13T18:55:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.724+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 0x7f0ca814e5f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009f70 tx=0x7f0c94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.728+0000 7f0c9e000700 1 -- 172.21.15.81:0/1893053380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9401a900 con 0x7f0ca80b1980 2024-09-13T18:55:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.728+0000 7f0c9e000700 1 -- 172.21.15.81:0/1893053380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9401f070 con 0x7f0ca80b1980 2024-09-13T18:55:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.728+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca8158410 con 0x7f0ca80b1980 2024-09-13T18:55:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.728+0000 7f0c9e000700 1 -- 172.21.15.81:0/1893053380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9401acc0 con 0x7f0ca80b1980 2024-09-13T18:55:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.728+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca81589d0 con 0x7f0ca80b1980 2024-09-13T18:55:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0c9e000700 1 -- 172.21.15.81:0/1893053380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0c9401b430 con 0x7f0ca80b1980 2024-09-13T18:55:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 Processor -- start 2024-09-13T18:55:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0c9e000700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c88066730 0x7f0c88068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 -- start start 2024-09-13T18:55:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0c9e000700 1 -- 172.21.15.81:0/1893053380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c94021070 con 0x7f0ca80b1980 2024-09-13T18:55:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0ca6800700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c88066730 0x7f0c88068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227a2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227ec550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22733010 con 0x227ec170 2024-09-13T18:55:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x226c0f40 con 0x227a1310 2024-09-13T18:55:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.732+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22713e30 con 0x227ebd90 2024-09-13T18:55:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227a2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:48638/0 (socket says 172.21.15.81:48638) 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 -- 172.21.15.81:0/3498564802 learned_addr learned my addr 172.21.15.81:0/3498564802 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227a2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:43936/0 (socket says 172.21.15.81:43936) 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca6800700 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227ec550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca6800700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c88066730 0x7f0c88068bf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8070c10 tx=0x7f0ca000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 -- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 msgr2=0x227a2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227a2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 -- 172.21.15.81:0/3498564802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 msgr2=0x227ec550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227ec550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 -- 172.21.15.81:0/3498564802 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2257fa40 con 0x227a1310 2024-09-13T18:55:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0ca5400700 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ca520 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0c9405e970 tx=0x7f0c94006e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dec1c6078c6fc55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0c92a00700 1 -- 172.21.15.81:0/3498564802 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9406e070 con 0x227a1310 2024-09-13T18:55:13.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0c92a00700 1 -- 172.21.15.81:0/3498564802 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9401ae20 con 0x227a1310 2024-09-13T18:55:13.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0c92a00700 1 -- 172.21.15.81:0/3498564802 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c940571b0 con 0x227a1310 2024-09-13T18:55:13.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 -- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 msgr2=0x227ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ca520 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0c9405e970 tx=0x7f0c94006e70 comp rx=0 tx=0).stop 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 -- 172.21.15.81:0/3498564802 shutdown_connections 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227ec550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ca520 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/3498564802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227a2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 -- 172.21.15.81:0/3498564802 >> 172.21.15.81:0/3498564802 conn(0x225345b0 msgr2=0x227a5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 -- 172.21.15.81:0/3498564802 shutdown_connections 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.736+0000 7f0cb00e4740 1 -- 172.21.15.81:0/3498564802 wait complete. 2024-09-13T18:55:13.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 -- start start 2024-09-13T18:55:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 Processor -- start 2024-09-13T18:55:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227a1310 0x227c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 0x227c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ec170 0x227c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2270f150 con 0x227ebd90 2024-09-13T18:55:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2270ceb0 con 0x227ec170 2024-09-13T18:55:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x226ca8e0 con 0x227a1310 2024-09-13T18:55:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 10 client.0 _ll_register_callbacks cb 0x226a9670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 0x227c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 0x227c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36628/0 (socket says 172.21.15.81:36628) 2024-09-13T18:55:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 -- 172.21.15.81:0/1936559305 learned_addr learned my addr 172.21.15.81:0/1936559305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227a1310 0x227c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca6800700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ec170 0x227c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 -- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227a1310 msgr2=0x227c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227a1310 0x227c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 -- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ec170 msgr2=0x227c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ec170 0x227c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 -- 172.21.15.81:0/1936559305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca81589d0 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227a1310 0x227c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca6800700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ec170 0x227c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 0x227c56a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f0c94011db0 tx=0x7f0c94000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3581bbc25a9587e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0c87400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0c87400700 1 -- 172.21.15.81:0/1936559305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9406e040 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0c87400700 1 -- 172.21.15.81:0/1936559305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c94056ab0 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x225412c0 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0c87400700 1 -- 172.21.15.81:0/1936559305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c9405a8e0 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 10 client.9156 fetch_fsmap learned FSMap version 111 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x226d3290 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.740+0000 7f0c87400700 1 -- 172.21.15.81:0/1936559305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x225412c0 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0c87400700 1 -- 172.21.15.81:0/1936559305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 111) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0c94055fa0 con 0x227ebd90 2024-09-13T18:55:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 10 client.9156 fetch_fsmap finished waiting for FSMap version 111 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 10 client.9156 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 20 client.9156 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x227ecda0 0x227c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 4 client.9156 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2258b540 con 0x227ecda0 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x227ecda0 0x227c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x227ecda0 0x227c3c80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa57a67d978b14b2 server_cookie=5e61af86c510396f in_seq=0 out_seq=0 2024-09-13T18:55:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0c87400700 10 client.9156 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0c87400700 1 -- 172.21.15.81:0/1936559305 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2258b540 con 0x227ecda0 2024-09-13T18:55:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0c87400700 10 client.9156 handle_command_reply: tid=0 2024-09-13T18:55:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 client.9156 shutdown 2024-09-13T18:55:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 msgr2=0x227c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 0x227c56a0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f0c94011db0 tx=0x7f0c94000bc0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 shutdown_connections 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x227ecda0 0x227c3c80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ec170 0x227c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ebd90 0x227c56a0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1936559305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227a1310 0x227c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0c87400700 0 client.9156 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 >> 172.21.15.81:0/1936559305 conn(0x225345b0 msgr2=0x227ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 shutdown_connections 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1936559305 wait complete. 2024-09-13T18:55:13.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.744+0000 7f0cb00e4740 20 client.9156 trim_cache size 0 max 16384 2024-09-13T18:55:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 Processor -- start 2024-09-13T18:55:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 -- start start 2024-09-13T18:55:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ea190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x227c6880 con 0x227ec170 2024-09-13T18:55:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x225b8b80 con 0x227a1310 2024-09-13T18:55:13.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22645da0 con 0x227ebd90 2024-09-13T18:55:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36630/0 (socket says 172.21.15.81:36630) 2024-09-13T18:55:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 -- 172.21.15.81:0/2251124219 learned_addr learned my addr 172.21.15.81:0/2251124219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca5400700 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 -- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 msgr2=0x227ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227ea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 -- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 msgr2=0x227ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ea190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.764+0000 7f0ca6800700 1 -- 172.21.15.81:0/2251124219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x226b94c0 con 0x227ec170 2024-09-13T18:55:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0ca6800700 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227c4d50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00175a0 tx=0x7f0ca0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d11122ee33f171e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0c93400700 1 -- 172.21.15.81:0/2251124219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca001c040 con 0x227ec170 2024-09-13T18:55:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0c93400700 1 -- 172.21.15.81:0/2251124219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000f040 con 0x227ec170 2024-09-13T18:55:13.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0c93400700 1 -- 172.21.15.81:0/2251124219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000e040 con 0x227ec170 2024-09-13T18:55:13.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 -- 172.21.15.81:0/2251124219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 msgr2=0x227c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227c4d50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0ca00175a0 tx=0x7f0ca0014000 comp rx=0 tx=0).stop 2024-09-13T18:55:13.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 -- 172.21.15.81:0/2251124219 shutdown_connections 2024-09-13T18:55:13.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227ec170 0x227c4d50 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ebd90 0x227ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/2251124219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227a1310 0x227ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 -- 172.21.15.81:0/2251124219 >> 172.21.15.81:0/2251124219 conn(0x225345b0 msgr2=0x227a5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 -- 172.21.15.81:0/2251124219 shutdown_connections 2024-09-13T18:55:13.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 -- 172.21.15.81:0/2251124219 wait complete. 2024-09-13T18:55:13.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:55:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 -- start start 2024-09-13T18:55:13.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.768+0000 7f0cb00e4740 1 Processor -- start 2024-09-13T18:55:13.782 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 0x2284c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ebd90 0x227fb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ec170 0x227fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x227a61a0 con 0x227a1310 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22803c10 con 0x227ebd90 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x227a5f70 con 0x227ec170 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 10 client.0 _ll_register_callbacks cb 0x2270b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 0x2284c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 0x2284c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36644/0 (socket says 172.21.15.81:36644) 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 -- 172.21.15.81:0/1093714037 learned_addr learned my addr 172.21.15.81:0/1093714037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ebd90 0x227fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca6800700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ec170 0x227fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 -- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ec170 msgr2=0x227fbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ec170 0x227fbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 -- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ebd90 msgr2=0x227fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ebd90 0x227fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 -- 172.21.15.81:0/1093714037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca0011df0 con 0x227a1310 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0ca5e00700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 0x2284c1e0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x227c6310 tx=0x7f0c98007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e99a7da995007c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0c87400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0c87400700 1 -- 172.21.15.81:0/1093714037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9801f040 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c9401ae20 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.772+0000 7f0c87400700 1 -- 172.21.15.81:0/1093714037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c9801a3a0 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0c87400700 1 -- 172.21.15.81:0/1093714037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c9801a560 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 10 client.9162 fetch_fsmap learned FSMap version 111 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x226ad790 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0c87400700 1 -- 172.21.15.81:0/1093714037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9401ae20 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0c87400700 1 -- 172.21.15.81:0/1093714037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 111) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f0c9801a6c0 con 0x227a1310 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 10 client.9162 fetch_fsmap finished waiting for FSMap version 111 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 10 client.9162 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 20 client.9162 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22803f60 0x22804370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 4 client.9162 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x225b02c0 con 0x22803f60 2024-09-13T18:55:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22803f60 0x22804370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0c87400700 10 client.9162 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.776+0000 7f0ca5400700 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22803f60 0x22804370 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24074de5a6f99d18 server_cookie=44fd89e22ed9ceb1 in_seq=0 out_seq=0 2024-09-13T18:55:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0c87400700 1 -- 172.21.15.81:0/1093714037 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x225b02c0 con 0x22803f60 2024-09-13T18:55:13.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0c87400700 10 client.9162 handle_command_reply: tid=0 2024-09-13T18:55:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 client.9162 shutdown 2024-09-13T18:55:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 msgr2=0x2284c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 0x2284c1e0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x227c6310 tx=0x7f0c98007e60 comp rx=0 tx=0).stop 2024-09-13T18:55:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 shutdown_connections 2024-09-13T18:55:13.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22803f60 0x22804370 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227ec170 0x227fbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227ebd90 0x227fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 --2- 172.21.15.81:0/1093714037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x227a1310 0x2284c1e0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0c87400700 0 client.9162 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 >> 172.21.15.81:0/1093714037 conn(0x225345b0 msgr2=0x227ea0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 shutdown_connections 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 1 -- 172.21.15.81:0/1093714037 wait complete. 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0cb00e4740 20 client.9162 trim_cache size 0 max 16384 2024-09-13T18:55:13.804 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:13.805 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:55:13.805 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:55:13.805 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c88066730 msgr2=0x7f0c88068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c88066730 0x7f0c88068bf0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8070c10 tx=0x7f0ca000b040 comp rx=0 tx=0).stop 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 msgr2=0x7f0ca814e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 0x7f0ca814e5f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009f70 tx=0x7f0c94004770 comp rx=0 tx=0).stop 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 shutdown_connections 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0c88066730 0x7f0c88068bf0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ca8161e00 0x7f0ca8159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca80b1980 0x7f0ca814e5f0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 --2- 172.21.15.81:0/1893053380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ca806c960 0x7f0ca81f71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 >> 172.21.15.81:0/1893053380 conn(0x7f0ca806a390 msgr2=0x7f0ca80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 shutdown_connections 2024-09-13T18:55:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:13.796+0000 7f0ca7200700 1 -- 172.21.15.81:0/1893053380 wait complete. 2024-09-13T18:55:13.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 flush journal 2024-09-13T18:55:14.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.068+0000 7f745be00700 1 Processor -- start 2024-09-13T18:55:14.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.068+0000 7f745be00700 1 -- start start 2024-09-13T18:55:14.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745be00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f745c06cd80 0x7f745c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f745c06ada0 0x7f745c06b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745be00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745c06b710 con 0x7f745c15ca20 2024-09-13T18:55:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745be00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c160680 con 0x7f745c06ada0 2024-09-13T18:55:14.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745be00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c15d670 con 0x7f745c06cd80 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f745c06ada0 0x7f745c06b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745b400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f745c06ada0 0x7f745c06b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36652/0 (socket says 172.21.15.81:36652) 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.072+0000 7f745b400700 1 -- 172.21.15.81:0/768368592 learned_addr learned my addr 172.21.15.81:0/768368592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745a000700 1 --2- 172.21.15.81:0/768368592 >> v2:172.21.15.178:3300/0 conn(0x7f745c06cd80 0x7f745c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745b400700 1 -- 172.21.15.81:0/768368592 >> v2:172.21.15.178:3300/0 conn(0x7f745c06cd80 msgr2=0x7f745c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745b400700 1 --2- 172.21.15.81:0/768368592 >> v2:172.21.15.178:3300/0 conn(0x7f745c06cd80 0x7f745c0b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745b400700 1 -- 172.21.15.81:0/768368592 >> v1:172.21.15.178:6789/0 conn(0x7f745c15ca20 legacy=0x7f745c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745b400700 1 -- 172.21.15.81:0/768368592 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c15d950 con 0x7f745c06ada0 2024-09-13T18:55:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745b400700 1 --2- 172.21.15.81:0/768368592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c06b1d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f745c0b5db0 tx=0x7f745400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37561ed210ab1ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f7459600700 1 -- 172.21.15.81:0/768368592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400e070 con 0x7f745c06ada0 2024-09-13T18:55:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f7459600700 1 -- 172.21.15.81:0/768368592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745400b910 con 0x7f745c06ada0 2024-09-13T18:55:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f7459600700 1 -- 172.21.15.81:0/768368592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400bcc0 con 0x7f745c06ada0 2024-09-13T18:55:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 -- 172.21.15.81:0/768368592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 msgr2=0x7f745c06b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 --2- 172.21.15.81:0/768368592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c06b1d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f745c0b5db0 tx=0x7f745400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 -- 172.21.15.81:0/768368592 shutdown_connections 2024-09-13T18:55:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 --2- 172.21.15.81:0/768368592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c06b1d0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 --2- 172.21.15.81:0/768368592 >> v2:172.21.15.178:3300/0 conn(0x7f745c06cd80 0x7f745c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 -- 172.21.15.81:0/768368592 >> 172.21.15.81:0/768368592 conn(0x7f745c071d20 msgr2=0x7f745c072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 -- 172.21.15.81:0/768368592 shutdown_connections 2024-09-13T18:55:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.076+0000 7f745be00700 1 -- 172.21.15.81:0/768368592 wait complete. 2024-09-13T18:55:14.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.080+0000 7f745be00700 1 Processor -- start 2024-09-13T18:55:14.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.080+0000 7f745be00700 1 -- start start 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f745c06cd80 0x7f745c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f745c15ca20 0x7f745c0cf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c158c90 con 0x7f745c06ada0 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c1f6a70 con 0x7f745c15ca20 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c1f61d0 con 0x7f745c06cd80 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36660/0 (socket says 172.21.15.81:36660) 2024-09-13T18:55:14.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 -- 172.21.15.81:0/2172165516 learned_addr learned my addr 172.21.15.81:0/2172165516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745a000700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f745c06cd80 0x7f745c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745b400700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f745c15ca20 0x7f745c0cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 -- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f745c06cd80 msgr2=0x7f745c14ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f745c06cd80 0x7f745c14ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 -- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f745c15ca20 msgr2=0x7f745c0cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f745c15ca20 0x7f745c0cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 -- 172.21.15.81:0/2172165516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454009b30 con 0x7f745c06ada0 2024-09-13T18:55:14.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745aa00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c1f5b60 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c500 tx=0x7f744c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f7452a00700 1 -- 172.21.15.81:0/2172165516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0052d0 con 0x7f745c06ada0 2024-09-13T18:55:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f7452a00700 1 -- 172.21.15.81:0/2172165516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c005430 con 0x7f745c06ada0 2024-09-13T18:55:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c1f64b0 con 0x7f745c06ada0 2024-09-13T18:55:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f7452a00700 1 -- 172.21.15.81:0/2172165516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0055a0 con 0x7f745c06ada0 2024-09-13T18:55:14.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.084+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c0cb280 con 0x7f745c06ada0 2024-09-13T18:55:14.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.088+0000 7f7452a00700 1 -- 172.21.15.81:0/2172165516 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f744c0038e0 con 0x7f745c06ada0 2024-09-13T18:55:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7452a00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f743c066760 0x7f743c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7452a00700 1 -- 172.21.15.81:0/2172165516 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f744c083730 con 0x7f745c06ada0 2024-09-13T18:55:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 Processor -- start 2024-09-13T18:55:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745a000700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f743c066760 0x7f743c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 -- start start 2024-09-13T18:55:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745a000700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f743c066760 0x7f743c068c20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f745c153c10 tx=0x7f7448008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b16b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b193520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b0fc010 con 0x3b1b5170 2024-09-13T18:55:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b089f40 con 0x3b16a310 2024-09-13T18:55:14.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3b0dce30 con 0x3b1b4d90 2024-09-13T18:55:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36668/0 (socket says 172.21.15.81:36668) 2024-09-13T18:55:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 -- 172.21.15.81:0/1461582679 learned_addr learned my addr 172.21.15.81:0/1461582679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745aa00700 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b16b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745a000700 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b193520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 -- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 msgr2=0x3b16b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b16b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 -- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 msgr2=0x3b193520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b193520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 -- 172.21.15.81:0/1461582679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3af48a40 con 0x3b1b5170 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f745b400700 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 0x3b1b5550 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f745c06b8a0 tx=0x7f7454010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7e17486c613e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.092+0000 7f7447000700 1 -- 172.21.15.81:0/1461582679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745400bc80 con 0x3b1b5170 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7447000700 1 -- 172.21.15.81:0/1461582679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7454003a40 con 0x3b1b5170 2024-09-13T18:55:14.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7447000700 1 -- 172.21.15.81:0/1461582679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454003db0 con 0x3b1b5170 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 -- 172.21.15.81:0/1461582679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 msgr2=0x3b1b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 0x3b1b5550 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f745c06b8a0 tx=0x7f7454010000 comp rx=0 tx=0).stop 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 -- 172.21.15.81:0/1461582679 shutdown_connections 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b193520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 --2- 172.21.15.81:0/1461582679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b16b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 -- 172.21.15.81:0/1461582679 >> 172.21.15.81:0/1461582679 conn(0x3aefd5b0 msgr2=0x3b16eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 -- 172.21.15.81:0/1461582679 shutdown_connections 2024-09-13T18:55:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 -- 172.21.15.81:0/1461582679 wait complete. 2024-09-13T18:55:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 -- start start 2024-09-13T18:55:14.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 Processor -- start 2024-09-13T18:55:14.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b18e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.096+0000 7f7464a49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 0x3b192030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b0d8150 con 0x3b1b4d90 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b0d5eb0 con 0x3b16a310 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3b0938e0 con 0x3b1b5170 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 10 client.0 _ll_register_callbacks cb 0x3b072670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 0x3b192030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 0x3b192030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36680/0 (socket says 172.21.15.81:36680) 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 -- 172.21.15.81:0/2680887096 learned_addr learned my addr 172.21.15.81:0/2680887096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745aa00700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b18e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745b400700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 -- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b5170 msgr2=0x3b1b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 -- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 msgr2=0x3b18e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b18e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 -- 172.21.15.81:0/2680887096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745400be70 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745a000700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 0x3b192030 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f74480154f0 tx=0x7f7448004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30123a4b3919ef49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f743b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f743b400700 1 -- 172.21.15.81:0/2680887096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448022420 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f743b400700 1 -- 172.21.15.81:0/2680887096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7448022580 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3af0a2c0 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f743b400700 1 -- 172.21.15.81:0/2680887096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7448022740 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 10 client.9174 fetch_fsmap learned FSMap version 111 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x3b09c290 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f743b400700 1 -- 172.21.15.81:0/2680887096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x3af0a2c0 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f743b400700 1 -- 172.21.15.81:0/2680887096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 111) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f74480228a0 con 0x3b1b4d90 2024-09-13T18:55:14.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 10 client.9174 fetch_fsmap finished waiting for FSMap version 111 2024-09-13T18:55:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 10 client.9174 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 20 client.9174 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b18ff50 0x3b18c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 4 client.9174 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3af54540 con 0x3b18ff50 2024-09-13T18:55:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.100+0000 7f745aa00700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b18ff50 0x3b18c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f743b400700 10 client.9174 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f745aa00700 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b18ff50 0x3b18c7f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bfb1c1375f46614 server_cookie=17d1352370aae0d8 in_seq=0 out_seq=0 2024-09-13T18:55:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f743b400700 1 -- 172.21.15.81:0/2680887096 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3af54540 con 0x3b18ff50 2024-09-13T18:55:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f743b400700 10 client.9174 handle_command_reply: tid=0 2024-09-13T18:55:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 client.9174 shutdown 2024-09-13T18:55:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 msgr2=0x3b192030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 0x3b192030 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f74480154f0 tx=0x7f7448004770 comp rx=0 tx=0).stop 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 shutdown_connections 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b5170 0x3b1b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b1b4d90 0x3b192030 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b18ff50 0x3b18c7f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 --2- 172.21.15.81:0/2680887096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b16a310 0x3b18e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f743b400700 0 client.9174 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 >> 172.21.15.81:0/2680887096 conn(0x3aefd5b0 msgr2=0x3b1934b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 shutdown_connections 2024-09-13T18:55:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 1 -- 172.21.15.81:0/2680887096 wait complete. 2024-09-13T18:55:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.104+0000 7f7464a49740 20 client.9174 trim_cache size 0 max 16384 2024-09-13T18:55:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 Processor -- start 2024-09-13T18:55:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 -- start start 2024-09-13T18:55:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3aefd5b0 0x3b1c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b1b4d90 0x3b1c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3af81b80 con 0x3b16a310 2024-09-13T18:55:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b0d36c0 con 0x3b1b4d90 2024-09-13T18:55:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3b096810 con 0x3aefd5b0 2024-09-13T18:55:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36692/0 (socket says 172.21.15.81:36692) 2024-09-13T18:55:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 -- 172.21.15.81:0/4025078226 learned_addr learned my addr 172.21.15.81:0/4025078226 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745b400700 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b1b4d90 0x3b1c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745aa00700 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3aefd5b0 0x3b1c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 -- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3aefd5b0 msgr2=0x3b1c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3aefd5b0 0x3b1c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 -- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b1b4d90 msgr2=0x3b1c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.124+0000 7f745a000700 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b1b4d90 0x3b1c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f745a000700 1 -- 172.21.15.81:0/4025078226 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3b0824c0 con 0x3b16a310 2024-09-13T18:55:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f745a000700 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1c7f40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7448004770 tx=0x7f7448022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c30d321022945e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7447a00700 1 -- 172.21.15.81:0/4025078226 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448011c70 con 0x3b16a310 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7447a00700 1 -- 172.21.15.81:0/4025078226 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448015ae0 con 0x3b16a310 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7447a00700 1 -- 172.21.15.81:0/4025078226 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448022420 con 0x3b16a310 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 -- 172.21.15.81:0/4025078226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 msgr2=0x3b1c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1c7f40 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f7448004770 tx=0x7f7448022000 comp rx=0 tx=0).stop 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 -- 172.21.15.81:0/4025078226 shutdown_connections 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3b1b4d90 0x3b1c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1c7f40 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 --2- 172.21.15.81:0/4025078226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3aefd5b0 0x3b1c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 -- 172.21.15.81:0/4025078226 >> 172.21.15.81:0/4025078226 conn(0x3b16ef10 msgr2=0x3b1b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 -- 172.21.15.81:0/4025078226 shutdown_connections 2024-09-13T18:55:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 -- 172.21.15.81:0/4025078226 wait complete. 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 -- start start 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.128+0000 7f7464a49740 1 Processor -- start 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3aefd5b0 0x3b218bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1d4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b1d4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b1cc460 con 0x3b16a310 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3b1ce2e0 con 0x3aefd5b0 2024-09-13T18:55:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3b1cb720 con 0x3b1b4d90 2024-09-13T18:55:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 10 client.0 _ll_register_callbacks cb 0x3b0d4610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1d4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1d4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36706/0 (socket says 172.21.15.81:36706) 2024-09-13T18:55:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 -- 172.21.15.81:0/1181388320 learned_addr learned my addr 172.21.15.81:0/1181388320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745b400700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b1d4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745aa00700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3aefd5b0 0x3b218bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 -- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 msgr2=0x3b1d4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b1d4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 -- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3aefd5b0 msgr2=0x3b218bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3aefd5b0 0x3b218bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 -- 172.21.15.81:0/1181388320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3b09c290 con 0x3b16a310 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745a000700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1d4420 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f744803a040 tx=0x7f7448016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91afeedb24177d49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f743b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f743b400700 1 -- 172.21.15.81:0/1181388320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448011c70 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7454003a40 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f743b400700 1 -- 172.21.15.81:0/1181388320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7448022420 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f743b400700 1 -- 172.21.15.81:0/1181388320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74480225e0 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 10 client.9180 fetch_fsmap learned FSMap version 111 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x3b076790 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f743b400700 1 -- 172.21.15.81:0/1181388320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7454003a40 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f743b400700 1 -- 172.21.15.81:0/1181388320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 111) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f744803e070 con 0x3b16a310 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 10 client.9180 fetch_fsmap finished waiting for FSMap version 111 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 10 client.9180 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 20 client.9180 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b1b5170 0x3b1d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 4 client.9180 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:55:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x3af792c0 con 0x3b1b5170 2024-09-13T18:55:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.132+0000 7f745aa00700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b1b5170 0x3b1d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.136+0000 7f743b400700 10 client.9180 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.136+0000 7f745aa00700 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b1b5170 0x3b1d4ea0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2e8a03a013feaf server_cookie=ec550a23d4c85a1 in_seq=0 out_seq=0 2024-09-13T18:55:14.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f743b400700 1 -- 172.21.15.81:0/1181388320 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x3af792c0 con 0x3b1b5170 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f743b400700 10 client.9180 handle_command_reply: tid=0 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 client.9180 shutdown 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 msgr2=0x3b1d4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1d4420 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f744803a040 tx=0x7f7448016000 comp rx=0 tx=0).stop 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 shutdown_connections 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3b1b4d90 0x3b1d4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3b16a310 0x3b1d4420 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x3b1b5170 0x3b1d4ea0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 --2- 172.21.15.81:0/1181388320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3aefd5b0 0x3b218bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f743b400700 0 client.9180 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 >> 172.21.15.81:0/1181388320 conn(0x3b16ef10 msgr2=0x3b1b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.148+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 shutdown_connections 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f7464a49740 1 -- 172.21.15.81:0/1181388320 wait complete. 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f7464a49740 20 client.9180 trim_cache size 0 max 16384 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:55:14.160 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f743c066760 msgr2=0x7f743c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f743c066760 0x7f743c068c20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f745c153c10 tx=0x7f7448008040 comp rx=0 tx=0).stop 2024-09-13T18:55:14.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 msgr2=0x7f745c1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c1f5b60 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c500 tx=0x7f744c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 shutdown_connections 2024-09-13T18:55:14.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f743c066760 0x7f743c068c20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f745c15ca20 0x7f745c0cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f745c06cd80 0x7f745c14ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 --2- 172.21.15.81:0/2172165516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f745c06ada0 0x7f745c1f5b60 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 >> 172.21.15.81:0/2172165516 conn(0x7f745c071d20 msgr2=0x7f745c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 shutdown_connections 2024-09-13T18:55:14.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.152+0000 7f745be00700 1 -- 172.21.15.81:0/2172165516 wait complete. 2024-09-13T18:55:14.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 flush journal 2024-09-13T18:55:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.348+0000 7f9c63c00700 1 Processor -- start 2024-09-13T18:55:14.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.348+0000 7f9c63c00700 1 -- start start 2024-09-13T18:55:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c63c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c5c0ce280 0x7f9c5c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c63c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c15df90 con 0x7f9c5c15a880 2024-09-13T18:55:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c63c00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c15aea0 con 0x7f9c5c0cf1e0 2024-09-13T18:55:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c63c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cf670 con 0x7f9c5c0ce280 2024-09-13T18:55:14.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c61c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9c5c15a880 0x7f9c5c070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38582/0 (socket says 172.21.15.81:38582) 2024-09-13T18:55:14.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c61c00700 1 -- 172.21.15.81:0/1928383922 learned_addr learned my addr 172.21.15.81:0/1928383922 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:14.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.352+0000 7f9c61200700 1 --2- 172.21.15.81:0/1928383922 >> v2:172.21.15.178:3300/0 conn(0x7f9c5c0ce280 0x7f9c5c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c5b400700 1 -- 172.21.15.81:0/1928383922 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2387243540 0 0) 0x7f9c5c15df90 con 0x7f9c5c15a880 2024-09-13T18:55:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c5b400700 1 -- 172.21.15.81:0/1928383922 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c440035d0 con 0x7f9c5c15a880 2024-09-13T18:55:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c61200700 1 -- 172.21.15.81:0/1928383922 >> v1:172.21.15.178:6789/0 conn(0x7f9c5c0cf1e0 legacy=0x7f9c5c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c61200700 1 -- 172.21.15.81:0/1928383922 >> v1:172.21.15.81:6789/0 conn(0x7f9c5c15a880 legacy=0x7f9c5c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c61200700 1 -- 172.21.15.81:0/1928383922 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c15d660 con 0x7f9c5c0ce280 2024-09-13T18:55:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c61200700 1 --2- 172.21.15.81:0/1928383922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0ce280 0x7f9c5c0ceca0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009850 tx=0x7f9c50009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6d6bb6ffbffeb3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c5b400700 1 -- 172.21.15.81:0/1928383922 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50011830 con 0x7f9c5c0ce280 2024-09-13T18:55:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c5b400700 1 -- 172.21.15.81:0/1928383922 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c50011990 con 0x7f9c5c0ce280 2024-09-13T18:55:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c5b400700 1 -- 172.21.15.81:0/1928383922 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50011d40 con 0x7f9c5c0ce280 2024-09-13T18:55:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 -- 172.21.15.81:0/1928383922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0ce280 msgr2=0x7f9c5c0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 --2- 172.21.15.81:0/1928383922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0ce280 0x7f9c5c0ceca0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009850 tx=0x7f9c50009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 -- 172.21.15.81:0/1928383922 shutdown_connections 2024-09-13T18:55:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 --2- 172.21.15.81:0/1928383922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0ce280 0x7f9c5c0ceca0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 -- 172.21.15.81:0/1928383922 >> 172.21.15.81:0/1928383922 conn(0x7f9c5c06a570 msgr2=0x7f9c5c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 -- 172.21.15.81:0/1928383922 shutdown_connections 2024-09-13T18:55:14.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.356+0000 7f9c63c00700 1 -- 172.21.15.81:0/1928383922 wait complete. 2024-09-13T18:55:14.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 Processor -- start 2024-09-13T18:55:14.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 -- start start 2024-09-13T18:55:14.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c5c0ce280 0x7f9c5c1440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0cf1e0 0x7f9c5c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 0x7f9c5c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cd0b0 con 0x7f9c5c15a880 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cd390 con 0x7f9c5c0cf1e0 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c63c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cd670 con 0x7f9c5c0ce280 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 0x7f9c5c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 0x7f9c5c0afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36712/0 (socket says 172.21.15.81:36712) 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 -- 172.21.15.81:0/2004771344 learned_addr learned my addr 172.21.15.81:0/2004771344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61200700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c5c0ce280 0x7f9c5c1440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c5be00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0cf1e0 0x7f9c5c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 -- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c5c0ce280 msgr2=0x7f9c5c1440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c5c0ce280 0x7f9c5c1440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 -- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0cf1e0 msgr2=0x7f9c5c0cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0cf1e0 0x7f9c5c0cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61c00700 1 -- 172.21.15.81:0/2004771344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500094b0 con 0x7f9c5c15a880 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c61200700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c5c0ce280 0x7f9c5c1440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.360+0000 7f9c5be00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0cf1e0 0x7f9c5c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 0x7f9c5c0afd60 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400caa0 tx=0x7f9c5400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c58c00700 1 -- 172.21.15.81:0/2004771344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400a7b0 con 0x7f9c5c15a880 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c58c00700 1 -- 172.21.15.81:0/2004771344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5400a910 con 0x7f9c5c15a880 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c0cd950 con 0x7f9c5c15a880 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c58c00700 1 -- 172.21.15.81:0/2004771344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400aca0 con 0x7f9c5c15a880 2024-09-13T18:55:14.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c15ce20 con 0x7f9c5c15a880 2024-09-13T18:55:14.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.364+0000 7f9c58c00700 1 -- 172.21.15.81:0/2004771344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c5401b3b0 con 0x7f9c5c15a880 2024-09-13T18:55:14.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.368+0000 7f9c58c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9c3c066730 0x7f9c3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.368+0000 7f9c58c00700 1 -- 172.21.15.81:0/2004771344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c54083e00 con 0x7f9c5c15a880 2024-09-13T18:55:14.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.368+0000 7f9c61200700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9c3c066730 0x7f9c3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.368+0000 7f9c61200700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9c3c066730 0x7f9c3c068bf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c500090b0 tx=0x7f9c5001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.368+0000 7f9c66fea740 1 Processor -- start 2024-09-13T18:55:14.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.368+0000 7f9c66fea740 1 -- start start 2024-09-13T18:55:14.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x149c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x149e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149985d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1492c010 con 0x149e5270 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x148b9f40 con 0x149c2d00 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1490ce30 con 0x149e4950 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36716/0 (socket says 172.21.15.81:36716) 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 -- 172.21.15.81:0/2804486882 learned_addr learned my addr 172.21.15.81:0/2804486882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61200700 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x149c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c5be00700 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x149e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 -- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 msgr2=0x149c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x149c3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 -- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 msgr2=0x149e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x149e4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 -- 172.21.15.81:0/2804486882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14778a40 con 0x149e5270 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149985d0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f9c54051130 tx=0x7f9c54055400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b920a68b3afc71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c4d600700 1 -- 172.21.15.81:0/2804486882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5405d020 con 0x149e5270 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c4d600700 1 -- 172.21.15.81:0/2804486882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54052d70 con 0x149e5270 2024-09-13T18:55:14.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c4d600700 1 -- 172.21.15.81:0/2804486882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54054120 con 0x149e5270 2024-09-13T18:55:14.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- 172.21.15.81:0/2804486882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 msgr2=0x149985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149985d0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f9c54051130 tx=0x7f9c54055400 comp rx=0 tx=0).stop 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- 172.21.15.81:0/2804486882 shutdown_connections 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149985d0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x149e4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2804486882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x149c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- 172.21.15.81:0/2804486882 >> 172.21.15.81:0/2804486882 conn(0x1472d5b0 msgr2=0x1499e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- 172.21.15.81:0/2804486882 shutdown_connections 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.372+0000 7f9c66fea740 1 -- 172.21.15.81:0/2804486882 wait complete. 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 -- start start 2024-09-13T18:55:14.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 Processor -- start 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149c2d00 0x1499a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149c2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149e3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x14908150 con 0x149e5270 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14905eb0 con 0x149e4950 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x148c38e0 con 0x149c2d00 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c66fea740 10 client.0 _ll_register_callbacks cb 0x148a2670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:14.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149e3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36718/0 (socket says 172.21.15.81:36718) 2024-09-13T18:55:14.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.376+0000 7f9c61c00700 1 -- 172.21.15.81:0/1570399612 learned_addr learned my addr 172.21.15.81:0/1570399612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c5be00700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61200700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149c2d00 0x1499a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61c00700 1 -- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149c2d00 msgr2=0x1499a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61c00700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149c2d00 0x1499a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61c00700 1 -- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 msgr2=0x149c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61c00700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61c00700 1 -- 172.21.15.81:0/1570399612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c15ce20 con 0x149e5270 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61c00700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149e3530 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f9c54051130 tx=0x7f9c54001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19653492a128c732 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c42000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c42000700 1 -- 172.21.15.81:0/1570399612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5407f070 con 0x149e5270 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c42000700 1 -- 172.21.15.81:0/1570399612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c5405d020 con 0x149e5270 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1473a2c0 con 0x149e5270 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c42000700 1 -- 172.21.15.81:0/1570399612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c5400ae00 con 0x149e5270 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 10 client.9192 fetch_fsmap learned FSMap version 111 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x148cc290 con 0x149e5270 2024-09-13T18:55:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c42000700 1 -- 172.21.15.81:0/1570399612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1473a2c0 con 0x149e5270 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c42000700 1 -- 172.21.15.81:0/1570399612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 111) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f9c54050a20 con 0x149e5270 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 10 client.9192 fetch_fsmap finished waiting for FSMap version 111 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 10 client.9192 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 20 client.9192 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f5b10 0x149f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 4 client.9192 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14784540 con 0x149f5b10 2024-09-13T18:55:14.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.380+0000 7f9c61200700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f5b10 0x149f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c61200700 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f5b10 0x149f7f00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24efd7e1e8cd74de server_cookie=6ab992954fa853c9 in_seq=0 out_seq=0 2024-09-13T18:55:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c42000700 10 client.9192 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c42000700 1 -- 172.21.15.81:0/1570399612 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x14784540 con 0x149f5b10 2024-09-13T18:55:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c42000700 10 client.9192 handle_command_reply: tid=0 2024-09-13T18:55:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 client.9192 shutdown 2024-09-13T18:55:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 msgr2=0x149e3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149e3530 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f9c54051130 tx=0x7f9c54001250 comp rx=0 tx=0).stop 2024-09-13T18:55:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 shutdown_connections 2024-09-13T18:55:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f5b10 0x149f7f00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149e3530 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1570399612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149c2d00 0x1499a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c42000700 0 client.9192 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 >> 172.21.15.81:0/1570399612 conn(0x1472d5b0 msgr2=0x1499b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 shutdown_connections 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 1 -- 172.21.15.81:0/1570399612 wait complete. 2024-09-13T18:55:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.384+0000 7f9c66fea740 20 client.9192 trim_cache size 0 max 16384 2024-09-13T18:55:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 Processor -- start 2024-09-13T18:55:14.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 -- start start 2024-09-13T18:55:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 0x149ede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e5270 0x149ecd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x147b1b80 con 0x149c2d00 2024-09-13T18:55:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x148a4620 con 0x149e4950 2024-09-13T18:55:14.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x149036c0 con 0x149e5270 2024-09-13T18:55:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 0x149ede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 0x149ede90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36724/0 (socket says 172.21.15.81:36724) 2024-09-13T18:55:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 -- 172.21.15.81:0/1001018025 learned_addr learned my addr 172.21.15.81:0/1001018025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c5be00700 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61c00700 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e5270 0x149ecd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 -- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e5270 msgr2=0x149ecd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e5270 0x149ecd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 -- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 msgr2=0x149ee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149ee3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 -- 172.21.15.81:0/1001018025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x148b24c0 con 0x149c2d00 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.404+0000 7f9c61200700 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 0x149ede90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9c50013000 tx=0x7f9c50010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369cfb8c9e1a576e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c4e000700 1 -- 172.21.15.81:0/1001018025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5002a070 con 0x149c2d00 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c4e000700 1 -- 172.21.15.81:0/1001018025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5002b040 con 0x149c2d00 2024-09-13T18:55:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c4e000700 1 -- 172.21.15.81:0/1001018025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50031620 con 0x149c2d00 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 -- 172.21.15.81:0/1001018025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 msgr2=0x149ede90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 0x149ede90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9c50013000 tx=0x7f9c50010000 comp rx=0 tx=0).stop 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 -- 172.21.15.81:0/1001018025 shutdown_connections 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e5270 0x149ecd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149e4950 0x149ee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 --2- 172.21.15.81:0/1001018025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149c2d00 0x149ede90 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 -- 172.21.15.81:0/1001018025 >> 172.21.15.81:0/1001018025 conn(0x1472d5b0 msgr2=0x1499d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 -- 172.21.15.81:0/1001018025 shutdown_connections 2024-09-13T18:55:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 -- 172.21.15.81:0/1001018025 wait complete. 2024-09-13T18:55:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 -- start start 2024-09-13T18:55:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.408+0000 7f9c66fea740 1 Processor -- start 2024-09-13T18:55:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x14a456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x14a45bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x149f5340 con 0x149e5270 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x149c1890 con 0x149c2d00 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x149f9c70 con 0x149e4950 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 10 client.0 _ll_register_callbacks cb 0x148d58f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36738/0 (socket says 172.21.15.81:36738) 2024-09-13T18:55:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 -- 172.21.15.81:0/2081085592 learned_addr learned my addr 172.21.15.81:0/2081085592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:14.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61200700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x14a456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c5be00700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x14a45bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 -- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 msgr2=0x14a45bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x14a45bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 -- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 msgr2=0x14a456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x14a456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 -- 172.21.15.81:0/2081085592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c15d660 con 0x149e5270 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c5be00700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x14a45bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c61c00700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149f8f50 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9c54055350 tx=0x7f9c540014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28db2de177d654e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c42000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c42000700 1 -- 172.21.15.81:0/2081085592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5407f070 con 0x149e5270 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c42000700 1 -- 172.21.15.81:0/2081085592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c5405d020 con 0x149e5270 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.412+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c54052d70 con 0x149e5270 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c42000700 1 -- 172.21.15.81:0/2081085592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=111) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c54054770 con 0x149e5270 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 10 client.9198 fetch_fsmap learned FSMap version 111 2024-09-13T18:55:14.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=111,monmap=2+}) v3 -- 0x148a6790 con 0x149e5270 2024-09-13T18:55:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c42000700 1 -- 172.21.15.81:0/2081085592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c54045070 con 0x149e5270 2024-09-13T18:55:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c42000700 1 -- 172.21.15.81:0/2081085592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 111) v1 ==== 3150+0+0 (secure 0 0 0) 0x7f9c54053b90 con 0x149e5270 2024-09-13T18:55:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 10 client.9198 fetch_fsmap finished waiting for FSMap version 111 2024-09-13T18:55:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 10 client.9198 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 20 client.9198 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f9490 0x14a01980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 4 client.9198 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x147a92c0 con 0x149f9490 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c61200700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f9490 0x14a01980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c61200700 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f9490 0x14a01980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=42149473a1ec969 server_cookie=50bbdfc8f9d3e483 in_seq=0 out_seq=0 2024-09-13T18:55:14.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.416+0000 7f9c42000700 10 client.9198 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c42000700 1 -- 172.21.15.81:0/2081085592 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x147a92c0 con 0x149f9490 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c42000700 10 client.9198 handle_command_reply: tid=0 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 client.9198 shutdown 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 msgr2=0x149f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149f8f50 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9c54055350 tx=0x7f9c540014d0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 shutdown_connections 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x149f9490 0x14a01980 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x149e5270 0x149f8f50 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x149e4950 0x14a45bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c42000700 0 client.9198 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 --2- 172.21.15.81:0/2081085592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x149c2d00 0x14a456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 >> 172.21.15.81:0/2081085592 conn(0x1472d5b0 msgr2=0x1499d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 shutdown_connections 2024-09-13T18:55:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.432+0000 7f9c66fea740 1 -- 172.21.15.81:0/2081085592 wait complete. 2024-09-13T18:55:14.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c66fea740 20 client.9198 trim_cache size 0 max 16384 2024-09-13T18:55:14.444 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "message": "", 2024-09-13T18:55:14.444 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:55:14.444 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9c3c066730 msgr2=0x7f9c3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9c3c066730 0x7f9c3c068bf0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9c500090b0 tx=0x7f9c5001c040 comp rx=0 tx=0).stop 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 msgr2=0x7f9c5c0afd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 0x7f9c5c0afd60 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400caa0 tx=0x7f9c5400cb80 comp rx=0 tx=0).stop 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 shutdown_connections 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9c3c066730 0x7f9c3c068bf0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c15a880 0x7f9c5c0afd60 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c5c0cf1e0 0x7f9c5c0cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 --2- 172.21.15.81:0/2004771344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c5c0ce280 0x7f9c5c1440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 >> 172.21.15.81:0/2004771344 conn(0x7f9c5c06a570 msgr2=0x7f9c5c0ad0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 shutdown_connections 2024-09-13T18:55:14.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:14.436+0000 7f9c63c00700 1 -- 172.21.15.81:0/2004771344 wait complete. 2024-09-13T18:55:14.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:14.467 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-13T18:55:14.503 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/ 2024-09-13T18:55:14.503 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4 2024-09-13T18:55:14.504 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5 2024-09-13T18:55:14.504 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6 2024-09-13T18:55:14.504 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-13T18:55:14.504 INFO:teuthology.orchestra.run.smithi081.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-13T18:55:14.505 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:55:14.505 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:55:14.505 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:55:14.505 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:55:14.506 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-13T18:55:14.506 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:55:14.640 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627778 2024-09-13T18:55:14.828 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:55:14.828 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:55:14.829 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:55:14.829 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:55:14.829 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-13T18:55:14.829 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:55:14.963 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627779 2024-09-13T18:55:15.154 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:55:15.154 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:55:15.154 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:55:15.154 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:55:15.154 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-13T18:55:15.154 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:55:15.290 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627780 2024-09-13T18:55:15.478 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:55:15.478 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:55:15.478 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:55:15.478 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:55:15.478 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-13T18:55:15.479 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:55:15.617 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627781 2024-09-13T18:55:15.806 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:55:15.806 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:55:15.806 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:55:15.807 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:55:15.807 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-13T18:55:15.807 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:55:15.950 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627782 2024-09-13T18:55:16.137 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:55:16.137 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-13T18:55:16.137 DEBUG:teuthology.orchestra.run.smithi081:> import stat 2024-09-13T18:55:16.137 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-13T18:55:16.137 DEBUG:teuthology.orchestra.run.smithi081:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-13T18:55:16.137 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-13T18:55:16.286 INFO:teuthology.orchestra.run.smithi081.stdout:1099511627783 2024-09-13T18:55:16.476 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-13T18:55:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.584+0000 7f9b6d222140 1 Processor -- start 2024-09-13T18:55:16.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.584+0000 7f9b6d222140 1 -- start start 2024-09-13T18:55:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6d222140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165bc760 0x5653165fd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6d222140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165cda50 0x5653166a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6d222140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653166a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6d222140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565316565a00 con 0x5653165cde30 2024-09-13T18:55:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6d222140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653165612f0 con 0x5653165cda50 2024-09-13T18:55:16.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6d222140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56531651d8e0 con 0x5653165bc760 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653166a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653166a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43638/0 (socket says 172.21.15.81:43638) 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 -- 172.21.15.81:0/521263484 learned_addr learned my addr 172.21.15.81:0/521263484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6a400700 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165bc760 0x5653165fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b69a00700 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165cda50 0x5653166a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 -- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165bc760 msgr2=0x5653165fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165bc760 0x5653165fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 -- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165cda50 msgr2=0x5653166a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165cda50 0x5653166a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 -- 172.21.15.81:0/521263484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5800a100 con 0x5653165cde30 2024-09-13T18:55:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b6ae00700 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653166a9fc0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400b1c0 tx=0x7f9b6400b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97773a6dcb5f94b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b63e00700 1 -- 172.21.15.81:0/521263484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400f3a0 con 0x5653165cde30 2024-09-13T18:55:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b63e00700 1 -- 172.21.15.81:0/521263484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6400a040 con 0x5653165cde30 2024-09-13T18:55:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.588+0000 7f9b63e00700 1 -- 172.21.15.81:0/521263484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400f740 con 0x5653165cde30 2024-09-13T18:55:16.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- 172.21.15.81:0/521263484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 msgr2=0x5653166a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653166a9fc0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400b1c0 tx=0x7f9b6400b4d0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- 172.21.15.81:0/521263484 shutdown_connections 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653166a9fc0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165cda50 0x5653166a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- 172.21.15.81:0/521263484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165bc760 0x5653165fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- 172.21.15.81:0/521263484 >> 172.21.15.81:0/521263484 conn(0x5653165fa0e0 msgr2=0x5653165fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- 172.21.15.81:0/521263484 shutdown_connections 2024-09-13T18:55:16.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- 172.21.15.81:0/521263484 wait complete. 2024-09-13T18:55:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 Processor -- start 2024-09-13T18:55:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- start start 2024-09-13T18:55:16.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165bc760 0x5653167397f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165cda50 0x5653165f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653165f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56531651d580 con 0x5653165cde30 2024-09-13T18:55:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653164f38d0 con 0x5653165bc760 2024-09-13T18:55:16.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6d222140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653165f0230 con 0x5653165cda50 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653165f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6ae00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653165f6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43646/0 (socket says 172.21.15.81:43646) 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6ae00700 1 -- 172.21.15.81:0/2047531949 learned_addr learned my addr 172.21.15.81:0/2047531949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b6a400700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165bc760 0x5653167397f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.592+0000 7f9b69a00700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165cda50 0x5653165f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6a400700 1 -- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165cda50 msgr2=0x5653165f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6a400700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5653165cda50 0x5653165f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6a400700 1 -- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 msgr2=0x5653165f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6a400700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653165cde30 0x5653165f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6a400700 1 -- 172.21.15.81:0/2047531949 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64001ac0 con 0x5653165bc760 2024-09-13T18:55:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6a400700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165bc760 0x5653167397f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0011e0 tx=0x7f9b5c001e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b62a00700 1 -- 172.21.15.81:0/2047531949 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c001a80 con 0x5653165bc760 2024-09-13T18:55:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b62a00700 1 -- 172.21.15.81:0/2047531949 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5c00f450 con 0x5653165bc760 2024-09-13T18:55:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5653164fef40 con 0x5653165bc760 2024-09-13T18:55:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b62a00700 1 -- 172.21.15.81:0/2047531949 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c00f800 con 0x5653165bc760 2024-09-13T18:55:16.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.596+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653164fe9a0 con 0x5653165bc760 2024-09-13T18:55:16.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b62a00700 1 -- 172.21.15.81:0/2047531949 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9b5c015020 con 0x5653165bc760 2024-09-13T18:55:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b62a00700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b4c065090 0x7f9b4c067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b62a00700 1 -- 172.21.15.81:0/2047531949 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b5c0832e0 con 0x5653165bc760 2024-09-13T18:55:16.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b69a00700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b4c065090 0x7f9b4c067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b6d222140 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x565316739d30 0x5653165f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 --> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] -- osd_op(unknown.0.0:1 15.12 15:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x565316732060 con 0x565316739d30 2024-09-13T18:55:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.600+0000 7f9b6ae00700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x565316739d30 0x5653165f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b69a00700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b4c065090 0x7f9b4c067550 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9b58013040 tx=0x7f9b58007030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6ae00700 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x565316739d30 0x5653165f7270 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6ae00700 1 -- 172.21.15.81:0/2047531949 <== osd.3 v2:172.21.15.81:6816/3484646797 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v109'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f9b64018040 con 0x565316739d30 2024-09-13T18:55:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x565316739d30 msgr2=0x5653165f7270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x565316739d30 0x5653165f7270 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b4c065090 msgr2=0x7f9b4c067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9b4c065090 0x7f9b4c067550 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9b58013040 tx=0x7f9b58007030 comp rx=0 tx=0).stop 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165bc760 msgr2=0x5653167397f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 --2- 172.21.15.81:0/2047531949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5653165bc760 0x5653167397f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c0011e0 tx=0x7f9b5c001e90 comp rx=0 tx=0).stop 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6ae00700 1 -- 172.21.15.81:0/2047531949 reap_dead start 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 shutdown_connections 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 >> 172.21.15.81:0/2047531949 conn(0x5653165fa0e0 msgr2=0x5653165f1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 shutdown_connections 2024-09-13T18:55:16.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.604+0000 7f9b6d222140 1 -- 172.21.15.81:0/2047531949 wait complete. 2024-09-13T18:55:16.622 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-13T18:55:16.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 Processor -- start 2024-09-13T18:55:16.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 -- start start 2024-09-13T18:55:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 0x5577cfb87340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfc1e7a0 0x5577cfb8fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc20b80 0x5577cfc1cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577cfafaa00 con 0x5577cfbac990 2024-09-13T18:55:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577cfaf62f0 con 0x5577cfc20b80 2024-09-13T18:55:16.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa634a140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577cfab28e0 con 0x5577cfc1e7a0 2024-09-13T18:55:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 0x5577cfb87340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 0x5577cfb87340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43650/0 (socket says 172.21.15.81:43650) 2024-09-13T18:55:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 -- 172.21.15.81:0/260193342 learned_addr learned my addr 172.21.15.81:0/260193342 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa2c00700 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfc1e7a0 0x5577cfb8fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa4000700 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc20b80 0x5577cfc1cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 -- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfc1e7a0 msgr2=0x5577cfb8fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfc1e7a0 0x5577cfb8fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 -- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc20b80 msgr2=0x5577cfc1cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc20b80 0x5577cfc1cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa3600700 1 -- 172.21.15.81:0/260193342 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94005d20 con 0x5577cfbac990 2024-09-13T18:55:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.680+0000 7f4fa4000700 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc20b80 0x5577cfc1cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa3600700 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 0x5577cfb87340 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400ab80 tx=0x7f4f9400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49c4bc16ff55502 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa1800700 1 -- 172.21.15.81:0/260193342 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9400a230 con 0x5577cfbac990 2024-09-13T18:55:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa1800700 1 -- 172.21.15.81:0/260193342 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f94008880 con 0x5577cfbac990 2024-09-13T18:55:16.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa1800700 1 -- 172.21.15.81:0/260193342 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f94008c30 con 0x5577cfbac990 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 -- 172.21.15.81:0/260193342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 msgr2=0x5577cfb87340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 0x5577cfb87340 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f4f9400ab80 tx=0x7f4f9400d000 comp rx=0 tx=0).stop 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 -- 172.21.15.81:0/260193342 shutdown_connections 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc20b80 0x5577cfc1cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfc1e7a0 0x5577cfb8fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 --2- 172.21.15.81:0/260193342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfbac990 0x5577cfb87340 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 -- 172.21.15.81:0/260193342 >> 172.21.15.81:0/260193342 conn(0x5577cfb65d90 msgr2=0x5577cfb94040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 -- 172.21.15.81:0/260193342 shutdown_connections 2024-09-13T18:55:16.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 -- 172.21.15.81:0/260193342 wait complete. 2024-09-13T18:55:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 Processor -- start 2024-09-13T18:55:16.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.684+0000 7f4fa634a140 1 -- start start 2024-09-13T18:55:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfbac990 0x5577cfc37c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc1e7a0 0x5577cfba3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfc20b80 0x5577cfc1b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577cfab2580 con 0x5577cfc20b80 2024-09-13T18:55:16.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577cfa888d0 con 0x5577cfc1e7a0 2024-09-13T18:55:16.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5577cfba48b0 con 0x5577cfbac990 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfc20b80 0x5577cfc1b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfc20b80 0x5577cfc1b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43662/0 (socket says 172.21.15.81:43662) 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 -- 172.21.15.81:0/3229175094 learned_addr learned my addr 172.21.15.81:0/3229175094 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa3600700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfbac990 0x5577cfc37c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa2c00700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc1e7a0 0x5577cfba3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 -- 172.21.15.81:0/3229175094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfbac990 msgr2=0x5577cfc37c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5577cfbac990 0x5577cfc37c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 -- 172.21.15.81:0/3229175094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc1e7a0 msgr2=0x5577cfba3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5577cfc1e7a0 0x5577cfba3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 -- 172.21.15.81:0/3229175094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577cfaa0b00 con 0x5577cfc20b80 2024-09-13T18:55:16.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa4000700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfc20b80 0x5577cfc1b8f0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d1e0 tx=0x7f4f9c00d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4f9be00700 1 -- 172.21.15.81:0/3229175094 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c00dd20 con 0x5577cfc20b80 2024-09-13T18:55:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4f9be00700 1 -- 172.21.15.81:0/3229175094 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9c00de80 con 0x5577cfc20b80 2024-09-13T18:55:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4f9be00700 1 -- 172.21.15.81:0/3229175094 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c003310 con 0x5577cfc20b80 2024-09-13T18:55:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5577cfa93f40 con 0x5577cfc20b80 2024-09-13T18:55:16.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.688+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5577cfa939a0 con 0x5577cfc20b80 2024-09-13T18:55:16.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.692+0000 7f4f9be00700 1 -- 172.21.15.81:0/3229175094 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4f9c001650 con 0x5577cfc20b80 2024-09-13T18:55:16.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.692+0000 7f4f9be00700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.692+0000 7f4f9be00700 1 -- 172.21.15.81:0/3229175094 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4f9c0825e0 con 0x5577cfc20b80 2024-09-13T18:55:16.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.692+0000 7f4fa3600700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.696+0000 7f4fa634a140 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x5577cfc1be30 0x5577cfb86960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.696+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 --> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] -- osd_op(unknown.0.0:1 15.12 15:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x5577cfb654f0 con 0x5577cfc1be30 2024-09-13T18:55:16.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.696+0000 7f4fa2c00700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x5577cfc1be30 0x5577cfb86960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.696+0000 7f4fa3600700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4f94020040 tx=0x7f4f94017040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.696+0000 7f4fa2c00700 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x5577cfc1be30 0x5577cfb86960 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.696+0000 7f4fa2c00700 1 -- 172.21.15.81:0/3229175094 <== osd.3 v2:172.21.15.81:6816/3484646797 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v109'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4f90010600 con 0x5577cfc1be30 2024-09-13T18:55:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x5577cfc1be30 msgr2=0x5577cfb86960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x5577cfc1be30 0x5577cfb86960 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 msgr2=0x7f4f84067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4f84065060 0x7f4f84067520 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f4f94020040 tx=0x7f4f94017040 comp rx=0 tx=0).stop 2024-09-13T18:55:16.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfc20b80 msgr2=0x5577cfc1b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 --2- 172.21.15.81:0/3229175094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577cfc20b80 0x5577cfc1b8f0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00d1e0 tx=0x7f4f9c00d4f0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa4000700 1 -- 172.21.15.81:0/3229175094 reap_dead start 2024-09-13T18:55:16.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 shutdown_connections 2024-09-13T18:55:16.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 >> 172.21.15.81:0/3229175094 conn(0x5577cfb65d90 msgr2=0x5577cfb8e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 shutdown_connections 2024-09-13T18:55:16.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.700+0000 7f4fa634a140 1 -- 172.21.15.81:0/3229175094 wait complete. 2024-09-13T18:55:16.715 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-13T18:55:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 Processor -- start 2024-09-13T18:55:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 -- start start 2024-09-13T18:55:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbf34270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbf1b560 0x55b4dbea8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4dbdf5a00 con 0x55b4dbea8810 2024-09-13T18:55:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4dbdf12f0 con 0x55b4dbf1b560 2024-09-13T18:55:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd27448c140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4dbdad8e0 con 0x55b4dbe5d540 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbf34270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbf34270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43664/0 (socket says 172.21.15.81:43664) 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 -- 172.21.15.81:0/4017084401 learned_addr learned my addr 172.21.15.81:0/4017084401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd272000700 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbf1b560 0x55b4dbea8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd271600700 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 -- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbe5d540 msgr2=0x55b4dbf38050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 -- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbf1b560 msgr2=0x55b4dbea8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbf1b560 0x55b4dbea8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 -- 172.21.15.81:0/4017084401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c00a100 con 0x55b4dbea8810 2024-09-13T18:55:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd270c00700 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbf34270 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd25c001ce0 tx=0x7fd25c00b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f5e3f396ba2a26 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd26b400700 1 -- 172.21.15.81:0/4017084401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00bde0 con 0x55b4dbea8810 2024-09-13T18:55:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd26b400700 1 -- 172.21.15.81:0/4017084401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c00e470 con 0x55b4dbea8810 2024-09-13T18:55:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.780+0000 7fd26b400700 1 -- 172.21.15.81:0/4017084401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00e820 con 0x55b4dbea8810 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- 172.21.15.81:0/4017084401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 msgr2=0x55b4dbf34270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbf34270 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fd25c001ce0 tx=0x7fd25c00b5d0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- 172.21.15.81:0/4017084401 shutdown_connections 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbf1b560 0x55b4dbea8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbf34270 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- 172.21.15.81:0/4017084401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- 172.21.15.81:0/4017084401 >> 172.21.15.81:0/4017084401 conn(0x55b4dbe5ecb0 msgr2=0x55b4dbe919d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- 172.21.15.81:0/4017084401 shutdown_connections 2024-09-13T18:55:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- 172.21.15.81:0/4017084401 wait complete. 2024-09-13T18:55:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 Processor -- start 2024-09-13T18:55:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- start start 2024-09-13T18:55:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbea7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbf1b560 0x55b4dbea59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4dbdad580 con 0x55b4dbea8810 2024-09-13T18:55:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4dbd838d0 con 0x55b4dbe5d540 2024-09-13T18:55:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd27448c140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4dbea2060 con 0x55b4dbf1b560 2024-09-13T18:55:16.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.784+0000 7fd270c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbea7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbea7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43670/0 (socket says 172.21.15.81:43670) 2024-09-13T18:55:16.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 -- 172.21.15.81:0/2318908188 learned_addr learned my addr 172.21.15.81:0/2318908188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd272000700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbf1b560 0x55b4dbea59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd271600700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 -- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbf1b560 msgr2=0x55b4dbea59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbf1b560 0x55b4dbea59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 -- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbe5d540 msgr2=0x55b4dbf38050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b4dbe5d540 0x55b4dbf38050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 -- 172.21.15.81:0/2318908188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4dbdb5ca0 con 0x55b4dbea8810 2024-09-13T18:55:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd272000700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b4dbf1b560 0x55b4dbea59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd270c00700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbea7d50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0011e0 tx=0x7fd25c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd26a000700 1 -- 172.21.15.81:0/2318908188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c01e070 con 0x55b4dbea8810 2024-09-13T18:55:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd26a000700 1 -- 172.21.15.81:0/2318908188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c001210 con 0x55b4dbea8810 2024-09-13T18:55:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd26a000700 1 -- 172.21.15.81:0/2318908188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00eea0 con 0x55b4dbea8810 2024-09-13T18:55:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b4dbd8ef40 con 0x55b4dbea8810 2024-09-13T18:55:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.788+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4dbd8e9a0 con 0x55b4dbea8810 2024-09-13T18:55:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd26a000700 1 -- 172.21.15.81:0/2318908188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd25c017640 con 0x55b4dbea8810 2024-09-13T18:55:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd26a000700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd250065060 0x7fd250067520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd26a000700 1 -- 172.21.15.81:0/2318908188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd25c0842c0 con 0x55b4dbea8810 2024-09-13T18:55:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd271600700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd250065060 0x7fd250067520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd27448c140 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55b4dbf32610 0x55b4dbf32a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- osd_op(unknown.0.0:1 15.5 15:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x55b4dbf32f60 con 0x55b4dbf32610 2024-09-13T18:55:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd272000700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55b4dbf32610 0x55b4dbf32a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.792+0000 7fd271600700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd250065060 0x7fd250067520 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd264000c00 tx=0x7fd2640038d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd272000700 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55b4dbf32610 0x55b4dbf32a20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd272000700 1 -- 172.21.15.81:0/2318908188 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v109'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd26c00fa60 con 0x55b4dbf32610 2024-09-13T18:55:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55b4dbf32610 msgr2=0x55b4dbf32a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x55b4dbf32610 0x55b4dbf32a20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd250065060 msgr2=0x7fd250067520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd250065060 0x7fd250067520 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd264000c00 tx=0x7fd2640038d0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 msgr2=0x55b4dbea7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 --2- 172.21.15.81:0/2318908188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b4dbea8810 0x55b4dbea7d50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0011e0 tx=0x7fd25c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd272000700 1 -- 172.21.15.81:0/2318908188 reap_dead start 2024-09-13T18:55:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 shutdown_connections 2024-09-13T18:55:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 >> 172.21.15.81:0/2318908188 conn(0x55b4dbe5ecb0 msgr2=0x55b4dbe919d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 shutdown_connections 2024-09-13T18:55:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.796+0000 7fd27448c140 1 -- 172.21.15.81:0/2318908188 wait complete. 2024-09-13T18:55:16.814 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-13T18:55:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 Processor -- start 2024-09-13T18:55:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 -- start start 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55696562cc20 0x556965749540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656a9c90 0x5569656a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 0x5569656a9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556965580a00 con 0x5569656aa070 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696557c2f0 con 0x55696562cc20 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c2aae140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569655388e0 con 0x5569656a9c90 2024-09-13T18:55:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c0600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 0x5569656a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.872+0000 7f79c0600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 0x5569656a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43684/0 (socket says 172.21.15.81:43684) 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 -- 172.21.15.81:0/99260617 learned_addr learned my addr 172.21.15.81:0/99260617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79bfc00700 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55696562cc20 0x556965749540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79bf200700 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656a9c90 0x5569656a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 -- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656a9c90 msgr2=0x5569656a8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656a9c90 0x5569656a8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 -- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55696562cc20 msgr2=0x556965749540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55696562cc20 0x556965749540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 -- 172.21.15.81:0/99260617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b800a100 con 0x5569656aa070 2024-09-13T18:55:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c0600700 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 0x5569656a9010 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f79b8013040 tx=0x7f79b800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9074fcfe1f497b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79bde00700 1 -- 172.21.15.81:0/99260617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800f790 con 0x5569656aa070 2024-09-13T18:55:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79bde00700 1 -- 172.21.15.81:0/99260617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b800fa60 con 0x5569656aa070 2024-09-13T18:55:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79bde00700 1 -- 172.21.15.81:0/99260617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b800fe10 con 0x5569656aa070 2024-09-13T18:55:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 -- 172.21.15.81:0/99260617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 msgr2=0x5569656a9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 0x5569656a9010 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f79b8013040 tx=0x7f79b800f000 comp rx=0 tx=0).stop 2024-09-13T18:55:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 -- 172.21.15.81:0/99260617 shutdown_connections 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569656aa070 0x5569656a9010 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656a9c90 0x5569656a8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 --2- 172.21.15.81:0/99260617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55696562cc20 0x556965749540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 -- 172.21.15.81:0/99260617 >> 172.21.15.81:0/99260617 conn(0x5569656150e0 msgr2=0x5569656191a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 -- 172.21.15.81:0/99260617 shutdown_connections 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.876+0000 7f79c2aae140 1 -- 172.21.15.81:0/99260617 wait complete. 2024-09-13T18:55:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 Processor -- start 2024-09-13T18:55:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 -- start start 2024-09-13T18:55:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55696562cc20 0x55696569c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569656a9c90 0x55696560ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656aa070 0x556965611c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556965538580 con 0x55696562cc20 2024-09-13T18:55:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55696550e8d0 con 0x5569656a9c90 2024-09-13T18:55:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55696560efa0 con 0x5569656aa070 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55696562cc20 0x55696569c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55696562cc20 0x55696569c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43688/0 (socket says 172.21.15.81:43688) 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 -- 172.21.15.81:0/4104030836 learned_addr learned my addr 172.21.15.81:0/4104030836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bf200700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569656a9c90 0x55696560ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c0600700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656aa070 0x556965611c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 -- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656aa070 msgr2=0x556965611c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656aa070 0x556965611c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 -- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569656a9c90 msgr2=0x55696560ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5569656a9c90 0x55696560ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 -- 172.21.15.81:0/4104030836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556965526b00 con 0x55696562cc20 2024-09-13T18:55:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c0600700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5569656aa070 0x556965611c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bfc00700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55696562cc20 0x55696569c6c0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f79b0002dd0 tx=0x7f79b000c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bca00700 1 -- 172.21.15.81:0/4104030836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0002c10 con 0x55696562cc20 2024-09-13T18:55:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bca00700 1 -- 172.21.15.81:0/4104030836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0008030 con 0x55696562cc20 2024-09-13T18:55:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556965519f40 con 0x55696562cc20 2024-09-13T18:55:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79bca00700 1 -- 172.21.15.81:0/4104030836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0011450 con 0x55696562cc20 2024-09-13T18:55:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.880+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569655199a0 con 0x55696562cc20 2024-09-13T18:55:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.884+0000 7f79bca00700 1 -- 172.21.15.81:0/4104030836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f79b00115b0 con 0x55696562cc20 2024-09-13T18:55:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.884+0000 7f79bca00700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79a0065090 0x7f79a0067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.884+0000 7f79bca00700 1 -- 172.21.15.81:0/4104030836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f79b0083110 con 0x55696562cc20 2024-09-13T18:55:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.888+0000 7f79bf200700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79a0065090 0x7f79a0067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.888+0000 7f79c2aae140 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x556965630df0 0x5569656100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.888+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- osd_op(unknown.0.0:1 15.9 15:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x556965610600 con 0x556965630df0 2024-09-13T18:55:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.888+0000 7f79c0600700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x556965630df0 0x5569656100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.888+0000 7f79bf200700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79a0065090 0x7f79a0067550 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f79ac000c00 tx=0x7f79ac001590 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.888+0000 7f79c0600700 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x556965630df0 0x5569656100c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c0600700 1 -- 172.21.15.81:0/4104030836 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v109'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f79b800fbd0 con 0x556965630df0 2024-09-13T18:55:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x556965630df0 msgr2=0x5569656100c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x556965630df0 0x5569656100c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79a0065090 msgr2=0x7f79a0067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f79a0065090 0x7f79a0067550 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f79ac000c00 tx=0x7f79ac001590 comp rx=0 tx=0).stop 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55696562cc20 msgr2=0x55696569c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 --2- 172.21.15.81:0/4104030836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55696562cc20 0x55696569c6c0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f79b0002dd0 tx=0x7f79b000c530 comp rx=0 tx=0).stop 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c0600700 1 -- 172.21.15.81:0/4104030836 reap_dead start 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 shutdown_connections 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 >> 172.21.15.81:0/4104030836 conn(0x5569656150e0 msgr2=0x556965619160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 shutdown_connections 2024-09-13T18:55:16.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.892+0000 7f79c2aae140 1 -- 172.21.15.81:0/4104030836 wait complete. 2024-09-13T18:55:16.906 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-13T18:55:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 Processor -- start 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 -- start start 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 0x564d768f3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d768f4080 0x564d7684c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d76863040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d767b02f0 con 0x564d76868340 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d7676c8e0 con 0x564d768f4460 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa84240e140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d7676c580 con 0x564d768f4080 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 0x564d768f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 0x564d768f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43702/0 (socket says 172.21.15.81:43702) 2024-09-13T18:55:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 -- 172.21.15.81:0/2299426948 learned_addr learned my addr 172.21.15.81:0/2299426948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa840000700 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d76863040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83ec00700 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d768f4080 0x564d7684c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 -- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d768f4080 msgr2=0x564d7684c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d768f4080 0x564d7684c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 -- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 msgr2=0x564d76863040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d76863040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 -- 172.21.15.81:0/2299426948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83800a100 con 0x564d76868340 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83ec00700 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d768f4080 0x564d7684c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.964+0000 7fa83f600700 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 0x564d768f3200 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa83000b310 tx=0x7fa83000b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c70f125e43fc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa83d800700 1 -- 172.21.15.81:0/2299426948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa830014070 con 0x564d76868340 2024-09-13T18:55:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa83d800700 1 -- 172.21.15.81:0/2299426948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83000f3f0 con 0x564d76868340 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa83d800700 1 -- 172.21.15.81:0/2299426948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83000f760 con 0x564d76868340 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 -- 172.21.15.81:0/2299426948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 msgr2=0x564d768f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 0x564d768f3200 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa83000b310 tx=0x7fa83000b620 comp rx=0 tx=0).stop 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 -- 172.21.15.81:0/2299426948 shutdown_connections 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d76863040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d768f4080 0x564d7684c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 --2- 172.21.15.81:0/2299426948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d76868340 0x564d768f3200 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 -- 172.21.15.81:0/2299426948 >> 172.21.15.81:0/2299426948 conn(0x564d7681f0c0 msgr2=0x564d768f0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 -- 172.21.15.81:0/2299426948 shutdown_connections 2024-09-13T18:55:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 -- 172.21.15.81:0/2299426948 wait complete. 2024-09-13T18:55:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 Processor -- start 2024-09-13T18:55:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.968+0000 7fa84240e140 1 -- start start 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d76868340 0x564d7681d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d768f4080 0x564d76840900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d769891e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d767428d0 con 0x564d768f4080 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d76840e40 con 0x564d768f4460 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d76841080 con 0x564d76868340 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d768f4080 0x564d76840900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d768f4080 0x564d76840900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43704/0 (socket says 172.21.15.81:43704) 2024-09-13T18:55:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 -- 172.21.15.81:0/1804354525 learned_addr learned my addr 172.21.15.81:0/1804354525 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa840000700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d769891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83f600700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d76868340 0x564d7681d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 -- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d76868340 msgr2=0x564d7681d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d76868340 0x564d7681d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 -- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 msgr2=0x564d769891e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d769891e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 -- 172.21.15.81:0/1804354525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa830001c10 con 0x564d768f4080 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa840000700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d768f4460 0x564d769891e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa83ec00700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d768f4080 0x564d76840900 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009f30 tx=0x7fa82c008790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa837e00700 1 -- 172.21.15.81:0/1804354525 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c018070 con 0x564d768f4080 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa837e00700 1 -- 172.21.15.81:0/1804354525 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c010040 con 0x564d768f4080 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564d7675ab00 con 0x564d768f4080 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa837e00700 1 -- 172.21.15.81:0/1804354525 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c006590 con 0x564d768f4080 2024-09-13T18:55:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.972+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d7674df40 con 0x564d768f4080 2024-09-13T18:55:16.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.976+0000 7fa837e00700 1 -- 172.21.15.81:0/1804354525 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa82c005020 con 0x564d768f4080 2024-09-13T18:55:16.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa837e00700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa820065090 0x7fa820067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa837e00700 1 -- 172.21.15.81:0/1804354525 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa82c082920 con 0x564d768f4080 2024-09-13T18:55:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa83f600700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa820065090 0x7fa820067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa84240e140 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x564d7684c900 0x564d76842b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- osd_op(unknown.0.0:1 15.5 15:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x564d768f62f0 con 0x564d7684c900 2024-09-13T18:55:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa83f600700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa820065090 0x7fa820067550 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa83000b310 tx=0x7fa830008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa840000700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x564d7684c900 0x564d76842b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.980+0000 7fa840000700 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x564d7684c900 0x564d76842b20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa840000700 1 -- 172.21.15.81:0/1804354525 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v109'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa83800f690 con 0x564d7684c900 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x564d7684c900 msgr2=0x564d76842b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x564d7684c900 0x564d76842b20 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa820065090 msgr2=0x7fa820067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa820065090 0x7fa820067550 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa83000b310 tx=0x7fa830008000 comp rx=0 tx=0).stop 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d768f4080 msgr2=0x564d76840900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 --2- 172.21.15.81:0/1804354525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564d768f4080 0x564d76840900 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009f30 tx=0x7fa82c008790 comp rx=0 tx=0).stop 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa840000700 1 -- 172.21.15.81:0/1804354525 reap_dead start 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 shutdown_connections 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 >> 172.21.15.81:0/1804354525 conn(0x564d7681f0c0 msgr2=0x564d76864d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 shutdown_connections 2024-09-13T18:55:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:16.984+0000 7fa84240e140 1 -- 172.21.15.81:0/1804354525 wait complete. 2024-09-13T18:55:17.001 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-13T18:55:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.064+0000 7fea275ab140 1 Processor -- start 2024-09-13T18:55:17.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.064+0000 7fea275ab140 1 -- start start 2024-09-13T18:55:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea275ab140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ebed6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea275ab140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebeb47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea275ab140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ebeb4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea275ab140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ebe4ca00 con 0x5624ebf75c90 2024-09-13T18:55:17.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea275ab140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ebe482f0 con 0x5624ebee54b0 2024-09-13T18:55:17.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea275ab140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624ebe048e0 con 0x5624ebefce20 2024-09-13T18:55:17.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebeb47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebeb47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43716/0 (socket says 172.21.15.81:43716) 2024-09-13T18:55:17.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 -- 172.21.15.81:0/2047190308 learned_addr learned my addr 172.21.15.81:0/2047190308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea25200700 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ebeb4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea24800700 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ebed6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 -- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 msgr2=0x5624ebed6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ebed6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 -- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 msgr2=0x5624ebeb4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ebeb4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 -- 172.21.15.81:0/2047190308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea10005d20 con 0x5624ebf75c90 2024-09-13T18:55:17.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea25200700 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ebeb4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:17.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea23e00700 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebeb47a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fea10002000 tx=0x7fea1000d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc19b20985a1f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea22a00700 1 -- 172.21.15.81:0/2047190308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10017070 con 0x5624ebf75c90 2024-09-13T18:55:17.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea22a00700 1 -- 172.21.15.81:0/2047190308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10013970 con 0x5624ebf75c90 2024-09-13T18:55:17.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.068+0000 7fea22a00700 1 -- 172.21.15.81:0/2047190308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1001a040 con 0x5624ebf75c90 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- 172.21.15.81:0/2047190308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 msgr2=0x5624ebeb47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebeb47a0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fea10002000 tx=0x7fea1000d000 comp rx=0 tx=0).stop 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- 172.21.15.81:0/2047190308 shutdown_connections 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ebeb4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebeb47a0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- 172.21.15.81:0/2047190308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ebed6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- 172.21.15.81:0/2047190308 >> 172.21.15.81:0/2047190308 conn(0x5624ebee10e0 msgr2=0x5624ebeb52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- 172.21.15.81:0/2047190308 shutdown_connections 2024-09-13T18:55:17.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- 172.21.15.81:0/2047190308 wait complete. 2024-09-13T18:55:17.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 Processor -- start 2024-09-13T18:55:17.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- start start 2024-09-13T18:55:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ec004ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ec022170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebf73320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ebe04580 con 0x5624ebf75c90 2024-09-13T18:55:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624ebdda8d0 con 0x5624ebee54b0 2024-09-13T18:55:17.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.072+0000 7fea275ab140 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624ec0226b0 con 0x5624ebefce20 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea25200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebf73320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ec004ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea25200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebf73320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43726/0 (socket says 172.21.15.81:43726) 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea25200700 1 -- 172.21.15.81:0/2108081738 learned_addr learned my addr 172.21.15.81:0/2108081738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea23e00700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ec022170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 -- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 msgr2=0x5624ec022170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5624ebefce20 0x5624ec022170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 -- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 msgr2=0x5624ebf73320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebf73320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 -- 172.21.15.81:0/2108081738 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624ebdf2b00 con 0x5624ebee54b0 2024-09-13T18:55:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea25200700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624ebf75c90 0x5624ebf73320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea24800700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ec004ae0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea1400b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea21600700 1 -- 172.21.15.81:0/2108081738 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14010410 con 0x5624ebee54b0 2024-09-13T18:55:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea21600700 1 -- 172.21.15.81:0/2108081738 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea14010590 con 0x5624ebee54b0 2024-09-13T18:55:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624ebde5f40 con 0x5624ebee54b0 2024-09-13T18:55:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea21600700 1 -- 172.21.15.81:0/2108081738 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14010940 con 0x5624ebee54b0 2024-09-13T18:55:17.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.076+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624ebde59a0 con 0x5624ebee54b0 2024-09-13T18:55:17.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.080+0000 7fea21600700 1 -- 172.21.15.81:0/2108081738 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea14010aa0 con 0x5624ebee54b0 2024-09-13T18:55:17.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.080+0000 7fea21600700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea04065090 0x7fea04067550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.080+0000 7fea21600700 1 -- 172.21.15.81:0/2108081738 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea1400a040 con 0x5624ebee54b0 2024-09-13T18:55:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.080+0000 7fea23e00700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea04065090 0x7fea04067550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.080+0000 7fea275ab140 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5624ec006ad0 0x5624ebeda250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.080+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- osd_op(unknown.0.0:1 15.1d 15:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v8 -- 0x5624ebeda790 con 0x5624ec006ad0 2024-09-13T18:55:17.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea25200700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5624ec006ad0 0x5624ebeda250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea23e00700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea04065090 0x7fea04067550 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fea10002000 tx=0x7fea10008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea25200700 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5624ec006ad0 0x5624ebeda250 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea25200700 1 -- 172.21.15.81:0/2108081738 <== osd.4 v2:172.21.15.178:6803/1450995168 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v109'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fea1c003cf0 con 0x5624ec006ad0 2024-09-13T18:55:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5624ec006ad0 msgr2=0x5624ebeda250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea275ab140 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x5624ec006ad0 0x5624ebeda250 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea04065090 msgr2=0x7fea04067550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.084+0000 7fea275ab140 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fea04065090 0x7fea04067550 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fea10002000 tx=0x7fea10008000 comp rx=0 tx=0).stop 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 msgr2=0x5624ec004ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea275ab140 1 --2- 172.21.15.81:0/2108081738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5624ebee54b0 0x5624ec004ae0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fea14000f60 tx=0x7fea1400b7f0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea25200700 1 -- 172.21.15.81:0/2108081738 reap_dead start 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 shutdown_connections 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 >> 172.21.15.81:0/2108081738 conn(0x5624ebee10e0 msgr2=0x5624ebeb52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 shutdown_connections 2024-09-13T18:55:17.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.088+0000 7fea275ab140 1 -- 172.21.15.81:0/2108081738 wait complete. 2024-09-13T18:55:17.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start /d1/d2/d3 recursive,force 2024-09-13T18:55:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.276+0000 7f8065200700 1 Processor -- start 2024-09-13T18:55:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.276+0000 7f8065200700 1 -- start start 2024-09-13T18:55:17.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f8065200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f806015cb40 0x7f80600b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f8065200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f8065200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80600af700 con 0x7f80600d08e0 2024-09-13T18:55:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f8065200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80600b2f60 con 0x7f806015cb40 2024-09-13T18:55:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f8065200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80600ce850 con 0x7f80600b25b0 2024-09-13T18:55:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:50050/0 (socket says 172.21.15.81:50050) 2024-09-13T18:55:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 -- 172.21.15.81:0/2776807722 learned_addr learned my addr 172.21.15.81:0/2776807722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805f400700 1 --2- 172.21.15.81:0/2776807722 >> v2:172.21.15.178:3300/0 conn(0x7f806015cb40 0x7f80600b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 -- 172.21.15.81:0/2776807722 >> v2:172.21.15.178:3300/0 conn(0x7f806015cb40 msgr2=0x7f80600b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 --2- 172.21.15.81:0/2776807722 >> v2:172.21.15.178:3300/0 conn(0x7f806015cb40 0x7f80600b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 -- 172.21.15.81:0/2776807722 >> v1:172.21.15.178:6789/0 conn(0x7f80600d08e0 legacy=0x7f80600d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.280+0000 7f805ea00700 1 -- 172.21.15.81:0/2776807722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806015cf20 con 0x7f80600b25b0 2024-09-13T18:55:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f805ea00700 1 --2- 172.21.15.81:0/2776807722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600b2a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f804c009910 tx=0x7f804c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fba4efe4248dc54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f805e000700 1 -- 172.21.15.81:0/2776807722 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c011830 con 0x7f80600b25b0 2024-09-13T18:55:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f805e000700 1 -- 172.21.15.81:0/2776807722 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c011990 con 0x7f80600b25b0 2024-09-13T18:55:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f805e000700 1 -- 172.21.15.81:0/2776807722 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c011d40 con 0x7f80600b25b0 2024-09-13T18:55:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 -- 172.21.15.81:0/2776807722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 msgr2=0x7f80600b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 --2- 172.21.15.81:0/2776807722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600b2a20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f804c009910 tx=0x7f804c009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 -- 172.21.15.81:0/2776807722 shutdown_connections 2024-09-13T18:55:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 --2- 172.21.15.81:0/2776807722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600b2a20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 --2- 172.21.15.81:0/2776807722 >> v2:172.21.15.178:3300/0 conn(0x7f806015cb40 0x7f80600b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 -- 172.21.15.81:0/2776807722 >> 172.21.15.81:0/2776807722 conn(0x7f8060066270 msgr2=0x7f8060071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 -- 172.21.15.81:0/2776807722 shutdown_connections 2024-09-13T18:55:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.284+0000 7f8065200700 1 -- 172.21.15.81:0/2776807722 wait complete. 2024-09-13T18:55:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 Processor -- start 2024-09-13T18:55:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 -- start start 2024-09-13T18:55:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80600d08e0 0x7f806015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f806015cb40 0x7f8060142300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8060160400 con 0x7f80600d08e0 2024-09-13T18:55:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80601f3180 con 0x7f806015cb40 2024-09-13T18:55:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f8065200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80601f3460 con 0x7f80600b25b0 2024-09-13T18:55:17.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:50062/0 (socket says 172.21.15.81:50062) 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 -- 172.21.15.81:0/2981141944 learned_addr learned my addr 172.21.15.81:0/2981141944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805fe00700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f806015cb40 0x7f8060142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805ea00700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80600d08e0 0x7f806015fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 -- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f806015cb40 msgr2=0x7f8060142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f806015cb40 0x7f8060142300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 -- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80600d08e0 msgr2=0x7f806015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80600d08e0 0x7f806015fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.288+0000 7f805f400700 1 -- 172.21.15.81:0/2981141944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c009570 con 0x7f80600b25b0 2024-09-13T18:55:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.292+0000 7f805f400700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600cc650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f805000e870 tx=0x7f805000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.292+0000 7f8057400700 1 -- 172.21.15.81:0/2981141944 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500095a0 con 0x7f80600b25b0 2024-09-13T18:55:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.292+0000 7f8057400700 1 -- 172.21.15.81:0/2981141944 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8050013680 con 0x7f80600b25b0 2024-09-13T18:55:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.292+0000 7f8057400700 1 -- 172.21.15.81:0/2981141944 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80500139f0 con 0x7f80600b25b0 2024-09-13T18:55:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.292+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80601f3790 con 0x7f80600b25b0 2024-09-13T18:55:17.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.292+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80601f3d50 con 0x7f80600b25b0 2024-09-13T18:55:17.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.296+0000 7f8057400700 1 -- 172.21.15.81:0/2981141944 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8050013b50 con 0x7f80600b25b0 2024-09-13T18:55:17.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.296+0000 7f8057400700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8040066730 0x7f8040068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.296+0000 7f8057400700 1 -- 172.21.15.81:0/2981141944 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8050084200 con 0x7f80600b25b0 2024-09-13T18:55:17.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.296+0000 7f805ea00700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8040066730 0x7f8040068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.296+0000 7f8069c7c740 1 Processor -- start 2024-09-13T18:55:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.296+0000 7f8069c7c740 1 -- start start 2024-09-13T18:55:17.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805ea00700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8040066730 0x7f8040068bf0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f804c000c00 tx=0x7f804c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa62af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa65040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa67970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xa989530 con 0xaa1d1e0 2024-09-13T18:55:17.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xa986cc0 con 0xaa1d5c0 2024-09-13T18:55:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xa9825b0 con 0xaa65580 2024-09-13T18:55:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa62af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa62af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43752/0 (socket says 172.21.15.81:43752) 2024-09-13T18:55:17.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 -- 172.21.15.81:0/2754933759 learned_addr learned my addr 172.21.15.81:0/2754933759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 -- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 msgr2=0xaa67970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa67970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 -- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 msgr2=0xaa65040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805ea00700 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa65040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa65040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 -- 172.21.15.81:0/2754933759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xa874f10 con 0xaa1d1e0 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805ea00700 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa65040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f805f400700 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa62af0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f805005cef0 tx=0x7f8050055030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620555bf106d3300 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f804be00700 1 -- 172.21.15.81:0/2754933759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050053170 con 0xaa1d1e0 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f804be00700 1 -- 172.21.15.81:0/2754933759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80500533d0 con 0xaa1d1e0 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f804be00700 1 -- 172.21.15.81:0/2754933759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050055290 con 0xaa1d1e0 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- 172.21.15.81:0/2754933759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 msgr2=0xaa62af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa62af0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f805005cef0 tx=0x7f8050055030 comp rx=0 tx=0).stop 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- 172.21.15.81:0/2754933759 shutdown_connections 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa67970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa65040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2754933759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa62af0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- 172.21.15.81:0/2754933759 >> 172.21.15.81:0/2754933759 conn(0xa7a97b0 msgr2=0xaa43ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- 172.21.15.81:0/2754933759 shutdown_connections 2024-09-13T18:55:17.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.300+0000 7f8069c7c740 1 -- 172.21.15.81:0/2754933759 wait complete. 2024-09-13T18:55:17.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 -- start start 2024-09-13T18:55:17.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 Processor -- start 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa1b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa1b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa6bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xa945950 con 0xaa1d1e0 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xa9455f0 con 0xaa1d5c0 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xa917e40 con 0xaa65580 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f8069c7c740 10 client.0 _ll_register_callbacks cb 0xa97bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa1b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa1b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43764/0 (socket says 172.21.15.81:43764) 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 -- 172.21.15.81:0/2756317773 learned_addr learned my addr 172.21.15.81:0/2756317773 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805ea00700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa1b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805fe00700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa6bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 -- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 msgr2=0xaa6bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa6bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 -- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 msgr2=0xaa1b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa1b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805f400700 1 -- 172.21.15.81:0/2756317773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80601f3d50 con 0xaa1d1e0 2024-09-13T18:55:17.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.304+0000 7f805fe00700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa6bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f805f400700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa1b240 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f8050084170 tx=0x7f8050000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13130b3c426a0eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 1 -- 172.21.15.81:0/2756317773 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8050054e00 con 0xaa1d1e0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 1 -- 172.21.15.81:0/2756317773 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f805005b070 con 0xaa1d1e0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xa7b64c0 con 0xaa1d1e0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 1 -- 172.21.15.81:0/2756317773 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8050051370 con 0xaa1d1e0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 10 client.9264 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0xa948630 con 0xaa1d1e0 2024-09-13T18:55:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 1 -- 172.21.15.81:0/2756317773 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805007a020 con 0xaa1d1e0 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 1 -- 172.21.15.81:0/2756317773 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f8050055290 con 0xaa1d1e0 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 10 client.9264 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 10 client.9264 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 20 client.9264 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa65f30 0xaa66340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 4 client.9264 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xa800740 con 0xaa65f30 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f805ea00700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa65f30 0xaa66340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f805ea00700 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa65f30 0xaa66340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d22b16dcd05054 server_cookie=d9ac394d8d1ea8ab in_seq=0 out_seq=0 2024-09-13T18:55:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 10 client.9264 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 1 -- 172.21.15.81:0/2756317773 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xa800740 con 0xaa65f30 2024-09-13T18:55:17.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8048c00700 10 client.9264 handle_command_reply: tid=0 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 client.9264 shutdown 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 msgr2=0xaa1b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa1b240 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f8050084170 tx=0x7f8050000bc0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 shutdown_connections 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa65f30 0xaa66340 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaa6bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.308+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d5c0 0xaa1b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.312+0000 7f8069c7c740 1 --2- 172.21.15.81:0/2756317773 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d1e0 0xaa1b240 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.312+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 >> 172.21.15.81:0/2756317773 conn(0xa7a97b0 msgr2=0xaa63a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.312+0000 7f8048c00700 0 client.9264 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.312+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 shutdown_connections 2024-09-13T18:55:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.312+0000 7f8069c7c740 1 -- 172.21.15.81:0/2756317773 wait complete. 2024-09-13T18:55:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.312+0000 7f8069c7c740 20 client.9264 trim_cache size 0 max 16384 2024-09-13T18:55:17.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 Processor -- start 2024-09-13T18:55:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 -- start start 2024-09-13T18:55:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa1d1e0 0xaa6b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaa6b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa65580 0xaa63740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xa97dda0 con 0xaa1d5c0 2024-09-13T18:55:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xa97fdc0 con 0xaa65580 2024-09-13T18:55:17.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xa917e40 con 0xaa1d1e0 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaa6b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa65580 0xaa63740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaa6b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43780/0 (socket says 172.21.15.81:43780) 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 -- 172.21.15.81:0/3972579114 learned_addr learned my addr 172.21.15.81:0/3972579114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805f400700 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa1d1e0 0xaa6b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 -- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa1d1e0 msgr2=0xaa6b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa1d1e0 0xaa6b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 -- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa65580 msgr2=0xaa63740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa65580 0xaa63740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 -- 172.21.15.81:0/3972579114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xa92e860 con 0xaa1d5c0 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f805ea00700 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaa6b890 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f804c013000 tx=0x7f804c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3480be0510dcb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.332+0000 7f8054c00700 1 -- 172.21.15.81:0/3972579114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c020070 con 0xaa1d5c0 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8054c00700 1 -- 172.21.15.81:0/3972579114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804c02e040 con 0xaa1d5c0 2024-09-13T18:55:17.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8054c00700 1 -- 172.21.15.81:0/3972579114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c034650 con 0xaa1d5c0 2024-09-13T18:55:17.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 -- 172.21.15.81:0/3972579114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 msgr2=0xaa6b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaa6b890 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f804c013000 tx=0x7f804c010000 comp rx=0 tx=0).stop 2024-09-13T18:55:17.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 -- 172.21.15.81:0/3972579114 shutdown_connections 2024-09-13T18:55:17.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa65580 0xaa63740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaa6b890 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 --2- 172.21.15.81:0/3972579114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa1d1e0 0xaa6b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 -- 172.21.15.81:0/3972579114 >> 172.21.15.81:0/3972579114 conn(0xa7a97b0 msgr2=0xaa406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 -- 172.21.15.81:0/3972579114 shutdown_connections 2024-09-13T18:55:17.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 -- 172.21.15.81:0/3972579114 wait complete. 2024-09-13T18:55:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 -- start start 2024-09-13T18:55:17.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.336+0000 7f8069c7c740 1 Processor -- start 2024-09-13T18:55:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d1e0 0xaa5d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaacc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaacc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xa9205d0 con 0xaa1d5c0 2024-09-13T18:55:17.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xa93c040 con 0xaa1d1e0 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xaa8ac90 con 0xaa65580 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 10 client.0 _ll_register_callbacks cb 0xa981180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaacc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaacc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43782/0 (socket says 172.21.15.81:43782) 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 -- 172.21.15.81:0/718090734 learned_addr learned my addr 172.21.15.81:0/718090734 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805f400700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d1e0 0xaa5d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805fe00700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaacc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 -- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 msgr2=0xaacc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaacc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 -- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d1e0 msgr2=0xaa5d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d1e0 0xaa5d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 -- 172.21.15.81:0/718090734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806015cf20 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805f400700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d1e0 0xaa5d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805fe00700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaacc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f805ea00700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaacc160 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f804c037040 tx=0x7f804c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce44b8664a3d2533 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8048c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8048c00700 1 -- 172.21.15.81:0/718090734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804c020040 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xaa60ed0 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.340+0000 7f8048c00700 1 -- 172.21.15.81:0/718090734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f804c0036c0 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 1 -- 172.21.15.81:0/718090734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f804c034910 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 10 client.9270 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0xa7f4c40 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 1 -- 172.21.15.81:0/718090734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xaa60ed0 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 1 -- 172.21.15.81:0/718090734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f804c003880 con 0xaa1d5c0 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 10 client.9270 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:17.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 10 client.9270 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 20 client.9270 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa5dce0 0xaa69370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 4 client.9270 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) v1 -- 0x7f80500533d0 con 0xaa5dce0 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f805f400700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa5dce0 0xaa69370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 10 client.9270 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f805f400700 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa5dce0 0xaa69370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb82b6cef758888c server_cookie=87f30a13aa6b3b21 in_seq=0 out_seq=0 2024-09-13T18:55:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 1 -- 172.21.15.81:0/718090734 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f80500533d0 con 0xaa5dce0 2024-09-13T18:55:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 10 client.9270 handle_command_reply: tid=0 2024-09-13T18:55:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 client.9270 shutdown 2024-09-13T18:55:17.356 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:55:17.344+0000 7fb8c4e00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:54:59.537231+0000 1=0+1) n(v3 rc2024-09-13T18:54:59.805225+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8602 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x56157ab01600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.537231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.805225+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.537231+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:54:59.805225+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:55:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 msgr2=0xaacc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaacc160 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f804c037040 tx=0x7f804c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 shutdown_connections 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xaa5dce0 0xaa69370 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xaa65580 0xaacc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xaa1d5c0 0xaacc160 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 --2- 172.21.15.81:0/718090734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xaa1d1e0 0xaa5d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 >> 172.21.15.81:0/718090734 conn(0xa7a97b0 msgr2=0xaa5cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.344+0000 7f8048c00700 0 client.9270 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 shutdown_connections 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8069c7c740 1 -- 172.21.15.81:0/718090734 wait complete. 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8069c7c740 20 client.9270 trim_cache size 0 max 16384 2024-09-13T18:55:17.358 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-09-13T18:55:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:17.359 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-09-13T18:55:17.359 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:17.359 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f338f800700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v2 rc2024-09-13T18:54:59.805225+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8602 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x558c9a0f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.805225+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:54:59.805225+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:55:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8040066730 msgr2=0x7f8040068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8040066730 0x7f8040068bf0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f804c000c00 tx=0x7f804c008030 comp rx=0 tx=0).stop 2024-09-13T18:55:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 msgr2=0x7f80600cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600cc650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f805000e870 tx=0x7f805000eb80 comp rx=0 tx=0).stop 2024-09-13T18:55:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 shutdown_connections 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8040066730 0x7f8040068bf0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f806015cb40 0x7f8060142300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f80600d08e0 0x7f806015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 --2- 172.21.15.81:0/2981141944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80600b25b0 0x7f80600cc650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 >> 172.21.15.81:0/2981141944 conn(0x7f8060066270 msgr2=0x7f80600b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 shutdown_connections 2024-09-13T18:55:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f8065200700 1 -- 172.21.15.81:0/2981141944 wait complete. 2024-09-13T18:55:17.361 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-13T18:55:17.348+0000 7fb8cc600700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v4 rc2024-09-13T18:54:59.805225+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={8602=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x56157ab01b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.805225+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:54:59.805225+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:55:17.361 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-13T18:55:17.348+0000 7f3397000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v1 rc2024-09-13T18:54:59.805225+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={8602=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x558c9a0f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.541231+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:54:59.805225+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:55:17.362 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:55:17.347+0000 7f4e5dc00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v0 rc2024-09-13T18:54:59.541231+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8602 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x562172feb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.541231+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:54:59.541231+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:55:17.362 INFO:tasks.ceph.mds.d.smithi178.stderr:2024-09-13T18:55:17.347+0000 7f4e5dc00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/AsLsXsFsx@2},l=8602 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x562172febb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:55:17.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub pause 2024-09-13T18:55:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.548+0000 7fb34b200700 1 Processor -- start 2024-09-13T18:55:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.548+0000 7fb34b200700 1 -- start start 2024-09-13T18:55:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb34b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34c143b70 0x7fb34c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb34b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d070 0x7fb34c0b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb34b200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0b1980 con 0x7fb34c06d620 2024-09-13T18:55:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb34b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0b2500 con 0x7fb34c143b70 2024-09-13T18:55:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb34b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0b1bd0 con 0x7fb34c06d070 2024-09-13T18:55:17.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34c143b70 0x7fb34c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb34c143b70 0x7fb34c0cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43790/0 (socket says 172.21.15.81:43790) 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb34c06d620 0x7fb34c06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41296/0 (socket says 172.21.15.81:41296) 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 -- 172.21.15.81:0/742624555 learned_addr learned my addr 172.21.15.81:0/742624555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb34a800700 1 --2- 172.21.15.81:0/742624555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d070 0x7fb34c0b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 -- 172.21.15.81:0/742624555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d070 msgr2=0x7fb34c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 --2- 172.21.15.81:0/742624555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d070 0x7fb34c0b2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 -- 172.21.15.81:0/742624555 >> v1:172.21.15.81:6789/0 conn(0x7fb34c06d620 legacy=0x7fb34c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb348a00700 1 -- 172.21.15.81:0/742624555 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237328046 0 0) 0x7fb34c0b1980 con 0x7fb34c06d620 2024-09-13T18:55:17.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 -- 172.21.15.81:0/742624555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0b1eb0 con 0x7fb34c143b70 2024-09-13T18:55:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb349e00700 1 --2- 172.21.15.81:0/742624555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c143b70 0x7fb34c0cde20 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009e50 tx=0x7fb33c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6673fd96fba3fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb348a00700 1 -- 172.21.15.81:0/742624555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00e070 con 0x7fb34c143b70 2024-09-13T18:55:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb348a00700 1 -- 172.21.15.81:0/742624555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c00b910 con 0x7fb34c143b70 2024-09-13T18:55:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.552+0000 7fb348a00700 1 -- 172.21.15.81:0/742624555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c00bcc0 con 0x7fb34c143b70 2024-09-13T18:55:17.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 -- 172.21.15.81:0/742624555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c143b70 msgr2=0x7fb34c0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 --2- 172.21.15.81:0/742624555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c143b70 0x7fb34c0cde20 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009e50 tx=0x7fb33c00b330 comp rx=0 tx=0).stop 2024-09-13T18:55:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 -- 172.21.15.81:0/742624555 shutdown_connections 2024-09-13T18:55:17.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 --2- 172.21.15.81:0/742624555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d070 0x7fb34c0b2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 --2- 172.21.15.81:0/742624555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c143b70 0x7fb34c0cde20 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 -- 172.21.15.81:0/742624555 >> 172.21.15.81:0/742624555 conn(0x7fb34c06a390 msgr2=0x7fb34c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 -- 172.21.15.81:0/742624555 shutdown_connections 2024-09-13T18:55:17.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.556+0000 7fb34b200700 1 -- 172.21.15.81:0/742624555 wait complete. 2024-09-13T18:55:17.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 Processor -- start 2024-09-13T18:55:17.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 -- start start 2024-09-13T18:55:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 0x7fb34c0adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d620 0x7fb34c071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb34c143b70 0x7fb34c13cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0ae1a0 con 0x7fb34c06d070 2024-09-13T18:55:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c071c80 con 0x7fb34c143b70 2024-09-13T18:55:17.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0acbc0 con 0x7fb34c06d620 2024-09-13T18:55:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 0x7fb34c0adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 0x7fb34c0adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43804/0 (socket says 172.21.15.81:43804) 2024-09-13T18:55:17.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 -- 172.21.15.81:0/2947832694 learned_addr learned my addr 172.21.15.81:0/2947832694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349400700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d620 0x7fb34c071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34a800700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb34c143b70 0x7fb34c13cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 -- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d620 msgr2=0x7fb34c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d620 0x7fb34c071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 -- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb34c143b70 msgr2=0x7fb34c13cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb34c143b70 0x7fb34c13cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349e00700 1 -- 172.21.15.81:0/2947832694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c009b30 con 0x7fb34c06d070 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb34a800700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb34c143b70 0x7fb34c13cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.560+0000 7fb349400700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d620 0x7fb34c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.564+0000 7fb349e00700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 0x7fb34c0adc60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0742f0 tx=0x7fb33c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.564+0000 7fb342000700 1 -- 172.21.15.81:0/2947832694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0099b0 con 0x7fb34c06d070 2024-09-13T18:55:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.564+0000 7fb342000700 1 -- 172.21.15.81:0/2947832694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c0092e0 con 0x7fb34c06d070 2024-09-13T18:55:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.564+0000 7fb342000700 1 -- 172.21.15.81:0/2947832694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c01c640 con 0x7fb34c06d070 2024-09-13T18:55:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.564+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c0acea0 con 0x7fb34c06d070 2024-09-13T18:55:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.564+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0ad460 con 0x7fb34c06d070 2024-09-13T18:55:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb342000700 1 -- 172.21.15.81:0/2947832694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb33c01c7a0 con 0x7fb34c06d070 2024-09-13T18:55:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb342000700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb32c066760 0x7fb32c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb3544de740 1 Processor -- start 2024-09-13T18:55:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb342000700 1 -- 172.21.15.81:0/2947832694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb33c085ca0 con 0x7fb34c06d070 2024-09-13T18:55:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb3544de740 1 -- start start 2024-09-13T18:55:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb349400700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb32c066760 0x7fb32c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.568+0000 7fb349400700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb32c066760 0x7fb32c068c20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0ce1e0 tx=0x7fb338009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 0x2429ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x242bd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x242715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x241e4dd0 con 0x242bcf60 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x241e2560 con 0x2429b4a0 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x241dde50 con 0x242bd880 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 0x2429ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 0x2429ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43820/0 (socket says 172.21.15.81:43820) 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 -- 172.21.15.81:0/3234020492 learned_addr learned my addr 172.21.15.81:0/3234020492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb34a800700 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x242715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349400700 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x242bd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 -- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 msgr2=0x242715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x242715f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 -- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 msgr2=0x242bd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x242bd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 -- 172.21.15.81:0/3234020492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24050a00 con 0x242bcf60 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb34a800700 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x242715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb349e00700 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 0x2429ba30 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fb33c056a60 tx=0x7fb33c0564c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b14acd7e882666 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb336a00700 1 -- 172.21.15.81:0/3234020492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c05a990 con 0x242bcf60 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb336a00700 1 -- 172.21.15.81:0/3234020492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c05ef50 con 0x242bcf60 2024-09-13T18:55:17.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb336a00700 1 -- 172.21.15.81:0/3234020492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c053270 con 0x242bcf60 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- 172.21.15.81:0/3234020492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 msgr2=0x2429ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 0x2429ba30 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fb33c056a60 tx=0x7fb33c0564c0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- 172.21.15.81:0/3234020492 shutdown_connections 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x242715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x242bd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 --2- 172.21.15.81:0/3234020492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bcf60 0x2429ba30 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- 172.21.15.81:0/3234020492 >> 172.21.15.81:0/3234020492 conn(0x24005570 msgr2=0x2429e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- 172.21.15.81:0/3234020492 shutdown_connections 2024-09-13T18:55:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.572+0000 7fb3544de740 1 -- 172.21.15.81:0/3234020492 wait complete. 2024-09-13T18:55:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 -- start start 2024-09-13T18:55:17.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 Processor -- start 2024-09-13T18:55:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x242938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x24293df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bd880 0x24274910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2419b760 con 0x2429b4a0 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x241a15e0 con 0x242bd880 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24089b40 con 0x242bcf60 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb3544de740 10 client.0 _ll_register_callbacks cb 0x241a2b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x242938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x242938b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43830/0 (socket says 172.21.15.81:43830) 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 -- 172.21.15.81:0/3336679837 learned_addr learned my addr 172.21.15.81:0/3336679837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349400700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x24293df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb34a800700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bd880 0x24274910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 -- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 msgr2=0x24293df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x24293df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 -- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bd880 msgr2=0x24274910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bd880 0x24274910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 -- 172.21.15.81:0/3336679837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c0ad460 con 0x2429b4a0 2024-09-13T18:55:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb34a800700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bd880 0x24274910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb349e00700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x242938b0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb33c06c040 tx=0x7fb33c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d7843bb0f96f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.576+0000 7fb32b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 1 -- 172.21.15.81:0/3336679837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c082070 con 0x2429b4a0 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 1 -- 172.21.15.81:0/3336679837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb33c056dc0 con 0x2429b4a0 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24012280 con 0x2429b4a0 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 1 -- 172.21.15.81:0/3336679837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb33c056f80 con 0x2429b4a0 2024-09-13T18:55:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 10 client.9285 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x241a4250 con 0x2429b4a0 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 1 -- 172.21.15.81:0/3336679837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24012280 con 0x2429b4a0 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 1 -- 172.21.15.81:0/3336679837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb33c056050 con 0x2429b4a0 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 10 client.9285 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 10 client.9285 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 20 client.9285 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24275340 0x242715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 4 client.9285 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2405c500 con 0x24275340 2024-09-13T18:55:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb349400700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24275340 0x242715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 10 client.9285 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb349400700 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24275340 0x242715f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff775a1e6ba1807f server_cookie=18767bfb33b1e3f2 in_seq=0 out_seq=0 2024-09-13T18:55:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 1 -- 172.21.15.81:0/3336679837 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2405c500 con 0x24275340 2024-09-13T18:55:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb32b400700 10 client.9285 handle_command_reply: tid=0 2024-09-13T18:55:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 client.9285 shutdown 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 msgr2=0x242938b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.580+0000 7fb3544de740 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x242938b0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb33c06c040 tx=0x7fb33c000f40 comp rx=0 tx=0).stop 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 shutdown_connections 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24275340 0x242715f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bd880 0x24274910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x24293df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 --2- 172.21.15.81:0/3336679837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x242938b0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb32b400700 0 client.9285 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 >> 172.21.15.81:0/3336679837 conn(0x24005570 msgr2=0x24296500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 shutdown_connections 2024-09-13T18:55:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 1 -- 172.21.15.81:0/3336679837 wait complete. 2024-09-13T18:55:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.584+0000 7fb3544de740 20 client.9285 trim_cache size 0 max 16384 2024-09-13T18:55:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 Processor -- start 2024-09-13T18:55:17.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 -- start start 2024-09-13T18:55:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x2429a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x242cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 0x242cfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x241a61c0 con 0x242bd880 2024-09-13T18:55:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2426c9f0 con 0x2429b4a0 2024-09-13T18:55:17.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x241a54f0 con 0x242bcf60 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 0x242cfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 0x242cfe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43842/0 (socket says 172.21.15.81:43842) 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 -- 172.21.15.81:0/3247310697 learned_addr learned my addr 172.21.15.81:0/3247310697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb349400700 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x242cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb349e00700 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x2429a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 -- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 msgr2=0x242cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x242cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 -- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 msgr2=0x2429a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x2429a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 -- 172.21.15.81:0/3247310697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2418a480 con 0x242bd880 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb349e00700 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x2429a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.604+0000 7fb34a800700 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 0x242cfe90 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fb344009cc0 tx=0x7fb344009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98178b0502f425ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb337400700 1 -- 172.21.15.81:0/3247310697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344004230 con 0x242bd880 2024-09-13T18:55:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb337400700 1 -- 172.21.15.81:0/3247310697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344004390 con 0x242bd880 2024-09-13T18:55:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb337400700 1 -- 172.21.15.81:0/3247310697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3440148d0 con 0x242bd880 2024-09-13T18:55:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 -- 172.21.15.81:0/3247310697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 msgr2=0x242cfe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 0x242cfe90 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fb344009cc0 tx=0x7fb344009240 comp rx=0 tx=0).stop 2024-09-13T18:55:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 -- 172.21.15.81:0/3247310697 shutdown_connections 2024-09-13T18:55:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x242bd880 0x242cfe90 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bcf60 0x242cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 --2- 172.21.15.81:0/3247310697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2429b4a0 0x2429a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 -- 172.21.15.81:0/3247310697 >> 172.21.15.81:0/3247310697 conn(0x24005570 msgr2=0x24298720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 -- 172.21.15.81:0/3247310697 shutdown_connections 2024-09-13T18:55:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 -- 172.21.15.81:0/3247310697 wait complete. 2024-09-13T18:55:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 -- start start 2024-09-13T18:55:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.608+0000 7fb3544de740 1 Processor -- start 2024-09-13T18:55:17.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x24326260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bcf60 0x24326eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x243273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x242e36b0 con 0x2429b4a0 2024-09-13T18:55:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x242d4f00 con 0x242bcf60 2024-09-13T18:55:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x242d5e20 con 0x242bd880 2024-09-13T18:55:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 10 client.0 _ll_register_callbacks cb 0x24183cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x24326260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x24326260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43850/0 (socket says 172.21.15.81:43850) 2024-09-13T18:55:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 -- 172.21.15.81:0/1923261464 learned_addr learned my addr 172.21.15.81:0/1923261464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb34a800700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x243273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349400700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bcf60 0x24326eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 -- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 msgr2=0x243273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x243273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 -- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bcf60 msgr2=0x24326eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bcf60 0x24326eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 -- 172.21.15.81:0/1923261464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb344009910 con 0x2429b4a0 2024-09-13T18:55:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb349e00700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x24326260 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fb33c055130 tx=0x7fb33c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96b0f9641f004ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb32b400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb32b400700 1 -- 172.21.15.81:0/1923261464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0564c0 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb32b400700 1 -- 172.21.15.81:0/1923261464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb33c055ac0 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb33c05ef50 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb32b400700 1 -- 172.21.15.81:0/1923261464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb33c057260 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 10 client.9291 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.612+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x2417e750 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb32b400700 1 -- 172.21.15.81:0/1923261464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c05ef50 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb32b400700 1 -- 172.21.15.81:0/1923261464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb33c056dc0 con 0x2429b4a0 2024-09-13T18:55:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 10 client.9291 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 10 client.9291 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 20 client.9291 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24327930 0x24327d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 4 client.9291 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x24081280 con 0x24327930 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb349400700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24327930 0x24327d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb349400700 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24327930 0x24327d10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b7ebee34e52fcb6 server_cookie=b5c60068dd762af in_seq=0 out_seq=0 2024-09-13T18:55:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb32b400700 10 client.9291 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb32b400700 1 -- 172.21.15.81:0/1923261464 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x24081280 con 0x24327930 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb32b400700 10 client.9291 handle_command_reply: tid=0 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 client.9291 shutdown 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 msgr2=0x24326260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x24326260 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fb33c055130 tx=0x7fb33c009810 comp rx=0 tx=0).stop 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 shutdown_connections 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x24327930 0x24327d10 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x242bd880 0x243273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x242bcf60 0x24326eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 --2- 172.21.15.81:0/1923261464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2429b4a0 0x24326260 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 >> 172.21.15.81:0/1923261464 conn(0x24005570 msgr2=0x24298f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb32b400700 0 client.9291 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 shutdown_connections 2024-09-13T18:55:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 1 -- 172.21.15.81:0/1923261464 wait complete. 2024-09-13T18:55:17.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb3544de740 20 client.9291 trim_cache size 0 max 16384 2024-09-13T18:55:17.630 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:17.630 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:55:17.631 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb32c066760 msgr2=0x7fb32c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb34b200700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb32c066760 0x7fb32c068c20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0ce1e0 tx=0x7fb338009040 comp rx=0 tx=0).stop 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.616+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 msgr2=0x7fb34c0adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 0x7fb34c0adc60 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fb34c0742f0 tx=0x7fb33c004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 shutdown_connections 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb32c066760 0x7fb32c068c20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb34c143b70 0x7fb34c13cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb34c06d620 0x7fb34c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 --2- 172.21.15.81:0/2947832694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb34c06d070 0x7fb34c0adc60 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 >> 172.21.15.81:0/2947832694 conn(0x7fb34c06a390 msgr2=0x7fb34c06c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 shutdown_connections 2024-09-13T18:55:17.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.620+0000 7fb34b200700 1 -- 172.21.15.81:0/2947832694 wait complete. 2024-09-13T18:55:17.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-13T18:55:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.812+0000 7f3be7200700 1 Processor -- start 2024-09-13T18:55:17.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.812+0000 7f3be7200700 1 -- start start 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be006aa10 0x7f3be00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be7200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be00b4690 con 0x7f3be00b2a80 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be7200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be015cf30 con 0x7f3be015cb50 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00b2f30 con 0x7f3be006aa10 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be6800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3be00b2a80 0x7f3be00b4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41302/0 (socket says 172.21.15.81:41302) 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be6800700 1 -- 172.21.15.81:0/2039070558 learned_addr learned my addr 172.21.15.81:0/2039070558 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be5400700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be006aa10 0x7f3be00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066521805 0 0) 0x7f3be00b4690 con 0x7f3be00b2a80 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc80035d0 con 0x7f3be00b2a80 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988167384 0 0) 0x7f3be015cf30 con 0x7f3be015cb50 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3be00b4690 con 0x7f3be015cb50 2024-09-13T18:55:17.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3603908862 0 0) 0x7f3bc80035d0 con 0x7f3be00b2a80 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be006aa10 msgr2=0x7f3be00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be006aa10 0x7f3be00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 >> v1:172.21.15.178:6789/0 conn(0x7f3be015cb50 legacy=0x7f3be006cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be00c9c30 con 0x7f3be00b2a80 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f3bdc0019f0 con 0x7f3be00b2a80 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.816+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 >> v1:172.21.15.81:6789/0 conn(0x7f3be00b2a80 legacy=0x7f3be00b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bc8003be0 0x7f3bc8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bc8004870 0x7f3bc8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8005230 0x7f3bc800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be00b2f30 con 0x7f3bc8003be0 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800c0a0 con 0x7f3bc8005230 2024-09-13T18:55:17.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800c260 con 0x7f3bc8004870 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5400700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be006aa10 0x7f3be00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bc8003be0 0x7f3bc8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be6800700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8005230 0x7f3bc800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5400700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bc8004870 0x7f3bc8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 -- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bc8004870 msgr2=0x7f3bc8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bc8004870 0x7f3bc8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 -- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8005230 msgr2=0x7f3bc800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8005230 0x7f3bc800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 -- 172.21.15.81:0/2039070558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80035d0 con 0x7f3bc8003be0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be5e00700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bc8003be0 0x7f3bc8003fe0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4001950 tx=0x7f3bc80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdc41058af46443 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4001d80 con 0x7f3bc8003be0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd40052d0 con 0x7f3bc8003be0 2024-09-13T18:55:17.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be4a00700 1 -- 172.21.15.81:0/2039070558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4001440 con 0x7f3bc8003be0 2024-09-13T18:55:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be7200700 1 -- 172.21.15.81:0/2039070558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bc8003be0 msgr2=0x7f3bc8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be7200700 1 --2- 172.21.15.81:0/2039070558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bc8003be0 0x7f3bc8003fe0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4001950 tx=0x7f3bc80058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be6800700 1 -- 172.21.15.81:0/2039070558 reap_dead start 2024-09-13T18:55:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be7200700 1 -- 172.21.15.81:0/2039070558 shutdown_connections 2024-09-13T18:55:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be7200700 1 -- 172.21.15.81:0/2039070558 >> 172.21.15.81:0/2039070558 conn(0x7f3be006fe10 msgr2=0x7f3be0070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be7200700 1 -- 172.21.15.81:0/2039070558 shutdown_connections 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.820+0000 7f3be7200700 1 -- 172.21.15.81:0/2039070558 wait complete. 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 Processor -- start 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 -- start start 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8003be0 0x7f3be014f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 0x7f3be0150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be00ce140 0x7f3be0150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be01528e0 con 0x7f3be00cdcc0 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be0153b90 con 0x7f3bc8003be0 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be014fd90 con 0x7f3be00ce140 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 0x7f3be0150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 0x7f3be0150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43858/0 (socket says 172.21.15.81:43858) 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 -- 172.21.15.81:0/3006354631 learned_addr learned my addr 172.21.15.81:0/3006354631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5e00700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8003be0 0x7f3be014f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be6800700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be00ce140 0x7f3be0150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 -- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be00ce140 msgr2=0x7f3be0150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be00ce140 0x7f3be0150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 -- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8003be0 msgr2=0x7f3be014f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8003be0 0x7f3be014f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.824+0000 7f3be5400700 1 -- 172.21.15.81:0/3006354631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0152af0 con 0x7f3be00cdcc0 2024-09-13T18:55:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.828+0000 7f3be5400700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 0x7f3be0150810 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0011860 tx=0x7f3bd0011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.828+0000 7f3bda000700 1 -- 172.21.15.81:0/3006354631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000f8d0 con 0x7f3be00cdcc0 2024-09-13T18:55:17.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.828+0000 7f3bda000700 1 -- 172.21.15.81:0/3006354631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd000fa30 con 0x7f3be00cdcc0 2024-09-13T18:55:17.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.828+0000 7f3bda000700 1 -- 172.21.15.81:0/3006354631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd000fdc0 con 0x7f3be00cdcc0 2024-09-13T18:55:17.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.828+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be0152dd0 con 0x7f3be00cdcc0 2024-09-13T18:55:17.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.828+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be0153390 con 0x7f3be00cdcc0 2024-09-13T18:55:17.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3bda000700 1 -- 172.21.15.81:0/3006354631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3bd0015460 con 0x7f3be00cdcc0 2024-09-13T18:55:17.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3bda000700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3bc4066760 0x7f3bc4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3bda000700 1 -- 172.21.15.81:0/3006354631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bd0084b70 con 0x7f3be00cdcc0 2024-09-13T18:55:17.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3be5e00700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3bc4066760 0x7f3bc4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3bebc5f740 1 Processor -- start 2024-09-13T18:55:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3bebc5f740 1 -- start start 2024-09-13T18:55:17.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3be5e00700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3bc4066760 0x7f3bc4068c20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4015040 tx=0x7f3bd4009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.832+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x170b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x170df520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 0x17101550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x17048010 con 0x17101170 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16fd5f40 con 0x17100d90 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x17028e30 con 0x170b6310 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 0x17101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 0x17101550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43870/0 (socket says 172.21.15.81:43870) 2024-09-13T18:55:17.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 -- 172.21.15.81:0/386237253 learned_addr learned my addr 172.21.15.81:0/386237253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be5e00700 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x170b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be5400700 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x170df520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 -- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 msgr2=0x170df520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x170df520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 -- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 msgr2=0x170b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x170b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 -- 172.21.15.81:0/386237253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16e94a40 con 0x17101170 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3be6800700 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 0x17101550 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc000f80 tx=0x7f3bdc001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20179e795d26d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bce600700 1 -- 172.21.15.81:0/386237253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc007690 con 0x17101170 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bce600700 1 -- 172.21.15.81:0/386237253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0077f0 con 0x17101170 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bce600700 1 -- 172.21.15.81:0/386237253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc007ba0 con 0x17101170 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- 172.21.15.81:0/386237253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 msgr2=0x17101550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 0x17101550 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc000f80 tx=0x7f3bdc001a30 comp rx=0 tx=0).stop 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- 172.21.15.81:0/386237253 shutdown_connections 2024-09-13T18:55:17.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17101170 0x17101550 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x170df520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/386237253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x170b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- 172.21.15.81:0/386237253 >> 172.21.15.81:0/386237253 conn(0x16e495b0 msgr2=0x170bab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- 172.21.15.81:0/386237253 shutdown_connections 2024-09-13T18:55:17.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- 172.21.15.81:0/386237253 wait complete. 2024-09-13T18:55:17.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.836+0000 7f3bebc5f740 1 -- start start 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 Processor -- start 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170b6310 0x170da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x170ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x17101170 0x170ddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x17024150 con 0x17100d90 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x17021eb0 con 0x170b6310 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16fdf8e0 con 0x17101170 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 10 client.0 _ll_register_callbacks cb 0x16fbe670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x170ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x170ff3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43882/0 (socket says 172.21.15.81:43882) 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 -- 172.21.15.81:0/469789878 learned_addr learned my addr 172.21.15.81:0/469789878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5e00700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170b6310 0x170da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be6800700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x17101170 0x170ddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 -- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x17101170 msgr2=0x170ddbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x17101170 0x170ddbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 -- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170b6310 msgr2=0x170da460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170b6310 0x170da460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 -- 172.21.15.81:0/469789878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc00f040 con 0x17100d90 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3be5400700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x170ff3e0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0082ea0 tx=0x7f3bd00561d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc5f4a3136c3628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bc2a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bc2a00700 1 -- 172.21.15.81:0/469789878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd001b500 con 0x17100d90 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bc2a00700 1 -- 172.21.15.81:0/469789878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bd0082a10 con 0x17100d90 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16e562c0 con 0x17100d90 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bc2a00700 1 -- 172.21.15.81:0/469789878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bd0082bd0 con 0x17100d90 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 10 client.9303 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:17.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x16fe8290 con 0x17100d90 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bc2a00700 1 -- 172.21.15.81:0/469789878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16e562c0 con 0x17100d90 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bc2a00700 1 -- 172.21.15.81:0/469789878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f3bd0055c00 con 0x17100d90 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 10 client.9303 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.840+0000 7f3bebc5f740 10 client.9303 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 20 client.9303 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x170def00 0x17101550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 4 client.9303 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x16ea0540 con 0x170def00 2024-09-13T18:55:17.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3be5e00700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x170def00 0x17101550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3be5e00700 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x170def00 0x17101550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a180e7e325eee378 server_cookie=f6c1363c329e723c in_seq=0 out_seq=0 2024-09-13T18:55:17.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bc2a00700 10 client.9303 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bc2a00700 1 -- 172.21.15.81:0/469789878 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x16ea0540 con 0x170def00 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bc2a00700 10 client.9303 handle_command_reply: tid=0 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 client.9303 shutdown 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 msgr2=0x170ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x170ff3e0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0082ea0 tx=0x7f3bd00561d0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 shutdown_connections 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x17101170 0x170ddbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x170ff3e0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x170def00 0x17101550 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/469789878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170b6310 0x170da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bc2a00700 0 client.9303 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 >> 172.21.15.81:0/469789878 conn(0x16e495b0 msgr2=0x170df4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 shutdown_connections 2024-09-13T18:55:17.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 1 -- 172.21.15.81:0/469789878 wait complete. 2024-09-13T18:55:17.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.844+0000 7f3bebc5f740 20 client.9303 trim_cache size 0 max 16384 2024-09-13T18:55:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 Processor -- start 2024-09-13T18:55:17.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 -- start start 2024-09-13T18:55:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16e495b0 0x170feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 0x1715cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x1715d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16ecdb80 con 0x170b6310 2024-09-13T18:55:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16fc0620 con 0x17100d90 2024-09-13T18:55:17.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16ff2c00 con 0x16e495b0 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 0x1715cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 0x1715cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43884/0 (socket says 172.21.15.81:43884) 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 -- 172.21.15.81:0/3332209235 learned_addr learned my addr 172.21.15.81:0/3332209235 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5e00700 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16e495b0 0x170feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be6800700 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x1715d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 -- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16e495b0 msgr2=0x170feeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16e495b0 0x170feeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 -- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 msgr2=0x1715d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x1715d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 -- 172.21.15.81:0/3332209235 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16fce4c0 con 0x170b6310 2024-09-13T18:55:17.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.868+0000 7f3be5400700 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 0x1715cc50 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f3bd005d860 tx=0x7f3bd001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b415d725bb6b68e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bcf000700 1 -- 172.21.15.81:0/3332209235 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd001b300 con 0x170b6310 2024-09-13T18:55:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bcf000700 1 -- 172.21.15.81:0/3332209235 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd001b460 con 0x170b6310 2024-09-13T18:55:17.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bcf000700 1 -- 172.21.15.81:0/3332209235 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd005db40 con 0x170b6310 2024-09-13T18:55:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 -- 172.21.15.81:0/3332209235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 msgr2=0x1715cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 0x1715cc50 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f3bd005d860 tx=0x7f3bd001f000 comp rx=0 tx=0).stop 2024-09-13T18:55:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 -- 172.21.15.81:0/3332209235 shutdown_connections 2024-09-13T18:55:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17100d90 0x1715d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170b6310 0x1715cc50 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/3332209235 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16e495b0 0x170feeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 -- 172.21.15.81:0/3332209235 >> 172.21.15.81:0/3332209235 conn(0x170baf10 msgr2=0x170fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 -- 172.21.15.81:0/3332209235 shutdown_connections 2024-09-13T18:55:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 -- 172.21.15.81:0/3332209235 wait complete. 2024-09-13T18:55:17.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 -- start start 2024-09-13T18:55:17.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.872+0000 7f3bebc5f740 1 Processor -- start 2024-09-13T18:55:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16e495b0 0x17165ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x171663e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x1711f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1701f6c0 con 0x17100d90 2024-09-13T18:55:17.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16faba50 con 0x16e495b0 2024-09-13T18:55:17.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1715c3d0 con 0x170b6310 2024-09-13T18:55:17.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 10 client.0 _ll_register_callbacks cb 0x17020610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x1711f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x1711f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43886/0 (socket says 172.21.15.81:43886) 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 -- 172.21.15.81:0/25696944 learned_addr learned my addr 172.21.15.81:0/25696944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be5e00700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16e495b0 0x17165ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be5400700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x171663e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 -- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 msgr2=0x171663e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x171663e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 -- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16e495b0 msgr2=0x17165ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:17.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16e495b0 0x17165ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 -- 172.21.15.81:0/25696944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x16fe8290 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3be6800700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x1711f520 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009010 tx=0x7f3bdc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f42cc30b7cd817a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bc2a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bc2a00700 1 -- 172.21.15.81:0/25696944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc025040 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bc2a00700 1 -- 172.21.15.81:0/25696944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3bdc01e640 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bdc0077f0 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bc2a00700 1 -- 172.21.15.81:0/25696944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bdc007690 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 10 client.9309 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.876+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x16fc2790 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bc2a00700 1 -- 172.21.15.81:0/25696944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0077f0 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bc2a00700 1 -- 172.21.15.81:0/25696944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f3bdc01e800 con 0x17100d90 2024-09-13T18:55:17.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 10 client.9309 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 10 client.9309 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 20 client.9309 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x17101170 0x1711fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 4 client.9309 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x16ec52c0 con 0x17101170 2024-09-13T18:55:17.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be5e00700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x17101170 0x1711fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be5e00700 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x17101170 0x1711fa60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dec3f6eeac07305 server_cookie=fddc540ea0b7cfdf in_seq=0 out_seq=0 2024-09-13T18:55:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bc2a00700 10 client.9309 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bc2a00700 1 -- 172.21.15.81:0/25696944 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x16ec52c0 con 0x17101170 2024-09-13T18:55:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bc2a00700 10 client.9309 handle_command_reply: tid=0 2024-09-13T18:55:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 client.9309 shutdown 2024-09-13T18:55:17.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 msgr2=0x1711f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x1711f520 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009010 tx=0x7f3bdc013000 comp rx=0 tx=0).stop 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 shutdown_connections 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x17100d90 0x1711f520 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170b6310 0x171663e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x17101170 0x1711fa60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 --2- 172.21.15.81:0/25696944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16e495b0 0x17165ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bc2a00700 0 client.9309 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 >> 172.21.15.81:0/25696944 conn(0x170baf10 msgr2=0x170d8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 shutdown_connections 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 1 -- 172.21.15.81:0/25696944 wait complete. 2024-09-13T18:55:17.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3bebc5f740 20 client.9309 trim_cache size 0 max 16384 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:17.892 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3bc4066760 msgr2=0x7f3bc4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be7200700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3bc4066760 0x7f3bc4068c20 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3bd4015040 tx=0x7f3bd4009030 comp rx=0 tx=0).stop 2024-09-13T18:55:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 msgr2=0x7f3be0150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be7200700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 0x7f3be0150810 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0011860 tx=0x7f3bd0011c20 comp rx=0 tx=0).stop 2024-09-13T18:55:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 shutdown_connections 2024-09-13T18:55:17.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.880+0000 7f3be7200700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3bc4066760 0x7f3bc4068c20 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.884+0000 7f3be7200700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3be00ce140 0x7f3be0150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.884+0000 7f3be7200700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be00cdcc0 0x7f3be0150810 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.884+0000 7f3be7200700 1 --2- 172.21.15.81:0/3006354631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc8003be0 0x7f3be014f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.884+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 >> 172.21.15.81:0/3006354631 conn(0x7f3be006fe10 msgr2=0x7f3be00ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.884+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 shutdown_connections 2024-09-13T18:55:17.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:17.884+0000 7f3be7200700 1 -- 172.21.15.81:0/3006354631 wait complete. 2024-09-13T18:55:17.914 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:17.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-13T18:55:18.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 Processor -- start 2024-09-13T18:55:18.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 -- start start 2024-09-13T18:55:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 0x7fc2b40ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40cf1e0 0x7fc2b415a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2b415a6b0 0x7fc2b40b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b415e420 con 0x7fc2b40ce280 2024-09-13T18:55:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b40cf640 con 0x7fc2b415a6b0 2024-09-13T18:55:18.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2bb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b415df90 con 0x7fc2b40cf1e0 2024-09-13T18:55:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2b3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 0x7fc2b40ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2b3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 0x7fc2b40ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43888/0 (socket says 172.21.15.81:43888) 2024-09-13T18:55:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2b9200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2b415a6b0 0x7fc2b40b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40cf1e0 0x7fc2b415a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.100+0000 7fc2b3e00700 1 -- 172.21.15.81:0/2213375761 learned_addr learned my addr 172.21.15.81:0/2213375761 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b9200700 1 -- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40cf1e0 msgr2=0x7fc2b415a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b9200700 1 --2- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40cf1e0 0x7fc2b415a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b9200700 1 -- 172.21.15.81:0/2213375761 >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 msgr2=0x7fc2b40ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b9200700 1 --2- 172.21.15.81:0/2213375761 >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 0x7fc2b40ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b9200700 1 -- 172.21.15.81:0/2213375761 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b415aea0 con 0x7fc2b415a6b0 2024-09-13T18:55:18.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/2213375761 >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 0x7fc2b40ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:18.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b9200700 1 --2- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b415a6b0 0x7fc2b40b25a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40704b0 tx=0x7fc2ac009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73e510d437d55a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b3400700 1 -- 172.21.15.81:0/2213375761 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac011830 con 0x7fc2b415a6b0 2024-09-13T18:55:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b3400700 1 -- 172.21.15.81:0/2213375761 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac011990 con 0x7fc2b415a6b0 2024-09-13T18:55:18.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2b3400700 1 -- 172.21.15.81:0/2213375761 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac011d20 con 0x7fc2b415a6b0 2024-09-13T18:55:18.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2bb200700 1 -- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b415a6b0 msgr2=0x7fc2b40b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.104+0000 7fc2bb200700 1 --2- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b415a6b0 0x7fc2b40b25a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40704b0 tx=0x7fc2ac009b30 comp rx=0 tx=0).stop 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 -- 172.21.15.81:0/2213375761 shutdown_connections 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 --2- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b415a6b0 0x7fc2b40b25a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 --2- 172.21.15.81:0/2213375761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40cf1e0 0x7fc2b415a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 --2- 172.21.15.81:0/2213375761 >> v2:172.21.15.81:3300/0 conn(0x7fc2b40ce280 0x7fc2b40ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 -- 172.21.15.81:0/2213375761 >> 172.21.15.81:0/2213375761 conn(0x7fc2b406a570 msgr2=0x7fc2b406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 -- 172.21.15.81:0/2213375761 shutdown_connections 2024-09-13T18:55:18.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.108+0000 7fc2bb200700 1 -- 172.21.15.81:0/2213375761 wait complete. 2024-09-13T18:55:18.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 Processor -- start 2024-09-13T18:55:18.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 -- start start 2024-09-13T18:55:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40ce280 0x7fc2b414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b40cf1e0 0x7fc2b414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 0x7fc2b415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b41f2600 con 0x7fc2b415a6b0 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b414db70 con 0x7fc2b40cf1e0 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b414de50 con 0x7fc2b40ce280 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 0x7fc2b415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 0x7fc2b415b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43892/0 (socket says 172.21.15.81:43892) 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 -- 172.21.15.81:0/3688138489 learned_addr learned my addr 172.21.15.81:0/3688138489 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40ce280 0x7fc2b414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2ab400700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b40cf1e0 0x7fc2b414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 -- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40ce280 msgr2=0x7fc2b414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40ce280 0x7fc2b414e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 -- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b40cf1e0 msgr2=0x7fc2b414d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b40cf1e0 0x7fc2b414d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 -- 172.21.15.81:0/3688138489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4009570 con 0x7fc2b415a6b0 2024-09-13T18:55:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b9200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 0x7fc2b415b030 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009fd0 tx=0x7fc2ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b0c00700 1 -- 172.21.15.81:0/3688138489 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac004240 con 0x7fc2b415a6b0 2024-09-13T18:55:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac0094b0 con 0x7fc2b415a6b0 2024-09-13T18:55:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b0c00700 1 -- 172.21.15.81:0/3688138489 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac01f070 con 0x7fc2b415a6b0 2024-09-13T18:55:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2b0c00700 1 -- 172.21.15.81:0/3688138489 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac0045c0 con 0x7fc2b415a6b0 2024-09-13T18:55:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.112+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b414e410 con 0x7fc2b415a6b0 2024-09-13T18:55:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.116+0000 7fc2b0c00700 1 -- 172.21.15.81:0/3688138489 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2ac021030 con 0x7fc2b415a6b0 2024-09-13T18:55:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 Processor -- start 2024-09-13T18:55:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 -- start start 2024-09-13T18:55:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2b0c00700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc290066730 0x7fc290068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2b0c00700 1 -- 172.21.15.81:0/3688138489 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2ac085300 con 0x7fc2b415a6b0 2024-09-13T18:55:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441c950 0x43fb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x441cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4364010 con 0x43fad00 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x42f1f40 con 0x441c950 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x4344e30 con 0x441d270 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc290066730 0x7fc290068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x441cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x441cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43902/0 (socket says 172.21.15.81:43902) 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 -- 172.21.15.81:0/816697051 learned_addr learned my addr 172.21.15.81:0/816697051 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2b9200700 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441c950 0x43fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 -- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 msgr2=0x43d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 -- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441c950 msgr2=0x43fb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441c950 0x43fb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.120+0000 7fc2ab400700 1 -- 172.21.15.81:0/816697051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x41b0a40 con 0x43fad00 2024-09-13T18:55:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2ab400700 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x441cd30 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ae20 tx=0x7fc29c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a432fbee0daa526a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2ab400700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc290066730 0x7fc290068bf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc29c008df0 tx=0x7fc29c0083f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2a8c00700 1 -- 172.21.15.81:0/816697051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00e070 con 0x43fad00 2024-09-13T18:55:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2a8c00700 1 -- 172.21.15.81:0/816697051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00f040 con 0x43fad00 2024-09-13T18:55:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2a8c00700 1 -- 172.21.15.81:0/816697051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c01bc80 con 0x43fad00 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 -- 172.21.15.81:0/816697051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 msgr2=0x441cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x441cd30 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ae20 tx=0x7fc29c01d000 comp rx=0 tx=0).stop 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 -- 172.21.15.81:0/816697051 shutdown_connections 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x441cd30 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/816697051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441c950 0x43fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 -- 172.21.15.81:0/816697051 >> 172.21.15.81:0/816697051 conn(0x41655b0 msgr2=0x43d69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 -- 172.21.15.81:0/816697051 shutdown_connections 2024-09-13T18:55:18.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 -- 172.21.15.81:0/816697051 wait complete. 2024-09-13T18:55:18.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 -- start start 2024-09-13T18:55:18.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.124+0000 7fc2be5f9740 1 Processor -- start 2024-09-13T18:55:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x43fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43e3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43e4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x4340150 con 0x441c950 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x433deb0 con 0x43fad00 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x42fb8e0 con 0x441d270 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 10 client.0 _ll_register_callbacks cb 0x42da670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43e3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43e3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43914/0 (socket says 172.21.15.81:43914) 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 -- 172.21.15.81:0/2288431088 learned_addr learned my addr 172.21.15.81:0/2288431088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2b9200700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43e4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x43fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 -- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 msgr2=0x43e4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43e4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 -- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 msgr2=0x43fe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x43fe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 -- 172.21.15.81:0/2288431088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c01abe0 con 0x441c950 2024-09-13T18:55:18.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2ab400700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43e3c20 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01bcf0 tx=0x7fc29c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f600db310c6d3da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2a1600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2a1600700 1 -- 172.21.15.81:0/2288431088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00e040 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2a1600700 1 -- 172.21.15.81:0/2288431088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc29c021070 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x41722c0 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2a1600700 1 -- 172.21.15.81:0/2288431088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc29c01ae50 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 10 client.9321 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.128+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x4304290 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2a1600700 1 -- 172.21.15.81:0/2288431088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x41722c0 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2a1600700 1 -- 172.21.15.81:0/2288431088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc29c030850 con 0x441c950 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 10 client.9321 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 10 client.9321 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 20 client.9321 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x43fcf20 0x441b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 4 client.9321 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x41bc540 con 0x43fcf20 2024-09-13T18:55:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x43fcf20 0x441b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x43fcf20 0x441b3c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ff6bc78ffc5cf02 server_cookie=80bad886d2d1b9f7 in_seq=0 out_seq=0 2024-09-13T18:55:18.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2a1600700 10 client.9321 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2a1600700 1 -- 172.21.15.81:0/2288431088 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x41bc540 con 0x43fcf20 2024-09-13T18:55:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2a1600700 10 client.9321 handle_command_reply: tid=0 2024-09-13T18:55:18.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.132+0000 7fc2be5f9740 1 client.9321 shutdown 2024-09-13T18:55:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 msgr2=0x43e3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43e3c20 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01bcf0 tx=0x7fc29c00b040 comp rx=0 tx=0).stop 2024-09-13T18:55:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 shutdown_connections 2024-09-13T18:55:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x43fcf20 0x441b3c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43e4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43e3c20 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2a1600700 0 client.9321 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/2288431088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x43fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 >> 172.21.15.81:0/2288431088 conn(0x41655b0 msgr2=0x43d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 shutdown_connections 2024-09-13T18:55:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 1 -- 172.21.15.81:0/2288431088 wait complete. 2024-09-13T18:55:18.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.136+0000 7fc2be5f9740 20 client.9321 trim_cache size 0 max 16384 2024-09-13T18:55:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 Processor -- start 2024-09-13T18:55:18.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 -- start start 2024-09-13T18:55:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x4419370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43fb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x41e9b80 con 0x441c950 2024-09-13T18:55:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x4365610 con 0x43fad00 2024-09-13T18:55:18.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x430ec00 con 0x441d270 2024-09-13T18:55:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43fb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43918/0 (socket says 172.21.15.81:43918) 2024-09-13T18:55:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 -- 172.21.15.81:0/553432075 learned_addr learned my addr 172.21.15.81:0/553432075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2b9200700 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43fb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x4419370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 -- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 msgr2=0x43fb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43fb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 -- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 msgr2=0x4419370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x4419370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 -- 172.21.15.81:0/553432075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x42ea4c0 con 0x441c950 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2b9200700 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.160+0000 7fc2ab400700 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43fb0e0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ab00 tx=0x7fc29c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4fae940160eeab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2a9600700 1 -- 172.21.15.81:0/553432075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c00e070 con 0x441c950 2024-09-13T18:55:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2a9600700 1 -- 172.21.15.81:0/553432075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c008a40 con 0x441c950 2024-09-13T18:55:18.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2a9600700 1 -- 172.21.15.81:0/553432075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c01aee0 con 0x441c950 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 -- 172.21.15.81:0/553432075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 msgr2=0x43fb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43fb0e0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fc29c01ab00 tx=0x7fc29c02d000 comp rx=0 tx=0).stop 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 -- 172.21.15.81:0/553432075 shutdown_connections 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441d270 0x43fb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x441c950 0x43fb0e0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/553432075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x43fad00 0x4419370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 -- 172.21.15.81:0/553432075 >> 172.21.15.81:0/553432075 conn(0x41655b0 msgr2=0x4417f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 -- 172.21.15.81:0/553432075 shutdown_connections 2024-09-13T18:55:18.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 -- 172.21.15.81:0/553432075 wait complete. 2024-09-13T18:55:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 -- start start 2024-09-13T18:55:18.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.164+0000 7fc2be5f9740 1 Processor -- start 2024-09-13T18:55:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x447d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441c950 0x447e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441d270 0x447e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x42dc620 con 0x43fad00 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x433b6c0 con 0x441d270 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x443aa90 con 0x441c950 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 10 client.0 _ll_register_callbacks cb 0x430d8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x447d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x447d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43928/0 (socket says 172.21.15.81:43928) 2024-09-13T18:55:18.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 -- 172.21.15.81:0/1262367063 learned_addr learned my addr 172.21.15.81:0/1262367063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2ab400700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441c950 0x447e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b9200700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441d270 0x447e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 -- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441c950 msgr2=0x447e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441c950 0x447e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 -- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441d270 msgr2=0x447e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441d270 0x447e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 -- 172.21.15.81:0/1262367063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x4304290 con 0x43fad00 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2b3e00700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x447d420 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x441bad0 tx=0x7fc2a401eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49291ae7aea78f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2a1600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2a1600700 1 -- 172.21.15.81:0/1262367063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a401c030 con 0x43fad00 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2a1600700 1 -- 172.21.15.81:0/1262367063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc2a4028c50 con 0x43fad00 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc29c00f040 con 0x43fad00 2024-09-13T18:55:18.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2a1600700 1 -- 172.21.15.81:0/1262367063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a4028e10 con 0x43fad00 2024-09-13T18:55:18.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 10 client.9327 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:18.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x42de790 con 0x43fad00 2024-09-13T18:55:18.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.168+0000 7fc2a1600700 1 -- 172.21.15.81:0/1262367063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c00f040 con 0x43fad00 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2a1600700 1 -- 172.21.15.81:0/1262367063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fc2a4004330 con 0x43fad00 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 10 client.9327 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 10 client.9327 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 20 client.9327 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x447d960 0x447eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 4 client.9327 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x41e12c0 con 0x447d960 2024-09-13T18:55:18.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2ab400700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x447d960 0x447eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2ab400700 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x447d960 0x447eac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45c863c536fbf41f server_cookie=fd181dd3003f6dbd in_seq=0 out_seq=0 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2a1600700 10 client.9327 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2a1600700 1 -- 172.21.15.81:0/1262367063 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x41e12c0 con 0x447d960 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2a1600700 10 client.9327 handle_command_reply: tid=0 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 client.9327 shutdown 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 msgr2=0x447d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x447d420 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x441bad0 tx=0x7fc2a401eb70 comp rx=0 tx=0).stop 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 shutdown_connections 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x447d960 0x447eac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x441d270 0x447e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x441c950 0x447e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2a1600700 0 client.9327 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:18.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 --2- 172.21.15.81:0/1262367063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x43fad00 0x447d420 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 >> 172.21.15.81:0/1262367063 conn(0x41655b0 msgr2=0x43fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 shutdown_connections 2024-09-13T18:55:18.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 1 -- 172.21.15.81:0/1262367063 wait complete. 2024-09-13T18:55:18.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.172+0000 7fc2be5f9740 20 client.9327 trim_cache size 0 max 16384 2024-09-13T18:55:18.183 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:18.184 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:18.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc290066730 msgr2=0x7fc290068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc290066730 0x7fc290068bf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc29c008df0 tx=0x7fc29c0083f0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 msgr2=0x7fc2b415b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 0x7fc2b415b030 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac009fd0 tx=0x7fc2ac004770 comp rx=0 tx=0).stop 2024-09-13T18:55:18.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 shutdown_connections 2024-09-13T18:55:18.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc290066730 0x7fc290068bf0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2b415a6b0 0x7fc2b415b030 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2b40cf1e0 0x7fc2b414d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 --2- 172.21.15.81:0/3688138489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2b40ce280 0x7fc2b414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 >> 172.21.15.81:0/3688138489 conn(0x7fc2b406a570 msgr2=0x7fc2b406bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 shutdown_connections 2024-09-13T18:55:18.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.176+0000 7fc2bb200700 1 -- 172.21.15.81:0/3688138489 wait complete. 2024-09-13T18:55:18.207 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:18.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-13T18:55:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.376+0000 7fbf62800700 1 Processor -- start 2024-09-13T18:55:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.376+0000 7fbf62800700 1 -- start start 2024-09-13T18:55:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf62800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf5c143b70 0x7fbf5c0cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf62800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0b1980 con 0x7fbf5c06d620 2024-09-13T18:55:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf62800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0b2500 con 0x7fbf5c06d070 2024-09-13T18:55:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf62800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c0b1bd0 con 0x7fbf5c143b70 2024-09-13T18:55:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf60a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbf5c06d620 0x7fbf5c06c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41306/0 (socket says 172.21.15.81:41306) 2024-09-13T18:55:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf60a00700 1 -- 172.21.15.81:0/1380284546 learned_addr learned my addr 172.21.15.81:0/1380284546 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf61400700 1 --2- 172.21.15.81:0/1380284546 >> v2:172.21.15.178:3300/0 conn(0x7fbf5c143b70 0x7fbf5c0cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597610786 0 0) 0x7fbf5c0b1980 con 0x7fbf5c06d620 2024-09-13T18:55:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf440035d0 con 0x7fbf5c06d620 2024-09-13T18:55:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141087910 0 0) 0x7fbf5c0b2500 con 0x7fbf5c06d070 2024-09-13T18:55:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf5c0b1980 con 0x7fbf5c06d070 2024-09-13T18:55:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf61400700 1 -- 172.21.15.81:0/1380284546 >> v1:172.21.15.178:6789/0 conn(0x7fbf5c06d070 legacy=0x7fbf5c0b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf61400700 1 -- 172.21.15.81:0/1380284546 >> v1:172.21.15.81:6789/0 conn(0x7fbf5c06d620 legacy=0x7fbf5c06c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf61400700 1 -- 172.21.15.81:0/1380284546 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0b1eb0 con 0x7fbf5c143b70 2024-09-13T18:55:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.380+0000 7fbf61400700 1 --2- 172.21.15.81:0/1380284546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c143b70 0x7fbf5c0cde20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009d90 tx=0x7fbf5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=744c74153d824e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000e070 con 0x7fbf5c143b70 2024-09-13T18:55:18.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5000bb20 con 0x7fbf5c143b70 2024-09-13T18:55:18.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf5be00700 1 -- 172.21.15.81:0/1380284546 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50012430 con 0x7fbf5c143b70 2024-09-13T18:55:18.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 -- 172.21.15.81:0/1380284546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c143b70 msgr2=0x7fbf5c0cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 --2- 172.21.15.81:0/1380284546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c143b70 0x7fbf5c0cde20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009d90 tx=0x7fbf5000b330 comp rx=0 tx=0).stop 2024-09-13T18:55:18.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 -- 172.21.15.81:0/1380284546 shutdown_connections 2024-09-13T18:55:18.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 --2- 172.21.15.81:0/1380284546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c143b70 0x7fbf5c0cde20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 -- 172.21.15.81:0/1380284546 >> 172.21.15.81:0/1380284546 conn(0x7fbf5c06a390 msgr2=0x7fbf5c06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 -- 172.21.15.81:0/1380284546 shutdown_connections 2024-09-13T18:55:18.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.384+0000 7fbf62800700 1 -- 172.21.15.81:0/1380284546 wait complete. 2024-09-13T18:55:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 Processor -- start 2024-09-13T18:55:18.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 -- start start 2024-09-13T18:55:18.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c06d070 0x7fbf5c13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 0x7fbf5c156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf5c143b70 0x7fbf5c071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0710f0 con 0x7fbf5c06d620 2024-09-13T18:55:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0704e0 con 0x7fbf5c06d070 2024-09-13T18:55:18.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf62800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0707c0 con 0x7fbf5c143b70 2024-09-13T18:55:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 0x7fbf5c156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 0x7fbf5c156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43932/0 (socket says 172.21.15.81:43932) 2024-09-13T18:55:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 -- 172.21.15.81:0/2745098233 learned_addr learned my addr 172.21.15.81:0/2745098233 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf61400700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c06d070 0x7fbf5c13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf61e00700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf5c143b70 0x7fbf5c071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 -- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf5c143b70 msgr2=0x7fbf5c071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf5c143b70 0x7fbf5c071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 -- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c06d070 msgr2=0x7fbf5c13f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c06d070 0x7fbf5c13f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf60a00700 1 -- 172.21.15.81:0/2745098233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50009a70 con 0x7fbf5c06d620 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.388+0000 7fbf61400700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c06d070 0x7fbf5c13f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.392+0000 7fbf60a00700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 0x7fbf5c156c20 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800c560 tx=0x7fbf4800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.392+0000 7fbf59600700 1 -- 172.21.15.81:0/2745098233 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48005d90 con 0x7fbf5c06d620 2024-09-13T18:55:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.392+0000 7fbf59600700 1 -- 172.21.15.81:0/2745098233 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf480070d0 con 0x7fbf5c06d620 2024-09-13T18:55:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.392+0000 7fbf59600700 1 -- 172.21.15.81:0/2745098233 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48007460 con 0x7fbf5c06d620 2024-09-13T18:55:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.392+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c070aa0 con 0x7fbf5c06d620 2024-09-13T18:55:18.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.392+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c13fbc0 con 0x7fbf5c06d620 2024-09-13T18:55:18.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf59600700 1 -- 172.21.15.81:0/2745098233 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf480075c0 con 0x7fbf5c06d620 2024-09-13T18:55:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf59600700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf3c066730 0x7fbf3c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf59600700 1 -- 172.21.15.81:0/2745098233 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf48083810 con 0x7fbf5c06d620 2024-09-13T18:55:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf61400700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf3c066730 0x7fbf3c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf67159740 1 Processor -- start 2024-09-13T18:55:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf61400700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf3c066730 0x7fbf3c068bf0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbf50014040 tx=0x7fbf5001d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.396+0000 7fbf67159740 1 -- start start 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4b9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd503550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd44a010 con 0xd4b8310 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3d7f40 con 0xd503170 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd42ae30 con 0xd502d90 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43936/0 (socket says 172.21.15.81:43936) 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 -- 172.21.15.81:0/2843859594 learned_addr learned my addr 172.21.15.81:0/2843859594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf61400700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 -- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 msgr2=0xd4b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf61e00700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd503550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 -- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 msgr2=0xd503550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd503550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 -- 172.21.15.81:0/2843859594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd296a40 con 0xd4b8310 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf61e00700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd503550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf61400700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf60a00700 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e1520 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fbf48054660 tx=0x7fbf48054290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce03b32371c63c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf4dc00700 1 -- 172.21.15.81:0/2843859594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf480546d0 con 0xd4b8310 2024-09-13T18:55:18.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf4dc00700 1 -- 172.21.15.81:0/2843859594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48058500 con 0xd4b8310 2024-09-13T18:55:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf4dc00700 1 -- 172.21.15.81:0/2843859594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4805cac0 con 0xd4b8310 2024-09-13T18:55:18.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- 172.21.15.81:0/2843859594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 msgr2=0xd4e1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e1520 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fbf48054660 tx=0x7fbf48054290 comp rx=0 tx=0).stop 2024-09-13T18:55:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- 172.21.15.81:0/2843859594 shutdown_connections 2024-09-13T18:55:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd503550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e1520 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 --2- 172.21.15.81:0/2843859594 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- 172.21.15.81:0/2843859594 >> 172.21.15.81:0/2843859594 conn(0xd24b5b0 msgr2=0xd4bcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- 172.21.15.81:0/2843859594 shutdown_connections 2024-09-13T18:55:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.400+0000 7fbf67159740 1 -- 172.21.15.81:0/2843859594 wait complete. 2024-09-13T18:55:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 -- start start 2024-09-13T18:55:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 Processor -- start 2024-09-13T18:55:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4dff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd501710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd426150 con 0xd4b8310 2024-09-13T18:55:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd423eb0 con 0xd503170 2024-09-13T18:55:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd3e18e0 con 0xd502d90 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf67159740 10 client.0 _ll_register_callbacks cb 0xd3c0670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43944/0 (socket says 172.21.15.81:43944) 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 -- 172.21.15.81:0/1004435129 learned_addr learned my addr 172.21.15.81:0/1004435129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf60a00700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61e00700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd501710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 -- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 msgr2=0xd4dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 -- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 msgr2=0xd501710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd501710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 -- 172.21.15.81:0/1004435129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c13fbc0 con 0xd4b8310 2024-09-13T18:55:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61e00700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd501710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf61400700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e3de0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000b680 tx=0x7fbf50004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289e1681a33772e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.404+0000 7fbf42000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 1 -- 172.21.15.81:0/1004435129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5001b600 con 0xd4b8310 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 1 -- 172.21.15.81:0/1004435129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf5001b760 con 0xd4b8310 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd2582c0 con 0xd4b8310 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 1 -- 172.21.15.81:0/1004435129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf5001b920 con 0xd4b8310 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 10 client.9339 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0xd3ea290 con 0xd4b8310 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 1 -- 172.21.15.81:0/1004435129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd2582c0 con 0xd4b8310 2024-09-13T18:55:18.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 1 -- 172.21.15.81:0/1004435129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fbf5002f3f0 con 0xd4b8310 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 10 client.9339 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 10 client.9339 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 20 client.9339 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd503a40 0xd503e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 4 client.9339 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd2a2540 con 0xd503a40 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf60a00700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd503a40 0xd503e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf60a00700 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd503a40 0xd503e50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9da57c06404f9aa1 server_cookie=7f68af5965ff474e in_seq=0 out_seq=0 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 10 client.9339 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 1 -- 172.21.15.81:0/1004435129 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xd2a2540 con 0xd503a40 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 10 client.9339 handle_command_reply: tid=0 2024-09-13T18:55:18.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 client.9339 shutdown 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 msgr2=0xd4e3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e3de0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000b680 tx=0x7fbf50004b60 comp rx=0 tx=0).stop 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 shutdown_connections 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd503a40 0xd503e50 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd503170 0xd501710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd502d90 0xd4dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 --2- 172.21.15.81:0/1004435129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd4b8310 0xd4e3de0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf42000700 0 client.9339 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.408+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 >> 172.21.15.81:0/1004435129 conn(0xd24b5b0 msgr2=0xd4e14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.412+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 shutdown_connections 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.412+0000 7fbf67159740 1 -- 172.21.15.81:0/1004435129 wait complete. 2024-09-13T18:55:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.412+0000 7fbf67159740 20 client.9339 trim_cache size 0 max 16384 2024-09-13T18:55:18.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.428+0000 7fbf67159740 1 Processor -- start 2024-09-13T18:55:18.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.428+0000 7fbf67159740 1 -- start start 2024-09-13T18:55:18.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd4b8310 0xd4e3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf67159740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 0xd5008b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd503170 0xd500df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf67159740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd2cfb80 con 0xd502d90 2024-09-13T18:55:18.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3c2620 con 0xd4b8310 2024-09-13T18:55:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd4e4380 con 0xd503170 2024-09-13T18:55:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 0xd5008b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 0xd5008b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43956/0 (socket says 172.21.15.81:43956) 2024-09-13T18:55:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 -- 172.21.15.81:0/1169461309 learned_addr learned my addr 172.21.15.81:0/1169461309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf61400700 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd4b8310 0xd4e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf61e00700 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd503170 0xd500df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 -- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd503170 msgr2=0xd500df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd503170 0xd500df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 -- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd4b8310 msgr2=0xd4e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd4b8310 0xd4e3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 -- 172.21.15.81:0/1169461309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd3d04c0 con 0xd502d90 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf61400700 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd4b8310 0xd4e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf60a00700 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 0xd5008b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fbf48054660 tx=0x7fbf48082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aa10251d6d5caf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf4e600700 1 -- 172.21.15.81:0/1169461309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf480546d0 con 0xd502d90 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf4e600700 1 -- 172.21.15.81:0/1169461309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48052a70 con 0xd502d90 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.432+0000 7fbf4e600700 1 -- 172.21.15.81:0/1169461309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48053bc0 con 0xd502d90 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 -- 172.21.15.81:0/1169461309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 msgr2=0xd5008b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 0xd5008b0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fbf48054660 tx=0x7fbf48082000 comp rx=0 tx=0).stop 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 -- 172.21.15.81:0/1169461309 shutdown_connections 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd503170 0xd500df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd502d90 0xd5008b0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 --2- 172.21.15.81:0/1169461309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd4b8310 0xd4e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 -- 172.21.15.81:0/1169461309 >> 172.21.15.81:0/1169461309 conn(0xd24b5b0 msgr2=0xd4e3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 -- 172.21.15.81:0/1169461309 shutdown_connections 2024-09-13T18:55:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 -- 172.21.15.81:0/1169461309 wait complete. 2024-09-13T18:55:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 -- start start 2024-09-13T18:55:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.436+0000 7fbf67159740 1 Processor -- start 2024-09-13T18:55:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd4b8310 0xd55d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd502d90 0xd55dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 0xd563d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd51aa20 con 0xd503170 2024-09-13T18:55:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd51fe70 con 0xd502d90 2024-09-13T18:55:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd520110 con 0xd4b8310 2024-09-13T18:55:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 10 client.0 _ll_register_callbacks cb 0xd422610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 0xd563d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 0xd563d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43960/0 (socket says 172.21.15.81:43960) 2024-09-13T18:55:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 -- 172.21.15.81:0/4145448978 learned_addr learned my addr 172.21.15.81:0/4145448978 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61400700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd4b8310 0xd55d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf60a00700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd502d90 0xd55dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 -- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd4b8310 msgr2=0xd55d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd4b8310 0xd55d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 -- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd502d90 msgr2=0xd55dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd502d90 0xd55dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 -- 172.21.15.81:0/4145448978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4806c040 con 0xd503170 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf61e00700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 0xd563d60 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fbf54001ea0 tx=0x7fbf540135b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2c8b70303dae3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf42000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf42000700 1 -- 172.21.15.81:0/4145448978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54013dc0 con 0xd503170 2024-09-13T18:55:18.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf48058500 con 0xd503170 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.440+0000 7fbf42000700 1 -- 172.21.15.81:0/4145448978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf540050d0 con 0xd503170 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 1 -- 172.21.15.81:0/4145448978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf54005290 con 0xd503170 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 10 client.9345 fetch_fsmap learned FSMap version 112 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0xd3c4790 con 0xd503170 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 1 -- 172.21.15.81:0/4145448978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48058500 con 0xd503170 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 1 -- 172.21.15.81:0/4145448978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 112) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fbf540053f0 con 0xd503170 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 10 client.9345 fetch_fsmap finished waiting for FSMap version 112 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 10 client.9345 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 20 client.9345 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd5642a0 0xd5646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 4 client.9345 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xd2c72c0 con 0xd5642a0 2024-09-13T18:55:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf61400700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd5642a0 0xd5646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 10 client.9345 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf61400700 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd5642a0 0xd5646b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0a078af2c28388b server_cookie=5097cc3679624485 in_seq=0 out_seq=0 2024-09-13T18:55:18.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 1 -- 172.21.15.81:0/4145448978 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0xd2c72c0 con 0xd5642a0 2024-09-13T18:55:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 10 client.9345 handle_command_reply: tid=0 2024-09-13T18:55:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 client.9345 shutdown 2024-09-13T18:55:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 msgr2=0xd563d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 0xd563d60 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fbf54001ea0 tx=0x7fbf540135b0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 shutdown_connections 2024-09-13T18:55:18.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0xd5642a0 0xd5646b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd503170 0xd563d60 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd502d90 0xd55dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 --2- 172.21.15.81:0/4145448978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd4b8310 0xd55d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf42000700 0 client.9345 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 >> 172.21.15.81:0/4145448978 conn(0xd24b5b0 msgr2=0xd4e4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 shutdown_connections 2024-09-13T18:55:18.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 1 -- 172.21.15.81:0/4145448978 wait complete. 2024-09-13T18:55:18.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.444+0000 7fbf67159740 20 client.9345 trim_cache size 0 max 16384 2024-09-13T18:55:18.463 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:18.463 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:18.463 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:18.464 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf3c066730 msgr2=0x7fbf3c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf3c066730 0x7fbf3c068bf0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbf50014040 tx=0x7fbf5001d040 comp rx=0 tx=0).stop 2024-09-13T18:55:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 msgr2=0x7fbf5c156c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 0x7fbf5c156c20 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800c560 tx=0x7fbf4800c870 comp rx=0 tx=0).stop 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 shutdown_connections 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbf3c066730 0x7fbf3c068bf0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf5c143b70 0x7fbf5c071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf5c06d620 0x7fbf5c156c20 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 --2- 172.21.15.81:0/2745098233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf5c06d070 0x7fbf5c13f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 >> 172.21.15.81:0/2745098233 conn(0x7fbf5c06a390 msgr2=0x7fbf5c0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 shutdown_connections 2024-09-13T18:55:18.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.448+0000 7fbf62800700 1 -- 172.21.15.81:0/2745098233 wait complete. 2024-09-13T18:55:18.480 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:18.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.640+0000 7fc74b000700 1 Processor -- start 2024-09-13T18:55:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.644+0000 7fc74b000700 1 -- start start 2024-09-13T18:55:18.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74b000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc74406b4d0 0x7fc74406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74b000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc74415b0e0 0x7fc74415b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74b000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74406a430 con 0x7fc744143d60 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74b000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74415ba70 con 0x7fc74406b4d0 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74b000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74406a710 con 0x7fc74415b0e0 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc74406b4d0 0x7fc74406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc74406b4d0 0x7fc74406b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43962/0 (socket says 172.21.15.81:43962) 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 -- 172.21.15.81:0/3341268743 learned_addr learned my addr 172.21.15.81:0/3341268743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74a600700 1 --2- 172.21.15.81:0/3341268743 >> v2:172.21.15.178:3300/0 conn(0x7fc74415b0e0 0x7fc74415b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 -- 172.21.15.81:0/3341268743 >> v2:172.21.15.178:3300/0 conn(0x7fc74415b0e0 msgr2=0x7fc74415b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 --2- 172.21.15.81:0/3341268743 >> v2:172.21.15.178:3300/0 conn(0x7fc74415b0e0 0x7fc74415b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 -- 172.21.15.81:0/3341268743 >> v1:172.21.15.178:6789/0 conn(0x7fc744143d60 legacy=0x7fc7440cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 -- 172.21.15.81:0/3341268743 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74406a9f0 con 0x7fc74406b4d0 2024-09-13T18:55:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc74a600700 1 --2- 172.21.15.81:0/3341268743 >> v2:172.21.15.178:3300/0 conn(0x7fc74415b0e0 0x7fc74415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:18.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc749200700 1 --2- 172.21.15.81:0/3341268743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc74406b4d0 0x7fc74406b910 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fc7440ced10 tx=0x7fc730009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13776ffc3ed4ea1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.648+0000 7fc743e00700 1 -- 172.21.15.81:0/3341268743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000b8a0 con 0x7fc74406b4d0 2024-09-13T18:55:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc743e00700 1 -- 172.21.15.81:0/3341268743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73000ba00 con 0x7fc74406b4d0 2024-09-13T18:55:18.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc743e00700 1 -- 172.21.15.81:0/3341268743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73000bd90 con 0x7fc74406b4d0 2024-09-13T18:55:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 -- 172.21.15.81:0/3341268743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc74406b4d0 msgr2=0x7fc74406b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 --2- 172.21.15.81:0/3341268743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc74406b4d0 0x7fc74406b910 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fc7440ced10 tx=0x7fc730009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 -- 172.21.15.81:0/3341268743 shutdown_connections 2024-09-13T18:55:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 --2- 172.21.15.81:0/3341268743 >> v2:172.21.15.178:3300/0 conn(0x7fc74415b0e0 0x7fc74415b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 --2- 172.21.15.81:0/3341268743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc74406b4d0 0x7fc74406b910 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 -- 172.21.15.81:0/3341268743 >> 172.21.15.81:0/3341268743 conn(0x7fc74406ca10 msgr2=0x7fc74406cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 -- 172.21.15.81:0/3341268743 shutdown_connections 2024-09-13T18:55:18.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.652+0000 7fc74b000700 1 -- 172.21.15.81:0/3341268743 wait complete. 2024-09-13T18:55:18.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 Processor -- start 2024-09-13T18:55:18.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 -- start start 2024-09-13T18:55:18.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc74406b4d0 0x7fc74413f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 0x7fc7441f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc74415b0e0 0x7fc7441f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74413d340 con 0x7fc744143d60 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441f6da0 con 0x7fc74415b0e0 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74b000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441f6ac0 con 0x7fc74406b4d0 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 0x7fc7441f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc74406b4d0 0x7fc74413f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 0x7fc7441f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43974/0 (socket says 172.21.15.81:43974) 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 -- 172.21.15.81:0/1777886049 learned_addr learned my addr 172.21.15.81:0/1777886049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:18.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74a600700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc74415b0e0 0x7fc7441f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 -- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc74406b4d0 msgr2=0x7fc74413f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc74406b4d0 0x7fc74413f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 -- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc74415b0e0 msgr2=0x7fc7441f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc74415b0e0 0x7fc7441f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749200700 1 -- 172.21.15.81:0/1777886049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009570 con 0x7fc744143d60 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc749c00700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc74406b4d0 0x7fc74413f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.656+0000 7fc74a600700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc74415b0e0 0x7fc7441f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc749200700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 0x7fc7441f5f50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc730004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730003ad0 con 0x7fc744143d60 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73001e070 con 0x7fc744143d60 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730003e90 con 0x7fc744143d60 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7440add20 con 0x7fc744143d60 2024-09-13T18:55:18.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7440ae2e0 con 0x7fc744143d60 2024-09-13T18:55:18.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc744144510 con 0x7fc744143d60 2024-09-13T18:55:18.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.660+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc730011420 con 0x7fc744143d60 2024-09-13T18:55:18.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.664+0000 7fc741600700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc724066730 0x7fc724068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:18.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.664+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc730020070 con 0x7fc744143d60 2024-09-13T18:55:18.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.664+0000 7fc749c00700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc724066730 0x7fc724068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:18.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.664+0000 7fc749c00700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc724066730 0x7fc724068bf0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc738001c90 tx=0x7fc738009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:18.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.672+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc730052d80 con 0x7fc744143d60 2024-09-13T18:55:18.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.896+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc74415f290 con 0x7fc744143d60 2024-09-13T18:55:18.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.896+0000 7fc741600700 1 -- 172.21.15.81:0/1777886049 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4779 (secure 0 0 0) 0x7fc7300563a0 con 0x7fc744143d60 2024-09-13T18:55:18.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:18.905 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":112,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:16.625299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc724066730 msgr2=0x7fc724068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc724066730 0x7fc724068bf0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc738001c90 tx=0x7fc738009040 comp rx=0 tx=0).stop 2024-09-13T18:55:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 msgr2=0x7fc7441f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 0x7fc7441f5f50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc730004770 comp rx=0 tx=0).stop 2024-09-13T18:55:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 shutdown_connections 2024-09-13T18:55:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc724066730 0x7fc724068bf0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc74415b0e0 0x7fc7441f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc744143d60 0x7fc7441f5f50 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 --2- 172.21.15.81:0/1777886049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc74406b4d0 0x7fc74413f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 >> 172.21.15.81:0/1777886049 conn(0x7fc74406ca10 msgr2=0x7fc74415bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 shutdown_connections 2024-09-13T18:55:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:18.900+0000 7fc74b000700 1 -- 172.21.15.81:0/1777886049 wait complete. 2024-09-13T18:55:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 112 2024-09-13T18:55:18.928 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:18.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 Processor -- start 2024-09-13T18:55:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 -- start start 2024-09-13T18:55:19.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2144143b70 0x7f21440cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f214406d070 0x7f21440b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21440b1980 con 0x7f214406d620 2024-09-13T18:55:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21440b2500 con 0x7f214406d070 2024-09-13T18:55:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440b1bd0 con 0x7f2144143b70 2024-09-13T18:55:19.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f214406d070 0x7f21440b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f214406d070 0x7f21440b2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43976/0 (socket says 172.21.15.81:43976) 2024-09-13T18:55:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2143400700 1 -- 172.21.15.81:0/2394839092 learned_addr learned my addr 172.21.15.81:0/2394839092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.080+0000 7f2142a00700 1 --2- 172.21.15.81:0/2394839092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2144143b70 0x7f21440cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143400700 1 -- 172.21.15.81:0/2394839092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2144143b70 msgr2=0x7f21440cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:19.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143400700 1 --2- 172.21.15.81:0/2394839092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2144143b70 0x7f21440cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143400700 1 -- 172.21.15.81:0/2394839092 >> v1:172.21.15.178:6789/0 conn(0x7f214406d620 legacy=0x7f214406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143400700 1 -- 172.21.15.81:0/2394839092 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440b1eb0 con 0x7f214406d070 2024-09-13T18:55:19.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143400700 1 --2- 172.21.15.81:0/2394839092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214406d070 0x7f21440b2990 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f213c009910 tx=0x7f213c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd74d19acb0a5b74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:19.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2142000700 1 -- 172.21.15.81:0/2394839092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00ba60 con 0x7f214406d070 2024-09-13T18:55:19.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2142000700 1 -- 172.21.15.81:0/2394839092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00bbc0 con 0x7f214406d070 2024-09-13T18:55:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2142000700 1 -- 172.21.15.81:0/2394839092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c009e60 con 0x7f214406d070 2024-09-13T18:55:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 -- 172.21.15.81:0/2394839092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214406d070 msgr2=0x7f21440b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 --2- 172.21.15.81:0/2394839092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214406d070 0x7f21440b2990 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f213c009910 tx=0x7f213c009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 -- 172.21.15.81:0/2394839092 shutdown_connections 2024-09-13T18:55:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 --2- 172.21.15.81:0/2394839092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214406d070 0x7f21440b2990 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 --2- 172.21.15.81:0/2394839092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2144143b70 0x7f21440cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 -- 172.21.15.81:0/2394839092 >> 172.21.15.81:0/2394839092 conn(0x7f214406a390 msgr2=0x7f214406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 -- 172.21.15.81:0/2394839092 shutdown_connections 2024-09-13T18:55:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.084+0000 7f2143e00700 1 -- 172.21.15.81:0/2394839092 wait complete. 2024-09-13T18:55:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 Processor -- start 2024-09-13T18:55:19.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 -- start start 2024-09-13T18:55:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f214406d070 0x7f2144142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f214406d620 0x7f21440c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 0x7f214413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2144131090 con 0x7f2144143b70 2024-09-13T18:55:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440ca440 con 0x7f214406d070 2024-09-13T18:55:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2144131330 con 0x7f214406d620 2024-09-13T18:55:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.088+0000 7f2143400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 0x7f214413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 0x7f214413eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43990/0 (socket says 172.21.15.81:43990) 2024-09-13T18:55:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 -- 172.21.15.81:0/3111928993 learned_addr learned my addr 172.21.15.81:0/3111928993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2142a00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f214406d070 0x7f2144142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f213a000700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f214406d620 0x7f21440c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 -- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f214406d620 msgr2=0x7f21440c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f214406d620 0x7f21440c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 -- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f214406d070 msgr2=0x7f2144142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f214406d070 0x7f2144142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 -- 172.21.15.81:0/3111928993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c009570 con 0x7f2144143b70 2024-09-13T18:55:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f213a000700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f214406d620 0x7f21440c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143400700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 0x7f214413eef0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f213c009c60 tx=0x7f213c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c004610 con 0x7f2144143b70 2024-09-13T18:55:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c01e070 con 0x7f2144143b70 2024-09-13T18:55:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440ca670 con 0x7f2144143b70 2024-09-13T18:55:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0038e0 con 0x7f2144143b70 2024-09-13T18:55:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21440cac30 con 0x7f2144143b70 2024-09-13T18:55:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.092+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21440cadc0 con 0x7f2144143b70 2024-09-13T18:55:19.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.096+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f213c003a40 con 0x7f2144143b70 2024-09-13T18:55:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.096+0000 7f213be00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2120066730 0x7f2120068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.096+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f213c020070 con 0x7f2144143b70 2024-09-13T18:55:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.096+0000 7f2142a00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2120066730 0x7f2120068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.100+0000 7f2142a00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2120066730 0x7f2120068bf0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f214413fb50 tx=0x7f2134008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:19.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.104+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f213c0529d0 con 0x7f2144143b70 2024-09-13T18:55:19.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.344+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f21440cde20 con 0x7f2144143b70 2024-09-13T18:55:19.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.344+0000 7f213be00700 1 -- 172.21.15.81:0/3111928993 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1578 (secure 0 0 0) 0x7f213c055ff0 con 0x7f2144143b70 2024-09-13T18:55:19.353 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:19.353 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":508,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":62,"data_bytes":664395,"bytes_used":267173888,"bytes_avail":772826939392,"bytes_total":773094113280,"write_bytes_sec":4776,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":112,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-13T18:54:29.118644+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:55:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2120066730 msgr2=0x7f2120068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2120066730 0x7f2120068bf0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f214413fb50 tx=0x7f2134008040 comp rx=0 tx=0).stop 2024-09-13T18:55:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 msgr2=0x7f214413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 0x7f214413eef0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f213c009c60 tx=0x7f213c004770 comp rx=0 tx=0).stop 2024-09-13T18:55:19.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 shutdown_connections 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2120066730 0x7f2120068bf0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144143b70 0x7f214413eef0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f214406d620 0x7f21440c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 --2- 172.21.15.81:0/3111928993 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f214406d070 0x7f2144142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 >> 172.21.15.81:0/3111928993 conn(0x7f214406a390 msgr2=0x7f214406b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 shutdown_connections 2024-09-13T18:55:19.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:19.348+0000 7f2143e00700 1 -- 172.21.15.81:0/3111928993 wait complete. 2024-09-13T18:55:19.377 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:55:20.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 Processor -- start 2024-09-13T18:55:20.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 -- start start 2024-09-13T18:55:20.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f559c0cb020 0x7f559c0cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f559c15c2a0 0x7f559c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c06aaa0 0x7f559c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c06b430 con 0x7f559c15c2a0 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0b2ad0 con 0x7f559c0cb020 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.544+0000 7f55a1c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c15b960 con 0x7f559c06aaa0 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f559c15c2a0 0x7f559c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f559c15c2a0 0x7f559c15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43996/0 (socket says 172.21.15.81:43996) 2024-09-13T18:55:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 -- 172.21.15.81:0/1795554998 learned_addr learned my addr 172.21.15.81:0/1795554998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f559be00700 1 --2- 172.21.15.81:0/1795554998 >> v2:172.21.15.178:3300/0 conn(0x7f559c0cb020 0x7f559c0cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 -- 172.21.15.81:0/1795554998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c06aaa0 msgr2=0x7f559c06aef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:55:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 --2- 172.21.15.81:0/1795554998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c06aaa0 0x7f559c06aef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 -- 172.21.15.81:0/1795554998 >> v2:172.21.15.178:3300/0 conn(0x7f559c0cb020 msgr2=0x7f559c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:20.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 --2- 172.21.15.81:0/1795554998 >> v2:172.21.15.178:3300/0 conn(0x7f559c0cb020 0x7f559c0cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 -- 172.21.15.81:0/1795554998 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c15bc40 con 0x7f559c15c2a0 2024-09-13T18:55:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f5593400700 1 --2- 172.21.15.81:0/1795554998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15c2a0 0x7f559c15b0e0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f559c06b660 tx=0x7f5584009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68767696d286bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f559b400700 1 -- 172.21.15.81:0/1795554998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400b8a0 con 0x7f559c15c2a0 2024-09-13T18:55:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f559b400700 1 -- 172.21.15.81:0/1795554998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558400ba00 con 0x7f559c15c2a0 2024-09-13T18:55:20.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f559b400700 1 -- 172.21.15.81:0/1795554998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558400bd90 con 0x7f559c15c2a0 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 -- 172.21.15.81:0/1795554998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15c2a0 msgr2=0x7f559c15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1795554998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15c2a0 0x7f559c15b0e0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f559c06b660 tx=0x7f5584009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 -- 172.21.15.81:0/1795554998 shutdown_connections 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1795554998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c06aaa0 0x7f559c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1795554998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15c2a0 0x7f559c15b0e0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1795554998 >> v2:172.21.15.178:3300/0 conn(0x7f559c0cb020 0x7f559c0cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 -- 172.21.15.81:0/1795554998 >> 172.21.15.81:0/1795554998 conn(0x7f559c0b0c40 msgr2=0x7f559c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 -- 172.21.15.81:0/1795554998 shutdown_connections 2024-09-13T18:55:20.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.548+0000 7f55a1c00700 1 -- 172.21.15.81:0/1795554998 wait complete. 2024-09-13T18:55:20.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.552+0000 7f55a1c00700 1 Processor -- start 2024-09-13T18:55:20.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.552+0000 7f55a1c00700 1 -- start start 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 0x7f559c0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c0cb020 0x7f559c0c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f559c15c2a0 0x7f559c0c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c144180 con 0x7f559c06aaa0 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c6c70 con 0x7f559c15c2a0 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c7230 con 0x7f559c0cb020 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 0x7f559c0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 0x7f559c0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44000/0 (socket says 172.21.15.81:44000) 2024-09-13T18:55:20.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 -- 172.21.15.81:0/1059686528 learned_addr learned my addr 172.21.15.81:0/1059686528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1200700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f559c15c2a0 0x7f559c0c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f5593400700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c0cb020 0x7f559c0c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 -- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c0cb020 msgr2=0x7f559c0c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c0cb020 0x7f559c0c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 -- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f559c15c2a0 msgr2=0x7f559c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f559c15c2a0 0x7f559c0c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 -- 172.21.15.81:0/1059686528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5584009570 con 0x7f559c06aaa0 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1200700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f559c15c2a0 0x7f559c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f5593400700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c0cb020 0x7f559c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f559be00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 0x7f559c0c9900 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d830 tx=0x7f558c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c0125f0 con 0x7f559c06aaa0 2024-09-13T18:55:20.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c012750 con 0x7f559c06aaa0 2024-09-13T18:55:20.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c012ac0 con 0x7f559c06aaa0 2024-09-13T18:55:20.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c0c5ef0 con 0x7f559c06aaa0 2024-09-13T18:55:20.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.556+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c0c6ec0 con 0x7f559c06aaa0 2024-09-13T18:55:20.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.560+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c15c6f0 con 0x7f559c06aaa0 2024-09-13T18:55:20.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.560+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f558c012c20 con 0x7f559c06aaa0 2024-09-13T18:55:20.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.560+0000 7f5598c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5578066730 0x7f5578068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:20.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.564+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f558c084680 con 0x7f559c06aaa0 2024-09-13T18:55:20.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.564+0000 7f5593400700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5578066730 0x7f5578068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:20.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.564+0000 7f5593400700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5578066730 0x7f5578068bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5584014040 tx=0x7f5584008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:20.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.568+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f558c051890 con 0x7f559c06aaa0 2024-09-13T18:55:20.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.804+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f559c154ed0 con 0x7f559c06aaa0 2024-09-13T18:55:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f5598c00700 1 -- 172.21.15.81:0/1059686528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4779 (secure 0 0 0) 0x7f558c012ed0 con 0x7f559c06aaa0 2024-09-13T18:55:20.816 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:20.816 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":112,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:16.625299+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5578066730 msgr2=0x7f5578068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5578066730 0x7f5578068bf0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5584014040 tx=0x7f5584008030 comp rx=0 tx=0).stop 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 msgr2=0x7f559c0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 0x7f559c0c9900 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f558c00d830 tx=0x7f558c00dbf0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 shutdown_connections 2024-09-13T18:55:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5578066730 0x7f5578068bf0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f559c15c2a0 0x7f559c0c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f559c0cb020 0x7f559c0c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 --2- 172.21.15.81:0/1059686528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c06aaa0 0x7f559c0c9900 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.808+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 >> 172.21.15.81:0/1059686528 conn(0x7f559c0b0c40 msgr2=0x7f559c158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.812+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 shutdown_connections 2024-09-13T18:55:20.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.812+0000 7f55a1c00700 1 -- 172.21.15.81:0/1059686528 wait complete. 2024-09-13T18:55:20.821 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 112 2024-09-13T18:55:20.839 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:20.839 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.988+0000 7f6e5ec00700 1 Processor -- start 2024-09-13T18:55:20.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.988+0000 7f6e5ec00700 1 -- start start 2024-09-13T18:55:21.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ec00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e5815cc60 0x7f6e580d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ec00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6e580ce9b0 0x7f6e580d1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580d35f0 0x7f6e580cd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ec00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580d0740 con 0x7f6e5815cc60 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ec00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580d0f50 con 0x7f6e580ce9b0 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580d0990 con 0x7f6e580d35f0 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5d800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e5815cc60 0x7f6e580d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5d800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e5815cc60 0x7f6e580d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44004/0 (socket says 172.21.15.81:44004) 2024-09-13T18:55:21.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5d800700 1 -- 172.21.15.81:0/2131135878 learned_addr learned my addr 172.21.15.81:0/2131135878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5d800700 1 -- 172.21.15.81:0/2131135878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580d35f0 msgr2=0x7f6e580cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:21.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5d800700 1 --2- 172.21.15.81:0/2131135878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580d35f0 0x7f6e580cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5d800700 1 -- 172.21.15.81:0/2131135878 >> v2:172.21.15.178:3300/0 conn(0x7f6e580ce9b0 msgr2=0x7f6e580d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.992+0000 7f6e5ce00700 1 --2- 172.21.15.81:0/2131135878 >> v2:172.21.15.178:3300/0 conn(0x7f6e580ce9b0 0x7f6e580d1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5d800700 1 --2- 172.21.15.81:0/2131135878 >> v2:172.21.15.178:3300/0 conn(0x7f6e580ce9b0 0x7f6e580d1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5d800700 1 -- 172.21.15.81:0/2131135878 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580d0c70 con 0x7f6e5815cc60 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ce00700 1 --2- 172.21.15.81:0/2131135878 >> v2:172.21.15.178:3300/0 conn(0x7f6e580ce9b0 0x7f6e580d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5d800700 1 --2- 172.21.15.81:0/2131135878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5815cc60 0x7f6e580d1120 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f6e580b8c20 tx=0x7f6e4c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de7106722317dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e57e00700 1 -- 172.21.15.81:0/2131135878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00b8a0 con 0x7f6e5815cc60 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e57e00700 1 -- 172.21.15.81:0/2131135878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c00ba00 con 0x7f6e5815cc60 2024-09-13T18:55:21.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e57e00700 1 -- 172.21.15.81:0/2131135878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c00bd90 con 0x7f6e5815cc60 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 -- 172.21.15.81:0/2131135878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5815cc60 msgr2=0x7f6e580d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/2131135878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5815cc60 0x7f6e580d1120 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f6e580b8c20 tx=0x7f6e4c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 -- 172.21.15.81:0/2131135878 shutdown_connections 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/2131135878 >> v2:172.21.15.178:3300/0 conn(0x7f6e580ce9b0 0x7f6e580d1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/2131135878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580d35f0 0x7f6e580cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/2131135878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e5815cc60 0x7f6e580d1120 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 -- 172.21.15.81:0/2131135878 >> 172.21.15.81:0/2131135878 conn(0x7f6e5809bec0 msgr2=0x7f6e580d2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 -- 172.21.15.81:0/2131135878 shutdown_connections 2024-09-13T18:55:21.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:20.996+0000 7f6e5ec00700 1 -- 172.21.15.81:0/2131135878 wait complete. 2024-09-13T18:55:21.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 Processor -- start 2024-09-13T18:55:21.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 -- start start 2024-09-13T18:55:21.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580ce9b0 0x7f6e581f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 0x7f6e58154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e5815cc60 0x7f6e580b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580c64a0 con 0x7f6e580d35f0 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58154a70 con 0x7f6e5815cc60 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e581f61b0 con 0x7f6e580ce9b0 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 0x7f6e58154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 0x7f6e58154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44012/0 (socket says 172.21.15.81:44012) 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.000+0000 7f6e5ce00700 1 -- 172.21.15.81:0/883857219 learned_addr learned my addr 172.21.15.81:0/883857219 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5e200700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e5815cc60 0x7f6e580b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ce00700 1 -- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580ce9b0 msgr2=0x7f6e581f5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ce00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580ce9b0 0x7f6e581f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ce00700 1 -- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e5815cc60 msgr2=0x7f6e580b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ce00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e5815cc60 0x7f6e580b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ce00700 1 -- 172.21.15.81:0/883857219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c009570 con 0x7f6e580d35f0 2024-09-13T18:55:21.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5e200700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e5815cc60 0x7f6e580b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ce00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 0x7f6e58154090 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c770 tx=0x7f6e4400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44011800 con 0x7f6e580d35f0 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e581575a0 con 0x7f6e580d35f0 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e44011960 con 0x7f6e580d35f0 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44011d10 con 0x7f6e580d35f0 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e581f66c0 con 0x7f6e580d35f0 2024-09-13T18:55:21.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.004+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e580d1120 con 0x7f6e580d35f0 2024-09-13T18:55:21.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.008+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6e44018360 con 0x7f6e580d35f0 2024-09-13T18:55:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.008+0000 7f6e55600700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e38066760 0x7f6e38068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.008+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e44084130 con 0x7f6e580d35f0 2024-09-13T18:55:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.008+0000 7f6e5d800700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e38066760 0x7f6e38068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:21.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.008+0000 7f6e5d800700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e38066760 0x7f6e38068c20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009c30 tx=0x7f6e4c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:21.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.016+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e44051350 con 0x7f6e580d35f0 2024-09-13T18:55:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.260+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6e581575a0 con 0x7f6e580d35f0 2024-09-13T18:55:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.260+0000 7f6e55600700 1 -- 172.21.15.81:0/883857219 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1597 (secure 0 0 0) 0x7f6e581575a0 con 0x7f6e580d35f0 2024-09-13T18:55:21.269 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:21.269 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":510,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694945,"bytes_used":267231232,"bytes_avail":772826882048,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9639,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":112,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-13T18:54:29.118644+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:55:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e38066760 msgr2=0x7f6e38068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e38066760 0x7f6e38068c20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c009c30 tx=0x7f6e4c010000 comp rx=0 tx=0).stop 2024-09-13T18:55:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 msgr2=0x7f6e58154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 0x7f6e58154090 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400c770 tx=0x7f6e4400cb30 comp rx=0 tx=0).stop 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 shutdown_connections 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6e38066760 0x7f6e38068c20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e5815cc60 0x7f6e580b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e580d35f0 0x7f6e58154090 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 --2- 172.21.15.81:0/883857219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e580ce9b0 0x7f6e581f5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 >> 172.21.15.81:0/883857219 conn(0x7f6e5809bec0 msgr2=0x7f6e580b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 shutdown_connections 2024-09-13T18:55:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:21.264+0000 7f6e5ec00700 1 -- 172.21.15.81:0/883857219 wait complete. 2024-09-13T18:55:21.291 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:55:22.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 Processor -- start 2024-09-13T18:55:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 -- start start 2024-09-13T18:55:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e1006aaa0 0x7f2e1006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e100b2670 0x7f2e100b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e100b3560 con 0x7f2e101610b0 2024-09-13T18:55:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e10070b30 con 0x7f2e1006aaa0 2024-09-13T18:55:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.456+0000 7f2e0f200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1006b450 con 0x7f2e100b2670 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e1006aaa0 0x7f2e1006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2e1006aaa0 0x7f2e1006af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44028/0 (socket says 172.21.15.81:44028) 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 -- 172.21.15.81:0/4274254741 learned_addr learned my addr 172.21.15.81:0/4274254741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0e800700 1 --2- 172.21.15.81:0/4274254741 >> v2:172.21.15.178:3300/0 conn(0x7f2e100b2670 0x7f2e100b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 -- 172.21.15.81:0/4274254741 >> v2:172.21.15.178:3300/0 conn(0x7f2e100b2670 msgr2=0x7f2e100b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 --2- 172.21.15.81:0/4274254741 >> v2:172.21.15.178:3300/0 conn(0x7f2e100b2670 0x7f2e100b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 -- 172.21.15.81:0/4274254741 >> v1:172.21.15.178:6789/0 conn(0x7f2e101610b0 legacy=0x7f2e100719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 -- 172.21.15.81:0/4274254741 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100b3000 con 0x7f2e1006aaa0 2024-09-13T18:55:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0d400700 1 --2- 172.21.15.81:0/4274254741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e1006af10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009940 tx=0x7f2dfc009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad86d9142a4f400 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0ca00700 1 -- 172.21.15.81:0/4274254741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc011830 con 0x7f2e1006aaa0 2024-09-13T18:55:22.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0ca00700 1 -- 172.21.15.81:0/4274254741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc011990 con 0x7f2e1006aaa0 2024-09-13T18:55:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0ca00700 1 -- 172.21.15.81:0/4274254741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc011d20 con 0x7f2e1006aaa0 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 -- 172.21.15.81:0/4274254741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 msgr2=0x7f2e1006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 --2- 172.21.15.81:0/4274254741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e1006af10 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009940 tx=0x7f2dfc009c50 comp rx=0 tx=0).stop 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 -- 172.21.15.81:0/4274254741 shutdown_connections 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 --2- 172.21.15.81:0/4274254741 >> v2:172.21.15.178:3300/0 conn(0x7f2e100b2670 0x7f2e100b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 --2- 172.21.15.81:0/4274254741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e1006af10 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 -- 172.21.15.81:0/4274254741 >> 172.21.15.81:0/4274254741 conn(0x7f2e100b0c40 msgr2=0x7f2e1006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 -- 172.21.15.81:0/4274254741 shutdown_connections 2024-09-13T18:55:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.460+0000 7f2e0f200700 1 -- 172.21.15.81:0/4274254741 wait complete. 2024-09-13T18:55:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.464+0000 7f2e0f200700 1 Processor -- start 2024-09-13T18:55:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.464+0000 7f2e0f200700 1 -- start start 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e100acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e100b2670 0x7f2e100abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e101610b0 0x7f2e100aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100ab940 con 0x7f2e1006aaa0 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100aacc0 con 0x7f2e100b2670 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e100aafa0 con 0x7f2e101610b0 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e100acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e100acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44030/0 (socket says 172.21.15.81:44030) 2024-09-13T18:55:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 -- 172.21.15.81:0/787972535 learned_addr learned my addr 172.21.15.81:0/787972535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 -- 172.21.15.81:0/787972535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e101610b0 msgr2=0x7f2e100aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e101610b0 0x7f2e100aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 -- 172.21.15.81:0/787972535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e100b2670 msgr2=0x7f2e100abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e100b2670 0x7f2e100abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 -- 172.21.15.81:0/787972535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc009570 con 0x7f2e1006aaa0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0de00700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e100acb40 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000c500 tx=0x7f2e0000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e000052d0 con 0x7f2e1006aaa0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00005470 con 0x7f2e1006aaa0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e100ab280 con 0x7f2e1006aaa0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00006ac0 con 0x7f2e1006aaa0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e100aa980 con 0x7f2e1006aaa0 2024-09-13T18:55:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.468+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e10162610 con 0x7f2e1006aaa0 2024-09-13T18:55:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.472+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e00006c20 con 0x7f2e1006aaa0 2024-09-13T18:55:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.472+0000 7f2e06000700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2df0066760 0x7f2df0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.472+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e000836a0 con 0x7f2e1006aaa0 2024-09-13T18:55:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.472+0000 7f2e0d400700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2df0066760 0x7f2df0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.476+0000 7f2e0d400700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2df0066760 0x7f2df0068c20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2e1015d730 tx=0x7f2dfc010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.476+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e00050840 con 0x7f2e1006aaa0 2024-09-13T18:55:22.677 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:55:22.668+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:55:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.704+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e10070740 con 0x7f2e1006aaa0 2024-09-13T18:55:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.704+0000 7f2e06000700 1 -- 172.21.15.81:0/787972535 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4780 (secure 0 0 0) 0x7f2e00053e60 con 0x7f2e1006aaa0 2024-09-13T18:55:22.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:22.713 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":113,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:22.672385+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":5,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2df0066760 msgr2=0x7f2df0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2df0066760 0x7f2df0068c20 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f2e1015d730 tx=0x7f2dfc010000 comp rx=0 tx=0).stop 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 msgr2=0x7f2e100acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e100acb40 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f2e0000c500 tx=0x7f2e0000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 shutdown_connections 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2df0066760 0x7f2df0068c20 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e101610b0 0x7f2e100aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e100b2670 0x7f2e100abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 --2- 172.21.15.81:0/787972535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e1006aaa0 0x7f2e100acb40 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 >> 172.21.15.81:0/787972535 conn(0x7f2e100b0c40 msgr2=0x7f2e1006bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:22.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 shutdown_connections 2024-09-13T18:55:22.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.712+0000 7f2e0f200700 1 -- 172.21.15.81:0/787972535 wait complete. 2024-09-13T18:55:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 113 2024-09-13T18:55:22.742 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:22.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:22.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.900+0000 7fb657e00700 1 Processor -- start 2024-09-13T18:55:22.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.900+0000 7fb657e00700 1 -- start start 2024-09-13T18:55:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.904+0000 7fb657e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658159920 0x7fb6580b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.904+0000 7fb657e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6580cd2a0 con 0x7fb6580b30d0 2024-09-13T18:55:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.904+0000 7fb657e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6580ccc90 con 0x7fb65806d070 2024-09-13T18:55:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.904+0000 7fb657e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b3580 con 0x7fb658159920 2024-09-13T18:55:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.904+0000 7fb64e000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb6580b30d0 0x7fb65806c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41316/0 (socket says 172.21.15.81:41316) 2024-09-13T18:55:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.904+0000 7fb64e000700 1 -- 172.21.15.81:0/1568337914 learned_addr learned my addr 172.21.15.81:0/1568337914 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:22.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656a00700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658159920 0x7fb6580b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373055270 0 0) 0x7fb6580cd2a0 con 0x7fb6580b30d0 2024-09-13T18:55:22.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb63c0035d0 con 0x7fb6580b30d0 2024-09-13T18:55:22.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188587035 0 0) 0x7fb63c0035d0 con 0x7fb6580b30d0 2024-09-13T18:55:22.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658159920 msgr2=0x7fb6580b2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658159920 0x7fb6580b2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 >> v1:172.21.15.178:6789/0 conn(0x7fb65806d070 legacy=0x7fb6580cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580b3860 con 0x7fb6580b30d0 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fb640001670 con 0x7fb6580b30d0 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 >> v1:172.21.15.81:6789/0 conn(0x7fb6580b30d0 legacy=0x7fb65806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63c003a50 0x7fb63c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c004370 0x7fb63c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63c005000 0x7fb63c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580b3580 con 0x7fb63c005000 2024-09-13T18:55:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c00bf70 con 0x7fb63c004370 2024-09-13T18:55:22.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c00e2c0 con 0x7fb63c003a50 2024-09-13T18:55:22.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63c005000 0x7fb63c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 -- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63c003a50 msgr2=0x7fb63c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb63c003a50 0x7fb63c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 -- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c004370 msgr2=0x7fb63c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c004370 0x7fb63c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 -- 172.21.15.81:0/1568337914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0035d0 con 0x7fb63c005000 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb657400700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63c005000 0x7fb63c00ba30 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb65806fc50 tx=0x7fb63c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a457a3905a0cbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650001390 con 0x7fb63c005000 2024-09-13T18:55:22.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000c660 con 0x7fb63c005000 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.908+0000 7fb656000700 1 -- 172.21.15.81:0/1568337914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000ca10 con 0x7fb63c005000 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657e00700 1 -- 172.21.15.81:0/1568337914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63c005000 msgr2=0x7fb63c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657e00700 1 --2- 172.21.15.81:0/1568337914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb63c005000 0x7fb63c00ba30 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fb65806fc50 tx=0x7fb63c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657400700 1 -- 172.21.15.81:0/1568337914 reap_dead start 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657e00700 1 -- 172.21.15.81:0/1568337914 shutdown_connections 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657e00700 1 -- 172.21.15.81:0/1568337914 >> 172.21.15.81:0/1568337914 conn(0x7fb65806a390 msgr2=0x7fb65806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:22.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657e00700 1 -- 172.21.15.81:0/1568337914 shutdown_connections 2024-09-13T18:55:22.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.912+0000 7fb657e00700 1 -- 172.21.15.81:0/1568337914 wait complete. 2024-09-13T18:55:22.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 Processor -- start 2024-09-13T18:55:22.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 -- start start 2024-09-13T18:55:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c005000 0x7fb6581f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658153280 0x7fb65814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 0x7fb6581551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581f7660 con 0x7fb658154d50 2024-09-13T18:55:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581e2780 con 0x7fb63c005000 2024-09-13T18:55:22.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb658152a80 con 0x7fb658153280 2024-09-13T18:55:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 0x7fb6581551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 0x7fb6581551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44048/0 (socket says 172.21.15.81:44048) 2024-09-13T18:55:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 -- 172.21.15.81:0/660234551 learned_addr learned my addr 172.21.15.81:0/660234551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb656a00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c005000 0x7fb6581f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb64e000700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658153280 0x7fb65814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 -- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658153280 msgr2=0x7fb65814eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658153280 0x7fb65814eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 -- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c005000 msgr2=0x7fb6581f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c005000 0x7fb6581f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 -- 172.21.15.81:0/660234551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb658152d60 con 0x7fb658154d50 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657400700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 0x7fb6581551e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005750 tx=0x7fb650001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650001330 con 0x7fb658154d50 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb650006880 con 0x7fb658154d50 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6581e2990 con 0x7fb658154d50 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.916+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650006c30 con 0x7fb658154d50 2024-09-13T18:55:22.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.920+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65814eff0 con 0x7fb658154d50 2024-09-13T18:55:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.920+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6581e2bb0 con 0x7fb658154d50 2024-09-13T18:55:22.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.920+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb650023070 con 0x7fb658154d50 2024-09-13T18:55:22.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.924+0000 7fb64f400700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb634066730 0x7fb634068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:22.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.924+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb650084f70 con 0x7fb658154d50 2024-09-13T18:55:22.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.924+0000 7fb656a00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb634066730 0x7fb634068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:22.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.924+0000 7fb656a00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb634066730 0x7fb634068bf0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb65814f560 tx=0x7fb64800d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:22.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:22.928+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6500521f0 con 0x7fb658154d50 2024-09-13T18:55:23.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.172+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb658159920 con 0x7fb658154d50 2024-09-13T18:55:23.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.172+0000 7fb64f400700 1 -- 172.21.15.81:0/660234551 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1715 (secure 0 0 0) 0x7fb650055810 con 0x7fb658154d50 2024-09-13T18:55:23.182 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:23.182 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":512,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694945,"bytes_used":267231232,"bytes_avail":772826882048,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6482,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":113,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-13T18:54:29.118644+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:55:23.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb634066730 msgr2=0x7fb634068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb634066730 0x7fb634068bf0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb65814f560 tx=0x7fb64800d040 comp rx=0 tx=0).stop 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 msgr2=0x7fb6581551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 0x7fb6581551e0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fb63c005750 tx=0x7fb650001230 comp rx=0 tx=0).stop 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 shutdown_connections 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb634066730 0x7fb634068bf0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb658154d50 0x7fb6581551e0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb658153280 0x7fb65814eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 --2- 172.21.15.81:0/660234551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb63c005000 0x7fb6581f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 >> 172.21.15.81:0/660234551 conn(0x7fb65806a390 msgr2=0x7fb658070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:23.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 shutdown_connections 2024-09-13T18:55:23.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:23.176+0000 7fb657e00700 1 -- 172.21.15.81:0/660234551 wait complete. 2024-09-13T18:55:23.203 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:55:24.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:24.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe37ce00700 1 Processor -- start 2024-09-13T18:55:24.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe37ce00700 1 -- start start 2024-09-13T18:55:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe37ce00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe37806aaa0 0x7fe37806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe37ce00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3780ccb40 con 0x7fe3780cc6f0 2024-09-13T18:55:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe37ce00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37806b430 con 0x7fe3780cb020 2024-09-13T18:55:24.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe37ce00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3780b2ad0 con 0x7fe37806aaa0 2024-09-13T18:55:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe376a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe3780cc6f0 0x7fe37815b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41324/0 (socket says 172.21.15.81:41324) 2024-09-13T18:55:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe376a00700 1 -- 172.21.15.81:0/2793111277 learned_addr learned my addr 172.21.15.81:0/2793111277 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:24.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe377e00700 1 --2- 172.21.15.81:0/2793111277 >> v2:172.21.15.178:3300/0 conn(0x7fe37806aaa0 0x7fe37806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.376+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028325074 0 0) 0x7fe3780ccb40 con 0x7fe3780cc6f0 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe35c0035d0 con 0x7fe3780cc6f0 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133273942 0 0) 0x7fe368001110 con 0x7fe3780cb020 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3780ccb40 con 0x7fe3780cb020 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe377e00700 1 -- 172.21.15.81:0/2793111277 >> v1:172.21.15.178:6789/0 conn(0x7fe3780cb020 legacy=0x7fe37815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe377e00700 1 -- 172.21.15.81:0/2793111277 >> v1:172.21.15.81:6789/0 conn(0x7fe3780cc6f0 legacy=0x7fe37815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe377e00700 1 -- 172.21.15.81:0/2793111277 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37815b960 con 0x7fe37806aaa0 2024-09-13T18:55:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe377e00700 1 --2- 172.21.15.81:0/2793111277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37806aef0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe370009d90 tx=0x7fe37000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdcd1f86747053f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37000e070 con 0x7fe37806aaa0 2024-09-13T18:55:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37000bb20 con 0x7fe37806aaa0 2024-09-13T18:55:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe376000700 1 -- 172.21.15.81:0/2793111277 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370012430 con 0x7fe37806aaa0 2024-09-13T18:55:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 -- 172.21.15.81:0/2793111277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 msgr2=0x7fe37806aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 --2- 172.21.15.81:0/2793111277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37806aef0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe370009d90 tx=0x7fe37000b330 comp rx=0 tx=0).stop 2024-09-13T18:55:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 -- 172.21.15.81:0/2793111277 shutdown_connections 2024-09-13T18:55:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 --2- 172.21.15.81:0/2793111277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37806aef0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 -- 172.21.15.81:0/2793111277 >> 172.21.15.81:0/2793111277 conn(0x7fe3780b0c40 msgr2=0x7fe37806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:24.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 -- 172.21.15.81:0/2793111277 shutdown_connections 2024-09-13T18:55:24.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.380+0000 7fe37ce00700 1 -- 172.21.15.81:0/2793111277 wait complete. 2024-09-13T18:55:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 Processor -- start 2024-09-13T18:55:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 -- start start 2024-09-13T18:55:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3780cb020 0x7fe37814e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 0x7fe378157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37814ed90 con 0x7fe3780cc6f0 2024-09-13T18:55:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37814ff00 con 0x7fe37806aaa0 2024-09-13T18:55:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe37ce00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37814f8f0 con 0x7fe3780cb020 2024-09-13T18:55:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.384+0000 7fe377e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 0x7fe378157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3780cb020 0x7fe37814e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe377400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe377e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 0x7fe378157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44056/0 (socket says 172.21.15.81:44056) 2024-09-13T18:55:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe377e00700 1 -- 172.21.15.81:0/252006635 learned_addr learned my addr 172.21.15.81:0/252006635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 -- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 msgr2=0x7fe37814b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37814b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 -- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 msgr2=0x7fe378157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 0x7fe378157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 -- 172.21.15.81:0/252006635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe370009a70 con 0x7fe3780cb020 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe377e00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 0x7fe378157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe376a00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3780cb020 0x7fe37814e850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c420 tx=0x7fe36400c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364005b40 con 0x7fe3780cb020 2024-09-13T18:55:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe364005cc0 con 0x7fe3780cb020 2024-09-13T18:55:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe364007310 con 0x7fe3780cb020 2024-09-13T18:55:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37814bf30 con 0x7fe3780cb020 2024-09-13T18:55:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37814fb90 con 0x7fe3780cb020 2024-09-13T18:55:24.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.388+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37806aef0 con 0x7fe3780cb020 2024-09-13T18:55:24.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.392+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe364007470 con 0x7fe3780cb020 2024-09-13T18:55:24.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.392+0000 7fe36f400700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe358066760 0x7fe358068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.392+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe364083700 con 0x7fe3780cb020 2024-09-13T18:55:24.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.392+0000 7fe377400700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe358066760 0x7fe358068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.392+0000 7fe377400700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe358066760 0x7fe358068c20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe368001370 tx=0x7fe368009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:24.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.404+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe3640507e0 con 0x7fe3780cb020 2024-09-13T18:55:24.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.636+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe378150040 con 0x7fe3780cb020 2024-09-13T18:55:24.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.636+0000 7fe36f400700 1 -- 172.21.15.81:0/252006635 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4781 (secure 0 0 0) 0x7fe364053e00 con 0x7fe3780cb020 2024-09-13T18:55:24.645 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:24.645 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":114,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:23.683990+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":5,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe358066760 msgr2=0x7fe358068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe358066760 0x7fe358068c20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe368001370 tx=0x7fe368009040 comp rx=0 tx=0).stop 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3780cb020 msgr2=0x7fe37814e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3780cb020 0x7fe37814e850 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe36400c420 tx=0x7fe36400c730 comp rx=0 tx=0).stop 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 shutdown_connections 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe358066760 0x7fe358068c20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3780cc6f0 0x7fe378157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3780cb020 0x7fe37814e850 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 --2- 172.21.15.81:0/252006635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe37806aaa0 0x7fe37814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 >> 172.21.15.81:0/252006635 conn(0x7fe3780b0c40 msgr2=0x7fe378159860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:24.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 shutdown_connections 2024-09-13T18:55:24.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.640+0000 7fe37ce00700 1 -- 172.21.15.81:0/252006635 wait complete. 2024-09-13T18:55:24.650 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 114 2024-09-13T18:55:24.668 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:24.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 Processor -- start 2024-09-13T18:55:24.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 -- start start 2024-09-13T18:55:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b380b1980 0x7f8b380b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3806cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b38071f70 con 0x7f8b381464c0 2024-09-13T18:55:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3806d330 con 0x7f8b380b1980 2024-09-13T18:55:24.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38070da0 con 0x7f8b3806c960 2024-09-13T18:55:24.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b380b1980 0x7f8b380b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8b380b1980 0x7f8b380b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44066/0 (socket says 172.21.15.81:44066) 2024-09-13T18:55:24.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 -- 172.21.15.81:0/2116964298 learned_addr learned my addr 172.21.15.81:0/2116964298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:24.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3e400700 1 --2- 172.21.15.81:0/2116964298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3806cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 -- 172.21.15.81:0/2116964298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 msgr2=0x7f8b3806cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:24.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 --2- 172.21.15.81:0/2116964298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3806cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 -- 172.21.15.81:0/2116964298 >> v1:172.21.15.178:6789/0 conn(0x7f8b381464c0 legacy=0x7f8b38071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.820+0000 7f8b3d000700 1 -- 172.21.15.81:0/2116964298 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b380b2440 con 0x7f8b380b1980 2024-09-13T18:55:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3d000700 1 --2- 172.21.15.81:0/2116964298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b380b1df0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009910 tx=0x7f8b28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cef173c162879d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b37e00700 1 -- 172.21.15.81:0/2116964298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800ba60 con 0x7f8b380b1980 2024-09-13T18:55:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b37e00700 1 -- 172.21.15.81:0/2116964298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2800bbc0 con 0x7f8b380b1980 2024-09-13T18:55:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b37e00700 1 -- 172.21.15.81:0/2116964298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28009e60 con 0x7f8b380b1980 2024-09-13T18:55:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 -- 172.21.15.81:0/2116964298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 msgr2=0x7f8b380b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/2116964298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b380b1df0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009910 tx=0x7f8b28009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 -- 172.21.15.81:0/2116964298 shutdown_connections 2024-09-13T18:55:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/2116964298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3806cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/2116964298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b380b1df0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 -- 172.21.15.81:0/2116964298 >> 172.21.15.81:0/2116964298 conn(0x7f8b3806a390 msgr2=0x7f8b3806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 -- 172.21.15.81:0/2116964298 shutdown_connections 2024-09-13T18:55:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.824+0000 7f8b3ee00700 1 -- 172.21.15.81:0/2116964298 wait complete. 2024-09-13T18:55:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 Processor -- start 2024-09-13T18:55:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 -- start start 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3815f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b3813aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b381464c0 0x7f8b3815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3813c720 con 0x7f8b380b1980 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3815ee90 con 0x7f8b381464c0 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3815f0e0 con 0x7f8b3806c960 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b3813aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b3813aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44070/0 (socket says 172.21.15.81:44070) 2024-09-13T18:55:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3d000700 1 -- 172.21.15.81:0/282592752 learned_addr learned my addr 172.21.15.81:0/282592752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.828+0000 7f8b3e400700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b381464c0 0x7f8b3815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3d000700 1 -- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 msgr2=0x7f8b3815f3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:55:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3d000700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3815f3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3d000700 1 -- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b381464c0 msgr2=0x7f8b3815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3d000700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b381464c0 0x7f8b3815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3d000700 1 -- 172.21.15.81:0/282592752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009570 con 0x7f8b380b1980 2024-09-13T18:55:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3d000700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b3813aad0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8b28014040 tx=0x7f8b28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28004610 con 0x7f8b380b1980 2024-09-13T18:55:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2801e070 con 0x7f8b380b1980 2024-09-13T18:55:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b380cc9e0 con 0x7f8b380b1980 2024-09-13T18:55:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b28003940 con 0x7f8b380b1980 2024-09-13T18:55:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b380ccfa0 con 0x7f8b380b1980 2024-09-13T18:55:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3806cdf0 con 0x7f8b380b1980 2024-09-13T18:55:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.832+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8b28003aa0 con 0x7f8b380b1980 2024-09-13T18:55:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.836+0000 7f8b35600700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b1c066730 0x7f8b1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.836+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8b28020070 con 0x7f8b380b1980 2024-09-13T18:55:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.836+0000 7f8b3da00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b1c066730 0x7f8b1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.836+0000 7f8b3da00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b1c066730 0x7f8b1c068bf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c000f60 tx=0x7f8b2c007a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:24.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:24.840+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8b280529a0 con 0x7f8b380b1980 2024-09-13T18:55:25.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.084+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8b38160270 con 0x7f8b380b1980 2024-09-13T18:55:25.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.084+0000 7f8b35600700 1 -- 172.21.15.81:0/282592752 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1967 (secure 0 0 0) 0x7f8b280157c0 con 0x7f8b380b1980 2024-09-13T18:55:25.093 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:25.093 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":514,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":694945,"bytes_used":267235328,"bytes_avail":772826877952,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6483,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-13T18:55:23.136814+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:55:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b1c066730 msgr2=0x7f8b1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b1c066730 0x7f8b1c068bf0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c000f60 tx=0x7f8b2c007a60 comp rx=0 tx=0).stop 2024-09-13T18:55:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 msgr2=0x7f8b3813aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b3813aad0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8b28014040 tx=0x7f8b28004770 comp rx=0 tx=0).stop 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 shutdown_connections 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8b1c066730 0x7f8b1c068bf0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b381464c0 0x7f8b3815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b380b1980 0x7f8b3813aad0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 --2- 172.21.15.81:0/282592752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b3806c960 0x7f8b3815f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 >> 172.21.15.81:0/282592752 conn(0x7f8b3806a390 msgr2=0x7f8b38138c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 shutdown_connections 2024-09-13T18:55:25.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.088+0000 7f8b3ee00700 1 -- 172.21.15.81:0/282592752 wait complete. 2024-09-13T18:55:25.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:55:25.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub abort 2024-09-13T18:55:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.284+0000 7f8f8d600700 1 Processor -- start 2024-09-13T18:55:25.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.284+0000 7f8f8d600700 1 -- start start 2024-09-13T18:55:25.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8d600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f88160c60 0x7f8f88161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8d600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f88162110 0x7f8f8806b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8d600700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f88161670 con 0x7f8f880b4ad0 2024-09-13T18:55:25.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8d600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8806bb50 con 0x7f8f88160c60 2024-09-13T18:55:25.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8d600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8806b870 con 0x7f8f88162110 2024-09-13T18:55:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8cc00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8f880b4ad0 0x7f8f880b1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41336/0 (socket says 172.21.15.81:41336) 2024-09-13T18:55:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f8cc00700 1 -- 172.21.15.81:0/44017385 learned_addr learned my addr 172.21.15.81:0/44017385 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f87400700 1 --2- 172.21.15.81:0/44017385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f88162110 0x7f8f8806b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f87e00700 1 --2- 172.21.15.81:0/44017385 >> v2:172.21.15.178:3300/0 conn(0x7f8f88160c60 0x7f8f88161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f86a00700 1 -- 172.21.15.81:0/44017385 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072446497 0 0) 0x7f8f88161670 con 0x7f8f880b4ad0 2024-09-13T18:55:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f86a00700 1 -- 172.21.15.81:0/44017385 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f6c0035d0 con 0x7f8f880b4ad0 2024-09-13T18:55:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f87400700 1 -- 172.21.15.81:0/44017385 >> v2:172.21.15.178:3300/0 conn(0x7f8f88160c60 msgr2=0x7f8f88161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f87400700 1 --2- 172.21.15.81:0/44017385 >> v2:172.21.15.178:3300/0 conn(0x7f8f88160c60 0x7f8f88161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f87400700 1 -- 172.21.15.81:0/44017385 >> v1:172.21.15.81:6789/0 conn(0x7f8f880b4ad0 legacy=0x7f8f880b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.288+0000 7f8f87400700 1 -- 172.21.15.81:0/44017385 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88161910 con 0x7f8f88162110 2024-09-13T18:55:25.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f87400700 1 --2- 172.21.15.81:0/44017385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f88162110 0x7f8f8806b020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009850 tx=0x7f8f74009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1e48acabf1f5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f86a00700 1 -- 172.21.15.81:0/44017385 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011830 con 0x7f8f88162110 2024-09-13T18:55:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f86a00700 1 -- 172.21.15.81:0/44017385 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74011990 con 0x7f8f88162110 2024-09-13T18:55:25.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f86a00700 1 -- 172.21.15.81:0/44017385 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74011d40 con 0x7f8f88162110 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 -- 172.21.15.81:0/44017385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f88162110 msgr2=0x7f8f8806b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 --2- 172.21.15.81:0/44017385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f88162110 0x7f8f8806b020 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009850 tx=0x7f8f74009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 -- 172.21.15.81:0/44017385 shutdown_connections 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 --2- 172.21.15.81:0/44017385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f88162110 0x7f8f8806b020 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 --2- 172.21.15.81:0/44017385 >> v2:172.21.15.178:3300/0 conn(0x7f8f88160c60 0x7f8f88161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 -- 172.21.15.81:0/44017385 >> 172.21.15.81:0/44017385 conn(0x7f8f8806cb90 msgr2=0x7f8f8806cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 -- 172.21.15.81:0/44017385 shutdown_connections 2024-09-13T18:55:25.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.292+0000 7f8f8d600700 1 -- 172.21.15.81:0/44017385 wait complete. 2024-09-13T18:55:25.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.296+0000 7f8f8d600700 1 Processor -- start 2024-09-13T18:55:25.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.296+0000 7f8f8d600700 1 -- start start 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f880b4ad0 0x7f8f8815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 0x7f8f88155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f88162110 0x7f8f880cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88156240 con 0x7f8f88160c60 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815c6a0 con 0x7f8f88162110 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8815c0e0 con 0x7f8f880b4ad0 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 0x7f8f88155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 0x7f8f88155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44076/0 (socket says 172.21.15.81:44076) 2024-09-13T18:55:25.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 -- 172.21.15.81:0/3333407095 learned_addr learned my addr 172.21.15.81:0/3333407095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87e00700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f880b4ad0 0x7f8f8815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 -- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f880b4ad0 msgr2=0x7f8f8815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f880b4ad0 0x7f8f8815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 -- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f88162110 msgr2=0x7f8f880cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f88162110 0x7f8f880cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 -- 172.21.15.81:0/3333407095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740094b0 con 0x7f8f88160c60 2024-09-13T18:55:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f87400700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 0x7f8f88155740 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f8f740090b0 tx=0x7f8f74004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f7fe00700 1 -- 172.21.15.81:0/3333407095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74004520 con 0x7f8f88160c60 2024-09-13T18:55:25.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f7fe00700 1 -- 172.21.15.81:0/3333407095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7401f070 con 0x7f8f88160c60 2024-09-13T18:55:25.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8815c3c0 con 0x7f8f88160c60 2024-09-13T18:55:25.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f7fe00700 1 -- 172.21.15.81:0/3333407095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74003900 con 0x7f8f88160c60 2024-09-13T18:55:25.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.300+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f881567e0 con 0x7f8f88160c60 2024-09-13T18:55:25.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.304+0000 7f8f7fe00700 1 -- 172.21.15.81:0/3333407095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f74003a60 con 0x7f8f88160c60 2024-09-13T18:55:25.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.304+0000 7f8f91f70740 1 Processor -- start 2024-09-13T18:55:25.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f7fe00700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f68066730 0x7f8f68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 -- start start 2024-09-13T18:55:25.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f7fe00700 1 -- 172.21.15.81:0/3333407095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f74021070 con 0x7f8f88160c60 2024-09-13T18:55:25.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f68066730 0x7f8f68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f68066730 0x7f8f68068bf0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f8815b420 tx=0x7f8f800015f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2295cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2295d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 0x2295dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2288bdd0 con 0x2295d810 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22889560 con 0x22942440 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22884e50 con 0x2295c9b0 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 0x2295dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 0x2295dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44092/0 (socket says 172.21.15.81:44092) 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 -- 172.21.15.81:0/3435528108 learned_addr learned my addr 172.21.15.81:0/3435528108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f87400700 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2295d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f87e00700 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2295cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 -- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 msgr2=0x2295cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2295cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 -- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 msgr2=0x2295d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2295d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 -- 172.21.15.81:0/3435528108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x226f7a00 con 0x2295d810 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 0x2295dbf0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c8b0 tx=0x7f8f8000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f6443b2a1b365d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f73e00700 1 -- 172.21.15.81:0/3435528108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8001b070 con 0x2295d810 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f73e00700 1 -- 172.21.15.81:0/3435528108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f800162e0 con 0x2295d810 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.308+0000 7f8f73e00700 1 -- 172.21.15.81:0/3435528108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800166d0 con 0x2295d810 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- 172.21.15.81:0/3435528108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 msgr2=0x2295dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 0x2295dbf0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c8b0 tx=0x7f8f8000f000 comp rx=0 tx=0).stop 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- 172.21.15.81:0/3435528108 shutdown_connections 2024-09-13T18:55:25.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295d810 0x2295dbf0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2295d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- 172.21.15.81:0/3435528108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2295cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- 172.21.15.81:0/3435528108 >> 172.21.15.81:0/3435528108 conn(0x226ac570 msgr2=0x22945500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- 172.21.15.81:0/3435528108 shutdown_connections 2024-09-13T18:55:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- 172.21.15.81:0/3435528108 wait complete. 2024-09-13T18:55:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- start start 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 Processor -- start 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2291d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 0x22945ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x22940520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22842760 con 0x2295c9b0 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x228485e0 con 0x22942440 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22730b40 con 0x2295d810 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 10 client.0 _ll_register_callbacks cb 0x22849b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 0x22945ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 0x22945ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44108/0 (socket says 172.21.15.81:44108) 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 -- 172.21.15.81:0/1382494925 learned_addr learned my addr 172.21.15.81:0/1382494925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2291d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x22940520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 -- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 msgr2=0x22940520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x22940520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 -- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 msgr2=0x2291d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2291d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 -- 172.21.15.81:0/1382494925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0035d0 con 0x2295c9b0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2291d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f87400700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 0x22945ca0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f8f740562d0 tx=0x7f8f74025f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791bdc6a43e6cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f70c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f70c00700 1 -- 172.21.15.81:0/1382494925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74083ea0 con 0x2295c9b0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f70c00700 1 -- 172.21.15.81:0/1382494925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f7405a400 con 0x2295c9b0 2024-09-13T18:55:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.312+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x226b9280 con 0x2295c9b0 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 1 -- 172.21.15.81:0/1382494925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f7405e9c0 con 0x2295c9b0 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 10 client.9405 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x2284b250 con 0x2295c9b0 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 1 -- 172.21.15.81:0/1382494925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x226b9280 con 0x2295c9b0 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 1 -- 172.21.15.81:0/1382494925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f8f74056830 con 0x2295c9b0 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 10 client.9405 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 10 client.9405 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 20 client.9405 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22942820 0x2296a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 4 client.9405 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22703500 con 0x22942820 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22942820 0x2296a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22942820 0x2296a1f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452a8cbfc453fb66 server_cookie=772b10e67c1a989c in_seq=0 out_seq=0 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 10 client.9405 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 1 -- 172.21.15.81:0/1382494925 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x22703500 con 0x22942820 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 10 client.9405 handle_command_reply: tid=0 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 client.9405 shutdown 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 msgr2=0x22945ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 0x22945ca0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f8f740562d0 tx=0x7f8f74025f40 comp rx=0 tx=0).stop 2024-09-13T18:55:25.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 shutdown_connections 2024-09-13T18:55:25.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x22942820 0x2296a1f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x22940520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2295c9b0 0x22945ca0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1382494925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22942440 0x2291d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f70c00700 0 client.9405 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:25.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 >> 172.21.15.81:0/1382494925 conn(0x226ac570 msgr2=0x22941590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 shutdown_connections 2024-09-13T18:55:25.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 1 -- 172.21.15.81:0/1382494925 wait complete. 2024-09-13T18:55:25.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.316+0000 7f8f91f70740 20 client.9405 trim_cache size 0 max 16384 2024-09-13T18:55:25.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.336+0000 7f8f91f70740 1 Processor -- start 2024-09-13T18:55:25.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.336+0000 7f8f91f70740 1 -- start start 2024-09-13T18:55:25.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x2295bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2291d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295d810 0x2291d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x22834410 con 0x22942440 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22836c80 con 0x2295d810 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x228b3f10 con 0x2295c9b0 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x2295bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x2295bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44120/0 (socket says 172.21.15.81:44120) 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 -- 172.21.15.81:0/1559959302 learned_addr learned my addr 172.21.15.81:0/1559959302 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295d810 0x2291d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87400700 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2291d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 -- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 msgr2=0x2291d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2291d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 -- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295d810 msgr2=0x2291d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295d810 0x2291d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 -- 172.21.15.81:0/1559959302 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22831480 con 0x22942440 2024-09-13T18:55:25.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87400700 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2291d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f87e00700 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x2295bda0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x229459d0 tx=0x7f8f78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8c12cd8e22ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f7d200700 1 -- 172.21.15.81:0/1559959302 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7801b040 con 0x22942440 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f7d200700 1 -- 172.21.15.81:0/1559959302 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f780040f0 con 0x22942440 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f7d200700 1 -- 172.21.15.81:0/1559959302 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78004480 con 0x22942440 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- 172.21.15.81:0/1559959302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 msgr2=0x2295bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x2295bda0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x229459d0 tx=0x7f8f78008040 comp rx=0 tx=0).stop 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- 172.21.15.81:0/1559959302 shutdown_connections 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295d810 0x2291d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295c9b0 0x2291d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 --2- 172.21.15.81:0/1559959302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x2295bda0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- 172.21.15.81:0/1559959302 >> 172.21.15.81:0/1559959302 conn(0x226ac570 msgr2=0x22959fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- 172.21.15.81:0/1559959302 shutdown_connections 2024-09-13T18:55:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.340+0000 7f8f91f70740 1 -- 172.21.15.81:0/1559959302 wait complete. 2024-09-13T18:55:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 -- start start 2024-09-13T18:55:25.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 Processor -- start 2024-09-13T18:55:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x229c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295c9b0 0x2291ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x2291cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2284f330 con 0x22942440 2024-09-13T18:55:25.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2284f520 con 0x2295c9b0 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2291dc30 con 0x2295d810 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f91f70740 10 client.0 _ll_register_callbacks cb 0x2282b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x229c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x229c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44122/0 (socket says 172.21.15.81:44122) 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 -- 172.21.15.81:0/434568016 learned_addr learned my addr 172.21.15.81:0/434568016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f8cc00700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x2291cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 -- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 msgr2=0x2291cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x2291cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87400700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295c9b0 0x2291ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 -- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295c9b0 msgr2=0x2291ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295c9b0 0x2291ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87e00700 1 -- 172.21.15.81:0/434568016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f78009db0 con 0x22942440 2024-09-13T18:55:25.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.344+0000 7f8f87400700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295c9b0 0x2291ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f87e00700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x229c4d50 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x2282a370 tx=0x7f8f74085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffff26fb90bc6da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 1 -- 172.21.15.81:0/434568016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7801e7c0 con 0x22942440 2024-09-13T18:55:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 1 -- 172.21.15.81:0/434568016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f78000e40 con 0x22942440 2024-09-13T18:55:25.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f800162e0 con 0x22942440 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 1 -- 172.21.15.81:0/434568016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f7801e920 con 0x22942440 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 10 client.9411 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x22825750 con 0x22942440 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 1 -- 172.21.15.81:0/434568016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f800162e0 con 0x22942440 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 1 -- 172.21.15.81:0/434568016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f8f7801e050 con 0x22942440 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 10 client.9411 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 10 client.9411 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 20 client.9411 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x229c5290 0x2291a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 4 client.9411 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x22728280 con 0x229c5290 2024-09-13T18:55:25.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f87400700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x229c5290 0x2291a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f87400700 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x229c5290 0x2291a6b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a014a44ad612346 server_cookie=2d0b4fa1cf059c55 in_seq=0 out_seq=0 2024-09-13T18:55:25.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 10 client.9411 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 1 -- 172.21.15.81:0/434568016 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x22728280 con 0x229c5290 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f70c00700 10 client.9411 handle_command_reply: tid=0 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.348+0000 7f8f91f70740 1 client.9411 shutdown 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 msgr2=0x229c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x229c4d50 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x2282a370 tx=0x7f8f74085040 comp rx=0 tx=0).stop 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 shutdown_connections 2024-09-13T18:55:25.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x229c5290 0x2291a6b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2295d810 0x2291cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2295c9b0 0x2291ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f70c00700 0 client.9411 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 --2- 172.21.15.81:0/434568016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x22942440 0x229c4d50 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 >> 172.21.15.81:0/434568016 conn(0x226ac570 msgr2=0x2293f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 shutdown_connections 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 1 -- 172.21.15.81:0/434568016 wait complete. 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f91f70740 20 client.9411 trim_cache size 0 max 16384 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:55:25.361 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f68066730 msgr2=0x7f8f68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f68066730 0x7f8f68068bf0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8f8815b420 tx=0x7f8f800015f0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 msgr2=0x7f8f88155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 0x7f8f88155740 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f8f740090b0 tx=0x7f8f74004770 comp rx=0 tx=0).stop 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 shutdown_connections 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8f68066730 0x7f8f68068bf0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f88162110 0x7f8f880cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f88160c60 0x7f8f88155740 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 --2- 172.21.15.81:0/3333407095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f880b4ad0 0x7f8f8815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 >> 172.21.15.81:0/3333407095 conn(0x7f8f8806cb90 msgr2=0x7f8f88164e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 shutdown_connections 2024-09-13T18:55:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.352+0000 7f8f8d600700 1 -- 172.21.15.81:0/3333407095 wait complete. 2024-09-13T18:55:25.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-13T18:55:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.564+0000 7fb8cde00700 1 Processor -- start 2024-09-13T18:55:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.564+0000 7fb8cde00700 1 -- start start 2024-09-13T18:55:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.564+0000 7fb8cde00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb8c80cfac0 0x7fb8c80d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.564+0000 7fb8cde00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c80d0780 con 0x7fb8c8143b60 2024-09-13T18:55:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8cde00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c8143f40 con 0x7fb8c815e720 2024-09-13T18:55:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8cde00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c815f710 con 0x7fb8c80cfac0 2024-09-13T18:55:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb8c8143b60 0x7fb8c80cf3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41350/0 (socket says 172.21.15.81:41350) 2024-09-13T18:55:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1417879075 learned_addr learned my addr 172.21.15.81:0/1417879075 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6000700 1 --2- 172.21.15.81:0/1417879075 >> v2:172.21.15.178:3300/0 conn(0x7fb8c80cfac0 0x7fb8c80d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73857219 0 0) 0x7fb8b8001110 con 0x7fb8c8143b60 2024-09-13T18:55:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ac0035d0 con 0x7fb8c8143b60 2024-09-13T18:55:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678345626 0 0) 0x7fb8c8143f40 con 0x7fb8c815e720 2024-09-13T18:55:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b8001110 con 0x7fb8c815e720 2024-09-13T18:55:25.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537650077 0 0) 0x7fb8ac0035d0 con 0x7fb8c8143b60 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6000700 1 -- 172.21.15.81:0/1417879075 >> v1:172.21.15.178:6789/0 conn(0x7fb8c815e720 legacy=0x7fb8c815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6000700 1 -- 172.21.15.81:0/1417879075 >> v1:172.21.15.81:6789/0 conn(0x7fb8c8143b60 legacy=0x7fb8c80cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6000700 1 -- 172.21.15.81:0/1417879075 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c815f430 con 0x7fb8c80cfac0 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c6000700 1 --2- 172.21.15.81:0/1417879075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c80cfac0 0x7fb8c80d14a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009850 tx=0x7fb8b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73cf0a2a6c0e6ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8001800 con 0x7fb8c80cfac0 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4004030 con 0x7fb8c80cfac0 2024-09-13T18:55:25.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.568+0000 7fb8c5600700 1 -- 172.21.15.81:0/1417879075 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40043c0 con 0x7fb8c80cfac0 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 -- 172.21.15.81:0/1417879075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c80cfac0 msgr2=0x7fb8c80d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 --2- 172.21.15.81:0/1417879075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c80cfac0 0x7fb8c80d14a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4009850 tx=0x7fb8b4009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 -- 172.21.15.81:0/1417879075 shutdown_connections 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 --2- 172.21.15.81:0/1417879075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c80cfac0 0x7fb8c80d14a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 -- 172.21.15.81:0/1417879075 >> 172.21.15.81:0/1417879075 conn(0x7fb8c806e660 msgr2=0x7fb8c806ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 -- 172.21.15.81:0/1417879075 shutdown_connections 2024-09-13T18:55:25.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 -- 172.21.15.81:0/1417879075 wait complete. 2024-09-13T18:55:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 Processor -- start 2024-09-13T18:55:25.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.572+0000 7fb8cde00700 1 -- start start 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8c80cfac0 0x7fb8c81f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8143b60 0x7fb8c815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 0x7fb8c815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c81f3f60 con 0x7fb8c815e720 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c815ad20 con 0x7fb8c8143b60 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c815bb80 con 0x7fb8c80cfac0 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 0x7fb8c815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 0x7fb8c815c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44126/0 (socket says 172.21.15.81:44126) 2024-09-13T18:55:25.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 -- 172.21.15.81:0/3839185460 learned_addr learned my addr 172.21.15.81:0/3839185460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c6000700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8143b60 0x7fb8c815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8c80cfac0 0x7fb8c81f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 -- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8c80cfac0 msgr2=0x7fb8c81f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8c80cfac0 0x7fb8c81f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 -- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8143b60 msgr2=0x7fb8c815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8143b60 0x7fb8c815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 -- 172.21.15.81:0/3839185460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40094b0 con 0x7fb8c815e720 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8c7400700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 0x7fb8c815c010 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000cc20 tx=0x7fb8c000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8bf400700 1 -- 172.21.15.81:0/3839185460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0003c20 con 0x7fb8c815e720 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8bf400700 1 -- 172.21.15.81:0/3839185460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c0003d80 con 0x7fb8c815e720 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c815af70 con 0x7fb8c815e720 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8bf400700 1 -- 172.21.15.81:0/3839185460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c000ab90 con 0x7fb8c815e720 2024-09-13T18:55:25.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.576+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c815b530 con 0x7fb8c815e720 2024-09-13T18:55:25.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.580+0000 7fb8bf400700 1 -- 172.21.15.81:0/3839185460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb8c000acf0 con 0x7fb8c815e720 2024-09-13T18:55:25.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.580+0000 7fb8bf400700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8a8066730 0x7fb8a8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8bf400700 1 -- 172.21.15.81:0/3839185460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8c0084390 con 0x7fb8c815e720 2024-09-13T18:55:25.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8a8066730 0x7fb8a8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8a8066730 0x7fb8a8068bf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8001370 tx=0x7fb8b8007aa0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 Processor -- start 2024-09-13T18:55:25.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 -- start start 2024-09-13T18:55:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cf5b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf5ad00 0x2cf7cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7d270 0x2cf305d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cec4010 con 0x2cf7c950 2024-09-13T18:55:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ce51f40 con 0x2cf5ad00 2024-09-13T18:55:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.584+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2cea4e30 con 0x2cf7d270 2024-09-13T18:55:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cf5b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cf5b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44134/0 (socket says 172.21.15.81:44134) 2024-09-13T18:55:25.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1741141520 learned_addr learned my addr 172.21.15.81:0/1741141520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7d270 msgr2=0x2cf305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7d270 0x2cf305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6000700 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf5ad00 0x2cf7cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf5ad00 msgr2=0x2cf7cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf5ad00 0x2cf7cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 -- 172.21.15.81:0/1741141520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2cd10a40 con 0x2cf7c950 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6000700 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf5ad00 0x2cf7cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cf5b240 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80015f0 tx=0x7fb8b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e53a07f8f5052f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8b3400700 1 -- 172.21.15.81:0/1741141520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8013630 con 0x2cf7c950 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8b3400700 1 -- 172.21.15.81:0/1741141520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8013790 con 0x2cf7c950 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8b3400700 1 -- 172.21.15.81:0/1741141520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8013b00 con 0x2cf7c950 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1741141520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 msgr2=0x2cf5b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cf5b240 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80015f0 tx=0x7fb8b8012000 comp rx=0 tx=0).stop 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1741141520 shutdown_connections 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7d270 0x2cf305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf5ad00 0x2cf7cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1741141520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cf5b240 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1741141520 >> 172.21.15.81:0/1741141520 conn(0x2ccc55b0 msgr2=0x2cf369b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1741141520 shutdown_connections 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1741141520 wait complete. 2024-09-13T18:55:25.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 -- start start 2024-09-13T18:55:25.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.588+0000 7fb8d11dc740 1 Processor -- start 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cf46910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7c950 0x2cf783c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 0x2cf44ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cea0150 con 0x2cf7d270 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ce9deb0 con 0x2cf7c950 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ce5b8e0 con 0x2cf5ad00 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 10 client.0 _ll_register_callbacks cb 0x2ce3a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 0x2cf44ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 0x2cf44ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44148/0 (socket says 172.21.15.81:44148) 2024-09-13T18:55:25.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 -- 172.21.15.81:0/1770932114 learned_addr learned my addr 172.21.15.81:0/1770932114 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c6000700 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7c950 0x2cf783c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 -- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 msgr2=0x2cf46910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cf46910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 -- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7c950 msgr2=0x2cf783c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7c950 0x2cf783c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 -- 172.21.15.81:0/1770932114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b800f040 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8c7400700 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 0x2cf44ca0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0051770 tx=0x7fb8c0055320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403bb2b41db50c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8a7e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8a7e00700 1 -- 172.21.15.81:0/1770932114 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00840b0 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2ccd22c0 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8a7e00700 1 -- 172.21.15.81:0/1770932114 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8c00730c0 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8a7e00700 1 -- 172.21.15.81:0/1770932114 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8c0084210 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 10 client.9423 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x2ce64290 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8a7e00700 1 -- 172.21.15.81:0/1770932114 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2ccd22c0 con 0x2cf7d270 2024-09-13T18:55:25.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8a7e00700 1 -- 172.21.15.81:0/1770932114 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb8c00554d0 con 0x2cf7d270 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 10 client.9423 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 10 client.9423 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 20 client.9423 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cf5a300 0x2cf791f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 4 client.9423 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.592+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2cd1c540 con 0x2cf5a300 2024-09-13T18:55:25.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cf5a300 0x2cf791f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cf5a300 0x2cf791f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f89cab67090311ec server_cookie=82ba123b81200956 in_seq=0 out_seq=0 2024-09-13T18:55:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8a7e00700 10 client.9423 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8a7e00700 1 -- 172.21.15.81:0/1770932114 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x2cd1c540 con 0x2cf5a300 2024-09-13T18:55:25.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8a7e00700 10 client.9423 handle_command_reply: tid=0 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 client.9423 shutdown 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 msgr2=0x2cf44ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 0x2cf44ca0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0051770 tx=0x7fb8c0055320 comp rx=0 tx=0).stop 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 shutdown_connections 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7d270 0x2cf44ca0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cf5a300 0x2cf791f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7c950 0x2cf783c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/1770932114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cf46910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 >> 172.21.15.81:0/1770932114 conn(0x2ccc55b0 msgr2=0x2cf31dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8a7e00700 0 client.9423 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 shutdown_connections 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 1 -- 172.21.15.81:0/1770932114 wait complete. 2024-09-13T18:55:25.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.596+0000 7fb8d11dc740 20 client.9423 trim_cache size 0 max 16384 2024-09-13T18:55:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.616+0000 7fb8d11dc740 1 Processor -- start 2024-09-13T18:55:25.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.616+0000 7fb8d11dc740 1 -- start start 2024-09-13T18:55:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 0x2cf7b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7c950 0x2cf94960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cf76ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2cd49b80 con 0x2cf5ad00 2024-09-13T18:55:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ce6ec00 con 0x2cf7d270 2024-09-13T18:55:25.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2cf36c10 con 0x2cf7c950 2024-09-13T18:55:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 0x2cf7b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 0x2cf7b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44154/0 (socket says 172.21.15.81:44154) 2024-09-13T18:55:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 -- 172.21.15.81:0/537776036 learned_addr learned my addr 172.21.15.81:0/537776036 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c7400700 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cf76ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6000700 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7c950 0x2cf94960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 -- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7c950 msgr2=0x2cf94960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7c950 0x2cf94960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 -- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 msgr2=0x2cf76ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cf76ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 -- 172.21.15.81:0/537776036 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2ce4a4c0 con 0x2cf5ad00 2024-09-13T18:55:25.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 0x2cf7b990 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8014000 tx=0x7fb8b8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14d85034b7bae83 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8b3e00700 1 -- 172.21.15.81:0/537776036 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8027040 con 0x2cf5ad00 2024-09-13T18:55:25.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8b3e00700 1 -- 172.21.15.81:0/537776036 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8019070 con 0x2cf5ad00 2024-09-13T18:55:25.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.620+0000 7fb8b3e00700 1 -- 172.21.15.81:0/537776036 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8013b00 con 0x2cf5ad00 2024-09-13T18:55:25.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- 172.21.15.81:0/537776036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 msgr2=0x2cf7b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 0x2cf7b990 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8014000 tx=0x7fb8b8011000 comp rx=0 tx=0).stop 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- 172.21.15.81:0/537776036 shutdown_connections 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cf76ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf7c950 0x2cf94960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/537776036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf5ad00 0x2cf7b990 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- 172.21.15.81:0/537776036 >> 172.21.15.81:0/537776036 conn(0x2ccc55b0 msgr2=0x2cf7b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- 172.21.15.81:0/537776036 shutdown_connections 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- 172.21.15.81:0/537776036 wait complete. 2024-09-13T18:55:25.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- start start 2024-09-13T18:55:25.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 Processor -- start 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cfe67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cfe76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cfe7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ce27a50 con 0x2cf7c950 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ce4fc70 con 0x2cf7d270 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ce9b6c0 con 0x2cf5ad00 2024-09-13T18:55:25.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8d11dc740 10 client.0 _ll_register_callbacks cb 0x2ce6d8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:25.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8c6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cfe76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8c6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cfe76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44166/0 (socket says 172.21.15.81:44166) 2024-09-13T18:55:25.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8c6000700 1 -- 172.21.15.81:0/943469337 learned_addr learned my addr 172.21.15.81:0/943469337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cfe67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.624+0000 7fb8c7400700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cfe7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6000700 1 -- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 msgr2=0x2cfe67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6000700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cfe67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6000700 1 -- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 msgr2=0x2cfe7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6000700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cfe7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6000700 1 -- 172.21.15.81:0/943469337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2cd10a40 con 0x2cf7c950 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6000700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cfe76e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8071c10 tx=0x7fb8b40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7870a9a678f59e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 1 -- 172.21.15.81:0/943469337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4003b50 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 1 -- 172.21.15.81:0/943469337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8b4003cb0 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8b8013790 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 1 -- 172.21.15.81:0/943469337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b4003e90 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 10 client.9429 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x2ce3e790 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 1 -- 172.21.15.81:0/943469337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b8013790 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 1 -- 172.21.15.81:0/943469337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fb8b4018070 con 0x2cf7c950 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 10 client.9429 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 10 client.9429 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:25.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 20 client.9429 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:25.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cfe6d00 0x2cfe8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 4 client.9429 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:25.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2cd412c0 con 0x2cfe6d00 2024-09-13T18:55:25.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cfe6d00 0x2cfe8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8c6a00700 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cfe6d00 0x2cfe8160 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b5af296d26f7d7d server_cookie=653ced52710f8170 in_seq=0 out_seq=0 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 10 client.9429 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 1 -- 172.21.15.81:0/943469337 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x2cd412c0 con 0x2cfe6d00 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8a7e00700 10 client.9429 handle_command_reply: tid=0 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.628+0000 7fb8d11dc740 1 client.9429 shutdown 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 msgr2=0x2cfe76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cfe76e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fb8c8071c10 tx=0x7fb8b40047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 shutdown_connections 2024-09-13T18:55:25.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x2cfe6d00 0x2cfe8160 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2cf7d270 0x2cfe7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x2cf7c950 0x2cfe76e0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8a7e00700 0 client.9429 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 --2- 172.21.15.81:0/943469337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2cf5ad00 0x2cfe67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 >> 172.21.15.81:0/943469337 conn(0x2ccc55b0 msgr2=0x2cf7b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 shutdown_connections 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 1 -- 172.21.15.81:0/943469337 wait complete. 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8d11dc740 20 client.9429 trim_cache size 0 max 16384 2024-09-13T18:55:25.640 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:25.641 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8a8066730 msgr2=0x7fb8a8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8a8066730 0x7fb8a8068bf0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8001370 tx=0x7fb8b8007aa0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 msgr2=0x7fb8c815c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 0x7fb8c815c010 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fb8c000cc20 tx=0x7fb8c000cf30 comp rx=0 tx=0).stop 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 shutdown_connections 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb8a8066730 0x7fb8a8068bf0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8c815e720 0x7fb8c815c010 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb8c8143b60 0x7fb8c815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 --2- 172.21.15.81:0/3839185460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb8c80cfac0 0x7fb8c81f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 >> 172.21.15.81:0/3839185460 conn(0x7fb8c806e660 msgr2=0x7fb8c815eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 shutdown_connections 2024-09-13T18:55:25.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.632+0000 7fb8cde00700 1 -- 172.21.15.81:0/3839185460 wait complete. 2024-09-13T18:55:25.661 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:25.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-13T18:55:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.832+0000 7fe056200700 1 Processor -- start 2024-09-13T18:55:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.832+0000 7fe056200700 1 -- start start 2024-09-13T18:55:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe056200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe050143b70 0x7fe0500cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe056200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe05006d620 0x7fe05006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe056200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500b1980 con 0x7fe05006cea0 2024-09-13T18:55:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe056200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0500b2500 con 0x7fe050143b70 2024-09-13T18:55:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe056200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05006d2f0 con 0x7fe05006d620 2024-09-13T18:55:25.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe050143b70 0x7fe0500cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe050143b70 0x7fe0500cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44168/0 (socket says 172.21.15.81:44168) 2024-09-13T18:55:25.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 -- 172.21.15.81:0/4282943644 learned_addr learned my addr 172.21.15.81:0/4282943644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe055800700 1 --1- 172.21.15.81:0/4282943644 >> v1:172.21.15.81:6789/0 conn(0x7fe05006cea0 0x7fe05015e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41364/0 (socket says 172.21.15.81:41364) 2024-09-13T18:55:25.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe04fe00700 1 --2- 172.21.15.81:0/4282943644 >> v2:172.21.15.178:3300/0 conn(0x7fe05006d620 0x7fe05006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 -- 172.21.15.81:0/4282943644 >> v2:172.21.15.178:3300/0 conn(0x7fe05006d620 msgr2=0x7fe05006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 --2- 172.21.15.81:0/4282943644 >> v2:172.21.15.178:3300/0 conn(0x7fe05006d620 0x7fe05006c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 -- 172.21.15.81:0/4282943644 >> v1:172.21.15.81:6789/0 conn(0x7fe05006cea0 legacy=0x7fe05015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 -- 172.21.15.81:0/4282943644 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500b1bd0 con 0x7fe050143b70 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe04f400700 1 -- 172.21.15.81:0/4282943644 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207147838 0 0) 0x7fe0500b1980 con 0x7fe05006cea0 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe04fe00700 1 --2- 172.21.15.81:0/4282943644 >> v2:172.21.15.178:3300/0 conn(0x7fe05006d620 0x7fe05006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe054e00700 1 --2- 172.21.15.81:0/4282943644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500cde20 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ce860 tx=0x7fe044009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6414f0da254edbeb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe04f400700 1 -- 172.21.15.81:0/4282943644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400b8a0 con 0x7fe050143b70 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe04f400700 1 -- 172.21.15.81:0/4282943644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04400ba00 con 0x7fe050143b70 2024-09-13T18:55:25.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.836+0000 7fe04f400700 1 -- 172.21.15.81:0/4282943644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400bd90 con 0x7fe050143b70 2024-09-13T18:55:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 -- 172.21.15.81:0/4282943644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 msgr2=0x7fe0500cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 --2- 172.21.15.81:0/4282943644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500cde20 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ce860 tx=0x7fe044009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 -- 172.21.15.81:0/4282943644 shutdown_connections 2024-09-13T18:55:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 --2- 172.21.15.81:0/4282943644 >> v2:172.21.15.178:3300/0 conn(0x7fe05006d620 0x7fe05006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 --2- 172.21.15.81:0/4282943644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500cde20 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 -- 172.21.15.81:0/4282943644 >> 172.21.15.81:0/4282943644 conn(0x7fe05006a390 msgr2=0x7fe05006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 -- 172.21.15.81:0/4282943644 shutdown_connections 2024-09-13T18:55:25.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.840+0000 7fe056200700 1 -- 172.21.15.81:0/4282943644 wait complete. 2024-09-13T18:55:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 Processor -- start 2024-09-13T18:55:25.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 -- start start 2024-09-13T18:55:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05006cea0 0x7fe05015b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05006d620 0x7fe0500ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500c4630 con 0x7fe050143b70 2024-09-13T18:55:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05015b670 con 0x7fe05006cea0 2024-09-13T18:55:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe056200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500c3a20 con 0x7fe05006d620 2024-09-13T18:55:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44174/0 (socket says 172.21.15.81:44174) 2024-09-13T18:55:25.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 -- 172.21.15.81:0/1671928622 learned_addr learned my addr 172.21.15.81:0/1671928622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe054e00700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05006cea0 0x7fe05015b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe04fe00700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05006d620 0x7fe0500ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 -- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05006d620 msgr2=0x7fe0500ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05006d620 0x7fe0500ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 -- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05006cea0 msgr2=0x7fe05015b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05006cea0 0x7fe05015b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.844+0000 7fe055800700 1 -- 172.21.15.81:0/1671928622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe044009570 con 0x7fe050143b70 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe04fe00700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05006d620 0x7fe0500ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe055800700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500ad5f0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe04800cca0 tx=0x7fe04800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe04cc00700 1 -- 172.21.15.81:0/1671928622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04800ac20 con 0x7fe050143b70 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe04cc00700 1 -- 172.21.15.81:0/1671928622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04800ad80 con 0x7fe050143b70 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe04cc00700 1 -- 172.21.15.81:0/1671928622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048007310 con 0x7fe050143b70 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0500c3d00 con 0x7fe050143b70 2024-09-13T18:55:25.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.848+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0500c42c0 con 0x7fe050143b70 2024-09-13T18:55:25.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe04cc00700 1 -- 172.21.15.81:0/1671928622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe048007470 con 0x7fe050143b70 2024-09-13T18:55:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe04cc00700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe030066730 0x7fe030068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe04cc00700 1 -- 172.21.15.81:0/1671928622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe048083ec0 con 0x7fe050143b70 2024-09-13T18:55:25.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe054e00700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe030066730 0x7fe030068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe05ac68740 1 Processor -- start 2024-09-13T18:55:25.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe05ac68740 1 -- start start 2024-09-13T18:55:25.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.852+0000 7fe054e00700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe030066730 0x7fe030068bf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe044014040 tx=0x7fe044008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x68dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6905520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6927550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe05ac68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x686e010 con 0x68dc310 2024-09-13T18:55:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x67fbf40 con 0x6926d90 2024-09-13T18:55:25.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x684ee30 con 0x6927170 2024-09-13T18:55:25.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6905520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6905520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44178/0 (socket says 172.21.15.81:44178) 2024-09-13T18:55:25.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 -- 172.21.15.81:0/2046759087 learned_addr learned my addr 172.21.15.81:0/2046759087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe054e00700 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x68dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe055800700 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6927550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 -- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 msgr2=0x6927550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6927550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 -- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 msgr2=0x68dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x68dd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 -- 172.21.15.81:0/2046759087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x66baa40 con 0x68dc310 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe04fe00700 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6905520 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00ab80 tx=0x7fe03c00ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5314111748c80ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe041600700 1 -- 172.21.15.81:0/2046759087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c004030 con 0x68dc310 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe041600700 1 -- 172.21.15.81:0/2046759087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00c050 con 0x68dc310 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.856+0000 7fe041600700 1 -- 172.21.15.81:0/2046759087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0043d0 con 0x68dc310 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 -- 172.21.15.81:0/2046759087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 msgr2=0x6905520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6905520 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00ab80 tx=0x7fe03c00ae90 comp rx=0 tx=0).stop 2024-09-13T18:55:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 -- 172.21.15.81:0/2046759087 shutdown_connections 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6927550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6905520 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 --2- 172.21.15.81:0/2046759087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x68dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 -- 172.21.15.81:0/2046759087 >> 172.21.15.81:0/2046759087 conn(0x666f5b0 msgr2=0x68e0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 -- 172.21.15.81:0/2046759087 shutdown_connections 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 -- 172.21.15.81:0/2046759087 wait complete. 2024-09-13T18:55:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 -- start start 2024-09-13T18:55:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.860+0000 7fe05ac68740 1 Processor -- start 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6925800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6903f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x684a150 con 0x68dc310 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x6847eb0 con 0x6926d90 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x68058e0 con 0x6927170 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 10 client.0 _ll_register_callbacks cb 0x67e4670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6925800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6925800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44186/0 (socket says 172.21.15.81:44186) 2024-09-13T18:55:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 -- 172.21.15.81:0/116323201 learned_addr learned my addr 172.21.15.81:0/116323201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe04fe00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe055800700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6903f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 -- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 msgr2=0x6903f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6903f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 -- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 msgr2=0x69039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 -- 172.21.15.81:0/116323201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c00a7e0 con 0x68dc310 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe055800700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6903f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe04fe00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe054e00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6925800 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe04400b0e0 tx=0x7fe04400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3196d73c89521f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe036000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe036000700 1 -- 172.21.15.81:0/116323201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04402d040 con 0x68dc310 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe036000700 1 -- 172.21.15.81:0/116323201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe044033c40 con 0x68dc310 2024-09-13T18:55:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x667c2c0 con 0x68dc310 2024-09-13T18:55:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe036000700 1 -- 172.21.15.81:0/116323201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe04401f070 con 0x68dc310 2024-09-13T18:55:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 10 client.9444 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:25.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x680e290 con 0x68dc310 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe036000700 1 -- 172.21.15.81:0/116323201 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x667c2c0 con 0x68dc310 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe036000700 1 -- 172.21.15.81:0/116323201 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe044032430 con 0x68dc310 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 10 client.9444 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 10 client.9444 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 20 client.9444 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x68ff2f0 0x68ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 4 client.9444 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.864+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x66c6540 con 0x68ff2f0 2024-09-13T18:55:25.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.868+0000 7fe04fe00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x68ff2f0 0x68ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.868+0000 7fe036000700 10 client.9444 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:25.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.868+0000 7fe04fe00700 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x68ff2f0 0x68ff700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b31a7335ce9cb484 server_cookie=427f8725fb06cdcb in_seq=0 out_seq=0 2024-09-13T18:55:25.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.868+0000 7fe036000700 1 -- 172.21.15.81:0/116323201 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x66c6540 con 0x68ff2f0 2024-09-13T18:55:25.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.868+0000 7fe036000700 10 client.9444 handle_command_reply: tid=0 2024-09-13T18:55:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.868+0000 7fe05ac68740 1 client.9444 shutdown 2024-09-13T18:55:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 msgr2=0x6925800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6925800 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fe04400b0e0 tx=0x7fe04400e000 comp rx=0 tx=0).stop 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 shutdown_connections 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x68ff2f0 0x68ff700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6903f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 --2- 172.21.15.81:0/116323201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x6925800 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 >> 172.21.15.81:0/116323201 conn(0x666f5b0 msgr2=0x69054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe036000700 0 client.9444 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 shutdown_connections 2024-09-13T18:55:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 1 -- 172.21.15.81:0/116323201 wait complete. 2024-09-13T18:55:25.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.872+0000 7fe05ac68740 20 client.9444 trim_cache size 0 max 16384 2024-09-13T18:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.892+0000 7fe05ac68740 1 Processor -- start 2024-09-13T18:55:25.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.892+0000 7fe05ac68740 1 -- start start 2024-09-13T18:55:25.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x68dc310 0x68dd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 0x68dd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x693a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe05ac68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x66f3b80 con 0x6926d90 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x67d1a50 con 0x68dc310 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x6818c00 con 0x6927170 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 0x68dd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 0x68dd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44200/0 (socket says 172.21.15.81:44200) 2024-09-13T18:55:25.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 -- 172.21.15.81:0/31691043 learned_addr learned my addr 172.21.15.81:0/31691043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe054e00700 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x68dc310 0x68dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe055800700 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x693a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 -- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 msgr2=0x693a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x693a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 -- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x68dc310 msgr2=0x68dd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x68dc310 0x68dd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 -- 172.21.15.81:0/31691043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x68e18d0 con 0x6926d90 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe054e00700 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x68dc310 0x68dd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe04fe00700 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 0x68dd5b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x6818fa0 tx=0x7fe03c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55cc9dc4821aaff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe042000700 1 -- 172.21.15.81:0/31691043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00ee70 con 0x6926d90 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe042000700 1 -- 172.21.15.81:0/31691043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00e930 con 0x6926d90 2024-09-13T18:55:25.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.896+0000 7fe042000700 1 -- 172.21.15.81:0/31691043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c025d70 con 0x6926d90 2024-09-13T18:55:25.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 -- 172.21.15.81:0/31691043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 msgr2=0x68dd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 0x68dd5b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x6818fa0 tx=0x7fe03c014000 comp rx=0 tx=0).stop 2024-09-13T18:55:25.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 -- 172.21.15.81:0/31691043 shutdown_connections 2024-09-13T18:55:25.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x693a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x6926d90 0x68dd5b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 --2- 172.21.15.81:0/31691043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x68dc310 0x68dd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 -- 172.21.15.81:0/31691043 >> 172.21.15.81:0/31691043 conn(0x666f5b0 msgr2=0x69368d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 -- 172.21.15.81:0/31691043 shutdown_connections 2024-09-13T18:55:25.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 -- 172.21.15.81:0/31691043 wait complete. 2024-09-13T18:55:25.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 -- start start 2024-09-13T18:55:25.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.900+0000 7fe05ac68740 1 Processor -- start 2024-09-13T18:55:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x693d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69901e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6990720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x68456c0 con 0x68dc310 2024-09-13T18:55:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x694ec10 con 0x6926d90 2024-09-13T18:55:25.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x693e080 con 0x6927170 2024-09-13T18:55:25.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 10 client.0 _ll_register_callbacks cb 0x6846610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x693d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x693d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44206/0 (socket says 172.21.15.81:44206) 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 -- 172.21.15.81:0/479060059 learned_addr learned my addr 172.21.15.81:0/479060059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe04fe00700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe055800700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6990720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 -- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 msgr2=0x6990720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6990720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 -- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 msgr2=0x69901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69901e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 -- 172.21.15.81:0/479060059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x66baa40 con 0x68dc310 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe054e00700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x693d6a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fe04400bdb0 tx=0x7fe0440047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05f3737f4cb046a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe036000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe036000700 1 -- 172.21.15.81:0/479060059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04402d040 con 0x68dc310 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe036000700 1 -- 172.21.15.81:0/479060059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe044032dd0 con 0x68dc310 2024-09-13T18:55:25.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe03c00c050 con 0x68dc310 2024-09-13T18:55:25.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe036000700 1 -- 172.21.15.81:0/479060059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe044011420 con 0x68dc310 2024-09-13T18:55:25.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 10 client.9450 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:25.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.904+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x67f44c0 con 0x68dc310 2024-09-13T18:55:25.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe036000700 1 -- 172.21.15.81:0/479060059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00c050 con 0x68dc310 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe036000700 1 -- 172.21.15.81:0/479060059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7fe044011580 con 0x68dc310 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 10 client.9450 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 10 client.9450 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 20 client.9450 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x693dbe0 0x694c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 4 client.9450 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x66eb2c0 con 0x693dbe0 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe04fe00700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x693dbe0 0x694c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:25.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe036000700 10 client.9450 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:25.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe04fe00700 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x693dbe0 0x694c570 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0cbd9ebab73e73c server_cookie=1cbf8264cf15bf56 in_seq=0 out_seq=0 2024-09-13T18:55:25.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe036000700 1 -- 172.21.15.81:0/479060059 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x66eb2c0 con 0x693dbe0 2024-09-13T18:55:25.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe036000700 10 client.9450 handle_command_reply: tid=0 2024-09-13T18:55:25.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 client.9450 shutdown 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 msgr2=0x693d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x693d6a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fe04400bdb0 tx=0x7fe0440047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 shutdown_connections 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0x693dbe0 0x694c570 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x6927170 0x6990720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x6926d90 0x69901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe036000700 0 client.9450 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 --2- 172.21.15.81:0/479060059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x68dc310 0x693d6a0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 >> 172.21.15.81:0/479060059 conn(0x666f5b0 msgr2=0x68dd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 shutdown_connections 2024-09-13T18:55:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.908+0000 7fe05ac68740 1 -- 172.21.15.81:0/479060059 wait complete. 2024-09-13T18:55:25.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe05ac68740 20 client.9450 trim_cache size 0 max 16384 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:25.920 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe030066730 msgr2=0x7fe030068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe030066730 0x7fe030068bf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe044014040 tx=0x7fe044008030 comp rx=0 tx=0).stop 2024-09-13T18:55:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 msgr2=0x7fe0500ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500ad5f0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fe04800cca0 tx=0x7fe04800a060 comp rx=0 tx=0).stop 2024-09-13T18:55:25.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 shutdown_connections 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe030066730 0x7fe030068bf0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe050143b70 0x7fe0500ad5f0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe05006d620 0x7fe0500ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 --2- 172.21.15.81:0/1671928622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe05006cea0 0x7fe05015b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 >> 172.21.15.81:0/1671928622 conn(0x7fe05006a390 msgr2=0x7fe0500cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 shutdown_connections 2024-09-13T18:55:25.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:25.912+0000 7fe056200700 1 -- 172.21.15.81:0/1671928622 wait complete. 2024-09-13T18:55:25.943 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:25.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-13T18:55:26.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.116+0000 7f1976a00700 1 Processor -- start 2024-09-13T18:55:26.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.116+0000 7f1976a00700 1 -- start start 2024-09-13T18:55:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1976a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006d620 0x7f197006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1976a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19700b1980 con 0x7f197006cea0 2024-09-13T18:55:26.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1976a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19700b2500 con 0x7f1970143b70 2024-09-13T18:55:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1976a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f197006d2f0 con 0x7f197006d620 2024-09-13T18:55:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1976000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f197006cea0 0x7f19700b2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41376/0 (socket says 172.21.15.81:41376) 2024-09-13T18:55:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1976000700 1 -- 172.21.15.81:0/2324600393 learned_addr learned my addr 172.21.15.81:0/2324600393 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:26.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1974c00700 1 --2- 172.21.15.81:0/2324600393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006d620 0x7f197006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241795075 0 0) 0x7f19700b1980 con 0x7f197006cea0 2024-09-13T18:55:26.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19580035d0 con 0x7f197006cea0 2024-09-13T18:55:26.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159834946 0 0) 0x7f19700b2500 con 0x7f1970143b70 2024-09-13T18:55:26.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19700b1980 con 0x7f1970143b70 2024-09-13T18:55:26.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1974c00700 1 -- 172.21.15.81:0/2324600393 >> v1:172.21.15.178:6789/0 conn(0x7f1970143b70 legacy=0x7f19700cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1974c00700 1 -- 172.21.15.81:0/2324600393 >> v1:172.21.15.81:6789/0 conn(0x7f197006cea0 legacy=0x7f19700b2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1974c00700 1 -- 172.21.15.81:0/2324600393 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700b1bd0 con 0x7f197006d620 2024-09-13T18:55:26.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.120+0000 7f1974c00700 1 --2- 172.21.15.81:0/2324600393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006d620 0x7f197006c960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f195c009880 tx=0x7f195c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ab0886ded0a499 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c011830 con 0x7f197006d620 2024-09-13T18:55:26.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c011990 con 0x7f197006d620 2024-09-13T18:55:26.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f196fe00700 1 -- 172.21.15.81:0/2324600393 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c011d20 con 0x7f197006d620 2024-09-13T18:55:26.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 -- 172.21.15.81:0/2324600393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006d620 msgr2=0x7f197006c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 --2- 172.21.15.81:0/2324600393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006d620 0x7f197006c960 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f195c009880 tx=0x7f195c009b90 comp rx=0 tx=0).stop 2024-09-13T18:55:26.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 -- 172.21.15.81:0/2324600393 shutdown_connections 2024-09-13T18:55:26.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 --2- 172.21.15.81:0/2324600393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006d620 0x7f197006c960 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 -- 172.21.15.81:0/2324600393 >> 172.21.15.81:0/2324600393 conn(0x7f197006a390 msgr2=0x7f197006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 -- 172.21.15.81:0/2324600393 shutdown_connections 2024-09-13T18:55:26.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.124+0000 7f1976a00700 1 -- 172.21.15.81:0/2324600393 wait complete. 2024-09-13T18:55:26.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 Processor -- start 2024-09-13T18:55:26.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 -- start start 2024-09-13T18:55:26.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006cea0 0x7f1970071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f197006d620 0x7f197006fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 0x7f1970135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970071090 con 0x7f1970143b70 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700701e0 con 0x7f197006d620 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1970070410 con 0x7f197006cea0 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 0x7f1970135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 0x7f1970135db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44216/0 (socket says 172.21.15.81:44216) 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 -- 172.21.15.81:0/3421770444 learned_addr learned my addr 172.21.15.81:0/3421770444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1974c00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f197006d620 0x7f197006fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1975600700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006cea0 0x7f1970071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 -- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006cea0 msgr2=0x7f1970071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006cea0 0x7f1970071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 -- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f197006d620 msgr2=0x7f197006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f197006d620 0x7f197006fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 -- 172.21.15.81:0/3421770444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0094b0 con 0x7f1970143b70 2024-09-13T18:55:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976000700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 0x7f1970135db0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f196800cba0 tx=0x7f196800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f196d600700 1 -- 172.21.15.81:0/3421770444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968007480 con 0x7f1970143b70 2024-09-13T18:55:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f196d600700 1 -- 172.21.15.81:0/3421770444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19680075e0 con 0x7f1970143b70 2024-09-13T18:55:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19700706f0 con 0x7f1970143b70 2024-09-13T18:55:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.128+0000 7f196d600700 1 -- 172.21.15.81:0/3421770444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968007970 con 0x7f1970143b70 2024-09-13T18:55:26.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.132+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1970070cb0 con 0x7f1970143b70 2024-09-13T18:55:26.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.132+0000 7f196d600700 1 -- 172.21.15.81:0/3421770444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f196801b3b0 con 0x7f1970143b70 2024-09-13T18:55:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 Processor -- start 2024-09-13T18:55:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 -- start start 2024-09-13T18:55:26.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f196d600700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950066730 0x7f1950068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f196d600700 1 -- 172.21.15.81:0/3421770444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1968083d80 con 0x7f1970143b70 2024-09-13T18:55:26.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1974c00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950066730 0x7f1950068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb0d90 0x3dd67810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3dd8f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 0x3ddb1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dcf8010 con 0x3dd66310 2024-09-13T18:55:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc85f40 con 0x3ddb0d90 2024-09-13T18:55:26.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dcd8e30 con 0x3ddb1170 2024-09-13T18:55:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1976000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 0x3ddb1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1974c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3dd8f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1976000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 0x3ddb1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:50588/0 (socket says 172.21.15.81:50588) 2024-09-13T18:55:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1976000700 1 -- 172.21.15.81:0/331599632 learned_addr learned my addr 172.21.15.81:0/331599632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1974c00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950066730 0x7f1950068bf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f195c0090b0 tx=0x7f195c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.136+0000 7f1975600700 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb0d90 0x3dd67810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1974c00700 1 -- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 msgr2=0x3ddb1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1974c00700 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 0x3ddb1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1974c00700 1 -- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb0d90 msgr2=0x3dd67810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1974c00700 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb0d90 0x3dd67810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1974c00700 1 -- 172.21.15.81:0/331599632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3db44a40 con 0x3dd66310 2024-09-13T18:55:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1976000700 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 0x3ddb1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1974c00700 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3dd8f520 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f195c015000 tx=0x7f195c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8917ef90e2d674 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1961c00700 1 -- 172.21.15.81:0/331599632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c032070 con 0x3dd66310 2024-09-13T18:55:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1961c00700 1 -- 172.21.15.81:0/331599632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c02a040 con 0x3dd66310 2024-09-13T18:55:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f1961c00700 1 -- 172.21.15.81:0/331599632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c024ac0 con 0x3dd66310 2024-09-13T18:55:26.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 -- 172.21.15.81:0/331599632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 msgr2=0x3dd8f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3dd8f520 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f195c015000 tx=0x7f195c010000 comp rx=0 tx=0).stop 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 -- 172.21.15.81:0/331599632 shutdown_connections 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb1170 0x3ddb1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3dd8f520 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 --2- 172.21.15.81:0/331599632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb0d90 0x3dd67810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 -- 172.21.15.81:0/331599632 >> 172.21.15.81:0/331599632 conn(0x3daf95b0 msgr2=0x3dd6ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 -- 172.21.15.81:0/331599632 shutdown_connections 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 -- 172.21.15.81:0/331599632 wait complete. 2024-09-13T18:55:26.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 -- start start 2024-09-13T18:55:26.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.140+0000 7f197b484740 1 Processor -- start 2024-09-13T18:55:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3ddaf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3dd8a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3dd8d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dcd4150 con 0x3ddb1170 2024-09-13T18:55:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dcd1eb0 con 0x3dd66310 2024-09-13T18:55:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dc8f8e0 con 0x3ddb0d90 2024-09-13T18:55:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 10 client.0 _ll_register_callbacks cb 0x3dc6e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3dd8d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3dd8d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44246/0 (socket says 172.21.15.81:44246) 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 -- 172.21.15.81:0/571024081 learned_addr learned my addr 172.21.15.81:0/571024081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1974c00700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3dd8a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1975600700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3ddaf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 -- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 msgr2=0x3dd8a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3dd8a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 -- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 msgr2=0x3ddaf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3ddaf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 -- 172.21.15.81:0/571024081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1970070cb0 con 0x3ddb1170 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1974c00700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3dd8a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1976000700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3dd8d890 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f196800cb70 tx=0x7f1968055070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36726670c77e2ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1956000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1956000700 1 -- 172.21.15.81:0/571024081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196805cf20 con 0x3ddb1170 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x3db062c0 con 0x3ddb1170 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1956000700 1 -- 172.21.15.81:0/571024081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f196805ca90 con 0x3ddb1170 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1956000700 1 -- 172.21.15.81:0/571024081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f196805cc50 con 0x3ddb1170 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 10 client.9462 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x7f19700b1bd0 con 0x3ddb1170 2024-09-13T18:55:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.144+0000 7f1956000700 1 -- 172.21.15.81:0/571024081 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196807f030 con 0x3ddb1170 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1956000700 1 -- 172.21.15.81:0/571024081 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f1968071200 con 0x3ddb1170 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 10 client.9462 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 10 client.9462 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 20 client.9462 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3dd88d00 0x3dd89110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 4 client.9462 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:26.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3db50540 con 0x3dd88d00 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1975600700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3dd88d00 0x3dd89110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1956000700 10 client.9462 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1975600700 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3dd88d00 0x3dd89110 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff40f25184c9d9ab server_cookie=6a0517f640bd841a in_seq=0 out_seq=0 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1956000700 1 -- 172.21.15.81:0/571024081 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3db50540 con 0x3dd88d00 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1956000700 10 client.9462 handle_command_reply: tid=0 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 client.9462 shutdown 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 msgr2=0x3dd8d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3dd8d890 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f196800cb70 tx=0x7f1968055070 comp rx=0 tx=0).stop 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 shutdown_connections 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3dd88d00 0x3dd89110 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3dd8d890 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f1956000700 0 client.9462 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3dd8a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 --2- 172.21.15.81:0/571024081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3ddaf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 >> 172.21.15.81:0/571024081 conn(0x3daf95b0 msgr2=0x3dd8f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 shutdown_connections 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 1 -- 172.21.15.81:0/571024081 wait complete. 2024-09-13T18:55:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.148+0000 7f197b484740 20 client.9462 trim_cache size 0 max 16384 2024-09-13T18:55:26.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 Processor -- start 2024-09-13T18:55:26.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 -- start start 2024-09-13T18:55:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3dd8a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3ddb87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3ddb8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3db7db80 con 0x3ddb1170 2024-09-13T18:55:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dc5ba50 con 0x3dd66310 2024-09-13T18:55:26.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.168+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3dc70620 con 0x3ddb0d90 2024-09-13T18:55:26.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3ddb8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3ddb8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44248/0 (socket says 172.21.15.81:44248) 2024-09-13T18:55:26.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 -- 172.21.15.81:0/2515768126 learned_addr learned my addr 172.21.15.81:0/2515768126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1975600700 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3dd8a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 -- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 msgr2=0x3ddb87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3ddb87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 -- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 msgr2=0x3dd8a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3dd8a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 -- 172.21.15.81:0/2515768126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3dc98290 con 0x3ddb1170 2024-09-13T18:55:26.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1976000700 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3ddb8d20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f19680012e0 tx=0x7f1968056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600bf0d95fb4547d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1962600700 1 -- 172.21.15.81:0/2515768126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968050e70 con 0x3ddb1170 2024-09-13T18:55:26.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1962600700 1 -- 172.21.15.81:0/2515768126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196807f070 con 0x3ddb1170 2024-09-13T18:55:26.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f1962600700 1 -- 172.21.15.81:0/2515768126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196805cf20 con 0x3ddb1170 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 -- 172.21.15.81:0/2515768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 msgr2=0x3ddb8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3ddb8d20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f19680012e0 tx=0x7f1968056000 comp rx=0 tx=0).stop 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 -- 172.21.15.81:0/2515768126 shutdown_connections 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3ddb1170 0x3ddb8d20 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3ddb87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 --2- 172.21.15.81:0/2515768126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3dd66310 0x3dd8a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 -- 172.21.15.81:0/2515768126 >> 172.21.15.81:0/2515768126 conn(0x3daf95b0 msgr2=0x3ddc0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 -- 172.21.15.81:0/2515768126 shutdown_connections 2024-09-13T18:55:26.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.172+0000 7f197b484740 1 -- 172.21.15.81:0/2515768126 wait complete. 2024-09-13T18:55:26.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 -- start start 2024-09-13T18:55:26.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 Processor -- start 2024-09-13T18:55:26.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3de11ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3de12730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb1170 0x3de12c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3dccf6c0 con 0x3dd66310 2024-09-13T18:55:26.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3ddc91c0 con 0x3ddb1170 2024-09-13T18:55:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x3ddc0d70 con 0x3ddb0d90 2024-09-13T18:55:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f197b484740 10 client.0 _ll_register_callbacks cb 0x3dcd0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3de11ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3de11ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44252/0 (socket says 172.21.15.81:44252) 2024-09-13T18:55:26.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 -- 172.21.15.81:0/1794760409 learned_addr learned my addr 172.21.15.81:0/1794760409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 -- 172.21.15.81:0/1794760409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 msgr2=0x3de12730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3de12730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 -- 172.21.15.81:0/1794760409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb1170 msgr2=0x3de12c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb1170 0x3de12c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 -- 172.21.15.81:0/1794760409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19700b1bd0 con 0x3dd66310 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1975600700 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3de11ca0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x3dd8f170 tx=0x7f1964004e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17391b20ef98a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.176+0000 7f1956000700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 1 -- 172.21.15.81:0/1794760409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196401f070 con 0x3dd66310 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 1 -- 172.21.15.81:0/1794760409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f196401a7d0 con 0x3dd66310 2024-09-13T18:55:26.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f195c02a040 con 0x3dd66310 2024-09-13T18:55:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 1 -- 172.21.15.81:0/1794760409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1964018440 con 0x3dd66310 2024-09-13T18:55:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 10 client.9468 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x3dc7e4c0 con 0x3dd66310 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 1 -- 172.21.15.81:0/1794760409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c02a040 con 0x3dd66310 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 1 -- 172.21.15.81:0/1794760409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f19640185a0 con 0x3dd66310 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 10 client.9468 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 10 client.9468 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 20 client.9468 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3ddb9150 0x3de131b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 4 client.9468 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x3db752c0 con 0x3ddb9150 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1974c00700 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3ddb9150 0x3de131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1974c00700 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3ddb9150 0x3de131b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ef37c0ecadf53cd server_cookie=6d2bbc0eefe1c190 in_seq=0 out_seq=0 2024-09-13T18:55:26.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 10 client.9468 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 1 -- 172.21.15.81:0/1794760409 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x3db752c0 con 0x3ddb9150 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 10 client.9468 handle_command_reply: tid=0 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 client.9468 shutdown 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 msgr2=0x3de11ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3de11ca0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x3dd8f170 tx=0x7f1964004e40 comp rx=0 tx=0).stop 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 shutdown_connections 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x3ddb9150 0x3de131b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x3ddb1170 0x3de12c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f1956000700 0 client.9468 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x3ddb0d90 0x3de12730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 --2- 172.21.15.81:0/1794760409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x3dd66310 0x3de11ca0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 >> 172.21.15.81:0/1794760409 conn(0x3daf95b0 msgr2=0x3ddc0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.180+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 shutdown_connections 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f197b484740 1 -- 172.21.15.81:0/1794760409 wait complete. 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f197b484740 20 client.9468 trim_cache size 0 max 16384 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:26.192 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950066730 msgr2=0x7f1950068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950066730 0x7f1950068bf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f195c0090b0 tx=0x7f195c01c040 comp rx=0 tx=0).stop 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 msgr2=0x7f1970135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 0x7f1970135db0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f196800cba0 tx=0x7f196800cbd0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 shutdown_connections 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f1950066730 0x7f1950068bf0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970143b70 0x7f1970135db0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f197006d620 0x7f197006fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 --2- 172.21.15.81:0/3421770444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f197006cea0 0x7f1970071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 >> 172.21.15.81:0/3421770444 conn(0x7f197006a390 msgr2=0x7f19700b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 shutdown_connections 2024-09-13T18:55:26.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.184+0000 7f1976a00700 1 -- 172.21.15.81:0/3421770444 wait complete. 2024-09-13T18:55:26.213 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:26.213 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-13T18:55:26.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.376+0000 7f0e25400700 1 Processor -- start 2024-09-13T18:55:26.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.376+0000 7f0e25400700 1 -- start start 2024-09-13T18:55:26.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e25400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e25400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e20161da0 con 0x7f0e200cf930 2024-09-13T18:55:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e25400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e200cef40 con 0x7f0e200cfd10 2024-09-13T18:55:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e25400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200cf220 con 0x7f0e200b4000 2024-09-13T18:55:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e1e800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0e200cf930 0x7f0e20160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41390/0 (socket says 172.21.15.81:41390) 2024-09-13T18:55:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e1e800700 1 -- 172.21.15.81:0/2225257646 learned_addr learned my addr 172.21.15.81:0/2225257646 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2225257646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.380+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266557948 0 0) 0x7f0e20161da0 con 0x7f0e200cf930 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e040035d0 con 0x7f0e200cf930 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696801609 0 0) 0x7f0e200cef40 con 0x7f0e200cfd10 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e20161da0 con 0x7f0e200cfd10 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1f200700 1 -- 172.21.15.81:0/2225257646 >> v1:172.21.15.178:6789/0 conn(0x7f0e200cfd10 legacy=0x7f0e20161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1f200700 1 -- 172.21.15.81:0/2225257646 >> v1:172.21.15.81:6789/0 conn(0x7f0e200cf930 legacy=0x7f0e20160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1f200700 1 -- 172.21.15.81:0/2225257646 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e200d1840 con 0x7f0e200b4000 2024-09-13T18:55:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2225257646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200d0fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009dc0 tx=0x7f0e1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac5d0502ec76b9dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800e070 con 0x7f0e200b4000 2024-09-13T18:55:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1800bae0 con 0x7f0e200b4000 2024-09-13T18:55:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e1d400700 1 -- 172.21.15.81:0/2225257646 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800be90 con 0x7f0e200b4000 2024-09-13T18:55:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 -- 172.21.15.81:0/2225257646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 msgr2=0x7f0e200d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 --2- 172.21.15.81:0/2225257646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200d0fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009dc0 tx=0x7f0e1800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 -- 172.21.15.81:0/2225257646 shutdown_connections 2024-09-13T18:55:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 --2- 172.21.15.81:0/2225257646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200d0fc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 -- 172.21.15.81:0/2225257646 >> 172.21.15.81:0/2225257646 conn(0x7f0e2009c0b0 msgr2=0x7f0e200d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 -- 172.21.15.81:0/2225257646 shutdown_connections 2024-09-13T18:55:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.384+0000 7f0e25400700 1 -- 172.21.15.81:0/2225257646 wait complete. 2024-09-13T18:55:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 Processor -- start 2024-09-13T18:55:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 -- start start 2024-09-13T18:55:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e200cf930 0x7f0e200c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 0x7f0e2015df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b5c50 con 0x7f0e200cfd10 2024-09-13T18:55:26.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200c79b0 con 0x7f0e200cf930 2024-09-13T18:55:26.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e25400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e200b5f10 con 0x7f0e200b4000 2024-09-13T18:55:26.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 0x7f0e2015df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 0x7f0e2015df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44268/0 (socket says 172.21.15.81:44268) 2024-09-13T18:55:26.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 -- 172.21.15.81:0/1133761029 learned_addr learned my addr 172.21.15.81:0/1133761029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1de00700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e200cf930 0x7f0e200c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1e800700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 -- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 msgr2=0x7f0e200b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 -- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e200cf930 msgr2=0x7f0e200c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e200cf930 0x7f0e200c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 -- 172.21.15.81:0/1133761029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18009a70 con 0x7f0e200cfd10 2024-09-13T18:55:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.388+0000 7f0e1f200700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 0x7f0e2015df70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009d90 tx=0x7f0e18004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.392+0000 7f0e16a00700 1 -- 172.21.15.81:0/1133761029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180046b0 con 0x7f0e200cfd10 2024-09-13T18:55:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.392+0000 7f0e16a00700 1 -- 172.21.15.81:0/1133761029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e18004810 con 0x7f0e200cfd10 2024-09-13T18:55:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.392+0000 7f0e16a00700 1 -- 172.21.15.81:0/1133761029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18012650 con 0x7f0e200cfd10 2024-09-13T18:55:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.392+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e200b61f0 con 0x7f0e200cfd10 2024-09-13T18:55:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.392+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200c7610 con 0x7f0e200cfd10 2024-09-13T18:55:26.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.392+0000 7f0e16a00700 1 -- 172.21.15.81:0/1133761029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e180127b0 con 0x7f0e200cfd10 2024-09-13T18:55:26.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.396+0000 7f0e16a00700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e00066730 0x7f0e00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.396+0000 7f0e16a00700 1 -- 172.21.15.81:0/1133761029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e18086090 con 0x7f0e200cfd10 2024-09-13T18:55:26.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.396+0000 7f0e1e800700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e00066730 0x7f0e00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.396+0000 7f0e1e800700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e00066730 0x7f0e00068bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0e100011e0 tx=0x7f0e10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.396+0000 7f0e288b3740 1 Processor -- start 2024-09-13T18:55:26.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.396+0000 7f0e288b3740 1 -- start start 2024-09-13T18:55:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 0x19bdd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19bfed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bb25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b46010 con 0x19bfe950 2024-09-13T18:55:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ad3f40 con 0x19bdcd00 2024-09-13T18:55:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19b26e30 con 0x19bff270 2024-09-13T18:55:26.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 0x19bdd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 0x19bdd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44280/0 (socket says 172.21.15.81:44280) 2024-09-13T18:55:26.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 -- 172.21.15.81:0/2862216026 learned_addr learned my addr 172.21.15.81:0/2862216026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1de00700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19bfed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bb25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 -- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 msgr2=0x19bb25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bb25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 -- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 msgr2=0x19bfed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19bfed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 -- 172.21.15.81:0/2862216026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19992a40 con 0x19bfe950 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1de00700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19bfed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bb25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e1e800700 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 0x19bdd240 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005a00 tx=0x7f0e10011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed0de8dca43604f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e0b000700 1 -- 172.21.15.81:0/2862216026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10001d60 con 0x19bfe950 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e0b000700 1 -- 172.21.15.81:0/2862216026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10007560 con 0x19bfe950 2024-09-13T18:55:26.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e0b000700 1 -- 172.21.15.81:0/2862216026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10004890 con 0x19bfe950 2024-09-13T18:55:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- 172.21.15.81:0/2862216026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 msgr2=0x19bdd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 0x19bdd240 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f0e10005a00 tx=0x7f0e10011000 comp rx=0 tx=0).stop 2024-09-13T18:55:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- 172.21.15.81:0/2862216026 shutdown_connections 2024-09-13T18:55:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bb25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19bfed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2862216026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bfe950 0x19bdd240 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- 172.21.15.81:0/2862216026 >> 172.21.15.81:0/2862216026 conn(0x199475b0 msgr2=0x19bb89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- 172.21.15.81:0/2862216026 shutdown_connections 2024-09-13T18:55:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.400+0000 7f0e288b3740 1 -- 172.21.15.81:0/2862216026 wait complete. 2024-09-13T18:55:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 -- start start 2024-09-13T18:55:26.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 Processor -- start 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 0x19bc5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bc7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bddca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b22150 con 0x19bdcd00 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b1feb0 con 0x19bfe950 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19add8e0 con 0x19bff270 2024-09-13T18:55:26.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e288b3740 10 client.0 _ll_register_callbacks cb 0x19abc670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 0x19bc5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 0x19bc5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44290/0 (socket says 172.21.15.81:44290) 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 -- 172.21.15.81:0/1015061884 learned_addr learned my addr 172.21.15.81:0/1015061884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1f200700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1de00700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bc7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 -- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 msgr2=0x19bddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bddca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 -- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 msgr2=0x19bc7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bc7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1e800700 1 -- 172.21.15.81:0/1015061884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1000f040 con 0x19bdcd00 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.404+0000 7f0e1de00700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bc7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e1e800700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 0x19bc5c20 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f0e10008fd0 tx=0x7f0e10000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7473cd7d6ba25e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 1 -- 172.21.15.81:0/1015061884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10028070 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 1 -- 172.21.15.81:0/1015061884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e10004d10 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x199542c0 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 1 -- 172.21.15.81:0/1015061884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e10005030 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 10 client.9480 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x19ae6290 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 1 -- 172.21.15.81:0/1015061884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x199542c0 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 1 -- 172.21.15.81:0/1015061884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f0e1001f030 con 0x19bdcd00 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 10 client.9480 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 10 client.9480 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 20 client.9480 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19bfa760 0x19bc7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 4 client.9480 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1999e540 con 0x19bfa760 2024-09-13T18:55:26.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e1de00700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19bfa760 0x19bc7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0dff400700 10 client.9480 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.408+0000 7f0e1de00700 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19bfa760 0x19bc7e80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d0461edc1628f38 server_cookie=945c40d997dc6f18 in_seq=0 out_seq=0 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0dff400700 1 -- 172.21.15.81:0/1015061884 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1999e540 con 0x19bfa760 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0dff400700 10 client.9480 handle_command_reply: tid=0 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 client.9480 shutdown 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 msgr2=0x19bc5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 0x19bc5c20 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f0e10008fd0 tx=0x7f0e10000ed0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 shutdown_connections 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bff270 0x19bddca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19bfa760 0x19bc7e80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bc7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 --2- 172.21.15.81:0/1015061884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bdcd00 0x19bc5c20 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0dff400700 0 client.9480 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 >> 172.21.15.81:0/1015061884 conn(0x199475b0 msgr2=0x19bb3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 shutdown_connections 2024-09-13T18:55:26.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 1 -- 172.21.15.81:0/1015061884 wait complete. 2024-09-13T18:55:26.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.412+0000 7f0e288b3740 20 client.9480 trim_cache size 0 max 16384 2024-09-13T18:55:26.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 Processor -- start 2024-09-13T18:55:26.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 -- start start 2024-09-13T18:55:26.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bdcd00 0x19c575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bdd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19bdd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x199cbb80 con 0x19bff270 2024-09-13T18:55:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19aa9a50 con 0x19bfe950 2024-09-13T18:55:26.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19b47610 con 0x19bdcd00 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19bdd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19bdd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44302/0 (socket says 172.21.15.81:44302) 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 -- 172.21.15.81:0/2998975527 learned_addr learned my addr 172.21.15.81:0/2998975527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 -- 172.21.15.81:0/2998975527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bdcd00 msgr2=0x19c575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bdcd00 0x19c575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 -- 172.21.15.81:0/2998975527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 msgr2=0x19bdd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bdd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.436+0000 7f0e1f200700 1 -- 172.21.15.81:0/2998975527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19acc4c0 con 0x19bff270 2024-09-13T18:55:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e1f200700 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19bdd620 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f0e18053400 tx=0x7f0e1805d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e54ebe67944edf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e0ba00700 1 -- 172.21.15.81:0/2998975527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1805ad80 con 0x19bff270 2024-09-13T18:55:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e0ba00700 1 -- 172.21.15.81:0/2998975527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1805f340 con 0x19bff270 2024-09-13T18:55:26.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e0ba00700 1 -- 172.21.15.81:0/2998975527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18053660 con 0x19bff270 2024-09-13T18:55:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- 172.21.15.81:0/2998975527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 msgr2=0x19bdd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19bdd620 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f0e18053400 tx=0x7f0e1805d050 comp rx=0 tx=0).stop 2024-09-13T18:55:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- 172.21.15.81:0/2998975527 shutdown_connections 2024-09-13T18:55:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19bdd620 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bfe950 0x19bdd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- 172.21.15.81:0/2998975527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bdcd00 0x19c575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- 172.21.15.81:0/2998975527 >> 172.21.15.81:0/2998975527 conn(0x199475b0 msgr2=0x19be0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- 172.21.15.81:0/2998975527 shutdown_connections 2024-09-13T18:55:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- 172.21.15.81:0/2998975527 wait complete. 2024-09-13T18:55:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- start start 2024-09-13T18:55:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 Processor -- start 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19c640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bfe950 0x19c645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19c61020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ae7590 con 0x19bff270 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b1d6c0 con 0x19bdcd00 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19af0c00 con 0x19bfe950 2024-09-13T18:55:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.440+0000 7f0e288b3740 10 client.0 _ll_register_callbacks cb 0x19aef8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19c61020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19c61020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44306/0 (socket says 172.21.15.81:44306) 2024-09-13T18:55:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 -- 172.21.15.81:0/3769649977 learned_addr learned my addr 172.21.15.81:0/3769649977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1e800700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19c640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1de00700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bfe950 0x19c645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 -- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bfe950 msgr2=0x19c645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bfe950 0x19c645f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 -- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 msgr2=0x19c640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19c640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 -- 172.21.15.81:0/3769649977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e200c7610 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1f200700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19c61020 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f0e18056c50 tx=0x7f0e18009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25c0f850a9145c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0dff400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0dff400700 1 -- 172.21.15.81:0/3769649977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1805ad80 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0dff400700 1 -- 172.21.15.81:0/3769649977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e180571b0 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e10007560 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0dff400700 1 -- 172.21.15.81:0/3769649977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e18057370 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 10 client.9486 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x19ac0790 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0dff400700 1 -- 172.21.15.81:0/3769649977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10007560 con 0x19bff270 2024-09-13T18:55:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0dff400700 1 -- 172.21.15.81:0/3769649977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f0e18077020 con 0x19bff270 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 10 client.9486 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 10 client.9486 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 20 client.9486 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19c61560 0x19c61970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 4 client.9486 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x199c32c0 con 0x19c61560 2024-09-13T18:55:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.444+0000 7f0e1e800700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19c61560 0x19c61970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e1e800700 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19c61560 0x19c61970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fad9355ba925d7a server_cookie=ebdc8c3089811b97 in_seq=0 out_seq=0 2024-09-13T18:55:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0dff400700 10 client.9486 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:26.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0dff400700 1 -- 172.21.15.81:0/3769649977 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x199c32c0 con 0x19c61560 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0dff400700 10 client.9486 handle_command_reply: tid=0 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 client.9486 shutdown 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 msgr2=0x19c61020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19c61020 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f0e18056c50 tx=0x7f0e18009750 comp rx=0 tx=0).stop 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 shutdown_connections 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x19bff270 0x19c61020 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19bfe950 0x19c645f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x19c61560 0x19c61970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 --2- 172.21.15.81:0/3769649977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19bdcd00 0x19c640b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 >> 172.21.15.81:0/3769649977 conn(0x199475b0 msgr2=0x19be0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0dff400700 0 client.9486 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:26.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 shutdown_connections 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 1 -- 172.21.15.81:0/3769649977 wait complete. 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e288b3740 20 client.9486 trim_cache size 0 max 16384 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:26.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:26.459 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:26.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:26.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:26.459 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e00066730 msgr2=0x7f0e00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e00066730 0x7f0e00068bf0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f0e100011e0 tx=0x7f0e10009040 comp rx=0 tx=0).stop 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 msgr2=0x7f0e2015df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 0x7f0e2015df70 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009d90 tx=0x7f0e18004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 shutdown_connections 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0e00066730 0x7f0e00068bf0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e200cfd10 0x7f0e2015df70 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e200cf930 0x7f0e200c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 --2- 172.21.15.81:0/1133761029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e200b4000 0x7f0e200b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 >> 172.21.15.81:0/1133761029 conn(0x7f0e2009c0b0 msgr2=0x7f0e2006bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 shutdown_connections 2024-09-13T18:55:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.448+0000 7f0e25400700 1 -- 172.21.15.81:0/1133761029 wait complete. 2024-09-13T18:55:26.478 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:26.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-13T18:55:26.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.648+0000 7f51a7200700 1 Processor -- start 2024-09-13T18:55:26.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.648+0000 7f51a7200700 1 -- start start 2024-09-13T18:55:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f51a815a7b0 0x7f51a815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a80cba40 0x7f51a80cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a7200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a815dc70 con 0x7f51a8161450 2024-09-13T18:55:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a7200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a815e230 con 0x7f51a815a7b0 2024-09-13T18:55:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80cc3d0 con 0x7f51a80cba40 2024-09-13T18:55:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f51a8161450 0x7f51a80cdeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59534/0 (socket says 172.21.15.81:59534) 2024-09-13T18:55:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5400700 1 -- 172.21.15.81:0/3963931910 learned_addr learned my addr 172.21.15.81:0/3963931910 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:26.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5e00700 1 --2- 172.21.15.81:0/3963931910 >> v2:172.21.15.81:3300/0 conn(0x7f51a815a7b0 0x7f51a815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a6800700 1 --2- 172.21.15.81:0/3963931910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a80cba40 0x7f51a80cbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a4a00700 1 -- 172.21.15.81:0/3963931910 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821793873 0 0) 0x7f51a815dc70 con 0x7f51a8161450 2024-09-13T18:55:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5e00700 1 -- 172.21.15.81:0/3963931910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a80cba40 msgr2=0x7f51a80cbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5e00700 1 --2- 172.21.15.81:0/3963931910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a80cba40 0x7f51a80cbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5e00700 1 -- 172.21.15.81:0/3963931910 >> v1:172.21.15.81:6789/0 conn(0x7f51a8161450 legacy=0x7f51a80cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5e00700 1 -- 172.21.15.81:0/3963931910 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a815df50 con 0x7f51a815a7b0 2024-09-13T18:55:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a5e00700 1 --2- 172.21.15.81:0/3963931910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a815a7b0 0x7f51a815d2d0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f5198009850 tx=0x7f5198009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a80fc34aa6a984 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a4a00700 1 -- 172.21.15.81:0/3963931910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198011830 con 0x7f51a815a7b0 2024-09-13T18:55:26.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a4a00700 1 -- 172.21.15.81:0/3963931910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198011990 con 0x7f51a815a7b0 2024-09-13T18:55:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.652+0000 7f51a4a00700 1 -- 172.21.15.81:0/3963931910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198011d40 con 0x7f51a815a7b0 2024-09-13T18:55:26.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 -- 172.21.15.81:0/3963931910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a815a7b0 msgr2=0x7f51a815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 --2- 172.21.15.81:0/3963931910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a815a7b0 0x7f51a815d2d0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f5198009850 tx=0x7f5198009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 -- 172.21.15.81:0/3963931910 shutdown_connections 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 --2- 172.21.15.81:0/3963931910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a80cba40 0x7f51a80cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 --2- 172.21.15.81:0/3963931910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a815a7b0 0x7f51a815d2d0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 -- 172.21.15.81:0/3963931910 >> 172.21.15.81:0/3963931910 conn(0x7f51a806a390 msgr2=0x7f51a806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 -- 172.21.15.81:0/3963931910 shutdown_connections 2024-09-13T18:55:26.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 -- 172.21.15.81:0/3963931910 wait complete. 2024-09-13T18:55:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 Processor -- start 2024-09-13T18:55:26.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.656+0000 7f51a7200700 1 -- start start 2024-09-13T18:55:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a7200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a80cba40 0x7f51a8153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a7200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a815a7b0 0x7f51a81552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 0x7f51a80affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a7200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8154270 con 0x7f51a8161450 2024-09-13T18:55:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a7200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8158120 con 0x7f51a80cba40 2024-09-13T18:55:26.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a7200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8154510 con 0x7f51a815a7b0 2024-09-13T18:55:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 0x7f51a80affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 0x7f51a80affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41172/0 (socket says 172.21.15.81:41172) 2024-09-13T18:55:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 -- 172.21.15.81:0/1542978807 learned_addr learned my addr 172.21.15.81:0/1542978807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a5e00700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a80cba40 0x7f51a8153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a5400700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a815a7b0 0x7f51a81552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 -- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a815a7b0 msgr2=0x7f51a81552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a815a7b0 0x7f51a81552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 -- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a80cba40 msgr2=0x7f51a8153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a80cba40 0x7f51a8153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 -- 172.21.15.81:0/1542978807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980094b0 con 0x7f51a8161450 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.660+0000 7f51a6800700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 0x7f51a80affe0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f51a000efc0 tx=0x7f51a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.664+0000 7f519e000700 1 -- 172.21.15.81:0/1542978807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0009ea0 con 0x7f51a8161450 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.664+0000 7f519e000700 1 -- 172.21.15.81:0/1542978807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a000f040 con 0x7f51a8161450 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.664+0000 7f519e000700 1 -- 172.21.15.81:0/1542978807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a000ced0 con 0x7f51a8161450 2024-09-13T18:55:26.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.664+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a81547f0 con 0x7f51a8161450 2024-09-13T18:55:26.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.664+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a8154db0 con 0x7f51a8161450 2024-09-13T18:55:26.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.664+0000 7f519e000700 1 -- 172.21.15.81:0/1542978807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51a0014480 con 0x7f51a8161450 2024-09-13T18:55:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f519e000700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5188066730 0x7f5188068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f519e000700 1 -- 172.21.15.81:0/1542978807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51a0084b10 con 0x7f51a8161450 2024-09-13T18:55:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a5e00700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5188066730 0x7f5188068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 Processor -- start 2024-09-13T18:55:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 -- start start 2024-09-13T18:55:26.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a5e00700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5188066730 0x7f5188068bf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5198009ba0 tx=0x7f5198008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd322810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd321310 0xd34a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 0xd36c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd2b3010 con 0xd36c170 2024-09-13T18:55:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd240f40 con 0xd36bd90 2024-09-13T18:55:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd293e30 con 0xd321310 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 0xd36c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 0xd36c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41182/0 (socket says 172.21.15.81:41182) 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 -- 172.21.15.81:0/3291682171 learned_addr learned my addr 172.21.15.81:0/3291682171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a5400700 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd321310 0xd34a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 -- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd321310 msgr2=0xd34a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd321310 0xd34a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 -- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 msgr2=0xd322810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd322810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.668+0000 7f51a6800700 1 -- 172.21.15.81:0/3291682171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd0ffa40 con 0xd36c170 2024-09-13T18:55:26.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51a6800700 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 0xd36c550 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f51a005d800 tx=0x7f51a00559f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633f307e0615eae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f5192600700 1 -- 172.21.15.81:0/3291682171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a005dd30 con 0xd36c170 2024-09-13T18:55:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f5192600700 1 -- 172.21.15.81:0/3291682171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0053d90 con 0xd36c170 2024-09-13T18:55:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f5192600700 1 -- 172.21.15.81:0/3291682171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0054ee0 con 0xd36c170 2024-09-13T18:55:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 -- 172.21.15.81:0/3291682171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 msgr2=0xd36c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 0xd36c550 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f51a005d800 tx=0x7f51a00559f0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 -- 172.21.15.81:0/3291682171 shutdown_connections 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36c170 0xd36c550 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd321310 0xd34a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 --2- 172.21.15.81:0/3291682171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd322810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 -- 172.21.15.81:0/3291682171 >> 172.21.15.81:0/3291682171 conn(0xd0b45b0 msgr2=0xd325b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 -- 172.21.15.81:0/3291682171 shutdown_connections 2024-09-13T18:55:26.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 -- 172.21.15.81:0/3291682171 wait complete. 2024-09-13T18:55:26.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 -- start start 2024-09-13T18:55:26.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.672+0000 7f51aff57740 1 Processor -- start 2024-09-13T18:55:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd3457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd36bd90 0xd348b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36c170 0xd36a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd28f150 con 0xd321310 2024-09-13T18:55:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd28ceb0 con 0xd36c170 2024-09-13T18:55:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd24a8e0 con 0xd36bd90 2024-09-13T18:55:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 10 client.0 _ll_register_callbacks cb 0xd229670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd3457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd3457b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41196/0 (socket says 172.21.15.81:41196) 2024-09-13T18:55:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 -- 172.21.15.81:0/199424359 learned_addr learned my addr 172.21.15.81:0/199424359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a6800700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36c170 0xd36a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5400700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd36bd90 0xd348b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 -- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd36bd90 msgr2=0xd348b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd36bd90 0xd348b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 -- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36c170 msgr2=0xd36a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36c170 0xd36a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 -- 172.21.15.81:0/199424359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a8154db0 con 0xd321310 2024-09-13T18:55:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51a5e00700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd3457b0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5198009eb0 tx=0x7f51980047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ca358c07ddd93c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f5186a00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f5186a00700 1 -- 172.21.15.81:0/199424359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519802c070 con 0xd321310 2024-09-13T18:55:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f5186a00700 1 -- 172.21.15.81:0/199424359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51980038d0 con 0xd321310 2024-09-13T18:55:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd0c12c0 con 0xd321310 2024-09-13T18:55:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f5186a00700 1 -- 172.21.15.81:0/199424359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5198020070 con 0xd321310 2024-09-13T18:55:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 10 client.9501 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0xd253290 con 0xd321310 2024-09-13T18:55:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f5186a00700 1 -- 172.21.15.81:0/199424359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd0c12c0 con 0xd321310 2024-09-13T18:55:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f5186a00700 1 -- 172.21.15.81:0/199424359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5198003ad0 con 0xd321310 2024-09-13T18:55:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 10 client.9501 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 10 client.9501 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 20 client.9501 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd349f90 0xd343d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 4 client.9501 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.676+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd10b540 con 0xd349f90 2024-09-13T18:55:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51a5400700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd349f90 0xd343d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51a5400700 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd349f90 0xd343d90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4b23eb611a09cdc server_cookie=66391c714611bcc3 in_seq=0 out_seq=0 2024-09-13T18:55:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f5186a00700 10 client.9501 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f5186a00700 1 -- 172.21.15.81:0/199424359 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xd10b540 con 0xd349f90 2024-09-13T18:55:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f5186a00700 10 client.9501 handle_command_reply: tid=0 2024-09-13T18:55:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 client.9501 shutdown 2024-09-13T18:55:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 msgr2=0xd3457b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd3457b0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5198009eb0 tx=0x7f51980047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 shutdown_connections 2024-09-13T18:55:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd349f90 0xd343d90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36c170 0xd36a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd36bd90 0xd348b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 --2- 172.21.15.81:0/199424359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd3457b0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 >> 172.21.15.81:0/199424359 conn(0xd0b45b0 msgr2=0xd34a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f5186a00700 0 client.9501 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 shutdown_connections 2024-09-13T18:55:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.680+0000 7f51aff57740 1 -- 172.21.15.81:0/199424359 wait complete. 2024-09-13T18:55:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.684+0000 7f51aff57740 20 client.9501 trim_cache size 0 max 16384 2024-09-13T18:55:26.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 Processor -- start 2024-09-13T18:55:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 -- start start 2024-09-13T18:55:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd321310 0xd3d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 0xd347320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd325150 con 0xd36bd90 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd138b80 con 0xd321310 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.700+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd216a50 con 0xd0b45b0 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 0xd347320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 0xd347320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41198/0 (socket says 172.21.15.81:41198) 2024-09-13T18:55:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 -- 172.21.15.81:0/2749053206 learned_addr learned my addr 172.21.15.81:0/2749053206 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a5400700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd321310 0xd3d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 -- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 msgr2=0xd3d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a5e00700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 -- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd321310 msgr2=0xd3d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd321310 0xd3d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 -- 172.21.15.81:0/2749053206 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd2394c0 con 0xd36bd90 2024-09-13T18:55:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a5400700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd321310 0xd3d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a5e00700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51a6800700 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 0xd347320 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f51a0051ef0 tx=0x7f51a0057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e05c3488099e316 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f5193000700 1 -- 172.21.15.81:0/2749053206 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a005dd30 con 0xd36bd90 2024-09-13T18:55:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f5193000700 1 -- 172.21.15.81:0/2749053206 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a006d210 con 0xd36bd90 2024-09-13T18:55:26.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f5193000700 1 -- 172.21.15.81:0/2749053206 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0055120 con 0xd36bd90 2024-09-13T18:55:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 -- 172.21.15.81:0/2749053206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 msgr2=0xd347320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 0xd347320 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f51a0051ef0 tx=0x7f51a0057000 comp rx=0 tx=0).stop 2024-09-13T18:55:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 -- 172.21.15.81:0/2749053206 shutdown_connections 2024-09-13T18:55:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd36bd90 0xd347320 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd321310 0xd3d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 --2- 172.21.15.81:0/2749053206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 -- 172.21.15.81:0/2749053206 >> 172.21.15.81:0/2749053206 conn(0xd325f10 msgr2=0xd3444d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 -- 172.21.15.81:0/2749053206 shutdown_connections 2024-09-13T18:55:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 -- 172.21.15.81:0/2749053206 wait complete. 2024-09-13T18:55:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 -- start start 2024-09-13T18:55:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.704+0000 7f51aff57740 1 Processor -- start 2024-09-13T18:55:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd391670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd391bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3475c0 con 0xd321310 2024-09-13T18:55:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3920f0 con 0xd36bd90 2024-09-13T18:55:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xd3270d0 con 0xd0b45b0 2024-09-13T18:55:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 10 client.0 _ll_register_callbacks cb 0xd28b610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd391670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:35840/0 (socket says 172.21.15.81:35840) 2024-09-13T18:55:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 -- 172.21.15.81:0/347209020 learned_addr learned my addr 172.21.15.81:0/347209020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a6800700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd391bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 -- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 msgr2=0xd391bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd391bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 -- 172.21.15.81:0/347209020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 msgr2=0xd391670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd391670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 -- 172.21.15.81:0/347209020 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd0ffa40 con 0xd0b45b0 2024-09-13T18:55:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5400700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd391670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51a5e00700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3cf9e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5198011d30 tx=0x7f5198020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca9217d9508f08a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f5186a00700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2024-09-13T18:55:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f5186a00700 1 -- 172.21.15.81:0/347209020 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198003ae0 con 0xd0b45b0 2024-09-13T18:55:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51a0053d90 con 0xd0b45b0 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f5186a00700 1 -- 172.21.15.81:0/347209020 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f519801a420 con 0xd0b45b0 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f5186a00700 1 -- 172.21.15.81:0/347209020 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f519801a640 con 0xd0b45b0 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 10 client.7958 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.708+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0xd22d790 con 0xd0b45b0 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f5186a00700 1 -- 172.21.15.81:0/347209020 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a0053d90 con 0xd0b45b0 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f5186a00700 1 -- 172.21.15.81:0/347209020 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f519801a7a0 con 0xd0b45b0 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 10 client.7958 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 10 client.7958 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 20 client.7958 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd36c170 0xd3d5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 4 client.7958 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xd1302c0 con 0xd36c170 2024-09-13T18:55:26.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51a5400700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd36c170 0xd3d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f5186a00700 10 client.7958 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51a5400700 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd36c170 0xd3d5be0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c1fc65ac3b200ef server_cookie=d2e88ea8783cdf09 in_seq=0 out_seq=0 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f5186a00700 1 -- 172.21.15.81:0/347209020 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0xd1302c0 con 0xd36c170 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f5186a00700 10 client.7958 handle_command_reply: tid=0 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 client.7958 shutdown 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 msgr2=0xd3cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3cf9e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5198011d30 tx=0x7f5198020000 comp rx=0 tx=0).stop 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 shutdown_connections 2024-09-13T18:55:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xd36c170 0xd3d5be0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd36bd90 0xd391bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xd321310 0xd391670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 --2- 172.21.15.81:0/347209020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xd0b45b0 0xd3cf9e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f5186a00700 0 client.7958 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 >> 172.21.15.81:0/347209020 conn(0xd325f10 msgr2=0xd348490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.712+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 shutdown_connections 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51aff57740 1 -- 172.21.15.81:0/347209020 wait complete. 2024-09-13T18:55:26.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51aff57740 20 client.7958 trim_cache size 0 max 16384 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:26.725 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5188066730 msgr2=0x7f5188068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5188066730 0x7f5188068bf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5198009ba0 tx=0x7f5198008030 comp rx=0 tx=0).stop 2024-09-13T18:55:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 msgr2=0x7f51a80affe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 0x7f51a80affe0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f51a000efc0 tx=0x7f51a000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 shutdown_connections 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5188066730 0x7f5188068bf0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a8161450 0x7f51a80affe0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51a815a7b0 0x7f51a81552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 --2- 172.21.15.81:0/1542978807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51a80cba40 0x7f51a8153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 >> 172.21.15.81:0/1542978807 conn(0x7f51a806a390 msgr2=0x7f51a80adb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 shutdown_connections 2024-09-13T18:55:26.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.716+0000 7f51a7200700 1 -- 172.21.15.81:0/1542978807 wait complete. 2024-09-13T18:55:26.747 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:26.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-13T18:55:26.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.912+0000 7f65fec00700 1 Processor -- start 2024-09-13T18:55:26.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.912+0000 7f65fec00700 1 -- start start 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65fec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 0x7f65f80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65fec00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65f806c8c0 0x7f65f80cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65fec00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f815ea30 con 0x7f65f8146720 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65fec00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f8070670 con 0x7f65f806c8c0 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65fec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8070950 con 0x7f65f806c4c0 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65f7e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f65f8146720 0x7f65f815e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59540/0 (socket says 172.21.15.81:59540) 2024-09-13T18:55:26.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65f7e00700 1 -- 172.21.15.81:0/3273625138 learned_addr learned my addr 172.21.15.81:0/3273625138 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65f7400700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 0x7f65f80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65fcc00700 1 --2- 172.21.15.81:0/3273625138 >> v2:172.21.15.178:3300/0 conn(0x7f65f806c8c0 0x7f65f80cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365172755 0 0) 0x7f65f815ea30 con 0x7f65f8146720 2024-09-13T18:55:26.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.916+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65dc0035d0 con 0x7f65f8146720 2024-09-13T18:55:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4021852225 0 0) 0x7f65dc0035d0 con 0x7f65f8146720 2024-09-13T18:55:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 msgr2=0x7f65f80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 0x7f65f80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 >> v2:172.21.15.178:3300/0 conn(0x7f65f806c8c0 msgr2=0x7f65f80cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 --2- 172.21.15.81:0/3273625138 >> v2:172.21.15.178:3300/0 conn(0x7f65f806c8c0 0x7f65f80cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f8070c30 con 0x7f65f8146720 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f65e80019f0 con 0x7f65f8146720 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65fcc00700 1 --2- 172.21.15.81:0/3273625138 >> v2:172.21.15.178:3300/0 conn(0x7f65f806c8c0 0x7f65f80cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 >> v1:172.21.15.81:6789/0 conn(0x7f65f8146720 legacy=0x7f65f815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65dc003a20 0x7f65dc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 0x7f65dc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc004db0 0x7f65dc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8070670 con 0x7f65dc003a20 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f8070950 con 0x7f65dc004db0 2024-09-13T18:55:26.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc00ba30 con 0x7f65f806c4c0 2024-09-13T18:55:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65dc003a20 0x7f65dc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65fcc00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc004db0 0x7f65dc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7400700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 0x7f65dc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 -- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 msgr2=0x7f65dc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f806c4c0 0x7f65dc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 -- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc004db0 msgr2=0x7f65dc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc004db0 0x7f65dc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 -- 172.21.15.81:0/3273625138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc0035d0 con 0x7f65dc003a20 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65dc003a20 0x7f65dc003e40 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f65e800a860 tx=0x7f65dc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207d694d9123bd87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e80072d0 con 0x7f65dc003a20 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8007450 con 0x7f65dc003a20 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.920+0000 7f65f6a00700 1 -- 172.21.15.81:0/3273625138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8007800 con 0x7f65dc003a20 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 -- 172.21.15.81:0/3273625138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65dc003a20 msgr2=0x7f65dc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 --2- 172.21.15.81:0/3273625138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65dc003a20 0x7f65dc003e40 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f65e800a860 tx=0x7f65dc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fcc00700 1 -- 172.21.15.81:0/3273625138 reap_dead start 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 -- 172.21.15.81:0/3273625138 shutdown_connections 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 -- 172.21.15.81:0/3273625138 >> 172.21.15.81:0/3273625138 conn(0x7f65f806a570 msgr2=0x7f65f806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 -- 172.21.15.81:0/3273625138 shutdown_connections 2024-09-13T18:55:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 -- 172.21.15.81:0/3273625138 wait complete. 2024-09-13T18:55:26.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 Processor -- start 2024-09-13T18:55:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.924+0000 7f65fec00700 1 -- start start 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65f813a340 0x7f65f8142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f81432a0 0x7f65f8159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 0x7f65f8157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80cdbd0 con 0x7f65f815a0d0 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80ccce0 con 0x7f65f813a340 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80ccfc0 con 0x7f65f81432a0 2024-09-13T18:55:26.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 0x7f65f8157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 0x7f65f8157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41228/0 (socket says 172.21.15.81:41228) 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 -- 172.21.15.81:0/1214993856 learned_addr learned my addr 172.21.15.81:0/1214993856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65f7400700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f81432a0 0x7f65f8159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65f7e00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65f813a340 0x7f65f8142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 -- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f81432a0 msgr2=0x7f65f8159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f81432a0 0x7f65f8159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 -- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65f813a340 msgr2=0x7f65f8142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65f813a340 0x7f65f8142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 -- 172.21.15.81:0/1214993856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f80cd2a0 con 0x7f65f815a0d0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fcc00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 0x7f65f8157820 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f65f806d420 tx=0x7f65f0011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65efe00700 1 -- 172.21.15.81:0/1214993856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0011ec0 con 0x7f65f815a0d0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65efe00700 1 -- 172.21.15.81:0/1214993856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f000f7b0 con 0x7f65f815a0d0 2024-09-13T18:55:26.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f80cd580 con 0x7f65f815a0d0 2024-09-13T18:55:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65efe00700 1 -- 172.21.15.81:0/1214993856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000fb60 con 0x7f65f815a0d0 2024-09-13T18:55:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.928+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f815a550 con 0x7f65f815a0d0 2024-09-13T18:55:26.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.932+0000 7f65efe00700 1 -- 172.21.15.81:0/1214993856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65f000fcc0 con 0x7f65f815a0d0 2024-09-13T18:55:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f65efe00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f65d8066730 0x7f65d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f65efe00700 1 -- 172.21.15.81:0/1214993856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65f00842f0 con 0x7f65f815a0d0 2024-09-13T18:55:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f65f7e00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f65d8066730 0x7f65d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f65f7e00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f65d8066730 0x7f65d8068bf0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f65f80cb250 tx=0x7f65e8009070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 Processor -- start 2024-09-13T18:55:26.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 -- start start 2024-09-13T18:55:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316da240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x316fbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fc270 0x316af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x31643010 con 0x316d9d00 2024-09-13T18:55:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x315d0f40 con 0x316fc270 2024-09-13T18:55:26.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.936+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x31623e30 con 0x316fb950 2024-09-13T18:55:26.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x316fbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x316fbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41230/0 (socket says 172.21.15.81:41230) 2024-09-13T18:55:26.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 -- 172.21.15.81:0/871932475 learned_addr learned my addr 172.21.15.81:0/871932475 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 -- 172.21.15.81:0/871932475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 msgr2=0x316da240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316da240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 -- 172.21.15.81:0/871932475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fc270 msgr2=0x316af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fc270 0x316af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 -- 172.21.15.81:0/871932475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x3148fa40 con 0x316d9d00 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65f7400700 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x316fbd30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009d40 tx=0x7f65e4009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e44edcb059ed09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65e3e00700 1 -- 172.21.15.81:0/871932475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4014a50 con 0x316d9d00 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65e3e00700 1 -- 172.21.15.81:0/871932475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4014bb0 con 0x316d9d00 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f65e3e00700 1 -- 172.21.15.81:0/871932475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e401d440 con 0x316d9d00 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 -- 172.21.15.81:0/871932475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 msgr2=0x316fbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x316fbd30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009d40 tx=0x7f65e4009d70 comp rx=0 tx=0).stop 2024-09-13T18:55:26.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 -- 172.21.15.81:0/871932475 shutdown_connections 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fc270 0x316af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x316fbd30 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 --2- 172.21.15.81:0/871932475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316da240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 -- 172.21.15.81:0/871932475 >> 172.21.15.81:0/871932475 conn(0x314445b0 msgr2=0x316b59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 -- 172.21.15.81:0/871932475 shutdown_connections 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 -- 172.21.15.81:0/871932475 wait complete. 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 -- start start 2024-09-13T18:55:26.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.940+0000 7f660208a740 1 Processor -- start 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316c5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 0x316c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x3161f150 con 0x316fc270 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x3161ceb0 con 0x316d9d00 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x315da8e0 con 0x316fb950 2024-09-13T18:55:26.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 10 client.0 _ll_register_callbacks cb 0x315b9670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 0x316c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 0x316c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41232/0 (socket says 172.21.15.81:41232) 2024-09-13T18:55:26.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 -- 172.21.15.81:0/3691743185 learned_addr learned my addr 172.21.15.81:0/3691743185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65f7400700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 -- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 msgr2=0x316c5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316c5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 -- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 msgr2=0x316c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 -- 172.21.15.81:0/3691743185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e4009970 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65fcc00700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 0x316c2de0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f65f0001eb0 tx=0x7f65f00553d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=239ab46f750dde8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65e0c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65e0c00700 1 -- 172.21.15.81:0/3691743185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f005d640 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65e0c00700 1 -- 172.21.15.81:0/3691743185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65f006c020 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x314512c0 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f65e0c00700 1 -- 172.21.15.81:0/3691743185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65f00535f0 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 10 client.9519 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.944+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x315e3290 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65e0c00700 1 -- 172.21.15.81:0/3691743185 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x314512c0 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65e0c00700 1 -- 172.21.15.81:0/3691743185 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f65f005b070 con 0x316fc270 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 10 client.9519 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 10 client.9519 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:26.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 20 client.9519 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x316c6760 0x316c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 4 client.9519 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x3149b540 con 0x316c6760 2024-09-13T18:55:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x316c6760 0x316c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65f7e00700 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x316c6760 0x316c6b70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d6924072dd65b9e server_cookie=3f6e21d43126494a in_seq=0 out_seq=0 2024-09-13T18:55:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65e0c00700 10 client.9519 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65e0c00700 1 -- 172.21.15.81:0/3691743185 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x3149b540 con 0x316c6760 2024-09-13T18:55:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65e0c00700 10 client.9519 handle_command_reply: tid=0 2024-09-13T18:55:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 client.9519 shutdown 2024-09-13T18:55:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 msgr2=0x316c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 0x316c2de0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f65f0001eb0 tx=0x7f65f00553d0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 shutdown_connections 2024-09-13T18:55:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x316c6760 0x316c6b70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fc270 0x316c2de0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fb950 0x316c5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 --2- 172.21.15.81:0/3691743185 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 >> 172.21.15.81:0/3691743185 conn(0x314445b0 msgr2=0x316b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f65e0c00700 0 client.9519 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 shutdown_connections 2024-09-13T18:55:26.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 1 -- 172.21.15.81:0/3691743185 wait complete. 2024-09-13T18:55:26.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.948+0000 7f660208a740 20 client.9519 trim_cache size 0 max 16384 2024-09-13T18:55:26.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 Processor -- start 2024-09-13T18:55:26.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 -- start start 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 0x3170f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x3170f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x314c8b80 con 0x316fb950 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x316b24c0 con 0x316d9d00 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x315a6a50 con 0x316fc270 2024-09-13T18:55:26.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 0x3170f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 0x3170f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41246/0 (socket says 172.21.15.81:41246) 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 -- 172.21.15.81:0/1494604148 learned_addr learned my addr 172.21.15.81:0/1494604148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 -- 172.21.15.81:0/1494604148 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 msgr2=0x3170f640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x3170f640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 -- 172.21.15.81:0/1494604148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 msgr2=0x316c48e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 -- 172.21.15.81:0/1494604148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x315c94c0 con 0x316fb950 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65f7400700 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 0x3170f100 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009db0 tx=0x7f65e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cde478336d96630 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65ed200700 1 -- 172.21.15.81:0/1494604148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40096e0 con 0x316fb950 2024-09-13T18:55:26.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65ed200700 1 -- 172.21.15.81:0/1494604148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4004040 con 0x316fb950 2024-09-13T18:55:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.972+0000 7f65ed200700 1 -- 172.21.15.81:0/1494604148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e40043f0 con 0x316fb950 2024-09-13T18:55:26.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 -- 172.21.15.81:0/1494604148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 msgr2=0x3170f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 0x3170f100 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f65e4009db0 tx=0x7f65e4017000 comp rx=0 tx=0).stop 2024-09-13T18:55:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 -- 172.21.15.81:0/1494604148 shutdown_connections 2024-09-13T18:55:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x3170f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316fb950 0x3170f100 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 --2- 172.21.15.81:0/1494604148 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316d9d00 0x316c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 -- 172.21.15.81:0/1494604148 >> 172.21.15.81:0/1494604148 conn(0x314445b0 msgr2=0x316f70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 -- 172.21.15.81:0/1494604148 shutdown_connections 2024-09-13T18:55:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 -- 172.21.15.81:0/1494604148 wait complete. 2024-09-13T18:55:26.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 -- start start 2024-09-13T18:55:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.976+0000 7f660208a740 1 Processor -- start 2024-09-13T18:55:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x31755040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fb950 0x31755da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x317562e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x315edc00 con 0x316d9d00 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x315bb620 con 0x316fb950 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x317159e0 con 0x316fc270 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f660208a740 10 client.0 _ll_register_callbacks cb 0x315ec8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x31755040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fb950 0x31755da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x31755040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41260/0 (socket says 172.21.15.81:41260) 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 -- 172.21.15.81:0/627843656 learned_addr learned my addr 172.21.15.81:0/627843656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65fcc00700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x317562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 -- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 msgr2=0x317562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x317562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 -- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fb950 msgr2=0x31755da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fb950 0x31755da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 -- 172.21.15.81:0/627843656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x3148fa40 con 0x316d9d00 2024-09-13T18:55:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7400700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fb950 0x31755da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:26.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65f7e00700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x31755040 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f65e8011000 tx=0x7f65e8001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fa4e4246691b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:26.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.980+0000 7f65e0c00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:26.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 1 -- 172.21.15.81:0/627843656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8031040 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 1 -- 172.21.15.81:0/627843656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65e8001a90 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65e4014bb0 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 1 -- 172.21.15.81:0/627843656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65e80079a0 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 10 client.9525 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x315bd790 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 1 -- 172.21.15.81:0/627843656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e4014bb0 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 1 -- 172.21.15.81:0/627843656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f65e8033b70 con 0x316d9d00 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 10 client.9525 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 10 client.9525 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 20 client.9525 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x31755580 0x31756820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:26.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 4 client.9525 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x314c02c0 con 0x31755580 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65f7400700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x31755580 0x31756820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 10 client.9525 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65f7400700 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x31755580 0x31756820 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d794ddf57eaa376 server_cookie=72a23e72a8dc626d in_seq=0 out_seq=0 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 1 -- 172.21.15.81:0/627843656 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x314c02c0 con 0x31755580 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 10 client.9525 handle_command_reply: tid=0 2024-09-13T18:55:26.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 client.9525 shutdown 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 msgr2=0x31755040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x31755040 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f65e8011000 tx=0x7f65e8001df0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 shutdown_connections 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x31755580 0x31756820 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x316fc270 0x317562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x316fb950 0x31755da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f65e0c00700 0 client.9525 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 --2- 172.21.15.81:0/627843656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x316d9d00 0x31755040 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 >> 172.21.15.81:0/627843656 conn(0x314445b0 msgr2=0x316c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 shutdown_connections 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 1 -- 172.21.15.81:0/627843656 wait complete. 2024-09-13T18:55:26.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.984+0000 7f660208a740 20 client.9525 trim_cache size 0 max 16384 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:26.999 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:27.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:27.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:27.000 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f65d8066730 msgr2=0x7f65d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f65d8066730 0x7f65d8068bf0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f65f80cb250 tx=0x7f65e8009070 comp rx=0 tx=0).stop 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 msgr2=0x7f65f8157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 0x7f65f8157820 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f65f806d420 tx=0x7f65f0011c80 comp rx=0 tx=0).stop 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 shutdown_connections 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f65d8066730 0x7f65d8068bf0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65f815a0d0 0x7f65f8157820 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65f81432a0 0x7f65f8159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 --2- 172.21.15.81:0/1214993856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65f813a340 0x7f65f8142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 >> 172.21.15.81:0/1214993856 conn(0x7f65f806a570 msgr2=0x7f65f815aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 shutdown_connections 2024-09-13T18:55:27.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:26.988+0000 7f65fec00700 1 -- 172.21.15.81:0/1214993856 wait complete. 2024-09-13T18:55:27.016 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:27.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:27.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.184+0000 7fd396e00700 1 Processor -- start 2024-09-13T18:55:27.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.184+0000 7fd396e00700 1 -- start start 2024-09-13T18:55:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd390161020 0x7fd390071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3900ccd90 0x7fd3900b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2f90 0x7fd39006ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39006bc20 con 0x7fd3900ccd90 2024-09-13T18:55:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39006a390 con 0x7fd390161020 2024-09-13T18:55:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900cd340 con 0x7fd3900b2f90 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3900ccd90 0x7fd3900b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2f90 0x7fd39006ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd390161020 0x7fd390071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3900ccd90 0x7fd3900b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41270/0 (socket says 172.21.15.81:41270) 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 -- 172.21.15.81:0/1992211122 learned_addr learned my addr 172.21.15.81:0/1992211122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 -- 172.21.15.81:0/1992211122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2f90 msgr2=0x7fd39006ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 --2- 172.21.15.81:0/1992211122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2f90 0x7fd39006ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 -- 172.21.15.81:0/1992211122 >> v2:172.21.15.178:3300/0 conn(0x7fd390161020 msgr2=0x7fd390071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 --2- 172.21.15.81:0/1992211122 >> v2:172.21.15.178:3300/0 conn(0x7fd390161020 0x7fd390071320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395000700 1 -- 172.21.15.81:0/1992211122 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd390071860 con 0x7fd3900ccd90 2024-09-13T18:55:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd396400700 1 --2- 172.21.15.81:0/1992211122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2f90 0x7fd39006ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.188+0000 7fd395a00700 1 --2- 172.21.15.81:0/1992211122 >> v2:172.21.15.178:3300/0 conn(0x7fd390161020 0x7fd390071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd395000700 1 --2- 172.21.15.81:0/1992211122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900ccd90 0x7fd3900b2a50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd39006d8c0 tx=0x7fd37c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca7bf445f5e18d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd38fe00700 1 -- 172.21.15.81:0/1992211122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011830 con 0x7fd3900ccd90 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd38fe00700 1 -- 172.21.15.81:0/1992211122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c011990 con 0x7fd3900ccd90 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd38fe00700 1 -- 172.21.15.81:0/1992211122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011d20 con 0x7fd3900ccd90 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 -- 172.21.15.81:0/1992211122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900ccd90 msgr2=0x7fd3900b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 --2- 172.21.15.81:0/1992211122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900ccd90 0x7fd3900b2a50 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd39006d8c0 tx=0x7fd37c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 -- 172.21.15.81:0/1992211122 shutdown_connections 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 --2- 172.21.15.81:0/1992211122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3900b2f90 0x7fd39006ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 --2- 172.21.15.81:0/1992211122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900ccd90 0x7fd3900b2a50 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 --2- 172.21.15.81:0/1992211122 >> v2:172.21.15.178:3300/0 conn(0x7fd390161020 0x7fd390071320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 -- 172.21.15.81:0/1992211122 >> 172.21.15.81:0/1992211122 conn(0x7fd39006ca10 msgr2=0x7fd39006cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 -- 172.21.15.81:0/1992211122 shutdown_connections 2024-09-13T18:55:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.192+0000 7fd396e00700 1 -- 172.21.15.81:0/1992211122 wait complete. 2024-09-13T18:55:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 Processor -- start 2024-09-13T18:55:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 -- start start 2024-09-13T18:55:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 0x7fd3901ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900ccd90 0x7fd39015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd390161020 0x7fd390157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015fa70 con 0x7fd3900b2f90 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015ff00 con 0x7fd3900ccd90 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015ee60 con 0x7fd390161020 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 0x7fd3901ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 0x7fd3901ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41278/0 (socket says 172.21.15.81:41278) 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395a00700 1 -- 172.21.15.81:0/971785073 learned_addr learned my addr 172.21.15.81:0/971785073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395000700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900ccd90 0x7fd39015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd396400700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd390161020 0x7fd390157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395a00700 1 -- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd390161020 msgr2=0x7fd390157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395a00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd390161020 0x7fd390157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.196+0000 7fd395a00700 1 -- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900ccd90 msgr2=0x7fd39015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd395a00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900ccd90 0x7fd39015e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd395a00700 1 -- 172.21.15.81:0/971785073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009a70 con 0x7fd3900b2f90 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd395000700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900ccd90 0x7fd39015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd395a00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 0x7fd3901ed790 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd38400ebe0 tx=0x7fd384009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400c910 con 0x7fd3900b2f90 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400ca70 con 0x7fd3900b2f90 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400ce00 con 0x7fd3900b2f90 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3840094b0 con 0x7fd3900b2f90 2024-09-13T18:55:27.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c009570 con 0x7fd3900b2f90 2024-09-13T18:55:27.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.200+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3900672a0 con 0x7fd3900b2f90 2024-09-13T18:55:27.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.204+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd384013470 con 0x7fd3900b2f90 2024-09-13T18:55:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.204+0000 7fd38d600700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.204+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd384084540 con 0x7fd3900b2f90 2024-09-13T18:55:27.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.204+0000 7fd395000700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.204+0000 7fd395000700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd37c000c00 tx=0x7fd37c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.212+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd384051750 con 0x7fd3900b2f90 2024-09-13T18:55:27.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.440+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd390162350 con 0x7fd3900b2f90 2024-09-13T18:55:27.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.444+0000 7fd38d600700 1 -- 172.21.15.81:0/971785073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7fd384054d70 con 0x7fd3900b2f90 2024-09-13T18:55:27.452 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:27.452 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 msgr2=0x7fd370068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd37c000c00 tx=0x7fd37c008030 comp rx=0 tx=0).stop 2024-09-13T18:55:27.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 msgr2=0x7fd3901ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 0x7fd3901ed790 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fd38400ebe0 tx=0x7fd384009ed0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 shutdown_connections 2024-09-13T18:55:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd370066730 0x7fd370068bf0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd390161020 0x7fd390157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3900ccd90 0x7fd39015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 --2- 172.21.15.81:0/971785073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3900b2f90 0x7fd3901ed790 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 >> 172.21.15.81:0/971785073 conn(0x7fd39006ca10 msgr2=0x7fd390163840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 shutdown_connections 2024-09-13T18:55:27.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.448+0000 7fd396e00700 1 -- 172.21.15.81:0/971785073 wait complete. 2024-09-13T18:55:27.458 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:27.479 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:27.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:27.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.640+0000 7fb72ce00700 1 Processor -- start 2024-09-13T18:55:27.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.640+0000 7fb72ce00700 1 -- start start 2024-09-13T18:55:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.640+0000 7fb72ce00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7280b0b10 0x7fb72806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.640+0000 7fb72ce00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728071030 con 0x7fb7280ccda0 2024-09-13T18:55:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.640+0000 7fb72ce00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72806cd10 con 0x7fb72815baf0 2024-09-13T18:55:27.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.640+0000 7fb72ce00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72815bf40 con 0x7fb7280b0b10 2024-09-13T18:55:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb7280ccda0 0x7fb7280b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59542/0 (socket says 172.21.15.81:59542) 2024-09-13T18:55:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 -- 172.21.15.81:0/3712940056 learned_addr learned my addr 172.21.15.81:0/3712940056 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250875076 0 0) 0x7fb728071030 con 0x7fb7280ccda0 2024-09-13T18:55:27.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb70c0035d0 con 0x7fb7280ccda0 2024-09-13T18:55:27.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167537788 0 0) 0x7fb72806cd10 con 0x7fb72815baf0 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb728071030 con 0x7fb72815baf0 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725e00700 1 --2- 172.21.15.81:0/3712940056 >> v2:172.21.15.178:3300/0 conn(0x7fb7280b0b10 0x7fb72806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2770488908 0 0) 0x7fb70c0035d0 con 0x7fb7280ccda0 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 >> v2:172.21.15.178:3300/0 conn(0x7fb7280b0b10 msgr2=0x7fb72806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 --2- 172.21.15.81:0/3712940056 >> v2:172.21.15.178:3300/0 conn(0x7fb7280b0b10 0x7fb72806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 >> v1:172.21.15.178:6789/0 conn(0x7fb72815baf0 legacy=0x7fb7281645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280704b0 con 0x7fb7280ccda0 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fb710001670 con 0x7fb7280ccda0 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 >> v1:172.21.15.81:6789/0 conn(0x7fb7280ccda0 legacy=0x7fb7280b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c003bb0 0x7fb70c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c004870 0x7fb70c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70c005350 0x7fb70c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815bf40 con 0x7fb70c004870 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c00c250 con 0x7fb70c005350 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c00c410 con 0x7fb70c003bb0 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725e00700 1 --2- 172.21.15.81:0/3712940056 >> v2:172.21.15.178:3300/0 conn(0x7fb7280b0b10 0x7fb72806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c004870 0x7fb70c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb726800700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70c005350 0x7fb70c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725e00700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c003bb0 0x7fb70c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 -- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c003bb0 msgr2=0x7fb70c003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c003bb0 0x7fb70c003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 -- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70c005350 msgr2=0x7fb70c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb70c005350 0x7fb70c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 -- 172.21.15.81:0/3712940056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c0035d0 con 0x7fb70c004870 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb726800700 1 -- 172.21.15.81:0/3712940056 reap_dead start 2024-09-13T18:55:27.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb725e00700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c003bb0 0x7fb70c003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:27.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.644+0000 7fb71d400700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c004870 0x7fb70c004cf0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb710001eb0 tx=0x7fb70c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6d462de083388e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000ccf0 con 0x7fb70c004870 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000ce50 con 0x7fb70c004870 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb725400700 1 -- 172.21.15.81:0/3712940056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710005bc0 con 0x7fb70c004870 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 -- 172.21.15.81:0/3712940056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c004870 msgr2=0x7fb70c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c004870 0x7fb70c004cf0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb710001eb0 tx=0x7fb70c0058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 -- 172.21.15.81:0/3712940056 shutdown_connections 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3712940056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb70c004870 0x7fb70c004cf0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 -- 172.21.15.81:0/3712940056 >> 172.21.15.81:0/3712940056 conn(0x7fb72806a7b0 msgr2=0x7fb72806abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 -- 172.21.15.81:0/3712940056 shutdown_connections 2024-09-13T18:55:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 -- 172.21.15.81:0/3712940056 wait complete. 2024-09-13T18:55:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 Processor -- start 2024-09-13T18:55:27.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.648+0000 7fb72ce00700 1 -- start start 2024-09-13T18:55:27.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c004870 0x7fb72814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 0x7fb728152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7281ee5f0 0x7fb7281e42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815d890 con 0x7fb728150cb0 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72814e2c0 con 0x7fb7281ee5f0 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815db30 con 0x7fb70c004870 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 0x7fb728152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 0x7fb728152580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41300/0 (socket says 172.21.15.81:41300) 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 -- 172.21.15.81:0/3809065109 learned_addr learned my addr 172.21.15.81:0/3809065109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb725e00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c004870 0x7fb72814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb726800700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7281ee5f0 0x7fb7281e42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 -- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c004870 msgr2=0x7fb72814dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c004870 0x7fb72814dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 -- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7281ee5f0 msgr2=0x7fb7281e42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7281ee5f0 0x7fb7281e42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 -- 172.21.15.81:0/3809065109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72815de10 con 0x7fb728150cb0 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71d400700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 0x7fb728152580 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c220 tx=0x7fb710001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710000ed0 con 0x7fb728150cb0 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100070d0 con 0x7fb728150cb0 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72814ede0 con 0x7fb728150cb0 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100074a0 con 0x7fb728150cb0 2024-09-13T18:55:27.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.652+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7281eea70 con 0x7fb728150cb0 2024-09-13T18:55:27.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.656+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb72815e050 con 0x7fb728150cb0 2024-09-13T18:55:27.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.656+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb710007600 con 0x7fb728150cb0 2024-09-13T18:55:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.656+0000 7fb71ea00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb704066730 0x7fb704068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.656+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb710084810 con 0x7fb728150cb0 2024-09-13T18:55:27.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.656+0000 7fb725e00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb704066730 0x7fb704068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:27.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.660+0000 7fb725e00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb704066730 0x7fb704068bf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb7280b3dc0 tx=0x7fb718008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.664+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb710051a10 con 0x7fb728150cb0 2024-09-13T18:55:27.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb72806cf50 con 0x7fb728150cb0 2024-09-13T18:55:27.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb71ea00700 1 -- 172.21.15.81:0/3809065109 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1967 (secure 0 0 0) 0x7fb710055030 con 0x7fb728150cb0 2024-09-13T18:55:27.920 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:27.920 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":517,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":267239424,"bytes_avail":772826873856,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5544,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-13T18:55:23.136814+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:55:27.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb704066730 msgr2=0x7fb704068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb704066730 0x7fb704068bf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb7280b3dc0 tx=0x7fb718008040 comp rx=0 tx=0).stop 2024-09-13T18:55:27.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 msgr2=0x7fb728152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:27.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 0x7fb728152580 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c220 tx=0x7fb710001980 comp rx=0 tx=0).stop 2024-09-13T18:55:27.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 shutdown_connections 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb704066730 0x7fb704068bf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7281ee5f0 0x7fb7281e42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb728150cb0 0x7fb728152580 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 --2- 172.21.15.81:0/3809065109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb70c004870 0x7fb72814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.912+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 >> 172.21.15.81:0/3809065109 conn(0x7fb72806a7b0 msgr2=0x7fb72806bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.916+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 shutdown_connections 2024-09-13T18:55:27.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:27.916+0000 7fb72ce00700 1 -- 172.21.15.81:0/3809065109 wait complete. 2024-09-13T18:55:27.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:55:27.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub resume 2024-09-13T18:55:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.112+0000 7f8543600700 1 Processor -- start 2024-09-13T18:55:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.112+0000 7f8543600700 1 -- start start 2024-09-13T18:55:28.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f8543600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c157470 0x7f853c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f8543600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f853c0725c0 0x7f853c15d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f8543600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c157850 con 0x7f853c06ed70 2024-09-13T18:55:28.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f8543600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c15dd20 con 0x7f853c0725c0 2024-09-13T18:55:28.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f8543600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c15e000 con 0x7f853c157470 2024-09-13T18:55:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f853c0725c0 0x7f853c15d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f853c0725c0 0x7f853c15d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41310/0 (socket says 172.21.15.81:41310) 2024-09-13T18:55:28.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 -- 172.21.15.81:0/1628432702 learned_addr learned my addr 172.21.15.81:0/1628432702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f8540c00700 1 --2- 172.21.15.81:0/1628432702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c157470 0x7f853c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 -- 172.21.15.81:0/1628432702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c157470 msgr2=0x7f853c15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 --2- 172.21.15.81:0/1628432702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c157470 0x7f853c15a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 -- 172.21.15.81:0/1628432702 >> v1:172.21.15.178:6789/0 conn(0x7f853c06ed70 legacy=0x7f853c0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 -- 172.21.15.81:0/1628432702 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c159ff0 con 0x7f853c0725c0 2024-09-13T18:55:28.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853be00700 1 --2- 172.21.15.81:0/1628432702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c0725c0 0x7f853c15d4d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f8528009910 tx=0x7f8528009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617717f51db0f80a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853b400700 1 -- 172.21.15.81:0/1628432702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528011830 con 0x7f853c0725c0 2024-09-13T18:55:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853b400700 1 -- 172.21.15.81:0/1628432702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528011990 con 0x7f853c0725c0 2024-09-13T18:55:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.116+0000 7f853b400700 1 -- 172.21.15.81:0/1628432702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528011d40 con 0x7f853c0725c0 2024-09-13T18:55:28.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 -- 172.21.15.81:0/1628432702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c0725c0 msgr2=0x7f853c15d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 --2- 172.21.15.81:0/1628432702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c0725c0 0x7f853c15d4d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f8528009910 tx=0x7f8528009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:28.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 -- 172.21.15.81:0/1628432702 shutdown_connections 2024-09-13T18:55:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 --2- 172.21.15.81:0/1628432702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c0725c0 0x7f853c15d4d0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 --2- 172.21.15.81:0/1628432702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c157470 0x7f853c15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 -- 172.21.15.81:0/1628432702 >> 172.21.15.81:0/1628432702 conn(0x7f853c0b1e10 msgr2=0x7f853c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 -- 172.21.15.81:0/1628432702 shutdown_connections 2024-09-13T18:55:28.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 -- 172.21.15.81:0/1628432702 wait complete. 2024-09-13T18:55:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 Processor -- start 2024-09-13T18:55:28.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.120+0000 7f8543600700 1 -- start start 2024-09-13T18:55:28.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 0x7f853c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c0725c0 0x7f853c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f853c157470 0x7f853c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c14da20 con 0x7f853c06ed70 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0ca960 con 0x7f853c157470 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0cac40 con 0x7f853c0725c0 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 0x7f853c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 0x7f853c0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41324/0 (socket says 172.21.15.81:41324) 2024-09-13T18:55:28.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 -- 172.21.15.81:0/4056948838 learned_addr learned my addr 172.21.15.81:0/4056948838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 -- 172.21.15.81:0/4056948838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c0725c0 msgr2=0x7f853c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c0725c0 0x7f853c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 -- 172.21.15.81:0/4056948838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f853c157470 msgr2=0x7f853c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f853c157470 0x7f853c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 -- 172.21.15.81:0/4056948838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009570 con 0x7f853c06ed70 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8540c00700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 0x7f853c0ca260 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9d0 tx=0x7f853000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8538c00700 1 -- 172.21.15.81:0/4056948838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530009720 con 0x7f853c06ed70 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8538c00700 1 -- 172.21.15.81:0/4056948838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000c850 con 0x7f853c06ed70 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c0caf20 con 0x7f853c06ed70 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8538c00700 1 -- 172.21.15.81:0/4056948838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000cbc0 con 0x7f853c06ed70 2024-09-13T18:55:28.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.124+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c143760 con 0x7f853c06ed70 2024-09-13T18:55:28.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.128+0000 7f8538c00700 1 -- 172.21.15.81:0/4056948838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f853000cd20 con 0x7f853c06ed70 2024-09-13T18:55:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.128+0000 7f8538c00700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f851c066730 0x7f851c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8538c00700 1 -- 172.21.15.81:0/4056948838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8530084490 con 0x7f853c06ed70 2024-09-13T18:55:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f853be00700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f851c066730 0x7f851c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f853be00700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f851c066730 0x7f851c068bf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8528009910 tx=0x7f8528010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 Processor -- start 2024-09-13T18:55:28.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 -- start start 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29dac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dabd00 0x29dcdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dce270 0x29d815d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29d15010 con 0x29dcd950 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ca2f40 con 0x29dce270 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29cf5e30 con 0x29dabd00 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29dac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29dac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41338/0 (socket says 172.21.15.81:41338) 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 -- 172.21.15.81:0/4146488028 learned_addr learned my addr 172.21.15.81:0/4146488028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f853be00700 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dabd00 0x29dcdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8541600700 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dce270 0x29d815d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 -- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dabd00 msgr2=0x29dcdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dabd00 0x29dcdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 -- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dce270 msgr2=0x29d815d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dce270 0x29d815d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.132+0000 7f8540c00700 1 -- 172.21.15.81:0/4146488028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29b61a40 con 0x29dcd950 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f8540c00700 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29dac240 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f8530054fc0 tx=0x7f85300552c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e960946de46c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f852d200700 1 -- 172.21.15.81:0/4146488028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853005d6b0 con 0x29dcd950 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f852d200700 1 -- 172.21.15.81:0/4146488028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530053660 con 0x29dcd950 2024-09-13T18:55:28.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f852d200700 1 -- 172.21.15.81:0/4146488028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300842c0 con 0x29dcd950 2024-09-13T18:55:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 -- 172.21.15.81:0/4146488028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 msgr2=0x29dac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29dac240 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f8530054fc0 tx=0x7f85300552c0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 -- 172.21.15.81:0/4146488028 shutdown_connections 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dce270 0x29d815d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dabd00 0x29dcdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 --2- 172.21.15.81:0/4146488028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29dac240 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 -- 172.21.15.81:0/4146488028 >> 172.21.15.81:0/4146488028 conn(0x29b165b0 msgr2=0x29d879b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 -- 172.21.15.81:0/4146488028 shutdown_connections 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 -- 172.21.15.81:0/4146488028 wait complete. 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 -- start start 2024-09-13T18:55:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 Processor -- start 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.136+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dcd950 0x29dab0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 0x29dcc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29cf1150 con 0x29dce270 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ceeeb0 con 0x29dabd00 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29cac8e0 con 0x29dcd950 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 10 client.0 _ll_register_callbacks cb 0x29c8b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 0x29dcc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 0x29dcc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41340/0 (socket says 172.21.15.81:41340) 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 -- 172.21.15.81:0/2856035969 learned_addr learned my addr 172.21.15.81:0/2856035969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f853be00700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dcd950 0x29dab0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8540c00700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 -- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dcd950 msgr2=0x29dab0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dcd950 0x29dab0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 -- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 msgr2=0x29dae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 -- 172.21.15.81:0/2856035969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c143760 con 0x29dce270 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8540c00700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8541600700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 0x29dcc530 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f853400e7b0 tx=0x7f853400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340d10ae3b50d6a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8521600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8521600700 1 -- 172.21.15.81:0/2856035969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534003c30 con 0x29dce270 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8521600700 1 -- 172.21.15.81:0/2856035969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8534003d90 con 0x29dce270 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29b232c0 con 0x29dce270 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8521600700 1 -- 172.21.15.81:0/2856035969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8534001be0 con 0x29dce270 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 10 client.9549 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x29cb5290 con 0x29dce270 2024-09-13T18:55:28.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8521600700 1 -- 172.21.15.81:0/2856035969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29b232c0 con 0x29dce270 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8521600700 1 -- 172.21.15.81:0/2856035969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f85340050d0 con 0x29dce270 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 10 client.9549 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 10 client.9549 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 20 client.9549 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29dad190 0x29dad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 4 client.9549 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29b6d540 con 0x29dad190 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.140+0000 7f8540c00700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29dad190 0x29dad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f8540c00700 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29dad190 0x29dad570 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e25233cd7c51944 server_cookie=9bebac66ab5dc87 in_seq=0 out_seq=0 2024-09-13T18:55:28.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f8521600700 10 client.9549 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f8521600700 1 -- 172.21.15.81:0/2856035969 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x29b6d540 con 0x29dad190 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f8521600700 10 client.9549 handle_command_reply: tid=0 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 client.9549 shutdown 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 msgr2=0x29dcc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 0x29dcc530 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f853400e7b0 tx=0x7f853400eb70 comp rx=0 tx=0).stop 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 shutdown_connections 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29dad190 0x29dad570 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dce270 0x29dcc530 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dcd950 0x29dab0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 --2- 172.21.15.81:0/2856035969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f8521600700 0 client.9549 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 >> 172.21.15.81:0/2856035969 conn(0x29b165b0 msgr2=0x29d80db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 shutdown_connections 2024-09-13T18:55:28.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 1 -- 172.21.15.81:0/2856035969 wait complete. 2024-09-13T18:55:28.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.144+0000 7f85468d3740 20 client.9549 trim_cache size 0 max 16384 2024-09-13T18:55:28.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 Processor -- start 2024-09-13T18:55:28.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 -- start start 2024-09-13T18:55:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dddbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29daab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29dab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29b9ab80 con 0x29dcd950 2024-09-13T18:55:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29c8d620 con 0x29dabd00 2024-09-13T18:55:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29cec6c0 con 0x29dce270 2024-09-13T18:55:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f853be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29daab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f853be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29daab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41344/0 (socket says 172.21.15.81:41344) 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f8540c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dddbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.164+0000 7f853be00700 1 -- 172.21.15.81:0/2101043073 learned_addr learned my addr 172.21.15.81:0/2101043073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8541600700 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29dab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8540c00700 1 -- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 msgr2=0x29dab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8540c00700 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29dab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8540c00700 1 -- 172.21.15.81:0/2101043073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 msgr2=0x29daab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8540c00700 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29daab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8540c00700 1 -- 172.21.15.81:0/2101043073 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29c9b4c0 con 0x29dabd00 2024-09-13T18:55:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f8540c00700 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dddbf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8530000c00 tx=0x7f8530021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0dfab365547c7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f852dc00700 1 -- 172.21.15.81:0/2101043073 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853005d6b0 con 0x29dabd00 2024-09-13T18:55:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f852dc00700 1 -- 172.21.15.81:0/2101043073 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530082040 con 0x29dabd00 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f852dc00700 1 -- 172.21.15.81:0/2101043073 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530055520 con 0x29dabd00 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 -- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 msgr2=0x29dddbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dddbf0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8530000c00 tx=0x7f8530021000 comp rx=0 tx=0).stop 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 -- 172.21.15.81:0/2101043073 shutdown_connections 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29dab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29daab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 --2- 172.21.15.81:0/2101043073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29dddbf0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 -- 172.21.15.81:0/2101043073 >> 172.21.15.81:0/2101043073 conn(0x29b165b0 msgr2=0x29dc92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 -- 172.21.15.81:0/2101043073 shutdown_connections 2024-09-13T18:55:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 -- 172.21.15.81:0/2101043073 wait complete. 2024-09-13T18:55:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 -- start start 2024-09-13T18:55:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.168+0000 7f85468d3740 1 Processor -- start 2024-09-13T18:55:28.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29df4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29e36e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29de45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x29c78a50 con 0x29dcd950 2024-09-13T18:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29cbfc00 con 0x29dabd00 2024-09-13T18:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29de5c60 con 0x29dce270 2024-09-13T18:55:28.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 10 client.0 _ll_register_callbacks cb 0x29cbe8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29e36e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29e36e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41358/0 (socket says 172.21.15.81:41358) 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 -- 172.21.15.81:0/1783636490 learned_addr learned my addr 172.21.15.81:0/1783636490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8540c00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29df4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8541600700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29de45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 -- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 msgr2=0x29de45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29de45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 -- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 msgr2=0x29df4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29df4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 -- 172.21.15.81:0/1783636490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x29b61a40 con 0x29dcd950 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8540c00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29df4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f853be00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29e36e90 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8528013000 tx=0x7f85280047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e916fac322fa0698 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8521600700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8521600700 1 -- 172.21.15.81:0/1783636490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852802d070 con 0x29dcd950 2024-09-13T18:55:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8530053660 con 0x29dcd950 2024-09-13T18:55:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8521600700 1 -- 172.21.15.81:0/1783636490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8528020070 con 0x29dcd950 2024-09-13T18:55:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8521600700 1 -- 172.21.15.81:0/1783636490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8528003cb0 con 0x29dcd950 2024-09-13T18:55:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 10 client.9555 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x29c8f790 con 0x29dcd950 2024-09-13T18:55:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8521600700 1 -- 172.21.15.81:0/1783636490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8530053660 con 0x29dcd950 2024-09-13T18:55:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8521600700 1 -- 172.21.15.81:0/1783636490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f8528027420 con 0x29dcd950 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 10 client.9555 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 10 client.9555 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 20 client.9555 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29de4b10 0x29e380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 4 client.9555 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x29b922c0 con 0x29de4b10 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.172+0000 7f8540c00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29de4b10 0x29e380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8540c00700 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29de4b10 0x29e380c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0019b1b12df030 server_cookie=d4e056f5d55c6ff5 in_seq=0 out_seq=0 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8521600700 10 client.9555 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8521600700 1 -- 172.21.15.81:0/1783636490 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x29b922c0 con 0x29de4b10 2024-09-13T18:55:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8521600700 10 client.9555 handle_command_reply: tid=0 2024-09-13T18:55:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 client.9555 shutdown 2024-09-13T18:55:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 msgr2=0x29e36e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29e36e90 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8528013000 tx=0x7f85280047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 shutdown_connections 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x29de4b10 0x29e380c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29dce270 0x29de45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x29dcd950 0x29e36e90 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8521600700 0 client.9555 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 --2- 172.21.15.81:0/1783636490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29dabd00 0x29df4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 >> 172.21.15.81:0/1783636490 conn(0x29b165b0 msgr2=0x29dddbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 shutdown_connections 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 1 -- 172.21.15.81:0/1783636490 wait complete. 2024-09-13T18:55:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f85468d3740 20 client.9555 trim_cache size 0 max 16384 2024-09-13T18:55:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:28.187 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0 2024-09-13T18:55:28.187 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f851c066730 msgr2=0x7f851c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f851c066730 0x7f851c068bf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8528009910 tx=0x7f8528010000 comp rx=0 tx=0).stop 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 msgr2=0x7f853c0ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 0x7f853c0ca260 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f853000e9d0 tx=0x7f853000ed90 comp rx=0 tx=0).stop 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 shutdown_connections 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f851c066730 0x7f851c068bf0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f853c157470 0x7f853c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f853c0725c0 0x7f853c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 --2- 172.21.15.81:0/4056948838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f853c06ed70 0x7f853c0ca260 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 >> 172.21.15.81:0/4056948838 conn(0x7f853c0b1e10 msgr2=0x7f853c159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 shutdown_connections 2024-09-13T18:55:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.176+0000 7f8543600700 1 -- 172.21.15.81:0/4056948838 wait complete. 2024-09-13T18:55:28.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-13T18:55:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.376+0000 7f6a87200700 1 Processor -- start 2024-09-13T18:55:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.376+0000 7f6a87200700 1 -- start start 2024-09-13T18:55:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a87200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6a8806dfb0 0x7f6a8815db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a87200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a88159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a87200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a880b1c20 con 0x7f6a88070a40 2024-09-13T18:55:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a87200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a880b3c90 con 0x7f6a8806dfb0 2024-09-13T18:55:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a87200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880b2030 con 0x7f6a88072000 2024-09-13T18:55:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f6a88070a40 0x7f6a880718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:42334/0 (socket says 172.21.15.81:42334) 2024-09-13T18:55:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85400700 1 -- 172.21.15.81:0/1129106711 learned_addr learned my addr 172.21.15.81:0/1129106711 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a86800700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a88159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85e00700 1 --2- 172.21.15.81:0/1129106711 >> v2:172.21.15.178:3300/0 conn(0x7f6a8806dfb0 0x7f6a8815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a84a00700 1 -- 172.21.15.81:0/1129106711 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732253317 0 0) 0x7f6a880b1c20 con 0x7f6a88070a40 2024-09-13T18:55:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a84a00700 1 -- 172.21.15.81:0/1129106711 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a6c0035d0 con 0x7f6a88070a40 2024-09-13T18:55:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85e00700 1 -- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 msgr2=0x7f6a88159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85e00700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a88159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85e00700 1 -- 172.21.15.81:0/1129106711 >> v1:172.21.15.178:6789/0 conn(0x7f6a88070a40 legacy=0x7f6a880718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a85e00700 1 -- 172.21.15.81:0/1129106711 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880b2800 con 0x7f6a8806dfb0 2024-09-13T18:55:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.380+0000 7f6a86800700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a88159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a85e00700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a8806dfb0 0x7f6a8815db40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009850 tx=0x7f6a78009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c230251cc4eba76a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a84a00700 1 -- 172.21.15.81:0/1129106711 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78011830 con 0x7f6a8806dfb0 2024-09-13T18:55:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a84a00700 1 -- 172.21.15.81:0/1129106711 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78011990 con 0x7f6a8806dfb0 2024-09-13T18:55:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a84a00700 1 -- 172.21.15.81:0/1129106711 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78011d00 con 0x7f6a8806dfb0 2024-09-13T18:55:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 -- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a8806dfb0 msgr2=0x7f6a8815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a8806dfb0 0x7f6a8815db40 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009850 tx=0x7f6a78009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 -- 172.21.15.81:0/1129106711 shutdown_connections 2024-09-13T18:55:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a88159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 --2- 172.21.15.81:0/1129106711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a8806dfb0 0x7f6a8815db40 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 -- 172.21.15.81:0/1129106711 >> 172.21.15.81:0/1129106711 conn(0x7f6a880b4770 msgr2=0x7f6a880b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 -- 172.21.15.81:0/1129106711 shutdown_connections 2024-09-13T18:55:28.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.384+0000 7f6a87200700 1 -- 172.21.15.81:0/1129106711 wait complete. 2024-09-13T18:55:28.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 Processor -- start 2024-09-13T18:55:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 -- start start 2024-09-13T18:55:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 0x7f6a881524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a88070a40 0x7f6a8815e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a881607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88159fd0 con 0x7f6a8806dfb0 2024-09-13T18:55:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88159cf0 con 0x7f6a88070a40 2024-09-13T18:55:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a87200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881560d0 con 0x7f6a88072000 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a85e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 0x7f6a881524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a85e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 0x7f6a881524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41366/0 (socket says 172.21.15.81:41366) 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.388+0000 7f6a85e00700 1 -- 172.21.15.81:0/1340238823 learned_addr learned my addr 172.21.15.81:0/1340238823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a86800700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a881607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85400700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a88070a40 0x7f6a8815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85e00700 1 -- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 msgr2=0x7f6a881607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85e00700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a881607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85e00700 1 -- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a88070a40 msgr2=0x7f6a8815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85e00700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a88070a40 0x7f6a8815e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85e00700 1 -- 172.21.15.81:0/1340238823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009a70 con 0x7f6a8806dfb0 2024-09-13T18:55:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a85e00700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 0x7f6a881524f0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f6a780090b0 tx=0x7f6a78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a7e000700 1 -- 172.21.15.81:0/1340238823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78004610 con 0x7f6a8806dfb0 2024-09-13T18:55:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a7e000700 1 -- 172.21.15.81:0/1340238823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7801f070 con 0x7f6a8806dfb0 2024-09-13T18:55:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a780094b0 con 0x7f6a8806dfb0 2024-09-13T18:55:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a7e000700 1 -- 172.21.15.81:0/1340238823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780038e0 con 0x7f6a8806dfb0 2024-09-13T18:55:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.392+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8815eb40 con 0x7f6a8806dfb0 2024-09-13T18:55:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.396+0000 7f6a7e000700 1 -- 172.21.15.81:0/1340238823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a78003a40 con 0x7f6a8806dfb0 2024-09-13T18:55:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.396+0000 7f6a90574740 1 Processor -- start 2024-09-13T18:55:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.396+0000 7f6a7e000700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a68066730 0x7f6a68068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.396+0000 7f6a90574740 1 -- start start 2024-09-13T18:55:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.396+0000 7f6a7e000700 1 -- 172.21.15.81:0/1340238823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a78021070 con 0x7f6a8806dfb0 2024-09-13T18:55:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.396+0000 7f6a86800700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a68066730 0x7f6a68068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c834810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87e170 0x1c87e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c7c5010 con 0x1c87dd90 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a86800700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a68066730 0x7f6a68068bf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6a88153520 tx=0x7f6a8000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c752f40 con 0x1c833310 2024-09-13T18:55:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c7a5e30 con 0x1c87e170 2024-09-13T18:55:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c834810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c834810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41382/0 (socket says 172.21.15.81:41382) 2024-09-13T18:55:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 -- 172.21.15.81:0/2018250957 learned_addr learned my addr 172.21.15.81:0/2018250957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85400700 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a86800700 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87e170 0x1c87e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 -- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87e170 msgr2=0x1c87e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87e170 0x1c87e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 -- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 msgr2=0x1c85c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 -- 172.21.15.81:0/2018250957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c611a40 con 0x1c87dd90 2024-09-13T18:55:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c834810 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f6a7805e680 tx=0x7f6a78006d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12793b306055421f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a72a00700 1 -- 172.21.15.81:0/2018250957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7806e070 con 0x1c87dd90 2024-09-13T18:55:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a72a00700 1 -- 172.21.15.81:0/2018250957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7806e1d0 con 0x1c87dd90 2024-09-13T18:55:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a72a00700 1 -- 172.21.15.81:0/2018250957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780567c0 con 0x1c87dd90 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- 172.21.15.81:0/2018250957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 msgr2=0x1c834810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c834810 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f6a7805e680 tx=0x7f6a78006d90 comp rx=0 tx=0).stop 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- 172.21.15.81:0/2018250957 shutdown_connections 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87e170 0x1c87e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 --2- 172.21.15.81:0/2018250957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c834810 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- 172.21.15.81:0/2018250957 >> 172.21.15.81:0/2018250957 conn(0x1c5c65b0 msgr2=0x1c837b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- 172.21.15.81:0/2018250957 shutdown_connections 2024-09-13T18:55:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.400+0000 7f6a90574740 1 -- 172.21.15.81:0/2018250957 wait complete. 2024-09-13T18:55:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 -- start start 2024-09-13T18:55:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 Processor -- start 2024-09-13T18:55:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c85d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c87c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c7a1150 con 0x1c87e170 2024-09-13T18:55:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c79eeb0 con 0x1c833310 2024-09-13T18:55:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c75c8e0 con 0x1c87dd90 2024-09-13T18:55:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a90574740 10 client.0 _ll_register_callbacks cb 0x1c73b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c87c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c87c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41390/0 (socket says 172.21.15.81:41390) 2024-09-13T18:55:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 -- 172.21.15.81:0/216438917 learned_addr learned my addr 172.21.15.81:0/216438917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a85400700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c85d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a85e00700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 -- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 msgr2=0x1c85d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c85d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 -- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 msgr2=0x1c85faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a86800700 1 -- 172.21.15.81:0/216438917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8815eb40 con 0x1c87e170 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.404+0000 7f6a85e00700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a86800700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c87c780 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009fa0 tx=0x7f6a80004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e828816fd5f53900 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 1 -- 172.21.15.81:0/216438917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000e040 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 1 -- 172.21.15.81:0/216438917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a80023620 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c5d32c0 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 1 -- 172.21.15.81:0/216438917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a80017e70 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 10 client.9564 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x1c765290 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 1 -- 172.21.15.81:0/216438917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c5d32c0 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 1 -- 172.21.15.81:0/216438917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f6a800237e0 con 0x1c87e170 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 10 client.9564 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 10 client.9564 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 20 client.9564 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c85de00 0x1c85ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 4 client.9564 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c61d540 con 0x1c85de00 2024-09-13T18:55:28.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a85e00700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c85de00 0x1c85ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 10 client.9564 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a85e00700 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c85de00 0x1c85ae40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da84872bfb7e075a server_cookie=5a38947988567ac3 in_seq=0 out_seq=0 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 1 -- 172.21.15.81:0/216438917 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1c61d540 con 0x1c85de00 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 10 client.9564 handle_command_reply: tid=0 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 client.9564 shutdown 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 msgr2=0x1c87c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c87c780 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009fa0 tx=0x7f6a80004b60 comp rx=0 tx=0).stop 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 shutdown_connections 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c87c780 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c85d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c85de00 0x1c85ae40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 --2- 172.21.15.81:0/216438917 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c85faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a67400700 0 client.9564 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:28.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.408+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 >> 172.21.15.81:0/216438917 conn(0x1c5c65b0 msgr2=0x1c85c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.412+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 shutdown_connections 2024-09-13T18:55:28.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.412+0000 7f6a90574740 1 -- 172.21.15.81:0/216438917 wait complete. 2024-09-13T18:55:28.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.412+0000 7f6a90574740 20 client.9564 trim_cache size 0 max 16384 2024-09-13T18:55:28.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 Processor -- start 2024-09-13T18:55:28.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 -- start start 2024-09-13T18:55:28.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c833310 0x1c87c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c886a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c87e170 0x1c886f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c64ab80 con 0x1c87dd90 2024-09-13T18:55:28.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c76d1e0 con 0x1c87e170 2024-09-13T18:55:28.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c76fc00 con 0x1c833310 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c886a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c886a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41400/0 (socket says 172.21.15.81:41400) 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 -- 172.21.15.81:0/2226628183 learned_addr learned my addr 172.21.15.81:0/2226628183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c833310 0x1c87c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a86800700 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c87e170 0x1c886f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 -- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c833310 msgr2=0x1c87c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c833310 0x1c87c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 -- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c87e170 msgr2=0x1c886f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c87e170 0x1c886f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 -- 172.21.15.81:0/2226628183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c74b4c0 con 0x1c87dd90 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a85400700 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c886a40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f6a8815e080 tx=0x7f6a74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7939352f50c272d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a73400700 1 -- 172.21.15.81:0/2226628183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740078d0 con 0x1c87dd90 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a73400700 1 -- 172.21.15.81:0/2226628183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a74016480 con 0x1c87dd90 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.432+0000 7f6a73400700 1 -- 172.21.15.81:0/2226628183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740167f0 con 0x1c87dd90 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 -- 172.21.15.81:0/2226628183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 msgr2=0x1c886a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c886a40 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f6a8815e080 tx=0x7f6a74000bc0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 -- 172.21.15.81:0/2226628183 shutdown_connections 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c87e170 0x1c886f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87dd90 0x1c886a40 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 --2- 172.21.15.81:0/2226628183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c833310 0x1c87c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 -- 172.21.15.81:0/2226628183 >> 172.21.15.81:0/2226628183 conn(0x1c5c65b0 msgr2=0x1c87b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 -- 172.21.15.81:0/2226628183 shutdown_connections 2024-09-13T18:55:28.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 -- 172.21.15.81:0/2226628183 wait complete. 2024-09-13T18:55:28.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 -- start start 2024-09-13T18:55:28.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.436+0000 7f6a90574740 1 Processor -- start 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c8ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c8a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c8a6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c79c6c0 con 0x1c87e170 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c85bd50 con 0x1c833310 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c728a50 con 0x1c87dd90 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 10 client.0 _ll_register_callbacks cb 0x1c79d610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c8a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c8a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41402/0 (socket says 172.21.15.81:41402) 2024-09-13T18:55:28.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 -- 172.21.15.81:0/2342098236 learned_addr learned my addr 172.21.15.81:0/2342098236 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a85400700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c8a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c8ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 -- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 msgr2=0x1c8a5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c8a5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 -- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 msgr2=0x1c8ea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c8ea6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 -- 172.21.15.81:0/2342098236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7400f040 con 0x1c87e170 2024-09-13T18:55:28.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c8ea6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a86800700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c8a6470 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f6a800070c0 tx=0x7f6a80004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5761068be89f536 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a67400700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a67400700 1 -- 172.21.15.81:0/2342098236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000e040 con 0x1c87e170 2024-09-13T18:55:28.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a67400700 1 -- 172.21.15.81:0/2342098236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a80023620 con 0x1c87e170 2024-09-13T18:55:28.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a7806e1d0 con 0x1c87e170 2024-09-13T18:55:28.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a67400700 1 -- 172.21.15.81:0/2342098236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a800237e0 con 0x1c87e170 2024-09-13T18:55:28.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 10 client.9570 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x1c73f790 con 0x1c87e170 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a67400700 1 -- 172.21.15.81:0/2342098236 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7806e1d0 con 0x1c87e170 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a67400700 1 -- 172.21.15.81:0/2342098236 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f6a80034440 con 0x1c87e170 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 10 client.9570 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 10 client.9570 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.c 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 20 client.9570 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c894e60 0x1c8a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 4 client.9570 mds_command: new command op to 8907 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 --> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1c6422c0 con 0x1c894e60 2024-09-13T18:55:28.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.440+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c894e60 0x1c8a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a67400700 10 client.9570 ms_handle_connect on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:28.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a85e00700 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c894e60 0x1c8a69b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee4f7a758ea74d0c server_cookie=b62d3cc04f2cd934 in_seq=0 out_seq=0 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a67400700 1 -- 172.21.15.81:0/2342098236 <== mds.1 v2:172.21.15.81:6834/4220647450 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x1c6422c0 con 0x1c894e60 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a67400700 10 client.9570 handle_command_reply: tid=0 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 client.9570 shutdown 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 msgr2=0x1c8a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c8a6470 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f6a800070c0 tx=0x7f6a80004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 shutdown_connections 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1c87e170 0x1c8a6470 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c87dd90 0x1c8a5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.81:6834/4220647450,v1:172.21.15.81:6836/4220647450] conn(0x1c894e60 0x1c8a69b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 --2- 172.21.15.81:0/2342098236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c833310 0x1c8ea6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 >> 172.21.15.81:0/2342098236 conn(0x1c5c65b0 msgr2=0x1c87c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a67400700 0 client.9570 ms_handle_reset on v2:172.21.15.81:6834/4220647450 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 shutdown_connections 2024-09-13T18:55:28.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 1 -- 172.21.15.81:0/2342098236 wait complete. 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a90574740 20 client.9570 trim_cache size 0 max 16384 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:28.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:28.455 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:28.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a68066730 msgr2=0x7f6a68068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a68066730 0x7f6a68068bf0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6a88153520 tx=0x7f6a8000b040 comp rx=0 tx=0).stop 2024-09-13T18:55:28.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 msgr2=0x7f6a881524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 0x7f6a881524f0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f6a780090b0 tx=0x7f6a78004770 comp rx=0 tx=0).stop 2024-09-13T18:55:28.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 shutdown_connections 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6a68066730 0x7f6a68068bf0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a88072000 0x7f6a881607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a88070a40 0x7f6a8815e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 --2- 172.21.15.81:0/1340238823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a8806dfb0 0x7f6a881524f0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 >> 172.21.15.81:0/1340238823 conn(0x7f6a880b4770 msgr2=0x7f6a880ac960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 shutdown_connections 2024-09-13T18:55:28.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.444+0000 7f6a87200700 1 -- 172.21.15.81:0/1340238823 wait complete. 2024-09-13T18:55:28.476 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:28.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-13T18:55:28.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.648+0000 7f7ec5a00700 1 Processor -- start 2024-09-13T18:55:28.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.648+0000 7f7ec5a00700 1 -- start start 2024-09-13T18:55:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ec5a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 0x7f7ec016cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ec5a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec00ce470 con 0x7f7ec00d38e0 2024-09-13T18:55:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ec5a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec00b3460 con 0x7f7ec00cfa00 2024-09-13T18:55:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ec5a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00b41c0 con 0x7f7ec00cfde0 2024-09-13T18:55:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebe000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7ec00d38e0 0x7f7ec00d10a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59556/0 (socket says 172.21.15.81:59556) 2024-09-13T18:55:28.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebe000700 1 -- 172.21.15.81:0/2169787367 learned_addr learned my addr 172.21.15.81:0/2169787367 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:28.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 0x7f7ec016cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638365996 0 0) 0x7f7ec00ce470 con 0x7f7ec00d38e0 2024-09-13T18:55:28.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea40035d0 con 0x7f7ec00d38e0 2024-09-13T18:55:28.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 432079696 0 0) 0x7f7ea40035d0 con 0x7f7ec00d38e0 2024-09-13T18:55:28.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 msgr2=0x7f7ec016cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 0x7f7ec016cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 >> v1:172.21.15.178:6789/0 conn(0x7f7ec00cfa00 legacy=0x7f7ec00d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec00b44a0 con 0x7f7ec00d38e0 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f7eac001690 con 0x7f7ec00d38e0 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 >> v1:172.21.15.81:6789/0 conn(0x7f7ec00d38e0 legacy=0x7f7ec00d10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 0x7f7ea4003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea4003f90 0x7f7ea4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea4004db0 0x7f7ea4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00b41c0 con 0x7f7ea4004db0 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400ba90 con 0x7f7ea4003f90 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea400bc50 con 0x7f7ec00cfde0 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea4004db0 0x7f7ea4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 0x7f7ea4003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.652+0000 7f7ebe000700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea4003f90 0x7f7ea4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 -- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 msgr2=0x7f7ea4003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00cfde0 0x7f7ea4003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 -- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea4003f90 msgr2=0x7f7ea4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea4003f90 0x7f7ea4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 -- 172.21.15.81:0/2169787367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40035d0 con 0x7f7ea4004db0 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea4004db0 0x7f7ea4005230 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009fc0 tx=0x7f7ea40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ab0de2798f5b52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800ec30 con 0x7f7ea4004db0 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb800f040 con 0x7f7ea4004db0 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebd600700 1 -- 172.21.15.81:0/2169787367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8014480 con 0x7f7ea4004db0 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2169787367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea4004db0 msgr2=0x7f7ea4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2169787367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ea4004db0 0x7f7ea4005230 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009fc0 tx=0x7f7ea40058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ebf400700 1 -- 172.21.15.81:0/2169787367 reap_dead start 2024-09-13T18:55:28.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2169787367 shutdown_connections 2024-09-13T18:55:28.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2169787367 >> 172.21.15.81:0/2169787367 conn(0x7f7ec00d2dc0 msgr2=0x7f7ec00d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2169787367 shutdown_connections 2024-09-13T18:55:28.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.656+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2169787367 wait complete. 2024-09-13T18:55:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 Processor -- start 2024-09-13T18:55:28.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 -- start start 2024-09-13T18:55:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea4004db0 0x7f7ec01ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 0x7f7ec01df700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec006ebe0 0x7f7ec01dfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00c76c0 con 0x7f7ec006e760 2024-09-13T18:55:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0071d10 con 0x7f7ec006ebe0 2024-09-13T18:55:28.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.660+0000 7f7ec5a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0071470 con 0x7f7ea4004db0 2024-09-13T18:55:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 0x7f7ec01df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 0x7f7ec01df700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41420/0 (socket says 172.21.15.81:41420) 2024-09-13T18:55:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 -- 172.21.15.81:0/2057876234 learned_addr learned my addr 172.21.15.81:0/2057876234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea4004db0 0x7f7ec01ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec006ebe0 0x7f7ec01dfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 -- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea4004db0 msgr2=0x7f7ec01ecdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea4004db0 0x7f7ec01ecdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 -- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec006ebe0 msgr2=0x7f7ec01dfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec006ebe0 0x7f7ec01dfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 -- 172.21.15.81:0/2057876234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0071750 con 0x7f7ec006e760 2024-09-13T18:55:28.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ebe000700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 0x7f7ec01df700 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00eaf0 tx=0x7f7eac00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7eb6a00700 1 -- 172.21.15.81:0/2057876234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac005e20 con 0x7f7ec006e760 2024-09-13T18:55:28.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7eb6a00700 1 -- 172.21.15.81:0/2057876234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac00c570 con 0x7f7ec006e760 2024-09-13T18:55:28.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec0071a30 con 0x7f7ec006e760 2024-09-13T18:55:28.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7eb6a00700 1 -- 172.21.15.81:0/2057876234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac00c920 con 0x7f7ec006e760 2024-09-13T18:55:28.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.664+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec01ed330 con 0x7f7ec006e760 2024-09-13T18:55:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.668+0000 7f7eb6a00700 1 -- 172.21.15.81:0/2057876234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7eac00ca80 con 0x7f7ec006e760 2024-09-13T18:55:28.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.668+0000 7f7eb6a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea0066760 0x7f7ea0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.668+0000 7f7eb6a00700 1 -- 172.21.15.81:0/2057876234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7eac083ee0 con 0x7f7ec006e760 2024-09-13T18:55:28.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.668+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea0066760 0x7f7ea0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.668+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea0066760 0x7f7ea0068c20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0007fd0 tx=0x7f7eb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 Processor -- start 2024-09-13T18:55:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 -- start start 2024-09-13T18:55:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xef0e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xef2fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xeee35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xee77010 con 0xef2f950 2024-09-13T18:55:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xee04f40 con 0xef0dd00 2024-09-13T18:55:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xee57e30 con 0xef30270 2024-09-13T18:55:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xef0e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xef0e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41428/0 (socket says 172.21.15.81:41428) 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 -- 172.21.15.81:0/2821490290 learned_addr learned my addr 172.21.15.81:0/2821490290 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebf400700 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xeee35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebe000700 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xef2fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 -- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 msgr2=0xeee35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xeee35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 -- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 msgr2=0xef2fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xef2fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 -- 172.21.15.81:0/2821490290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xecc3a40 con 0xef2f950 2024-09-13T18:55:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.672+0000 7f7ebea00700 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xef0e240 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0012cb0 tx=0x7f7eb0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38907e464a9af6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7eab400700 1 -- 172.21.15.81:0/2821490290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0015b10 con 0xef2f950 2024-09-13T18:55:28.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7eab400700 1 -- 172.21.15.81:0/2821490290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0015c70 con 0xef2f950 2024-09-13T18:55:28.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7eab400700 1 -- 172.21.15.81:0/2821490290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0021410 con 0xef2f950 2024-09-13T18:55:28.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/2821490290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 msgr2=0xef0e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xef0e240 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0012cb0 tx=0x7f7eb0015000 comp rx=0 tx=0).stop 2024-09-13T18:55:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/2821490290 shutdown_connections 2024-09-13T18:55:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xeee35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xef2fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/2821490290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xef0e240 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/2821490290 >> 172.21.15.81:0/2821490290 conn(0xec785b0 msgr2=0xeee99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/2821490290 shutdown_connections 2024-09-13T18:55:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/2821490290 wait complete. 2024-09-13T18:55:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- start start 2024-09-13T18:55:28.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 Processor -- start 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xeef6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xeef8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef0eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xee53150 con 0xef2f950 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xee50eb0 con 0xef0dd00 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xee0e8e0 con 0xef30270 2024-09-13T18:55:28.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.676+0000 7f7ec8eb3740 10 client.0 _ll_register_callbacks cb 0xeded670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xeef8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xeef8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41440/0 (socket says 172.21.15.81:41440) 2024-09-13T18:55:28.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 -- 172.21.15.81:0/4277694573 learned_addr learned my addr 172.21.15.81:0/4277694573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebea00700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xeef6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebf400700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef0eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 -- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 msgr2=0xef0eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef0eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 -- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 msgr2=0xeef6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xeef6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 -- 172.21.15.81:0/4277694573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0012960 con 0xef2f950 2024-09-13T18:55:28.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebe000700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xeef8250 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7eac054a10 tx=0x7f7eac054dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89dfc1df5b1a95b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7e9fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7e9fe00700 1 -- 172.21.15.81:0/4277694573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac054200 con 0xef2f950 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xec852c0 con 0xef2f950 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7e9fe00700 1 -- 172.21.15.81:0/4277694573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7eac054360 con 0xef2f950 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7e9fe00700 1 -- 172.21.15.81:0/4277694573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eac06f020 con 0xef2f950 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 10 client.9582 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0xee17290 con 0xef2f950 2024-09-13T18:55:28.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7e9fe00700 1 -- 172.21.15.81:0/4277694573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac076080 con 0xef2f950 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7e9fe00700 1 -- 172.21.15.81:0/4277694573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f7eac055d20 con 0xef2f950 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 10 client.9582 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 10 client.9582 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 20 client.9582 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef2b760 0xeef8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 4 client.9582 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xeccf540 con 0xef2b760 2024-09-13T18:55:28.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.680+0000 7f7ebea00700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef2b760 0xeef8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ebea00700 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef2b760 0xeef8e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54505e067f59de76 server_cookie=6da971c9e836fb1f in_seq=0 out_seq=0 2024-09-13T18:55:28.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7e9fe00700 10 client.9582 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7e9fe00700 1 -- 172.21.15.81:0/4277694573 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0xeccf540 con 0xef2b760 2024-09-13T18:55:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7e9fe00700 10 client.9582 handle_command_reply: tid=0 2024-09-13T18:55:28.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 client.9582 shutdown 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 msgr2=0xeef8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xeef8250 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7eac054a10 tx=0x7f7eac054dc0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 shutdown_connections 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef2b760 0xeef8e80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef0eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef2f950 0xeef8250 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7e9fe00700 0 client.9582 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:28.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/4277694573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef0dd00 0xeef6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 >> 172.21.15.81:0/4277694573 conn(0xec785b0 msgr2=0xeee4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 shutdown_connections 2024-09-13T18:55:28.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/4277694573 wait complete. 2024-09-13T18:55:28.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.684+0000 7f7ec8eb3740 20 client.9582 trim_cache size 0 max 16384 2024-09-13T18:55:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 Processor -- start 2024-09-13T18:55:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 -- start start 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 0xef0ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef42a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef42fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xecfcb80 con 0xef0dd00 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xee21c00 con 0xef2f950 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xee4e6c0 con 0xef30270 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ebea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 0xef0ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ebea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 0xef0ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41444/0 (socket says 172.21.15.81:41444) 2024-09-13T18:55:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.704+0000 7f7ebea00700 1 -- 172.21.15.81:0/3853386317 learned_addr learned my addr 172.21.15.81:0/3853386317 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebf400700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef42fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebea00700 1 -- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 msgr2=0xef42fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebe000700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef42a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebea00700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef42fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebea00700 1 -- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 msgr2=0xef42a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebea00700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef42a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebea00700 1 -- 172.21.15.81:0/3853386317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xedfd4c0 con 0xef0dd00 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebf400700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef42fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebe000700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef42a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ebea00700 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 0xef0ceb0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0023040 tx=0x7f7eb0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c385cc107c1cc751 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7eabe00700 1 -- 172.21.15.81:0/3853386317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0031070 con 0xef0dd00 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7eabe00700 1 -- 172.21.15.81:0/3853386317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0033b00 con 0xef0dd00 2024-09-13T18:55:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7eabe00700 1 -- 172.21.15.81:0/3853386317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0015b10 con 0xef0dd00 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/3853386317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 msgr2=0xef0ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 0xef0ceb0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0023040 tx=0x7f7eb0018000 comp rx=0 tx=0).stop 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/3853386317 shutdown_connections 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef30270 0xef42fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef42a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/3853386317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef0dd00 0xef0ceb0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/3853386317 >> 172.21.15.81:0/3853386317 conn(0xec785b0 msgr2=0xef48d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/3853386317 shutdown_connections 2024-09-13T18:55:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/3853386317 wait complete. 2024-09-13T18:55:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 -- start start 2024-09-13T18:55:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 Processor -- start 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef0dd00 0xef485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef8b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.708+0000 7f7ec8eb3740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 0xef8bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0xeee64c0 con 0xef30270 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xeddaa50 con 0xef2f950 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xeee8d20 con 0xef0dd00 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 10 client.0 _ll_register_callbacks cb 0xee208f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 0xef8bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 0xef8bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41458/0 (socket says 172.21.15.81:41458) 2024-09-13T18:55:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 -- 172.21.15.81:0/1141287867 learned_addr learned my addr 172.21.15.81:0/1141287867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebe000700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef8b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebea00700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef0dd00 0xef485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 -- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef0dd00 msgr2=0xef485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef0dd00 0xef485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 -- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 msgr2=0xef8b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef8b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 -- 172.21.15.81:0/1141287867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xecc3a40 con 0xef30270 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebe000700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef8b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ebf400700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 0xef8bc70 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8016000 tx=0x7f7eb8004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb32a8cb6908b0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7e9fe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7e9fe00700 1 -- 172.21.15.81:0/1141287867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8014890 con 0xef30270 2024-09-13T18:55:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7eb0015c70 con 0xef30270 2024-09-13T18:55:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7e9fe00700 1 -- 172.21.15.81:0/1141287867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7eb8022070 con 0xef30270 2024-09-13T18:55:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7e9fe00700 1 -- 172.21.15.81:0/1141287867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7eb80149f0 con 0xef30270 2024-09-13T18:55:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 10 client.9588 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0xedf1790 con 0xef30270 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7e9fe00700 1 -- 172.21.15.81:0/1141287867 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0015c70 con 0xef30270 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7e9fe00700 1 -- 172.21.15.81:0/1141287867 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f7eb8014b50 con 0xef30270 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 10 client.9588 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 10 client.9588 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 20 client.9588 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef48b20 0xef46780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 4 client.9588 mds_command: new command op to 7550 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.712+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 --> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xecf42c0 con 0xef48b20 2024-09-13T18:55:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ebea00700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef48b20 0xef46780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7e9fe00700 10 client.9588 ms_handle_connect on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ebea00700 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef48b20 0xef46780 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8a3da94983aed31 server_cookie=6922ce05b37e122d in_seq=0 out_seq=0 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7e9fe00700 1 -- 172.21.15.81:0/1141287867 <== mds.2 v2:172.21.15.178:6833/1735589745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0xecf42c0 con 0xef48b20 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7e9fe00700 10 client.9588 handle_command_reply: tid=0 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 client.9588 shutdown 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 msgr2=0xef8bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 0xef8bc70 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8016000 tx=0x7f7eb8004b60 comp rx=0 tx=0).stop 2024-09-13T18:55:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 shutdown_connections 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:6833/1735589745,v1:172.21.15.178:6835/1735589745] conn(0xef48b20 0xef46780 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0xef30270 0xef8bc70 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xef2f950 0xef8b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 --2- 172.21.15.81:0/1141287867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xef0dd00 0xef485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7e9fe00700 0 client.9588 ms_handle_reset on v2:172.21.15.178:6833/1735589745 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 >> 172.21.15.81:0/1141287867 conn(0xec785b0 msgr2=0xef2e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 shutdown_connections 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 1 -- 172.21.15.81:0/1141287867 wait complete. 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec8eb3740 20 client.9588 trim_cache size 0 max 16384 2024-09-13T18:55:28.726 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:28.727 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea0066760 msgr2=0x7f7ea0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea0066760 0x7f7ea0068c20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0007fd0 tx=0x7f7eb0009040 comp rx=0 tx=0).stop 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 msgr2=0x7f7ec01df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 0x7f7ec01df700 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00eaf0 tx=0x7f7eac00ee00 comp rx=0 tx=0).stop 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 shutdown_connections 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7ea0066760 0x7f7ea0068c20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec006ebe0 0x7f7ec01dfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ec006e760 0x7f7ec01df700 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 --2- 172.21.15.81:0/2057876234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea4004db0 0x7f7ec01ecdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 >> 172.21.15.81:0/2057876234 conn(0x7f7ec00d2dc0 msgr2=0x7f7ec00d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 shutdown_connections 2024-09-13T18:55:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.716+0000 7f7ec5a00700 1 -- 172.21.15.81:0/2057876234 wait complete. 2024-09-13T18:55:28.748 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:28.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-13T18:55:28.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.916+0000 7f5fefe00700 1 Processor -- start 2024-09-13T18:55:28.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.916+0000 7f5fefe00700 1 -- start start 2024-09-13T18:55:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fefe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ff0143b70 0x7f5ff00cde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fefe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fefe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ff006cea0 0x7f5ff015e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fefe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff00b1980 con 0x7f5ff0143b70 2024-09-13T18:55:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fefe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff00b2500 con 0x7f5ff006cea0 2024-09-13T18:55:28.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fefe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff006d2f0 con 0x7f5ff006d620 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ff0143b70 0x7f5ff00cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ff0143b70 0x7f5ff00cde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41474/0 (socket says 172.21.15.81:41474) 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 -- 172.21.15.81:0/537887674 learned_addr learned my addr 172.21.15.81:0/537887674 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fee000700 1 --2- 172.21.15.81:0/537887674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 -- 172.21.15.81:0/537887674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 msgr2=0x7f5ff006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 --2- 172.21.15.81:0/537887674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff006c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 -- 172.21.15.81:0/537887674 >> v2:172.21.15.178:3300/0 conn(0x7f5ff006cea0 msgr2=0x7f5ff015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fef400700 1 --2- 172.21.15.81:0/537887674 >> v2:172.21.15.178:3300/0 conn(0x7f5ff006cea0 0x7f5ff015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 --2- 172.21.15.81:0/537887674 >> v2:172.21.15.178:3300/0 conn(0x7f5ff006cea0 0x7f5ff015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 -- 172.21.15.81:0/537887674 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00b1bd0 con 0x7f5ff0143b70 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fef400700 1 --2- 172.21.15.81:0/537887674 >> v2:172.21.15.178:3300/0 conn(0x7f5ff006cea0 0x7f5ff015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5feea00700 1 --2- 172.21.15.81:0/537887674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff0143b70 0x7f5ff00cde20 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006b370 tx=0x7f5fe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93f4e8a3181449 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fed600700 1 -- 172.21.15.81:0/537887674 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000e070 con 0x7f5ff0143b70 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fed600700 1 -- 172.21.15.81:0/537887674 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000b9c0 con 0x7f5ff0143b70 2024-09-13T18:55:28.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.920+0000 7f5fed600700 1 -- 172.21.15.81:0/537887674 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000bd70 con 0x7f5ff0143b70 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 -- 172.21.15.81:0/537887674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff0143b70 msgr2=0x7f5ff00cde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 --2- 172.21.15.81:0/537887674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff0143b70 0x7f5ff00cde20 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f5ff006b370 tx=0x7f5fe000b330 comp rx=0 tx=0).stop 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 -- 172.21.15.81:0/537887674 shutdown_connections 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 --2- 172.21.15.81:0/537887674 >> v2:172.21.15.178:3300/0 conn(0x7f5ff006cea0 0x7f5ff015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 --2- 172.21.15.81:0/537887674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff006c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 --2- 172.21.15.81:0/537887674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff0143b70 0x7f5ff00cde20 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 -- 172.21.15.81:0/537887674 >> 172.21.15.81:0/537887674 conn(0x7f5ff006a390 msgr2=0x7f5ff006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 -- 172.21.15.81:0/537887674 shutdown_connections 2024-09-13T18:55:28.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.924+0000 7f5fefe00700 1 -- 172.21.15.81:0/537887674 wait complete. 2024-09-13T18:55:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 Processor -- start 2024-09-13T18:55:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 -- start start 2024-09-13T18:55:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 0x7f5ff0155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff0159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0143b70 0x7f5ff0159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0155d80 con 0x7f5ff006cea0 2024-09-13T18:55:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff013da40 con 0x7f5ff0143b70 2024-09-13T18:55:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.928+0000 7f5fefe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff013dd20 con 0x7f5ff006d620 2024-09-13T18:55:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 0x7f5ff0155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 0x7f5ff0155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41490/0 (socket says 172.21.15.81:41490) 2024-09-13T18:55:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 -- 172.21.15.81:0/3556868921 learned_addr learned my addr 172.21.15.81:0/3556868921 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fef400700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0143b70 0x7f5ff0159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fee000700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff0159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 -- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 msgr2=0x7f5ff0159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff0159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 -- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0143b70 msgr2=0x7f5ff0159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0143b70 0x7f5ff0159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 -- 172.21.15.81:0/3556868921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0009b30 con 0x7f5ff006cea0 2024-09-13T18:55:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5feea00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 0x7f5ff0155840 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000b370 tx=0x7f5fe0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fe6a00700 1 -- 172.21.15.81:0/3556868921 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0004250 con 0x7f5ff006cea0 2024-09-13T18:55:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fe6a00700 1 -- 172.21.15.81:0/3556868921 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe00043b0 con 0x7f5ff006cea0 2024-09-13T18:55:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff013e000 con 0x7f5ff006cea0 2024-09-13T18:55:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fe6a00700 1 -- 172.21.15.81:0/3556868921 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0004740 con 0x7f5ff006cea0 2024-09-13T18:55:28.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.932+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff013e5c0 con 0x7f5ff006cea0 2024-09-13T18:55:28.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.936+0000 7f5fe6a00700 1 -- 172.21.15.81:0/3556868921 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5fe001b430 con 0x7f5ff006cea0 2024-09-13T18:55:28.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.936+0000 7f5fe6a00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5fd0066730 0x7f5fd0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.936+0000 7f5fe6a00700 1 -- 172.21.15.81:0/3556868921 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fe0085520 con 0x7f5ff006cea0 2024-09-13T18:55:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.936+0000 7f5fee000700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5fd0066730 0x7f5fd0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5fee000700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5fd0066730 0x7f5fd0068bf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cbe20 tx=0x7f5fdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 Processor -- start 2024-09-13T18:55:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 -- start start 2024-09-13T18:55:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711ed90 0x170d5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170fd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711f170 0x1711f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x17066010 con 0x170d4310 2024-09-13T18:55:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16ff3f40 con 0x1711f170 2024-09-13T18:55:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x17046e30 con 0x1711ed90 2024-09-13T18:55:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5fee000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5feea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711ed90 0x170d5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5fee000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170fd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41496/0 (socket says 172.21.15.81:41496) 2024-09-13T18:55:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5fee000700 1 -- 172.21.15.81:0/766619304 learned_addr learned my addr 172.21.15.81:0/766619304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5fef400700 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711f170 0x1711f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5feea00700 1 -- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711f170 msgr2=0x1711f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5feea00700 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711f170 0x1711f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5feea00700 1 -- 172.21.15.81:0/766619304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 msgr2=0x170fd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5feea00700 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170fd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.940+0000 7f5feea00700 1 -- 172.21.15.81:0/766619304 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16eb2a40 con 0x1711ed90 2024-09-13T18:55:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5feea00700 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711ed90 0x170d5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0056420 tx=0x7f5fe0004970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937ecbb284e59bef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5fdb400700 1 -- 172.21.15.81:0/766619304 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe005c040 con 0x1711ed90 2024-09-13T18:55:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5fdb400700 1 -- 172.21.15.81:0/766619304 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe005e7d0 con 0x1711ed90 2024-09-13T18:55:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5fdb400700 1 -- 172.21.15.81:0/766619304 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0052ba0 con 0x1711ed90 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 -- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711ed90 msgr2=0x170d5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711ed90 0x170d5810 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0056420 tx=0x7f5fe0004970 comp rx=0 tx=0).stop 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 -- 172.21.15.81:0/766619304 shutdown_connections 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711f170 0x1711f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170fd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/766619304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711ed90 0x170d5810 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 -- 172.21.15.81:0/766619304 >> 172.21.15.81:0/766619304 conn(0x16e675b0 msgr2=0x170d8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 -- 172.21.15.81:0/766619304 shutdown_connections 2024-09-13T18:55:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 -- 172.21.15.81:0/766619304 wait complete. 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 -- start start 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.944+0000 7f5ff8e73740 1 Processor -- start 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x170fc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x170fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x17042150 con 0x170d4310 2024-09-13T18:55:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1703feb0 con 0x1711ed90 2024-09-13T18:55:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16ffd8e0 con 0x1711f170 2024-09-13T18:55:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 10 client.0 _ll_register_callbacks cb 0x16fdc670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170dbbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41504/0 (socket says 172.21.15.81:41504) 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 -- 172.21.15.81:0/3530031274 learned_addr learned my addr 172.21.15.81:0/3530031274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fee000700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x170fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 -- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 msgr2=0x170fdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fef400700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x170fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x170fdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 -- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 msgr2=0x170fc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x170fc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 -- 172.21.15.81:0/3530031274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff013e5c0 con 0x170d4310 2024-09-13T18:55:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fee000700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x170fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fef400700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x170fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5feea00700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170dbbb0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00563d0 tx=0x7f5fe0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c317c4c58e934a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 1 -- 172.21.15.81:0/3530031274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00548f0 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 1 -- 172.21.15.81:0/3530031274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fe00742d0 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16e742c0 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 1 -- 172.21.15.81:0/3530031274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fe0055980 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 10 client.9600 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x17006290 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 1 -- 172.21.15.81:0/3530031274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16e742c0 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 1 -- 172.21.15.81:0/3530031274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5fe007d340 con 0x170d4310 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 10 client.9600 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 10 client.9600 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:28.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 20 client.9600 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x170dc670 0x17128730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 4 client.9600 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:55:28.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x16ebe540 con 0x170dc670 2024-09-13T18:55:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fee000700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x170dc670 0x17128730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fee000700 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x170dc670 0x17128730 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7f96961cf096ce server_cookie=fb8e75b69d6e8012 in_seq=0 out_seq=0 2024-09-13T18:55:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.948+0000 7f5fcfe00700 10 client.9600 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5fcfe00700 1 -- 172.21.15.81:0/3530031274 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x16ebe540 con 0x170dc670 2024-09-13T18:55:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5fcfe00700 10 client.9600 handle_command_reply: tid=0 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 client.9600 shutdown 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 msgr2=0x170dbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170dbbb0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5fe00563d0 tx=0x7f5fe0009810 comp rx=0 tx=0).stop 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 shutdown_connections 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x170dc670 0x17128730 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x170fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x170fc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/3530031274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x170d4310 0x170dbbb0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 >> 172.21.15.81:0/3530031274 conn(0x16e675b0 msgr2=0x170d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5fcfe00700 0 client.9600 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 shutdown_connections 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 1 -- 172.21.15.81:0/3530031274 wait complete. 2024-09-13T18:55:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.952+0000 7f5ff8e73740 20 client.9600 trim_cache size 0 max 16384 2024-09-13T18:55:28.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 Processor -- start 2024-09-13T18:55:28.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 -- start start 2024-09-13T18:55:28.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 0x17130b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711ed90 0x171310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x171315f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x16eebb80 con 0x1711ed90 2024-09-13T18:55:28.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1700e370 con 0x170d4310 2024-09-13T18:55:28.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.972+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16f78da0 con 0x1711f170 2024-09-13T18:55:28.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5feea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 0x17130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711ed90 0x171310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5feea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 0x17130b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:51116/0 (socket says 172.21.15.81:51116) 2024-09-13T18:55:28.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5feea00700 1 -- 172.21.15.81:0/1798850586 learned_addr learned my addr 172.21.15.81:0/1798850586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 -- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 msgr2=0x171315f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x171315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 -- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 msgr2=0x17130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 0x17130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 -- 172.21.15.81:0/1798850586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16fec4c0 con 0x1711ed90 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5feea00700 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 0x17130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fee000700 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711ed90 0x171310b0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x170421f0 tx=0x7f5fdc018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f555225b7db525 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fdbe00700 1 -- 172.21.15.81:0/1798850586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc014760 con 0x1711ed90 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fdbe00700 1 -- 172.21.15.81:0/1798850586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc0148c0 con 0x1711ed90 2024-09-13T18:55:28.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5fdbe00700 1 -- 172.21.15.81:0/1798850586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc014c30 con 0x1711ed90 2024-09-13T18:55:28.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 -- 172.21.15.81:0/1798850586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711ed90 msgr2=0x171310b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711ed90 0x171310b0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x170421f0 tx=0x7f5fdc018040 comp rx=0 tx=0).stop 2024-09-13T18:55:28.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 -- 172.21.15.81:0/1798850586 shutdown_connections 2024-09-13T18:55:28.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1711f170 0x171315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711ed90 0x171310b0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/1798850586 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x170d4310 0x17130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 -- 172.21.15.81:0/1798850586 >> 172.21.15.81:0/1798850586 conn(0x16e675b0 msgr2=0x1711c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 -- 172.21.15.81:0/1798850586 shutdown_connections 2024-09-13T18:55:28.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.976+0000 7f5ff8e73740 1 -- 172.21.15.81:0/1798850586 wait complete. 2024-09-13T18:55:28.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 -- start start 2024-09-13T18:55:28.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 Processor -- start 2024-09-13T18:55:28.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170d4310 0x1717ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x1717fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 0x1717ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x1713d3d0 con 0x1711f170 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x170ddeb0 con 0x1711ed90 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1713c0c0 con 0x170d4310 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5ff8e73740 10 client.0 _ll_register_callbacks cb 0x1703e610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5fef400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 0x1717ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5fef400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 0x1717ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41512/0 (socket says 172.21.15.81:41512) 2024-09-13T18:55:28.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5fef400700 1 -- 172.21.15.81:0/127133418 learned_addr learned my addr 172.21.15.81:0/127133418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5fee000700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x1717fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.980+0000 7f5feea00700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170d4310 0x1717ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fef400700 1 -- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170d4310 msgr2=0x1717ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fef400700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170d4310 0x1717ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fef400700 1 -- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 msgr2=0x1717fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fef400700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x1717fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fef400700 1 -- 172.21.15.81:0/127133418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x17006290 con 0x1711f170 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fef400700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 0x1717ff90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80047b0 tx=0x7f5fe80138a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b407d9778e8fc8e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 1 -- 172.21.15.81:0/127133418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8015830 con 0x1711f170 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 1 -- 172.21.15.81:0/127133418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fe8019070 con 0x1711f170 2024-09-13T18:55:28.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fe005e7d0 con 0x1711f170 2024-09-13T18:55:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 1 -- 172.21.15.81:0/127133418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fe8013ea0 con 0x1711f170 2024-09-13T18:55:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 10 client.9606 fetch_fsmap learned FSMap version 115 2024-09-13T18:55:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=2+}) v3 -- 0x7f5fdc00e040 con 0x1711f170 2024-09-13T18:55:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 1 -- 172.21.15.81:0/127133418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe005e7d0 con 0x1711f170 2024-09-13T18:55:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 1 -- 172.21.15.81:0/127133418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 115) v1 ==== 3154+0+0 (secure 0 0 0) 0x7f5fe8015990 con 0x1711f170 2024-09-13T18:55:28.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 10 client.9606 fetch_fsmap finished waiting for FSMap version 115 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 10 client.9606 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 20 client.9606 populate_metadata read hostname 'smithi081' 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x171804d0 0x171808e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 4 client.9606 mds_command: new command op to 8910 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 --> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x16ee32c0 con 0x171804d0 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5feea00700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x171804d0 0x171808e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5feea00700 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x171804d0 0x171808e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1583e63fb6f3a639 server_cookie=caafc46f0856f57b in_seq=0 out_seq=0 2024-09-13T18:55:28.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 10 client.9606 ms_handle_connect on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 1 -- 172.21.15.81:0/127133418 <== mds.0 v2:172.21.15.81:6835/2331750359 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x16ee32c0 con 0x171804d0 2024-09-13T18:55:28.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 10 client.9606 handle_command_reply: tid=0 2024-09-13T18:55:28.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 client.9606 shutdown 2024-09-13T18:55:28.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 msgr2=0x1717ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 0x1717ff90 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80047b0 tx=0x7f5fe80138a0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 shutdown_connections 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:6835/2331750359,v1:172.21.15.81:6837/2331750359] conn(0x171804d0 0x171808e0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x1711f170 0x1717ff90 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1711ed90 0x1717fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 --2- 172.21.15.81:0/127133418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x170d4310 0x1717ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 >> 172.21.15.81:0/127133418 conn(0x16e675b0 msgr2=0x17131390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.984+0000 7f5fcfe00700 0 client.9606 ms_handle_reset on v2:172.21.15.81:6835/2331750359 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 shutdown_connections 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5ff8e73740 1 -- 172.21.15.81:0/127133418 wait complete. 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5ff8e73740 20 client.9606 trim_cache size 0 max 16384 2024-09-13T18:55:28.996 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: "f9941095-4d5b-4ff8-b013-3c8f10f67e5e": { 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/d1/d2/d3", 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "f9941095-4d5b-4ff8-b013-3c8f10f67e5e", 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-13T18:55:28.997 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5fd0066730 msgr2=0x7f5fd0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5fd0066730 0x7f5fd0068bf0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00cbe20 tx=0x7f5fdc008040 comp rx=0 tx=0).stop 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 msgr2=0x7f5ff0155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 0x7f5ff0155840 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000b370 tx=0x7f5fe0004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 shutdown_connections 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5fd0066730 0x7f5fd0068bf0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ff0143b70 0x7f5ff0159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ff006d620 0x7f5ff0159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 --2- 172.21.15.81:0/3556868921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ff006cea0 0x7f5ff0155840 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 >> 172.21.15.81:0/3556868921 conn(0x7f5ff006a390 msgr2=0x7f5ff00cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:28.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 shutdown_connections 2024-09-13T18:55:28.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:28.988+0000 7f5fefe00700 1 -- 172.21.15.81:0/3556868921 wait complete. 2024-09-13T18:55:29.015 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-13T18:55:29.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:29.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.176+0000 7fe4ee800700 1 Processor -- start 2024-09-13T18:55:29.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.176+0000 7fe4ee800700 1 -- start start 2024-09-13T18:55:29.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ee800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4e81593f0 0x7fe4e80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ee800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4e80b3150 0x7fe4e806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ee800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e80cd190 con 0x7fe4e806cbb0 2024-09-13T18:55:29.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ee800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e81597d0 con 0x7fe4e81593f0 2024-09-13T18:55:29.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ee800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e806d530 con 0x7fe4e80b3150 2024-09-13T18:55:29.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4eca00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe4e806cbb0 0x7fe4e806fd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59568/0 (socket says 172.21.15.81:59568) 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4eca00700 1 -- 172.21.15.81:0/3211207784 learned_addr learned my addr 172.21.15.81:0/3211207784 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ed400700 1 --2- 172.21.15.81:0/3211207784 >> v2:172.21.15.81:3300/0 conn(0x7fe4e81593f0 0x7fe4e80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4ede00700 1 --2- 172.21.15.81:0/3211207784 >> v2:172.21.15.178:3300/0 conn(0x7fe4e80b3150 0x7fe4e806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286073930 0 0) 0x7fe4e80cd190 con 0x7fe4e806cbb0 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.180+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d00035d0 con 0x7fe4e806cbb0 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3271463717 0 0) 0x7fe4d00035d0 con 0x7fe4e806cbb0 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 >> v2:172.21.15.178:3300/0 conn(0x7fe4e80b3150 msgr2=0x7fe4e806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 --2- 172.21.15.81:0/3211207784 >> v2:172.21.15.178:3300/0 conn(0x7fe4e80b3150 0x7fe4e806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 >> v2:172.21.15.81:3300/0 conn(0x7fe4e81593f0 msgr2=0x7fe4e80718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 --2- 172.21.15.81:0/3211207784 >> v2:172.21.15.81:3300/0 conn(0x7fe4e81593f0 0x7fe4e80718c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80b19b0 con 0x7fe4e806cbb0 2024-09-13T18:55:29.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fe4d4001670 con 0x7fe4e806cbb0 2024-09-13T18:55:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 >> v1:172.21.15.81:6789/0 conn(0x7fe4e806cbb0 legacy=0x7fe4e806fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0003a90 0x7fe4d0003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d0004870 0x7fe4d0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d0005230 0x7fe4d000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81597d0 con 0x7fe4d0005230 2024-09-13T18:55:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e806d530 con 0x7fe4d0003a90 2024-09-13T18:55:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d000c050 con 0x7fe4d0004870 2024-09-13T18:55:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d0005230 0x7fe4d000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ed400700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0003a90 0x7fe4d0003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4eca00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d0004870 0x7fe4d0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 -- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d0004870 msgr2=0x7fe4d0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4d0004870 0x7fe4d0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 -- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0003a90 msgr2=0x7fe4d0003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0003a90 0x7fe4d0003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 -- 172.21.15.81:0/3211207784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d00035d0 con 0x7fe4d0005230 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 -- 172.21.15.81:0/3211207784 reap_dead start 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4ede00700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d0005230 0x7fe4d000ba30 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0010290 tx=0x7fe4d00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b35c813a31c774 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0010db0 con 0x7fe4d0005230 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0003a40 con 0x7fe4d0005230 2024-09-13T18:55:29.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.184+0000 7fe4e7e00700 1 -- 172.21.15.81:0/3211207784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0003df0 con 0x7fe4d0005230 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 -- 172.21.15.81:0/3211207784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d0005230 msgr2=0x7fe4d000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d0005230 0x7fe4d000ba30 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0010290 tx=0x7fe4d00058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 -- 172.21.15.81:0/3211207784 shutdown_connections 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 --2- 172.21.15.81:0/3211207784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4d0005230 0x7fe4d000ba30 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 -- 172.21.15.81:0/3211207784 >> 172.21.15.81:0/3211207784 conn(0x7fe4e80b0c40 msgr2=0x7fe4e806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 -- 172.21.15.81:0/3211207784 shutdown_connections 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 -- 172.21.15.81:0/3211207784 wait complete. 2024-09-13T18:55:29.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 Processor -- start 2024-09-13T18:55:29.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.188+0000 7fe4ee800700 1 -- start start 2024-09-13T18:55:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0005230 0x7fe4e81e4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 0x7fe4e81f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e815be90 0x7fe4e815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e815c850 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81e4aa0 con 0x7fe4d0005230 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e81e47c0 con 0x7fe4e815be90 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 0x7fe4e81f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 0x7fe4e81f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41536/0 (socket says 172.21.15.81:41536) 2024-09-13T18:55:29.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 -- 172.21.15.81:0/2094400889 learned_addr learned my addr 172.21.15.81:0/2094400889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ede00700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e815be90 0x7fe4e815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ed400700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0005230 0x7fe4e81e4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 -- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e815be90 msgr2=0x7fe4e815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e815be90 0x7fe4e815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 -- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0005230 msgr2=0x7fe4e81e4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0005230 0x7fe4e81e4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 -- 172.21.15.81:0/2094400889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e81e6ea0 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ed400700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0005230 0x7fe4e81e4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4eca00700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 0x7fe4e81f61c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4000c00 tx=0x7fe4d400eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4012590 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d40126f0 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e81e7180 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d4012a60 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.192+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e81e1f40 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.196+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e81e76a0 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.196+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4d4012bc0 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.196+0000 7fe4e5600700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4c8066760 0x7fe4c8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.196+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe4d4083f90 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.196+0000 7fe4ed400700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4c8066760 0x7fe4c8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.196+0000 7fe4ed400700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4c8066760 0x7fe4c8068c20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009af0 tx=0x7fe4dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:29.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.200+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4e81e76a0 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.424+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4e80ce440 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.424+0000 7fe4e5600700 1 -- 172.21.15.81:0/2094400889 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7fe4d4054b90 con 0x7fe4e81e1ac0 2024-09-13T18:55:29.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:29.433 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4c8066760 msgr2=0x7fe4c8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4c8066760 0x7fe4c8068c20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009af0 tx=0x7fe4dc008040 comp rx=0 tx=0).stop 2024-09-13T18:55:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 msgr2=0x7fe4e81f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 0x7fe4e81f61c0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4000c00 tx=0x7fe4d400eb10 comp rx=0 tx=0).stop 2024-09-13T18:55:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 shutdown_connections 2024-09-13T18:55:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe4c8066760 0x7fe4c8068c20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4e815be90 0x7fe4e815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4e81e1ac0 0x7fe4e81f61c0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 --2- 172.21.15.81:0/2094400889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4d0005230 0x7fe4e81e4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 >> 172.21.15.81:0/2094400889 conn(0x7fe4e80b0c40 msgr2=0x7fe4e80ad5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 shutdown_connections 2024-09-13T18:55:29.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.428+0000 7fe4ee800700 1 -- 172.21.15.81:0/2094400889 wait complete. 2024-09-13T18:55:29.438 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:29.460 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:29.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:29.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.616+0000 7fbd35c00700 1 Processor -- start 2024-09-13T18:55:29.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd35c00700 1 -- start start 2024-09-13T18:55:29.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd35c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd300ce4f0 0x7fbd300b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd35c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300b1050 0x7fbd30146940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd35c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd300b14b0 con 0x7fbd30146e80 2024-09-13T18:55:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd35c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd30144440 con 0x7fbd300ce4f0 2024-09-13T18:55:29.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd35c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301615d0 con 0x7fbd300b1050 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2ea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbd300ce4f0 0x7fbd300b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2f400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbd30146e80 0x7fbd3006fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59584/0 (socket says 172.21.15.81:59584) 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2f400700 1 -- 172.21.15.81:0/3190841785 learned_addr learned my addr 172.21.15.81:0/3190841785 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3190841785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300b1050 msgr2=0x7fbd30146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2ea00700 1 --2- 172.21.15.81:0/3190841785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300b1050 0x7fbd30146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3190841785 >> v1:172.21.15.81:6789/0 conn(0x7fbd30146e80 legacy=0x7fbd3006fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3190841785 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd301620e0 con 0x7fbd300ce4f0 2024-09-13T18:55:29.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2e000700 1 -- 172.21.15.81:0/3190841785 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 13742332 0 0) 0x7fbd300b14b0 con 0x7fbd30146e80 2024-09-13T18:55:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2ea00700 1 --2- 172.21.15.81:0/3190841785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300ce4f0 0x7fbd300b0b10 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009850 tx=0x7fbd20009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bb30d8d21f39a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2e000700 1 -- 172.21.15.81:0/3190841785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20011830 con 0x7fbd300ce4f0 2024-09-13T18:55:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2e000700 1 -- 172.21.15.81:0/3190841785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20011990 con 0x7fbd300ce4f0 2024-09-13T18:55:29.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.620+0000 7fbd2e000700 1 -- 172.21.15.81:0/3190841785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20011d20 con 0x7fbd300ce4f0 2024-09-13T18:55:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 -- 172.21.15.81:0/3190841785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300ce4f0 msgr2=0x7fbd300b0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3190841785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300ce4f0 0x7fbd300b0b10 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009850 tx=0x7fbd20009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 -- 172.21.15.81:0/3190841785 shutdown_connections 2024-09-13T18:55:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3190841785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd300b1050 0x7fbd30146940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3190841785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300ce4f0 0x7fbd300b0b10 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 -- 172.21.15.81:0/3190841785 >> 172.21.15.81:0/3190841785 conn(0x7fbd3006a7b0 msgr2=0x7fbd3006abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 -- 172.21.15.81:0/3190841785 shutdown_connections 2024-09-13T18:55:29.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 -- 172.21.15.81:0/3190841785 wait complete. 2024-09-13T18:55:29.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 Processor -- start 2024-09-13T18:55:29.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.624+0000 7fbd35c00700 1 -- start start 2024-09-13T18:55:29.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 0x7fbd30155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd300ce4f0 0x7fbd301455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd30146e80 0x7fbd30145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3015d1c0 con 0x7fbd300b1050 2024-09-13T18:55:29.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301f7f30 con 0x7fbd300ce4f0 2024-09-13T18:55:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd301f7320 con 0x7fbd30146e80 2024-09-13T18:55:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 0x7fbd30155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 0x7fbd30155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41558/0 (socket says 172.21.15.81:41558) 2024-09-13T18:55:29.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3257924461 learned_addr learned my addr 172.21.15.81:0/3257924461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd26000700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd300ce4f0 0x7fbd301455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd30146e80 msgr2=0x7fbd30145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2f400700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd30146e80 0x7fbd30145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd30146e80 0x7fbd30145b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd300ce4f0 msgr2=0x7fbd301455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd300ce4f0 0x7fbd301455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 -- 172.21.15.81:0/3257924461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200094b0 con 0x7fbd300b1050 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd26000700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd300ce4f0 0x7fbd301455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd2ea00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 0x7fbd30155170 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbd20000c00 tx=0x7fbd20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200038c0 con 0x7fbd300b1050 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20003a20 con 0x7fbd300b1050 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003db0 con 0x7fbd300b1050 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd301f7600 con 0x7fbd300b1050 2024-09-13T18:55:29.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.628+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd301f7bc0 con 0x7fbd300b1050 2024-09-13T18:55:29.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.632+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30161d70 con 0x7fbd300b1050 2024-09-13T18:55:29.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.632+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd2001a430 con 0x7fbd300b1050 2024-09-13T18:55:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.632+0000 7fbd27400700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd0c066730 0x7fbd0c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:29.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.636+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbd20021030 con 0x7fbd300b1050 2024-09-13T18:55:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.636+0000 7fbd26000700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd0c066730 0x7fbd0c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:29.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.636+0000 7fbd26000700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd0c066730 0x7fbd0c068bf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbd30143440 tx=0x7fbd18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:29.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.640+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd20052dd0 con 0x7fbd300b1050 2024-09-13T18:55:29.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.884+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbd301f7d80 con 0x7fbd300b1050 2024-09-13T18:55:29.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.888+0000 7fbd27400700 1 -- 172.21.15.81:0/3257924461 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1967 (secure 0 0 0) 0x7fbd2002b080 con 0x7fbd300b1050 2024-09-13T18:55:29.895 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:29.895 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":519,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":267239424,"bytes_avail":772826873856,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5544,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-13T18:55:23.136814+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:55:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd0c066730 msgr2=0x7fbd0c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd0c066730 0x7fbd0c068bf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbd30143440 tx=0x7fbd18008040 comp rx=0 tx=0).stop 2024-09-13T18:55:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 msgr2=0x7fbd30155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:29.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 0x7fbd30155170 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbd20000c00 tx=0x7fbd20004770 comp rx=0 tx=0).stop 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 shutdown_connections 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fbd0c066730 0x7fbd0c068bf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd30146e80 0x7fbd30145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd300ce4f0 0x7fbd301455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 --2- 172.21.15.81:0/3257924461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd300b1050 0x7fbd30155170 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 >> 172.21.15.81:0/3257924461 conn(0x7fbd3006a7b0 msgr2=0x7fbd300af870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 shutdown_connections 2024-09-13T18:55:29.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:29.892+0000 7fbd35c00700 1 -- 172.21.15.81:0/3257924461 wait complete. 2024-09-13T18:55:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:55:30.500 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:55:30.492+0000 7fbc37600700 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-13T18:55:30.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:31.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.100+0000 7f6501000700 1 Processor -- start 2024-09-13T18:55:31.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.100+0000 7f6501000700 1 -- start start 2024-09-13T18:55:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f6501000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64fc15b700 0x7f64fc15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f6501000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc06a5d0 0x7f64fc06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f6501000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc0cdd90 con 0x7f64fc06c460 2024-09-13T18:55:31.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f6501000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64fc06afa0 con 0x7f64fc15b700 2024-09-13T18:55:31.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f6501000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc06ce10 con 0x7f64fc06a5d0 2024-09-13T18:55:31.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64fc15b700 0x7f64fc15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f64fc15b700 0x7f64fc15bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41568/0 (socket says 172.21.15.81:41568) 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 -- 172.21.15.81:0/227693511 learned_addr learned my addr 172.21.15.81:0/227693511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64fa800700 1 --2- 172.21.15.81:0/227693511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc06a5d0 0x7f64fc06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 -- 172.21.15.81:0/227693511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc06a5d0 msgr2=0x7f64fc06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 --2- 172.21.15.81:0/227693511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc06a5d0 0x7f64fc06aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 -- 172.21.15.81:0/227693511 >> v1:172.21.15.178:6789/0 conn(0x7f64fc06c460 legacy=0x7f64fc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 -- 172.21.15.81:0/227693511 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc15c020 con 0x7f64fc15b700 2024-09-13T18:55:31.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9e00700 1 --2- 172.21.15.81:0/227693511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc15b700 0x7f64fc15bae0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009910 tx=0x7f64ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcd9bf5a03f09d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:31.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9400700 1 -- 172.21.15.81:0/227693511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00ba60 con 0x7f64fc15b700 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9400700 1 -- 172.21.15.81:0/227693511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00bbc0 con 0x7f64fc15b700 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.104+0000 7f64f9400700 1 -- 172.21.15.81:0/227693511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec009e60 con 0x7f64fc15b700 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 -- 172.21.15.81:0/227693511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc15b700 msgr2=0x7f64fc15bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 --2- 172.21.15.81:0/227693511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc15b700 0x7f64fc15bae0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f64ec009910 tx=0x7f64ec009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 -- 172.21.15.81:0/227693511 shutdown_connections 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 --2- 172.21.15.81:0/227693511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc06a5d0 0x7f64fc06aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 --2- 172.21.15.81:0/227693511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc15b700 0x7f64fc15bae0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 -- 172.21.15.81:0/227693511 >> 172.21.15.81:0/227693511 conn(0x7f64fc0b08d0 msgr2=0x7f64fc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 -- 172.21.15.81:0/227693511 shutdown_connections 2024-09-13T18:55:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 -- 172.21.15.81:0/227693511 wait complete. 2024-09-13T18:55:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 Processor -- start 2024-09-13T18:55:31.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.108+0000 7f6501000700 1 -- start start 2024-09-13T18:55:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 0x7f64fc150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64fc06c460 0x7f64fc1e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc15b700 0x7f64fc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1e5bb0 con 0x7f64fc06a5d0 2024-09-13T18:55:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1e4fa0 con 0x7f64fc06c460 2024-09-13T18:55:31.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc1e5280 con 0x7f64fc15b700 2024-09-13T18:55:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 0x7f64fc150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 0x7f64fc150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41570/0 (socket says 172.21.15.81:41570) 2024-09-13T18:55:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 -- 172.21.15.81:0/348748844 learned_addr learned my addr 172.21.15.81:0/348748844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64fa800700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc15b700 0x7f64fc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f1400700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64fc06c460 0x7f64fc1e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 -- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc15b700 msgr2=0x7f64fc071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc15b700 0x7f64fc071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 -- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64fc06c460 msgr2=0x7f64fc1e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64fc06c460 0x7f64fc1e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 -- 172.21.15.81:0/348748844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec009570 con 0x7f64fc06a5d0 2024-09-13T18:55:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f9e00700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 0x7f64fc150010 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c00 tx=0x7f64ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0036c0 con 0x7f64fc06a5d0 2024-09-13T18:55:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec01e070 con 0x7f64fc06a5d0 2024-09-13T18:55:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc1e5560 con 0x7f64fc06a5d0 2024-09-13T18:55:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec003a80 con 0x7f64fc06a5d0 2024-09-13T18:55:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.112+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc150790 con 0x7f64fc06a5d0 2024-09-13T18:55:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.116+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc150920 con 0x7f64fc06a5d0 2024-09-13T18:55:31.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.116+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64ec003be0 con 0x7f64fc06a5d0 2024-09-13T18:55:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.120+0000 7f64f2a00700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64d8066730 0x7f64d8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.120+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f64ec020070 con 0x7f64fc06a5d0 2024-09-13T18:55:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.120+0000 7f64f1400700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64d8066730 0x7f64d8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.120+0000 7f64f1400700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64d8066730 0x7f64d8068bf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f64fc072000 tx=0x7f64e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.124+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f64ec0529e0 con 0x7f64fc06a5d0 2024-09-13T18:55:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.360+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64fc06aa60 con 0x7f64fc06a5d0 2024-09-13T18:55:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.360+0000 7f64f2a00700 1 -- 172.21.15.81:0/348748844 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7f64ec056000 con 0x7f64fc06a5d0 2024-09-13T18:55:31.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:31.369 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64d8066730 msgr2=0x7f64d8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64d8066730 0x7f64d8068bf0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f64fc072000 tx=0x7f64e4009040 comp rx=0 tx=0).stop 2024-09-13T18:55:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 msgr2=0x7f64fc150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 0x7f64fc150010 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f64ec000c00 tx=0x7f64ec004770 comp rx=0 tx=0).stop 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 shutdown_connections 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f64d8066730 0x7f64d8068bf0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64fc15b700 0x7f64fc071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64fc06c460 0x7f64fc1e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 --2- 172.21.15.81:0/348748844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64fc06a5d0 0x7f64fc150010 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 >> 172.21.15.81:0/348748844 conn(0x7f64fc0b08d0 msgr2=0x7f64fc0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 shutdown_connections 2024-09-13T18:55:31.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.364+0000 7f6501000700 1 -- 172.21.15.81:0/348748844 wait complete. 2024-09-13T18:55:31.374 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:31.393 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:31.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:31.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.560+0000 7f9472400700 1 Processor -- start 2024-09-13T18:55:31.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.560+0000 7f9472400700 1 -- start start 2024-09-13T18:55:31.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9472400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c0b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9472400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f946c0b2f20 0x7f946c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9472400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c15c020 con 0x7f946c0b5e10 2024-09-13T18:55:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9472400700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c0b3d00 con 0x7f946c0b2f20 2024-09-13T18:55:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9472400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0b3fe0 con 0x7f946c154fe0 2024-09-13T18:55:31.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9463e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f946c0b5e10 0x7f946c0b2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:59594/0 (socket says 172.21.15.81:59594) 2024-09-13T18:55:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f9463e00700 1 -- 172.21.15.81:0/2962813566 learned_addr learned my addr 172.21.15.81:0/2962813566 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946be00700 1 --2- 172.21.15.81:0/2962813566 >> v2:172.21.15.81:3300/0 conn(0x7f946c0b2f20 0x7f946c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946b400700 1 --2- 172.21.15.81:0/2962813566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c0b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946aa00700 1 -- 172.21.15.81:0/2962813566 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689459599 0 0) 0x7f946c15c020 con 0x7f946c0b5e10 2024-09-13T18:55:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946aa00700 1 -- 172.21.15.81:0/2962813566 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94500035d0 con 0x7f946c0b5e10 2024-09-13T18:55:31.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946be00700 1 -- 172.21.15.81:0/2962813566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 msgr2=0x7f946c0b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946be00700 1 --2- 172.21.15.81:0/2962813566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c0b58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946be00700 1 -- 172.21.15.81:0/2962813566 >> v1:172.21.15.81:6789/0 conn(0x7f946c0b5e10 legacy=0x7f946c0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946be00700 1 -- 172.21.15.81:0/2962813566 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0b42c0 con 0x7f946c0b2f20 2024-09-13T18:55:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946be00700 1 --2- 172.21.15.81:0/2962813566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b2f20 0x7f946c15c210 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f9464009d90 tx=0x7f946400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b54195fef663d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946aa00700 1 -- 172.21.15.81:0/2962813566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400e070 con 0x7f946c0b2f20 2024-09-13T18:55:31.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946aa00700 1 -- 172.21.15.81:0/2962813566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400bb20 con 0x7f946c0b2f20 2024-09-13T18:55:31.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.564+0000 7f946aa00700 1 -- 172.21.15.81:0/2962813566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464012430 con 0x7f946c0b2f20 2024-09-13T18:55:31.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 -- 172.21.15.81:0/2962813566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b2f20 msgr2=0x7f946c15c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 --2- 172.21.15.81:0/2962813566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b2f20 0x7f946c15c210 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f9464009d90 tx=0x7f946400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 -- 172.21.15.81:0/2962813566 shutdown_connections 2024-09-13T18:55:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 --2- 172.21.15.81:0/2962813566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b2f20 0x7f946c15c210 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 --2- 172.21.15.81:0/2962813566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c0b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 -- 172.21.15.81:0/2962813566 >> 172.21.15.81:0/2962813566 conn(0x7f946c0726e0 msgr2=0x7f946c06e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 -- 172.21.15.81:0/2962813566 shutdown_connections 2024-09-13T18:55:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 -- 172.21.15.81:0/2962813566 wait complete. 2024-09-13T18:55:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 Processor -- start 2024-09-13T18:55:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.568+0000 7f9472400700 1 -- start start 2024-09-13T18:55:31.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946c0b2f20 0x7f946c149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 0x7f946c06a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c06a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c14dbd0 con 0x7f946c0b5e10 2024-09-13T18:55:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c14eb60 con 0x7f946c0b2f20 2024-09-13T18:55:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c14e5e0 con 0x7f946c154fe0 2024-09-13T18:55:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 0x7f946c06a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 0x7f946c06a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41586/0 (socket says 172.21.15.81:41586) 2024-09-13T18:55:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 -- 172.21.15.81:0/1427385332 learned_addr learned my addr 172.21.15.81:0/1427385332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f946b400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946c0b2f20 0x7f946c149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f946be00700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c06a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 -- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 msgr2=0x7f946c06a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c06a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 -- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946c0b2f20 msgr2=0x7f946c149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946c0b2f20 0x7f946c149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 -- 172.21.15.81:0/1427385332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464009a70 con 0x7f946c0b5e10 2024-09-13T18:55:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463e00700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 0x7f946c06a390 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f945400c700 tx=0x7f945400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454005d90 con 0x7f946c0b5e10 2024-09-13T18:55:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540070d0 con 0x7f946c0b5e10 2024-09-13T18:55:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c14de20 con 0x7f946c0b5e10 2024-09-13T18:55:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454007480 con 0x7f946c0b5e10 2024-09-13T18:55:31.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c0cd680 con 0x7f946c0b5e10 2024-09-13T18:55:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.572+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c0cd4e0 con 0x7f946c0b5e10 2024-09-13T18:55:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.576+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94540075e0 con 0x7f946c0b5e10 2024-09-13T18:55:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.576+0000 7f9463400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.576+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9454083840 con 0x7f946c0b5e10 2024-09-13T18:55:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.576+0000 7f946b400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.580+0000 7f946b400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f945c009ae0 tx=0x7f945c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.584+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f946c0cd4e0 con 0x7f946c0b5e10 2024-09-13T18:55:31.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.832+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f946c0cd4e0 con 0x7f946c0b5e10 2024-09-13T18:55:31.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.832+0000 7f9463400700 1 -- 172.21.15.81:0/1427385332 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1947 (secure 0 0 0) 0x7f946c0cd4e0 con 0x7f946c0b5e10 2024-09-13T18:55:31.840 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:31.840 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":521,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":267239424,"bytes_avail":772826873856,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-13T18:55:23.136814+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:55:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 msgr2=0x7f9448068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f945c009ae0 tx=0x7f945c008040 comp rx=0 tx=0).stop 2024-09-13T18:55:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 msgr2=0x7f946c06a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 0x7f946c06a390 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f945400c700 tx=0x7f945400cac0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 shutdown_connections 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9448066760 0x7f9448068c20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f946c154fe0 0x7f946c06a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c0b5e10 0x7f946c06a390 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 --2- 172.21.15.81:0/1427385332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f946c0b2f20 0x7f946c149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 >> 172.21.15.81:0/1427385332 conn(0x7f946c0726e0 msgr2=0x7f946c159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 shutdown_connections 2024-09-13T18:55:31.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:31.836+0000 7f9472400700 1 -- 172.21.15.81:0/1427385332 wait complete. 2024-09-13T18:55:31.866 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:55:32.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:33.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.032+0000 7fba3b000700 1 Processor -- start 2024-09-13T18:55:33.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.032+0000 7fba3b000700 1 -- start start 2024-09-13T18:55:33.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba340cb020 0x7fba340cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3406aaa0 0x7fba3406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3406b430 con 0x7fba3415c2a0 2024-09-13T18:55:33.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba340b2ad0 con 0x7fba340cb020 2024-09-13T18:55:33.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3415b960 con 0x7fba3406aaa0 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba340cb020 0x7fba340cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fba340cb020 0x7fba340cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41594/0 (socket says 172.21.15.81:41594) 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 -- 172.21.15.81:0/3796819811 learned_addr learned my addr 172.21.15.81:0/3796819811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3a600700 1 --2- 172.21.15.81:0/3796819811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3406aaa0 0x7fba3406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 -- 172.21.15.81:0/3796819811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3406aaa0 msgr2=0x7fba3406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 --2- 172.21.15.81:0/3796819811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3406aaa0 0x7fba3406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 -- 172.21.15.81:0/3796819811 >> v1:172.21.15.178:6789/0 conn(0x7fba3415c2a0 legacy=0x7fba3415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 -- 172.21.15.81:0/3796819811 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3415bc40 con 0x7fba340cb020 2024-09-13T18:55:33.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba39c00700 1 --2- 172.21.15.81:0/3796819811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba340cc6f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fba28009e50 tx=0x7fba2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1f00407419e146 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:33.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba33e00700 1 -- 172.21.15.81:0/3796819811 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800e070 con 0x7fba340cb020 2024-09-13T18:55:33.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba33e00700 1 -- 172.21.15.81:0/3796819811 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2800b9c0 con 0x7fba340cb020 2024-09-13T18:55:33.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba33e00700 1 -- 172.21.15.81:0/3796819811 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800bd70 con 0x7fba340cb020 2024-09-13T18:55:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- 172.21.15.81:0/3796819811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 msgr2=0x7fba340cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 --2- 172.21.15.81:0/3796819811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba340cc6f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fba28009e50 tx=0x7fba2800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- 172.21.15.81:0/3796819811 shutdown_connections 2024-09-13T18:55:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 --2- 172.21.15.81:0/3796819811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3406aaa0 0x7fba3406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 --2- 172.21.15.81:0/3796819811 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba340cc6f0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- 172.21.15.81:0/3796819811 >> 172.21.15.81:0/3796819811 conn(0x7fba340b0c40 msgr2=0x7fba3406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:33.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.036+0000 7fba3b000700 1 -- 172.21.15.81:0/3796819811 shutdown_connections 2024-09-13T18:55:33.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.040+0000 7fba3b000700 1 -- 172.21.15.81:0/3796819811 wait complete. 2024-09-13T18:55:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.040+0000 7fba3b000700 1 Processor -- start 2024-09-13T18:55:33.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.040+0000 7fba3b000700 1 -- start start 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba3406aaa0 0x7fba340c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba3414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3415c2a0 0x7fba341f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341f2f60 con 0x7fba340cb020 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341f3240 con 0x7fba3406aaa0 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba341f3520 con 0x7fba3415c2a0 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba3414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba3414ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41608/0 (socket says 172.21.15.81:41608) 2024-09-13T18:55:33.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 -- 172.21.15.81:0/61559020 learned_addr learned my addr 172.21.15.81:0/61559020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39c00700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba3406aaa0 0x7fba340c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3a600700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3415c2a0 0x7fba341f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 -- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3415c2a0 msgr2=0x7fba341f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3415c2a0 0x7fba341f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 -- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba3406aaa0 msgr2=0x7fba340c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba3406aaa0 0x7fba340c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 -- 172.21.15.81:0/61559020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28009b30 con 0x7fba340cb020 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3a600700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3415c2a0 0x7fba341f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba39200700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba3414ee00 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fba2000c500 tx=0x7fba2000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200052d0 con 0x7fba340cb020 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba20005430 con 0x7fba340cb020 2024-09-13T18:55:33.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba340c7c90 con 0x7fba340cb020 2024-09-13T18:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200055a0 con 0x7fba340cb020 2024-09-13T18:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.044+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba341f2bd0 con 0x7fba340cb020 2024-09-13T18:55:33.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.048+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba340c81b0 con 0x7fba340cb020 2024-09-13T18:55:33.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.048+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba200038e0 con 0x7fba340cb020 2024-09-13T18:55:33.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.048+0000 7fba31600700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fba14066730 0x7fba14068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.048+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba20083580 con 0x7fba340cb020 2024-09-13T18:55:33.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.048+0000 7fba39c00700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fba14066730 0x7fba14068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.052+0000 7fba39c00700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fba14066730 0x7fba14068bf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fba2800b370 tx=0x7fba28009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:33.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.056+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba340c81b0 con 0x7fba340cb020 2024-09-13T18:55:33.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.292+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba3406b430 con 0x7fba340cb020 2024-09-13T18:55:33.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.292+0000 7fba31600700 1 -- 172.21.15.81:0/61559020 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7fba3406b430 con 0x7fba340cb020 2024-09-13T18:55:33.302 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:33.302 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fba14066730 msgr2=0x7fba14068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fba14066730 0x7fba14068bf0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fba2800b370 tx=0x7fba28009000 comp rx=0 tx=0).stop 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 msgr2=0x7fba3414ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba3414ee00 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fba2000c500 tx=0x7fba2000c810 comp rx=0 tx=0).stop 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 shutdown_connections 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fba14066730 0x7fba14068bf0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba3415c2a0 0x7fba341f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba340cb020 0x7fba3414ee00 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 --2- 172.21.15.81:0/61559020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba3406aaa0 0x7fba340c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 >> 172.21.15.81:0/61559020 conn(0x7fba340b0c40 msgr2=0x7fba3415dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:33.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 shutdown_connections 2024-09-13T18:55:33.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.296+0000 7fba3b000700 1 -- 172.21.15.81:0/61559020 wait complete. 2024-09-13T18:55:33.307 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:33.329 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:33.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:33.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 Processor -- start 2024-09-13T18:55:33.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 -- start start 2024-09-13T18:55:33.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb406c960 0x7efeb4161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb40b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb4162340 con 0x7efeb40b1980 2024-09-13T18:55:33.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb40b2280 con 0x7efeb406c960 2024-09-13T18:55:33.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb40b2560 con 0x7efeb406cd40 2024-09-13T18:55:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb406c960 0x7efeb4161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efeb406c960 0x7efeb4161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41624/0 (socket says 172.21.15.81:41624) 2024-09-13T18:55:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 -- 172.21.15.81:0/1623110278 learned_addr learned my addr 172.21.15.81:0/1623110278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeaa000700 1 --2- 172.21.15.81:0/1623110278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb40b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 -- 172.21.15.81:0/1623110278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 msgr2=0x7efeb40b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:33.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 --2- 172.21.15.81:0/1623110278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb40b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 -- 172.21.15.81:0/1623110278 >> v1:172.21.15.178:6789/0 conn(0x7efeb40b1980 legacy=0x7efeb4162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 -- 172.21.15.81:0/1623110278 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40b2840 con 0x7efeb406c960 2024-09-13T18:55:33.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.488+0000 7efeb2a00700 1 --2- 172.21.15.81:0/1623110278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb4161e00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87db263569e8c2dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:33.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb2000700 1 -- 172.21.15.81:0/1623110278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400e070 con 0x7efeb406c960 2024-09-13T18:55:33.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb2000700 1 -- 172.21.15.81:0/1623110278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400b9c0 con 0x7efeb406c960 2024-09-13T18:55:33.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb2000700 1 -- 172.21.15.81:0/1623110278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea400bd70 con 0x7efeb406c960 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 -- 172.21.15.81:0/1623110278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 msgr2=0x7efeb4161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 --2- 172.21.15.81:0/1623110278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb4161e00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7efea4009e50 tx=0x7efea400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 -- 172.21.15.81:0/1623110278 shutdown_connections 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 --2- 172.21.15.81:0/1623110278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb40b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 --2- 172.21.15.81:0/1623110278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb4161e00 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 -- 172.21.15.81:0/1623110278 >> 172.21.15.81:0/1623110278 conn(0x7efeb406a390 msgr2=0x7efeb406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 -- 172.21.15.81:0/1623110278 shutdown_connections 2024-09-13T18:55:33.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.492+0000 7efeb3e00700 1 -- 172.21.15.81:0/1623110278 wait complete. 2024-09-13T18:55:33.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 Processor -- start 2024-09-13T18:55:33.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 -- start start 2024-09-13T18:55:33.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb41498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40b1980 0x7efeb41e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4149e00 con 0x7efeb406c960 2024-09-13T18:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41ea180 con 0x7efeb40b1980 2024-09-13T18:55:33.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41ea460 con 0x7efeb406cd40 2024-09-13T18:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41638/0 (socket says 172.21.15.81:41638) 2024-09-13T18:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 -- 172.21.15.81:0/3792052521 learned_addr learned my addr 172.21.15.81:0/3792052521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeaa000700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb41498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3400700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40b1980 0x7efeb41e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 -- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 msgr2=0x7efeb41498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb41498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 -- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40b1980 msgr2=0x7efeb41e96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40b1980 0x7efeb41e96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 -- 172.21.15.81:0/3792052521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4009b30 con 0x7efeb406c960 2024-09-13T18:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb3400700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40b1980 0x7efeb41e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:33.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.496+0000 7efeb2a00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb415d910 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7efea400b370 tx=0x7efea4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea4004960 con 0x7efeb406c960 2024-09-13T18:55:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40092e0 con 0x7efeb406c960 2024-09-13T18:55:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efea401b690 con 0x7efeb406c960 2024-09-13T18:55:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb41ea740 con 0x7efeb406c960 2024-09-13T18:55:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb41ead00 con 0x7efeb406c960 2024-09-13T18:55:33.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb41eaef0 con 0x7efeb406c960 2024-09-13T18:55:33.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.500+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efea401b7f0 con 0x7efeb406c960 2024-09-13T18:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.504+0000 7efeab400700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe90066760 0x7efe90068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:33.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.504+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efea4085590 con 0x7efeb406c960 2024-09-13T18:55:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.504+0000 7efeaa000700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe90066760 0x7efe90068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:33.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.504+0000 7efeaa000700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe90066760 0x7efe90068c20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7efeb41fa2a0 tx=0x7efe9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:33.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.508+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efea40527a0 con 0x7efeb406c960 2024-09-13T18:55:33.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.756+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7efeb40b1dd0 con 0x7efeb406c960 2024-09-13T18:55:33.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeab400700 1 -- 172.21.15.81:0/3792052521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1947 (secure 0 0 0) 0x7efea4055dc0 con 0x7efeb406c960 2024-09-13T18:55:33.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:33.767 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":523,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":267239424,"bytes_avail":772826873856,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-13T18:55:23.136814+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe90066760 msgr2=0x7efe90068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe90066760 0x7efe90068c20 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7efeb41fa2a0 tx=0x7efe9c008040 comp rx=0 tx=0).stop 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 msgr2=0x7efeb415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb415d910 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7efea400b370 tx=0x7efea4004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 shutdown_connections 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe90066760 0x7efe90068c20 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40b1980 0x7efeb41e96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb406cd40 0x7efeb41498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 --2- 172.21.15.81:0/3792052521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efeb406c960 0x7efeb415d910 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 >> 172.21.15.81:0/3792052521 conn(0x7efeb406a390 msgr2=0x7efeb415a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 shutdown_connections 2024-09-13T18:55:33.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:33.760+0000 7efeb3e00700 1 -- 172.21.15.81:0/3792052521 wait complete. 2024-09-13T18:55:33.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-13T18:55:34.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.956+0000 7fecd0e00700 1 Processor -- start 2024-09-13T18:55:34.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.956+0000 7fecd0e00700 1 -- start start 2024-09-13T18:55:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecd0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc0cddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecd0e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feccc0ce2f0 0x7feccc06a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecd0e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feccc06ab10 0x7feccc160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecd0e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc0ce750 con 0x7feccc0ce2f0 2024-09-13T18:55:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecd0e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc06afa0 con 0x7feccc06ab10 2024-09-13T18:55:34.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecd0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0ad480 con 0x7feccc1573b0 2024-09-13T18:55:34.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feccc0ce2f0 0x7feccc06a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc0cddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feccc0ce2f0 0x7feccc06a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41642/0 (socket says 172.21.15.81:41642) 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 -- 172.21.15.81:0/3437575566 learned_addr learned my addr 172.21.15.81:0/3437575566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecca800700 1 --2- 172.21.15.81:0/3437575566 >> v2:172.21.15.178:3300/0 conn(0x7feccc06ab10 0x7feccc160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 -- 172.21.15.81:0/3437575566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 msgr2=0x7feccc0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 --2- 172.21.15.81:0/3437575566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc0cddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 -- 172.21.15.81:0/3437575566 >> v2:172.21.15.178:3300/0 conn(0x7feccc06ab10 msgr2=0x7feccc160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 --2- 172.21.15.81:0/3437575566 >> v2:172.21.15.178:3300/0 conn(0x7feccc06ab10 0x7feccc160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.960+0000 7fecc3e00700 1 -- 172.21.15.81:0/3437575566 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc157790 con 0x7feccc0ce2f0 2024-09-13T18:55:34.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecc3e00700 1 --2- 172.21.15.81:0/3437575566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc0ce2f0 0x7feccc06a5d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7feccc0b1790 tx=0x7fecb4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4311bc4f76b4017 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:34.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecc9400700 1 -- 172.21.15.81:0/3437575566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011830 con 0x7feccc0ce2f0 2024-09-13T18:55:34.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecc9400700 1 -- 172.21.15.81:0/3437575566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4011990 con 0x7feccc0ce2f0 2024-09-13T18:55:34.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecc9400700 1 -- 172.21.15.81:0/3437575566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011d20 con 0x7feccc0ce2f0 2024-09-13T18:55:34.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 -- 172.21.15.81:0/3437575566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc0ce2f0 msgr2=0x7feccc06a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:34.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 --2- 172.21.15.81:0/3437575566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc0ce2f0 0x7feccc06a5d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7feccc0b1790 tx=0x7fecb4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 -- 172.21.15.81:0/3437575566 shutdown_connections 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 --2- 172.21.15.81:0/3437575566 >> v2:172.21.15.178:3300/0 conn(0x7feccc06ab10 0x7feccc160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 --2- 172.21.15.81:0/3437575566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc0ce2f0 0x7feccc06a5d0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 --2- 172.21.15.81:0/3437575566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc0cddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 -- 172.21.15.81:0/3437575566 >> 172.21.15.81:0/3437575566 conn(0x7feccc0b08d0 msgr2=0x7feccc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 -- 172.21.15.81:0/3437575566 shutdown_connections 2024-09-13T18:55:34.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.964+0000 7fecd0e00700 1 -- 172.21.15.81:0/3437575566 wait complete. 2024-09-13T18:55:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.968+0000 7fecd0e00700 1 Processor -- start 2024-09-13T18:55:34.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.968+0000 7fecd0e00700 1 -- start start 2024-09-13T18:55:34.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.968+0000 7fecd0e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 0x7feccc155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feccc0ce2f0 0x7feccc1f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc154870 con 0x7feccc06ab10 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc154b50 con 0x7feccc0ce2f0 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc154e30 con 0x7feccc1573b0 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 0x7feccc155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 0x7feccc155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41654/0 (socket says 172.21.15.81:41654) 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 -- 172.21.15.81:0/1729895069 learned_addr learned my addr 172.21.15.81:0/1729895069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecca800700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc3e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feccc0ce2f0 0x7feccc1f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 -- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 msgr2=0x7feccc13d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc13d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 -- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feccc0ce2f0 msgr2=0x7feccc1f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feccc0ce2f0 0x7feccc1f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:34.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 -- 172.21.15.81:0/1729895069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4009570 con 0x7feccc06ab10 2024-09-13T18:55:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc3e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feccc0ce2f0 0x7feccc1f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc9e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 0x7feccc155910 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00e870 tx=0x7fecbc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:34.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0095c0 con 0x7feccc06ab10 2024-09-13T18:55:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc00ee70 con 0x7feccc06ab10 2024-09-13T18:55:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc155110 con 0x7feccc06ab10 2024-09-13T18:55:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00ca70 con 0x7feccc06ab10 2024-09-13T18:55:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.972+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc1f6e80 con 0x7feccc06ab10 2024-09-13T18:55:34.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.976+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0ae250 con 0x7feccc06ab10 2024-09-13T18:55:34.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.976+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fecbc00cbd0 con 0x7feccc06ab10 2024-09-13T18:55:34.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.976+0000 7fecc2000700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feca8066730 0x7feca8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:34.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.976+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fecbc084240 con 0x7feccc06ab10 2024-09-13T18:55:34.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.976+0000 7fecc3e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feca8066730 0x7feca8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:34.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.980+0000 7fecc3e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feca8066730 0x7feca8068bf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feccc0b1790 tx=0x7fecb4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:34.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:34.984+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fecbc051450 con 0x7feccc06ab10 2024-09-13T18:55:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.212+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feccc0aef00 con 0x7feccc06ab10 2024-09-13T18:55:35.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.212+0000 7fecc2000700 1 -- 172.21.15.81:0/1729895069 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7fecbc059e60 con 0x7feccc06ab10 2024-09-13T18:55:35.220 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:35.221 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feca8066730 msgr2=0x7feca8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feca8066730 0x7feca8068bf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feccc0b1790 tx=0x7fecb4008030 comp rx=0 tx=0).stop 2024-09-13T18:55:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 msgr2=0x7feccc155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 0x7feccc155910 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00e870 tx=0x7fecbc00ec30 comp rx=0 tx=0).stop 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 shutdown_connections 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7feca8066730 0x7feca8068bf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feccc1573b0 0x7feccc13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feccc0ce2f0 0x7feccc1f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 --2- 172.21.15.81:0/1729895069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feccc06ab10 0x7feccc155910 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 >> 172.21.15.81:0/1729895069 conn(0x7feccc0b08d0 msgr2=0x7feccc06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 shutdown_connections 2024-09-13T18:55:35.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.216+0000 7fecd0e00700 1 -- 172.21.15.81:0/1729895069 wait complete. 2024-09-13T18:55:35.225 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:35.249 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:35.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:35.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.484+0000 7f9fb1200700 1 Processor -- start 2024-09-13T18:55:35.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.484+0000 7f9fb1200700 1 -- start start 2024-09-13T18:55:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0b10 0x7f9fac06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fac0ccda0 0x7f9fac15baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9fac0b0ef0 0x7f9fac06bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac071030 con 0x7f9fac0ccda0 2024-09-13T18:55:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0704b0 con 0x7f9fac0b0ef0 2024-09-13T18:55:35.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac070790 con 0x7f9fac0b0b10 2024-09-13T18:55:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fac0ccda0 0x7f9fac15baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9fac0ccda0 0x7f9fac15baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41662/0 (socket says 172.21.15.81:41662) 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 -- 172.21.15.81:0/780573250 learned_addr learned my addr 172.21.15.81:0/780573250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9faa800700 1 --2- 172.21.15.81:0/780573250 >> v2:172.21.15.178:3300/0 conn(0x7f9fac0b0ef0 0x7f9fac06bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa9e00700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0b10 0x7f9fac06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 -- 172.21.15.81:0/780573250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0b10 msgr2=0x7f9fac06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0b10 0x7f9fac06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 -- 172.21.15.81:0/780573250 >> v2:172.21.15.178:3300/0 conn(0x7f9fac0b0ef0 msgr2=0x7f9fac06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 --2- 172.21.15.81:0/780573250 >> v2:172.21.15.178:3300/0 conn(0x7f9fac0b0ef0 0x7f9fac06bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 -- 172.21.15.81:0/780573250 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac070a70 con 0x7f9fac0ccda0 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa9e00700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0b10 0x7f9fac06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:35.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9faa800700 1 --2- 172.21.15.81:0/780573250 >> v2:172.21.15.178:3300/0 conn(0x7f9fac0b0ef0 0x7f9fac06bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:35.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa1400700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0ccda0 0x7f9fac15baf0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f9fac06e040 tx=0x7f9f94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ba4dfe0bfc328 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa9400700 1 -- 172.21.15.81:0/780573250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011830 con 0x7f9fac0ccda0 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa9400700 1 -- 172.21.15.81:0/780573250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94011990 con 0x7f9fac0ccda0 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fa9400700 1 -- 172.21.15.81:0/780573250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94011d20 con 0x7f9fac0ccda0 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 -- 172.21.15.81:0/780573250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0ccda0 msgr2=0x7f9fac15baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.488+0000 7f9fb1200700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0ccda0 0x7f9fac15baf0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f9fac06e040 tx=0x7f9f94009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 -- 172.21.15.81:0/780573250 shutdown_connections 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 --2- 172.21.15.81:0/780573250 >> v2:172.21.15.178:3300/0 conn(0x7f9fac0b0ef0 0x7f9fac06bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac0ccda0 0x7f9fac15baf0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 --2- 172.21.15.81:0/780573250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0b10 0x7f9fac06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 -- 172.21.15.81:0/780573250 >> 172.21.15.81:0/780573250 conn(0x7f9fac06a7b0 msgr2=0x7f9fac06abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 -- 172.21.15.81:0/780573250 shutdown_connections 2024-09-13T18:55:35.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 -- 172.21.15.81:0/780573250 wait complete. 2024-09-13T18:55:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.492+0000 7f9fb1200700 1 Processor -- start 2024-09-13T18:55:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 -- start start 2024-09-13T18:55:35.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac0b0b10 0x7f9fac0ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0ef0 0x7f9fac141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 0x7f9fac150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f4db0 con 0x7f9fac142390 2024-09-13T18:55:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f4130 con 0x7f9fac0b0b10 2024-09-13T18:55:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fb1200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1f4410 con 0x7f9fac0b0ef0 2024-09-13T18:55:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 0x7f9fac150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 0x7f9fac150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41676/0 (socket says 172.21.15.81:41676) 2024-09-13T18:55:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fa9e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac0b0b10 0x7f9fac0ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 -- 172.21.15.81:0/1185118006 learned_addr learned my addr 172.21.15.81:0/1185118006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fa1400700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0ef0 0x7f9fac141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 -- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0ef0 msgr2=0x7f9fac141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0ef0 0x7f9fac141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 -- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac0b0b10 msgr2=0x7f9fac0ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac0b0b10 0x7f9fac0ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9faa800700 1 -- 172.21.15.81:0/1185118006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa4009a70 con 0x7f9fac142390 2024-09-13T18:55:35.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.496+0000 7f9fa9e00700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac0b0b10 0x7f9fac0ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9faa800700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 0x7f9fac150e60 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400efc0 tx=0x7f9fa400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400ca90 con 0x7f9fac142390 2024-09-13T18:55:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400f040 con 0x7f9fac142390 2024-09-13T18:55:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f94009570 con 0x7f9fac142390 2024-09-13T18:55:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa400ce10 con 0x7f9fac142390 2024-09-13T18:55:35.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac1f49d0 con 0x7f9fac142390 2024-09-13T18:55:35.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.500+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac1f4ef0 con 0x7f9fac142390 2024-09-13T18:55:35.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.504+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9fa4014480 con 0x7f9fac142390 2024-09-13T18:55:35.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.504+0000 7f9fa2a00700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f88066760 0x7f9f88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:35.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.504+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fa4084880 con 0x7f9fac142390 2024-09-13T18:55:35.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.504+0000 7f9fa9e00700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f88066760 0x7f9f88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:35.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.504+0000 7f9fa9e00700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f88066760 0x7f9f88068c20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009f40 tx=0x7f9f9c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:35.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.512+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9fac1f4ef0 con 0x7f9fac142390 2024-09-13T18:55:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.752+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9fac1f4ef0 con 0x7f9fac142390 2024-09-13T18:55:35.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.752+0000 7f9fa2a00700 1 -- 172.21.15.81:0/1185118006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1918 (secure 0 0 0) 0x7f9fac1f4ef0 con 0x7f9fac142390 2024-09-13T18:55:35.762 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:35.762 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":525,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700277,"bytes_used":267243520,"bytes_avail":772826869760,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-13T18:55:33.140187+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f88066760 msgr2=0x7f9f88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f88066760 0x7f9f88068c20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009f40 tx=0x7f9f9c008040 comp rx=0 tx=0).stop 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 msgr2=0x7f9fac150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 0x7f9fac150e60 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400efc0 tx=0x7f9fa400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 shutdown_connections 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9f88066760 0x7f9f88068c20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9fac142390 0x7f9fac150e60 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9fac0b0ef0 0x7f9fac141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 --2- 172.21.15.81:0/1185118006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9fac0b0b10 0x7f9fac0ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 >> 172.21.15.81:0/1185118006 conn(0x7f9fac06a7b0 msgr2=0x7f9fac15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 shutdown_connections 2024-09-13T18:55:35.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:35.760+0000 7f9fb1200700 1 -- 172.21.15.81:0/1185118006 wait complete. 2024-09-13T18:55:35.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-13T18:55:36.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:36.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.952+0000 7f6885200700 1 Processor -- start 2024-09-13T18:55:36.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 -- start start 2024-09-13T18:55:36.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800d02d0 0x7f68800703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f688015de00 0x7f68800cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68800cda10 0x7f68800ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800d06b0 con 0x7f68800cda10 2024-09-13T18:55:36.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800cde70 con 0x7f688015de00 2024-09-13T18:55:36.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6885200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688006f330 con 0x7f68800d02d0 2024-09-13T18:55:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f687fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68800cda10 0x7f68800ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6877e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f688015de00 0x7f68800cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f687f400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800d02d0 0x7f68800703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f687fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f68800cda10 0x7f68800ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49376/0 (socket says 172.21.15.81:49376) 2024-09-13T18:55:36.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f687fe00700 1 -- 172.21.15.81:0/1841270417 learned_addr learned my addr 172.21.15.81:0/1841270417 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6877e00700 1 -- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800d02d0 msgr2=0x7f68800703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6877e00700 1 --2- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800d02d0 0x7f68800703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6877e00700 1 -- 172.21.15.81:0/1841270417 >> v2:172.21.15.81:3300/0 conn(0x7f68800cda10 msgr2=0x7f68800ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6877e00700 1 --2- 172.21.15.81:0/1841270417 >> v2:172.21.15.81:3300/0 conn(0x7f68800cda10 0x7f68800ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.956+0000 7f6877e00700 1 -- 172.21.15.81:0/1841270417 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688006f610 con 0x7f688015de00 2024-09-13T18:55:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6877e00700 1 --2- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688015de00 0x7f68800cd4d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f68800cb200 tx=0x7f6868009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41399f715740332a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f687ea00700 1 -- 172.21.15.81:0/1841270417 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868011830 con 0x7f688015de00 2024-09-13T18:55:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f687ea00700 1 -- 172.21.15.81:0/1841270417 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868011990 con 0x7f688015de00 2024-09-13T18:55:36.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f687ea00700 1 -- 172.21.15.81:0/1841270417 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868011d20 con 0x7f688015de00 2024-09-13T18:55:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 -- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688015de00 msgr2=0x7f68800cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 --2- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688015de00 0x7f68800cd4d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f68800cb200 tx=0x7f6868009b30 comp rx=0 tx=0).stop 2024-09-13T18:55:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 -- 172.21.15.81:0/1841270417 shutdown_connections 2024-09-13T18:55:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 --2- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f688015de00 0x7f68800cd4d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 --2- 172.21.15.81:0/1841270417 >> v2:172.21.15.81:3300/0 conn(0x7f68800cda10 0x7f68800ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 --2- 172.21.15.81:0/1841270417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800d02d0 0x7f68800703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 -- 172.21.15.81:0/1841270417 >> 172.21.15.81:0/1841270417 conn(0x7f6880072650 msgr2=0x7f68800b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 -- 172.21.15.81:0/1841270417 shutdown_connections 2024-09-13T18:55:36.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.960+0000 7f6885200700 1 -- 172.21.15.81:0/1841270417 wait complete. 2024-09-13T18:55:36.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 Processor -- start 2024-09-13T18:55:36.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 -- start start 2024-09-13T18:55:36.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800cda10 0x7f6880148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68800d02d0 0x7f688015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 0x7f688015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6880148b20 con 0x7f688015de00 2024-09-13T18:55:36.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68801493c0 con 0x7f68800d02d0 2024-09-13T18:55:36.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6885200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688006a390 con 0x7f68800cda10 2024-09-13T18:55:36.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f687fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 0x7f688015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f687fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 0x7f688015aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49378/0 (socket says 172.21.15.81:49378) 2024-09-13T18:55:36.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f687fe00700 1 -- 172.21.15.81:0/2950233750 learned_addr learned my addr 172.21.15.81:0/2950233750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:36.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f687f400700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800cda10 0x7f6880148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.964+0000 7f6877e00700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68800d02d0 0x7f688015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f687fe00700 1 -- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800cda10 msgr2=0x7f6880148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f687fe00700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800cda10 0x7f6880148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f687fe00700 1 -- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68800d02d0 msgr2=0x7f688015a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f687fe00700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68800d02d0 0x7f688015a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f687fe00700 1 -- 172.21.15.81:0/2950233750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680094b0 con 0x7f688015de00 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f687fe00700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 0x7f688015aef0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f687800ef00 tx=0x7f687800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:36.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878010040 con 0x7f688015de00 2024-09-13T18:55:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878003a40 con 0x7f688015de00 2024-09-13T18:55:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878003df0 con 0x7f688015de00 2024-09-13T18:55:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6880148840 con 0x7f688015de00 2024-09-13T18:55:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6880148d70 con 0x7f688015de00 2024-09-13T18:55:36.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68800cbc40 con 0x7f688015de00 2024-09-13T18:55:36.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.968+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f687800b810 con 0x7f688015de00 2024-09-13T18:55:36.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.972+0000 7f6877400700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f685c066730 0x7f685c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:36.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.972+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6878083e60 con 0x7f688015de00 2024-09-13T18:55:36.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.972+0000 7f687f400700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f685c066730 0x7f685c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:36.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.972+0000 7f687f400700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f685c066730 0x7f685c068bf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f68800b0640 tx=0x7f6870009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:36.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:36.976+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6878051080 con 0x7f688015de00 2024-09-13T18:55:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.200+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6880149500 con 0x7f688015de00 2024-09-13T18:55:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.204+0000 7f6877400700 1 -- 172.21.15.81:0/2950233750 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7f68780546a0 con 0x7f688015de00 2024-09-13T18:55:37.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:37.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.204+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f685c066730 msgr2=0x7f685c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.204+0000 7f6885200700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f685c066730 0x7f685c068bf0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f68800b0640 tx=0x7f6870009240 comp rx=0 tx=0).stop 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.204+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 msgr2=0x7f688015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.204+0000 7f6885200700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 0x7f688015aef0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f687800ef00 tx=0x7f687800b390 comp rx=0 tx=0).stop 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 shutdown_connections 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f685c066730 0x7f685c068bf0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688015de00 0x7f688015aef0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68800d02d0 0x7f688015a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 --2- 172.21.15.81:0/2950233750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68800cda10 0x7f6880148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 >> 172.21.15.81:0/2950233750 conn(0x7f6880072650 msgr2=0x7f688015d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 shutdown_connections 2024-09-13T18:55:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.208+0000 7f6885200700 1 -- 172.21.15.81:0/2950233750 wait complete. 2024-09-13T18:55:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:37.237 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-13T18:55:37.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:55:37.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.400+0000 7f5585400700 1 Processor -- start 2024-09-13T18:55:37.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.400+0000 7f5585400700 1 -- start start 2024-09-13T18:55:37.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.400+0000 7f5585400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f558006c2e0 0x7f558006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:37.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5585400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558006cc70 con 0x7f55801595e0 2024-09-13T18:55:37.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5585400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558015a560 con 0x7f558014fff0 2024-09-13T18:55:37.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5585400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800b3c80 con 0x7f558006c2e0 2024-09-13T18:55:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557f200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f55801595e0 0x7f5580159a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35304/0 (socket says 172.21.15.81:35304) 2024-09-13T18:55:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557f200700 1 -- 172.21.15.81:0/2077398176 learned_addr learned my addr 172.21.15.81:0/2077398176 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5575e00700 1 --2- 172.21.15.81:0/2077398176 >> v2:172.21.15.178:3300/0 conn(0x7f558006c2e0 0x7f558006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563301527 0 0) 0x7f5578001490 con 0x7f55801595e0 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55640035d0 con 0x7f55801595e0 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651284330 0 0) 0x7f558015a560 con 0x7f558014fff0 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5578001490 con 0x7f558014fff0 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5575e00700 1 -- 172.21.15.81:0/2077398176 >> v1:172.21.15.178:6789/0 conn(0x7f558014fff0 legacy=0x7f55800b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5575e00700 1 -- 172.21.15.81:0/2077398176 >> v1:172.21.15.81:6789/0 conn(0x7f55801595e0 legacy=0x7f5580159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5575e00700 1 -- 172.21.15.81:0/2077398176 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800b29c0 con 0x7f558006c2e0 2024-09-13T18:55:37.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f5575e00700 1 --2- 172.21.15.81:0/2077398176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558006c2e0 0x7f558006c730 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f556800a9f0 tx=0x7f556800ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5f7d2376a38f8fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:37.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556800cb70 con 0x7f558006c2e0 2024-09-13T18:55:37.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556800ae90 con 0x7f558006c2e0 2024-09-13T18:55:37.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.404+0000 7f557de00700 1 -- 172.21.15.81:0/2077398176 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5568018400 con 0x7f558006c2e0 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 -- 172.21.15.81:0/2077398176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558006c2e0 msgr2=0x7f558006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 --2- 172.21.15.81:0/2077398176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558006c2e0 0x7f558006c730 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f556800a9f0 tx=0x7f556800ad00 comp rx=0 tx=0).stop 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 -- 172.21.15.81:0/2077398176 shutdown_connections 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 --2- 172.21.15.81:0/2077398176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558006c2e0 0x7f558006c730 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 -- 172.21.15.81:0/2077398176 >> 172.21.15.81:0/2077398176 conn(0x7f558006a7b0 msgr2=0x7f558006abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 -- 172.21.15.81:0/2077398176 shutdown_connections 2024-09-13T18:55:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 -- 172.21.15.81:0/2077398176 wait complete. 2024-09-13T18:55:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.408+0000 7f5585400700 1 Processor -- start 2024-09-13T18:55:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 -- start start 2024-09-13T18:55:37.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 0x7f55800aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:37.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558014fff0 0x7f5580150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:37.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55801595e0 0x7f55801511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800af4b0 con 0x7f558006c2e0 2024-09-13T18:55:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800af750 con 0x7f558014fff0 2024-09-13T18:55:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800afa30 con 0x7f55801595e0 2024-09-13T18:55:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 0x7f55800aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 0x7f55800aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49384/0 (socket says 172.21.15.81:49384) 2024-09-13T18:55:37.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 -- 172.21.15.81:0/3323877610 learned_addr learned my addr 172.21.15.81:0/3323877610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5575e00700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558014fff0 0x7f5580150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557f200700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55801595e0 0x7f55801511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 -- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55801595e0 msgr2=0x7f55801511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55801595e0 0x7f55801511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 -- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558014fff0 msgr2=0x7f5580150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558014fff0 0x7f5580150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 -- 172.21.15.81:0/3323877610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556800a650 con 0x7f558006c2e0 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5575e00700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558014fff0 0x7f5580150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f557e800700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 0x7f55800aef70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f557000c490 tx=0x7f557000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700052d0 con 0x7f558006c2e0 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570005450 con 0x7f558006c2e0 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55800afd10 con 0x7f558006c2e0 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.412+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700038e0 con 0x7f558006c2e0 2024-09-13T18:55:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.416+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5580151720 con 0x7f558006c2e0 2024-09-13T18:55:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.416+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55800aff50 con 0x7f558006c2e0 2024-09-13T18:55:37.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.416+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5570003a40 con 0x7f558006c2e0 2024-09-13T18:55:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.416+0000 7f5577400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f555c066730 0x7f555c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.420+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5570083870 con 0x7f558006c2e0 2024-09-13T18:55:37.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.420+0000 7f5575e00700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f555c066730 0x7f555c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:37.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.420+0000 7f5575e00700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f555c066730 0x7f555c068bf0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f556800a1c0 tx=0x7f5568008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:37.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.428+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55800aff50 con 0x7f558006c2e0 2024-09-13T18:55:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.672+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55800aff50 con 0x7f558006c2e0 2024-09-13T18:55:37.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.672+0000 7f5577400700 1 -- 172.21.15.81:0/3323877610 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1824 (secure 0 0 0) 0x7f55800aff50 con 0x7f558006c2e0 2024-09-13T18:55:37.682 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:37.682 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":527,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":109,"num_osds":8,"num_up_osds":8,"osd_up_since":1726253222,"num_in_osds":8,"osd_in_since":1726253213,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":705738,"bytes_used":267247616,"bytes_avail":772826865664,"bytes_total":773094113280,"write_bytes_sec":597,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":115,"id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7550},{"filesystem_id":7,"rank":1,"name":"c","status":"up:active","gid":8907},{"filesystem_id":7,"rank":0,"name":"a","status":"up:active","gid":8910}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-13T18:55:37.141693+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:55:37.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f555c066730 msgr2=0x7f555c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f555c066730 0x7f555c068bf0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f556800a1c0 tx=0x7f5568008040 comp rx=0 tx=0).stop 2024-09-13T18:55:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 msgr2=0x7f55800aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 0x7f55800aef70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f557000c490 tx=0x7f557000c850 comp rx=0 tx=0).stop 2024-09-13T18:55:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 shutdown_connections 2024-09-13T18:55:37.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f555c066730 0x7f555c068bf0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55801595e0 0x7f55801511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f558014fff0 0x7f5580150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 --2- 172.21.15.81:0/3323877610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f558006c2e0 0x7f55800aef70 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 >> 172.21.15.81:0/3323877610 conn(0x7f558006a7b0 msgr2=0x7f558006fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 shutdown_connections 2024-09-13T18:55:37.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:37.676+0000 7f5585400700 1 -- 172.21.15.81:0/3323877610 wait complete. 2024-09-13T18:55:37.708 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2024-09-13T18:55:37.708 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:55:37.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:55:37.749 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:55:37.789 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:55:37.790 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:55:37.790 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:37.810 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:55:37.810 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:37.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:55:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.084+0000 7fb06ea00700 1 Processor -- start 2024-09-13T18:55:38.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.084+0000 7fb06ea00700 1 -- start start 2024-09-13T18:55:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb06ea00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb06815b700 0x7fb06815bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb06ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06806c460 0x7fb06806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb06ea00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0680cdd90 con 0x7fb06806a5d0 2024-09-13T18:55:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb06ea00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06806ce10 con 0x7fb06815b700 2024-09-13T18:55:38.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb06ea00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06815c020 con 0x7fb06806c460 2024-09-13T18:55:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb06815b700 0x7fb06815bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb06815b700 0x7fb06815bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49392/0 (socket says 172.21.15.81:49392) 2024-09-13T18:55:38.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 -- 172.21.15.81:0/2467015286 learned_addr learned my addr 172.21.15.81:0/2467015286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067400700 1 --2- 172.21.15.81:0/2467015286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06806c460 0x7fb06806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 -- 172.21.15.81:0/2467015286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06806c460 msgr2=0x7fb06806d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 --2- 172.21.15.81:0/2467015286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06806c460 0x7fb06806d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 -- 172.21.15.81:0/2467015286 >> v1:172.21.15.178:6789/0 conn(0x7fb06806a5d0 legacy=0x7fb0680b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.088+0000 7fb067e00700 1 -- 172.21.15.81:0/2467015286 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06806d7e0 con 0x7fb06815b700 2024-09-13T18:55:38.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb067e00700 1 --2- 172.21.15.81:0/2467015286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06815b700 0x7fb06815bae0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb058009910 tx=0x7fb058009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a950bf6743702dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb066a00700 1 -- 172.21.15.81:0/2467015286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800ba60 con 0x7fb06815b700 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb066a00700 1 -- 172.21.15.81:0/2467015286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05800bbc0 con 0x7fb06815b700 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb066a00700 1 -- 172.21.15.81:0/2467015286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058009e60 con 0x7fb06815b700 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 -- 172.21.15.81:0/2467015286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06815b700 msgr2=0x7fb06815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 --2- 172.21.15.81:0/2467015286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06815b700 0x7fb06815bae0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb058009910 tx=0x7fb058009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 -- 172.21.15.81:0/2467015286 shutdown_connections 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 --2- 172.21.15.81:0/2467015286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06806c460 0x7fb06806d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 --2- 172.21.15.81:0/2467015286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06815b700 0x7fb06815bae0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 -- 172.21.15.81:0/2467015286 >> 172.21.15.81:0/2467015286 conn(0x7fb0680b08d0 msgr2=0x7fb0680b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:38.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 -- 172.21.15.81:0/2467015286 shutdown_connections 2024-09-13T18:55:38.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.092+0000 7fb06ea00700 1 -- 172.21.15.81:0/2467015286 wait complete. 2024-09-13T18:55:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 Processor -- start 2024-09-13T18:55:38.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 -- start start 2024-09-13T18:55:38.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06806a5d0 0x7fb068151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 0x7fb068071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06815b700 0x7fb0681e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068151a80 con 0x7fb06806c460 2024-09-13T18:55:38.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb068159940 con 0x7fb06806a5d0 2024-09-13T18:55:38.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ea00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0681f74f0 con 0x7fb06815b700 2024-09-13T18:55:38.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb067400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 0x7fb068071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb067400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 0x7fb068071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49394/0 (socket says 172.21.15.81:49394) 2024-09-13T18:55:38.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb067400700 1 -- 172.21.15.81:0/3659359841 learned_addr learned my addr 172.21.15.81:0/3659359841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:38.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb067e00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06806a5d0 0x7fb068151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.096+0000 7fb06ca00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06815b700 0x7fb0681e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067400700 1 -- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06815b700 msgr2=0x7fb0681e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067400700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06815b700 0x7fb0681e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067400700 1 -- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06806a5d0 msgr2=0x7fb068151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067400700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06806a5d0 0x7fb068151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067400700 1 -- 172.21.15.81:0/3659359841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058009570 con 0x7fb06806c460 2024-09-13T18:55:38.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067e00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06806a5d0 0x7fb068151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb067400700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 0x7fb068071700 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb05400e760 tx=0x7fb05400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05400c070 con 0x7fb06806c460 2024-09-13T18:55:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb054013610 con 0x7fb06806c460 2024-09-13T18:55:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0681f77d0 con 0x7fb06806c460 2024-09-13T18:55:38.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054013980 con 0x7fb06806c460 2024-09-13T18:55:38.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0681f7d90 con 0x7fb06806c460 2024-09-13T18:55:38.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.100+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06806c240 con 0x7fb06806c460 2024-09-13T18:55:38.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.104+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb054013ae0 con 0x7fb06806c460 2024-09-13T18:55:38.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.104+0000 7fb05fe00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb048066760 0x7fb048068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.104+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0540840c0 con 0x7fb06806c460 2024-09-13T18:55:38.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.104+0000 7fb067e00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb048066760 0x7fb048068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.104+0000 7fb067e00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb048066760 0x7fb048068c20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb058000c00 tx=0x7fb058008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.112+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb054051240 con 0x7fb06806c460 2024-09-13T18:55:38.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.300+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb06806d280 con 0x7fb06806c460 2024-09-13T18:55:38.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.304+0000 7fb05fe00700 1 -- 172.21.15.81:0/3659359841 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16766 (secure 0 0 0) 0x7fb054054860 con 0x7fb06806c460 2024-09-13T18:55:38.313 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:38.313 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:55:01.545466+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.11","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:55:38.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb048066760 msgr2=0x7fb048068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb048066760 0x7fb048068c20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb058000c00 tx=0x7fb058008030 comp rx=0 tx=0).stop 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 msgr2=0x7fb068071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 0x7fb068071700 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb05400e760 tx=0x7fb05400ea70 comp rx=0 tx=0).stop 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 shutdown_connections 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fb048066760 0x7fb048068c20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb06815b700 0x7fb0681e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb06806c460 0x7fb068071700 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 --2- 172.21.15.81:0/3659359841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb06806a5d0 0x7fb068151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 >> 172.21.15.81:0/3659359841 conn(0x7fb0680b08d0 msgr2=0x7fb0680af550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 shutdown_connections 2024-09-13T18:55:38.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.308+0000 7fb06ea00700 1 -- 172.21.15.81:0/3659359841 wait complete. 2024-09-13T18:55:38.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:54:44.442235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:54:45.450767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:55:38.341 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:55:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.508+0000 7fd3d3e00700 1 Processor -- start 2024-09-13T18:55:38.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3e00700 1 -- start start 2024-09-13T18:55:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3d4159920 0x7fd3d40b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3d406d070 0x7fd3d40cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40cd2a0 con 0x7fd3d40b30d0 2024-09-13T18:55:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40ccc90 con 0x7fd3d4159920 2024-09-13T18:55:38.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40b3580 con 0x7fd3d406d070 2024-09-13T18:55:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd3d4159920 0x7fd3d40b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d2000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd3d40b30d0 0x7fd3d406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35314/0 (socket says 172.21.15.81:35314) 2024-09-13T18:55:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d2000700 1 -- 172.21.15.81:0/4137498985 learned_addr learned my addr 172.21.15.81:0/4137498985 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:38.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.512+0000 7fd3d3400700 1 --2- 172.21.15.81:0/4137498985 >> v2:172.21.15.178:3300/0 conn(0x7fd3d406d070 0x7fd3d40cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d1600700 1 -- 172.21.15.81:0/4137498985 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654999311 0 0) 0x7fd3d40cd2a0 con 0x7fd3d40b30d0 2024-09-13T18:55:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d1600700 1 -- 172.21.15.81:0/4137498985 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b80035d0 con 0x7fd3d40b30d0 2024-09-13T18:55:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d2a00700 1 -- 172.21.15.81:0/4137498985 >> v2:172.21.15.178:3300/0 conn(0x7fd3d406d070 msgr2=0x7fd3d40cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d2a00700 1 --2- 172.21.15.81:0/4137498985 >> v2:172.21.15.178:3300/0 conn(0x7fd3d406d070 0x7fd3d40cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d2a00700 1 -- 172.21.15.81:0/4137498985 >> v1:172.21.15.81:6789/0 conn(0x7fd3d40b30d0 legacy=0x7fd3d406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d2a00700 1 -- 172.21.15.81:0/4137498985 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40b3860 con 0x7fd3d4159920 2024-09-13T18:55:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d2a00700 1 --2- 172.21.15.81:0/4137498985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4159920 0x7fd3d40b2b90 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40cc9f0 tx=0x7fd3c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402ca8b7673fb252 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d1600700 1 -- 172.21.15.81:0/4137498985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400f8a0 con 0x7fd3d4159920 2024-09-13T18:55:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d1600700 1 -- 172.21.15.81:0/4137498985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c400fa00 con 0x7fd3d4159920 2024-09-13T18:55:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d1600700 1 -- 172.21.15.81:0/4137498985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400fd90 con 0x7fd3d4159920 2024-09-13T18:55:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 -- 172.21.15.81:0/4137498985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4159920 msgr2=0x7fd3d40b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/4137498985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4159920 0x7fd3d40b2b90 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40cc9f0 tx=0x7fd3c4009b30 comp rx=0 tx=0).stop 2024-09-13T18:55:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 -- 172.21.15.81:0/4137498985 shutdown_connections 2024-09-13T18:55:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/4137498985 >> v2:172.21.15.178:3300/0 conn(0x7fd3d406d070 0x7fd3d40cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/4137498985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d4159920 0x7fd3d40b2b90 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 -- 172.21.15.81:0/4137498985 >> 172.21.15.81:0/4137498985 conn(0x7fd3d406a390 msgr2=0x7fd3d406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 -- 172.21.15.81:0/4137498985 shutdown_connections 2024-09-13T18:55:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.516+0000 7fd3d3e00700 1 -- 172.21.15.81:0/4137498985 wait complete. 2024-09-13T18:55:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 Processor -- start 2024-09-13T18:55:38.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 -- start start 2024-09-13T18:55:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d406d070 0x7fd3d4142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d40b30d0 0x7fd3d40c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 0x7fd3d41f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4142650 con 0x7fd3d41f5e90 2024-09-13T18:55:38.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d4141660 con 0x7fd3d40b30d0 2024-09-13T18:55:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d41f6950 con 0x7fd3d406d070 2024-09-13T18:55:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 0x7fd3d41f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 0x7fd3d41f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49418/0 (socket says 172.21.15.81:49418) 2024-09-13T18:55:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d3400700 1 -- 172.21.15.81:0/1187263816 learned_addr learned my addr 172.21.15.81:0/1187263816 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.520+0000 7fd3d2000700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d40b30d0 0x7fd3d40c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d2a00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d406d070 0x7fd3d4142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3400700 1 -- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d406d070 msgr2=0x7fd3d4142110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3400700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d406d070 0x7fd3d4142110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3400700 1 -- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d40b30d0 msgr2=0x7fd3d40c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3400700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d40b30d0 0x7fd3d40c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3400700 1 -- 172.21.15.81:0/1187263816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40094b0 con 0x7fd3d41f5e90 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3400700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 0x7fd3d41f6340 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00efc0 tx=0x7fd3cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc009ea0 con 0x7fd3d41f5e90 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00f040 con 0x7fd3d41f5e90 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc014480 con 0x7fd3d41f5e90 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d41f6c30 con 0x7fd3d41f5e90 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d4141bf0 con 0x7fd3d41f5e90 2024-09-13T18:55:38.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d406c960 con 0x7fd3d41f5e90 2024-09-13T18:55:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.524+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3cc0145e0 con 0x7fd3d41f5e90 2024-09-13T18:55:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.528+0000 7fd3caa00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.528+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3cc084af0 con 0x7fd3d41f5e90 2024-09-13T18:55:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.528+0000 7fd3d2a00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.528+0000 7fd3d2a00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4000c00 tx=0x7fd3c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.536+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3cc051d90 con 0x7fd3d41f5e90 2024-09-13T18:55:38.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.716+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3d40cdf20 con 0x7fd3d41f5e90 2024-09-13T18:55:38.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.716+0000 7fd3caa00700 1 -- 172.21.15.81:0/1187263816 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3cc018020 con 0x7fd3d41f5e90 2024-09-13T18:55:38.724 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:55:38.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 msgr2=0x7fd3b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4000c00 tx=0x7fd3c4008030 comp rx=0 tx=0).stop 2024-09-13T18:55:38.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 msgr2=0x7fd3d41f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 0x7fd3d41f6340 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00efc0 tx=0x7fd3cc00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 shutdown_connections 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd3b4066730 0x7fd3b4068bf0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3d41f5e90 0x7fd3d41f6340 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3d40b30d0 0x7fd3d40c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 --2- 172.21.15.81:0/1187263816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3d406d070 0x7fd3d4142110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 >> 172.21.15.81:0/1187263816 conn(0x7fd3d406a390 msgr2=0x7fd3d40cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 shutdown_connections 2024-09-13T18:55:38.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.720+0000 7fd3d3e00700 1 -- 172.21.15.81:0/1187263816 wait complete. 2024-09-13T18:55:38.747 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:55:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.904+0000 7f09fbe00700 1 Processor -- start 2024-09-13T18:55:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.904+0000 7f09fbe00700 1 -- start start 2024-09-13T18:55:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09fc15aa90 0x7f09fc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fbe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0b4680 con 0x7f09fc0cf830 2024-09-13T18:55:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fbe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc0b4960 con 0x7f09fc06c5a0 2024-09-13T18:55:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fbe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09fc15aee0 con 0x7f09fc15aa90 2024-09-13T18:55:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fa000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09fc15aa90 0x7f09fc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fb400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f09fc0cf830 0x7f09fc0cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35328/0 (socket says 172.21.15.81:35328) 2024-09-13T18:55:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fb400700 1 -- 172.21.15.81:0/2166868100 learned_addr learned my addr 172.21.15.81:0/2166868100 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fa000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f09fc15aa90 0x7f09fc0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49422/0 (socket says 172.21.15.81:49422) 2024-09-13T18:55:38.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fa000700 1 -- 172.21.15.81:0/2166868100 >> v1:172.21.15.178:6789/0 conn(0x7f09fc06c5a0 legacy=0x7f09fc06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fa000700 1 -- 172.21.15.81:0/2166868100 >> v1:172.21.15.81:6789/0 conn(0x7f09fc0cf830 legacy=0x7f09fc0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fa000700 1 -- 172.21.15.81:0/2166868100 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc0cf030 con 0x7f09fc15aa90 2024-09-13T18:55:38.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09fa000700 1 --2- 172.21.15.81:0/2166868100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc15aa90 0x7f09fc0b56c0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009850 tx=0x7f09e8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410e9680c53c8bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09f9600700 1 -- 172.21.15.81:0/2166868100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011830 con 0x7f09fc15aa90 2024-09-13T18:55:38.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09f9600700 1 -- 172.21.15.81:0/2166868100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8011990 con 0x7f09fc15aa90 2024-09-13T18:55:38.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.908+0000 7f09f9600700 1 -- 172.21.15.81:0/2166868100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011d20 con 0x7f09fc15aa90 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- 172.21.15.81:0/2166868100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc15aa90 msgr2=0x7f09fc0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 --2- 172.21.15.81:0/2166868100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc15aa90 0x7f09fc0b56c0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009850 tx=0x7f09e8009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- 172.21.15.81:0/2166868100 shutdown_connections 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 --2- 172.21.15.81:0/2166868100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc15aa90 0x7f09fc0b56c0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- 172.21.15.81:0/2166868100 >> 172.21.15.81:0/2166868100 conn(0x7f09fc071d20 msgr2=0x7f09fc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- 172.21.15.81:0/2166868100 shutdown_connections 2024-09-13T18:55:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- 172.21.15.81:0/2166868100 wait complete. 2024-09-13T18:55:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 Processor -- start 2024-09-13T18:55:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- start start 2024-09-13T18:55:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 0x7f09fc15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09fc0cf830 0x7f09fc143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09fc15aa90 0x7f09fc1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc15dbf0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc15de20 con 0x7f09fc0cf830 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.912+0000 7f09fbe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc148710 con 0x7f09fc15aa90 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 0x7f09fc15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 0x7f09fc15d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49438/0 (socket says 172.21.15.81:49438) 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 -- 172.21.15.81:0/1117893328 learned_addr learned my addr 172.21.15.81:0/1117893328 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fa000700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09fc0cf830 0x7f09fc143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fb400700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09fc15aa90 0x7f09fc1497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 -- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09fc15aa90 msgr2=0x7f09fc1497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09fc15aa90 0x7f09fc1497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 -- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09fc0cf830 msgr2=0x7f09fc143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09fc0cf830 0x7f09fc143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 -- 172.21.15.81:0/1117893328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80094b0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fa000700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09fc0cf830 0x7f09fc143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fb400700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09fc15aa90 0x7f09fc1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09faa00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 0x7f09fc15d6b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c500 tx=0x7f09ec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0052d0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec005430 con 0x7f09fc06c5a0 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc1489b0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0055a0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc144050 con 0x7f09fc06c5a0 2024-09-13T18:55:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.916+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc06c980 con 0x7f09fc06c5a0 2024-09-13T18:55:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.920+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09ec0038e0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.920+0000 7f09f3400700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f09dc066730 0x7f09dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.920+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09ec0837c0 con 0x7f09fc06c5a0 2024-09-13T18:55:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.920+0000 7f09fa000700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f09dc066730 0x7f09dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.920+0000 7f09fa000700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f09dc066730 0x7f09dc068bf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f09e80090b0 tx=0x7f09e8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:38.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:38.924+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09ec0509d0 con 0x7f09fc06c5a0 2024-09-13T18:55:39.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.096+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09fc15b030 con 0x7f09fc06c5a0 2024-09-13T18:55:39.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.096+0000 7f09f3400700 1 -- 172.21.15.81:0/1117893328 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09ec053ff0 con 0x7f09fc06c5a0 2024-09-13T18:55:39.105 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:55:39.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f09dc066730 msgr2=0x7f09dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f09dc066730 0x7f09dc068bf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f09e80090b0 tx=0x7f09e8008030 comp rx=0 tx=0).stop 2024-09-13T18:55:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 msgr2=0x7f09fc15d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 0x7f09fc15d6b0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f09ec00c500 tx=0x7f09ec00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 shutdown_connections 2024-09-13T18:55:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f09dc066730 0x7f09dc068bf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09fc15aa90 0x7f09fc1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09fc0cf830 0x7f09fc143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 --2- 172.21.15.81:0/1117893328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc06c5a0 0x7f09fc15d6b0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 >> 172.21.15.81:0/1117893328 conn(0x7f09fc071d20 msgr2=0x7f09fc0ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 shutdown_connections 2024-09-13T18:55:39.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.100+0000 7f09fbe00700 1 -- 172.21.15.81:0/1117893328 wait complete. 2024-09-13T18:55:39.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:55:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.304+0000 7fa223200700 1 Processor -- start 2024-09-13T18:55:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.304+0000 7fa223200700 1 -- start start 2024-09-13T18:55:39.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa223200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa22406cd80 0x7fa2240b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa223200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa224160680 con 0x7fa22406ada0 2024-09-13T18:55:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa223200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22415d670 con 0x7fa22415ca20 2024-09-13T18:55:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa223200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22415d950 con 0x7fa22406cd80 2024-09-13T18:55:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa221400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa22406cd80 0x7fa2240b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa222800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa22406ada0 0x7fa224160b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35344/0 (socket says 172.21.15.81:35344) 2024-09-13T18:55:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa222800700 1 -- 172.21.15.81:0/3933207201 learned_addr learned my addr 172.21.15.81:0/3933207201 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa221400700 1 -- 172.21.15.81:0/3933207201 >> v1:172.21.15.178:6789/0 conn(0x7fa22415ca20 legacy=0x7fa22415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa221400700 1 -- 172.21.15.81:0/3933207201 >> v1:172.21.15.81:6789/0 conn(0x7fa22406ada0 legacy=0x7fa224160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa221400700 1 -- 172.21.15.81:0/3933207201 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22415dc30 con 0x7fa22406cd80 2024-09-13T18:55:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa221400700 1 --2- 172.21.15.81:0/3933207201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22406cd80 0x7fa2240b4310 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fa210009850 tx=0x7fa210009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cfc26a088dedf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa220a00700 1 -- 172.21.15.81:0/3933207201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210011830 con 0x7fa22406cd80 2024-09-13T18:55:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa220a00700 1 -- 172.21.15.81:0/3933207201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210011990 con 0x7fa22406cd80 2024-09-13T18:55:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.308+0000 7fa220a00700 1 -- 172.21.15.81:0/3933207201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210011d20 con 0x7fa22406cd80 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- 172.21.15.81:0/3933207201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22406cd80 msgr2=0x7fa2240b4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 --2- 172.21.15.81:0/3933207201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22406cd80 0x7fa2240b4310 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fa210009850 tx=0x7fa210009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- 172.21.15.81:0/3933207201 shutdown_connections 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 --2- 172.21.15.81:0/3933207201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22406cd80 0x7fa2240b4310 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- 172.21.15.81:0/3933207201 >> 172.21.15.81:0/3933207201 conn(0x7fa224071d20 msgr2=0x7fa224072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- 172.21.15.81:0/3933207201 shutdown_connections 2024-09-13T18:55:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- 172.21.15.81:0/3933207201 wait complete. 2024-09-13T18:55:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 Processor -- start 2024-09-13T18:55:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- start start 2024-09-13T18:55:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa22406ada0 0x7fa2241f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22406cd80 0x7fa2240cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 0x7fa224145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2241f4870 con 0x7fa22415ca20 2024-09-13T18:55:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2241f4b50 con 0x7fa22406cd80 2024-09-13T18:55:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.312+0000 7fa223200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2241f4e30 con 0x7fa22406ada0 2024-09-13T18:55:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 0x7fa224145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 0x7fa224145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49464/0 (socket says 172.21.15.81:49464) 2024-09-13T18:55:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 -- 172.21.15.81:0/1751007911 learned_addr learned my addr 172.21.15.81:0/1751007911 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa221400700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22406cd80 0x7fa2240cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa221e00700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa22406ada0 0x7fa2241f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 -- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa22406ada0 msgr2=0x7fa2241f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa22406ada0 0x7fa2241f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 -- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22406cd80 msgr2=0x7fa2240cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22406cd80 0x7fa2240cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 -- 172.21.15.81:0/1751007911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2100094b0 con 0x7fa22415ca20 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa222800700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 0x7fa224145380 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00cbc0 tx=0x7fa21c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c007480 con 0x7fa22415ca20 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c0075e0 con 0x7fa22415ca20 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c007950 con 0x7fa22415ca20 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2241f5110 con 0x7fa22415ca20 2024-09-13T18:55:39.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2241458c0 con 0x7fa22415ca20 2024-09-13T18:55:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.316+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2241f5630 con 0x7fa22415ca20 2024-09-13T18:55:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.320+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa21c012400 con 0x7fa22415ca20 2024-09-13T18:55:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.320+0000 7fa21a000700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa204066730 0x7fa204068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.320+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa21c083b50 con 0x7fa22415ca20 2024-09-13T18:55:39.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.320+0000 7fa221e00700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa204066730 0x7fa204068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.320+0000 7fa221e00700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa204066730 0x7fa204068bf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa2240b2e70 tx=0x7fa214009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.324+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2241f5630 con 0x7fa22415ca20 2024-09-13T18:55:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.500+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2241f5630 con 0x7fa22415ca20 2024-09-13T18:55:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.500+0000 7fa21a000700 1 -- 172.21.15.81:0/1751007911 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2241f5630 con 0x7fa22415ca20 2024-09-13T18:55:39.509 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:55:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa204066730 msgr2=0x7fa204068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa204066730 0x7fa204068bf0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa2240b2e70 tx=0x7fa214009040 comp rx=0 tx=0).stop 2024-09-13T18:55:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 msgr2=0x7fa224145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 0x7fa224145380 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00cbc0 tx=0x7fa21c00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 shutdown_connections 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa204066730 0x7fa204068bf0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22415ca20 0x7fa224145380 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa22406cd80 0x7fa2240cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 --2- 172.21.15.81:0/1751007911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa22406ada0 0x7fa2241f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 >> 172.21.15.81:0/1751007911 conn(0x7fa224071d20 msgr2=0x7fa2240d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 shutdown_connections 2024-09-13T18:55:39.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.504+0000 7fa223200700 1 -- 172.21.15.81:0/1751007911 wait complete. 2024-09-13T18:55:39.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:55:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.700+0000 7fd260a00700 1 Processor -- start 2024-09-13T18:55:39.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.700+0000 7fd260a00700 1 -- start start 2024-09-13T18:55:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd260a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd25c0cc6f0 0x7fd25c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd260a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c0ccb40 con 0x7fd25c0cb020 2024-09-13T18:55:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd260a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd25c0b2ad0 con 0x7fd25c06aaa0 2024-09-13T18:55:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd260a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25c15b960 con 0x7fd25c0cc6f0 2024-09-13T18:55:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd25c0cb020 0x7fd25c15c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35346/0 (socket says 172.21.15.81:35346) 2024-09-13T18:55:39.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 -- 172.21.15.81:0/1185649609 learned_addr learned my addr 172.21.15.81:0/1185649609 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd253e00700 1 --2- 172.21.15.81:0/1185649609 >> v2:172.21.15.178:3300/0 conn(0x7fd25c0cc6f0 0x7fd25c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676160060 0 0) 0x7fd25c0ccb40 con 0x7fd25c0cb020 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2400035d0 con 0x7fd25c0cb020 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173151072 0 0) 0x7fd2400035d0 con 0x7fd25c0cb020 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 >> v2:172.21.15.178:3300/0 conn(0x7fd25c0cc6f0 msgr2=0x7fd25c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 --2- 172.21.15.81:0/1185649609 >> v2:172.21.15.178:3300/0 conn(0x7fd25c0cc6f0 0x7fd25c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 >> v1:172.21.15.178:6789/0 conn(0x7fd25c06aaa0 legacy=0x7fd25c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c15bc40 con 0x7fd25c0cb020 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fd24c001670 con 0x7fd25c0cb020 2024-09-13T18:55:39.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 >> v1:172.21.15.81:6789/0 conn(0x7fd25c0cb020 legacy=0x7fd25c15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240003a90 0x7fd240003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240004870 0x7fd240004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240005230 0x7fd24000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c15b960 con 0x7fd240003a90 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24000c0b0 con 0x7fd240005230 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24000c270 con 0x7fd240004870 2024-09-13T18:55:39.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240003a90 0x7fd240003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25be00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240005230 0x7fd24000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 -- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240004870 msgr2=0x7fd240004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd253e00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240004870 0x7fd240004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240004870 0x7fd240004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 -- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240005230 msgr2=0x7fd24000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240005230 0x7fd24000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 -- 172.21.15.81:0/1185649609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400035d0 con 0x7fd240003a90 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd253e00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240004870 0x7fd240004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25be00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd240005230 0x7fd24000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25be00700 1 -- 172.21.15.81:0/1185649609 reap_dead start 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.704+0000 7fd25b400700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240003a90 0x7fd240003e70 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0051b0 tx=0x7fd2400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d7d224deed71e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c005b80 con 0x7fd240003a90 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c005ce0 con 0x7fd240003a90 2024-09-13T18:55:39.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd25aa00700 1 -- 172.21.15.81:0/1185649609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c008370 con 0x7fd240003a90 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 -- 172.21.15.81:0/1185649609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240003a90 msgr2=0x7fd240003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240003a90 0x7fd240003e70 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0051b0 tx=0x7fd2400058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 -- 172.21.15.81:0/1185649609 shutdown_connections 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 --2- 172.21.15.81:0/1185649609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd240003a90 0x7fd240003e70 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 -- 172.21.15.81:0/1185649609 >> 172.21.15.81:0/1185649609 conn(0x7fd25c0b0c40 msgr2=0x7fd25c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 -- 172.21.15.81:0/1185649609 shutdown_connections 2024-09-13T18:55:39.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.708+0000 7fd260a00700 1 -- 172.21.15.81:0/1185649609 wait complete. 2024-09-13T18:55:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 Processor -- start 2024-09-13T18:55:39.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 -- start start 2024-09-13T18:55:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240003a90 0x7fd25c155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c156d60 0x7fd25c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 0x7fd25c0c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c155ca0 con 0x7fd25c144180 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c155f40 con 0x7fd25c156d60 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd260a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25c156220 con 0x7fd240003a90 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 0x7fd25c0c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 0x7fd25c0c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49478/0 (socket says 172.21.15.81:49478) 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 -- 172.21.15.81:0/1137356545 learned_addr learned my addr 172.21.15.81:0/1137356545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25b400700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240003a90 0x7fd25c155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd253e00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c156d60 0x7fd25c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 -- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240003a90 msgr2=0x7fd25c155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240003a90 0x7fd25c155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 -- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c156d60 msgr2=0x7fd25c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c156d60 0x7fd25c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd25be00700 1 -- 172.21.15.81:0/1137356545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25c156500 con 0x7fd25c144180 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.712+0000 7fd253e00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c156d60 0x7fd25c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd25be00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 0x7fd25c0c97c0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0cb8d0 tx=0x7fd25400de70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd254003c20 con 0x7fd25c144180 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd254003d80 con 0x7fd25c144180 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c1e66b0 con 0x7fd25c144180 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400baa0 con 0x7fd25c144180 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25c1576f0 con 0x7fd25c144180 2024-09-13T18:55:39.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25c1e68f0 con 0x7fd25c144180 2024-09-13T18:55:39.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.716+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd25400bc00 con 0x7fd25c144180 2024-09-13T18:55:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.720+0000 7fd253400700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd238066760 0x7fd238068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.720+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd254084210 con 0x7fd25c144180 2024-09-13T18:55:39.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.720+0000 7fd25b400700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd238066760 0x7fd238068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:39.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.720+0000 7fd25b400700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd238066760 0x7fd238068c20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0051b0 tx=0x7fd24c00a070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:39.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.728+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd25c1e68f0 con 0x7fd25c144180 2024-09-13T18:55:39.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.924+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd25c1e68f0 con 0x7fd25c144180 2024-09-13T18:55:39.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.924+0000 7fd253400700 1 -- 172.21.15.81:0/1137356545 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd25c1e68f0 con 0x7fd25c144180 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd238066760 msgr2=0x7fd238068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd238066760 0x7fd238068c20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0051b0 tx=0x7fd24c00a070 comp rx=0 tx=0).stop 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 msgr2=0x7fd25c0c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 0x7fd25c0c97c0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0cb8d0 tx=0x7fd25400de70 comp rx=0 tx=0).stop 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 shutdown_connections 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd238066760 0x7fd238068c20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd25c144180 0x7fd25c0c97c0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd25c156d60 0x7fd25c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 --2- 172.21.15.81:0/1137356545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd240003a90 0x7fd25c155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 >> 172.21.15.81:0/1137356545 conn(0x7fd25c0b0c40 msgr2=0x7fd25c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 shutdown_connections 2024-09-13T18:55:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:39.928+0000 7fd260a00700 1 -- 172.21.15.81:0/1137356545 wait complete. 2024-09-13T18:55:39.939 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-13T18:55:39.958 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:55:39.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:39.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:55:40.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:55:40.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:40.005 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:55:40.066 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:55:40.066 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:40.087 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:55:40.088 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:55:40.088 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:40.124 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:55:40.125 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:55:40.125 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:40.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:55:40.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:40.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 Processor -- start 2024-09-13T18:55:40.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 -- start start 2024-09-13T18:55:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23440cb020 0x7f23440cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440b2ad0 con 0x7f234406aaa0 2024-09-13T18:55:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234415b960 con 0x7f23440cb020 2024-09-13T18:55:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.328+0000 7f2349200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234415bc40 con 0x7f234415c2a0 2024-09-13T18:55:40.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23440cb020 0x7f23440cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23440cb020 0x7f23440cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49494/0 (socket says 172.21.15.81:49494) 2024-09-13T18:55:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 -- 172.21.15.81:0/981075415 learned_addr learned my addr 172.21.15.81:0/981075415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f233aa00700 1 --2- 172.21.15.81:0/981075415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 -- 172.21.15.81:0/981075415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 msgr2=0x7f234415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 --2- 172.21.15.81:0/981075415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 -- 172.21.15.81:0/981075415 >> v1:172.21.15.178:6789/0 conn(0x7f234406aaa0 legacy=0x7f23440b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 -- 172.21.15.81:0/981075415 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234415bf20 con 0x7f23440cb020 2024-09-13T18:55:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2343400700 1 --2- 172.21.15.81:0/981075415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23440cb020 0x7f23440cc6f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f2334009910 tx=0x7f2334009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7233b244772c52b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:40.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2342a00700 1 -- 172.21.15.81:0/981075415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334011830 con 0x7f23440cb020 2024-09-13T18:55:40.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2342a00700 1 -- 172.21.15.81:0/981075415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334011990 con 0x7f23440cb020 2024-09-13T18:55:40.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2342a00700 1 -- 172.21.15.81:0/981075415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334011d40 con 0x7f23440cb020 2024-09-13T18:55:40.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2349200700 1 -- 172.21.15.81:0/981075415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23440cb020 msgr2=0x7f23440cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2349200700 1 --2- 172.21.15.81:0/981075415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23440cb020 0x7f23440cc6f0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f2334009910 tx=0x7f2334009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2349200700 1 -- 172.21.15.81:0/981075415 shutdown_connections 2024-09-13T18:55:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2349200700 1 --2- 172.21.15.81:0/981075415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2349200700 1 --2- 172.21.15.81:0/981075415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23440cb020 0x7f23440cc6f0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.332+0000 7f2349200700 1 -- 172.21.15.81:0/981075415 >> 172.21.15.81:0/981075415 conn(0x7f23440b0c40 msgr2=0x7f234406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.336+0000 7f2349200700 1 -- 172.21.15.81:0/981075415 shutdown_connections 2024-09-13T18:55:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.336+0000 7f2349200700 1 -- 172.21.15.81:0/981075415 wait complete. 2024-09-13T18:55:40.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.336+0000 7f2349200700 1 Processor -- start 2024-09-13T18:55:40.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.336+0000 7f2349200700 1 -- start start 2024-09-13T18:55:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 0x7f234413e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23440cb020 0x7f23441574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441f6180 con 0x7f234406aaa0 2024-09-13T18:55:40.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23441f5e30 con 0x7f23440cb020 2024-09-13T18:55:40.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234413ccb0 con 0x7f234415c2a0 2024-09-13T18:55:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 0x7f234413e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 0x7f234413e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49506/0 (socket says 172.21.15.81:49506) 2024-09-13T18:55:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 -- 172.21.15.81:0/1106102266 learned_addr learned my addr 172.21.15.81:0/1106102266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f233aa00700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23440cb020 0x7f23441574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343e00700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 -- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 msgr2=0x7f234413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 -- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23440cb020 msgr2=0x7f23441574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23440cb020 0x7f23441574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 -- 172.21.15.81:0/1106102266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009570 con 0x7f234406aaa0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343e00700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2343400700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 0x7f234413e160 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f2334004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334004610 con 0x7f234406aaa0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340036c0 con 0x7f234406aaa0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23440c8ef0 con 0x7f234406aaa0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334003a50 con 0x7f234406aaa0 2024-09-13T18:55:40.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23441f6610 con 0x7f234406aaa0 2024-09-13T18:55:40.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.340+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234415b5e0 con 0x7f234406aaa0 2024-09-13T18:55:40.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.344+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2334003bb0 con 0x7f234406aaa0 2024-09-13T18:55:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.344+0000 7f233be00700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2320066730 0x7f2320068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.344+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2334021030 con 0x7f234406aaa0 2024-09-13T18:55:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.344+0000 7f233aa00700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2320066730 0x7f2320068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.348+0000 7f233aa00700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2320066730 0x7f2320068bf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f23440b0570 tx=0x7f232c00b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:40.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.352+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2334052c60 con 0x7f234406aaa0 2024-09-13T18:55:40.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.576+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23441f5fa0 con 0x7f234406aaa0 2024-09-13T18:55:40.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.576+0000 7f233be00700 1 -- 172.21.15.81:0/1106102266 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7f2334015090 con 0x7f234406aaa0 2024-09-13T18:55:40.584 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:40.584 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2320066730 msgr2=0x7f2320068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2320066730 0x7f2320068bf0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f23440b0570 tx=0x7f232c00b040 comp rx=0 tx=0).stop 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 msgr2=0x7f234413e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 0x7f234413e160 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f2334004770 comp rx=0 tx=0).stop 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 shutdown_connections 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2320066730 0x7f2320068bf0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234415c2a0 0x7f234413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23440cb020 0x7f23441574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 --2- 172.21.15.81:0/1106102266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f234406aaa0 0x7f234413e160 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 >> 172.21.15.81:0/1106102266 conn(0x7f23440b0c40 msgr2=0x7f234415db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:40.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 shutdown_connections 2024-09-13T18:55:40.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.580+0000 7f2349200700 1 -- 172.21.15.81:0/1106102266 wait complete. 2024-09-13T18:55:40.589 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:40.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:55:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 Processor -- start 2024-09-13T18:55:40.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 -- start start 2024-09-13T18:55:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd47c1610b0 0x7fd47c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd47c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c0b3560 con 0x7fd47c0b2670 2024-09-13T18:55:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c070b30 con 0x7fd47c1610b0 2024-09-13T18:55:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd480c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c06b420 con 0x7fd47c06aaa0 2024-09-13T18:55:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47be00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd47c0b2670 0x7fd47c0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35358/0 (socket says 172.21.15.81:35358) 2024-09-13T18:55:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47be00700 1 -- 172.21.15.81:0/4202283149 learned_addr learned my addr 172.21.15.81:0/4202283149 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47b400700 1 --2- 172.21.15.81:0/4202283149 >> v2:172.21.15.81:3300/0 conn(0x7fd47c1610b0 0x7fd47c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607478710 0 0) 0x7fd47c0b3560 con 0x7fd47c0b2670 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47aa00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd47c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4600035d0 con 0x7fd47c0b2670 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1871253186 0 0) 0x7fd4600035d0 con 0x7fd47c0b2670 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 msgr2=0x7fd47c06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd47c06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 >> v2:172.21.15.81:3300/0 conn(0x7fd47c1610b0 msgr2=0x7fd47c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 --2- 172.21.15.81:0/4202283149 >> v2:172.21.15.81:3300/0 conn(0x7fd47c1610b0 0x7fd47c0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0b3280 con 0x7fd47c0b2670 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7fd4740019f0 con 0x7fd47c0b2670 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.768+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 >> v1:172.21.15.81:6789/0 conn(0x7fd47c0b2670 legacy=0x7fd47c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460003a90 0x7fd460003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd460004870 0x7fd460004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd460005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c070b30 con 0x7fd460004870 2024-09-13T18:55:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c06b420 con 0x7fd460003a90 2024-09-13T18:55:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46000bb90 con 0x7fd47c06aaa0 2024-09-13T18:55:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd460004870 0x7fd460004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47b400700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460003a90 0x7fd460003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47be00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd460005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 -- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 msgr2=0x7fd460005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd460005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 -- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460003a90 msgr2=0x7fd460003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460003a90 0x7fd460003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 -- 172.21.15.81:0/4202283149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4600035d0 con 0x7fd460004870 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47be00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c06aaa0 0x7fd460005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47aa00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd460004870 0x7fd460004cf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fd468009880 tx=0x7fd4600058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b314cca16bffca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800c070 con 0x7fd460004870 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd468013610 con 0x7fd460004870 2024-09-13T18:55:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47a000700 1 -- 172.21.15.81:0/4202283149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680139c0 con 0x7fd460004870 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd480c00700 1 -- 172.21.15.81:0/4202283149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd460004870 msgr2=0x7fd460004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd480c00700 1 --2- 172.21.15.81:0/4202283149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd460004870 0x7fd460004cf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fd468009880 tx=0x7fd4600058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd47be00700 1 -- 172.21.15.81:0/4202283149 reap_dead start 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd480c00700 1 -- 172.21.15.81:0/4202283149 shutdown_connections 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.772+0000 7fd480c00700 1 -- 172.21.15.81:0/4202283149 >> 172.21.15.81:0/4202283149 conn(0x7fd47c0b0c40 msgr2=0x7fd47c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.776+0000 7fd480c00700 1 -- 172.21.15.81:0/4202283149 shutdown_connections 2024-09-13T18:55:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.776+0000 7fd480c00700 1 -- 172.21.15.81:0/4202283149 wait complete. 2024-09-13T18:55:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.776+0000 7fd480c00700 1 Processor -- start 2024-09-13T18:55:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.776+0000 7fd480c00700 1 -- start start 2024-09-13T18:55:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.776+0000 7fd480c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460004870 0x7fd47c158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 0x7fd47c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c15b5f0 0x7fd47c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c144930 con 0x7fd47c15b170 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c145840 con 0x7fd460004870 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c144c30 con 0x7fd47c15b5f0 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 0x7fd47c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 0x7fd47c143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49538/0 (socket says 172.21.15.81:49538) 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 -- 172.21.15.81:0/1476695562 learned_addr learned my addr 172.21.15.81:0/1476695562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47b400700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460004870 0x7fd47c158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47be00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c15b5f0 0x7fd47c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 -- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c15b5f0 msgr2=0x7fd47c1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c15b5f0 0x7fd47c1443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 -- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460004870 msgr2=0x7fd47c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460004870 0x7fd47c158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 -- 172.21.15.81:0/1476695562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c144f10 con 0x7fd47c15b170 2024-09-13T18:55:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd47aa00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 0x7fd47c143eb0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd46000bae0 tx=0x7fd4680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:40.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468021070 con 0x7fd47c15b170 2024-09-13T18:55:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd468027420 con 0x7fd47c15b170 2024-09-13T18:55:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680277b0 con 0x7fd47c15b170 2024-09-13T18:55:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c1451f0 con 0x7fd47c15b170 2024-09-13T18:55:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c163720 con 0x7fd47c15b170 2024-09-13T18:55:40.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.780+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c161490 con 0x7fd47c15b170 2024-09-13T18:55:40.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.784+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd468025070 con 0x7fd47c15b170 2024-09-13T18:55:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.784+0000 7fd473400700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd45c066730 0x7fd45c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:40.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.784+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd468084cb0 con 0x7fd47c15b170 2024-09-13T18:55:40.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.784+0000 7fd47b400700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd45c066730 0x7fd45c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:40.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.784+0000 7fd47b400700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd45c066730 0x7fd45c068bf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009c30 tx=0x7fd46c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:40.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.792+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd468051ef0 con 0x7fd47c15b170 2024-09-13T18:55:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.980+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd47c145980 con 0x7fd47c15b170 2024-09-13T18:55:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.980+0000 7fd473400700 1 -- 172.21.15.81:0/1476695562 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16766 (secure 0 0 0) 0x7fd468017090 con 0x7fd47c15b170 2024-09-13T18:55:40.990 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:40.990 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:55:01.545466+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.11","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:55:40.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd45c066730 msgr2=0x7fd45c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd45c066730 0x7fd45c068bf0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009c30 tx=0x7fd46c008040 comp rx=0 tx=0).stop 2024-09-13T18:55:40.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 msgr2=0x7fd47c143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:40.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 0x7fd47c143eb0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd46000bae0 tx=0x7fd4680047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 shutdown_connections 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fd45c066730 0x7fd45c068bf0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd47c15b5f0 0x7fd47c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47c15b170 0x7fd47c143eb0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 --2- 172.21.15.81:0/1476695562 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd460004870 0x7fd47c158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 >> 172.21.15.81:0/1476695562 conn(0x7fd47c0b0c40 msgr2=0x7fd47c15e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 shutdown_connections 2024-09-13T18:55:40.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:40.984+0000 7fd480c00700 1 -- 172.21.15.81:0/1476695562 wait complete. 2024-09-13T18:55:41.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:47:03.051737+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:54:44.442235+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:54:45.450767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:55:41.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:55:41.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.176+0000 7f612d000700 1 Processor -- start 2024-09-13T18:55:41.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.176+0000 7f612d000700 1 -- start start 2024-09-13T18:55:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f612d000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f612806c960 0x7f6128161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f612d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806cd40 0x7f61280b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f612d000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f61280b1980 0x7f6128162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f612d000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6128162340 con 0x7f612806c960 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f612d000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61280b2280 con 0x7f61280b1980 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f612d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61280b2560 con 0x7f612806cd40 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f612806c960 0x7f6128161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f612806c960 0x7f6128161e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49550/0 (socket says 172.21.15.81:49550) 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 -- 172.21.15.81:0/1573487639 learned_addr learned my addr 172.21.15.81:0/1573487639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127e00700 1 --2- 172.21.15.81:0/1573487639 >> v2:172.21.15.178:3300/0 conn(0x7f61280b1980 0x7f6128162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f611ea00700 1 --2- 172.21.15.81:0/1573487639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806cd40 0x7f61280b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 -- 172.21.15.81:0/1573487639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806cd40 msgr2=0x7f61280b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 --2- 172.21.15.81:0/1573487639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806cd40 0x7f61280b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 -- 172.21.15.81:0/1573487639 >> v2:172.21.15.178:3300/0 conn(0x7f61280b1980 msgr2=0x7f6128162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:41.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 --2- 172.21.15.81:0/1573487639 >> v2:172.21.15.178:3300/0 conn(0x7f61280b1980 0x7f6128162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 -- 172.21.15.81:0/1573487639 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61280b2840 con 0x7f612806c960 2024-09-13T18:55:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6127400700 1 --2- 172.21.15.81:0/1573487639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806c960 0x7f6128161e00 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f61280b3db0 tx=0x7f6118009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e2b49b9df682e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6126a00700 1 -- 172.21.15.81:0/1573487639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800b8a0 con 0x7f612806c960 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6126a00700 1 -- 172.21.15.81:0/1573487639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611800ba00 con 0x7f612806c960 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.180+0000 7f6126a00700 1 -- 172.21.15.81:0/1573487639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611800bd90 con 0x7f612806c960 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 -- 172.21.15.81:0/1573487639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806c960 msgr2=0x7f6128161e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 --2- 172.21.15.81:0/1573487639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806c960 0x7f6128161e00 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f61280b3db0 tx=0x7f6118009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 -- 172.21.15.81:0/1573487639 shutdown_connections 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 --2- 172.21.15.81:0/1573487639 >> v2:172.21.15.178:3300/0 conn(0x7f61280b1980 0x7f6128162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 --2- 172.21.15.81:0/1573487639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806cd40 0x7f61280b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 --2- 172.21.15.81:0/1573487639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806c960 0x7f6128161e00 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 -- 172.21.15.81:0/1573487639 >> 172.21.15.81:0/1573487639 conn(0x7f612806a390 msgr2=0x7f612806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 -- 172.21.15.81:0/1573487639 shutdown_connections 2024-09-13T18:55:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 -- 172.21.15.81:0/1573487639 wait complete. 2024-09-13T18:55:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 Processor -- start 2024-09-13T18:55:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.184+0000 7f612d000700 1 -- start start 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806c960 0x7f6128152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 0x7f61281faba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61280b1980 0x7f6128157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281fb0e0 con 0x7f612806cd40 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61281507a0 con 0x7f61280b1980 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6128153410 con 0x7f612806c960 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 0x7f61281faba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 0x7f61281faba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49564/0 (socket says 172.21.15.81:49564) 2024-09-13T18:55:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 -- 172.21.15.81:0/2415572484 learned_addr learned my addr 172.21.15.81:0/2415572484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f6127400700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806c960 0x7f6128152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 -- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806c960 msgr2=0x7f6128152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806c960 0x7f6128152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 -- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61280b1980 msgr2=0x7f6128157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61280b1980 0x7f6128157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 -- 172.21.15.81:0/2415572484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118009570 con 0x7f612806cd40 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f6127400700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806c960 0x7f6128152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611ea00700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 0x7f61281faba0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f611000d800 tx=0x7f611000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110014620 con 0x7f612806cd40 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6110014780 con 0x7f612806cd40 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61281536f0 con 0x7f612806cd40 2024-09-13T18:55:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6110014b10 con 0x7f612806cd40 2024-09-13T18:55:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.188+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128150d40 con 0x7f612806cd40 2024-09-13T18:55:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.192+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128150f60 con 0x7f612806cd40 2024-09-13T18:55:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.192+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6110014c70 con 0x7f612806cd40 2024-09-13T18:55:41.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.192+0000 7f611fe00700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6104066730 0x7f6104068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.192+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f61100848b0 con 0x7f612806cd40 2024-09-13T18:55:41.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.192+0000 7f6127400700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6104066730 0x7f6104068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.196+0000 7f6127400700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6104066730 0x7f6104068bf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6118000c00 tx=0x7f6118008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:41.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.200+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6110051a20 con 0x7f612806cd40 2024-09-13T18:55:41.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.380+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61280b1dd0 con 0x7f612806cd40 2024-09-13T18:55:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.380+0000 7f611fe00700 1 -- 172.21.15.81:0/2415572484 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6110055040 con 0x7f612806cd40 2024-09-13T18:55:41.390 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-13T18:55:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.384+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6104066730 msgr2=0x7f6104068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.384+0000 7f612d000700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6104066730 0x7f6104068bf0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6118000c00 tx=0x7f6118008030 comp rx=0 tx=0).stop 2024-09-13T18:55:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 msgr2=0x7f61281faba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 0x7f61281faba0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f611000d800 tx=0x7f611000dbc0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 shutdown_connections 2024-09-13T18:55:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f6104066730 0x7f6104068bf0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61280b1980 0x7f6128157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f612806cd40 0x7f61281faba0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 --2- 172.21.15.81:0/2415572484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612806c960 0x7f6128152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 >> 172.21.15.81:0/2415572484 conn(0x7f612806a390 msgr2=0x7f612806aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 shutdown_connections 2024-09-13T18:55:41.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.388+0000 7f612d000700 1 -- 172.21.15.81:0/2415572484 wait complete. 2024-09-13T18:55:41.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.580+0000 7f7a7b200700 1 Processor -- start 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.580+0000 7f7a7b200700 1 -- start start 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7b200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a740e2ef0 0x7f7a7400af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a740e32d0 0x7f7a74039750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a74039c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7b200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7400ab30 con 0x7f7a740e2ef0 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740558f0 con 0x7f7a740e32d0 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74007020 con 0x7f7a740553c0 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a740e2ef0 0x7f7a7400af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a740e2ef0 0x7f7a7400af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49566/0 (socket says 172.21.15.81:49566) 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 -- 172.21.15.81:0/2519533882 learned_addr learned my addr 172.21.15.81:0/2519533882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79400700 1 --2- 172.21.15.81:0/2519533882 >> v2:172.21.15.178:3300/0 conn(0x7f7a740e32d0 0x7f7a74039750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a7a800700 1 --2- 172.21.15.81:0/2519533882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a74039c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 -- 172.21.15.81:0/2519533882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 msgr2=0x7f7a74039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 --2- 172.21.15.81:0/2519533882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a74039c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 -- 172.21.15.81:0/2519533882 >> v2:172.21.15.178:3300/0 conn(0x7f7a740e32d0 msgr2=0x7f7a74039750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 --2- 172.21.15.81:0/2519533882 >> v2:172.21.15.178:3300/0 conn(0x7f7a740e32d0 0x7f7a74039750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.584+0000 7f7a79e00700 1 -- 172.21.15.81:0/2519533882 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74007300 con 0x7f7a740e2ef0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a79e00700 1 --2- 172.21.15.81:0/2519533882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e2ef0 0x7f7a7400af80 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400df80 tx=0x7f7a6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc6b8fae01d5f95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a78a00700 1 -- 172.21.15.81:0/2519533882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c005e50 con 0x7f7a740e2ef0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a78a00700 1 -- 172.21.15.81:0/2519533882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c006030 con 0x7f7a740e2ef0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a78a00700 1 -- 172.21.15.81:0/2519533882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0063c0 con 0x7f7a740e2ef0 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 -- 172.21.15.81:0/2519533882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e2ef0 msgr2=0x7f7a7400af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 --2- 172.21.15.81:0/2519533882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e2ef0 0x7f7a7400af80 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400df80 tx=0x7f7a6c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 -- 172.21.15.81:0/2519533882 shutdown_connections 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 --2- 172.21.15.81:0/2519533882 >> v2:172.21.15.178:3300/0 conn(0x7f7a740e32d0 0x7f7a74039750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 --2- 172.21.15.81:0/2519533882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a74039c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 --2- 172.21.15.81:0/2519533882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e2ef0 0x7f7a7400af80 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 -- 172.21.15.81:0/2519533882 >> 172.21.15.81:0/2519533882 conn(0x7f7a7401de30 msgr2=0x7f7a74054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 -- 172.21.15.81:0/2519533882 shutdown_connections 2024-09-13T18:55:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.588+0000 7f7a7b200700 1 -- 172.21.15.81:0/2519533882 wait complete. 2024-09-13T18:55:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 Processor -- start 2024-09-13T18:55:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 -- start start 2024-09-13T18:55:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a7417c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740e2ef0 0x7f7a74005a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 0x7f7a740daa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7404b580 con 0x7f7a740e32d0 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7417cac0 con 0x7f7a740e2ef0 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74049ae0 con 0x7f7a740553c0 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 0x7f7a740daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7a800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 0x7f7a740daa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49578/0 (socket says 172.21.15.81:49578) 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7a800700 1 -- 172.21.15.81:0/3056077252 learned_addr learned my addr 172.21.15.81:0/3056077252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a79e00700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a7417c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a79400700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740e2ef0 0x7f7a74005a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7a800700 1 -- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 msgr2=0x7f7a7417c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.592+0000 7f7a7a800700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a7417c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7a800700 1 -- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740e2ef0 msgr2=0x7f7a74005a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7a800700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740e2ef0 0x7f7a74005a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7a800700 1 -- 172.21.15.81:0/3056077252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c009520 con 0x7f7a740e32d0 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7a800700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 0x7f7a740daa70 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c074530 tx=0x7f7a7c0733b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0680d0 con 0x7f7a740e32d0 2024-09-13T18:55:41.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7c068290 con 0x7f7a740e32d0 2024-09-13T18:55:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c068640 con 0x7f7a740e32d0 2024-09-13T18:55:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74049dc0 con 0x7f7a740e32d0 2024-09-13T18:55:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7404a380 con 0x7f7a740e32d0 2024-09-13T18:55:41.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7401ec30 con 0x7f7a740e32d0 2024-09-13T18:55:41.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.596+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7a7c073660 con 0x7f7a740e32d0 2024-09-13T18:55:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.600+0000 7f7a72000700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7a5c066730 0x7f7a5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.600+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a7c0fd130 con 0x7f7a740e32d0 2024-09-13T18:55:41.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.600+0000 7f7a79e00700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7a5c066730 0x7f7a5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:41.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.600+0000 7f7a79e00700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7a5c066730 0x7f7a5c068bf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c000c00 tx=0x7f7a6c008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:41.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.608+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a7401ec30 con 0x7f7a740e32d0 2024-09-13T18:55:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.788+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a7401ec30 con 0x7f7a740e32d0 2024-09-13T18:55:41.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.788+0000 7f7a72000700 1 -- 172.21.15.81:0/3056077252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a7401ec30 con 0x7f7a740e32d0 2024-09-13T18:55:41.797 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7a5c066730 msgr2=0x7f7a5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7a5c066730 0x7f7a5c068bf0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c000c00 tx=0x7f7a6c008070 comp rx=0 tx=0).stop 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 msgr2=0x7f7a740daa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 0x7f7a740daa70 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c074530 tx=0x7f7a7c0733b0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 shutdown_connections 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7a5c066730 0x7f7a5c068bf0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a740e32d0 0x7f7a740daa70 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740e2ef0 0x7f7a74005a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 --2- 172.21.15.81:0/3056077252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a740553c0 0x7f7a7417c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 >> 172.21.15.81:0/3056077252 conn(0x7f7a7401de30 msgr2=0x7f7a74054ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 shutdown_connections 2024-09-13T18:55:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.792+0000 7f7a7b200700 1 -- 172.21.15.81:0/3056077252 wait complete. 2024-09-13T18:55:41.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:55:41.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.988+0000 7f28a6800700 1 Processor -- start 2024-09-13T18:55:41.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.988+0000 7f28a6800700 1 -- start start 2024-09-13T18:55:42.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.988+0000 7f28a6800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a006c5a0 0x7f28a015aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.988+0000 7f28a6800700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b4680 con 0x7f28a006c980 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.988+0000 7f28a6800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00b4960 con 0x7f28a00cf830 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.988+0000 7f28a6800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00b5dd0 con 0x7f28a006c5a0 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a5400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28a006c5a0 0x7f28a015aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a4a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28a006c980 0x7f28a00b56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35362/0 (socket says 172.21.15.81:35362) 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a4a00700 1 -- 172.21.15.81:0/838417969 learned_addr learned my addr 172.21.15.81:0/838417969 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a5400700 1 -- 172.21.15.81:0/838417969 >> v1:172.21.15.178:6789/0 conn(0x7f28a00cf830 legacy=0x7f28a00cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a5400700 1 -- 172.21.15.81:0/838417969 >> v1:172.21.15.81:6789/0 conn(0x7f28a006c980 legacy=0x7f28a00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f289fe00700 1 -- 172.21.15.81:0/838417969 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396728088 0 0) 0x7f28a00b4960 con 0x7f28a00cf830 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a5400700 1 -- 172.21.15.81:0/838417969 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00cf030 con 0x7f28a006c5a0 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a5400700 1 --2- 172.21.15.81:0/838417969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c5a0 0x7f28a015aa90 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f2894009850 tx=0x7f2894009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29e3e1ddb8ab734 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f289fe00700 1 -- 172.21.15.81:0/838417969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894004230 con 0x7f28a006c5a0 2024-09-13T18:55:42.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f289fe00700 1 -- 172.21.15.81:0/838417969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894004390 con 0x7f28a006c5a0 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f289fe00700 1 -- 172.21.15.81:0/838417969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28940036c0 con 0x7f28a006c5a0 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 -- 172.21.15.81:0/838417969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c5a0 msgr2=0x7f28a015aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 --2- 172.21.15.81:0/838417969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c5a0 0x7f28a015aa90 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f2894009850 tx=0x7f2894009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 -- 172.21.15.81:0/838417969 shutdown_connections 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 --2- 172.21.15.81:0/838417969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c5a0 0x7f28a015aa90 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 -- 172.21.15.81:0/838417969 >> 172.21.15.81:0/838417969 conn(0x7f28a0071d20 msgr2=0x7f28a0072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 -- 172.21.15.81:0/838417969 shutdown_connections 2024-09-13T18:55:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.992+0000 7f28a6800700 1 -- 172.21.15.81:0/838417969 wait complete. 2024-09-13T18:55:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.996+0000 7f28a6800700 1 Processor -- start 2024-09-13T18:55:42.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:41.996+0000 7f28a6800700 1 -- start start 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a006c5a0 0x7f28a01f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 0x7f28a014a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a00cf830 0x7f28a014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01f2900 con 0x7f28a006c980 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a014e430 con 0x7f28a00cf830 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a014e150 con 0x7f28a006c5a0 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 0x7f28a014a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 0x7f28a014a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49596/0 (socket says 172.21.15.81:49596) 2024-09-13T18:55:42.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 -- 172.21.15.81:0/46978077 learned_addr learned my addr 172.21.15.81:0/46978077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a5400700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a006c5a0 0x7f28a01f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a5e00700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a00cf830 0x7f28a014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 -- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a006c5a0 msgr2=0x7f28a01f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a006c5a0 0x7f28a01f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 -- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a00cf830 msgr2=0x7f28a014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a00cf830 0x7f28a014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 -- 172.21.15.81:0/46978077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28940094b0 con 0x7f28a006c980 2024-09-13T18:55:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a4a00700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 0x7f28a014a710 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c780 tx=0x7f288c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c004ca0 con 0x7f28a006c980 2024-09-13T18:55:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c004e00 con 0x7f28a006c980 2024-09-13T18:55:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a01f22b0 con 0x7f28a006c980 2024-09-13T18:55:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0072f0 con 0x7f28a006c980 2024-09-13T18:55:42.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.000+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a014ac50 con 0x7f28a006c980 2024-09-13T18:55:42.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.004+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a01f2a70 con 0x7f28a006c980 2024-09-13T18:55:42.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.004+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f288c007450 con 0x7f28a006c980 2024-09-13T18:55:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.008+0000 7f289d600700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2880066730 0x7f2880068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.008+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f288c083510 con 0x7f28a006c980 2024-09-13T18:55:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.008+0000 7f28a5400700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2880066730 0x7f2880068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.008+0000 7f28a5400700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2880066730 0x7f2880068bf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2894009850 tx=0x7f2894010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.012+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f288c050680 con 0x7f28a006c980 2024-09-13T18:55:42.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.192+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28a00cec70 con 0x7f28a006c980 2024-09-13T18:55:42.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.192+0000 7f289d600700 1 -- 172.21.15.81:0/46978077 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7f288c053ca0 con 0x7f28a006c980 2024-09-13T18:55:42.201 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-13T18:55:42.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2880066730 msgr2=0x7f2880068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2880066730 0x7f2880068bf0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f2894009850 tx=0x7f2894010000 comp rx=0 tx=0).stop 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 msgr2=0x7f28a014a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 0x7f28a014a710 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f288c00c780 tx=0x7f288c00cb40 comp rx=0 tx=0).stop 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 shutdown_connections 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f2880066730 0x7f2880068bf0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28a00cf830 0x7f28a014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28a006c980 0x7f28a014a710 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 --2- 172.21.15.81:0/46978077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28a006c5a0 0x7f28a01f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 >> 172.21.15.81:0/46978077 conn(0x7f28a0071d20 msgr2=0x7f28a01569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 shutdown_connections 2024-09-13T18:55:42.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.196+0000 7f28a6800700 1 -- 172.21.15.81:0/46978077 wait complete. 2024-09-13T18:55:42.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.384+0000 7f48a8e00700 1 Processor -- start 2024-09-13T18:55:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.384+0000 7f48a8e00700 1 -- start start 2024-09-13T18:55:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48a415cd90 0x7f48a40b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f48a40cdfe0 0x7f48a40ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a40d1390 con 0x7f48a415d170 2024-09-13T18:55:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40b2530 con 0x7f48a415cd90 2024-09-13T18:55:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a40d05f0 con 0x7f48a40cdfe0 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48a415cd90 0x7f48a40b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f48a415cd90 0x7f48a40b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49612/0 (socket says 172.21.15.81:49612) 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 -- 172.21.15.81:0/1649733511 learned_addr learned my addr 172.21.15.81:0/1649733511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3e00700 1 --2- 172.21.15.81:0/1649733511 >> v2:172.21.15.178:3300/0 conn(0x7f48a40cdfe0 0x7f48a40ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 -- 172.21.15.81:0/1649733511 >> v2:172.21.15.178:3300/0 conn(0x7f48a40cdfe0 msgr2=0x7f48a40ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 --2- 172.21.15.81:0/1649733511 >> v2:172.21.15.178:3300/0 conn(0x7f48a40cdfe0 0x7f48a40ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 -- 172.21.15.81:0/1649733511 >> v1:172.21.15.81:6789/0 conn(0x7f48a415d170 legacy=0x7f48a40cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 -- 172.21.15.81:0/1649733511 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40d1670 con 0x7f48a415cd90 2024-09-13T18:55:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a3400700 1 --2- 172.21.15.81:0/1649733511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a415cd90 0x7f48a40b1f50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f48a408b590 tx=0x7f489400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc348359e668eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a2a00700 1 -- 172.21.15.81:0/1649733511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400e070 con 0x7f48a415cd90 2024-09-13T18:55:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a2a00700 1 -- 172.21.15.81:0/1649733511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400b910 con 0x7f48a415cd90 2024-09-13T18:55:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a2a00700 1 -- 172.21.15.81:0/1649733511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400bcc0 con 0x7f48a415cd90 2024-09-13T18:55:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 -- 172.21.15.81:0/1649733511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a415cd90 msgr2=0x7f48a40b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 --2- 172.21.15.81:0/1649733511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a415cd90 0x7f48a40b1f50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f48a408b590 tx=0x7f489400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 -- 172.21.15.81:0/1649733511 shutdown_connections 2024-09-13T18:55:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 --2- 172.21.15.81:0/1649733511 >> v2:172.21.15.178:3300/0 conn(0x7f48a40cdfe0 0x7f48a40ce410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 --2- 172.21.15.81:0/1649733511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a415cd90 0x7f48a40b1f50 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.388+0000 7f48a8e00700 1 -- 172.21.15.81:0/1649733511 >> 172.21.15.81:0/1649733511 conn(0x7f48a40d2c10 msgr2=0x7f48a40d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.392+0000 7f48a8e00700 1 -- 172.21.15.81:0/1649733511 shutdown_connections 2024-09-13T18:55:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.392+0000 7f48a8e00700 1 -- 172.21.15.81:0/1649733511 wait complete. 2024-09-13T18:55:42.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.392+0000 7f48a8e00700 1 Processor -- start 2024-09-13T18:55:42.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.392+0000 7f48a8e00700 1 -- start start 2024-09-13T18:55:42.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 0x7f48a415f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a415cd90 0x7f48a40b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a415d170 0x7f48a41f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4148b60 con 0x7f48a40cdfe0 2024-09-13T18:55:42.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4148e40 con 0x7f48a415d170 2024-09-13T18:55:42.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4149120 con 0x7f48a415cd90 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 0x7f48a415f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 0x7f48a415f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49616/0 (socket says 172.21.15.81:49616) 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 -- 172.21.15.81:0/3969156296 learned_addr learned my addr 172.21.15.81:0/3969156296 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a415d170 0x7f48a41f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f489aa00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a415cd90 0x7f48a40b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 -- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a415cd90 msgr2=0x7f48a40b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a415cd90 0x7f48a40b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 -- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a415d170 msgr2=0x7f48a41f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a415d170 0x7f48a41f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 -- 172.21.15.81:0/3969156296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894009b30 con 0x7f48a40cdfe0 2024-09-13T18:55:42.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f489aa00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a415cd90 0x7f48a40b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a3400700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 0x7f48a415f1c0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f48a40d2b70 tx=0x7f4894004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894004970 con 0x7f48a40cdfe0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48940092e0 con 0x7f48a40cdfe0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a4149400 con 0x7f48a40cdfe0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489401c660 con 0x7f48a40cdfe0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.396+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a415f700 con 0x7f48a40cdfe0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.400+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a40ce410 con 0x7f48a40cdfe0 2024-09-13T18:55:42.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.400+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f489401c7c0 con 0x7f48a40cdfe0 2024-09-13T18:55:42.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.400+0000 7f489be00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4880066730 0x7f4880068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.404+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4894085b30 con 0x7f48a40cdfe0 2024-09-13T18:55:42.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.404+0000 7f489aa00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4880066730 0x7f4880068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.404+0000 7f489aa00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4880066730 0x7f4880068bf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f48a406ccb0 tx=0x7f488c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.408+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4894052dd0 con 0x7f48a40cdfe0 2024-09-13T18:55:42.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.644+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48a40d0cb0 con 0x7f48a40cdfe0 2024-09-13T18:55:42.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f489be00700 1 -- 172.21.15.81:0/3969156296 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7f48940563f0 con 0x7f48a40cdfe0 2024-09-13T18:55:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:42.655 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4880066730 msgr2=0x7f4880068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4880066730 0x7f4880068bf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f48a406ccb0 tx=0x7f488c009040 comp rx=0 tx=0).stop 2024-09-13T18:55:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 msgr2=0x7f48a415f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 0x7f48a415f1c0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f48a40d2b70 tx=0x7f4894004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 shutdown_connections 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4880066730 0x7f4880068bf0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48a415d170 0x7f48a41f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48a415cd90 0x7f48a40b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 --2- 172.21.15.81:0/3969156296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48a40cdfe0 0x7f48a415f1c0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 >> 172.21.15.81:0/3969156296 conn(0x7f48a40d2c10 msgr2=0x7f48a406c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 shutdown_connections 2024-09-13T18:55:42.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.648+0000 7f48a8e00700 1 -- 172.21.15.81:0/3969156296 wait complete. 2024-09-13T18:55:42.660 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:42.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:55:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.848+0000 7fcb86400700 1 Processor -- start 2024-09-13T18:55:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.848+0000 7fcb86400700 1 -- start start 2024-09-13T18:55:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb86400700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcb80159bd0 0x7fcb800cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb86400700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb800707d0 con 0x7fcb80071870 2024-09-13T18:55:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb86400700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8006fee0 con 0x7fcb8006b1b0 2024-09-13T18:55:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb86400700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800720a0 con 0x7fcb80159bd0 2024-09-13T18:55:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb77e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcb80071870 0x7fcb8006aaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35388/0 (socket says 172.21.15.81:35388) 2024-09-13T18:55:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb77e00700 1 -- 172.21.15.81:0/242138801 learned_addr learned my addr 172.21.15.81:0/242138801 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb85000700 1 --2- 172.21.15.81:0/242138801 >> v2:172.21.15.178:3300/0 conn(0x7fcb80159bd0 0x7fcb800cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb85000700 1 -- 172.21.15.81:0/242138801 >> v1:172.21.15.178:6789/0 conn(0x7fcb8006b1b0 legacy=0x7fcb801636b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb85000700 1 -- 172.21.15.81:0/242138801 >> v1:172.21.15.81:6789/0 conn(0x7fcb80071870 legacy=0x7fcb8006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb85000700 1 -- 172.21.15.81:0/242138801 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800b2ef0 con 0x7fcb80159bd0 2024-09-13T18:55:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb7fe00700 1 -- 172.21.15.81:0/242138801 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446168690 0 0) 0x7fcb800707d0 con 0x7fcb80071870 2024-09-13T18:55:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb85000700 1 --2- 172.21.15.81:0/242138801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb800cb700 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009880 tx=0x7fcb70009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3759bf1a6cbc893c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb7fe00700 1 -- 172.21.15.81:0/242138801 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70011830 con 0x7fcb80159bd0 2024-09-13T18:55:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb7fe00700 1 -- 172.21.15.81:0/242138801 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70011990 con 0x7fcb80159bd0 2024-09-13T18:55:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.852+0000 7fcb7fe00700 1 -- 172.21.15.81:0/242138801 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70011d20 con 0x7fcb80159bd0 2024-09-13T18:55:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 -- 172.21.15.81:0/242138801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 msgr2=0x7fcb800cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 --2- 172.21.15.81:0/242138801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb800cb700 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009880 tx=0x7fcb70009b90 comp rx=0 tx=0).stop 2024-09-13T18:55:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 -- 172.21.15.81:0/242138801 shutdown_connections 2024-09-13T18:55:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 --2- 172.21.15.81:0/242138801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb800cb700 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 -- 172.21.15.81:0/242138801 >> 172.21.15.81:0/242138801 conn(0x7fcb800b0c40 msgr2=0x7fcb8006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 -- 172.21.15.81:0/242138801 shutdown_connections 2024-09-13T18:55:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.856+0000 7fcb86400700 1 -- 172.21.15.81:0/242138801 wait complete. 2024-09-13T18:55:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 Processor -- start 2024-09-13T18:55:42.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 -- start start 2024-09-13T18:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb8006b1b0 0x7fcb8014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb80071870 0x7fcb80145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb8006c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8014f2a0 con 0x7fcb80071870 2024-09-13T18:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801f40d0 con 0x7fcb80159bd0 2024-09-13T18:55:42.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb86400700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801f43b0 con 0x7fcb8006b1b0 2024-09-13T18:55:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb77e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb80071870 0x7fcb80145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb8006b1b0 0x7fcb8014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb77e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb80071870 0x7fcb80145140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49630/0 (socket says 172.21.15.81:49630) 2024-09-13T18:55:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb77e00700 1 -- 172.21.15.81:0/2029535554 learned_addr learned my addr 172.21.15.81:0/2029535554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:42.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85a00700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb8006c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 -- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 msgr2=0x7fcb8006c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb8006c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 -- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb80071870 msgr2=0x7fcb80145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb80071870 0x7fcb80145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 -- 172.21.15.81:0/2029535554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700094b0 con 0x7fcb8006b1b0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85a00700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb8006c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.860+0000 7fcb85000700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb8006b1b0 0x7fcb8014e4f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb70016000 tx=0x7fcb70004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70019b70 con 0x7fcb8006b1b0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb801f4690 con 0x7fcb8006b1b0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7001e070 con 0x7fcb8006b1b0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7001a420 con 0x7fcb8006b1b0 2024-09-13T18:55:42.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb80145680 con 0x7fcb8006b1b0 2024-09-13T18:55:42.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb800cb700 con 0x7fcb8006b1b0 2024-09-13T18:55:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.864+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb7001a580 con 0x7fcb8006b1b0 2024-09-13T18:55:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.868+0000 7fcb7d600700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb5c066730 0x7fcb5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.868+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb700859d0 con 0x7fcb8006b1b0 2024-09-13T18:55:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.868+0000 7fcb77e00700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb5c066730 0x7fcb5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.868+0000 7fcb77e00700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb5c066730 0x7fcb5c068bf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcb68001360 tx=0x7fcb680012f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:42.872+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcb70052bd0 con 0x7fcb8006b1b0 2024-09-13T18:55:43.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.056+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb8015d100 con 0x7fcb8006b1b0 2024-09-13T18:55:43.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.060+0000 7fcb7d600700 1 -- 172.21.15.81:0/2029535554 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16766 (secure 0 0 0) 0x7fcb70020090 con 0x7fcb8006b1b0 2024-09-13T18:55:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:43.068 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:55:01.545466+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.11","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:55:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb5c066730 msgr2=0x7fcb5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb5c066730 0x7fcb5c068bf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fcb68001360 tx=0x7fcb680012f0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb8006b1b0 msgr2=0x7fcb8014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb8006b1b0 0x7fcb8014e4f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcb70016000 tx=0x7fcb70004770 comp rx=0 tx=0).stop 2024-09-13T18:55:43.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 shutdown_connections 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb5c066730 0x7fcb5c068bf0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb80159bd0 0x7fcb8006c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb80071870 0x7fcb80145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 --2- 172.21.15.81:0/2029535554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb8006b1b0 0x7fcb8014e4f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 >> 172.21.15.81:0/2029535554 conn(0x7fcb800b0c40 msgr2=0x7fcb80157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 shutdown_connections 2024-09-13T18:55:43.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.064+0000 7fcb86400700 1 -- 172.21.15.81:0/2029535554 wait complete. 2024-09-13T18:55:43.094 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:55:43.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:43.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 Processor -- start 2024-09-13T18:55:43.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 -- start start 2024-09-13T18:55:43.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40f0161060 0x7f40f006b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f00667a0 0x7f40f0071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f00b3180 con 0x7f40f0165650 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f00b29e0 con 0x7f40f0161060 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f7600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0070d10 con 0x7f40f00667a0 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f4c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f40f0161060 0x7f40f006b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40efe00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f40f0165650 0x7f40f0066090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:43766/0 (socket says 172.21.15.81:43766) 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40efe00700 1 -- 172.21.15.81:0/1558927642 learned_addr learned my addr 172.21.15.81:0/1558927642 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:43.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.256+0000 7f40f5600700 1 --2- 172.21.15.81:0/1558927642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f00667a0 0x7f40f0071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40ef400700 1 -- 172.21.15.81:0/1558927642 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155041071 0 0) 0x7f40f00b3180 con 0x7f40f0165650 2024-09-13T18:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40ef400700 1 -- 172.21.15.81:0/1558927642 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d80035d0 con 0x7f40f0165650 2024-09-13T18:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f5600700 1 -- 172.21.15.81:0/1558927642 >> v2:172.21.15.81:3300/0 conn(0x7f40f0161060 msgr2=0x7f40f006b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f5600700 1 --2- 172.21.15.81:0/1558927642 >> v2:172.21.15.81:3300/0 conn(0x7f40f0161060 0x7f40f006b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f5600700 1 -- 172.21.15.81:0/1558927642 >> v1:172.21.15.178:6789/0 conn(0x7f40f0165650 legacy=0x7f40f0066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f5600700 1 -- 172.21.15.81:0/1558927642 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f00b2bc0 con 0x7f40f00667a0 2024-09-13T18:55:43.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f4c00700 1 --2- 172.21.15.81:0/1558927642 >> v2:172.21.15.81:3300/0 conn(0x7f40f0161060 0x7f40f006b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:43.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f5600700 1 --2- 172.21.15.81:0/1558927642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f00667a0 0x7f40f0071410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009d90 tx=0x7f40e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd8c2aa6445afb5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:43.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40ef400700 1 -- 172.21.15.81:0/1558927642 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e070 con 0x7f40f00667a0 2024-09-13T18:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40ef400700 1 -- 172.21.15.81:0/1558927642 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e800bb20 con 0x7f40f00667a0 2024-09-13T18:55:43.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40ef400700 1 -- 172.21.15.81:0/1558927642 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800be90 con 0x7f40f00667a0 2024-09-13T18:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f7600700 1 -- 172.21.15.81:0/1558927642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f00667a0 msgr2=0x7f40f0071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f7600700 1 --2- 172.21.15.81:0/1558927642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f00667a0 0x7f40f0071410 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009d90 tx=0x7f40e800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f7600700 1 -- 172.21.15.81:0/1558927642 shutdown_connections 2024-09-13T18:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f7600700 1 --2- 172.21.15.81:0/1558927642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f00667a0 0x7f40f0071410 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f7600700 1 --2- 172.21.15.81:0/1558927642 >> v2:172.21.15.81:3300/0 conn(0x7f40f0161060 0x7f40f006b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.260+0000 7f40f7600700 1 -- 172.21.15.81:0/1558927642 >> 172.21.15.81:0/1558927642 conn(0x7f40f00b1e00 msgr2=0x7f40f00cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.264+0000 7f40f7600700 1 -- 172.21.15.81:0/1558927642 shutdown_connections 2024-09-13T18:55:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.264+0000 7f40f7600700 1 -- 172.21.15.81:0/1558927642 wait complete. 2024-09-13T18:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.264+0000 7f40f7600700 1 Processor -- start 2024-09-13T18:55:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.264+0000 7f40f7600700 1 -- start start 2024-09-13T18:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 0x7f40f014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f0161060 0x7f40f0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f0165650 0x7f40f015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0155b60 con 0x7f40f00667a0 2024-09-13T18:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f01615c0 con 0x7f40f0161060 2024-09-13T18:55:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f0155880 con 0x7f40f0165650 2024-09-13T18:55:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 0x7f40f014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 0x7f40f014fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49640/0 (socket says 172.21.15.81:49640) 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 -- 172.21.15.81:0/3556448089 learned_addr learned my addr 172.21.15.81:0/3556448089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40efe00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f0161060 0x7f40f0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f5600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f0165650 0x7f40f015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 -- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f0165650 msgr2=0x7f40f015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f0165650 0x7f40f015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 -- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f0161060 msgr2=0x7f40f0154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f0161060 0x7f40f0154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 -- 172.21.15.81:0/3556448089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40094b0 con 0x7f40f00667a0 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40efe00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f0161060 0x7f40f0154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f5600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f0165650 0x7f40f015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f4c00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 0x7f40f014fdc0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f40e400ec10 tx=0x7f40e4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400c940 con 0x7f40f00667a0 2024-09-13T18:55:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e400caa0 con 0x7f40f00667a0 2024-09-13T18:55:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e8009a70 con 0x7f40f00667a0 2024-09-13T18:55:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e400ce30 con 0x7f40f00667a0 2024-09-13T18:55:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.268+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f0159340 con 0x7f40f00667a0 2024-09-13T18:55:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.272+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f0067730 con 0x7f40f00667a0 2024-09-13T18:55:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.272+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f40e4013470 con 0x7f40f00667a0 2024-09-13T18:55:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.272+0000 7f40ecc00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d0066760 0x7f40d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.272+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f40e4084450 con 0x7f40f00667a0 2024-09-13T18:55:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.272+0000 7f40efe00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d0066760 0x7f40d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.276+0000 7f40efe00700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d0066760 0x7f40d0068c20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f40f01f9d40 tx=0x7f40dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.280+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40e40516f0 con 0x7f40f00667a0 2024-09-13T18:55:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.504+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40f0066230 con 0x7f40f00667a0 2024-09-13T18:55:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40ecc00700 1 -- 172.21.15.81:0/3556448089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7f40e4054d10 con 0x7f40f00667a0 2024-09-13T18:55:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:43.515 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d0066760 msgr2=0x7f40d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d0066760 0x7f40d0068c20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f40f01f9d40 tx=0x7f40dc009040 comp rx=0 tx=0).stop 2024-09-13T18:55:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 msgr2=0x7f40f014fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 0x7f40f014fdc0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f40e400ec10 tx=0x7f40e4009ed0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 shutdown_connections 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f40d0066760 0x7f40d0068c20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40f0165650 0x7f40f015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40f0161060 0x7f40f0154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 --2- 172.21.15.81:0/3556448089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40f00667a0 0x7f40f014fdc0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.508+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 >> 172.21.15.81:0/3556448089 conn(0x7f40f00b1e00 msgr2=0x7f40f015e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.512+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 shutdown_connections 2024-09-13T18:55:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.512+0000 7f40f7600700 1 -- 172.21.15.81:0/3556448089 wait complete. 2024-09-13T18:55:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:43.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:55:43.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.704+0000 7fcb89e00700 1 Processor -- start 2024-09-13T18:55:43.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.704+0000 7fcb89e00700 1 -- start start 2024-09-13T18:55:43.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.704+0000 7fcb89e00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcb8406ca50 0x7fcb8406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.704+0000 7fcb89e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84166bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.704+0000 7fcb89e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8406b140 con 0x7fcb8415cb30 2024-09-13T18:55:43.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89e00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb840cd7a0 con 0x7fcb8406ca50 2024-09-13T18:55:43.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8406d3d0 con 0x7fcb841647e0 2024-09-13T18:55:43.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb88a00700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fcb8415cb30 0x7fcb8406bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:43776/0 (socket says 172.21.15.81:43776) 2024-09-13T18:55:43.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb88a00700 1 -- 172.21.15.81:0/1858371522 learned_addr learned my addr 172.21.15.81:0/1858371522 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:43.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89400700 1 --2- 172.21.15.81:0/1858371522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84166bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb7be00700 1 --2- 172.21.15.81:0/1858371522 >> v2:172.21.15.178:3300/0 conn(0x7fcb8406ca50 0x7fcb8406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb83e00700 1 -- 172.21.15.81:0/1858371522 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295954344 0 0) 0x7fcb8406b140 con 0x7fcb8415cb30 2024-09-13T18:55:43.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb83e00700 1 -- 172.21.15.81:0/1858371522 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb680035d0 con 0x7fcb8415cb30 2024-09-13T18:55:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89400700 1 -- 172.21.15.81:0/1858371522 >> v2:172.21.15.178:3300/0 conn(0x7fcb8406ca50 msgr2=0x7fcb8406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89400700 1 --2- 172.21.15.81:0/1858371522 >> v2:172.21.15.178:3300/0 conn(0x7fcb8406ca50 0x7fcb8406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89400700 1 -- 172.21.15.81:0/1858371522 >> v1:172.21.15.178:6789/0 conn(0x7fcb8415cb30 legacy=0x7fcb8406bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89400700 1 -- 172.21.15.81:0/1858371522 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8406a530 con 0x7fcb841647e0 2024-09-13T18:55:43.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb89400700 1 --2- 172.21.15.81:0/1858371522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84166bd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009d90 tx=0x7fcb7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce0bcc2d18e76fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:43.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb83e00700 1 -- 172.21.15.81:0/1858371522 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00e070 con 0x7fcb841647e0 2024-09-13T18:55:43.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb83e00700 1 -- 172.21.15.81:0/1858371522 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00bb20 con 0x7fcb841647e0 2024-09-13T18:55:43.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.708+0000 7fcb83e00700 1 -- 172.21.15.81:0/1858371522 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00be90 con 0x7fcb841647e0 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 -- 172.21.15.81:0/1858371522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 msgr2=0x7fcb84166bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 --2- 172.21.15.81:0/1858371522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84166bd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009d90 tx=0x7fcb7c00b330 comp rx=0 tx=0).stop 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 -- 172.21.15.81:0/1858371522 shutdown_connections 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 --2- 172.21.15.81:0/1858371522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84166bd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 --2- 172.21.15.81:0/1858371522 >> v2:172.21.15.178:3300/0 conn(0x7fcb8406ca50 0x7fcb8406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 -- 172.21.15.81:0/1858371522 >> 172.21.15.81:0/1858371522 conn(0x7fcb84071f00 msgr2=0x7fcb840722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:43.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 -- 172.21.15.81:0/1858371522 shutdown_connections 2024-09-13T18:55:43.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 -- 172.21.15.81:0/1858371522 wait complete. 2024-09-13T18:55:43.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 Processor -- start 2024-09-13T18:55:43.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.712+0000 7fcb89e00700 1 -- start start 2024-09-13T18:55:43.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 0x7fcb840ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8415cb30 0x7fcb8414df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840b3cc0 con 0x7fcb8406ca50 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840b2b10 con 0x7fcb8415cb30 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb840b2550 con 0x7fcb841647e0 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 0x7fcb840ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 0x7fcb840ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49656/0 (socket says 172.21.15.81:49656) 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 -- 172.21.15.81:0/2802046218 learned_addr learned my addr 172.21.15.81:0/2802046218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89400700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb7be00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8415cb30 0x7fcb8414df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 -- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 msgr2=0x7fcb84156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 -- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8415cb30 msgr2=0x7fcb8414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8415cb30 0x7fcb8414df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 -- 172.21.15.81:0/2802046218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c009a70 con 0x7fcb8406ca50 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb88a00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 0x7fcb840ccd60 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c4f0 tx=0x7fcb7400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74005d90 con 0x7fcb8406ca50 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb740070d0 con 0x7fcb8406ca50 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb74007440 con 0x7fcb8406ca50 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.716+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb840b2830 con 0x7fcb8406ca50 2024-09-13T18:55:43.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.720+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb840cd2a0 con 0x7fcb8406ca50 2024-09-13T18:55:43.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.720+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8415cf10 con 0x7fcb8406ca50 2024-09-13T18:55:43.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.724+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcb740075a0 con 0x7fcb8406ca50 2024-09-13T18:55:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.724+0000 7fcb81600700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb60066730 0x7fcb60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.724+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb74083630 con 0x7fcb8406ca50 2024-09-13T18:55:43.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.724+0000 7fcb7be00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb60066730 0x7fcb60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:43.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.724+0000 7fcb7be00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb60066730 0x7fcb60068bf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fcb84157710 tx=0x7fcb6c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.732+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcb74050850 con 0x7fcb8406ca50 2024-09-13T18:55:43.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:55:43.866 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:55:43.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.960+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb84158350 con 0x7fcb8406ca50 2024-09-13T18:55:43.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.960+0000 7fcb81600700 1 -- 172.21.15.81:0/2802046218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4782 (secure 0 0 0) 0x7fcb74053e70 con 0x7fcb8406ca50 2024-09-13T18:55:43.969 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:43.969 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":115,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:54:46.454706+0000","modified":"2024-09-13T18:55:24.693124+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8910,"mds_1":8907,"mds_2":7550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7550":{"gid":7550,"name":"d","rank":2,"incarnation":108,"state":"up:active","state_seq":12,"addr":"172.21.15.178:6835/1735589745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":1735589745},{"type":"v1","addr":"172.21.15.178:6835","nonce":1735589745}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8907":{"gid":8907,"name":"c","rank":1,"incarnation":106,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6836/4220647450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":4220647450},{"type":"v1","addr":"172.21.15.81:6836","nonce":4220647450}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_8910":{"gid":8910,"name":"a","rank":0,"incarnation":101,"state":"up:active","state_seq":12,"addr":"172.21.15.81:6837/2331750359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2331750359},{"type":"v1","addr":"172.21.15.81:6837","nonce":2331750359}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:55:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb60066730 msgr2=0x7fcb60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb60066730 0x7fcb60068bf0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fcb84157710 tx=0x7fcb6c009240 comp rx=0 tx=0).stop 2024-09-13T18:55:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 msgr2=0x7fcb840ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 0x7fcb840ccd60 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c4f0 tx=0x7fcb7400c800 comp rx=0 tx=0).stop 2024-09-13T18:55:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 shutdown_connections 2024-09-13T18:55:43.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fcb60066730 0x7fcb60068bf0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb841647e0 0x7fcb84156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb8415cb30 0x7fcb8414df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 --2- 172.21.15.81:0/2802046218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcb8406ca50 0x7fcb840ccd60 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 >> 172.21.15.81:0/2802046218 conn(0x7fcb84071f00 msgr2=0x7fcb840c7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 shutdown_connections 2024-09-13T18:55:43.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:43.964+0000 7fcb89e00700 1 -- 172.21.15.81:0/2802046218 wait complete. 2024-09-13T18:55:43.974 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 115 2024-09-13T18:55:43.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:55:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.160+0000 7f5628600700 1 Processor -- start 2024-09-13T18:55:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.160+0000 7f5628600700 1 -- start start 2024-09-13T18:55:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5628600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562015b700 0x7f562015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5628600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f562006c460 0x7f562006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5628600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f562006a5d0 0x7f562006aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5628600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562006afa0 con 0x7f562006a5d0 2024-09-13T18:55:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5628600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56200cdd90 con 0x7f562006c460 2024-09-13T18:55:44.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5628600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562006ce10 con 0x7f562015b700 2024-09-13T18:55:44.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f562006a5d0 0x7f562006aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f562006a5d0 0x7f562006aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49662/0 (socket says 172.21.15.81:49662) 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 -- 172.21.15.81:0/2498216061 learned_addr learned my addr 172.21.15.81:0/2498216061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5625c00700 1 --2- 172.21.15.81:0/2498216061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562015b700 0x7f562015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5625200700 1 --2- 172.21.15.81:0/2498216061 >> v2:172.21.15.178:3300/0 conn(0x7f562006c460 0x7f562006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 -- 172.21.15.81:0/2498216061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562015b700 msgr2=0x7f562015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 --2- 172.21.15.81:0/2498216061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562015b700 0x7f562015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 -- 172.21.15.81:0/2498216061 >> v2:172.21.15.178:3300/0 conn(0x7f562006c460 msgr2=0x7f562006d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 --2- 172.21.15.81:0/2498216061 >> v2:172.21.15.178:3300/0 conn(0x7f562006c460 0x7f562006d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 -- 172.21.15.81:0/2498216061 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562015c020 con 0x7f562006a5d0 2024-09-13T18:55:44.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f5626600700 1 --2- 172.21.15.81:0/2498216061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562006a5d0 0x7f562006aa60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f56200cc590 tx=0x7f561800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e27da72bc4f75d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f561fe00700 1 -- 172.21.15.81:0/2498216061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800e070 con 0x7f562006a5d0 2024-09-13T18:55:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f561fe00700 1 -- 172.21.15.81:0/2498216061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561800b9c0 con 0x7f562006a5d0 2024-09-13T18:55:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.164+0000 7f561fe00700 1 -- 172.21.15.81:0/2498216061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f561800bd70 con 0x7f562006a5d0 2024-09-13T18:55:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 -- 172.21.15.81:0/2498216061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562006a5d0 msgr2=0x7f562006aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 --2- 172.21.15.81:0/2498216061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562006a5d0 0x7f562006aa60 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f56200cc590 tx=0x7f561800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 -- 172.21.15.81:0/2498216061 shutdown_connections 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 --2- 172.21.15.81:0/2498216061 >> v2:172.21.15.178:3300/0 conn(0x7f562006c460 0x7f562006d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 --2- 172.21.15.81:0/2498216061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562006a5d0 0x7f562006aa60 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 --2- 172.21.15.81:0/2498216061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562015b700 0x7f562015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 -- 172.21.15.81:0/2498216061 >> 172.21.15.81:0/2498216061 conn(0x7f56200b08d0 msgr2=0x7f56200b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 -- 172.21.15.81:0/2498216061 shutdown_connections 2024-09-13T18:55:44.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.168+0000 7f5628600700 1 -- 172.21.15.81:0/2498216061 wait complete. 2024-09-13T18:55:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 Processor -- start 2024-09-13T18:55:44.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 -- start start 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006a5d0 0x7f562014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f562006c460 0x7f5620148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 0x7f56201e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56200705a0 con 0x7f562015b700 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56201e7550 con 0x7f562006c460 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5628600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56201e7270 con 0x7f562006a5d0 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 0x7f56201e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 0x7f56201e6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49670/0 (socket says 172.21.15.81:49670) 2024-09-13T18:55:44.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 -- 172.21.15.81:0/3044908089 learned_addr learned my addr 172.21.15.81:0/3044908089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5625c00700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006a5d0 0x7f562014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 -- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006a5d0 msgr2=0x7f562014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006a5d0 0x7f562014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 -- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f562006c460 msgr2=0x7f5620148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5625200700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f562006c460 0x7f5620148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f562006c460 0x7f5620148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 -- 172.21.15.81:0/3044908089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5618009b30 con 0x7f562015b700 2024-09-13T18:55:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5625c00700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006a5d0 0x7f562014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5625200700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f562006c460 0x7f5620148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.172+0000 7f5626600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 0x7f56201e6920 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f561800b730 tx=0x7f5618004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618004250 con 0x7f562015b700 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56180043b0 con 0x7f562015b700 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5618004760 con 0x7f562015b700 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562006ff50 con 0x7f562015b700 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5620148d40 con 0x7f562015b700 2024-09-13T18:55:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562006caa0 con 0x7f562015b700 2024-09-13T18:55:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.176+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f561801c440 con 0x7f562015b700 2024-09-13T18:55:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.180+0000 7f561d600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5600066730 0x7f5600068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.180+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5618085bf0 con 0x7f562015b700 2024-09-13T18:55:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.180+0000 7f5625c00700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5600066730 0x7f5600068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.180+0000 7f5625c00700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5600066730 0x7f5600068bf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5614009840 tx=0x7f5614008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:44.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.184+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5618052d70 con 0x7f562015b700 2024-09-13T18:55:44.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.376+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f562015aeb0 con 0x7f562015b700 2024-09-13T18:55:44.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f561d600700 1 -- 172.21.15.81:0/3044908089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16766 (secure 0 0 0) 0x7f5618020090 con 0x7f562015b700 2024-09-13T18:55:44.388 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:44.388 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:55:01.545466+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:54:44.442235+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-09-13T18:54:45.450767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.11","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:55:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5600066730 msgr2=0x7f5600068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5600066730 0x7f5600068bf0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5614009840 tx=0x7f5614008040 comp rx=0 tx=0).stop 2024-09-13T18:55:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 msgr2=0x7f56201e6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 0x7f56201e6920 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f561800b730 tx=0x7f5618004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 shutdown_connections 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5600066730 0x7f5600068bf0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f562015b700 0x7f56201e6920 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f562006c460 0x7f5620148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 --2- 172.21.15.81:0/3044908089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f562006a5d0 0x7f562014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.380+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 >> 172.21.15.81:0/3044908089 conn(0x7f56200b08d0 msgr2=0x7f56200b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.384+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 shutdown_connections 2024-09-13T18:55:44.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.384+0000 7f5628600700 1 -- 172.21.15.81:0/3044908089 wait complete. 2024-09-13T18:55:44.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:55:44.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 Processor -- start 2024-09-13T18:55:44.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 -- start start 2024-09-13T18:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc31806f880 0x7fc31806fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3180d0a80 0x7fc3180d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc318146a40 con 0x7fc3180cb4e0 2024-09-13T18:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3181629d0 con 0x7fc3180d0a80 2024-09-13T18:55:44.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.568+0000 7fc31f800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc318147670 con 0x7fc31806f880 2024-09-13T18:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3180d0a80 0x7fc3180d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3180d0a80 0x7fc3180d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49686/0 (socket says 172.21.15.81:49686) 2024-09-13T18:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 -- 172.21.15.81:0/3607897468 learned_addr learned my addr 172.21.15.81:0/3607897468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31ce00700 1 --2- 172.21.15.81:0/3607897468 >> v2:172.21.15.178:3300/0 conn(0x7fc31806f880 0x7fc31806fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 -- 172.21.15.81:0/3607897468 >> v2:172.21.15.178:3300/0 conn(0x7fc31806f880 msgr2=0x7fc31806fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:44.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 --2- 172.21.15.81:0/3607897468 >> v2:172.21.15.178:3300/0 conn(0x7fc31806f880 0x7fc31806fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 -- 172.21.15.81:0/3607897468 >> v1:172.21.15.178:6789/0 conn(0x7fc3180cb4e0 legacy=0x7fc3180cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 -- 172.21.15.81:0/3607897468 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180701a0 con 0x7fc3180d0a80 2024-09-13T18:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31d800700 1 --2- 172.21.15.81:0/3607897468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180d0a80 0x7fc3180d0e90 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fc3180b3800 tx=0x7fc31000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b90c9becf4d673 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc317400700 1 -- 172.21.15.81:0/3607897468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000e070 con 0x7fc3180d0a80 2024-09-13T18:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc317400700 1 -- 172.21.15.81:0/3607897468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31000b910 con 0x7fc3180d0a80 2024-09-13T18:55:44.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc317400700 1 -- 172.21.15.81:0/3607897468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31000bcc0 con 0x7fc3180d0a80 2024-09-13T18:55:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 -- 172.21.15.81:0/3607897468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180d0a80 msgr2=0x7fc3180d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 --2- 172.21.15.81:0/3607897468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180d0a80 0x7fc3180d0e90 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fc3180b3800 tx=0x7fc31000b330 comp rx=0 tx=0).stop 2024-09-13T18:55:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 -- 172.21.15.81:0/3607897468 shutdown_connections 2024-09-13T18:55:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 --2- 172.21.15.81:0/3607897468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180d0a80 0x7fc3180d0e90 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 --2- 172.21.15.81:0/3607897468 >> v2:172.21.15.178:3300/0 conn(0x7fc31806f880 0x7fc31806fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 -- 172.21.15.81:0/3607897468 >> 172.21.15.81:0/3607897468 conn(0x7fc3180726d0 msgr2=0x7fc31806e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 -- 172.21.15.81:0/3607897468 shutdown_connections 2024-09-13T18:55:44.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.572+0000 7fc31f800700 1 -- 172.21.15.81:0/3607897468 wait complete. 2024-09-13T18:55:44.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.576+0000 7fc31f800700 1 Processor -- start 2024-09-13T18:55:44.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 -- start start 2024-09-13T18:55:44.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc31806f880 0x7fc318159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 0x7fc31815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3180d0a80 0x7fc3181f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318159f50 con 0x7fc3180cb4e0 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31815ad50 con 0x7fc3180d0a80 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31815a140 con 0x7fc31806f880 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 0x7fc31815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 0x7fc31815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49692/0 (socket says 172.21.15.81:49692) 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 -- 172.21.15.81:0/4127952913 learned_addr learned my addr 172.21.15.81:0/4127952913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31ce00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc31806f880 0x7fc318159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31d800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3180d0a80 0x7fc3181f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 -- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc31806f880 msgr2=0x7fc318159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc31806f880 0x7fc318159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 -- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3180d0a80 msgr2=0x7fc3181f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3180d0a80 0x7fc3181f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 -- 172.21.15.81:0/4127952913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009b30 con 0x7fc3180cb4e0 2024-09-13T18:55:44.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc317e00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 0x7fc31815b1e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fc30400c500 tx=0x7fc30400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040052d0 con 0x7fc3180cb4e0 2024-09-13T18:55:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc304005430 con 0x7fc3180cb4e0 2024-09-13T18:55:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31815a420 con 0x7fc3180cb4e0 2024-09-13T18:55:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.580+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3040055a0 con 0x7fc3180cb4e0 2024-09-13T18:55:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.584+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31815a9e0 con 0x7fc3180cb4e0 2024-09-13T18:55:44.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.584+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3180ce420 con 0x7fc3180cb4e0 2024-09-13T18:55:44.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.584+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3040038e0 con 0x7fc3180cb4e0 2024-09-13T18:55:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.584+0000 7fc314c00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc2f8066730 0x7fc2f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.584+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc304083750 con 0x7fc3180cb4e0 2024-09-13T18:55:44.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.588+0000 7fc31ce00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc2f8066730 0x7fc2f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:44.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.588+0000 7fc31ce00700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc2f8066730 0x7fc2f8068bf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009bf0 tx=0x7fc30c009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:44.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.592+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3040508e0 con 0x7fc3180cb4e0 2024-09-13T18:55:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.812+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc318067730 con 0x7fc3180cb4e0 2024-09-13T18:55:44.823 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-13T18:55:44.816+0000 7fbc34400700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:55:44.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.828+0000 7fc314c00700 1 -- 172.21.15.81:0/4127952913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v116) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc304053f00 con 0x7fc3180cb4e0 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc2f8066730 msgr2=0x7fc2f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc2f8066730 0x7fc2f8068bf0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009bf0 tx=0x7fc30c009240 comp rx=0 tx=0).stop 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 msgr2=0x7fc31815b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 0x7fc31815b1e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fc30400c500 tx=0x7fc30400c810 comp rx=0 tx=0).stop 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 shutdown_connections 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc2f8066730 0x7fc2f8068bf0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3180d0a80 0x7fc3181f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3180cb4e0 0x7fc31815b1e0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 --2- 172.21.15.81:0/4127952913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc31806f880 0x7fc318159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:44.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 >> 172.21.15.81:0/4127952913 conn(0x7fc3180726d0 msgr2=0x7fc3180cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 shutdown_connections 2024-09-13T18:55:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:44.832+0000 7fc31f800700 1 -- 172.21.15.81:0/4127952913 wait complete. 2024-09-13T18:55:44.841 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:55:44.849 INFO:tasks.ceph.mds.d.smithi178.stderr: -1236> 2024-09-13T18:55:17.347+0000 7f4e5dc00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v0 rc2024-09-13T18:54:59.541231+0000 2=0+2) (inest lock) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8602 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x562172feb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.541231+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-13T18:54:59.541231+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-13T18:55:44.849 INFO:tasks.ceph.mds.d.smithi178.stderr: -1219> 2024-09-13T18:55:17.347+0000 7f4e5dc00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/AsLsXsFsx@2},l=8602 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x562172febb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-13T18:55:44.850 INFO:tasks.ceph.mds.c.smithi081.stderr: -1332> 2024-09-13T18:55:17.348+0000 7f338f800700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v2 rc2024-09-13T18:54:59.805225+0000 4=0+4) (inest lock) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8602 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x558c9a0f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.805225+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-13T18:54:59.805225+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-13T18:55:44.851 INFO:tasks.ceph.mds.c.smithi081.stderr: -1216> 2024-09-13T18:55:17.348+0000 7f3397000700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v1 rc2024-09-13T18:54:59.805225+0000 3=0+3) (idft sync r=1) (inest sync r=1 scatter_wanted) (ifile sync r=1) (iversion lock) caps={8602=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=3 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x558c9a0f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.541231+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-13T18:54:59.805225+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-13T18:55:44.851 INFO:tasks.ceph.mds.a.smithi081.stderr: -7381> 2024-09-13T18:55:01.957+0000 7fb8c9400700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:55:44.857 INFO:tasks.ceph.mds.a.smithi081.stderr: -3005> 2024-09-13T18:55:17.344+0000 7fb8c4e00700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-13T18:54:59.537231+0000 1=0+1) n(v3 rc2024-09-13T18:54:59.805225+0000 6=0+6) (inest mix dirty) (ifile excl) (iversion lock) caps={8602=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8602 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x56157ab01600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.537231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.805225+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.537231+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-13T18:54:59.805225+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-13T18:55:44.858 INFO:tasks.ceph.mds.a.smithi081.stderr: -2889> 2024-09-13T18:55:17.348+0000 7fb8cc600700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1) n(v4 rc2024-09-13T18:54:59.805225+0000 5=0+5) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={8602=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x56157ab01b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(15)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-13T18:54:59.805225+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-13T18:54:59.541231+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-13T18:54:59.805225+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-13T18:55:44.859 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:55:44.901 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-09-13T18:55:44.904 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-13T18:55:44.908 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-13T18:55:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.016+0000 7f4a2ee00700 1 Processor -- start 2024-09-13T18:55:45.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.016+0000 7f4a2ee00700 1 -- start start 2024-09-13T18:55:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2ee00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a2806c960 0x7f4a28161e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806cd40 0x7f4a280b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2ee00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a280b1980 0x7f4a28162560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2ee00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a28162340 con 0x7f4a280b1980 2024-09-13T18:55:45.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2ee00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a280b2280 con 0x7f4a2806c960 2024-09-13T18:55:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a280b2560 con 0x7f4a2806cd40 2024-09-13T18:55:45.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a280b1980 0x7f4a28162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4a280b1980 0x7f4a28162560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49744/0 (socket says 172.21.15.81:49744) 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 -- 172.21.15.81:0/2761596504 learned_addr learned my addr 172.21.15.81:0/2761596504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2d000700 1 --2- 172.21.15.81:0/2761596504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806cd40 0x7f4a280b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2da00700 1 --2- 172.21.15.81:0/2761596504 >> v2:172.21.15.178:3300/0 conn(0x7f4a2806c960 0x7f4a28161e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 -- 172.21.15.81:0/2761596504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806cd40 msgr2=0x7f4a280b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 --2- 172.21.15.81:0/2761596504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806cd40 0x7f4a280b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 -- 172.21.15.81:0/2761596504 >> v2:172.21.15.178:3300/0 conn(0x7f4a2806c960 msgr2=0x7f4a28161e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 --2- 172.21.15.81:0/2761596504 >> v2:172.21.15.178:3300/0 conn(0x7f4a2806c960 0x7f4a28161e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 -- 172.21.15.81:0/2761596504 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280b2840 con 0x7f4a280b1980 2024-09-13T18:55:45.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a2e400700 1 --2- 172.21.15.81:0/2761596504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a280b1980 0x7f4a28162560 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f4a280725d0 tx=0x7f4a20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a654437db2e77294 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a27e00700 1 -- 172.21.15.81:0/2761596504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000b8a0 con 0x7f4a280b1980 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a27e00700 1 -- 172.21.15.81:0/2761596504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2000ba00 con 0x7f4a280b1980 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.020+0000 7f4a27e00700 1 -- 172.21.15.81:0/2761596504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000bd90 con 0x7f4a280b1980 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- 172.21.15.81:0/2761596504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a280b1980 msgr2=0x7f4a28162560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/2761596504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a280b1980 0x7f4a28162560 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f4a280725d0 tx=0x7f4a20009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- 172.21.15.81:0/2761596504 shutdown_connections 2024-09-13T18:55:45.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/2761596504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a280b1980 0x7f4a28162560 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/2761596504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806cd40 0x7f4a280b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/2761596504 >> v2:172.21.15.178:3300/0 conn(0x7f4a2806c960 0x7f4a28161e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- 172.21.15.81:0/2761596504 >> 172.21.15.81:0/2761596504 conn(0x7f4a2806a390 msgr2=0x7f4a2806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- 172.21.15.81:0/2761596504 shutdown_connections 2024-09-13T18:55:45.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- 172.21.15.81:0/2761596504 wait complete. 2024-09-13T18:55:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 Processor -- start 2024-09-13T18:55:45.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- start start 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806c960 0x7f4a281e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 0x7f4a28154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a280b1980 0x7f4a281eb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a281e9590 con 0x7f4a2806cd40 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a281e8980 con 0x7f4a280b1980 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.024+0000 7f4a2ee00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a281e8c60 con 0x7f4a2806c960 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 0x7f4a28154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 0x7f4a28154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49756/0 (socket says 172.21.15.81:49756) 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 -- 172.21.15.81:0/3434090190 learned_addr learned my addr 172.21.15.81:0/3434090190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2da00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806c960 0x7f4a281e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2e400700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a280b1980 0x7f4a281eb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 -- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806c960 msgr2=0x7f4a281e9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806c960 0x7f4a281e9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 -- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a280b1980 msgr2=0x7f4a281eb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a280b1980 0x7f4a281eb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 -- 172.21.15.81:0/3434090190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a20009570 con 0x7f4a2806cd40 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2d000700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 0x7f4a28154a10 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d800 tx=0x7f4a1400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a140125f0 con 0x7f4a2806cd40 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a14012750 con 0x7f4a2806cd40 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a281e8f40 con 0x7f4a2806cd40 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14012b00 con 0x7f4a2806cd40 2024-09-13T18:55:45.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a281e9f60 con 0x7f4a2806cd40 2024-09-13T18:55:45.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.028+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28067350 con 0x7f4a2806cd40 2024-09-13T18:55:45.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.032+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a14012c60 con 0x7f4a2806cd40 2024-09-13T18:55:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.032+0000 7f4a25600700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4a08066730 0x7f4a08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.036+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f4a140847b0 con 0x7f4a2806cd40 2024-09-13T18:55:45.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.036+0000 7f4a2da00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4a08066730 0x7f4a08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:45.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.036+0000 7f4a2da00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4a08066730 0x7f4a08068bf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4a2815a960 tx=0x7f4a1c003b00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:45.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.040+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a140518b0 con 0x7f4a2806cd40 2024-09-13T18:55:45.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.260+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a280b1dd0 con 0x7f4a2806cd40 2024-09-13T18:55:45.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.832+0000 7f4a25600700 1 -- 172.21.15.81:0/3434090190 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v117) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a14054ed0 con 0x7f4a2806cd40 2024-09-13T18:55:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4a08066730 msgr2=0x7f4a08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4a08066730 0x7f4a08068bf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4a2815a960 tx=0x7f4a1c003b00 comp rx=0 tx=0).stop 2024-09-13T18:55:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 msgr2=0x7f4a28154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:45.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 0x7f4a28154a10 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400d800 tx=0x7f4a1400dbc0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 shutdown_connections 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4a08066730 0x7f4a08068bf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a280b1980 0x7f4a281eb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a2806cd40 0x7f4a28154a10 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 --2- 172.21.15.81:0/3434090190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a2806c960 0x7f4a281e9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.836+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 >> 172.21.15.81:0/3434090190 conn(0x7f4a2806a390 msgr2=0x7f4a28070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.840+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 shutdown_connections 2024-09-13T18:55:45.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:45.840+0000 7f4a2ee00700 1 -- 172.21.15.81:0/3434090190 wait complete. 2024-09-13T18:55:45.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:55:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.092+0000 7f2902a00700 1 Processor -- start 2024-09-13T18:55:46.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.092+0000 7f2902a00700 1 -- start start 2024-09-13T18:55:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28fc15a9d0 0x7f28fc0afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 0x7f28fc0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc15adb0 con 0x7f28fc0ce1d0 2024-09-13T18:55:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0cd280 con 0x7f28fc15a9d0 2024-09-13T18:55:46.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0ce850 con 0x7f28fc0b0000 2024-09-13T18:55:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28fc0ce1d0 0x7f28fc0b4400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:35402/0 (socket says 172.21.15.81:35402) 2024-09-13T18:55:46.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2902000700 1 -- 172.21.15.81:0/3892022704 learned_addr learned my addr 172.21.15.81:0/3892022704 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2901600700 1 --2- 172.21.15.81:0/3892022704 >> v2:172.21.15.81:3300/0 conn(0x7f28fc15a9d0 0x7f28fc0afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2900c00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 0x7f28fc0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901331137 0 0) 0x7f28fc15adb0 con 0x7f28fc0ce1d0 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e40035d0 con 0x7f28fc0ce1d0 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901731270 0 0) 0x7f28e40035d0 con 0x7f28fc0ce1d0 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 msgr2=0x7f28fc0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:46.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 0x7f28fc0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 >> v2:172.21.15.81:3300/0 conn(0x7f28fc15a9d0 msgr2=0x7f28fc0afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 --2- 172.21.15.81:0/3892022704 >> v2:172.21.15.81:3300/0 conn(0x7f28fc15a9d0 0x7f28fc0afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0ceb30 con 0x7f28fc0ce1d0 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f28f40019f0 con 0x7f28fc0ce1d0 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 >> v1:172.21.15.81:6789/0 conn(0x7f28fc0ce1d0 legacy=0x7f28fc0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e4003a90 0x7f28e4003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28e4004870 0x7f28e4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 0x7f28e4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0cd280 con 0x7f28e4003a90 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0ce850 con 0x7f28e4004870 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e400ba30 con 0x7f28fc0b0000 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2901600700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e4003a90 0x7f28e4003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2900c00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28e4004870 0x7f28e4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2901600700 1 -- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 msgr2=0x7f28e4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2901600700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28fc0b0000 0x7f28e4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2901600700 1 -- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28e4004870 msgr2=0x7f28e4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.096+0000 7f2901600700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28e4004870 0x7f28e4004cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2901600700 1 -- 172.21.15.81:0/3892022704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40035d0 con 0x7f28e4003a90 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2901600700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e4003a90 0x7f28e4003eb0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009ba0 tx=0x7f28e40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54023d056e124f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000e6c0 con 0x7f28e4003a90 2024-09-13T18:55:46.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000e820 con 0x7f28e4003a90 2024-09-13T18:55:46.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f28fbe00700 1 -- 172.21.15.81:0/3892022704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000eb90 con 0x7f28e4003a90 2024-09-13T18:55:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902a00700 1 -- 172.21.15.81:0/3892022704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e4003a90 msgr2=0x7f28e4003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902a00700 1 --2- 172.21.15.81:0/3892022704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e4003a90 0x7f28e4003eb0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009ba0 tx=0x7f28e40058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902000700 1 -- 172.21.15.81:0/3892022704 reap_dead start 2024-09-13T18:55:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902a00700 1 -- 172.21.15.81:0/3892022704 shutdown_connections 2024-09-13T18:55:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902a00700 1 -- 172.21.15.81:0/3892022704 >> 172.21.15.81:0/3892022704 conn(0x7f28fc066270 msgr2=0x7f28fc071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902a00700 1 -- 172.21.15.81:0/3892022704 shutdown_connections 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.100+0000 7f2902a00700 1 -- 172.21.15.81:0/3892022704 wait complete. 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 Processor -- start 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 -- start start 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28e4003a90 0x7f28fc0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 0x7f28fc150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc142f10 0x7f28fc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0b2dd0 con 0x7f28fc142ab0 2024-09-13T18:55:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0b1810 con 0x7f28fc142f10 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0b1af0 con 0x7f28e4003a90 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 0x7f28fc150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 0x7f28fc150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49790/0 (socket says 172.21.15.81:49790) 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 -- 172.21.15.81:0/4202769775 learned_addr learned my addr 172.21.15.81:0/4202769775 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2902000700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc142f10 0x7f28fc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2901600700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28e4003a90 0x7f28fc0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 -- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28e4003a90 msgr2=0x7f28fc0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28e4003a90 0x7f28fc0b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 -- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc142f10 msgr2=0x7f28fc1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc142f10 0x7f28fc1511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2900c00700 1 -- 172.21.15.81:0/4202769775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0b1dd0 con 0x7f28fc142ab0 2024-09-13T18:55:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.104+0000 7f2901600700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28e4003a90 0x7f28fc0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:46.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f2900c00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 0x7f28fc150cb0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f28e8010860 tx=0x7f28e8010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8014800 con 0x7f28fc142ab0 2024-09-13T18:55:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8014980 con 0x7f28fc142ab0 2024-09-13T18:55:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8014d30 con 0x7f28fc142ab0 2024-09-13T18:55:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc0b20b0 con 0x7f28fc142ab0 2024-09-13T18:55:46.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc0b14c0 con 0x7f28fc142ab0 2024-09-13T18:55:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.108+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc0afac0 con 0x7f28fc142ab0 2024-09-13T18:55:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.112+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f28e800e410 con 0x7f28fc142ab0 2024-09-13T18:55:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.112+0000 7f28f9600700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f28dc066760 0x7f28dc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.112+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f28e80844c0 con 0x7f28fc142ab0 2024-09-13T18:55:46.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.112+0000 7f2901600700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f28dc066760 0x7f28dc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.112+0000 7f2901600700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f28dc066760 0x7f28dc068c20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f28f00090b0 tx=0x7f28f0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.120+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f28e80514b0 con 0x7f28fc142ab0 2024-09-13T18:55:46.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:46.296+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28fc0ae730 con 0x7f28fc142ab0 2024-09-13T18:55:47.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.268+0000 7f28f9600700 1 -- 172.21.15.81:0/4202769775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v111) v1 ==== 181+0+0 (secure 0 0 0) 0x7f28e8054ad0 con 0x7f28fc142ab0 2024-09-13T18:55:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f28dc066760 msgr2=0x7f28dc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f28dc066760 0x7f28dc068c20 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f28f00090b0 tx=0x7f28f0008030 comp rx=0 tx=0).stop 2024-09-13T18:55:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 msgr2=0x7f28fc150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 0x7f28fc150cb0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f28e8010860 tx=0x7f28e8010b70 comp rx=0 tx=0).stop 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 shutdown_connections 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f28dc066760 0x7f28dc068c20 secure :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f28f00090b0 tx=0x7f28f0008030 comp rx=0 tx=0).stop 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28fc142f10 0x7f28fc1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc142ab0 0x7f28fc150cb0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 --2- 172.21.15.81:0/4202769775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28e4003a90 0x7f28fc0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 >> 172.21.15.81:0/4202769775 conn(0x7f28fc066270 msgr2=0x7f28fc0aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 shutdown_connections 2024-09-13T18:55:47.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.276+0000 7f2902a00700 1 -- 172.21.15.81:0/4202769775 wait complete. 2024-09-13T18:55:47.287 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:55:47.306 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:55:47.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.468+0000 7fc8dbe00700 1 Processor -- start 2024-09-13T18:55:47.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.468+0000 7fc8dbe00700 1 -- start start 2024-09-13T18:55:47.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8dbe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc8dc06de80 0x7fc8dc167e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:47.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8dbe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0b2520 con 0x7fc8dc0ae020 2024-09-13T18:55:47.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8dbe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0b2240 con 0x7fc8dc06c460 2024-09-13T18:55:47.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8dbe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8dc0b2030 con 0x7fc8dc06de80 2024-09-13T18:55:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8db400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc8dc06de80 0x7fc8dc167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8da000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc8dc0ae020 0x7fc8dc164760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47310/0 (socket says 172.21.15.81:47310) 2024-09-13T18:55:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8da000700 1 -- 172.21.15.81:0/4127538683 learned_addr learned my addr 172.21.15.81:0/4127538683 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:47.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8d9600700 1 -- 172.21.15.81:0/4127538683 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430546684 0 0) 0x7fc8dc0b2240 con 0x7fc8dc06c460 2024-09-13T18:55:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8d9600700 1 -- 172.21.15.81:0/4127538683 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c00035d0 con 0x7fc8dc06c460 2024-09-13T18:55:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8db400700 1 -- 172.21.15.81:0/4127538683 >> v1:172.21.15.178:6789/0 conn(0x7fc8dc06c460 legacy=0x7fc8dc06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8db400700 1 -- 172.21.15.81:0/4127538683 >> v1:172.21.15.81:6789/0 conn(0x7fc8dc0ae020 legacy=0x7fc8dc164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8db400700 1 -- 172.21.15.81:0/4127538683 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0b3bf0 con 0x7fc8dc06de80 2024-09-13T18:55:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8db400700 1 --2- 172.21.15.81:0/4127538683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06de80 0x7fc8dc167e90 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009dc0 tx=0x7fc8d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b11d4fbb3264b54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:47.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8d9600700 1 -- 172.21.15.81:0/4127538683 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400e070 con 0x7fc8dc06de80 2024-09-13T18:55:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8d9600700 1 -- 172.21.15.81:0/4127538683 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d400bae0 con 0x7fc8dc06de80 2024-09-13T18:55:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.472+0000 7fc8d9600700 1 -- 172.21.15.81:0/4127538683 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400be50 con 0x7fc8dc06de80 2024-09-13T18:55:47.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 -- 172.21.15.81:0/4127538683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06de80 msgr2=0x7fc8dc167e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/4127538683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06de80 0x7fc8dc167e90 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4009dc0 tx=0x7fc8d400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 -- 172.21.15.81:0/4127538683 shutdown_connections 2024-09-13T18:55:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/4127538683 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06de80 0x7fc8dc167e90 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 -- 172.21.15.81:0/4127538683 >> 172.21.15.81:0/4127538683 conn(0x7fc8dc071880 msgr2=0x7fc8dc071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 -- 172.21.15.81:0/4127538683 shutdown_connections 2024-09-13T18:55:47.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 -- 172.21.15.81:0/4127538683 wait complete. 2024-09-13T18:55:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.476+0000 7fc8dbe00700 1 Processor -- start 2024-09-13T18:55:47.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 -- start start 2024-09-13T18:55:47.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 0x7fc8dc09c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc06de80 0x7fc8dc145090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0ae020 0x7fc8dc1455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc09c010 con 0x7fc8dc06c460 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc144de0 con 0x7fc8dc06de80 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc09b400 con 0x7fc8dc0ae020 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 0x7fc8dc09c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 0x7fc8dc09c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33374/0 (socket says 172.21.15.81:33374) 2024-09-13T18:55:47.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 -- 172.21.15.81:0/679142043 learned_addr learned my addr 172.21.15.81:0/679142043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8db400700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0ae020 0x7fc8dc1455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:47.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8da000700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc06de80 0x7fc8dc145090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 -- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0ae020 msgr2=0x7fc8dc1455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0ae020 0x7fc8dc1455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 -- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc06de80 msgr2=0x7fc8dc145090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc06de80 0x7fc8dc145090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 -- 172.21.15.81:0/679142043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4009a70 con 0x7fc8dc06c460 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8daa00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 0x7fc8dc09c430 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c4c0 tx=0x7fc8cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0052d0 con 0x7fc8dc06c460 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc005430 con 0x7fc8dc06c460 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc09b670 con 0x7fc8dc06c460 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.480+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0055a0 con 0x7fc8dc06c460 2024-09-13T18:55:47.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.484+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc09bc30 con 0x7fc8dc06c460 2024-09-13T18:55:47.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.484+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc09c150 con 0x7fc8dc06c460 2024-09-13T18:55:47.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.484+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8cc0038e0 con 0x7fc8dc06c460 2024-09-13T18:55:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.488+0000 7fc8d2a00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc8bc066730 0x7fc8bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.488+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5878+0+0 (secure 0 0 0) 0x7fc8cc0837f0 con 0x7fc8dc06c460 2024-09-13T18:55:47.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.488+0000 7fc8da000700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc8bc066730 0x7fc8bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:47.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.488+0000 7fc8da000700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc8bc066730 0x7fc8bc068bf0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc157c00 tx=0x7fc8c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:47.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.492+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8cc050ab0 con 0x7fc8dc06c460 2024-09-13T18:55:47.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:47.672+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8dc0723a0 con 0x7fc8dc06c460 2024-09-13T18:55:48.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.272+0000 7fc8d2a00700 1 -- 172.21.15.81:0/679142043 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v112) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc8cc0170d0 con 0x7fc8dc06c460 2024-09-13T18:55:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.284+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc8bc066730 msgr2=0x7fc8bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.284+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc8bc066730 0x7fc8bc068bf0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc157c00 tx=0x7fc8c8009040 comp rx=0 tx=0).stop 2024-09-13T18:55:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.284+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 msgr2=0x7fc8dc09c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.284+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 0x7fc8dc09c430 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00c4c0 tx=0x7fc8cc00c880 comp rx=0 tx=0).stop 2024-09-13T18:55:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 shutdown_connections 2024-09-13T18:55:48.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc8bc066730 0x7fc8bc068bf0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc0ae020 0x7fc8dc1455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc06de80 0x7fc8dc145090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 --2- 172.21.15.81:0/679142043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8dc06c460 0x7fc8dc09c430 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 >> 172.21.15.81:0/679142043 conn(0x7fc8dc071880 msgr2=0x7fc8dc0ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 shutdown_connections 2024-09-13T18:55:48.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.288+0000 7fc8dbe00700 1 -- 172.21.15.81:0/679142043 wait complete. 2024-09-13T18:55:48.299 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-13T18:55:48.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:55:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 Processor -- start 2024-09-13T18:55:48.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 -- start start 2024-09-13T18:55:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3b415ca20 0x7fc3b415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406ada0 0x7fc3b406b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b4160680 con 0x7fc3b406cd80 2024-09-13T18:55:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b40b4a20 con 0x7fc3b415ca20 2024-09-13T18:55:48.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.476+0000 7fc3b3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b406b750 con 0x7fc3b406ada0 2024-09-13T18:55:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc3b415ca20 0x7fc3b415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3b406cd80 0x7fc3b40b4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47326/0 (socket says 172.21.15.81:47326) 2024-09-13T18:55:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2000700 1 -- 172.21.15.81:0/1918018400 learned_addr learned my addr 172.21.15.81:0/1918018400 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:48.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3400700 1 --2- 172.21.15.81:0/1918018400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406ada0 0x7fc3b406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2a00700 1 -- 172.21.15.81:0/1918018400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406ada0 msgr2=0x7fc3b406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:48.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2a00700 1 --2- 172.21.15.81:0/1918018400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406ada0 0x7fc3b406b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2a00700 1 -- 172.21.15.81:0/1918018400 >> v1:172.21.15.81:6789/0 conn(0x7fc3b406cd80 legacy=0x7fc3b40b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b1600700 1 -- 172.21.15.81:0/1918018400 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329860348 0 0) 0x7fc3b4160680 con 0x7fc3b406cd80 2024-09-13T18:55:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2a00700 1 -- 172.21.15.81:0/1918018400 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b415d670 con 0x7fc3b415ca20 2024-09-13T18:55:48.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b2a00700 1 --2- 172.21.15.81:0/1918018400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b415ca20 0x7fc3b415ce00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009850 tx=0x7fc3a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec07178e5b1e7eef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:48.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b1600700 1 -- 172.21.15.81:0/1918018400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4011830 con 0x7fc3b415ca20 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b1600700 1 -- 172.21.15.81:0/1918018400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a4011990 con 0x7fc3b415ca20 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b1600700 1 -- 172.21.15.81:0/1918018400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4011d40 con 0x7fc3b415ca20 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 -- 172.21.15.81:0/1918018400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b415ca20 msgr2=0x7fc3b415ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/1918018400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b415ca20 0x7fc3b415ce00 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009850 tx=0x7fc3a4009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 -- 172.21.15.81:0/1918018400 shutdown_connections 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/1918018400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406ada0 0x7fc3b406b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/1918018400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b415ca20 0x7fc3b415ce00 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 -- 172.21.15.81:0/1918018400 >> 172.21.15.81:0/1918018400 conn(0x7fc3b4071d20 msgr2=0x7fc3b4072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:48.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 -- 172.21.15.81:0/1918018400 shutdown_connections 2024-09-13T18:55:48.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.480+0000 7fc3b3e00700 1 -- 172.21.15.81:0/1918018400 wait complete. 2024-09-13T18:55:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.484+0000 7fc3b3e00700 1 Processor -- start 2024-09-13T18:55:48.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.484+0000 7fc3b3e00700 1 -- start start 2024-09-13T18:55:48.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b3e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 0x7fc3b4157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b3e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406cd80 0x7fc3b40d0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b3e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3b40d0e50 0x7fc3b41432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b3e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40cd160 con 0x7fc3b406ada0 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b3e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b40d1300 con 0x7fc3b40d0e50 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b3e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b4144040 con 0x7fc3b406cd80 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 0x7fc3b4157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 0x7fc3b4157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33390/0 (socket says 172.21.15.81:33390) 2024-09-13T18:55:48.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 -- 172.21.15.81:0/3429083584 learned_addr learned my addr 172.21.15.81:0/3429083584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2000700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406cd80 0x7fc3b40d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 -- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406cd80 msgr2=0x7fc3b40d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406cd80 0x7fc3b40d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 -- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3b40d0e50 msgr2=0x7fc3b41432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3b40d0e50 0x7fc3b41432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 -- 172.21.15.81:0/3429083584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a40094b0 con 0x7fc3b406ada0 2024-09-13T18:55:48.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3b2a00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 0x7fc3b4157fd0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000c00 tx=0x7fc3a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a401aa00 con 0x7fc3b406ada0 2024-09-13T18:55:48.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.488+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a401f070 con 0x7fc3b406ada0 2024-09-13T18:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.492+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b4141160 con 0x7fc3b406ada0 2024-09-13T18:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.492+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a401ada0 con 0x7fc3b406ada0 2024-09-13T18:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.492+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b4141720 con 0x7fc3b406ada0 2024-09-13T18:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.492+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b406d1c0 con 0x7fc3b406ada0 2024-09-13T18:55:48.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.492+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3a402e450 con 0x7fc3b406ada0 2024-09-13T18:55:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.496+0000 7fc3aaa00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc394066760 0x7fc394068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.496+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fc3a4084f80 con 0x7fc3b406ada0 2024-09-13T18:55:48.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.496+0000 7fc3b2000700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc394066760 0x7fc394068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.496+0000 7fc3b2000700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc394066760 0x7fc394068c20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4072580 tx=0x7fc3a0007cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:48.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.500+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3a4052490 con 0x7fc3b406ada0 2024-09-13T18:55:48.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.684+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc3b406ab80 con 0x7fc3b406ada0 2024-09-13T18:55:48.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.692+0000 7fc3aaa00700 1 -- 172.21.15.81:0/3429083584 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc3a40210a0 con 0x7fc3b406ada0 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc394066760 msgr2=0x7fc394068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc394066760 0x7fc394068c20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4072580 tx=0x7fc3a0007cb0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 msgr2=0x7fc3b4157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 0x7fc3b4157fd0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4000c00 tx=0x7fc3a4004770 comp rx=0 tx=0).stop 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 shutdown_connections 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fc394066760 0x7fc394068c20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3b40d0e50 0x7fc3b41432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3b406cd80 0x7fc3b40d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 --2- 172.21.15.81:0/3429083584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3b406ada0 0x7fc3b4157fd0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 >> 172.21.15.81:0/3429083584 conn(0x7fc3b4071d20 msgr2=0x7fc3b415b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 shutdown_connections 2024-09-13T18:55:48.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.696+0000 7fc3b3e00700 1 -- 172.21.15.81:0/3429083584 wait complete. 2024-09-13T18:55:48.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2024-09-13T18:55:48.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.888+0000 7ff75ca00700 1 Processor -- start 2024-09-13T18:55:48.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.888+0000 7ff75ca00700 1 -- start start 2024-09-13T18:55:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff75ca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff7580cc6f0 0x7ff75815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff75ca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff75806aaa0 0x7ff75806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff75ca00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7580ccb40 con 0x7ff7580cb020 2024-09-13T18:55:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff75ca00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff75806b430 con 0x7ff7580cc6f0 2024-09-13T18:55:48.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff75ca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580b2ad0 con 0x7ff75806aaa0 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff756800700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff7580cb020 0x7ff75815c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47342/0 (socket says 172.21.15.81:47342) 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff756800700 1 -- 172.21.15.81:0/1901438994 learned_addr learned my addr 172.21.15.81:0/1901438994 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff757200700 1 --2- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff75806aaa0 0x7ff75806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755e00700 1 --2- 172.21.15.81:0/1901438994 >> v2:172.21.15.178:3300/0 conn(0x7ff7580cc6f0 0x7ff75815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755400700 1 -- 172.21.15.81:0/1901438994 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851403597 0 0) 0x7ff7580ccb40 con 0x7ff7580cb020 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755400700 1 -- 172.21.15.81:0/1901438994 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff73c0035d0 con 0x7ff7580cb020 2024-09-13T18:55:48.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755e00700 1 -- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff75806aaa0 msgr2=0x7ff75806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755e00700 1 --2- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff75806aaa0 0x7ff75806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755e00700 1 -- 172.21.15.81:0/1901438994 >> v1:172.21.15.81:6789/0 conn(0x7ff7580cb020 legacy=0x7ff75815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755e00700 1 -- 172.21.15.81:0/1901438994 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75815b960 con 0x7ff7580cc6f0 2024-09-13T18:55:48.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.892+0000 7ff755e00700 1 --2- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7580cc6f0 0x7ff75815b0e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff740009850 tx=0x7ff740009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bae8fb81401b55a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff755400700 1 -- 172.21.15.81:0/1901438994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740011830 con 0x7ff7580cc6f0 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff755400700 1 -- 172.21.15.81:0/1901438994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff740011990 con 0x7ff7580cc6f0 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff755400700 1 -- 172.21.15.81:0/1901438994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740011d40 con 0x7ff7580cc6f0 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 -- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7580cc6f0 msgr2=0x7ff75815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 --2- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7580cc6f0 0x7ff75815b0e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff740009850 tx=0x7ff740009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 -- 172.21.15.81:0/1901438994 shutdown_connections 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 --2- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff75806aaa0 0x7ff75806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 --2- 172.21.15.81:0/1901438994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7580cc6f0 0x7ff75815b0e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 -- 172.21.15.81:0/1901438994 >> 172.21.15.81:0/1901438994 conn(0x7ff7580b0c40 msgr2=0x7ff75806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 -- 172.21.15.81:0/1901438994 shutdown_connections 2024-09-13T18:55:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.896+0000 7ff75ca00700 1 -- 172.21.15.81:0/1901438994 wait complete. 2024-09-13T18:55:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 Processor -- start 2024-09-13T18:55:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 -- start start 2024-09-13T18:55:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75806aaa0 0x7ff7581f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7580cb020 0x7ff75814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 0x7ff75806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75814dae0 con 0x7ff7580cc6f0 2024-09-13T18:55:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7580c9390 con 0x7ff75806aaa0 2024-09-13T18:55:48.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff75ca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff758070590 con 0x7ff7580cb020 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 0x7ff75806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff756800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75806aaa0 0x7ff7581f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 0x7ff75806bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33400/0 (socket says 172.21.15.81:33400) 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 -- 172.21.15.81:0/4166042106 learned_addr learned my addr 172.21.15.81:0/4166042106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff755e00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7580cb020 0x7ff75814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 -- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7580cb020 msgr2=0x7ff75814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7580cb020 0x7ff75814d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 -- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75806aaa0 msgr2=0x7ff7581f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75806aaa0 0x7ff7581f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 -- 172.21.15.81:0/4166042106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7400094b0 con 0x7ff7580cc6f0 2024-09-13T18:55:48.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff755e00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7580cb020 0x7ff75814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.900+0000 7ff757200700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 0x7ff75806bbe0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7ff75000efc0 tx=0x7ff75000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750009ea0 con 0x7ff7580cc6f0 2024-09-13T18:55:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75000f040 con 0x7ff7580cc6f0 2024-09-13T18:55:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff750014480 con 0x7ff7580cc6f0 2024-09-13T18:55:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff758070870 con 0x7ff7580cc6f0 2024-09-13T18:55:48.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7580c9670 con 0x7ff7580cc6f0 2024-09-13T18:55:48.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75806a8c0 con 0x7ff7580cc6f0 2024-09-13T18:55:48.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.904+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff7500145e0 con 0x7ff7580cc6f0 2024-09-13T18:55:48.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.908+0000 7ff74ea00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff734066760 0x7ff734068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.908+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7ff7500849d0 con 0x7ff7580cc6f0 2024-09-13T18:55:48.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.908+0000 7ff756800700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff734066760 0x7ff734068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:48.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.908+0000 7ff756800700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff734066760 0x7ff734068c20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff748007fd0 tx=0x7ff748007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:48.912+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff750051d30 con 0x7ff7580cc6f0 2024-09-13T18:55:49.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.164+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) v1 -- 0x7ff7580cb400 con 0x7ff7580cc6f0 2024-09-13T18:55:49.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.280+0000 7ff74ea00700 1 -- 172.21.15.81:0/4166042106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v449) v1 ==== 165+0+0 (secure 0 0 0) 0x7ff7500180e0 con 0x7ff7580cc6f0 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff734066760 msgr2=0x7ff734068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff734066760 0x7ff734068c20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7ff748007fd0 tx=0x7ff748007de0 comp rx=0 tx=0).stop 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 msgr2=0x7ff75806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 0x7ff75806bbe0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7ff75000efc0 tx=0x7ff75000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 shutdown_connections 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff734066760 0x7ff734068c20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:49.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7580cc6f0 0x7ff75806bbe0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7580cb020 0x7ff75814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 --2- 172.21.15.81:0/4166042106 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75806aaa0 0x7ff7581f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 >> 172.21.15.81:0/4166042106 conn(0x7ff7580b0c40 msgr2=0x7ff75806d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 shutdown_connections 2024-09-13T18:55:49.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:49.284+0000 7ff75ca00700 1 -- 172.21.15.81:0/4166042106 wait complete. 2024-09-13T18:55:49.315 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-13T18:55:49.316 INFO:tasks.cephfs_test_runner: 2024-09-13T18:55:49.316 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T18:55:49.316 INFO:tasks.cephfs_test_runner:Ran 6 tests in 459.731s 2024-09-13T18:55:49.316 INFO:tasks.cephfs_test_runner: 2024-09-13T18:55:49.316 INFO:tasks.cephfs_test_runner:OK 2024-09-13T18:55:49.316 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T18:55:49.328 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T18:55:49.345 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T18:55:49.345 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:55:49.345 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:49.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:55:49.365 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-13T18:55:49.365 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:49.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346832k,nr_inodes=4086708,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2656 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:55:49.422 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:55:49.422 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:49.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:55:49.441 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-13T18:55:49.441 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:55:49.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16346756k,nr_inodes=4086689,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1710 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274964k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274968k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:55:49.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:49.503 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:55:49.522 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:55:49.522 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:55:49.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:49.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:55:49.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:49.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:55:50.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:50.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-13T18:55:50.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:50.239 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-13T18:55:50.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:50.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-13T18:55:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-13T18:55:50.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:55:50.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:50.679 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-09-13T18:55:50.695 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:55:50.695 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:55:50.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:50.696 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:55:50.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:50.774 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:55:51.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:51.251 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-09-13T18:55:51.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:51.390 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-09-13T18:55:51.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:55:51.406 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-09-13T18:55:51.824 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-09-13T18:55:51.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:55:51.827 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:55:51.836 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:55:51.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:55:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.004+0000 7f886f200700 1 Processor -- start 2024-09-13T18:55:52.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.004+0000 7f886f200700 1 -- start start 2024-09-13T18:55:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886f200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f887006b1b0 0x7f88701646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886f200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700707d0 con 0x7f8870159bd0 2024-09-13T18:55:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886f200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887006fee0 con 0x7f88700cb700 2024-09-13T18:55:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886f200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88700720a0 con 0x7f887006b1b0 2024-09-13T18:55:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886de00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8870159bd0 0x7f8870071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47356/0 (socket says 172.21.15.81:47356) 2024-09-13T18:55:52.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886de00700 1 -- 172.21.15.81:0/1156510253 learned_addr learned my addr 172.21.15.81:0/1156510253 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886e800700 1 --2- 172.21.15.81:0/1156510253 >> v2:172.21.15.81:3300/0 conn(0x7f887006b1b0 0x7f88701646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886ca00700 1 -- 172.21.15.81:0/1156510253 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339726588 0 0) 0x7f88700707d0 con 0x7f8870159bd0 2024-09-13T18:55:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886ca00700 1 -- 172.21.15.81:0/1156510253 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88540035d0 con 0x7f8870159bd0 2024-09-13T18:55:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886e800700 1 -- 172.21.15.81:0/1156510253 >> v1:172.21.15.178:6789/0 conn(0x7f88700cb700 legacy=0x7f887006aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886e800700 1 -- 172.21.15.81:0/1156510253 >> v1:172.21.15.81:6789/0 conn(0x7f8870159bd0 legacy=0x7f8870071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886e800700 1 -- 172.21.15.81:0/1156510253 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700b2ef0 con 0x7f887006b1b0 2024-09-13T18:55:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886e800700 1 --2- 172.21.15.81:0/1156510253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88701646c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f8868009dc0 tx=0x7f886800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90c9969d029162e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.008+0000 7f886ca00700 1 -- 172.21.15.81:0/1156510253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800e070 con 0x7f887006b1b0 2024-09-13T18:55:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886ca00700 1 -- 172.21.15.81:0/1156510253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800bae0 con 0x7f887006b1b0 2024-09-13T18:55:52.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886ca00700 1 -- 172.21.15.81:0/1156510253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800be90 con 0x7f887006b1b0 2024-09-13T18:55:52.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 -- 172.21.15.81:0/1156510253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 msgr2=0x7f88701646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 --2- 172.21.15.81:0/1156510253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88701646c0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f8868009dc0 tx=0x7f886800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 -- 172.21.15.81:0/1156510253 shutdown_connections 2024-09-13T18:55:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 --2- 172.21.15.81:0/1156510253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88701646c0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 -- 172.21.15.81:0/1156510253 >> 172.21.15.81:0/1156510253 conn(0x7f88700b0c40 msgr2=0x7f887006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 -- 172.21.15.81:0/1156510253 shutdown_connections 2024-09-13T18:55:52.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.012+0000 7f886f200700 1 -- 172.21.15.81:0/1156510253 wait complete. 2024-09-13T18:55:52.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 Processor -- start 2024-09-13T18:55:52.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 -- start start 2024-09-13T18:55:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88700c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700cb700 0x7f887014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8870159bd0 0x7f887014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887015b460 con 0x7f887006b1b0 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700c3880 con 0x7f8870159bd0 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886f200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700c3b60 con 0x7f88700cb700 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88700c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886de00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88700c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33406/0 (socket says 172.21.15.81:33406) 2024-09-13T18:55:52.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886de00700 1 -- 172.21.15.81:0/2160034755 learned_addr learned my addr 172.21.15.81:0/2160034755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886e800700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8870159bd0 0x7f887014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886d400700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700cb700 0x7f887014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.016+0000 7f886de00700 1 -- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700cb700 msgr2=0x7f887014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886de00700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700cb700 0x7f887014de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886de00700 1 -- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8870159bd0 msgr2=0x7f887014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886de00700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8870159bd0 0x7f887014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886de00700 1 -- 172.21.15.81:0/2160034755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009a70 con 0x7f887006b1b0 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886d400700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700cb700 0x7f887014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886de00700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88700c7610 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f886000c500 tx=0x7f886000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860005d90 con 0x7f887006b1b0 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88600070d0 con 0x7f887006b1b0 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887015b6b0 con 0x7f887006b1b0 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860007480 con 0x7f887006b1b0 2024-09-13T18:55:52.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887014c380 con 0x7f887006b1b0 2024-09-13T18:55:52.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.020+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887006aaa0 con 0x7f887006b1b0 2024-09-13T18:55:52.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.024+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88600075e0 con 0x7f887006b1b0 2024-09-13T18:55:52.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.024+0000 7f8866000700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8850066730 0x7f8850068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.024+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8860083580 con 0x7f887006b1b0 2024-09-13T18:55:52.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.024+0000 7f886d400700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8850066730 0x7f8850068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.028+0000 7f886d400700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8850066730 0x7f8850068bf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f88701f5f10 tx=0x7f885c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.036+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88600509f0 con 0x7f887006b1b0 2024-09-13T18:55:52.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.220+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8870070c60 con 0x7f8850066730 2024-09-13T18:55:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.224+0000 7f8866000700 1 -- 172.21.15.81:0/2160034755 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48361 (secure 0 0 0) 0x7f885c0123d0 con 0x7f8850066730 2024-09-13T18:55:52.234 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8850066730 msgr2=0x7f8850068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8850066730 0x7f8850068bf0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f88701f5f10 tx=0x7f885c009040 comp rx=0 tx=0).stop 2024-09-13T18:55:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 msgr2=0x7f88700c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88700c7610 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f886000c500 tx=0x7f886000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 shutdown_connections 2024-09-13T18:55:52.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8850066730 0x7f8850068bf0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8870159bd0 0x7f887014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88700cb700 0x7f887014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 --2- 172.21.15.81:0/2160034755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887006b1b0 0x7f88700c7610 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 >> 172.21.15.81:0/2160034755 conn(0x7f88700b0c40 msgr2=0x7f88700cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 shutdown_connections 2024-09-13T18:55:52.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.228+0000 7f886f200700 1 -- 172.21.15.81:0/2160034755 wait complete. 2024-09-13T18:55:52.239 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:55:52.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-13T18:55:51.146111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260896,"kb_used_data":11960,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713824,"statfs":{"total":773094113280,"available":772826955776,"internally_reserved":0,"allocated":12247040,"data_stored":6305662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-119363,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-253,"num_write_kb":-202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.325156"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-13T18:55:45.805229+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:55:45.805229+0000","last_peered":"2024-09-13T18:55:45.805229+0000","last_clean":"2024-09-13T18:55:45.805229+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:55:45.805229+0000","last_undegraded":"2024-09-13T18:55:45.805229+0000","last_fullsized":"2024-09-13T18:55:45.805229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1974272,"data_stored":1231500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.121,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.591,"5min":1.746,"15min":1.746},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.0920000000000001,"15min":1.115},"min":{"1min":0.83899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.423,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1479999999999999,"15min":1.139},"min":{"1min":0.82999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.571,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.347},{"interface":"front","average":{"1min":1.173,"5min":1.1499999999999999,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"max":{"1min":1.548,"5min":1.885,"15min":1.885},"last":1.585},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.222,"15min":1.214},"min":{"1min":0.79900000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.7070000000000001},"last":1.538}]},{"osd":3,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3320000000000001,"15min":1.403},"min":{"1min":0.93400000000000005,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.45,"5min":1.861,"15min":2.2610000000000001},"last":1.6699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4990000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1899999999999999,"15min":1.1830000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5069999999999999,"5min":1.823,"15min":1.823},"last":1.226}]},{"osd":5,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2450000000000001,"15min":1.2949999999999999},"min":{"1min":1.016,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.474,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.5509999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":1.1040000000000001,"5min":0.86199999999999999,"15min":0.85599999999999998},"max":{"1min":1.6379999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.47},{"interface":"front","average":{"1min":1.274,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4750000000000001,"5min":1.845,"15min":1.845},"last":1.4419999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.111,"15min":1.131},"min":{"1min":0.626,"5min":0.626,"15min":0.371},"max":{"1min":1.448,"5min":1.619,"15min":3.0369999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.103,"15min":1.1479999999999999},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1020000000000001,"15min":1.1120000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.59799999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.153,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5169999999999999,"5min":1.5229999999999999,"15min":1.7470000000000001},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1479999999999999,"15min":1.353},"min":{"1min":0.90800000000000003,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":3.7480000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.175,"15min":1.3899999999999999},"min":{"1min":0.751,"5min":0.747,"15min":0.747},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":5.0490000000000004},"last":1.167}]},{"osd":3,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.268,"15min":1.4390000000000001},"min":{"1min":0.86199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.883},"last":1.28},{"interface":"front","average":{"1min":1.278,"5min":1.2709999999999999,"15min":1.4490000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.55000000000000004},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":4.8630000000000004},"last":1.3100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.72799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.831,"5min":1.831,"15min":2.7229999999999999},"last":1.028},{"interface":"front","average":{"1min":1.256,"5min":1.232,"15min":1.3100000000000001},"min":{"1min":0.82399999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.744,"5min":1.744,"15min":2.077},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.26,"15min":1.3680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.861,"5min":1.861,"15min":2.1699999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.4510000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.6030000000000002},"last":1.2509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3600000000000001,"15min":1.4390000000000001},"min":{"1min":1.115,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.2120000000000002},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3600000000000001,"15min":1.4790000000000001},"min":{"1min":0.95499999999999996,"5min":0.82299999999999995,"15min":0.63700000000000001},"max":{"1min":1.913,"5min":1.913,"15min":2.367},"last":1.22}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":635392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.075,"15min":1.1579999999999999},"min":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0409999999999999},"last":2.6579999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.66400000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.278},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.163,"15min":1.2410000000000001},"min":{"1min":0.84799999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.119,"15min":1.1699999999999999},"min":{"1min":0.82599999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.3420000000000001,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.262},"min":{"1min":0.92200000000000004,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.617,"5min":1.619,"15min":1.9059999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.123,"15min":1.2190000000000001},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3939999999999999,"5min":1.6080000000000001,"15min":2.157},"last":2.746}]},{"osd":3,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2569999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0750000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.304,"15min":1.3999999999999999},"min":{"1min":1.147,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.5409999999999999,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.498}]},{"osd":4,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0940000000000001,"15min":1.1830000000000001},"min":{"1min":0.76200000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":2.5950000000000002},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1830000000000001,"15min":1.2490000000000001},"min":{"1min":0.81399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.7270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.23,"15min":1.2849999999999999},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.698,"5min":1.698,"15min":2.0219999999999998},"last":3.754},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2390000000000001,"15min":1.3220000000000001},"min":{"1min":0.83799999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.153,"5min":2.153,"15min":2.1739999999999999},"last":2.7040000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.3779999999999999,"15min":1.4159999999999999},"min":{"1min":1.109,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":3.927},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.415,"15min":1.4850000000000001},"min":{"1min":1.089,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.8140000000000001},"last":3.8140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1404928,"data_stored":649142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.105,"15min":1.1200000000000001},"min":{"1min":0.68400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.6419999999999999},"last":1.127},{"interface":"front","average":{"1min":1.099,"5min":1.1339999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.585,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2889999999999999,"15min":1.341},"min":{"1min":0.84999999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7769999999999999,"5min":2.141,"15min":2.6930000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2350000000000001,"15min":1.3},"min":{"1min":0.67700000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.667,"5min":1.7669999999999999,"15min":2.423},"last":1.2310000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.226,"15min":1.268},"min":{"1min":0.70099999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.591,"5min":1.6299999999999999,"15min":1.99},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2669999999999999,"15min":1.3480000000000001},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.7370000000000001,"15min":2.335},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1879999999999999,"15min":1.2749999999999999},"min":{"1min":0.85399999999999998,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.732,"5min":1.7689999999999999,"15min":2.621},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.204,"15min":1.248},"min":{"1min":0.91300000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6419999999999999,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":1.462}]},{"osd":5,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.149,"15min":1.264},"min":{"1min":0.81899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":2.274},"last":1.673},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.23,"15min":1.29},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5860000000000001,"5min":2.0289999999999999,"15min":2.266},"last":1.6240000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.246,"15min":1.3200000000000001},"min":{"1min":0.97999999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.4710000000000001},"last":1.722},{"interface":"front","average":{"1min":1.349,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.772,"5min":1.9099999999999999,"15min":2.5},"last":1.3799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.4330000000000001},"min":{"1min":0.76600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8069999999999999,"5min":2.2360000000000002,"15min":2.395},"last":1.774},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3879999999999999,"15min":1.444},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.415},"last":1.8029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82599999999999996,"15min":0.875},"min":{"1min":0.623,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4510000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.65700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.70199999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":1.056},"min":{"1min":0.64700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.345,"5min":1.345,"15min":4.0149999999999997},"last":1.157}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0569999999999999,"15min":1.0129999999999999},"min":{"1min":0.60999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.4770000000000001,"5min":1.5609999999999999,"15min":2.4729999999999999},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2170000000000001,"15min":1.2310000000000001},"min":{"1min":0.98299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1599999999999999,"15min":1.214},"min":{"1min":0.91700000000000004,"5min":0.82299999999999995,"15min":0.71199999999999997},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.996,"5min":0.89000000000000001,"15min":0.81999999999999995},"max":{"1min":1.734,"5min":1.734,"15min":2.0099999999999998},"last":1.204},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.27,"15min":1.343},"min":{"1min":0.96599999999999997,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.8740000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3069999999999999,"15min":1.3959999999999999},"min":{"1min":1.157,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.5940000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.357},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.3029999999999999,"15min":1.389},"min":{"1min":0.96499999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.464}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.331,"15min":1.458},"min":{"1min":1.075,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.7799999999999998},"last":1.518},{"interface":"front","average":{"1min":1.333,"5min":1.3180000000000001,"15min":1.3999999999999999},"min":{"1min":1.0629999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.98,"5min":1.98,"15min":1.9810000000000001},"last":1.2929999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80000000000000004,"15min":0.92500000000000004},"min":{"1min":0.54900000000000004,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.292,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.628},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.286,"5min":1.54,"15min":4.6349999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.87,"15min":1.052},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0660000000000001,"15min":1.1799999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.593,"5min":1.762,"15min":4.7009999999999996},"last":0.98399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.129,"15min":1.2569999999999999},"min":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.784,"5min":1.784,"15min":4.1920000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0369999999999999,"15min":1.1679999999999999},"min":{"1min":0.68300000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5069999999999999,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2150000000000001,"15min":1.5249999999999999},"min":{"1min":0.82399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":8.6989999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.819,"5min":1.819,"15min":4.7309999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2869999999999999,"15min":1.446},"min":{"1min":1.002,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.776,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2709999999999999,"15min":1.4239999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.944,"5min":1.944,"15min":4.335},"last":1.498}]},{"osd":6,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.306,"15min":1.4730000000000001},"min":{"1min":0.96499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":4.3730000000000002},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.274,"15min":1.619},"min":{"1min":0.88200000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.73,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.2609999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3460000000000001,"15min":1.498},"min":{"1min":0.90900000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9390000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.389},{"interface":"front","average":{"1min":1.456,"5min":1.3859999999999999,"15min":1.5489999999999999},"min":{"1min":1.0089999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":4.4050000000000002},"last":1.3540000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1372160,"data_stored":634732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.83899999999999997},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0669999999999999,"5min":1.264,"15min":2.2170000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.78900000000000003,"15min":0.97899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":6.1760000000000002},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0009999999999999,"15min":1.133},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.395,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":1.222},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2789999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.085,"15min":1.252},"min":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.5329999999999999,"5min":1.748,"15min":6.0919999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0349999999999999,"15min":1.3049999999999999},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.4590000000000001,"5min":1.768,"15min":10.368},"last":0.872}]},{"osd":4,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1930000000000001,"15min":1.327},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4490000000000001,"5min":1.8660000000000001,"15min":3.0739999999999998},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.325},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.80000000000000004},"max":{"1min":1.4530000000000001,"5min":1.958,"15min":2.911},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2230000000000001,"15min":1.589},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":10.214},"last":1.248},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.268,"15min":1.421},"min":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.478,"5min":1.669,"15min":2.8849999999999998},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.272,"15min":1.4910000000000001},"min":{"1min":0.879,"5min":0.874,"15min":0.874},"max":{"1min":1.607,"5min":1.915,"15min":6.032},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.298,"15min":1.6419999999999999},"min":{"1min":0.96099999999999997,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":10.112},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.704},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.81299999999999994},"max":{"1min":2.02,"5min":2.02,"15min":10.172000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3220000000000001,"15min":1.5009999999999999},"min":{"1min":0.92100000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.532,"5min":1.762,"15min":3.0299999999999998},"last":1.2729999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1974272,"data_stored":1231500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.749,"15min":0.92700000000000005},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.476,"5min":1.476,"15min":4.2039999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.95999999999999996},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.427,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89300000000000002,"15min":1.0760000000000001},"min":{"1min":0.51000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.321,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95699999999999996,"15min":1.141},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.589,"5min":1.589,"15min":3.5640000000000001},"last":1.014}]},{"osd":3,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94599999999999995,"15min":1.127},"min":{"1min":0.61599999999999999,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":4.093},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1060000000000001,"15min":1.3340000000000001},"min":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":4.7439999999999998},"last":1.4350000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2310000000000001,"15min":1.385},"min":{"1min":0.877,"5min":0.745,"15min":0.745},"max":{"1min":2.274,"5min":2.274,"15min":3.4060000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.512,"5min":1.881,"15min":4.5449999999999999},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2589999999999999,"15min":1.518},"min":{"1min":0.88900000000000001,"5min":0.753,"15min":0.753},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":4.9390000000000001},"last":1.24},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.254,"15min":1.4590000000000001},"min":{"1min":0.90500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":3.2290000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.246,"15min":1.4650000000000001},"min":{"1min":0.92500000000000004,"5min":0.84499999999999997,"15min":0.83999999999999997},"max":{"1min":1.794,"5min":1.968,"15min":4.4569999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3089999999999999,"15min":1.5900000000000001},"min":{"1min":0.97899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.873,"5min":1.873,"15min":4.8570000000000002},"last":1.7290000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.327,"15min":1.522},"min":{"1min":0.95099999999999996,"5min":0.873,"15min":0.86099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":3.056},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3169999999999999,"15min":1.534},"min":{"1min":0.96799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.885,"5min":2.149,"15min":4.5019999999999998},"last":1.869}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:55:52.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:55:52.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.428+0000 7f3499c00700 1 Processor -- start 2024-09-13T18:55:52.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.428+0000 7f3499c00700 1 -- start start 2024-09-13T18:55:52.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f349415c2a0 0x7f349415b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499c00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940b2ad0 con 0x7f349406aaa0 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349415b960 con 0x7f349415c2a0 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349415bc40 con 0x7f34940cb020 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499200700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f349406aaa0 0x7f34940b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47360/0 (socket says 172.21.15.81:47360) 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3499200700 1 -- 172.21.15.81:0/1213071704 learned_addr learned my addr 172.21.15.81:0/1213071704 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:52.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3493e00700 1 --2- 172.21.15.81:0/1213071704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f348b400700 1 --2- 172.21.15.81:0/1213071704 >> v2:172.21.15.178:3300/0 conn(0x7f349415c2a0 0x7f349415b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3493e00700 1 -- 172.21.15.81:0/1213071704 >> v2:172.21.15.178:3300/0 conn(0x7f349415c2a0 msgr2=0x7f349415b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:52.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3493e00700 1 --2- 172.21.15.81:0/1213071704 >> v2:172.21.15.178:3300/0 conn(0x7f349415c2a0 0x7f349415b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3493e00700 1 -- 172.21.15.81:0/1213071704 >> v1:172.21.15.81:6789/0 conn(0x7f349406aaa0 legacy=0x7f34940b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3493e00700 1 -- 172.21.15.81:0/1213071704 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349415bf20 con 0x7f34940cb020 2024-09-13T18:55:52.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.432+0000 7f3493400700 1 -- 172.21.15.81:0/1213071704 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601803796 0 0) 0x7f34940b2ad0 con 0x7f349406aaa0 2024-09-13T18:55:52.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3493e00700 1 --2- 172.21.15.81:0/1213071704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940cc6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3484009850 tx=0x7f3484009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1ac90f9ca14ebc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3493400700 1 -- 172.21.15.81:0/1213071704 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484011830 con 0x7f34940cb020 2024-09-13T18:55:52.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3493400700 1 -- 172.21.15.81:0/1213071704 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484011990 con 0x7f34940cb020 2024-09-13T18:55:52.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3493400700 1 -- 172.21.15.81:0/1213071704 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484011d40 con 0x7f34940cb020 2024-09-13T18:55:52.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 -- 172.21.15.81:0/1213071704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 msgr2=0x7f34940cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 --2- 172.21.15.81:0/1213071704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940cc6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3484009850 tx=0x7f3484009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 -- 172.21.15.81:0/1213071704 shutdown_connections 2024-09-13T18:55:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 --2- 172.21.15.81:0/1213071704 >> v2:172.21.15.178:3300/0 conn(0x7f349415c2a0 0x7f349415b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 --2- 172.21.15.81:0/1213071704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940cc6f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 -- 172.21.15.81:0/1213071704 >> 172.21.15.81:0/1213071704 conn(0x7f34940b0c40 msgr2=0x7f349406a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 -- 172.21.15.81:0/1213071704 shutdown_connections 2024-09-13T18:55:52.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.436+0000 7f3499c00700 1 -- 172.21.15.81:0/1213071704 wait complete. 2024-09-13T18:55:52.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 Processor -- start 2024-09-13T18:55:52.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 -- start start 2024-09-13T18:55:52.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f349406aaa0 0x7f34940c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 0x7f34940c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941f1510 con 0x7f349415c2a0 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940c3bf0 con 0x7f349406aaa0 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940c3ed0 con 0x7f34940cb020 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 0x7f34940c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 0x7f34940c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33412/0 (socket says 172.21.15.81:33412) 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3499200700 1 -- 172.21.15.81:0/934025322 learned_addr learned my addr 172.21.15.81:0/934025322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f3493e00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f349406aaa0 0x7f34940c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.440+0000 7f348b400700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499200700 1 -- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 msgr2=0x7f34940ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499200700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499200700 1 -- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f349406aaa0 msgr2=0x7f34940c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499200700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f349406aaa0 0x7f34940c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499200700 1 -- 172.21.15.81:0/934025322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840094b0 con 0x7f349415c2a0 2024-09-13T18:55:52.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499200700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 0x7f34940c7f90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f348c002230 tx=0x7f348c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00ab70 con 0x7f349415c2a0 2024-09-13T18:55:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34940c41b0 con 0x7f349415c2a0 2024-09-13T18:55:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00acf0 con 0x7f349415c2a0 2024-09-13T18:55:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c007310 con 0x7f349415c2a0 2024-09-13T18:55:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940c4770 con 0x7f349415c2a0 2024-09-13T18:55:52.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34940cc6f0 con 0x7f349415c2a0 2024-09-13T18:55:52.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.444+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f348c007470 con 0x7f349415c2a0 2024-09-13T18:55:52.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.448+0000 7f3490c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3470066730 0x7f3470068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.448+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f348c083bc0 con 0x7f349415c2a0 2024-09-13T18:55:52.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.448+0000 7f3493e00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3470066730 0x7f3470068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.448+0000 7f3493e00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3470066730 0x7f3470068bf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f34840090b0 tx=0x7f3484008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.456+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f348c050fc0 con 0x7f349415c2a0 2024-09-13T18:55:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.640+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34940cb400 con 0x7f3470066730 2024-09-13T18:55:52.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.640+0000 7f3490c00700 1 -- 172.21.15.81:0/934025322 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48361 (secure 0 0 0) 0x7f3484011c30 con 0x7f3470066730 2024-09-13T18:55:52.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3470066730 msgr2=0x7f3470068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3470066730 0x7f3470068bf0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f34840090b0 tx=0x7f3484008030 comp rx=0 tx=0).stop 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 msgr2=0x7f34940c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 0x7f34940c7f90 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f348c002230 tx=0x7f348c00cf50 comp rx=0 tx=0).stop 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 shutdown_connections 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3470066730 0x7f3470068bf0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f349415c2a0 0x7f34940c7f90 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34940cb020 0x7f34940ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 --2- 172.21.15.81:0/934025322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f349406aaa0 0x7f34940c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 >> 172.21.15.81:0/934025322 conn(0x7f34940b0c40 msgr2=0x7f349406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 shutdown_connections 2024-09-13T18:55:52.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.648+0000 7f3499c00700 1 -- 172.21.15.81:0/934025322 wait complete. 2024-09-13T18:55:52.657 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:55:52.678 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-13T18:55:51.146111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260896,"kb_used_data":11960,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713824,"statfs":{"total":773094113280,"available":772826955776,"internally_reserved":0,"allocated":12247040,"data_stored":6305662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-119363,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-253,"num_write_kb":-202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.325156"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-13T18:55:45.805229+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:55:45.805229+0000","last_peered":"2024-09-13T18:55:45.805229+0000","last_clean":"2024-09-13T18:55:45.805229+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:55:45.805229+0000","last_undegraded":"2024-09-13T18:55:45.805229+0000","last_fullsized":"2024-09-13T18:55:45.805229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1974272,"data_stored":1231500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.121,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.591,"5min":1.746,"15min":1.746},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.0920000000000001,"15min":1.115},"min":{"1min":0.83899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.423,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1479999999999999,"15min":1.139},"min":{"1min":0.82999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.571,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.347},{"interface":"front","average":{"1min":1.173,"5min":1.1499999999999999,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"max":{"1min":1.548,"5min":1.885,"15min":1.885},"last":1.585},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.222,"15min":1.214},"min":{"1min":0.79900000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.7070000000000001},"last":1.538}]},{"osd":3,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3320000000000001,"15min":1.403},"min":{"1min":0.93400000000000005,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.45,"5min":1.861,"15min":2.2610000000000001},"last":1.6699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4990000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1899999999999999,"15min":1.1830000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5069999999999999,"5min":1.823,"15min":1.823},"last":1.226}]},{"osd":5,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2450000000000001,"15min":1.2949999999999999},"min":{"1min":1.016,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.474,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.5509999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":1.1040000000000001,"5min":0.86199999999999999,"15min":0.85599999999999998},"max":{"1min":1.6379999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.47},{"interface":"front","average":{"1min":1.274,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4750000000000001,"5min":1.845,"15min":1.845},"last":1.4419999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.111,"15min":1.131},"min":{"1min":0.626,"5min":0.626,"15min":0.371},"max":{"1min":1.448,"5min":1.619,"15min":3.0369999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.103,"15min":1.1479999999999999},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1020000000000001,"15min":1.1120000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.59799999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.153,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5169999999999999,"5min":1.5229999999999999,"15min":1.7470000000000001},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1479999999999999,"15min":1.353},"min":{"1min":0.90800000000000003,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":3.7480000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.175,"15min":1.3899999999999999},"min":{"1min":0.751,"5min":0.747,"15min":0.747},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":5.0490000000000004},"last":1.167}]},{"osd":3,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.268,"15min":1.4390000000000001},"min":{"1min":0.86199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.883},"last":1.28},{"interface":"front","average":{"1min":1.278,"5min":1.2709999999999999,"15min":1.4490000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.55000000000000004},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":4.8630000000000004},"last":1.3100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.72799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.831,"5min":1.831,"15min":2.7229999999999999},"last":1.028},{"interface":"front","average":{"1min":1.256,"5min":1.232,"15min":1.3100000000000001},"min":{"1min":0.82399999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.744,"5min":1.744,"15min":2.077},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.26,"15min":1.3680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.861,"5min":1.861,"15min":2.1699999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.4510000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.6030000000000002},"last":1.2509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3600000000000001,"15min":1.4390000000000001},"min":{"1min":1.115,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.2120000000000002},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3600000000000001,"15min":1.4790000000000001},"min":{"1min":0.95499999999999996,"5min":0.82299999999999995,"15min":0.63700000000000001},"max":{"1min":1.913,"5min":1.913,"15min":2.367},"last":1.22}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":635392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.075,"15min":1.1579999999999999},"min":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0409999999999999},"last":2.6579999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.66400000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.278},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.163,"15min":1.2410000000000001},"min":{"1min":0.84799999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.119,"15min":1.1699999999999999},"min":{"1min":0.82599999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.3420000000000001,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.262},"min":{"1min":0.92200000000000004,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.617,"5min":1.619,"15min":1.9059999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.123,"15min":1.2190000000000001},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3939999999999999,"5min":1.6080000000000001,"15min":2.157},"last":2.746}]},{"osd":3,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2569999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0750000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.304,"15min":1.3999999999999999},"min":{"1min":1.147,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.5409999999999999,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.498}]},{"osd":4,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0940000000000001,"15min":1.1830000000000001},"min":{"1min":0.76200000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":2.5950000000000002},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1830000000000001,"15min":1.2490000000000001},"min":{"1min":0.81399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.7270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.23,"15min":1.2849999999999999},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.698,"5min":1.698,"15min":2.0219999999999998},"last":3.754},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2390000000000001,"15min":1.3220000000000001},"min":{"1min":0.83799999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.153,"5min":2.153,"15min":2.1739999999999999},"last":2.7040000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.3779999999999999,"15min":1.4159999999999999},"min":{"1min":1.109,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":3.927},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.415,"15min":1.4850000000000001},"min":{"1min":1.089,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.8140000000000001},"last":3.8140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1404928,"data_stored":649142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.105,"15min":1.1200000000000001},"min":{"1min":0.68400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.6419999999999999},"last":1.127},{"interface":"front","average":{"1min":1.099,"5min":1.1339999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.585,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2889999999999999,"15min":1.341},"min":{"1min":0.84999999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7769999999999999,"5min":2.141,"15min":2.6930000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2350000000000001,"15min":1.3},"min":{"1min":0.67700000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.667,"5min":1.7669999999999999,"15min":2.423},"last":1.2310000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.226,"15min":1.268},"min":{"1min":0.70099999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.591,"5min":1.6299999999999999,"15min":1.99},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2669999999999999,"15min":1.3480000000000001},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.7370000000000001,"15min":2.335},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1879999999999999,"15min":1.2749999999999999},"min":{"1min":0.85399999999999998,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.732,"5min":1.7689999999999999,"15min":2.621},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.204,"15min":1.248},"min":{"1min":0.91300000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6419999999999999,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":1.462}]},{"osd":5,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.149,"15min":1.264},"min":{"1min":0.81899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":2.274},"last":1.673},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.23,"15min":1.29},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5860000000000001,"5min":2.0289999999999999,"15min":2.266},"last":1.6240000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.246,"15min":1.3200000000000001},"min":{"1min":0.97999999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.4710000000000001},"last":1.722},{"interface":"front","average":{"1min":1.349,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.772,"5min":1.9099999999999999,"15min":2.5},"last":1.3799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.4330000000000001},"min":{"1min":0.76600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8069999999999999,"5min":2.2360000000000002,"15min":2.395},"last":1.774},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3879999999999999,"15min":1.444},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.415},"last":1.8029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82599999999999996,"15min":0.875},"min":{"1min":0.623,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4510000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.65700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.70199999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":1.056},"min":{"1min":0.64700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.345,"5min":1.345,"15min":4.0149999999999997},"last":1.157}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0569999999999999,"15min":1.0129999999999999},"min":{"1min":0.60999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.4770000000000001,"5min":1.5609999999999999,"15min":2.4729999999999999},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2170000000000001,"15min":1.2310000000000001},"min":{"1min":0.98299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1599999999999999,"15min":1.214},"min":{"1min":0.91700000000000004,"5min":0.82299999999999995,"15min":0.71199999999999997},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.996,"5min":0.89000000000000001,"15min":0.81999999999999995},"max":{"1min":1.734,"5min":1.734,"15min":2.0099999999999998},"last":1.204},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.27,"15min":1.343},"min":{"1min":0.96599999999999997,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.8740000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3069999999999999,"15min":1.3959999999999999},"min":{"1min":1.157,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.5940000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.357},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.3029999999999999,"15min":1.389},"min":{"1min":0.96499999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.464}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.331,"15min":1.458},"min":{"1min":1.075,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.7799999999999998},"last":1.518},{"interface":"front","average":{"1min":1.333,"5min":1.3180000000000001,"15min":1.3999999999999999},"min":{"1min":1.0629999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.98,"5min":1.98,"15min":1.9810000000000001},"last":1.2929999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80000000000000004,"15min":0.92500000000000004},"min":{"1min":0.54900000000000004,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.292,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.628},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.286,"5min":1.54,"15min":4.6349999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.87,"15min":1.052},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0660000000000001,"15min":1.1799999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.593,"5min":1.762,"15min":4.7009999999999996},"last":0.98399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.129,"15min":1.2569999999999999},"min":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.784,"5min":1.784,"15min":4.1920000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0369999999999999,"15min":1.1679999999999999},"min":{"1min":0.68300000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5069999999999999,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2150000000000001,"15min":1.5249999999999999},"min":{"1min":0.82399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":8.6989999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.819,"5min":1.819,"15min":4.7309999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2869999999999999,"15min":1.446},"min":{"1min":1.002,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.776,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2709999999999999,"15min":1.4239999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.944,"5min":1.944,"15min":4.335},"last":1.498}]},{"osd":6,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.306,"15min":1.4730000000000001},"min":{"1min":0.96499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":4.3730000000000002},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.274,"15min":1.619},"min":{"1min":0.88200000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.73,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.2609999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3460000000000001,"15min":1.498},"min":{"1min":0.90900000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9390000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.389},{"interface":"front","average":{"1min":1.456,"5min":1.3859999999999999,"15min":1.5489999999999999},"min":{"1min":1.0089999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":4.4050000000000002},"last":1.3540000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1372160,"data_stored":634732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.83899999999999997},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0669999999999999,"5min":1.264,"15min":2.2170000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.78900000000000003,"15min":0.97899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":6.1760000000000002},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0009999999999999,"15min":1.133},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.395,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":1.222},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2789999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.085,"15min":1.252},"min":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.5329999999999999,"5min":1.748,"15min":6.0919999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0349999999999999,"15min":1.3049999999999999},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.4590000000000001,"5min":1.768,"15min":10.368},"last":0.872}]},{"osd":4,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1930000000000001,"15min":1.327},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4490000000000001,"5min":1.8660000000000001,"15min":3.0739999999999998},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.325},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.80000000000000004},"max":{"1min":1.4530000000000001,"5min":1.958,"15min":2.911},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2230000000000001,"15min":1.589},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":10.214},"last":1.248},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.268,"15min":1.421},"min":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.478,"5min":1.669,"15min":2.8849999999999998},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.272,"15min":1.4910000000000001},"min":{"1min":0.879,"5min":0.874,"15min":0.874},"max":{"1min":1.607,"5min":1.915,"15min":6.032},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.298,"15min":1.6419999999999999},"min":{"1min":0.96099999999999997,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":10.112},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.704},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.81299999999999994},"max":{"1min":2.02,"5min":2.02,"15min":10.172000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3220000000000001,"15min":1.5009999999999999},"min":{"1min":0.92100000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.532,"5min":1.762,"15min":3.0299999999999998},"last":1.2729999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1974272,"data_stored":1231500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.749,"15min":0.92700000000000005},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.476,"5min":1.476,"15min":4.2039999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.95999999999999996},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.427,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89300000000000002,"15min":1.0760000000000001},"min":{"1min":0.51000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.321,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95699999999999996,"15min":1.141},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.589,"5min":1.589,"15min":3.5640000000000001},"last":1.014}]},{"osd":3,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94599999999999995,"15min":1.127},"min":{"1min":0.61599999999999999,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":4.093},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1060000000000001,"15min":1.3340000000000001},"min":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":4.7439999999999998},"last":1.4350000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2310000000000001,"15min":1.385},"min":{"1min":0.877,"5min":0.745,"15min":0.745},"max":{"1min":2.274,"5min":2.274,"15min":3.4060000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.512,"5min":1.881,"15min":4.5449999999999999},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2589999999999999,"15min":1.518},"min":{"1min":0.88900000000000001,"5min":0.753,"15min":0.753},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":4.9390000000000001},"last":1.24},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.254,"15min":1.4590000000000001},"min":{"1min":0.90500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":3.2290000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.246,"15min":1.4650000000000001},"min":{"1min":0.92500000000000004,"5min":0.84499999999999997,"15min":0.83999999999999997},"max":{"1min":1.794,"5min":1.968,"15min":4.4569999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3089999999999999,"15min":1.5900000000000001},"min":{"1min":0.97899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.873,"5min":1.873,"15min":4.8570000000000002},"last":1.7290000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.327,"15min":1.522},"min":{"1min":0.95099999999999996,"5min":0.873,"15min":0.86099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":3.056},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3169999999999999,"15min":1.534},"min":{"1min":0.96799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.885,"5min":2.149,"15min":4.5019999999999998},"last":1.869}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:55:52.680 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:55:52.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:55:52.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.836+0000 7f4e0a000700 1 Processor -- start 2024-09-13T18:55:52.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.836+0000 7f4e0a000700 1 -- start start 2024-09-13T18:55:52.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e0a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4e040b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e0a000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4e040cdfe0 0x7f4e040ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e0a000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e040d1390 con 0x7f4e0415cd90 2024-09-13T18:55:52.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e0a000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e040b2530 con 0x7f4e040cdfe0 2024-09-13T18:55:52.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e0a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040d05f0 con 0x7f4e0415d170 2024-09-13T18:55:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e08c00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4e0415cd90 0x7f4e040cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47372/0 (socket says 172.21.15.81:47372) 2024-09-13T18:55:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e08c00700 1 -- 172.21.15.81:0/22010607 learned_addr learned my addr 172.21.15.81:0/22010607 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e09600700 1 --2- 172.21.15.81:0/22010607 >> v2:172.21.15.178:3300/0 conn(0x7f4e040cdfe0 0x7f4e040ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4e040b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919616609 0 0) 0x7f4e040d1390 con 0x7f4e0415cd90 2024-09-13T18:55:52.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dec0035d0 con 0x7f4e0415cd90 2024-09-13T18:55:52.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531901422 0 0) 0x7f4dec0035d0 con 0x7f4e0415cd90 2024-09-13T18:55:52.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 msgr2=0x7f4e040b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:52.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4e040b1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 >> v2:172.21.15.178:3300/0 conn(0x7f4e040cdfe0 msgr2=0x7f4e040ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:52.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 --2- 172.21.15.81:0/22010607 >> v2:172.21.15.178:3300/0 conn(0x7f4e040cdfe0 0x7f4e040ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040d1670 con 0x7f4e0415cd90 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3328147048 0 0) 0x7f4df8001670 con 0x7f4e0415cd90 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 >> v1:172.21.15.81:6789/0 conn(0x7f4e0415cd90 legacy=0x7f4e040cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4dec003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec004010 0x7f4dec004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dec004db0 0x7f4dec005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040b2530 con 0x7f4dec004010 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec00ba30 con 0x7f4dec004db0 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec00bba0 con 0x7f4e0415d170 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec004010 0x7f4dec004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e09600700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dec004db0 0x7f4dec005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 -- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 msgr2=0x7f4dec003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:52.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e08c00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4dec003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4dec003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 -- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dec004db0 msgr2=0x7f4dec005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dec004db0 0x7f4dec005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e03e00700 1 -- 172.21.15.81:0/22010607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec0035d0 con 0x7f4dec004010 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e09600700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dec004db0 0x7f4dec005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.840+0000 7f4e08c00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e0415d170 0x7f4dec003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:52.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e03e00700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec004010 0x7f4dec004870 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009b40 tx=0x7f4dec0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba88e2b27795aba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000e6c0 con 0x7f4dec004010 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df000e820 con 0x7f4dec004010 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e03400700 1 -- 172.21.15.81:0/22010607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000eb90 con 0x7f4dec004010 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e0a000700 1 -- 172.21.15.81:0/22010607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec004010 msgr2=0x7f4dec004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e0a000700 1 --2- 172.21.15.81:0/22010607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec004010 0x7f4dec004870 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f4df0009b40 tx=0x7f4dec0058a0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e09600700 1 -- 172.21.15.81:0/22010607 reap_dead start 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e0a000700 1 -- 172.21.15.81:0/22010607 shutdown_connections 2024-09-13T18:55:52.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e0a000700 1 -- 172.21.15.81:0/22010607 >> 172.21.15.81:0/22010607 conn(0x7f4e040d2c10 msgr2=0x7f4e040d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:52.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e0a000700 1 -- 172.21.15.81:0/22010607 shutdown_connections 2024-09-13T18:55:52.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.844+0000 7f4e0a000700 1 -- 172.21.15.81:0/22010607 wait complete. 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 Processor -- start 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 -- start start 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dec004010 0x7f4e0415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 0x7f4e040cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e040cbd50 0x7f4e040c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040cc200 con 0x7f4e041f2610 2024-09-13T18:55:52.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0415b700 con 0x7f4e040cbd50 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e0a000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040cac80 con 0x7f4dec004010 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 0x7f4e040cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 0x7f4e040cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33432/0 (socket says 172.21.15.81:33432) 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 -- 172.21.15.81:0/559014309 learned_addr learned my addr 172.21.15.81:0/559014309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e08c00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dec004010 0x7f4e0415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e09600700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e040cbd50 0x7f4e040c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 -- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dec004010 msgr2=0x7f4e0415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dec004010 0x7f4e0415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 -- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e040cbd50 msgr2=0x7f4e040c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e040cbd50 0x7f4e040c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 -- 172.21.15.81:0/559014309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040b5ae0 con 0x7f4e041f2610 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e09600700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e040cbd50 0x7f4e040c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e08c00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dec004010 0x7f4e0415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:52.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.848+0000 7f4e03e00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 0x7f4e040cb810 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4dec004780 tx=0x7f4df00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000e6c0 con 0x7f4e041f2610 2024-09-13T18:55:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0013e00 con 0x7f4e041f2610 2024-09-13T18:55:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0004270 con 0x7f4e041f2610 2024-09-13T18:55:52.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e040b5dc0 con 0x7f4e041f2610 2024-09-13T18:55:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e040b6380 con 0x7f4e041f2610 2024-09-13T18:55:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e040b6540 con 0x7f4e041f2610 2024-09-13T18:55:52.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.852+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4df00043d0 con 0x7f4e041f2610 2024-09-13T18:55:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.856+0000 7f4e00c00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4de4066760 0x7f4de4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.856+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4df00857a0 con 0x7f4e041f2610 2024-09-13T18:55:52.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.856+0000 7f4e08c00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4de4066760 0x7f4de4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:52.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.856+0000 7f4e08c00700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4de4066760 0x7f4de4068c20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4df80018e0 tx=0x7f4df8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:52.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:52.860+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4df0052dd0 con 0x7f4e041f2610 2024-09-13T18:55:53.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.044+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4e040d1c30 con 0x7f4de4066760 2024-09-13T18:55:53.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e00c00700 1 -- 172.21.15.81:0/559014309 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48361 (secure 0 0 0) 0x7f4df800d050 con 0x7f4de4066760 2024-09-13T18:55:53.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4de4066760 msgr2=0x7f4de4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4de4066760 0x7f4de4068c20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4df80018e0 tx=0x7f4df8009040 comp rx=0 tx=0).stop 2024-09-13T18:55:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 msgr2=0x7f4e040cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 0x7f4e040cb810 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4dec004780 tx=0x7f4df00047e0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 shutdown_connections 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f4de4066760 0x7f4de4068c20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e040cbd50 0x7f4e040c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e041f2610 0x7f4e040cb810 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 --2- 172.21.15.81:0/559014309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dec004010 0x7f4e0415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.052+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 >> 172.21.15.81:0/559014309 conn(0x7f4e040d2c10 msgr2=0x7f4e040ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.056+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 shutdown_connections 2024-09-13T18:55:53.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.056+0000 7f4e0a000700 1 -- 172.21.15.81:0/559014309 wait complete. 2024-09-13T18:55:53.064 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:55:53.087 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-13T18:55:51.146111+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260896,"kb_used_data":11960,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713824,"statfs":{"total":773094113280,"available":772826955776,"internally_reserved":0,"allocated":12247040,"data_stored":6305662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-119363,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-253,"num_write_kb":-202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.325156"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":242,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-09-13T18:55:45.805229+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:55:45.805229+0000","last_peered":"2024-09-13T18:55:45.805229+0000","last_clean":"2024-09-13T18:55:45.805229+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:55:45.805229+0000","last_undegraded":"2024-09-13T18:55:45.805229+0000","last_fullsized":"2024-09-13T18:55:45.805229+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574957,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1974272,"data_stored":1231500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.121,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.591,"5min":1.746,"15min":1.746},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.0920000000000001,"15min":1.115},"min":{"1min":0.83899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.423,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3069999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1479999999999999,"15min":1.139},"min":{"1min":0.82999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.571,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.347},{"interface":"front","average":{"1min":1.173,"5min":1.1499999999999999,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":0.86499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"max":{"1min":1.548,"5min":1.885,"15min":1.885},"last":1.585},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.222,"15min":1.214},"min":{"1min":0.79900000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.7070000000000001},"last":1.538}]},{"osd":3,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3320000000000001,"15min":1.403},"min":{"1min":0.93400000000000005,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.45,"5min":1.861,"15min":2.2610000000000001},"last":1.6699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4990000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1899999999999999,"15min":1.1830000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5069999999999999,"5min":1.823,"15min":1.823},"last":1.226}]},{"osd":5,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2450000000000001,"15min":1.2949999999999999},"min":{"1min":1.016,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.474,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.5509999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0429999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":1.1040000000000001,"5min":0.86199999999999999,"15min":0.85599999999999998},"max":{"1min":1.6379999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.47},{"interface":"front","average":{"1min":1.274,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4750000000000001,"5min":1.845,"15min":1.845},"last":1.4419999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.111,"15min":1.131},"min":{"1min":0.626,"5min":0.626,"15min":0.371},"max":{"1min":1.448,"5min":1.619,"15min":3.0369999999999999},"last":1.046},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.103,"15min":1.1479999999999999},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.80800000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1020000000000001,"15min":1.1120000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.59799999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.153,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5169999999999999,"5min":1.5229999999999999,"15min":1.7470000000000001},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1479999999999999,"15min":1.353},"min":{"1min":0.90800000000000003,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":3.7480000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.175,"15min":1.3899999999999999},"min":{"1min":0.751,"5min":0.747,"15min":0.747},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":5.0490000000000004},"last":1.167}]},{"osd":3,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.268,"15min":1.4390000000000001},"min":{"1min":0.86199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.883},"last":1.28},{"interface":"front","average":{"1min":1.278,"5min":1.2709999999999999,"15min":1.4490000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.55000000000000004},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":4.8630000000000004},"last":1.3100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.72799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.831,"5min":1.831,"15min":2.7229999999999999},"last":1.028},{"interface":"front","average":{"1min":1.256,"5min":1.232,"15min":1.3100000000000001},"min":{"1min":0.82399999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.744,"5min":1.744,"15min":2.077},"last":1.0980000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.26,"15min":1.3680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.861,"5min":1.861,"15min":2.1699999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.4510000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.6030000000000002},"last":1.2509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3600000000000001,"15min":1.4390000000000001},"min":{"1min":1.115,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.2120000000000002},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.3600000000000001,"15min":1.4790000000000001},"min":{"1min":0.95499999999999996,"5min":0.82299999999999995,"15min":0.63700000000000001},"max":{"1min":1.913,"5min":1.913,"15min":2.367},"last":1.22}]}]},{"osd":5,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":635392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.075,"15min":1.1579999999999999},"min":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0409999999999999},"last":2.6579999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.66400000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.278},"last":0.63100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.163,"15min":1.2410000000000001},"min":{"1min":0.84799999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.119,"15min":1.1699999999999999},"min":{"1min":0.82599999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.3420000000000001,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":1.3919999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.262},"min":{"1min":0.92200000000000004,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.617,"5min":1.619,"15min":1.9059999999999999},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.123,"15min":1.2190000000000001},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3939999999999999,"5min":1.6080000000000001,"15min":2.157},"last":2.746}]},{"osd":3,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2569999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0750000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.304,"15min":1.3999999999999999},"min":{"1min":1.147,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.5409999999999999,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.498}]},{"osd":4,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0940000000000001,"15min":1.1830000000000001},"min":{"1min":0.76200000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":2.5950000000000002},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1830000000000001,"15min":1.2490000000000001},"min":{"1min":0.81399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.7270000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.23,"15min":1.2849999999999999},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.698,"5min":1.698,"15min":2.0219999999999998},"last":3.754},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2390000000000001,"15min":1.3220000000000001},"min":{"1min":0.83799999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.153,"5min":2.153,"15min":2.1739999999999999},"last":2.7040000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.3779999999999999,"15min":1.4159999999999999},"min":{"1min":1.109,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":3.927},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.415,"15min":1.4850000000000001},"min":{"1min":1.089,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.8140000000000001},"last":3.8140000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1404928,"data_stored":649142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.105,"15min":1.1200000000000001},"min":{"1min":0.68400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.6419999999999999},"last":1.127},{"interface":"front","average":{"1min":1.099,"5min":1.1339999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.585,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2889999999999999,"15min":1.341},"min":{"1min":0.84999999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7769999999999999,"5min":2.141,"15min":2.6930000000000001},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.2350000000000001,"15min":1.3},"min":{"1min":0.67700000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.667,"5min":1.7669999999999999,"15min":2.423},"last":1.2310000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.226,"15min":1.268},"min":{"1min":0.70099999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.591,"5min":1.6299999999999999,"15min":1.99},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2669999999999999,"15min":1.3480000000000001},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.7370000000000001,"15min":2.335},"last":1.3080000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1879999999999999,"15min":1.2749999999999999},"min":{"1min":0.85399999999999998,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.732,"5min":1.7689999999999999,"15min":2.621},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.204,"15min":1.248},"min":{"1min":0.91300000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6419999999999999,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":1.462}]},{"osd":5,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.149,"15min":1.264},"min":{"1min":0.81899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":2.274},"last":1.673},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.23,"15min":1.29},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5860000000000001,"5min":2.0289999999999999,"15min":2.266},"last":1.6240000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.246,"15min":1.3200000000000001},"min":{"1min":0.97999999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.4710000000000001},"last":1.722},{"interface":"front","average":{"1min":1.349,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.772,"5min":1.9099999999999999,"15min":2.5},"last":1.3799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.4330000000000001},"min":{"1min":0.76600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8069999999999999,"5min":2.2360000000000002,"15min":2.395},"last":1.774},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3879999999999999,"15min":1.444},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.415},"last":1.8029999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574956,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82599999999999996,"15min":0.875},"min":{"1min":0.623,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4510000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.65700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.90100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.70199999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":1.056},"min":{"1min":0.64700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.345,"5min":1.345,"15min":4.0149999999999997},"last":1.157}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0569999999999999,"15min":1.0129999999999999},"min":{"1min":0.60999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.4770000000000001,"5min":1.5609999999999999,"15min":2.4729999999999999},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2170000000000001,"15min":1.2310000000000001},"min":{"1min":0.98299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.224,"5min":1.1599999999999999,"15min":1.214},"min":{"1min":0.91700000000000004,"5min":0.82299999999999995,"15min":0.71199999999999997},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.996,"5min":0.89000000000000001,"15min":0.81999999999999995},"max":{"1min":1.734,"5min":1.734,"15min":2.0099999999999998},"last":1.204},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.27,"15min":1.343},"min":{"1min":0.96599999999999997,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.8740000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3069999999999999,"15min":1.3959999999999999},"min":{"1min":1.157,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.5940000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.357},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.3029999999999999,"15min":1.389},"min":{"1min":0.96499999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.464}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.331,"15min":1.458},"min":{"1min":1.075,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.7799999999999998},"last":1.518},{"interface":"front","average":{"1min":1.333,"5min":1.3180000000000001,"15min":1.3999999999999999},"min":{"1min":1.0629999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.98,"5min":1.98,"15min":1.9810000000000001},"last":1.2929999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574955,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1380352,"data_stored":641132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80000000000000004,"15min":0.92500000000000004},"min":{"1min":0.54900000000000004,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.292,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.628},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.286,"5min":1.54,"15min":4.6349999999999998},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.87,"15min":1.052},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0660000000000001,"15min":1.1799999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.593,"5min":1.762,"15min":4.7009999999999996},"last":0.98399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.129,"15min":1.2569999999999999},"min":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.784,"5min":1.784,"15min":4.1920000000000002},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0369999999999999,"15min":1.1679999999999999},"min":{"1min":0.68300000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5069999999999999,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":1.1739999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2150000000000001,"15min":1.5249999999999999},"min":{"1min":0.82399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":8.6989999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.819,"5min":1.819,"15min":4.7309999999999999},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2869999999999999,"15min":1.446},"min":{"1min":1.002,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.776,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2709999999999999,"15min":1.4239999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.944,"5min":1.944,"15min":4.335},"last":1.498}]},{"osd":6,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.306,"15min":1.4730000000000001},"min":{"1min":0.96499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":4.3730000000000002},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.274,"15min":1.619},"min":{"1min":0.88200000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.73,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.2609999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3460000000000001,"15min":1.498},"min":{"1min":0.90900000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9390000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.389},{"interface":"front","average":{"1min":1.456,"5min":1.3859999999999999,"15min":1.5489999999999999},"min":{"1min":1.0089999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":4.4050000000000002},"last":1.3540000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574956,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1372160,"data_stored":634732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.83899999999999997},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0669999999999999,"5min":1.264,"15min":2.2170000000000001},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.78900000000000003,"15min":0.97899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":6.1760000000000002},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0009999999999999,"15min":1.133},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.395,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":1.222},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2789999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.085,"15min":1.252},"min":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.5329999999999999,"5min":1.748,"15min":6.0919999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0349999999999999,"15min":1.3049999999999999},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.4590000000000001,"5min":1.768,"15min":10.368},"last":0.872}]},{"osd":4,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1930000000000001,"15min":1.327},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4490000000000001,"5min":1.8660000000000001,"15min":3.0739999999999998},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.325},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.80000000000000004},"max":{"1min":1.4530000000000001,"5min":1.958,"15min":2.911},"last":0.90300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2230000000000001,"15min":1.589},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":10.214},"last":1.248},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.268,"15min":1.421},"min":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.478,"5min":1.669,"15min":2.8849999999999998},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.272,"15min":1.4910000000000001},"min":{"1min":0.879,"5min":0.874,"15min":0.874},"max":{"1min":1.607,"5min":1.915,"15min":6.032},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.298,"15min":1.6419999999999999},"min":{"1min":0.96099999999999997,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":10.112},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.704},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.81299999999999994},"max":{"1min":2.02,"5min":2.02,"15min":10.172000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3220000000000001,"15min":1.5009999999999999},"min":{"1min":0.92100000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.532,"5min":1.762,"15min":3.0299999999999998},"last":1.2729999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574955,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1928,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1974272,"data_stored":1231500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.749,"15min":0.92700000000000005},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.476,"5min":1.476,"15min":4.2039999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.95999999999999996},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.427,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89300000000000002,"15min":1.0760000000000001},"min":{"1min":0.51000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.321,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95699999999999996,"15min":1.141},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.589,"5min":1.589,"15min":3.5640000000000001},"last":1.014}]},{"osd":3,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94599999999999995,"15min":1.127},"min":{"1min":0.61599999999999999,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":4.093},"last":1.7689999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1060000000000001,"15min":1.3340000000000001},"min":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":4.7439999999999998},"last":1.4350000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2310000000000001,"15min":1.385},"min":{"1min":0.877,"5min":0.745,"15min":0.745},"max":{"1min":2.274,"5min":2.274,"15min":3.4060000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.512,"5min":1.881,"15min":4.5449999999999999},"last":1.5640000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2589999999999999,"15min":1.518},"min":{"1min":0.88900000000000001,"5min":0.753,"15min":0.753},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":4.9390000000000001},"last":1.24},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.254,"15min":1.4590000000000001},"min":{"1min":0.90500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":3.2290000000000001},"last":1.1359999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.246,"15min":1.4650000000000001},"min":{"1min":0.92500000000000004,"5min":0.84499999999999997,"15min":0.83999999999999997},"max":{"1min":1.794,"5min":1.968,"15min":4.4569999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.3089999999999999,"15min":1.5900000000000001},"min":{"1min":0.97899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.873,"5min":1.873,"15min":4.8570000000000002},"last":1.7290000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.327,"15min":1.522},"min":{"1min":0.95099999999999996,"5min":0.873,"15min":0.86099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":3.056},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3169999999999999,"15min":1.534},"min":{"1min":0.96799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.885,"5min":2.149,"15min":4.5019999999999998},"last":1.869}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:55:53.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:55:53.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.248+0000 7f631d000700 1 Processor -- start 2024-09-13T18:55:53.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.248+0000 7f631d000700 1 -- start start 2024-09-13T18:55:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f631d000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63180cb020 0x7f63180cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f631d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631806aaa0 0x7f631806aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f631d000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631806b430 con 0x7f631815c2a0 2024-09-13T18:55:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f631d000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63180b2ad0 con 0x7f63180cb020 2024-09-13T18:55:53.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f631d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631815b960 con 0x7f631806aaa0 2024-09-13T18:55:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f631815c2a0 0x7f631815b0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47380/0 (socket says 172.21.15.81:47380) 2024-09-13T18:55:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316a00700 1 -- 172.21.15.81:0/3293747636 learned_addr learned my addr 172.21.15.81:0/3293747636 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317400700 1 --2- 172.21.15.81:0/3293747636 >> v2:172.21.15.178:3300/0 conn(0x7f63180cb020 0x7f63180cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:53.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317e00700 1 --2- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631806aaa0 0x7f631806aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316000700 1 -- 172.21.15.81:0/3293747636 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167799158 0 0) 0x7f6304001110 con 0x7f631815c2a0 2024-09-13T18:55:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316000700 1 -- 172.21.15.81:0/3293747636 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62fc0035d0 con 0x7f631815c2a0 2024-09-13T18:55:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317400700 1 -- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631806aaa0 msgr2=0x7f631806aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317400700 1 --2- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631806aaa0 0x7f631806aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317400700 1 -- 172.21.15.81:0/3293747636 >> v1:172.21.15.81:6789/0 conn(0x7f631815c2a0 legacy=0x7f631815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317400700 1 -- 172.21.15.81:0/3293747636 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631815bc40 con 0x7f63180cb020 2024-09-13T18:55:53.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6317400700 1 --2- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f63180cc6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6308009d90 tx=0x7f630800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81fafa330096bc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316000700 1 -- 172.21.15.81:0/3293747636 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630800e070 con 0x7f63180cb020 2024-09-13T18:55:53.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316000700 1 -- 172.21.15.81:0/3293747636 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630800bb20 con 0x7f63180cb020 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.252+0000 7f6316000700 1 -- 172.21.15.81:0/3293747636 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308012430 con 0x7f63180cb020 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 -- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 msgr2=0x7f63180cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 --2- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f63180cc6f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6308009d90 tx=0x7f630800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 -- 172.21.15.81:0/3293747636 shutdown_connections 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 --2- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631806aaa0 0x7f631806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 --2- 172.21.15.81:0/3293747636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f63180cc6f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 -- 172.21.15.81:0/3293747636 >> 172.21.15.81:0/3293747636 conn(0x7f63180b0c40 msgr2=0x7f631806a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 -- 172.21.15.81:0/3293747636 shutdown_connections 2024-09-13T18:55:53.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.256+0000 7f631d000700 1 -- 172.21.15.81:0/3293747636 wait complete. 2024-09-13T18:55:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 Processor -- start 2024-09-13T18:55:53.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 -- start start 2024-09-13T18:55:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 0x7f631814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:53.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f6318153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631815c2a0 0x7f6318154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63181579a0 con 0x7f631806aaa0 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63181526e0 con 0x7f63180cb020 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f631d000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6318154550 con 0x7f631815c2a0 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 0x7f631814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 0x7f631814b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33438/0 (socket says 172.21.15.81:33438) 2024-09-13T18:55:53.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 -- 172.21.15.81:0/992337289 learned_addr learned my addr 172.21.15.81:0/992337289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317e00700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631815c2a0 0x7f6318154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6316a00700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f6318153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 -- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631815c2a0 msgr2=0x7f6318154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631815c2a0 0x7f6318154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 -- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 msgr2=0x7f6318153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f6318153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 -- 172.21.15.81:0/992337289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308009a70 con 0x7f631806aaa0 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6316a00700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f6318153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.260+0000 7f6317400700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 0x7f631814b7d0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f63180b1690 tx=0x7f6308004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6308004960 con 0x7f631806aaa0 2024-09-13T18:55:53.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6308020070 con 0x7f631806aaa0 2024-09-13T18:55:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63080276c0 con 0x7f631806aaa0 2024-09-13T18:55:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63181549b0 con 0x7f631806aaa0 2024-09-13T18:55:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6318152090 con 0x7f631806aaa0 2024-09-13T18:55:53.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631806aef0 con 0x7f631806aaa0 2024-09-13T18:55:53.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.264+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6308027820 con 0x7f631806aaa0 2024-09-13T18:55:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.268+0000 7f630f400700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066730 0x7f62f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:53.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.268+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f6308022070 con 0x7f631806aaa0 2024-09-13T18:55:53.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.268+0000 7f6316a00700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066730 0x7f62f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:53.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.268+0000 7f6316a00700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066730 0x7f62f8068bf0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6304007fd0 tx=0x7f6304009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:53.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.272+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63080534d0 con 0x7f631806aaa0 2024-09-13T18:55:53.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.476+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63180673c0 con 0x7f631806aaa0 2024-09-13T18:55:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.480+0000 7f630f400700 1 -- 172.21.15.81:0/992337289 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+13463 (secure 0 0 0) 0x7f6308056af0 con 0x7f631806aaa0 2024-09-13T18:55:53.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:55:53.488 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":112,"fsid":"a8432ea3-e34b-45da-88c0-4120757fcc5d","created":"2024-09-13T18:46:50.586372+0000","modified":"2024-09-13T18:55:48.264255+0000","last_up_change":"2024-09-13T18:47:02.755952+0000","last_in_change":"2024-09-13T18:46:53.713140+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:47:03.051737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"167aa7b6-9aad-41fc-88da-b10f711eae43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6801","nonce":3220976985}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6803","nonce":3220976985}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6807","nonce":3220976985}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3220976985},{"type":"v1","addr":"172.21.15.81:6805","nonce":3220976985}]},"public_addr":"172.21.15.81:6801/3220976985","cluster_addr":"172.21.15.81:6803/3220976985","heartbeat_back_addr":"172.21.15.81:6807/3220976985","heartbeat_front_addr":"172.21.15.81:6805/3220976985","state":["exists","up"]},{"osd":1,"uuid":"57d343ca-dd86-4384-88ea-ffb3a19cb365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6825","nonce":2924937371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6827","nonce":2924937371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6831","nonce":2924937371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2924937371},{"type":"v1","addr":"172.21.15.81:6829","nonce":2924937371}]},"public_addr":"172.21.15.81:6825/2924937371","cluster_addr":"172.21.15.81:6827/2924937371","heartbeat_back_addr":"172.21.15.81:6831/2924937371","heartbeat_front_addr":"172.21.15.81:6829/2924937371","state":["exists","up"]},{"osd":2,"uuid":"993f59f2-3b85-4b10-9ec7-44520fc63801","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6809","nonce":533641915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6811","nonce":533641915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6815","nonce":533641915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":533641915},{"type":"v1","addr":"172.21.15.81:6813","nonce":533641915}]},"public_addr":"172.21.15.81:6809/533641915","cluster_addr":"172.21.15.81:6811/533641915","heartbeat_back_addr":"172.21.15.81:6815/533641915","heartbeat_front_addr":"172.21.15.81:6813/533641915","state":["exists","up"]},{"osd":3,"uuid":"348901a1-54b4-4010-9689-6ef1283134d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6817","nonce":3484646797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6819","nonce":3484646797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6823","nonce":3484646797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":3484646797},{"type":"v1","addr":"172.21.15.81:6821","nonce":3484646797}]},"public_addr":"172.21.15.81:6817/3484646797","cluster_addr":"172.21.15.81:6819/3484646797","heartbeat_back_addr":"172.21.15.81:6823/3484646797","heartbeat_front_addr":"172.21.15.81:6821/3484646797","state":["exists","up"]},{"osd":4,"uuid":"6bb5d485-7450-4d97-a335-523aa57a09e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6805","nonce":1450995168}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6810","nonce":1450995168}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6815","nonce":1450995168}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":1450995168},{"type":"v1","addr":"172.21.15.178:6813","nonce":1450995168}]},"public_addr":"172.21.15.178:6805/1450995168","cluster_addr":"172.21.15.178:6810/1450995168","heartbeat_back_addr":"172.21.15.178:6815/1450995168","heartbeat_front_addr":"172.21.15.178:6813/1450995168","state":["exists","up"]},{"osd":5,"uuid":"57334a11-3b8c-481e-8e49-59a71ab4d1e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6825","nonce":2042484449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6827","nonce":2042484449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6831","nonce":2042484449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":2042484449},{"type":"v1","addr":"172.21.15.178:6829","nonce":2042484449}]},"public_addr":"172.21.15.178:6825/2042484449","cluster_addr":"172.21.15.178:6827/2042484449","heartbeat_back_addr":"172.21.15.178:6831/2042484449","heartbeat_front_addr":"172.21.15.178:6829/2042484449","state":["exists","up"]},{"osd":6,"uuid":"e338156d-44b8-487f-8b42-2e4836f87f65","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6801","nonce":3369283961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6804","nonce":3369283961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6811","nonce":3369283961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":3369283961},{"type":"v1","addr":"172.21.15.178:6807","nonce":3369283961}]},"public_addr":"172.21.15.178:6801/3369283961","cluster_addr":"172.21.15.178:6804/3369283961","heartbeat_back_addr":"172.21.15.178:6811/3369283961","heartbeat_front_addr":"172.21.15.178:6807/3369283961","state":["exists","up"]},{"osd":7,"uuid":"a84fab1f-403b-4f03-b474-0a2f131b25f4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6817","nonce":2829585854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6819","nonce":2829585854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6823","nonce":2829585854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":2829585854},{"type":"v1","addr":"172.21.15.178:6821","nonce":2829585854}]},"public_addr":"172.21.15.178:6817/2829585854","cluster_addr":"172.21.15.178:6819/2829585854","heartbeat_back_addr":"172.21.15.178:6823/2829585854","heartbeat_front_addr":"172.21.15.178:6821/2829585854","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.480995+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.558286+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.463431+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.517039+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.728772+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.793526+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.395080+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:46:59.532113+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2331750359":"2024-09-14T18:55:44.816466+0000","172.21.15.81:6837/2331750359":"2024-09-14T18:55:44.816466+0000","172.21.15.178:6835/1735589745":"2024-09-14T18:55:44.816408+0000","172.21.15.178:6833/1735589745":"2024-09-14T18:55:44.816408+0000","172.21.15.81:6836/4220647450":"2024-09-14T18:55:44.816444+0000","172.21.15.81:6834/4220647450":"2024-09-14T18:55:44.816444+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066730 msgr2=0x7f62f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066730 0x7f62f8068bf0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6304007fd0 tx=0x7f6304009040 comp rx=0 tx=0).stop 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 msgr2=0x7f631814b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 0x7f631814b7d0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f63180b1690 tx=0x7f6308004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 shutdown_connections 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f62f8066730 0x7f62f8068bf0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f631815c2a0 0x7f6318154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63180cb020 0x7f6318153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 --2- 172.21.15.81:0/992337289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f631806aaa0 0x7f631814b7d0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 >> 172.21.15.81:0/992337289 conn(0x7f63180b0c40 msgr2=0x7f63180b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 shutdown_connections 2024-09-13T18:55:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:53.484+0000 7f631d000700 1 -- 172.21.15.81:0/992337289 wait complete. 2024-09-13T18:55:54.515 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:55:54.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:54.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.688+0000 7fe892e00700 1 Processor -- start 2024-09-13T18:55:54.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.688+0000 7fe892e00700 1 -- start start 2024-09-13T18:55:54.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe892e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c06c1a0 0x7fe88c0b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe892e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c071f50 con 0x7fe88c15cfe0 2024-09-13T18:55:54.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe892e00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0b1470 con 0x7fe88c071ac0 2024-09-13T18:55:54.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe892e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cce00 con 0x7fe88c06c1a0 2024-09-13T18:55:54.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe891a00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe88c15cfe0 0x7fe88c0cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47394/0 (socket says 172.21.15.81:47394) 2024-09-13T18:55:54.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe891a00700 1 -- 172.21.15.81:0/964702725 learned_addr learned my addr 172.21.15.81:0/964702725 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:54.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.692+0000 7fe892400700 1 --2- 172.21.15.81:0/964702725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c06c1a0 0x7fe88c0b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118906985 0 0) 0x7fe878001040 con 0x7fe88c071ac0 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8740035d0 con 0x7fe88c071ac0 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246284192 0 0) 0x7fe88c071f50 con 0x7fe88c15cfe0 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe878001040 con 0x7fe88c15cfe0 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892400700 1 -- 172.21.15.81:0/964702725 >> v1:172.21.15.178:6789/0 conn(0x7fe88c071ac0 legacy=0x7fe88c06ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892400700 1 -- 172.21.15.81:0/964702725 >> v1:172.21.15.81:6789/0 conn(0x7fe88c15cfe0 legacy=0x7fe88c0cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892400700 1 -- 172.21.15.81:0/964702725 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c15d3c0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892400700 1 --2- 172.21.15.81:0/964702725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c06c1a0 0x7fe88c0b18a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe884009dc0 tx=0x7fe88400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f2a893da6877c14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400e070 con 0x7fe88c06c1a0 2024-09-13T18:55:54.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400bb20 con 0x7fe88c06c1a0 2024-09-13T18:55:54.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe88be00700 1 -- 172.21.15.81:0/964702725 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400be90 con 0x7fe88c06c1a0 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 -- 172.21.15.81:0/964702725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c06c1a0 msgr2=0x7fe88c0b18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 --2- 172.21.15.81:0/964702725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c06c1a0 0x7fe88c0b18a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe884009dc0 tx=0x7fe88400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 -- 172.21.15.81:0/964702725 shutdown_connections 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 --2- 172.21.15.81:0/964702725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c06c1a0 0x7fe88c0b18a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 -- 172.21.15.81:0/964702725 >> 172.21.15.81:0/964702725 conn(0x7fe88c0b05a0 msgr2=0x7fe88c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 -- 172.21.15.81:0/964702725 shutdown_connections 2024-09-13T18:55:54.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.696+0000 7fe892e00700 1 -- 172.21.15.81:0/964702725 wait complete. 2024-09-13T18:55:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 Processor -- start 2024-09-13T18:55:54.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 -- start start 2024-09-13T18:55:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe88c06c1a0 0x7fe88c14f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe88c071ac0 0x7fe88c157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c15cfe0 0x7fe88c159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c15ba30 con 0x7fe88c06c1a0 2024-09-13T18:55:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c15bd10 con 0x7fe88c071ac0 2024-09-13T18:55:54.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c15bff0 con 0x7fe88c15cfe0 2024-09-13T18:55:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe88c06c1a0 0x7fe88c14f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe88c06c1a0 0x7fe88c14f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33454/0 (socket says 172.21.15.81:33454) 2024-09-13T18:55:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 -- 172.21.15.81:0/2173192694 learned_addr learned my addr 172.21.15.81:0/2173192694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:54.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891000700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe88c071ac0 0x7fe88c157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe892400700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c15cfe0 0x7fe88c159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 -- 172.21.15.81:0/2173192694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c15cfe0 msgr2=0x7fe88c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe88c15cfe0 0x7fe88c159740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 -- 172.21.15.81:0/2173192694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe88c071ac0 msgr2=0x7fe88c157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe88c071ac0 0x7fe88c157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.700+0000 7fe891a00700 1 -- 172.21.15.81:0/2173192694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe884009a70 con 0x7fe88c06c1a0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe891a00700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe88c06c1a0 0x7fe88c14f0b0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c4f0 tx=0x7fe88000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880005d90 con 0x7fe88c06c1a0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8800070d0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880007440 con 0x7fe88c06c1a0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c15c2d0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c158110 con 0x7fe88c06c1a0 2024-09-13T18:55:54.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe88c070fe0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.704+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8800075a0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe889600700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe86c066730 0x7fe86c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe8800833c0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe891000700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe86c066730 0x7fe86c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe889600700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7fe86c06cb70 0x7fe86c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe86c06f680 con 0x7fe86c06cb70 2024-09-13T18:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8800859a0 con 0x7fe88c06c1a0 2024-09-13T18:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe892400700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7fe86c06cb70 0x7fe86c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe891000700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe86c066730 0x7fe86c068bf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0cc370 tx=0x7fe878009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.708+0000 7fe892400700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7fe86c06cb70 0x7fe86c06efb0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.712+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== osd.0 v2:172.21.15.81:6800/3220976985 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe86c06f680 con 0x7fe86c06cb70 2024-09-13T18:55:54.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 --> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe88c070d00 con 0x7fe86c06cb70 2024-09-13T18:55:54.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe889600700 1 -- 172.21.15.81:0/2173192694 <== osd.0 v2:172.21.15.81:6800/3220976985 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe8840098f0 con 0x7fe86c06cb70 2024-09-13T18:55:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:54.738 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:54.738 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7fe86c06cb70 msgr2=0x7fe86c06efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6800/3220976985,v1:172.21.15.81:6801/3220976985] conn(0x7fe86c06cb70 0x7fe86c06efb0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe86c066730 msgr2=0x7fe86c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe86c066730 0x7fe86c068bf0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fe88c0cc370 tx=0x7fe878009040 comp rx=0 tx=0).stop 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe88c06c1a0 msgr2=0x7fe88c14f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892e00700 1 --2- 172.21.15.81:0/2173192694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe88c06c1a0 0x7fe88c14f0b0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c4f0 tx=0x7fe88000c800 comp rx=0 tx=0).stop 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.728+0000 7fe892400700 1 -- 172.21.15.81:0/2173192694 reap_dead start 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.732+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 shutdown_connections 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.732+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 >> 172.21.15.81:0/2173192694 conn(0x7fe88c0b05a0 msgr2=0x7fe88c152070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.732+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 shutdown_connections 2024-09-13T18:55:54.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.732+0000 7fe892e00700 1 -- 172.21.15.81:0/2173192694 wait complete. 2024-09-13T18:55:54.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:55:54.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.928+0000 7f72b7000700 1 Processor -- start 2024-09-13T18:55:54.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.928+0000 7f72b7000700 1 -- start start 2024-09-13T18:55:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.928+0000 7f72b7000700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72b015e070 0x7f72b00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b7000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f72b00d10f0 0x7f72b00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b7000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00cd970 con 0x7f72b00d1540 2024-09-13T18:55:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b7000700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b015e450 con 0x7f72b015e070 2024-09-13T18:55:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b7000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00d0050 con 0x7f72b00d10f0 2024-09-13T18:55:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72b015e070 0x7f72b00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b6600700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72b00d1540 0x7f72b00b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47408/0 (socket says 172.21.15.81:47408) 2024-09-13T18:55:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b6600700 1 -- 172.21.15.81:0/3747551932 learned_addr learned my addr 172.21.15.81:0/3747551932 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5200700 1 --2- 172.21.15.81:0/3747551932 >> v2:172.21.15.178:3300/0 conn(0x7f72b00d10f0 0x7f72b00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5c00700 1 -- 172.21.15.81:0/3747551932 >> v2:172.21.15.178:3300/0 conn(0x7f72b00d10f0 msgr2=0x7f72b00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5c00700 1 --2- 172.21.15.81:0/3747551932 >> v2:172.21.15.178:3300/0 conn(0x7f72b00d10f0 0x7f72b00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5c00700 1 -- 172.21.15.81:0/3747551932 >> v1:172.21.15.81:6789/0 conn(0x7f72b00d1540 legacy=0x7f72b00b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5c00700 1 -- 172.21.15.81:0/3747551932 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00d0330 con 0x7f72b015e070 2024-09-13T18:55:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b5c00700 1 --2- 172.21.15.81:0/3747551932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b015e070 0x7f72b00cd430 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f72b00ce350 tx=0x7f72a4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394b650a2482a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72afe00700 1 -- 172.21.15.81:0/3747551932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011830 con 0x7f72b015e070 2024-09-13T18:55:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72afe00700 1 -- 172.21.15.81:0/3747551932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4011990 con 0x7f72b015e070 2024-09-13T18:55:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72afe00700 1 -- 172.21.15.81:0/3747551932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011d20 con 0x7f72b015e070 2024-09-13T18:55:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b7000700 1 -- 172.21.15.81:0/3747551932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b015e070 msgr2=0x7f72b00cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.932+0000 7f72b7000700 1 --2- 172.21.15.81:0/3747551932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b015e070 0x7f72b00cd430 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f72b00ce350 tx=0x7f72a4009b30 comp rx=0 tx=0).stop 2024-09-13T18:55:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 -- 172.21.15.81:0/3747551932 shutdown_connections 2024-09-13T18:55:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 --2- 172.21.15.81:0/3747551932 >> v2:172.21.15.178:3300/0 conn(0x7f72b00d10f0 0x7f72b00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 --2- 172.21.15.81:0/3747551932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b015e070 0x7f72b00cd430 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 -- 172.21.15.81:0/3747551932 >> 172.21.15.81:0/3747551932 conn(0x7f72b0071f00 msgr2=0x7f72b00722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 -- 172.21.15.81:0/3747551932 shutdown_connections 2024-09-13T18:55:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 -- 172.21.15.81:0/3747551932 wait complete. 2024-09-13T18:55:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 Processor -- start 2024-09-13T18:55:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.936+0000 7f72b7000700 1 -- start start 2024-09-13T18:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72b00d10f0 0x7f72b00ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 0x7f72b014aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72b015e070 0x7f72b00c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b014b410 con 0x7f72b00d1540 2024-09-13T18:55:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b014bcd0 con 0x7f72b00d10f0 2024-09-13T18:55:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00b6070 con 0x7f72b015e070 2024-09-13T18:55:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 0x7f72b014aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 0x7f72b014aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33482/0 (socket says 172.21.15.81:33482) 2024-09-13T18:55:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 -- 172.21.15.81:0/4196645589 learned_addr learned my addr 172.21.15.81:0/4196645589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5c00700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72b00d10f0 0x7f72b00ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b6600700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72b015e070 0x7f72b00c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 -- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72b015e070 msgr2=0x7f72b00c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72b015e070 0x7f72b00c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 -- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72b00d10f0 msgr2=0x7f72b00ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72b00d10f0 0x7f72b00ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 -- 172.21.15.81:0/4196645589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40094b0 con 0x7f72b00d1540 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b5200700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 0x7f72b014aed0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e870 tx=0x7f729c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0095a0 con 0x7f72b00d1540 2024-09-13T18:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c00ee70 con 0x7f72b00d1540 2024-09-13T18:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00b6350 con 0x7f72b00d1540 2024-09-13T18:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c00ca50 con 0x7f72b00d1540 2024-09-13T18:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.940+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b014b960 con 0x7f72b00d1540 2024-09-13T18:55:54.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.944+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b00cb050 con 0x7f72b00d1540 2024-09-13T18:55:54.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.944+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f729c00cbb0 con 0x7f72b00d1540 2024-09-13T18:55:54.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.948+0000 7f72ad600700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7290066730 0x7f7290068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:54.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.948+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f729c0843a0 con 0x7f72b00d1540 2024-09-13T18:55:54.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.948+0000 7f72b5c00700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7290066730 0x7f7290068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:54.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.948+0000 7f72b5c00700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7290066730 0x7f7290068bf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f72a4000c00 tx=0x7f72a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:54.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:54.956+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f729c051810 con 0x7f72b00d1540 2024-09-13T18:55:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.136+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f72b00d0bd0 con 0x7f7290066730 2024-09-13T18:55:55.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.136+0000 7f72ad600700 1 -- 172.21.15.81:0/4196645589 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72a4011c00 con 0x7f7290066730 2024-09-13T18:55:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7290066730 msgr2=0x7f7290068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7290066730 0x7f7290068bf0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f72a4000c00 tx=0x7f72a4008030 comp rx=0 tx=0).stop 2024-09-13T18:55:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 msgr2=0x7f72b014aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 0x7f72b014aed0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f729c00e870 tx=0x7f729c00ec30 comp rx=0 tx=0).stop 2024-09-13T18:55:55.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 shutdown_connections 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f7290066730 0x7f7290068bf0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72b015e070 0x7f72b00c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72b00d1540 0x7f72b014aed0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 --2- 172.21.15.81:0/4196645589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72b00d10f0 0x7f72b00ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 >> 172.21.15.81:0/4196645589 conn(0x7f72b0071f00 msgr2=0x7f72b00cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 shutdown_connections 2024-09-13T18:55:55.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.140+0000 7f72b7000700 1 -- 172.21.15.81:0/4196645589 wait complete. 2024-09-13T18:55:55.151 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:55:55.173 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:55:55.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:55.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.340+0000 7f3bb6e00700 1 Processor -- start 2024-09-13T18:55:55.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.340+0000 7f3bb6e00700 1 -- start start 2024-09-13T18:55:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb6e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bb015cfe0 0x7f3bb0071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb00ccb80 0x7f3bb00b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb6e00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb00b1470 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb6e00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb015d3c0 con 0x7f3bb015cfe0 2024-09-13T18:55:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0070a20 con 0x7f3bb00ccb80 2024-09-13T18:55:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3bb015cfe0 0x7f3bb0071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3bb00cc6f0 0x7f3bb006ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:47414/0 (socket says 172.21.15.81:47414) 2024-09-13T18:55:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5000700 1 -- 172.21.15.81:0/2078643578 learned_addr learned my addr 172.21.15.81:0/2078643578 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb6400700 1 --2- 172.21.15.81:0/2078643578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb00ccb80 0x7f3bb00b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2078643578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb00ccb80 msgr2=0x7f3bb00b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5a00700 1 --2- 172.21.15.81:0/2078643578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb00ccb80 0x7f3bb00b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2078643578 >> v1:172.21.15.81:6789/0 conn(0x7f3bb00cc6f0 legacy=0x7f3bb006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2078643578 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0070d00 con 0x7f3bb015cfe0 2024-09-13T18:55:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bb5a00700 1 --2- 172.21.15.81:0/2078643578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb015cfe0 0x7f3bb0071ac0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009850 tx=0x7f3ba4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761994e63a98bf84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bafe00700 1 -- 172.21.15.81:0/2078643578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4011830 con 0x7f3bb015cfe0 2024-09-13T18:55:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bafe00700 1 -- 172.21.15.81:0/2078643578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba4011990 con 0x7f3bb015cfe0 2024-09-13T18:55:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.344+0000 7f3bafe00700 1 -- 172.21.15.81:0/2078643578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4011d20 con 0x7f3bb015cfe0 2024-09-13T18:55:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2078643578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb015cfe0 msgr2=0x7f3bb0071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 --2- 172.21.15.81:0/2078643578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb015cfe0 0x7f3bb0071ac0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009850 tx=0x7f3ba4009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2078643578 shutdown_connections 2024-09-13T18:55:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 --2- 172.21.15.81:0/2078643578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb00ccb80 0x7f3bb00b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 --2- 172.21.15.81:0/2078643578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb015cfe0 0x7f3bb0071ac0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2078643578 >> 172.21.15.81:0/2078643578 conn(0x7f3bb00b05a0 msgr2=0x7f3bb00b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2078643578 shutdown_connections 2024-09-13T18:55:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2078643578 wait complete. 2024-09-13T18:55:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 Processor -- start 2024-09-13T18:55:55.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- start start 2024-09-13T18:55:55.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb00cc6f0 0x7f3bb01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb00ccb80 0x7f3bb00ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb015cfe0 0x7f3bb00abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb00ac250 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.348+0000 7f3bb6e00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb01443f0 con 0x7f3bb00ccb80 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb6e00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb01440c0 con 0x7f3bb015cfe0 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb00cc6f0 0x7f3bb01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb00cc6f0 0x7f3bb01573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33496/0 (socket says 172.21.15.81:33496) 2024-09-13T18:55:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2039453943 learned_addr learned my addr 172.21.15.81:0/2039453943 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2039453943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb015cfe0 msgr2=0x7f3bb00abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb015cfe0 0x7f3bb00abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2039453943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb00ccb80 msgr2=0x7f3bb00ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb00ccb80 0x7f3bb00ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 -- 172.21.15.81:0/2039453943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40094b0 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb5a00700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb00cc6f0 0x7f3bb01573d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4000c00 tx=0x7f3ba4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4004570 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba401f070 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb0157d90 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4003900 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb0158350 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.352+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bb00715a0 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ba4021030 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bad600700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b90066730 0x7f3b90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f3ba40854e0 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bb5000700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b90066730 0x7f3b90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bad600700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7f3b9006cb70 0x7f3b9006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b9006f680 con 0x7f3b9006cb70 2024-09-13T18:55:55.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ba4087ac0 con 0x7f3bb00cc6f0 2024-09-13T18:55:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bb6400700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7f3b9006cb70 0x7f3b9006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.356+0000 7f3bb5000700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b90066730 0x7f3b90068bf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3bb015c960 tx=0x7f3b9c007af0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.360+0000 7f3bb6400700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7f3b9006cb70 0x7f3b9006efb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.360+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== osd.1 v2:172.21.15.81:6824/2924937371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3b9006f680 con 0x7f3b9006cb70 2024-09-13T18:55:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.376+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 --> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3bb00712c0 con 0x7f3b9006cb70 2024-09-13T18:55:55.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.376+0000 7f3bad600700 1 -- 172.21.15.81:0/2039453943 <== osd.1 v2:172.21.15.81:6824/2924937371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3ba8009ad0 con 0x7f3b9006cb70 2024-09-13T18:55:55.386 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:55.386 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:55.386 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.376+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7f3b9006cb70 msgr2=0x7f3b9006efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.376+0000 7f3bb6e00700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6824/2924937371,v1:172.21.15.81:6825/2924937371] conn(0x7f3b9006cb70 0x7f3b9006efb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b90066730 msgr2=0x7f3b90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f3b90066730 0x7f3b90068bf0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3bb015c960 tx=0x7f3b9c007af0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb00cc6f0 msgr2=0x7f3bb01573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 --2- 172.21.15.81:0/2039453943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bb00cc6f0 0x7f3bb01573d0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4000c00 tx=0x7f3ba4004770 comp rx=0 tx=0).stop 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6400700 1 -- 172.21.15.81:0/2039453943 reap_dead start 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 shutdown_connections 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 >> 172.21.15.81:0/2039453943 conn(0x7f3bb00b05a0 msgr2=0x7f3bb00af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 shutdown_connections 2024-09-13T18:55:55.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.380+0000 7f3bb6e00700 1 -- 172.21.15.81:0/2039453943 wait complete. 2024-09-13T18:55:55.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:55:55.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 Processor -- start 2024-09-13T18:55:55.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 -- start start 2024-09-13T18:55:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f755c0b2670 0x7f755c0b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0b3040 con 0x7f755c1610b0 2024-09-13T18:55:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c070b30 con 0x7f755c0b2670 2024-09-13T18:55:55.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.580+0000 7f755b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c0b3560 con 0x7f755c06aaa0 2024-09-13T18:55:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559400700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755a800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f755c0b2670 0x7f755c0b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755a800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f755c0b2670 0x7f755c0b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:53206/0 (socket says 172.21.15.81:53206) 2024-09-13T18:55:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755a800700 1 -- 172.21.15.81:0/3910772613 learned_addr learned my addr 172.21.15.81:0/3910772613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:55.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559e00700 1 --1- 172.21.15.81:0/3910772613 >> v1:172.21.15.178:6789/0 conn(0x7f755c1610b0 0x7f755c0719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:57170/0 (socket says 172.21.15.81:57170) 2024-09-13T18:55:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559400700 1 -- 172.21.15.81:0/3910772613 >> v2:172.21.15.178:3300/0 conn(0x7f755c0b2670 msgr2=0x7f755c0b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559400700 1 --2- 172.21.15.81:0/3910772613 >> v2:172.21.15.178:3300/0 conn(0x7f755c0b2670 0x7f755c0b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559400700 1 -- 172.21.15.81:0/3910772613 >> v1:172.21.15.178:6789/0 conn(0x7f755c1610b0 legacy=0x7f755c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559400700 1 -- 172.21.15.81:0/3910772613 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c06b420 con 0x7f755c06aaa0 2024-09-13T18:55:55.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7558a00700 1 -- 172.21.15.81:0/3910772613 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636636545 0 0) 0x7f754c001110 con 0x7f755c1610b0 2024-09-13T18:55:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7559400700 1 --2- 172.21.15.81:0/3910772613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c06aee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7548009850 tx=0x7f7548009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a398055c14b25597 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7558a00700 1 -- 172.21.15.81:0/3910772613 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548011830 con 0x7f755c06aaa0 2024-09-13T18:55:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7558a00700 1 -- 172.21.15.81:0/3910772613 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548011990 con 0x7f755c06aaa0 2024-09-13T18:55:55.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f7558a00700 1 -- 172.21.15.81:0/3910772613 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548011d40 con 0x7f755c06aaa0 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 -- 172.21.15.81:0/3910772613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 msgr2=0x7f755c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 --2- 172.21.15.81:0/3910772613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c06aee0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7548009850 tx=0x7f7548009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 -- 172.21.15.81:0/3910772613 shutdown_connections 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 --2- 172.21.15.81:0/3910772613 >> v2:172.21.15.178:3300/0 conn(0x7f755c0b2670 0x7f755c0b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 --2- 172.21.15.81:0/3910772613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c06aee0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 -- 172.21.15.81:0/3910772613 >> 172.21.15.81:0/3910772613 conn(0x7f755c0b0c40 msgr2=0x7f755c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:55.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.584+0000 7f755b200700 1 -- 172.21.15.81:0/3910772613 shutdown_connections 2024-09-13T18:55:55.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 -- 172.21.15.81:0/3910772613 wait complete. 2024-09-13T18:55:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 Processor -- start 2024-09-13T18:55:55.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 -- start start 2024-09-13T18:55:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c0a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 0x7f755c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c1610b0 0x7f755c1f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1583a0 con 0x7f755c0b2670 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1fa9b0 con 0x7f755c1610b0 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755b200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1fac90 con 0x7f755c06aaa0 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f7559400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 0x7f755c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f7559400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 0x7f755c1579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33512/0 (socket says 172.21.15.81:33512) 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f7559400700 1 -- 172.21.15.81:0/451214507 learned_addr learned my addr 172.21.15.81:0/451214507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f755a800700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c1610b0 0x7f755c1f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.588+0000 7f7559e00700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c0a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7559400700 1 -- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 msgr2=0x7f755c0a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7559400700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c0a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7559400700 1 -- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c1610b0 msgr2=0x7f755c1f9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7559400700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c1610b0 0x7f755c1f9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7559400700 1 -- 172.21.15.81:0/451214507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480094b0 con 0x7f755c0b2670 2024-09-13T18:55:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7559400700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 0x7f755c1579d0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f7548000c00 tx=0x7f7548004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754801a990 con 0x7f755c0b2670 2024-09-13T18:55:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754801f070 con 0x7f755c0b2670 2024-09-13T18:55:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754801ad30 con 0x7f755c0b2670 2024-09-13T18:55:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c1585b0 con 0x7f755c0b2670 2024-09-13T18:55:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c15a590 con 0x7f755c0b2670 2024-09-13T18:55:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.592+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c1faea0 con 0x7f755c0b2670 2024-09-13T18:55:55.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.596+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f754801b430 con 0x7f755c0b2670 2024-09-13T18:55:55.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.596+0000 7f7552000700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f753c066730 0x7f753c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.596+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7548084fe0 con 0x7f755c0b2670 2024-09-13T18:55:55.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.596+0000 7f7559e00700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f753c066730 0x7f753c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.596+0000 7f7559e00700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f753c066730 0x7f753c068bf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f754c000f60 tx=0x7f754c007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.604+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f755c1faea0 con 0x7f755c0b2670 2024-09-13T18:55:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.784+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f755c0711c0 con 0x7f753c066730 2024-09-13T18:55:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.784+0000 7f7552000700 1 -- 172.21.15.81:0/451214507 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f754c0133f0 con 0x7f753c066730 2024-09-13T18:55:55.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f753c066730 msgr2=0x7f753c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f753c066730 0x7f753c068bf0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f754c000f60 tx=0x7f754c007e90 comp rx=0 tx=0).stop 2024-09-13T18:55:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 msgr2=0x7f755c1579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 0x7f755c1579d0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f7548000c00 tx=0x7f7548004770 comp rx=0 tx=0).stop 2024-09-13T18:55:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 shutdown_connections 2024-09-13T18:55:55.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f753c066730 0x7f753c068bf0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f755c1610b0 0x7f755c1f9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f755c0b2670 0x7f755c1579d0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 --2- 172.21.15.81:0/451214507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f755c06aaa0 0x7f755c0a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 >> 172.21.15.81:0/451214507 conn(0x7f755c0b0c40 msgr2=0x7f755c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 shutdown_connections 2024-09-13T18:55:55.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.788+0000 7f755b200700 1 -- 172.21.15.81:0/451214507 wait complete. 2024-09-13T18:55:55.797 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:55:55.820 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:55:55.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 Processor -- start 2024-09-13T18:55:55.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 -- start start 2024-09-13T18:55:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f56a80b22b0 0x7f56a8161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56a8162180 0x7f56a816aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a80cc6f0 con 0x7f56a8161860 2024-09-13T18:55:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a815f060 con 0x7f56a8162180 2024-09-13T18:55:55.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56aca00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a806c210 con 0x7f56a80b22b0 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56a8162180 0x7f56a816aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f56a8162180 0x7f56a816aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33520/0 (socket says 172.21.15.81:33520) 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 -- 172.21.15.81:0/1976811617 learned_addr learned my addr 172.21.15.81:0/1976811617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a5e00700 1 --2- 172.21.15.81:0/1976811617 >> v2:172.21.15.178:3300/0 conn(0x7f56a80b22b0 0x7f56a8161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 -- 172.21.15.81:0/1976811617 >> v2:172.21.15.178:3300/0 conn(0x7f56a80b22b0 msgr2=0x7f56a8161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 --2- 172.21.15.81:0/1976811617 >> v2:172.21.15.178:3300/0 conn(0x7f56a80b22b0 0x7f56a8161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 -- 172.21.15.81:0/1976811617 >> v1:172.21.15.178:6789/0 conn(0x7f56a8161860 legacy=0x7f56a806bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.984+0000 7f56a7200700 1 -- 172.21.15.81:0/1976811617 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a80b2740 con 0x7f56a8162180 2024-09-13T18:55:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56a7200700 1 --2- 172.21.15.81:0/1976811617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8162180 0x7f56a816aba0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f56a80ae4e0 tx=0x7f56a0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6a9f11e63bb44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56a5400700 1 -- 172.21.15.81:0/1976811617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0004230 con 0x7f56a8162180 2024-09-13T18:55:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56a5400700 1 -- 172.21.15.81:0/1976811617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a0004390 con 0x7f56a8162180 2024-09-13T18:55:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56a5400700 1 -- 172.21.15.81:0/1976811617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a00036c0 con 0x7f56a8162180 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 -- 172.21.15.81:0/1976811617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8162180 msgr2=0x7f56a816aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 --2- 172.21.15.81:0/1976811617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8162180 0x7f56a816aba0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f56a80ae4e0 tx=0x7f56a0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 -- 172.21.15.81:0/1976811617 shutdown_connections 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 --2- 172.21.15.81:0/1976811617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8162180 0x7f56a816aba0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 --2- 172.21.15.81:0/1976811617 >> v2:172.21.15.178:3300/0 conn(0x7f56a80b22b0 0x7f56a8161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 -- 172.21.15.81:0/1976811617 >> 172.21.15.81:0/1976811617 conn(0x7f56a80b05a0 msgr2=0x7f56a80b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:55.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 -- 172.21.15.81:0/1976811617 shutdown_connections 2024-09-13T18:55:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.988+0000 7f56aca00700 1 -- 172.21.15.81:0/1976811617 wait complete. 2024-09-13T18:55:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 Processor -- start 2024-09-13T18:55:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 -- start start 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56a8161860 0x7f56a8152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56a8162180 0x7f56a8144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8151790 0x7f56a8144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8142400 con 0x7f56a8151790 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8152790 con 0x7f56a8162180 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56aca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8145290 con 0x7f56a8161860 2024-09-13T18:55:56.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.992+0000 7f56a7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8151790 0x7f56a8144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8151790 0x7f56a8144c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33532/0 (socket says 172.21.15.81:33532) 2024-09-13T18:55:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 -- 172.21.15.81:0/1106713564 learned_addr learned my addr 172.21.15.81:0/1106713564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a5e00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56a8162180 0x7f56a8144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a6800700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56a8161860 0x7f56a8152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 -- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56a8161860 msgr2=0x7f56a8152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56a8161860 0x7f56a8152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 -- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56a8162180 msgr2=0x7f56a8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56a8162180 0x7f56a8144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 -- 172.21.15.81:0/1106713564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0009570 con 0x7f56a8151790 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a6800700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56a8161860 0x7f56a8152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:56.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56a7200700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8151790 0x7f56a8144c60 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f56a0004000 tx=0x7f56a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000b660 con 0x7f56a8151790 2024-09-13T18:55:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a8145570 con 0x7f56a8151790 2024-09-13T18:55:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a8152420 con 0x7f56a8151790 2024-09-13T18:55:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000b7e0 con 0x7f56a8151790 2024-09-13T18:55:56.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000bb90 con 0x7f56a8151790 2024-09-13T18:55:56.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:55.996+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5680000fc0 con 0x7f56a8151790 2024-09-13T18:55:56.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56a000bcf0 con 0x7f56a8151790 2024-09-13T18:55:56.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f569ea00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5688066730 0x7f5688068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f56a0085a00 con 0x7f56a8151790 2024-09-13T18:55:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f569ea00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f568806cb70 0x7f568806efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 --> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f568806f680 con 0x7f568806cb70 2024-09-13T18:55:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56a0085e50 con 0x7f56a8151790 2024-09-13T18:55:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f56a6800700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5688066730 0x7f5688068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f56a5e00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f568806cb70 0x7f568806efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f56a6800700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5688066730 0x7f5688068bf0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f56a815ae00 tx=0x7f5698009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.000+0000 7f56a5e00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f568806cb70 0x7f568806efb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.004+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== osd.2 v2:172.21.15.81:6808/533641915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f568806f680 con 0x7f568806cb70 2024-09-13T18:55:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.020+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 --> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5680002d80 con 0x7f568806cb70 2024-09-13T18:55:56.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.020+0000 7f569ea00700 1 -- 172.21.15.81:0/1106713564 <== osd.2 v2:172.21.15.81:6808/533641915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5680002d80 con 0x7f568806cb70 2024-09-13T18:55:56.030 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:56.030 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:56.030 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f568806cb70 msgr2=0x7f568806efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6808/533641915,v1:172.21.15.81:6809/533641915] conn(0x7f568806cb70 0x7f568806efb0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5688066730 msgr2=0x7f5688068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5688066730 0x7f5688068bf0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f56a815ae00 tx=0x7f5698009040 comp rx=0 tx=0).stop 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8151790 msgr2=0x7f56a8144c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 --2- 172.21.15.81:0/1106713564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56a8151790 0x7f56a8144c60 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f56a0004000 tx=0x7f56a0004770 comp rx=0 tx=0).stop 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56a7200700 1 -- 172.21.15.81:0/1106713564 reap_dead start 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 shutdown_connections 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 >> 172.21.15.81:0/1106713564 conn(0x7f56a80b05a0 msgr2=0x7f56a80cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 shutdown_connections 2024-09-13T18:55:56.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.024+0000 7f56aca00700 1 -- 172.21.15.81:0/1106713564 wait complete. 2024-09-13T18:55:56.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:55:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.216+0000 7f9322c00700 1 Processor -- start 2024-09-13T18:55:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.216+0000 7f9322c00700 1 -- start start 2024-09-13T18:55:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322c00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f931c06aaa0 0x7f931c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c0b3980 0x7f931c06ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322c00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f931c06cbb0 0x7f931c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322c00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c0adf90 con 0x7f931c06cbb0 2024-09-13T18:55:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322c00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f931c15e560 con 0x7f931c06aaa0 2024-09-13T18:55:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c06b3c0 con 0x7f931c0b3980 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f931c06cbb0 0x7f931c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f931c06cbb0 0x7f931c06d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33546/0 (socket says 172.21.15.81:33546) 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 -- 172.21.15.81:0/934099873 learned_addr learned my addr 172.21.15.81:0/934099873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9320e00700 1 --2- 172.21.15.81:0/934099873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c0b3980 0x7f931c06ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9321800700 1 --2- 172.21.15.81:0/934099873 >> v2:172.21.15.178:3300/0 conn(0x7f931c06aaa0 0x7f931c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 -- 172.21.15.81:0/934099873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c0b3980 msgr2=0x7f931c06ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 --2- 172.21.15.81:0/934099873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c0b3980 0x7f931c06ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 -- 172.21.15.81:0/934099873 >> v2:172.21.15.178:3300/0 conn(0x7f931c06aaa0 msgr2=0x7f931c15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 --2- 172.21.15.81:0/934099873 >> v2:172.21.15.178:3300/0 conn(0x7f931c06aaa0 0x7f931c15d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 -- 172.21.15.81:0/934099873 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c15d920 con 0x7f931c06cbb0 2024-09-13T18:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9321800700 1 --2- 172.21.15.81:0/934099873 >> v2:172.21.15.178:3300/0 conn(0x7f931c06aaa0 0x7f931c15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:56.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f9322200700 1 --2- 172.21.15.81:0/934099873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c06cbb0 0x7f931c06d060 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f931c0ad490 tx=0x7f931400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb650ecc21fcd5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.220+0000 7f931be00700 1 -- 172.21.15.81:0/934099873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400e070 con 0x7f931c06cbb0 2024-09-13T18:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f931be00700 1 -- 172.21.15.81:0/934099873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931400b910 con 0x7f931c06cbb0 2024-09-13T18:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f931be00700 1 -- 172.21.15.81:0/934099873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931400bcc0 con 0x7f931c06cbb0 2024-09-13T18:55:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 -- 172.21.15.81:0/934099873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c06cbb0 msgr2=0x7f931c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 --2- 172.21.15.81:0/934099873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c06cbb0 0x7f931c06d060 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f931c0ad490 tx=0x7f931400b330 comp rx=0 tx=0).stop 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 -- 172.21.15.81:0/934099873 shutdown_connections 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 --2- 172.21.15.81:0/934099873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c06cbb0 0x7f931c06d060 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 --2- 172.21.15.81:0/934099873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c0b3980 0x7f931c06ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 --2- 172.21.15.81:0/934099873 >> v2:172.21.15.178:3300/0 conn(0x7f931c06aaa0 0x7f931c15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 -- 172.21.15.81:0/934099873 >> 172.21.15.81:0/934099873 conn(0x7f931c0b0c40 msgr2=0x7f931c06a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 -- 172.21.15.81:0/934099873 shutdown_connections 2024-09-13T18:55:56.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 -- 172.21.15.81:0/934099873 wait complete. 2024-09-13T18:55:56.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 Processor -- start 2024-09-13T18:55:56.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.224+0000 7f9322c00700 1 -- start start 2024-09-13T18:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c06aaa0 0x7f931c140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f931c06cbb0 0x7f931c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 0x7f931c140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0cab00 con 0x7f931c0b3980 2024-09-13T18:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f931c1406a0 con 0x7f931c06cbb0 2024-09-13T18:55:56.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f931c0cb0e0 con 0x7f931c06aaa0 2024-09-13T18:55:56.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 0x7f931c140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 0x7f931c140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33562/0 (socket says 172.21.15.81:33562) 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 -- 172.21.15.81:0/2076343288 learned_addr learned my addr 172.21.15.81:0/2076343288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9320e00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f931c06cbb0 0x7f931c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9321800700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c06aaa0 0x7f931c140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 -- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c06aaa0 msgr2=0x7f931c140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c06aaa0 0x7f931c140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 -- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f931c06cbb0 msgr2=0x7f931c0cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f931c06cbb0 0x7f931c0cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 -- 172.21.15.81:0/2076343288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9314009b30 con 0x7f931c0b3980 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9320e00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f931c06cbb0 0x7f931c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322200700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 0x7f931c140f20 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f931c0b1690 tx=0x7f9314004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93140099b0 con 0x7f931c0b3980 2024-09-13T18:55:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9314004250 con 0x7f931c0b3980 2024-09-13T18:55:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931c0cb3c0 con 0x7f931c0b3980 2024-09-13T18:55:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314004600 con 0x7f931c0b3980 2024-09-13T18:55:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.228+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f931c0cb980 con 0x7f931c0b3980 2024-09-13T18:55:56.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.232+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f931c143540 con 0x7f931c0b3980 2024-09-13T18:55:56.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.232+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9314004760 con 0x7f931c0b3980 2024-09-13T18:55:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.232+0000 7f9319600700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9300066760 0x7f9300068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.236+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f93140854f0 con 0x7f931c0b3980 2024-09-13T18:55:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.236+0000 7f9321800700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9300066760 0x7f9300068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.236+0000 7f9321800700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9300066760 0x7f9300068c20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f931c15d820 tx=0x7f9310008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.240+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9314052990 con 0x7f931c0b3980 2024-09-13T18:55:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.424+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f931c0cb250 con 0x7f9300066760 2024-09-13T18:55:56.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.424+0000 7f9319600700 1 -- 172.21.15.81:0/2076343288 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f931c0cb250 con 0x7f9300066760 2024-09-13T18:55:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.424+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9300066760 msgr2=0x7f9300068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.424+0000 7f9322c00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9300066760 0x7f9300068c20 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f931c15d820 tx=0x7f9310008040 comp rx=0 tx=0).stop 2024-09-13T18:55:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.424+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 msgr2=0x7f931c140f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.424+0000 7f9322c00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 0x7f931c140f20 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f931c0b1690 tx=0x7f9314004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 shutdown_connections 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f9300066760 0x7f9300068c20 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c0b3980 0x7f931c140f20 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f931c06cbb0 0x7f931c0cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 --2- 172.21.15.81:0/2076343288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f931c06aaa0 0x7f931c140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 >> 172.21.15.81:0/2076343288 conn(0x7f931c0b0c40 msgr2=0x7f931c06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 shutdown_connections 2024-09-13T18:55:56.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.428+0000 7f9322c00700 1 -- 172.21.15.81:0/2076343288 wait complete. 2024-09-13T18:55:56.436 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:55:56.454 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:55:56.454 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.632+0000 7efe66800700 1 Processor -- start 2024-09-13T18:55:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.632+0000 7efe66800700 1 -- start start 2024-09-13T18:55:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe6015ca20 0x7efe60160780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe60160cc0 0x7efe600b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe60161720 con 0x7efe6015ce00 2024-09-13T18:55:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe60161160 con 0x7efe6015ca20 2024-09-13T18:55:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe60161440 con 0x7efe60160cc0 2024-09-13T18:55:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe6015ca20 0x7efe60160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efe6015ca20 0x7efe60160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60146/0 (socket says 172.21.15.81:60146) 2024-09-13T18:55:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 -- 172.21.15.81:0/2163115252 learned_addr learned my addr 172.21.15.81:0/2163115252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe64a00700 1 --2- 172.21.15.81:0/2163115252 >> v2:172.21.15.178:3300/0 conn(0x7efe60160cc0 0x7efe600b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 -- 172.21.15.81:0/2163115252 >> v2:172.21.15.178:3300/0 conn(0x7efe60160cc0 msgr2=0x7efe600b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 --2- 172.21.15.81:0/2163115252 >> v2:172.21.15.178:3300/0 conn(0x7efe60160cc0 0x7efe600b26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 -- 172.21.15.81:0/2163115252 >> v1:172.21.15.178:6789/0 conn(0x7efe6015ce00 legacy=0x7efe600710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 -- 172.21.15.81:0/2163115252 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600b1ea0 con 0x7efe6015ca20 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe64a00700 1 --2- 172.21.15.81:0/2163115252 >> v2:172.21.15.178:3300/0 conn(0x7efe60160cc0 0x7efe600b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe65400700 1 --2- 172.21.15.81:0/2163115252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ca20 0x7efe60160780 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7efe600b1610 tx=0x7efe54009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f04605b74cb99f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe5fe00700 1 -- 172.21.15.81:0/2163115252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54004230 con 0x7efe6015ca20 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe5fe00700 1 -- 172.21.15.81:0/2163115252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54004390 con 0x7efe6015ca20 2024-09-13T18:55:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe5fe00700 1 -- 172.21.15.81:0/2163115252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe540036c0 con 0x7efe6015ca20 2024-09-13T18:55:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 -- 172.21.15.81:0/2163115252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ca20 msgr2=0x7efe60160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 --2- 172.21.15.81:0/2163115252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ca20 0x7efe60160780 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7efe600b1610 tx=0x7efe54009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 -- 172.21.15.81:0/2163115252 shutdown_connections 2024-09-13T18:55:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 --2- 172.21.15.81:0/2163115252 >> v2:172.21.15.178:3300/0 conn(0x7efe60160cc0 0x7efe600b26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 --2- 172.21.15.81:0/2163115252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ca20 0x7efe60160780 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.636+0000 7efe66800700 1 -- 172.21.15.81:0/2163115252 >> 172.21.15.81:0/2163115252 conn(0x7efe6006a9c0 msgr2=0x7efe600b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.640+0000 7efe66800700 1 -- 172.21.15.81:0/2163115252 shutdown_connections 2024-09-13T18:55:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.640+0000 7efe66800700 1 -- 172.21.15.81:0/2163115252 wait complete. 2024-09-13T18:55:56.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.640+0000 7efe66800700 1 Processor -- start 2024-09-13T18:55:56.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.640+0000 7efe66800700 1 -- start start 2024-09-13T18:55:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe6015ca20 0x7efe6015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ce00 0x7efe60143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe60160cc0 0x7efe6015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015b920 con 0x7efe6015ce00 2024-09-13T18:55:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015aca0 con 0x7efe60160cc0 2024-09-13T18:55:56.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015af80 con 0x7efe6015ca20 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ce00 0x7efe60143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ce00 0x7efe60143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60160/0 (socket says 172.21.15.81:60160) 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 -- 172.21.15.81:0/3576922914 learned_addr learned my addr 172.21.15.81:0/3576922914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe65400700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe6015ca20 0x7efe6015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe65e00700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe60160cc0 0x7efe6015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 -- 172.21.15.81:0/3576922914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe6015ca20 msgr2=0x7efe6015bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe6015ca20 0x7efe6015bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 -- 172.21.15.81:0/3576922914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe60160cc0 msgr2=0x7efe6015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe60160cc0 0x7efe6015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 -- 172.21.15.81:0/3576922914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009570 con 0x7efe6015ce00 2024-09-13T18:55:56.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe64a00700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ce00 0x7efe60143750 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c7c0 tx=0x7efe4c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c011800 con 0x7efe6015ce00 2024-09-13T18:55:56.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c011960 con 0x7efe6015ce00 2024-09-13T18:55:56.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c011cf0 con 0x7efe6015ce00 2024-09-13T18:55:56.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6015b260 con 0x7efe6015ce00 2024-09-13T18:55:56.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe60143c90 con 0x7efe6015ce00 2024-09-13T18:55:56.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.644+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe600717b0 con 0x7efe6015ce00 2024-09-13T18:55:56.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe4c021350 con 0x7efe6015ce00 2024-09-13T18:55:56.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe5d600700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe40066760 0x7efe40068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7efe4c083ea0 con 0x7efe6015ce00 2024-09-13T18:55:56.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe5d600700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7efe4006cba0 0x7efe4006efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 --> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe4006f6b0 con 0x7efe4006cba0 2024-09-13T18:55:56.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe4c086560 con 0x7efe6015ce00 2024-09-13T18:55:56.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe65400700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe40066760 0x7efe40068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe65e00700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7efe4006cba0 0x7efe4006efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe65400700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe40066760 0x7efe40068c20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7efe600b1610 tx=0x7efe54008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.648+0000 7efe65e00700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7efe4006cba0 0x7efe4006efe0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.652+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== osd.3 v2:172.21.15.81:6816/3484646797 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efe4006f6b0 con 0x7efe4006cba0 2024-09-13T18:55:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.668+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 --> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efe600677c0 con 0x7efe4006cba0 2024-09-13T18:55:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.668+0000 7efe5d600700 1 -- 172.21.15.81:0/3576922914 <== osd.3 v2:172.21.15.81:6816/3484646797 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efe600677c0 con 0x7efe4006cba0 2024-09-13T18:55:56.678 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:56.679 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:56.679 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7efe4006cba0 msgr2=0x7efe4006efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6816/3484646797,v1:172.21.15.81:6817/3484646797] conn(0x7efe4006cba0 0x7efe4006efe0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe40066760 msgr2=0x7efe40068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7efe40066760 0x7efe40068c20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7efe600b1610 tx=0x7efe54008030 comp rx=0 tx=0).stop 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ce00 msgr2=0x7efe60143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 --2- 172.21.15.81:0/3576922914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe6015ce00 0x7efe60143750 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00c7c0 tx=0x7efe4c00cad0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe65e00700 1 -- 172.21.15.81:0/3576922914 reap_dead start 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 shutdown_connections 2024-09-13T18:55:56.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 >> 172.21.15.81:0/3576922914 conn(0x7efe6006a9c0 msgr2=0x7efe600ac220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:56.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 shutdown_connections 2024-09-13T18:55:56.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.672+0000 7efe66800700 1 -- 172.21.15.81:0/3576922914 wait complete. 2024-09-13T18:55:56.705 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:55:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.872+0000 7f72c5200700 1 Processor -- start 2024-09-13T18:55:56.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.872+0000 7f72c5200700 1 -- start start 2024-09-13T18:55:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72c5200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72c00cb200 0x7f72c00ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72c5200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00ccfd0 0x7f72c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72c5200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c0071150 con 0x7f72c00cb5e0 2024-09-13T18:55:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72c5200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c00ceb20 con 0x7f72c00cb200 2024-09-13T18:55:56.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72c5200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00cd540 con 0x7f72c00ccfd0 2024-09-13T18:55:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72bf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f72c00cb200 0x7f72c00ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72bfe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f72c00cb5e0 0x7f72c00704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60136/0 (socket says 172.21.15.81:60136) 2024-09-13T18:55:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72bfe00700 1 -- 172.21.15.81:0/1716218833 learned_addr learned my addr 172.21.15.81:0/1716218833 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:56.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.876+0000 7f72bea00700 1 --2- 172.21.15.81:0/1716218833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00ccfd0 0x7f72c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72bf400700 1 -- 172.21.15.81:0/1716218833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00ccfd0 msgr2=0x7f72c006d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:56.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72bf400700 1 --2- 172.21.15.81:0/1716218833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00ccfd0 0x7f72c006d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72bf400700 1 -- 172.21.15.81:0/1716218833 >> v1:172.21.15.81:6789/0 conn(0x7f72c00cb5e0 legacy=0x7f72c00704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72be000700 1 -- 172.21.15.81:0/1716218833 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573294099 0 0) 0x7f72c0071150 con 0x7f72c00cb5e0 2024-09-13T18:55:56.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72bf400700 1 -- 172.21.15.81:0/1716218833 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00cd820 con 0x7f72c00cb200 2024-09-13T18:55:56.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72bf400700 1 --2- 172.21.15.81:0/1716218833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb200 0x7f72c00ce5e0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009850 tx=0x7f72b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0221b2e3dc716be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72be000700 1 -- 172.21.15.81:0/1716218833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0011830 con 0x7f72c00cb200 2024-09-13T18:55:56.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72be000700 1 -- 172.21.15.81:0/1716218833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0011990 con 0x7f72c00cb200 2024-09-13T18:55:56.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72be000700 1 -- 172.21.15.81:0/1716218833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0011d40 con 0x7f72c00cb200 2024-09-13T18:55:56.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 -- 172.21.15.81:0/1716218833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb200 msgr2=0x7f72c00ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 --2- 172.21.15.81:0/1716218833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb200 0x7f72c00ce5e0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009850 tx=0x7f72b0009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:56.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 -- 172.21.15.81:0/1716218833 shutdown_connections 2024-09-13T18:55:56.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 --2- 172.21.15.81:0/1716218833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00ccfd0 0x7f72c006d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 --2- 172.21.15.81:0/1716218833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb200 0x7f72c00ce5e0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 -- 172.21.15.81:0/1716218833 >> 172.21.15.81:0/1716218833 conn(0x7f72c00cf0d0 msgr2=0x7f72c00cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 -- 172.21.15.81:0/1716218833 shutdown_connections 2024-09-13T18:55:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.880+0000 7f72c5200700 1 -- 172.21.15.81:0/1716218833 wait complete. 2024-09-13T18:55:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 Processor -- start 2024-09-13T18:55:56.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 -- start start 2024-09-13T18:55:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00cb200 0x7f72c015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 0x7f72c00c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c00ccfd0 0x7f72c00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c8150 con 0x7f72c00cb5e0 2024-09-13T18:55:56.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c4530 con 0x7f72c00ccfd0 2024-09-13T18:55:56.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72c5200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c4810 con 0x7f72c00cb200 2024-09-13T18:55:56.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 0x7f72c00c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72bea00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 0x7f72c00c8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60182/0 (socket says 172.21.15.81:60182) 2024-09-13T18:55:56.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.884+0000 7f72bea00700 1 -- 172.21.15.81:0/4293534833 learned_addr learned my addr 172.21.15.81:0/4293534833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:56.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bf400700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00cb200 0x7f72c015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bfe00700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c00ccfd0 0x7f72c00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bea00700 1 -- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00cb200 msgr2=0x7f72c015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bea00700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00cb200 0x7f72c015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bea00700 1 -- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c00ccfd0 msgr2=0x7f72c00b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:56.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bea00700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c00ccfd0 0x7f72c00b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bea00700 1 -- 172.21.15.81:0/4293534833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094b0 con 0x7f72c00cb5e0 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72bea00700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 0x7f72c00c8930 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00e9d0 tx=0x7f72ac00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac009720 con 0x7f72c00cb5e0 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00ee70 con 0x7f72c00cb5e0 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00ca50 con 0x7f72c00cb5e0 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c00c4af0 con 0x7f72c00cb5e0 2024-09-13T18:55:56.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00c50b0 con 0x7f72c00cb5e0 2024-09-13T18:55:56.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.888+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c006b0a0 con 0x7f72c00cb5e0 2024-09-13T18:55:56.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.892+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72ac00cbb0 con 0x7f72c00cb5e0 2024-09-13T18:55:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.892+0000 7f72b7400700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72a0066760 0x7f72a0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.892+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f72ac084140 con 0x7f72c00cb5e0 2024-09-13T18:55:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.892+0000 7f72bf400700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72a0066760 0x7f72a0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:56.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.896+0000 7f72bf400700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72a0066760 0x7f72a0068c20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f72b00090b0 tx=0x7f72b001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:56.900+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72ac051520 con 0x7f72c00cb5e0 2024-09-13T18:55:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f72c00ce0c0 con 0x7f72a0066760 2024-09-13T18:55:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72b7400700 1 -- 172.21.15.81:0/4293534833 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72b0011b80 con 0x7f72a0066760 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72a0066760 msgr2=0x7f72a0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72a0066760 0x7f72a0068c20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f72b00090b0 tx=0x7f72b001c040 comp rx=0 tx=0).stop 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 msgr2=0x7f72c00c8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 0x7f72c00c8930 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00e9d0 tx=0x7f72ac00ece0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 shutdown_connections 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f72a0066760 0x7f72a0068c20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72c00ccfd0 0x7f72c00b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72c00cb5e0 0x7f72c00c8930 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 --2- 172.21.15.81:0/4293534833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72c00cb200 0x7f72c015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.084+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 >> 172.21.15.81:0/4293534833 conn(0x7f72c00cf0d0 msgr2=0x7f72c006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.088+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 shutdown_connections 2024-09-13T18:55:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.088+0000 7f72c5200700 1 -- 172.21.15.81:0/4293534833 wait complete. 2024-09-13T18:55:57.097 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:55:57.114 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:55:57.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 Processor -- start 2024-09-13T18:55:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 -- start start 2024-09-13T18:55:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ba8144330 0x7f5ba80cef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144710 0x7f5ba80b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba806bcf0 con 0x7f5ba806d760 2024-09-13T18:55:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80cce10 con 0x7f5ba8144330 2024-09-13T18:55:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5baca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba806cb50 con 0x7f5ba8144710 2024-09-13T18:55:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5ba5e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5ba8144330 0x7f5ba80cef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5ba5400700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5ba806d760 0x7f5ba80b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60152/0 (socket says 172.21.15.81:60152) 2024-09-13T18:55:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5ba5400700 1 -- 172.21.15.81:0/2658570234 learned_addr learned my addr 172.21.15.81:0/2658570234 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.280+0000 7f5ba6800700 1 --2- 172.21.15.81:0/2658570234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144710 0x7f5ba80b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba5e00700 1 -- 172.21.15.81:0/2658570234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144710 msgr2=0x7f5ba80b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba5e00700 1 --2- 172.21.15.81:0/2658570234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144710 0x7f5ba80b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba5e00700 1 -- 172.21.15.81:0/2658570234 >> v1:172.21.15.81:6789/0 conn(0x7f5ba806d760 legacy=0x7f5ba80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba5e00700 1 -- 172.21.15.81:0/2658570234 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80cf4b0 con 0x7f5ba8144330 2024-09-13T18:55:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba5e00700 1 --2- 172.21.15.81:0/2658570234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba8144330 0x7f5ba80cef70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009d90 tx=0x7f5b9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42543d5447ef441 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba4a00700 1 -- 172.21.15.81:0/2658570234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9800e070 con 0x7f5ba8144330 2024-09-13T18:55:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba4a00700 1 -- 172.21.15.81:0/2658570234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9800bb20 con 0x7f5ba8144330 2024-09-13T18:55:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5ba4a00700 1 -- 172.21.15.81:0/2658570234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98012430 con 0x7f5ba8144330 2024-09-13T18:55:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 -- 172.21.15.81:0/2658570234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba8144330 msgr2=0x7f5ba80cef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 --2- 172.21.15.81:0/2658570234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba8144330 0x7f5ba80cef70 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009d90 tx=0x7f5b9800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 -- 172.21.15.81:0/2658570234 shutdown_connections 2024-09-13T18:55:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 --2- 172.21.15.81:0/2658570234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144710 0x7f5ba80b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 --2- 172.21.15.81:0/2658570234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba8144330 0x7f5ba80cef70 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 -- 172.21.15.81:0/2658570234 >> 172.21.15.81:0/2658570234 conn(0x7f5ba806a570 msgr2=0x7f5ba806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 -- 172.21.15.81:0/2658570234 shutdown_connections 2024-09-13T18:55:57.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.284+0000 7f5baca00700 1 -- 172.21.15.81:0/2658570234 wait complete. 2024-09-13T18:55:57.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.288+0000 7f5baca00700 1 Processor -- start 2024-09-13T18:55:57.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.288+0000 7f5baca00700 1 -- start start 2024-09-13T18:55:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba806d760 0x7f5ba80ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144330 0x7f5ba8152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ba80b0fe0 0x7f5ba8152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80b1550 con 0x7f5ba806d760 2024-09-13T18:55:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba81f0690 con 0x7f5ba80b0fe0 2024-09-13T18:55:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8155230 con 0x7f5ba8144330 2024-09-13T18:55:57.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba806d760 0x7f5ba80ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba806d760 0x7f5ba80ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60198/0 (socket says 172.21.15.81:60198) 2024-09-13T18:55:57.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 -- 172.21.15.81:0/1516258640 learned_addr learned my addr 172.21.15.81:0/1516258640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:57.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5400700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144330 0x7f5ba8152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba6800700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ba80b0fe0 0x7f5ba8152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 -- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144330 msgr2=0x7f5ba8152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ba8144330 0x7f5ba8152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 -- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ba80b0fe0 msgr2=0x7f5ba8152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ba80b0fe0 0x7f5ba8152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 -- 172.21.15.81:0/1516258640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009a70 con 0x7f5ba806d760 2024-09-13T18:55:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5ba5e00700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba806d760 0x7f5ba80ce2b0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f5b98014040 tx=0x7f5b98004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98012430 con 0x7f5ba806d760 2024-09-13T18:55:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98020070 con 0x7f5ba806d760 2024-09-13T18:55:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98004280 con 0x7f5ba806d760 2024-09-13T18:55:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba81349f0 con 0x7f5ba806d760 2024-09-13T18:55:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.292+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba8134fb0 con 0x7f5ba806d760 2024-09-13T18:55:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.296+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ba815c4f0 con 0x7f5ba806d760 2024-09-13T18:55:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.296+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b980043e0 con 0x7f5ba806d760 2024-09-13T18:55:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.296+0000 7f5b9e000700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b88066760 0x7f5b88068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.296+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f5b98022070 con 0x7f5ba806d760 2024-09-13T18:55:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.296+0000 7f5ba5400700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b88066760 0x7f5b88068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5b9e000700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f5b8806cba0 0x7f5b8806efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b8806f6b0 con 0x7f5b8806cba0 2024-09-13T18:55:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b9808a2a0 con 0x7f5ba806d760 2024-09-13T18:55:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5ba6800700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f5b8806cba0 0x7f5b8806efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5ba5400700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b88066760 0x7f5b88068c20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80b2540 tx=0x7f5b94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5ba6800700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f5b8806cba0 0x7f5b8806efe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.300+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== osd.4 v2:172.21.15.178:6803/1450995168 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5b8806f6b0 con 0x7f5b8806cba0 2024-09-13T18:55:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.320+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 --> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5ba806c500 con 0x7f5b8806cba0 2024-09-13T18:55:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5b9e000700 1 -- 172.21.15.81:0/1516258640 <== osd.4 v2:172.21.15.178:6803/1450995168 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5ba0009b50 con 0x7f5b8806cba0 2024-09-13T18:55:57.330 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:57.331 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:57.331 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f5b8806cba0 msgr2=0x7f5b8806efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.178:6803/1450995168,v1:172.21.15.178:6805/1450995168] conn(0x7f5b8806cba0 0x7f5b8806efe0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b88066760 msgr2=0x7f5b88068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f5b88066760 0x7f5b88068c20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80b2540 tx=0x7f5b94009040 comp rx=0 tx=0).stop 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba806d760 msgr2=0x7f5ba80ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 --2- 172.21.15.81:0/1516258640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ba806d760 0x7f5ba80ce2b0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f5b98014040 tx=0x7f5b98004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5ba6800700 1 -- 172.21.15.81:0/1516258640 reap_dead start 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 shutdown_connections 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 >> 172.21.15.81:0/1516258640 conn(0x7f5ba806a570 msgr2=0x7f5ba8139810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 shutdown_connections 2024-09-13T18:55:57.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.324+0000 7f5baca00700 1 -- 172.21.15.81:0/1516258640 wait complete. 2024-09-13T18:55:57.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:55:57.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.524+0000 7ff656200700 1 Processor -- start 2024-09-13T18:55:57.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.524+0000 7ff656200700 1 -- start start 2024-09-13T18:55:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff656200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff65006d180 0x7ff6500cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff656200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 0x7ff6500d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff656200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6500b0190 con 0x7ff65015cb30 2024-09-13T18:55:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff656200700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6500d0770 con 0x7ff65006d180 2024-09-13T18:55:57.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff656200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65006a530 con 0x7ff65015cf10 2024-09-13T18:55:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 0x7ff6500d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff64fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff65006d180 0x7ff6500cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 0x7ff6500d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.81:43290/0 (socket says 172.21.15.81:43290) 2024-09-13T18:55:57.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 -- 172.21.15.81:0/2072640023 learned_addr learned my addr 172.21.15.81:0/2072640023 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 -- 172.21.15.81:0/2072640023 >> v2:172.21.15.178:3300/0 conn(0x7ff65006d180 msgr2=0x7ff6500cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 --2- 172.21.15.81:0/2072640023 >> v2:172.21.15.178:3300/0 conn(0x7ff65006d180 0x7ff6500cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 -- 172.21.15.81:0/2072640023 >> v1:172.21.15.178:6789/0 conn(0x7ff65015cb30 legacy=0x7ff65006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 -- 172.21.15.81:0/2072640023 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65006a810 con 0x7ff65015cf10 2024-09-13T18:55:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff655800700 1 --2- 172.21.15.81:0/2072640023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 0x7ff6500d0230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff648009e50 tx=0x7ff64800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6a305e99761967 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff64f400700 1 -- 172.21.15.81:0/2072640023 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800e070 con 0x7ff65015cf10 2024-09-13T18:55:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff64f400700 1 -- 172.21.15.81:0/2072640023 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64800b910 con 0x7ff65015cf10 2024-09-13T18:55:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.528+0000 7ff64f400700 1 -- 172.21.15.81:0/2072640023 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800bcc0 con 0x7ff65015cf10 2024-09-13T18:55:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 -- 172.21.15.81:0/2072640023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 msgr2=0x7ff6500d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 --2- 172.21.15.81:0/2072640023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 0x7ff6500d0230 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff648009e50 tx=0x7ff64800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 -- 172.21.15.81:0/2072640023 shutdown_connections 2024-09-13T18:55:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 --2- 172.21.15.81:0/2072640023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cf10 0x7ff6500d0230 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 --2- 172.21.15.81:0/2072640023 >> v2:172.21.15.178:3300/0 conn(0x7ff65006d180 0x7ff6500cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 -- 172.21.15.81:0/2072640023 >> 172.21.15.81:0/2072640023 conn(0x7ff650071f00 msgr2=0x7ff6500722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 -- 172.21.15.81:0/2072640023 shutdown_connections 2024-09-13T18:55:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 -- 172.21.15.81:0/2072640023 wait complete. 2024-09-13T18:55:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.532+0000 7ff656200700 1 Processor -- start 2024-09-13T18:55:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 -- start start 2024-09-13T18:55:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff65006d180 0x7ff6500b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cb30 0x7ff6500b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 0x7ff6500b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500b2550 con 0x7ff65015cf10 2024-09-13T18:55:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500b2830 con 0x7ff65006d180 2024-09-13T18:55:57.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500b2b10 con 0x7ff65015cb30 2024-09-13T18:55:57.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 0x7ff6500b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 0x7ff6500b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60204/0 (socket says 172.21.15.81:60204) 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 -- 172.21.15.81:0/3998669177 learned_addr learned my addr 172.21.15.81:0/3998669177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff654e00700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff65006d180 0x7ff6500b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff64fe00700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cb30 0x7ff6500b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 -- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cb30 msgr2=0x7ff6500b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cb30 0x7ff6500b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 -- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff65006d180 msgr2=0x7ff6500b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff65006d180 0x7ff6500b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 -- 172.21.15.81:0/3998669177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648009b30 con 0x7ff65015cf10 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff655800700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 0x7ff6500b0860 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff65006a670 tx=0x7ff648004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648004960 con 0x7ff65015cf10 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6480092e0 con 0x7ff65015cf10 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.536+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65015d510 con 0x7ff65015cf10 2024-09-13T18:55:57.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.540+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64801c660 con 0x7ff65015cf10 2024-09-13T18:55:57.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.540+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65015b1b0 con 0x7ff65015cf10 2024-09-13T18:55:57.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.540+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65006ca70 con 0x7ff65015cf10 2024-09-13T18:55:57.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.540+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff64801c7c0 con 0x7ff65015cf10 2024-09-13T18:55:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.544+0000 7ff64cc00700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff630066730 0x7ff630068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.544+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7ff648085c60 con 0x7ff65015cf10 2024-09-13T18:55:57.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.544+0000 7ff654e00700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff630066730 0x7ff630068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.544+0000 7ff654e00700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff630066730 0x7ff630068bf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff644000f60 tx=0x7ff644009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.544+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff648053170 con 0x7ff65015cf10 2024-09-13T18:55:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.723+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff65006add0 con 0x7ff630066730 2024-09-13T18:55:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.723+0000 7ff64cc00700 1 -- 172.21.15.81:0/3998669177 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff6440050d0 con 0x7ff630066730 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.723+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff630066730 msgr2=0x7ff630068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.723+0000 7ff656200700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff630066730 0x7ff630068bf0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7ff644000f60 tx=0x7ff644009040 comp rx=0 tx=0).stop 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.723+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 msgr2=0x7ff6500b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.723+0000 7ff656200700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 0x7ff6500b0860 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff65006a670 tx=0x7ff648004af0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 shutdown_connections 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7ff630066730 0x7ff630068bf0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff65015cf10 0x7ff6500b0860 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015cb30 0x7ff6500b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 --2- 172.21.15.81:0/3998669177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff65006d180 0x7ff6500b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 >> 172.21.15.81:0/3998669177 conn(0x7ff650071f00 msgr2=0x7ff6500b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 shutdown_connections 2024-09-13T18:55:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.727+0000 7ff656200700 1 -- 172.21.15.81:0/3998669177 wait complete. 2024-09-13T18:55:57.736 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:55:57.753 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:55:57.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:57.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.927+0000 7f2752000700 1 Processor -- start 2024-09-13T18:55:57.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.927+0000 7f2752000700 1 -- start start 2024-09-13T18:55:57.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f2752000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f274c154f40 0x7f274c0b5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f2752000700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c15f450 con 0x7f274c0b5d80 2024-09-13T18:55:57.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f2752000700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c15e5f0 con 0x7f274c0d1180 2024-09-13T18:55:57.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f2752000700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c15c040 con 0x7f274c154f40 2024-09-13T18:55:57.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274aa00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f274c0b5d80 0x7f274c0d0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60164/0 (socket says 172.21.15.81:60164) 2024-09-13T18:55:57.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274aa00700 1 -- 172.21.15.81:0/394570972 learned_addr learned my addr 172.21.15.81:0/394570972 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:57.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274b400700 1 --2- 172.21.15.81:0/394570972 >> v2:172.21.15.178:3300/0 conn(0x7f274c154f40 0x7f274c0b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618800146 0 0) 0x7f274c15f450 con 0x7f274c0b5d80 2024-09-13T18:55:57.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27300035d0 con 0x7f274c0b5d80 2024-09-13T18:55:57.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142804847 0 0) 0x7f274c15e5f0 con 0x7f274c0d1180 2024-09-13T18:55:57.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c15f450 con 0x7f274c0d1180 2024-09-13T18:55:57.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274b400700 1 -- 172.21.15.81:0/394570972 >> v1:172.21.15.178:6789/0 conn(0x7f274c0d1180 legacy=0x7f274c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274b400700 1 -- 172.21.15.81:0/394570972 >> v1:172.21.15.81:6789/0 conn(0x7f274c0b5d80 legacy=0x7f274c0d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3898624504 0 0) 0x7f27300035d0 con 0x7f274c0b5d80 2024-09-13T18:55:57.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274b400700 1 -- 172.21.15.81:0/394570972 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c15e840 con 0x7f274c154f40 2024-09-13T18:55:57.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274b400700 1 --2- 172.21.15.81:0/394570972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c154f40 0x7f274c0b5840 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f273c009850 tx=0x7f273c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bbf2b4598691b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.931+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738001670 con 0x7f274c154f40 2024-09-13T18:55:57.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c004030 con 0x7f274c154f40 2024-09-13T18:55:57.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f274a000700 1 -- 172.21.15.81:0/394570972 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c0043a0 con 0x7f274c154f40 2024-09-13T18:55:57.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 -- 172.21.15.81:0/394570972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c154f40 msgr2=0x7f274c0b5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 --2- 172.21.15.81:0/394570972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c154f40 0x7f274c0b5840 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f273c009850 tx=0x7f273c009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:57.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 -- 172.21.15.81:0/394570972 shutdown_connections 2024-09-13T18:55:57.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 --2- 172.21.15.81:0/394570972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c154f40 0x7f274c0b5840 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 -- 172.21.15.81:0/394570972 >> 172.21.15.81:0/394570972 conn(0x7f274c06e660 msgr2=0x7f274c06ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 -- 172.21.15.81:0/394570972 shutdown_connections 2024-09-13T18:55:57.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 -- 172.21.15.81:0/394570972 wait complete. 2024-09-13T18:55:57.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 Processor -- start 2024-09-13T18:55:57.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.935+0000 7f2752000700 1 -- start start 2024-09-13T18:55:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b5d80 0x7f274c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c0d1180 0x7f274c1f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c156740 0x7f274c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c157880 con 0x7f274c0d1180 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1f6160 con 0x7f274c0b5d80 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1f32e0 con 0x7f274c156740 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c0d1180 0x7f274c1f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c0d1180 0x7f274c1f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60216/0 (socket says 172.21.15.81:60216) 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 -- 172.21.15.81:0/1918208633 learned_addr learned my addr 172.21.15.81:0/1918208633 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274be00700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c156740 0x7f274c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274b400700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b5d80 0x7f274c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 -- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c156740 msgr2=0x7f274c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f274c156740 0x7f274c151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 -- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b5d80 msgr2=0x7f274c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b5d80 0x7f274c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 -- 172.21.15.81:0/1918208633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0094b0 con 0x7f274c0d1180 2024-09-13T18:55:57.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274b400700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f274c0b5d80 0x7f274c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f274aa00700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c0d1180 0x7f274c1f2da0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f273800c750 tx=0x7f273800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738004d00 con 0x7f274c0d1180 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738004e60 con 0x7f274c0d1180 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380072d0 con 0x7f274c0d1180 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c156c00 con 0x7f274c0d1180 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c1571c0 con 0x7f274c0d1180 2024-09-13T18:55:57.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.939+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f274c0ce250 con 0x7f274c0d1180 2024-09-13T18:55:57.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2738007430 con 0x7f274c0d1180 2024-09-13T18:55:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f2743400700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f272c066730 0x7f272c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f27380838b0 con 0x7f274c0d1180 2024-09-13T18:55:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f2743400700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f272c06cb70 0x7f272c06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f272c06f680 con 0x7f272c06cb70 2024-09-13T18:55:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27380882a0 con 0x7f274c0d1180 2024-09-13T18:55:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.943+0000 7f274b400700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f272c066730 0x7f272c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.947+0000 7f274be00700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f272c06cb70 0x7f272c06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:57.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.947+0000 7f274b400700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f272c066730 0x7f272c068bf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f274c0d16b0 tx=0x7f273c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.947+0000 7f274be00700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f272c06cb70 0x7f272c06efb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:57.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.947+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== osd.5 v2:172.21.15.178:6824/2042484449 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f272c06f680 con 0x7f272c06cb70 2024-09-13T18:55:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 --> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f274c15f0e0 con 0x7f272c06cb70 2024-09-13T18:55:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2743400700 1 -- 172.21.15.81:0/1918208633 <== osd.5 v2:172.21.15.178:6824/2042484449 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2744001f40 con 0x7f272c06cb70 2024-09-13T18:55:57.977 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:57.977 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:57.977 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f272c06cb70 msgr2=0x7f272c06efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.178:6824/2042484449,v1:172.21.15.178:6825/2042484449] conn(0x7f272c06cb70 0x7f272c06efb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f272c066730 msgr2=0x7f272c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f272c066730 0x7f272c068bf0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f274c0d16b0 tx=0x7f273c008030 comp rx=0 tx=0).stop 2024-09-13T18:55:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c0d1180 msgr2=0x7f274c1f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:57.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f2752000700 1 --2- 172.21.15.81:0/1918208633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c0d1180 0x7f274c1f2da0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f273800c750 tx=0x7f273800ca60 comp rx=0 tx=0).stop 2024-09-13T18:55:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.967+0000 7f274be00700 1 -- 172.21.15.81:0/1918208633 reap_dead start 2024-09-13T18:55:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.971+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 shutdown_connections 2024-09-13T18:55:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.971+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 >> 172.21.15.81:0/1918208633 conn(0x7f274c06e660 msgr2=0x7f274c1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.971+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 shutdown_connections 2024-09-13T18:55:57.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:57.971+0000 7f2752000700 1 -- 172.21.15.81:0/1918208633 wait complete. 2024-09-13T18:55:58.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:55:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.167+0000 7f0300a00700 1 Processor -- start 2024-09-13T18:55:58.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.167+0000 7f0300a00700 1 -- start start 2024-09-13T18:55:58.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f0300a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc161020 0x7f02fc071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f0300a00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f02fc0ccd90 0x7f02fc0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f0300a00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc06a390 con 0x7f02fc0b2f90 2024-09-13T18:55:58.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f0300a00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc06bc20 con 0x7f02fc0ccd90 2024-09-13T18:55:58.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f0300a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0cd340 con 0x7f02fc161020 2024-09-13T18:55:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fbe00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f02fc0b2f90 0x7f02fc06ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60170/0 (socket says 172.21.15.81:60170) 2024-09-13T18:55:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fbe00700 1 -- 172.21.15.81:0/616047195 learned_addr learned my addr 172.21.15.81:0/616047195 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02faa00700 1 --2- 172.21.15.81:0/616047195 >> v2:172.21.15.81:3300/0 conn(0x7f02fc0ccd90 0x7f02fc0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fb400700 1 --2- 172.21.15.81:0/616047195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc161020 0x7f02fc071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fa000700 1 -- 172.21.15.81:0/616047195 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454904578 0 0) 0x7f02fc06a390 con 0x7f02fc0b2f90 2024-09-13T18:55:58.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fa000700 1 -- 172.21.15.81:0/616047195 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02e00035d0 con 0x7f02fc0b2f90 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fb400700 1 -- 172.21.15.81:0/616047195 >> v2:172.21.15.81:3300/0 conn(0x7f02fc0ccd90 msgr2=0x7f02fc0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fb400700 1 --2- 172.21.15.81:0/616047195 >> v2:172.21.15.81:3300/0 conn(0x7f02fc0ccd90 0x7f02fc0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fb400700 1 -- 172.21.15.81:0/616047195 >> v1:172.21.15.81:6789/0 conn(0x7f02fc0b2f90 legacy=0x7f02fc06ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fb400700 1 -- 172.21.15.81:0/616047195 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc071860 con 0x7f02fc161020 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fb400700 1 --2- 172.21.15.81:0/616047195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc161020 0x7f02fc071320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009850 tx=0x7f02ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50888871254a9cde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.171+0000 7f02fa000700 1 -- 172.21.15.81:0/616047195 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec011830 con 0x7f02fc161020 2024-09-13T18:55:58.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f02fa000700 1 -- 172.21.15.81:0/616047195 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec011990 con 0x7f02fc161020 2024-09-13T18:55:58.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f02fa000700 1 -- 172.21.15.81:0/616047195 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec011d00 con 0x7f02fc161020 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 -- 172.21.15.81:0/616047195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc161020 msgr2=0x7f02fc071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 --2- 172.21.15.81:0/616047195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc161020 0x7f02fc071320 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009850 tx=0x7f02ec009b60 comp rx=0 tx=0).stop 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 -- 172.21.15.81:0/616047195 shutdown_connections 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 --2- 172.21.15.81:0/616047195 >> v2:172.21.15.81:3300/0 conn(0x7f02fc0ccd90 0x7f02fc0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 --2- 172.21.15.81:0/616047195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc161020 0x7f02fc071320 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 -- 172.21.15.81:0/616047195 >> 172.21.15.81:0/616047195 conn(0x7f02fc06ca10 msgr2=0x7f02fc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 -- 172.21.15.81:0/616047195 shutdown_connections 2024-09-13T18:55:58.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.175+0000 7f0300a00700 1 -- 172.21.15.81:0/616047195 wait complete. 2024-09-13T18:55:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 Processor -- start 2024-09-13T18:55:58.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 -- start start 2024-09-13T18:55:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 0x7f02fc142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc0ccd90 0x7f02fc14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc160300 0x7f02fc15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc142f80 con 0x7f02fc0b2f90 2024-09-13T18:55:58.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1518f0 con 0x7f02fc160300 2024-09-13T18:55:58.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f0300a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc1515f0 con 0x7f02fc0ccd90 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f02fb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 0x7f02fc142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f02fb400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 0x7f02fc142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60232/0 (socket says 172.21.15.81:60232) 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f02fb400700 1 -- 172.21.15.81:0/3766924305 learned_addr learned my addr 172.21.15.81:0/3766924305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f02faa00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc0ccd90 0x7f02fc14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.179+0000 7f02fbe00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc160300 0x7f02fc15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02fb400700 1 -- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc0ccd90 msgr2=0x7f02fc14f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02fb400700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc0ccd90 0x7f02fc14f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02fb400700 1 -- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc160300 msgr2=0x7f02fc15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02fb400700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc160300 0x7f02fc15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02fb400700 1 -- 172.21.15.81:0/3766924305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0094b0 con 0x7f02fc0b2f90 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02fb400700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 0x7f02fc142a40 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f02ec013000 tx=0x7f02ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec004550 con 0x7f02fc0b2f90 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec01f070 con 0x7f02fc0b2f90 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc14fa80 con 0x7f02fc0b2f90 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec003900 con 0x7f02fc0b2f90 2024-09-13T18:55:58.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc150040 con 0x7f02fc0b2f90 2024-09-13T18:55:58.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.183+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc071320 con 0x7f02fc0b2f90 2024-09-13T18:55:58.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.187+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f02ec003a60 con 0x7f02fc0b2f90 2024-09-13T18:55:58.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.187+0000 7f02f3400700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f02dc066730 0x7f02dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.187+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f02ec021070 con 0x7f02fc0b2f90 2024-09-13T18:55:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.187+0000 7f02faa00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f02dc066730 0x7f02dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.191+0000 7f02faa00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f02dc066730 0x7f02dc068bf0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f02fc15d040 tx=0x7f02e8009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.191+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02ec052bc0 con 0x7f02fc0b2f90 2024-09-13T18:55:58.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.375+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f02fc070f20 con 0x7f02dc066730 2024-09-13T18:55:58.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.375+0000 7f02f3400700 1 -- 172.21.15.81:0/3766924305 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f02fc070f20 con 0x7f02dc066730 2024-09-13T18:55:58.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f02dc066730 msgr2=0x7f02dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f02dc066730 0x7f02dc068bf0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f02fc15d040 tx=0x7f02e8009240 comp rx=0 tx=0).stop 2024-09-13T18:55:58.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 msgr2=0x7f02fc142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 0x7f02fc142a40 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f02ec013000 tx=0x7f02ec004770 comp rx=0 tx=0).stop 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 shutdown_connections 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f02dc066730 0x7f02dc068bf0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc160300 0x7f02fc15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc0ccd90 0x7f02fc14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 --2- 172.21.15.81:0/3766924305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02fc0b2f90 0x7f02fc142a40 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 >> 172.21.15.81:0/3766924305 conn(0x7f02fc06ca10 msgr2=0x7f02fc1628b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 shutdown_connections 2024-09-13T18:55:58.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.379+0000 7f0300a00700 1 -- 172.21.15.81:0/3766924305 wait complete. 2024-09-13T18:55:58.390 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:55:58.409 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:55:58.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:58.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.571+0000 7fe395a00700 1 Processor -- start 2024-09-13T18:55:58.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.571+0000 7fe395a00700 1 -- start start 2024-09-13T18:55:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.571+0000 7fe395a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe39015a980 0x7fe3900cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.571+0000 7fe395a00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3900cd530 0x7fe390071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.571+0000 7fe395a00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900cf7a0 con 0x7fe39015ad60 2024-09-13T18:55:58.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.571+0000 7fe395a00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39015b5d0 con 0x7fe3900cd530 2024-09-13T18:55:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39015b8b0 con 0x7fe39015a980 2024-09-13T18:55:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395000700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3900cd530 0x7fe390071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe39015a980 0x7fe3900cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38f400700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe39015ad60 0x7fe3900cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.81:60126/0 (socket says 172.21.15.81:60126) 2024-09-13T18:55:58.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38f400700 1 -- 172.21.15.81:0/3368088065 learned_addr learned my addr 172.21.15.81:0/3368088065 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:58.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38ea00700 1 -- 172.21.15.81:0/3368088065 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691934607 0 0) 0x7fe3900cf7a0 con 0x7fe39015ad60 2024-09-13T18:55:58.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38ea00700 1 -- 172.21.15.81:0/3368088065 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3740035d0 con 0x7fe39015ad60 2024-09-13T18:55:58.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395000700 1 -- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe39015a980 msgr2=0x7fe3900cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:58.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395000700 1 --2- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe39015a980 0x7fe3900cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395000700 1 -- 172.21.15.81:0/3368088065 >> v1:172.21.15.178:6789/0 conn(0x7fe39015ad60 legacy=0x7fe3900cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395000700 1 -- 172.21.15.81:0/3368088065 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39015bb90 con 0x7fe3900cd530 2024-09-13T18:55:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe395000700 1 --2- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3900cd530 0x7fe390071360 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe388009d90 tx=0x7fe38800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a143094b6b24c348 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38ea00700 1 -- 172.21.15.81:0/3368088065 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38800e070 con 0x7fe3900cd530 2024-09-13T18:55:58.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38ea00700 1 -- 172.21.15.81:0/3368088065 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38800bb20 con 0x7fe3900cd530 2024-09-13T18:55:58.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.575+0000 7fe38ea00700 1 -- 172.21.15.81:0/3368088065 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388012430 con 0x7fe3900cd530 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 -- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3900cd530 msgr2=0x7fe390071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 --2- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3900cd530 0x7fe390071360 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe388009d90 tx=0x7fe38800b330 comp rx=0 tx=0).stop 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 -- 172.21.15.81:0/3368088065 shutdown_connections 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 --2- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3900cd530 0x7fe390071360 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 --2- 172.21.15.81:0/3368088065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe39015a980 0x7fe3900cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 -- 172.21.15.81:0/3368088065 >> 172.21.15.81:0/3368088065 conn(0x7fe39006d4b0 msgr2=0x7fe39006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 -- 172.21.15.81:0/3368088065 shutdown_connections 2024-09-13T18:55:58.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 -- 172.21.15.81:0/3368088065 wait complete. 2024-09-13T18:55:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 Processor -- start 2024-09-13T18:55:58.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.579+0000 7fe395a00700 1 -- start start 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3900cd530 0x7fe39014a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39015a980 0x7fe390154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe39015ad60 0x7fe3901567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39014a870 con 0x7fe39015a980 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900ad190 con 0x7fe39015ad60 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900ace60 con 0x7fe3900cd530 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39015a980 0x7fe390154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39015a980 0x7fe390154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60242/0 (socket says 172.21.15.81:60242) 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 -- 172.21.15.81:0/2676481377 learned_addr learned my addr 172.21.15.81:0/2676481377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38fe00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3900cd530 0x7fe39014a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395000700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe39015ad60 0x7fe3901567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 -- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3900cd530 msgr2=0x7fe39014a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3900cd530 0x7fe39014a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 -- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe39015ad60 msgr2=0x7fe3901567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe39015ad60 0x7fe3901567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 -- 172.21.15.81:0/2676481377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388009a70 con 0x7fe39015a980 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38fe00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3900cd530 0x7fe39014a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe38f400700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39015a980 0x7fe390154a70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fe37c005930 tx=0x7fe37c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c005d90 con 0x7fe39015a980 2024-09-13T18:55:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c0070d0 con 0x7fe39015a980 2024-09-13T18:55:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c007480 con 0x7fe39015a980 2024-09-13T18:55:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3901522e0 con 0x7fe39015a980 2024-09-13T18:55:58.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe390154fb0 con 0x7fe39015a980 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.583+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3900718a0 con 0x7fe39015a980 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe37c0075e0 con 0x7fe39015a980 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe387e00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe370066730 0x7fe370068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe37c083d40 con 0x7fe39015a980 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe387e00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7fe37006cb70 0x7fe37006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe37006f680 con 0x7fe37006cb70 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe37c0840b0 con 0x7fe39015a980 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe38fe00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe370066730 0x7fe370068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe395000700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7fe37006cb70 0x7fe37006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.587+0000 7fe38fe00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe370066730 0x7fe370068bf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe380009c40 tx=0x7fe380008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.591+0000 7fe395000700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7fe37006cb70 0x7fe37006efb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.591+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== osd.6 v2:172.21.15.178:6800/3369283961 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe37006f680 con 0x7fe37006cb70 2024-09-13T18:55:58.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.607+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 --> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe390067e60 con 0x7fe37006cb70 2024-09-13T18:55:58.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.607+0000 7fe387e00700 1 -- 172.21.15.81:0/2676481377 <== osd.6 v2:172.21.15.178:6800/3369283961 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe390067e60 con 0x7fe37006cb70 2024-09-13T18:55:58.618 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:58.618 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:58.619 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7fe37006cb70 msgr2=0x7fe37006efb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.178:6800/3369283961,v1:172.21.15.178:6801/3369283961] conn(0x7fe37006cb70 0x7fe37006efb0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe370066730 msgr2=0x7fe370068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe370066730 0x7fe370068bf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe380009c40 tx=0x7fe380008040 comp rx=0 tx=0).stop 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39015a980 msgr2=0x7fe390154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 --2- 172.21.15.81:0/2676481377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe39015a980 0x7fe390154a70 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fe37c005930 tx=0x7fe37c00c860 comp rx=0 tx=0).stop 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395000700 1 -- 172.21.15.81:0/2676481377 reap_dead start 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 shutdown_connections 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 >> 172.21.15.81:0/2676481377 conn(0x7fe39006d4b0 msgr2=0x7fe39006ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 shutdown_connections 2024-09-13T18:55:58.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.611+0000 7fe395a00700 1 -- 172.21.15.81:0/2676481377 wait complete. 2024-09-13T18:55:58.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:55:58.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.803+0000 7fa2f6200700 1 Processor -- start 2024-09-13T18:55:58.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.803+0000 7fa2f6200700 1 -- start start 2024-09-13T18:55:58.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2f6200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2f00cc6f0 0x7fa2f015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2f6200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00ccb40 con 0x7fa2f006aaa0 2024-09-13T18:55:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2f6200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00b2ad0 con 0x7fa2f00cb020 2024-09-13T18:55:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2f6200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f015b960 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2f00cc6f0 0x7fa2f015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa2f00cc6f0 0x7fa2f015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60256/0 (socket says 172.21.15.81:60256) 2024-09-13T18:55:58.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 -- 172.21.15.81:0/2427724783 learned_addr learned my addr 172.21.15.81:0/2427724783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 -- 172.21.15.81:0/2427724783 >> v1:172.21.15.178:6789/0 conn(0x7fa2f00cb020 legacy=0x7fa2f015c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 -- 172.21.15.81:0/2427724783 >> v1:172.21.15.81:6789/0 conn(0x7fa2f006aaa0 legacy=0x7fa2f00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 -- 172.21.15.81:0/2427724783 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f015bc40 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2efe00700 1 --2- 172.21.15.81:0/2427724783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f015b0e0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009910 tx=0x7fa2dc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebff3263ce96e3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2ef400700 1 -- 172.21.15.81:0/2427724783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc004230 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2ef400700 1 -- 172.21.15.81:0/2427724783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2dc004390 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2ef400700 1 -- 172.21.15.81:0/2427724783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc009e60 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2f6200700 1 -- 172.21.15.81:0/2427724783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 msgr2=0x7fa2f015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.807+0000 7fa2f6200700 1 --2- 172.21.15.81:0/2427724783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f015b0e0 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009910 tx=0x7fa2dc009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.811+0000 7fa2f6200700 1 -- 172.21.15.81:0/2427724783 shutdown_connections 2024-09-13T18:55:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.811+0000 7fa2f6200700 1 --2- 172.21.15.81:0/2427724783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f015b0e0 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.811+0000 7fa2f6200700 1 -- 172.21.15.81:0/2427724783 >> 172.21.15.81:0/2427724783 conn(0x7fa2f00b0c40 msgr2=0x7fa2f006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.811+0000 7fa2f6200700 1 -- 172.21.15.81:0/2427724783 shutdown_connections 2024-09-13T18:55:58.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.811+0000 7fa2f6200700 1 -- 172.21.15.81:0/2427724783 wait complete. 2024-09-13T18:55:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.811+0000 7fa2f6200700 1 Processor -- start 2024-09-13T18:55:58.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 -- start start 2024-09-13T18:55:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f006aaa0 0x7fa2f0156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00cb020 0x7fa2f01e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f01e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0156420 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0157090 con 0x7fa2f006aaa0 2024-09-13T18:55:58.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f6200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0071200 con 0x7fa2f00cb020 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f01e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f01e7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60262/0 (socket says 172.21.15.81:60262) 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 -- 172.21.15.81:0/3275991228 learned_addr learned my addr 172.21.15.81:0/3275991228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f4e00700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f006aaa0 0x7fa2f0156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2efe00700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00cb020 0x7fa2f01e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 -- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00cb020 msgr2=0x7fa2f01e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00cb020 0x7fa2f01e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 -- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f006aaa0 msgr2=0x7fa2f0156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f006aaa0 0x7fa2f0156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.815+0000 7fa2f5800700 1 -- 172.21.15.81:0/3275991228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc009570 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2f5800700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f01e7a40 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800cba0 tx=0x7fa2e800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8003c20 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8003d80 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f00714e0 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800aae0 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f0156630 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.819+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0156820 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.823+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa2e800ac40 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.823+0000 7fa2ecc00700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d0066730 0x7fa2d0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.823+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fa2e8084080 con 0x7fa2f00cc6f0 2024-09-13T18:55:58.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.823+0000 7fa2f4e00700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d0066730 0x7fa2d0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.823+0000 7fa2f4e00700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d0066730 0x7fa2d0068bf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4005150 tx=0x7fa2e4007ee0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:58.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:58.827+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2e80b5db0 con 0x7fa2f00cc6f0 2024-09-13T18:55:59.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.011+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2f015b620 con 0x7fa2d0066730 2024-09-13T18:55:59.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.011+0000 7fa2ecc00700 1 -- 172.21.15.81:0/3275991228 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2e4003ab0 con 0x7fa2d0066730 2024-09-13T18:55:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d0066730 msgr2=0x7fa2d0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d0066730 0x7fa2d0068bf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4005150 tx=0x7fa2e4007ee0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 msgr2=0x7fa2f01e7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f01e7a40 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800cba0 tx=0x7fa2e800ceb0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 shutdown_connections 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa2d0066730 0x7fa2d0068bf0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f00cc6f0 0x7fa2f01e7a40 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00cb020 0x7fa2f01e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 --2- 172.21.15.81:0/3275991228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f006aaa0 0x7fa2f0156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 >> 172.21.15.81:0/3275991228 conn(0x7fa2f00b0c40 msgr2=0x7fa2f006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 shutdown_connections 2024-09-13T18:55:59.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.015+0000 7fa2f6200700 1 -- 172.21.15.81:0/3275991228 wait complete. 2024-09-13T18:55:59.025 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:55:59.047 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:55:59.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:55:59.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.207+0000 7fa458200700 1 Processor -- start 2024-09-13T18:55:59.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.207+0000 7fa458200700 1 -- start start 2024-09-13T18:55:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.207+0000 7fa458200700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa45006c4c0 0x7fa4500ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.207+0000 7fa458200700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa45015ea30 con 0x7fa450146720 2024-09-13T18:55:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.207+0000 7fa458200700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa450070670 con 0x7fa45006c8c0 2024-09-13T18:55:59.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.207+0000 7fa458200700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa450070950 con 0x7fa45006c4c0 2024-09-13T18:55:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa45006c4c0 0x7fa4500ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa45006c4c0 0x7fa4500ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60268/0 (socket says 172.21.15.81:60268) 2024-09-13T18:55:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 -- 172.21.15.81:0/3828942685 learned_addr learned my addr 172.21.15.81:0/3828942685 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 -- 172.21.15.81:0/3828942685 >> v1:172.21.15.178:6789/0 conn(0x7fa45006c8c0 legacy=0x7fa450071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:59.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 -- 172.21.15.81:0/3828942685 >> v1:172.21.15.81:6789/0 conn(0x7fa450146720 legacy=0x7fa45015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 -- 172.21.15.81:0/3828942685 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450070c30 con 0x7fa45006c4c0 2024-09-13T18:55:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa454e00700 1 --2- 172.21.15.81:0/3828942685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45006c4c0 0x7fa4500ceb70 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009910 tx=0x7fa43c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c583c53d862d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa44fe00700 1 -- 172.21.15.81:0/3828942685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c004230 con 0x7fa45006c4c0 2024-09-13T18:55:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa44fe00700 1 -- 172.21.15.81:0/3828942685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c004390 con 0x7fa45006c4c0 2024-09-13T18:55:59.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa44fe00700 1 -- 172.21.15.81:0/3828942685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c009e60 con 0x7fa45006c4c0 2024-09-13T18:55:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 -- 172.21.15.81:0/3828942685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45006c4c0 msgr2=0x7fa4500ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 --2- 172.21.15.81:0/3828942685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45006c4c0 0x7fa4500ceb70 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009910 tx=0x7fa43c009c20 comp rx=0 tx=0).stop 2024-09-13T18:55:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 -- 172.21.15.81:0/3828942685 shutdown_connections 2024-09-13T18:55:59.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 --2- 172.21.15.81:0/3828942685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa45006c4c0 0x7fa4500ceb70 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 -- 172.21.15.81:0/3828942685 >> 172.21.15.81:0/3828942685 conn(0x7fa45006a570 msgr2=0x7fa45006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:59.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 -- 172.21.15.81:0/3828942685 shutdown_connections 2024-09-13T18:55:59.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.211+0000 7fa458200700 1 -- 172.21.15.81:0/3828942685 wait complete. 2024-09-13T18:55:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 Processor -- start 2024-09-13T18:55:59.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 -- start start 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa45006c4c0 0x7fa450157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa45006c8c0 0x7fa4501444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa450146720 0x7fa4500b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4501f2890 con 0x7fa450146720 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa450159c60 con 0x7fa45006c8c0 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa458200700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa450144a20 con 0x7fa45006c4c0 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa450146720 0x7fa4500b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa450146720 0x7fa4500b05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60280/0 (socket says 172.21.15.81:60280) 2024-09-13T18:55:59.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 -- 172.21.15.81:0/2310811522 learned_addr learned my addr 172.21.15.81:0/2310811522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa455800700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa45006c4c0 0x7fa450157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa454e00700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa45006c8c0 0x7fa4501444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 -- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa45006c4c0 msgr2=0x7fa450157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa45006c4c0 0x7fa450157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 -- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa45006c8c0 msgr2=0x7fa4501444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa45006c8c0 0x7fa4501444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 -- 172.21.15.81:0/2310811522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009570 con 0x7fa450146720 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.215+0000 7fa456200700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa450146720 0x7fa4500b05b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa44800cb90 tx=0x7fa44800cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44800aa80 con 0x7fa450146720 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44800abe0 con 0x7fa450146720 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa448012420 con 0x7fa450146720 2024-09-13T18:55:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4501587c0 con 0x7fa450146720 2024-09-13T18:55:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa450158200 con 0x7fa450146720 2024-09-13T18:55:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4500711f0 con 0x7fa450146720 2024-09-13T18:55:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.219+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa448012580 con 0x7fa450146720 2024-09-13T18:55:59.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa44d600700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa430066760 0x7fa430068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fa4480847d0 con 0x7fa450146720 2024-09-13T18:55:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa455800700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa430066760 0x7fa430068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa44d600700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7fa43006cba0 0x7fa43006efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa43006f6b0 con 0x7fa43006cba0 2024-09-13T18:55:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa448086db0 con 0x7fa450146720 2024-09-13T18:55:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa455800700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa430066760 0x7fa430068c20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa444001800 tx=0x7fa444009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa454e00700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7fa43006cba0 0x7fa43006efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.223+0000 7fa454e00700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7fa43006cba0 0x7fa43006efe0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.227+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== osd.7 v2:172.21.15.178:6816/2829585854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa43006f6b0 con 0x7fa43006cba0 2024-09-13T18:55:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.243+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 --> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa4501f2a40 con 0x7fa43006cba0 2024-09-13T18:55:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.243+0000 7fa44d600700 1 -- 172.21.15.81:0/2310811522 <== osd.7 v2:172.21.15.178:6816/2829585854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa4501f2a40 con 0x7fa43006cba0 2024-09-13T18:55:59.254 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-13T18:55:59.255 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:55:59.255 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7fa43006cba0 msgr2=0x7fa43006efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.178:6816/2829585854,v1:172.21.15.178:6817/2829585854] conn(0x7fa43006cba0 0x7fa43006efe0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa430066760 msgr2=0x7fa430068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fa430066760 0x7fa430068c20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa444001800 tx=0x7fa444009040 comp rx=0 tx=0).stop 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa450146720 msgr2=0x7fa4500b05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 --2- 172.21.15.81:0/2310811522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa450146720 0x7fa4500b05b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fa44800cb90 tx=0x7fa44800cea0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa456200700 1 -- 172.21.15.81:0/2310811522 reap_dead start 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 shutdown_connections 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 >> 172.21.15.81:0/2310811522 conn(0x7fa45006a570 msgr2=0x7fa450145200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 shutdown_connections 2024-09-13T18:55:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.247+0000 7fa458200700 1 -- 172.21.15.81:0/2310811522 wait complete. 2024-09-13T18:55:59.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:55:59.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.435+0000 7fe0cfe00700 1 Processor -- start 2024-09-13T18:55:59.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.435+0000 7fe0cfe00700 1 -- start start 2024-09-13T18:55:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0d00b2d80 0x7fe0d006af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cfe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00b3560 con 0x7fe0d006aaa0 2024-09-13T18:55:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cfe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d00b3280 con 0x7fe0d01610b0 2024-09-13T18:55:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cfe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d0070b30 con 0x7fe0d00b2d80 2024-09-13T18:55:59.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cf400700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe0d00b2d80 0x7fe0d006af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0c6000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe0d006aaa0 0x7fe0d00b2670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:60192/0 (socket says 172.21.15.81:60192) 2024-09-13T18:55:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0c6000700 1 -- 172.21.15.81:0/469075892 learned_addr learned my addr 172.21.15.81:0/469075892 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:55:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0ce000700 1 -- 172.21.15.81:0/469075892 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917834921 0 0) 0x7fe0d00b3560 con 0x7fe0d006aaa0 2024-09-13T18:55:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0ce000700 1 -- 172.21.15.81:0/469075892 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b40035d0 con 0x7fe0d006aaa0 2024-09-13T18:55:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cf400700 1 -- 172.21.15.81:0/469075892 >> v1:172.21.15.178:6789/0 conn(0x7fe0d01610b0 legacy=0x7fe0d00719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cf400700 1 -- 172.21.15.81:0/469075892 >> v1:172.21.15.81:6789/0 conn(0x7fe0d006aaa0 legacy=0x7fe0d00b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cf400700 1 -- 172.21.15.81:0/469075892 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0070ee0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.439+0000 7fe0cf400700 1 --2- 172.21.15.81:0/469075892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d006af10 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009880 tx=0x7fe0c8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded8a78ec8621169 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0ce000700 1 -- 172.21.15.81:0/469075892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8011830 con 0x7fe0d00b2d80 2024-09-13T18:55:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0ce000700 1 -- 172.21.15.81:0/469075892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8011990 con 0x7fe0d00b2d80 2024-09-13T18:55:59.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0ce000700 1 -- 172.21.15.81:0/469075892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8011d00 con 0x7fe0d00b2d80 2024-09-13T18:55:59.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 -- 172.21.15.81:0/469075892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 msgr2=0x7fe0d006af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/469075892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d006af10 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009880 tx=0x7fe0c8009b90 comp rx=0 tx=0).stop 2024-09-13T18:55:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 -- 172.21.15.81:0/469075892 shutdown_connections 2024-09-13T18:55:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/469075892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d006af10 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 -- 172.21.15.81:0/469075892 >> 172.21.15.81:0/469075892 conn(0x7fe0d00b0c40 msgr2=0x7fe0d006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 -- 172.21.15.81:0/469075892 shutdown_connections 2024-09-13T18:55:59.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.443+0000 7fe0cfe00700 1 -- 172.21.15.81:0/469075892 wait complete. 2024-09-13T18:55:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 Processor -- start 2024-09-13T18:55:59.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 -- start start 2024-09-13T18:55:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0d006aaa0 0x7fe0d01f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d0158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d01610b0 0x7fe0d0153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01639a0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d01f8010 con 0x7fe0d006aaa0 2024-09-13T18:55:59.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0163c40 con 0x7fe0d01610b0 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d0158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d0158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60300/0 (socket says 172.21.15.81:60300) 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 -- 172.21.15.81:0/2570374867 learned_addr learned my addr 172.21.15.81:0/2570374867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cf400700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d01610b0 0x7fe0d0153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cea00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0d006aaa0 0x7fe0d01f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 -- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d01610b0 msgr2=0x7fe0d0153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d01610b0 0x7fe0d0153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 -- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0d006aaa0 msgr2=0x7fe0d01f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0d006aaa0 0x7fe0d01f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 -- 172.21.15.81:0/2570374867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80094b0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c6000700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d0158580 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800c700 tx=0x7fe0b800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8005d90 con 0x7fe0d00b2d80 2024-09-13T18:55:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b80070d0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d0163f20 con 0x7fe0d00b2d80 2024-09-13T18:55:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.447+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8007480 con 0x7fe0d00b2d80 2024-09-13T18:55:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.451+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d01644e0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.451+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d006a390 con 0x7fe0d00b2d80 2024-09-13T18:55:59.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.451+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0b80075e0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.455+0000 7fe0c7400700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe0ac066760 0x7fe0ac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.455+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fe0b80836e0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.455+0000 7fe0cea00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe0ac066760 0x7fe0ac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.455+0000 7fe0cea00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe0ac066760 0x7fe0ac068c20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0163930 tx=0x7fe0c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.459+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe0b8050ad0 con 0x7fe0d00b2d80 2024-09-13T18:55:59.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.639+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0d00714a0 con 0x7fe0ac066760 2024-09-13T18:55:59.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.639+0000 7fe0c7400700 1 -- 172.21.15.81:0/2570374867 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0c0003a20 con 0x7fe0ac066760 2024-09-13T18:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe0ac066760 msgr2=0x7fe0ac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe0ac066760 0x7fe0ac068c20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0163930 tx=0x7fe0c0009040 comp rx=0 tx=0).stop 2024-09-13T18:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 msgr2=0x7fe0d0158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d0158580 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800c700 tx=0x7fe0b800cac0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 shutdown_connections 2024-09-13T18:55:59.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7fe0ac066760 0x7fe0ac068c20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0d01610b0 0x7fe0d0153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0d00b2d80 0x7fe0d0158580 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 --2- 172.21.15.81:0/2570374867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0d006aaa0 0x7fe0d01f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 >> 172.21.15.81:0/2570374867 conn(0x7fe0d00b0c40 msgr2=0x7fe0d00adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 shutdown_connections 2024-09-13T18:55:59.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.643+0000 7fe0cfe00700 1 -- 172.21.15.81:0/2570374867 wait complete. 2024-09-13T18:55:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:55:59.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:55:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 Processor -- start 2024-09-13T18:55:59.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 -- start start 2024-09-13T18:55:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b200cb020 0x7f0b200cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b2015c2a0 0x7f0b2015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b2006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2006b430 con 0x7f0b2015c2a0 2024-09-13T18:55:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200b2ad0 con 0x7f0b200cb020 2024-09-13T18:55:59.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.843+0000 7f0b26600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2015b960 con 0x7f0b2006aaa0 2024-09-13T18:55:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b200cb020 0x7f0b200cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b17e00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b2015c2a0 0x7f0b2015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b200cb020 0x7f0b200cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.81:35354/0 (socket says 172.21.15.81:35354) 2024-09-13T18:55:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 -- 172.21.15.81:0/1046104669 learned_addr learned my addr 172.21.15.81:0/1046104669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25c00700 1 --2- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b2006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 -- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 msgr2=0x7f0b2006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 --2- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b2006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 -- 172.21.15.81:0/1046104669 >> v2:172.21.15.81:3300/0 conn(0x7f0b2015c2a0 msgr2=0x7f0b2015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:55:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 --2- 172.21.15.81:0/1046104669 >> v2:172.21.15.81:3300/0 conn(0x7f0b2015c2a0 0x7f0b2015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 -- 172.21.15.81:0/1046104669 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2015bc40 con 0x7f0b200cb020 2024-09-13T18:55:59.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b17e00700 1 --2- 172.21.15.81:0/1046104669 >> v2:172.21.15.81:3300/0 conn(0x7f0b2015c2a0 0x7f0b2015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:55:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b25200700 1 --2- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b200cc6f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0b2006b660 tx=0x7f0b10009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98fc8a6c73d7f155 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b1fe00700 1 -- 172.21.15.81:0/1046104669 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011830 con 0x7f0b200cb020 2024-09-13T18:55:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b1fe00700 1 -- 172.21.15.81:0/1046104669 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b10011990 con 0x7f0b200cb020 2024-09-13T18:55:59.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b1fe00700 1 -- 172.21.15.81:0/1046104669 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10011d20 con 0x7f0b200cb020 2024-09-13T18:55:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b26600700 1 -- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 msgr2=0x7f0b200cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.847+0000 7f0b26600700 1 --2- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b200cc6f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0b2006b660 tx=0x7f0b10009bf0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 -- 172.21.15.81:0/1046104669 shutdown_connections 2024-09-13T18:55:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 --2- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b2006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 --2- 172.21.15.81:0/1046104669 >> v2:172.21.15.81:3300/0 conn(0x7f0b2015c2a0 0x7f0b2015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 --2- 172.21.15.81:0/1046104669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b200cc6f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 -- 172.21.15.81:0/1046104669 >> 172.21.15.81:0/1046104669 conn(0x7f0b200b0c40 msgr2=0x7f0b2006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:55:59.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 -- 172.21.15.81:0/1046104669 shutdown_connections 2024-09-13T18:55:59.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.851+0000 7f0b26600700 1 -- 172.21.15.81:0/1046104669 wait complete. 2024-09-13T18:55:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 Processor -- start 2024-09-13T18:55:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 -- start start 2024-09-13T18:55:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b200c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b20141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 0x7f0b200c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c80a0 con 0x7f0b2015c2a0 2024-09-13T18:55:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200aff40 con 0x7f0b200cb020 2024-09-13T18:55:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200c9e30 con 0x7f0b2006aaa0 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 0x7f0b200c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 0x7f0b200c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60308/0 (socket says 172.21.15.81:60308) 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 -- 172.21.15.81:0/3584205374 learned_addr learned my addr 172.21.15.81:0/3584205374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b17e00700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b20141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25200700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b200c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 -- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 msgr2=0x7f0b200c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b200c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 -- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 msgr2=0x7f0b20141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:55:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b20141650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:55:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 -- 172.21.15.81:0/3584205374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080094b0 con 0x7f0b2015c2a0 2024-09-13T18:55:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b25c00700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 0x7f0b200c8530 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800eed0 tx=0x7f0b1800b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18010040 con 0x7f0b2015c2a0 2024-09-13T18:55:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1800bb70 con 0x7f0b2015c2a0 2024-09-13T18:55:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.855+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b10009570 con 0x7f0b2015c2a0 2024-09-13T18:55:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.859+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b18014400 con 0x7f0b2015c2a0 2024-09-13T18:55:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.859+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200ca3f0 con 0x7f0b2015c2a0 2024-09-13T18:55:59.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.859+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b200c8250 con 0x7f0b2015c2a0 2024-09-13T18:55:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.863+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b18014560 con 0x7f0b2015c2a0 2024-09-13T18:55:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.863+0000 7f0b1d600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0afc066730 0x7f0afc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:55:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.863+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f0b18084740 con 0x7f0b2015c2a0 2024-09-13T18:55:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.863+0000 7f0b25200700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0afc066730 0x7f0afc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:55:59.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.863+0000 7f0b25200700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0afc066730 0x7f0afc068bf0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000c00 tx=0x7f0b10008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:55:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:55:59.871+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b200c8250 con 0x7f0b2015c2a0 2024-09-13T18:56:00.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.059+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b2015b620 con 0x7f0afc066730 2024-09-13T18:56:00.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.063+0000 7f0b1d600700 1 -- 172.21.15.81:0/3584205374 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48252 (secure 0 0 0) 0x7f0b10011b00 con 0x7f0afc066730 2024-09-13T18:56:00.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:56:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0afc066730 msgr2=0x7f0afc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:00.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0afc066730 0x7f0afc068bf0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0b10000c00 tx=0x7f0b10008030 comp rx=0 tx=0).stop 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 msgr2=0x7f0b200c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 0x7f0b200c8530 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800eed0 tx=0x7f0b1800b0b0 comp rx=0 tx=0).stop 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 shutdown_connections 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f0afc066730 0x7f0afc068bf0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b2015c2a0 0x7f0b200c8530 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b200cb020 0x7f0b20141650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 --2- 172.21.15.81:0/3584205374 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b2006aaa0 0x7f0b200c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 >> 172.21.15.81:0/3584205374 conn(0x7f0b200b0c40 msgr2=0x7f0b2006fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 shutdown_connections 2024-09-13T18:56:00.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:00.067+0000 7f0b26600700 1 -- 172.21.15.81:0/3584205374 wait complete. 2024-09-13T18:56:00.079 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:56:00.096 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-13T18:55:59.148244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261020,"kb_used_data":12072,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713700,"statfs":{"total":773094113280,"available":772826828800,"internally_reserved":0,"allocated":12361728,"data_stored":6358384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.872796"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":243,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:55:47.453688+0000","last_change":"2024-09-13T18:47:04.785460+0000","last_active":"2024-09-13T18:55:47.453688+0000","last_peered":"2024-09-13T18:55:47.453688+0000","last_clean":"2024-09-13T18:55:47.453688+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:55:47.453688+0000","last_undegraded":"2024-09-13T18:55:47.453688+0000","last_fullsized":"2024-09-13T18:55:47.453688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:03.760422+0000","last_clean_scrub_stamp":"2024-09-13T18:47:03.760422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:13.378501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574959,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1990656,"data_stored":1237574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.121,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.591,"5min":1.746,"15min":1.746},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.131,"5min":1.0920000000000001,"15min":1.115},"min":{"1min":0.83899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.423,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1479999999999999,"15min":1.139},"min":{"1min":0.82999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.571,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.028},{"interface":"front","average":{"1min":1.173,"5min":1.1499999999999999,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":0.91100000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"max":{"1min":1.548,"5min":1.885,"15min":1.885},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.222,"15min":1.214},"min":{"1min":0.79900000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.7070000000000001},"last":0.96299999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3320000000000001,"15min":1.403},"min":{"1min":0.93400000000000005,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.45,"5min":1.861,"15min":2.2610000000000001},"last":1.0960000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4990000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.153},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1899999999999999,"15min":1.1830000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5069999999999999,"5min":1.823,"15min":1.823},"last":1.2490000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2450000000000001,"15min":1.2949999999999999},"min":{"1min":1.016,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.474,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.224},{"interface":"front","average":{"1min":1.216,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.5509999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":1.1040000000000001,"5min":0.86199999999999999,"15min":0.85599999999999998},"max":{"1min":1.6379999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.278},{"interface":"front","average":{"1min":1.274,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4750000000000001,"5min":1.845,"15min":1.845},"last":1.3140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.111,"15min":1.131},"min":{"1min":0.626,"5min":0.626,"15min":0.371},"max":{"1min":1.448,"5min":1.619,"15min":3.0369999999999999},"last":1.139},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.103,"15min":1.1479999999999999},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1020000000000001,"15min":1.1120000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.59799999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.111},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.153,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5169999999999999,"5min":1.5229999999999999,"15min":1.7470000000000001},"last":0.96099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1479999999999999,"15min":1.353},"min":{"1min":0.90800000000000003,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":3.7480000000000002},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.175,"15min":1.3899999999999999},"min":{"1min":0.751,"5min":0.747,"15min":0.747},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":5.0490000000000004},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.268,"15min":1.4390000000000001},"min":{"1min":0.86199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.883},"last":1.093},{"interface":"front","average":{"1min":1.278,"5min":1.2709999999999999,"15min":1.4490000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.55000000000000004},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":4.8630000000000004},"last":1.1950000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.72799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.831,"5min":1.831,"15min":2.7229999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.232,"15min":1.3100000000000001},"min":{"1min":0.82399999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.744,"5min":1.744,"15min":2.077},"last":1.161}]},{"osd":5,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.26,"15min":1.3680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.861,"5min":1.861,"15min":2.1699999999999999},"last":0.875},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.4510000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.6030000000000002},"last":1.206}]},{"osd":7,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3600000000000001,"15min":1.4390000000000001},"min":{"1min":1.115,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.2120000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3600000000000001,"15min":1.4790000000000001},"min":{"1min":0.95499999999999996,"5min":0.82299999999999995,"15min":0.63700000000000001},"max":{"1min":1.913,"5min":1.913,"15min":2.367},"last":0.77500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.075,"15min":1.1579999999999999},"min":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0409999999999999},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.66400000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.278},"last":1.004}]},{"osd":1,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.163,"15min":1.2410000000000001},"min":{"1min":0.84799999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.087,"5min":1.119,"15min":1.1699999999999999},"min":{"1min":0.82599999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.3420000000000001,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.262},"min":{"1min":0.92200000000000004,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.617,"5min":1.619,"15min":1.9059999999999999},"last":1.212},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.123,"15min":1.2190000000000001},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3939999999999999,"5min":1.6080000000000001,"15min":2.157},"last":1.264}]},{"osd":3,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2569999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0750000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.304,"15min":1.3999999999999999},"min":{"1min":1.147,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.5409999999999999,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.0389999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0940000000000001,"15min":1.1830000000000001},"min":{"1min":0.76200000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1830000000000001,"15min":1.2490000000000001},"min":{"1min":0.81399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.23,"15min":1.2849999999999999},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.698,"5min":1.698,"15min":2.0219999999999998},"last":1.119},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2390000000000001,"15min":1.3220000000000001},"min":{"1min":0.83799999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.153,"5min":2.153,"15min":2.1739999999999999},"last":1.6140000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.3779999999999999,"15min":1.4159999999999999},"min":{"1min":1.109,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.415,"15min":1.4850000000000001},"min":{"1min":1.089,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.8140000000000001},"last":1.3440000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.105,"15min":1.1200000000000001},"min":{"1min":0.68400000000000005,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.603,"5min":1.603,"15min":1.6419999999999999},"last":0.748},{"interface":"front","average":{"1min":1.099,"5min":1.1339999999999999,"15min":1.135},"min":{"1min":0.64100000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.585,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.135}]},{"osd":1,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.2889999999999999,"15min":1.341},"min":{"1min":0.84999999999999998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.7769999999999999,"5min":2.141,"15min":2.6930000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2350000000000001,"15min":1.3},"min":{"1min":0.67700000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.667,"5min":1.7669999999999999,"15min":2.423},"last":1.1759999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.226,"15min":1.268},"min":{"1min":0.70099999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.591,"5min":1.6299999999999999,"15min":1.99},"last":0.94799999999999995},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2669999999999999,"15min":1.3480000000000001},"min":{"1min":0.77500000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.542,"5min":1.7370000000000001,"15min":2.335},"last":1.1100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.1879999999999999,"15min":1.2749999999999999},"min":{"1min":0.85399999999999998,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.732,"5min":1.7689999999999999,"15min":2.621},"last":1.0169999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.204,"15min":1.248},"min":{"1min":0.91300000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.6419999999999999,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.149,"15min":1.264},"min":{"1min":0.81899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":2.274},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.23,"15min":1.29},"min":{"1min":0.67800000000000005,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5860000000000001,"5min":2.0289999999999999,"15min":2.266},"last":1.1850000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.246,"15min":1.3200000000000001},"min":{"1min":0.97999999999999998,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.4710000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.323,"15min":1.4239999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.772,"5min":1.9099999999999999,"15min":2.5},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:55:13 2024","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.4330000000000001},"min":{"1min":0.76600000000000001,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.8069999999999999,"5min":2.2360000000000002,"15min":2.395},"last":1.075},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3879999999999999,"15min":1.444},"min":{"1min":0.79000000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.415},"last":1.056}]}]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82599999999999996,"15min":0.875},"min":{"1min":0.623,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4510000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.65700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":0.54400000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.70199999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":1.056},"min":{"1min":0.64700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.345,"5min":1.345,"15min":4.0149999999999997},"last":1.0569999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0569999999999999,"15min":1.0129999999999999},"min":{"1min":0.60999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.4770000000000001,"5min":1.5609999999999999,"15min":2.4729999999999999},"last":1.1279999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2170000000000001,"15min":1.2310000000000001},"min":{"1min":0.98299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.224,"5min":1.1599999999999999,"15min":1.214},"min":{"1min":0.91700000000000004,"5min":0.82299999999999995,"15min":0.71199999999999997},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.2330000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.996,"5min":0.89000000000000001,"15min":0.81999999999999995},"max":{"1min":1.734,"5min":1.734,"15min":2.0099999999999998},"last":1.349},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.27,"15min":1.343},"min":{"1min":0.96599999999999997,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.8740000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3069999999999999,"15min":1.3959999999999999},"min":{"1min":1.157,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.5940000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.3029999999999999,"15min":1.389},"min":{"1min":0.96499999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.325}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.331,"15min":1.458},"min":{"1min":1.075,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.7799999999999998},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3180000000000001,"15min":1.3999999999999999},"min":{"1min":1.0629999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.98,"5min":1.98,"15min":1.9810000000000001},"last":1.444}]}]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32480,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80000000000000004,"15min":0.92500000000000004},"min":{"1min":0.54900000000000004,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.292,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.286,"5min":1.54,"15min":4.6349999999999998},"last":0.622}]},{"osd":1,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.87,"15min":1.052},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0660000000000001,"15min":1.1799999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.593,"5min":1.762,"15min":4.7009999999999996},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.129,"15min":1.2569999999999999},"min":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.784,"5min":1.784,"15min":4.1920000000000002},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.0369999999999999,"15min":1.1679999999999999},"min":{"1min":0.68300000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5069999999999999,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2150000000000001,"15min":1.5249999999999999},"min":{"1min":0.82399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":8.6989999999999998},"last":1.022},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.819,"5min":1.819,"15min":4.7309999999999999},"last":1.0549999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2869999999999999,"15min":1.446},"min":{"1min":1.002,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.776,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.097},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2709999999999999,"15min":1.4239999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.944,"5min":1.944,"15min":4.335},"last":1.1759999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.306,"15min":1.4730000000000001},"min":{"1min":0.96499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":4.3730000000000002},"last":1.23},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.274,"15min":1.619},"min":{"1min":0.88200000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.73,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.071}]},{"osd":7,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3460000000000001,"15min":1.498},"min":{"1min":0.90900000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9390000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.3859999999999999,"15min":1.5489999999999999},"min":{"1min":1.0089999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":4.4050000000000002},"last":1.2829999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.83899999999999997},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0669999999999999,"5min":1.264,"15min":2.2170000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.78900000000000003,"15min":0.97899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":6.1760000000000002},"last":0.67100000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0009999999999999,"15min":1.133},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.395,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2789999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.88600000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.085,"15min":1.252},"min":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.5329999999999999,"5min":1.748,"15min":6.0919999999999996},"last":1.3839999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0349999999999999,"15min":1.3049999999999999},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.4590000000000001,"5min":1.768,"15min":10.368},"last":1.3400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1930000000000001,"15min":1.327},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4490000000000001,"5min":1.8660000000000001,"15min":3.0739999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.325},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.80000000000000004},"max":{"1min":1.4530000000000001,"5min":1.958,"15min":2.911},"last":1.3089999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2230000000000001,"15min":1.589},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":10.214},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.268,"15min":1.421},"min":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.478,"5min":1.669,"15min":2.8849999999999998},"last":1.4019999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.272,"15min":1.4910000000000001},"min":{"1min":0.879,"5min":0.874,"15min":0.874},"max":{"1min":1.607,"5min":1.915,"15min":6.032},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.298,"15min":1.6419999999999999},"min":{"1min":0.96099999999999997,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":10.112},"last":1.4710000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.704},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.81299999999999994},"max":{"1min":2.02,"5min":2.02,"15min":10.172000000000001},"last":1.657},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3220000000000001,"15min":1.5009999999999999},"min":{"1min":0.92100000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.532,"5min":1.762,"15min":3.0299999999999998},"last":1.448}]}]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1990656,"data_stored":1237574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.749,"15min":0.92700000000000005},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.476,"5min":1.476,"15min":4.2039999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.86099999999999999,"15min":0.95999999999999996},"min":{"1min":0.48199999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.427,"5min":1.5149999999999999,"15min":2.7450000000000001},"last":0.83799999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.89300000000000002,"15min":1.0760000000000001},"min":{"1min":0.51000000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.321,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95699999999999996,"15min":1.141},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.589,"5min":1.589,"15min":3.5640000000000001},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94599999999999995,"15min":1.127},"min":{"1min":0.61599999999999999,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":4.093},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1060000000000001,"15min":1.3340000000000001},"min":{"1min":0.61899999999999999,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":4.7439999999999998},"last":1.0089999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2310000000000001,"15min":1.385},"min":{"1min":0.877,"5min":0.745,"15min":0.745},"max":{"1min":2.274,"5min":2.274,"15min":3.4060000000000001},"last":1.226},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1990000000000001,"15min":1.381},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.512,"5min":1.881,"15min":4.5449999999999999},"last":1.216}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.2589999999999999,"15min":1.518},"min":{"1min":0.88900000000000001,"5min":0.753,"15min":0.753},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":4.9390000000000001},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.254,"15min":1.4590000000000001},"min":{"1min":0.90500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":3.2290000000000001},"last":1.304}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.246,"15min":1.4650000000000001},"min":{"1min":0.92500000000000004,"5min":0.84499999999999997,"15min":0.83999999999999997},"max":{"1min":1.794,"5min":1.968,"15min":4.4569999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.3089999999999999,"15min":1.5900000000000001},"min":{"1min":0.97899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.873,"5min":1.873,"15min":4.8570000000000002},"last":1.1000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.327,"15min":1.522},"min":{"1min":0.95099999999999996,"5min":0.873,"15min":0.86099999999999999},"max":{"1min":1.798,"5min":1.798,"15min":3.056},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3169999999999999,"15min":1.534},"min":{"1min":0.96799999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.885,"5min":2.149,"15min":4.5019999999999998},"last":1.2829999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:56:00.101 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:47:03.760422+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=47, tm_sec=3, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=55, tm_sec=53, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:56:00.101 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:56:13.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:13.945 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:20.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:56:20.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.283+0000 7f8a7fe00700 1 Processor -- start 2024-09-13T18:56:20.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7fe00700 1 -- start start 2024-09-13T18:56:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7fe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a7806c460 0x7f8a7806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7fe00700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8a7806a5d0 0x7f8a7806aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7fe00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a780cdd90 con 0x7f8a7815b700 2024-09-13T18:56:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7fe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7806ce10 con 0x7f8a7806c460 2024-09-13T18:56:20.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7fe00700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7806af50 con 0x7f8a7806a5d0 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a7806c460 0x7f8a7806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a7806c460 0x7f8a7806d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45324/0 (socket says 172.21.15.81:45324) 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 -- 172.21.15.81:0/1124132535 learned_addr learned my addr 172.21.15.81:0/1124132535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7de00700 1 --2- 172.21.15.81:0/1124132535 >> v2:172.21.15.178:3300/0 conn(0x7f8a7806a5d0 0x7f8a7806aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 -- 172.21.15.81:0/1124132535 >> v2:172.21.15.178:3300/0 conn(0x7f8a7806a5d0 msgr2=0x7f8a7806aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 --2- 172.21.15.81:0/1124132535 >> v2:172.21.15.178:3300/0 conn(0x7f8a7806a5d0 0x7f8a7806aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 -- 172.21.15.81:0/1124132535 >> v1:172.21.15.178:6789/0 conn(0x7f8a7815b700 legacy=0x7f8a7815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 -- 172.21.15.81:0/1124132535 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7806d7e0 con 0x7f8a7806c460 2024-09-13T18:56:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7de00700 1 --2- 172.21.15.81:0/1124132535 >> v2:172.21.15.178:3300/0 conn(0x7f8a7806a5d0 0x7f8a7806aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:56:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.287+0000 7f8a7ca00700 1 --2- 172.21.15.81:0/1124132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806c460 0x7f8a7806d2a0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f8a780722a0 tx=0x7f8a64009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26ec1722104fb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a77e00700 1 -- 172.21.15.81:0/1124132535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400b8a0 con 0x7f8a7806c460 2024-09-13T18:56:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a77e00700 1 -- 172.21.15.81:0/1124132535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6400ba00 con 0x7f8a7806c460 2024-09-13T18:56:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a77e00700 1 -- 172.21.15.81:0/1124132535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400bd90 con 0x7f8a7806c460 2024-09-13T18:56:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 -- 172.21.15.81:0/1124132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806c460 msgr2=0x7f8a7806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/1124132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806c460 0x7f8a7806d2a0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f8a780722a0 tx=0x7f8a64009bf0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 -- 172.21.15.81:0/1124132535 shutdown_connections 2024-09-13T18:56:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/1124132535 >> v2:172.21.15.178:3300/0 conn(0x7f8a7806a5d0 0x7f8a7806aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/1124132535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806c460 0x7f8a7806d2a0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 -- 172.21.15.81:0/1124132535 >> 172.21.15.81:0/1124132535 conn(0x7f8a780b08d0 msgr2=0x7f8a780b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 -- 172.21.15.81:0/1124132535 shutdown_connections 2024-09-13T18:56:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 -- 172.21.15.81:0/1124132535 wait complete. 2024-09-13T18:56:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 Processor -- start 2024-09-13T18:56:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.291+0000 7f8a7fe00700 1 -- start start 2024-09-13T18:56:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 0x7f8a7815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a7806c460 0x7f8a781e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a7815b700 0x7f8a781e72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781e46e0 con 0x7f8a7806a5d0 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781e7bf0 con 0x7f8a7815b700 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781e4930 con 0x7f8a7806c460 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 0x7f8a7815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 0x7f8a7815d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45336/0 (socket says 172.21.15.81:45336) 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 -- 172.21.15.81:0/2119428759 learned_addr learned my addr 172.21.15.81:0/2119428759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7de00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a7815b700 0x7f8a781e72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7ca00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a7806c460 0x7f8a781e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 -- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a7806c460 msgr2=0x7f8a781e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a7806c460 0x7f8a781e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 -- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a7815b700 msgr2=0x7f8a781e72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a7815b700 0x7f8a781e72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 -- 172.21.15.81:0/2119428759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009570 con 0x7f8a7806a5d0 2024-09-13T18:56:20.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7d400700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 0x7f8a7815d070 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00c410 tx=0x7f8a6c00c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:20.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0052d0 con 0x7f8a7806a5d0 2024-09-13T18:56:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c005430 con 0x7f8a7806a5d0 2024-09-13T18:56:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0055a0 con 0x7f8a7806a5d0 2024-09-13T18:56:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a781e4c10 con 0x7f8a7806a5d0 2024-09-13T18:56:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.295+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7815c870 con 0x7f8a7806a5d0 2024-09-13T18:56:20.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.299+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7806aa10 con 0x7f8a7806a5d0 2024-09-13T18:56:20.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.299+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8a6c0036a0 con 0x7f8a7806a5d0 2024-09-13T18:56:20.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.299+0000 7f8a75600700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8a58066730 0x7f8a58068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.299+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8a6c0833b0 con 0x7f8a7806a5d0 2024-09-13T18:56:20.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.299+0000 7f8a7ca00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8a58066730 0x7f8a58068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.303+0000 7f8a7ca00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8a58066730 0x7f8a58068bf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8a64000c00 tx=0x7f8a64008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:20.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.307+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8a6c050790 con 0x7f8a7806a5d0 2024-09-13T18:56:20.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.499+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 --> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a780cdab0 con 0x7f8a58066730 2024-09-13T18:56:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a75600700 1 -- 172.21.15.81:0/2119428759 <== mgr.4110 v2:172.21.15.81:6832/3385480382 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48181 (secure 0 0 0) 0x7f8a64004040 con 0x7f8a58066730 2024-09-13T18:56:20.512 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:56:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8a58066730 msgr2=0x7f8a58068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8a58066730 0x7f8a58068bf0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f8a64000c00 tx=0x7f8a64008030 comp rx=0 tx=0).stop 2024-09-13T18:56:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 msgr2=0x7f8a7815d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 0x7f8a7815d070 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00c410 tx=0x7f8a6c00c7d0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 shutdown_connections 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f8a58066730 0x7f8a58068bf0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a7815b700 0x7f8a781e72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a7806c460 0x7f8a781e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 --2- 172.21.15.81:0/2119428759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7806a5d0 0x7f8a7815d070 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 >> 172.21.15.81:0/2119428759 conn(0x7f8a780b08d0 msgr2=0x7f8a780b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 shutdown_connections 2024-09-13T18:56:20.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.503+0000 7f8a7fe00700 1 -- 172.21.15.81:0/2119428759 wait complete. 2024-09-13T18:56:20.516 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-13T18:56:20.535 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":383,"stamp":"2024-09-13T18:56:19.154156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":261012,"kb_used_data":12072,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713708,"statfs":{"total":773094113280,"available":772826836992,"internally_reserved":0,"allocated":12361728,"data_stored":6358384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12741,"internal_metadata":254791227},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003584"},"pg_stats":[{"pgid":"1.0","version":"112'119","reported_seq":257,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:56:02.708750+0000","last_change":"2024-09-13T18:56:02.708915+0000","last_active":"2024-09-13T18:56:02.708750+0000","last_peered":"2024-09-13T18:56:02.708750+0000","last_clean":"2024-09-13T18:56:02.708750+0000","last_became_active":"2024-09-13T18:47:04.784896+0000","last_became_peered":"2024-09-13T18:47:04.784896+0000","last_unstale":"2024-09-13T18:56:02.708750+0000","last_undegraded":"2024-09-13T18:56:02.708750+0000","last_fullsized":"2024-09-13T18:56:02.708750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"112'119","last_scrub_stamp":"2024-09-13T18:56:02.708717+0000","last_deep_scrub":"112'119","last_deep_scrub_stamp":"2024-09-13T18:56:02.708717+0000","last_clean_scrub_stamp":"2024-09-13T18:56:02.708717+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:56.885746+0000","scrub_duration":0.0097399349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33056,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338784,"statfs":{"total":96636764160,"available":96602914816,"internally_reserved":0,"allocated":1990656,"data_stored":1237574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.121,"15min":1.0960000000000001},"min":{"1min":0.71099999999999997,"5min":0.63800000000000001,"15min":0.57899999999999996},"max":{"1min":1.591,"5min":1.746,"15min":1.746},"last":0.874},{"interface":"front","average":{"1min":1.131,"5min":1.0920000000000001,"15min":1.115},"min":{"1min":0.83899999999999997,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.423,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.0489999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1479999999999999,"15min":1.139},"min":{"1min":0.82999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.571,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.173,"5min":1.1499999999999999,"15min":1.2010000000000001},"min":{"1min":0.70999999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.45,"5min":1.7869999999999999,"15min":1.7889999999999999},"last":1.1479999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.298,"15min":1.3220000000000001},"min":{"1min":0.99099999999999999,"5min":0.79200000000000004,"15min":0.76800000000000002},"max":{"1min":1.548,"5min":1.885,"15min":1.885},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.222,"15min":1.214},"min":{"1min":0.79900000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.7070000000000001},"last":1.123}]},{"osd":3,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.262,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.6539999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.242},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3320000000000001,"15min":1.403},"min":{"1min":0.93400000000000005,"5min":0.88600000000000001,"15min":0.81999999999999995},"max":{"1min":1.45,"5min":1.861,"15min":2.2610000000000001},"last":1.2929999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.1020000000000001,"15min":1.111},"min":{"1min":0.84399999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.4990000000000001,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.1899999999999999,"15min":1.1830000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5069999999999999,"5min":1.823,"15min":1.823},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.2450000000000001,"15min":1.2949999999999999},"min":{"1min":1.016,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.474,"5min":1.9370000000000001,"15min":2.0659999999999998},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.218,"15min":1.2230000000000001},"min":{"1min":0.91800000000000004,"5min":0.76900000000000002,"15min":0.73899999999999999},"max":{"1min":1.5509999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:21 2024","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.397},"min":{"1min":1.1040000000000001,"5min":0.86199999999999999,"15min":0.85599999999999998},"max":{"1min":1.6379999999999999,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.3700000000000001,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.4750000000000001,"5min":1.845,"15min":1.845},"last":1.3320000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.111,"15min":1.131},"min":{"1min":0.626,"5min":0.626,"15min":0.371},"max":{"1min":1.448,"5min":1.619,"15min":3.0369999999999999},"last":1.085},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.103,"15min":1.1479999999999999},"min":{"1min":0.80800000000000005,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1020000000000001,"15min":1.1120000000000001},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.59799999999999998},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.153,"15min":1.1879999999999999},"min":{"1min":0.746,"5min":0.72199999999999998,"15min":0.69999999999999996},"max":{"1min":1.5169999999999999,"5min":1.5229999999999999,"15min":1.7470000000000001},"last":1.3440000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.1479999999999999,"15min":1.353},"min":{"1min":0.90800000000000003,"5min":0.67700000000000005,"15min":0.50800000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":3.7480000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.175,"15min":1.3899999999999999},"min":{"1min":0.751,"5min":0.747,"15min":0.747},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":5.0490000000000004},"last":1.1519999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.268,"15min":1.4390000000000001},"min":{"1min":0.86199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":4.883},"last":1.444},{"interface":"front","average":{"1min":1.278,"5min":1.2709999999999999,"15min":1.4490000000000001},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.55000000000000004},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":4.8630000000000004},"last":1.3740000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1579999999999999,"15min":1.262},"min":{"1min":0.72799999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.831,"5min":1.831,"15min":2.7229999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.256,"5min":1.232,"15min":1.3100000000000001},"min":{"1min":0.82399999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.744,"5min":1.744,"15min":2.077},"last":1.22}]},{"osd":5,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.26,"15min":1.3680000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.861,"5min":1.861,"15min":2.1699999999999999},"last":1.419},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3660000000000001,"15min":1.4510000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.6030000000000002},"last":1.544}]},{"osd":7,"last update":"Fri Sep 13 18:55:19 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.3600000000000001,"15min":1.4390000000000001},"min":{"1min":1.115,"5min":0.85499999999999998,"15min":0.84599999999999997},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.2120000000000002},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.3600000000000001,"15min":1.4790000000000001},"min":{"1min":0.95499999999999996,"5min":0.82299999999999995,"15min":0.63700000000000001},"max":{"1min":1.913,"5min":1.913,"15min":2.367},"last":1.611}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.075,"15min":1.1579999999999999},"min":{"1min":0.64500000000000002,"5min":0.63700000000000001,"15min":0.60799999999999998},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":2.0409999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1240000000000001,"15min":1.1499999999999999},"min":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.66400000000000003},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":2.278},"last":1.3}]},{"osd":1,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.163,"15min":1.2410000000000001},"min":{"1min":0.84799999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.087,"5min":1.119,"15min":1.1699999999999999},"min":{"1min":0.82599999999999996,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.3420000000000001,"5min":1.6839999999999999,"15min":2.1040000000000001},"last":1.069}]},{"osd":2,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1919999999999999,"15min":1.262},"min":{"1min":0.92200000000000004,"5min":0.70099999999999996,"15min":0.65600000000000003},"max":{"1min":1.617,"5min":1.619,"15min":1.9059999999999999},"last":1.218},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.123,"15min":1.2190000000000001},"min":{"1min":0.90600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3939999999999999,"5min":1.6080000000000001,"15min":2.157},"last":0.96099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2569999999999999,"15min":1.339},"min":{"1min":1.0469999999999999,"5min":0.83799999999999997,"15min":0.749},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0750000000000002},"last":1.347},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.304,"15min":1.3999999999999999},"min":{"1min":1.147,"5min":0.88700000000000001,"15min":0.80500000000000005},"max":{"1min":1.5409999999999999,"5min":1.7310000000000001,"15min":2.9470000000000001},"last":1.2829999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0940000000000001,"15min":1.1830000000000001},"min":{"1min":0.76200000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.036},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1830000000000001,"15min":1.2490000000000001},"min":{"1min":0.81399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.3159999999999998,"5min":2.3159999999999998,"15min":2.3159999999999998},"last":1.3899999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.23,"15min":1.2849999999999999},"min":{"1min":1.0229999999999999,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.698,"5min":1.698,"15min":2.0219999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2390000000000001,"15min":1.3220000000000001},"min":{"1min":0.83799999999999997,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.153,"5min":2.153,"15min":2.1739999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:55:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4610000000000001,"5min":1.3779999999999999,"15min":1.4159999999999999},"min":{"1min":1.109,"5min":0.97099999999999997,"15min":0.81699999999999995},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.415,"15min":1.4850000000000001},"min":{"1min":1.089,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.8140000000000001},"last":1.1439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.101,"15min":1.1180000000000001},"min":{"1min":0.748,"5min":0.68400000000000005,"15min":0.42899999999999999},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.147,"15min":1.141},"min":{"1min":0.79900000000000004,"5min":0.64100000000000001,"15min":0.45200000000000001},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.4950000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.302,"15min":1.3380000000000001},"min":{"1min":0.96499999999999997,"5min":0.77000000000000002,"15min":0.58499999999999996},"max":{"1min":1.6619999999999999,"5min":2.141,"15min":2.6930000000000001},"last":1.72},{"interface":"front","average":{"1min":1.254,"5min":1.2410000000000001,"15min":1.294},"min":{"1min":0.81000000000000005,"5min":0.67700000000000005,"15min":0.48099999999999998},"max":{"1min":1.6990000000000001,"5min":1.7669999999999999,"15min":2.423},"last":1.702}]},{"osd":2,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2350000000000001,"15min":1.264},"min":{"1min":0.82199999999999995,"5min":0.70099999999999996,"15min":0.59899999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.99},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.2709999999999999,"15min":1.3420000000000001},"min":{"1min":0.82899999999999996,"5min":0.75900000000000001,"15min":0.65500000000000003},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":2.335},"last":1.629}]},{"osd":3,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2070000000000001,"15min":1.2709999999999999},"min":{"1min":0.92300000000000004,"5min":0.73499999999999999,"15min":0.626},"max":{"1min":1.623,"5min":1.7689999999999999,"15min":2.621},"last":1.657},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.208,"15min":1.244},"min":{"1min":0.874,"5min":0.874,"15min":0.63600000000000001},"max":{"1min":1.5660000000000001,"5min":1.7290000000000001,"15min":1.8640000000000001},"last":1.081}]},{"osd":5,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.1759999999999999,"15min":1.258},"min":{"1min":0.79400000000000004,"5min":0.55500000000000005,"15min":0.52400000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":2.274},"last":1.5369999999999999},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.264,"15min":1.29},"min":{"1min":0.89200000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.764,"5min":2.0289999999999999,"15min":2.266},"last":1.413}]},{"osd":6,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.262,"15min":1.3140000000000001},"min":{"1min":1.0169999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.722,"5min":1.9179999999999999,"15min":2.4710000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.448,"5min":1.3460000000000001,"15min":1.421},"min":{"1min":1.0349999999999999,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.927,"5min":1.927,"15min":2.5},"last":1.353}]},{"osd":7,"last update":"Fri Sep 13 18:56:13 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.3999999999999999,"15min":1.4330000000000001},"min":{"1min":1.0700000000000001,"5min":0.72399999999999998,"15min":0.69199999999999995},"max":{"1min":2.0600000000000001,"5min":2.2360000000000002,"15min":2.395},"last":1.5840000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.4159999999999999,"15min":1.4399999999999999},"min":{"1min":1.056,"5min":0.79000000000000004,"15min":0.67400000000000004},"max":{"1min":1.8720000000000001,"5min":2.1080000000000001,"15min":2.415},"last":1.45}]}]},{"osd":3,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82599999999999996,"15min":0.875},"min":{"1min":0.623,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4510000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.65700000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.919,"5min":2.919,"15min":2.919},"last":1.24}]},{"osd":1,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.88300000000000001,"15min":0.875},"min":{"1min":0.70199999999999996,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94099999999999995,"15min":1.056},"min":{"1min":0.64700000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.345,"5min":1.345,"15min":4.0149999999999997},"last":1.0469999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.0569999999999999,"15min":1.0129999999999999},"min":{"1min":0.60999999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.755},{"interface":"front","average":{"1min":1.129,"5min":1.145,"15min":1.1559999999999999},"min":{"1min":0.73699999999999999,"5min":0.60399999999999998,"15min":0.58099999999999996},"max":{"1min":1.4770000000000001,"5min":1.5609999999999999,"15min":2.4729999999999999},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.2170000000000001,"15min":1.2310000000000001},"min":{"1min":0.98299999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":3.0699999999999998,"5min":3.0699999999999998,"15min":3.0699999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.1599999999999999,"15min":1.214},"min":{"1min":0.91700000000000004,"5min":0.82299999999999995,"15min":0.71199999999999997},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.117}]},{"osd":5,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.996,"5min":0.89000000000000001,"15min":0.81999999999999995},"max":{"1min":1.734,"5min":1.734,"15min":2.0099999999999998},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.27,"15min":1.343},"min":{"1min":0.96599999999999997,"5min":0.85099999999999998,"15min":0.75900000000000001},"max":{"1min":1.8740000000000001,"5min":1.9870000000000001,"15min":2.6030000000000002},"last":1.367}]},{"osd":6,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3069999999999999,"15min":1.3959999999999999},"min":{"1min":1.157,"5min":0.85399999999999998,"15min":0.79800000000000004},"max":{"1min":1.5940000000000001,"5min":1.9239999999999999,"15min":2.714},"last":1.454},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.3029999999999999,"15min":1.389},"min":{"1min":0.96499999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":1.4810000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:17 2024","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.331,"15min":1.458},"min":{"1min":1.075,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.7799999999999998},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3180000000000001,"15min":1.3999999999999999},"min":{"1min":1.0629999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.98,"5min":1.98,"15min":1.9810000000000001},"last":1.306}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32480,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.80000000000000004,"15min":0.92500000000000004},"min":{"1min":0.54900000000000004,"5min":0.434,"15min":0.40799999999999997},"max":{"1min":1.292,"5min":1.3959999999999999,"15min":3.4169999999999998},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.81799999999999995,"15min":0.98399999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.286,"5min":1.54,"15min":4.6349999999999998},"last":0.77100000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.87,"15min":1.052},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":1.7350000000000001,"15min":4.1479999999999997},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0660000000000001,"15min":1.1799999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.593,"5min":1.762,"15min":4.7009999999999996},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.129,"15min":1.2569999999999999},"min":{"1min":0.67900000000000005,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.784,"5min":1.784,"15min":4.1920000000000002},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.0369999999999999,"15min":1.1679999999999999},"min":{"1min":0.68300000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.5069999999999999,"5min":1.6040000000000001,"15min":3.4590000000000001},"last":0.94399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2150000000000001,"15min":1.5249999999999999},"min":{"1min":0.82399999999999995,"5min":0.627,"15min":0.627},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":8.6989999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.3919999999999999},"min":{"1min":0.85599999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.819,"5min":1.819,"15min":4.7309999999999999},"last":1.5}]},{"osd":5,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2869999999999999,"15min":1.446},"min":{"1min":1.002,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.776,"5min":1.8740000000000001,"15min":4.7590000000000003},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.2709999999999999,"15min":1.4239999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.944,"5min":1.944,"15min":4.335},"last":1.5389999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.306,"15min":1.4730000000000001},"min":{"1min":0.96499999999999997,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":1.8939999999999999,"5min":1.8939999999999999,"15min":4.3730000000000002},"last":1.472},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.274,"15min":1.619},"min":{"1min":0.88200000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.73,"5min":2.2050000000000001,"15min":8.6300000000000008},"last":1.425}]},{"osd":7,"last update":"Fri Sep 13 18:55:24 2024","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3460000000000001,"15min":1.498},"min":{"1min":0.90900000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.9390000000000001,"5min":1.9399999999999999,"15min":4.6699999999999999},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.3859999999999999,"15min":1.5489999999999999},"min":{"1min":1.0089999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":4.4050000000000002},"last":1.5860000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32484,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1396736,"data_stored":647206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72799999999999998,"15min":0.83899999999999997},"min":{"1min":0.50600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.0669999999999999,"5min":1.264,"15min":2.2170000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.78900000000000003,"15min":0.97899999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":6.1760000000000002},"last":0.83699999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":1.0009999999999999,"15min":1.133},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.395,"5min":1.9350000000000001,"15min":2.5539999999999998},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":1.0329999999999999},"min":{"1min":0.623,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.2789999999999999,"5min":1.804,"15min":2.6219999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.085,"15min":1.252},"min":{"1min":0.63500000000000001,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.5329999999999999,"5min":1.748,"15min":6.0919999999999996},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0349999999999999,"15min":1.3049999999999999},"min":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.46300000000000002},"max":{"1min":1.4590000000000001,"5min":1.768,"15min":10.368},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1930000000000001,"15min":1.327},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.4490000000000001,"5min":1.8660000000000001,"15min":3.0739999999999998},"last":1.087},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2270000000000001,"15min":1.325},"min":{"1min":0.83499999999999996,"5min":0.82499999999999996,"15min":0.80000000000000004},"max":{"1min":1.4530000000000001,"5min":1.958,"15min":2.911},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2230000000000001,"15min":1.589},"min":{"1min":0.745,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.109,"5min":2.109,"15min":10.214},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.268,"15min":1.421},"min":{"1min":0.85699999999999998,"5min":0.80700000000000005,"15min":0.77600000000000002},"max":{"1min":1.478,"5min":1.669,"15min":2.8849999999999998},"last":1.415}]},{"osd":6,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.272,"15min":1.4910000000000001},"min":{"1min":0.879,"5min":0.874,"15min":0.874},"max":{"1min":1.607,"5min":1.915,"15min":6.032},"last":1.248},{"interface":"front","average":{"1min":1.3,"5min":1.298,"15min":1.6419999999999999},"min":{"1min":0.96099999999999997,"5min":0.94099999999999995,"15min":0.77300000000000002},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":10.112},"last":1.2190000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:55:27 2024","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3680000000000001,"15min":1.704},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.81299999999999994},"max":{"1min":2.02,"5min":2.02,"15min":10.172000000000001},"last":1.371},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.3220000000000001,"15min":1.5009999999999999},"min":{"1min":0.92100000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.532,"5min":1.762,"15min":3.0299999999999998},"last":1.3220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33056,"kb_used_data":1944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338784,"statfs":{"total":96636764160,"available":96602914816,"internally_reserved":0,"allocated":1990656,"data_stored":1237574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.76600000000000001,"15min":0.90900000000000003},"min":{"1min":0.56499999999999995,"5min":0.379,"15min":0.32600000000000001},"max":{"1min":1.3540000000000001,"5min":1.476,"15min":4.2039999999999997},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86199999999999999,"15min":0.94599999999999995},"min":{"1min":0.64700000000000002,"5min":0.45800000000000002,"15min":0.36699999999999999},"max":{"1min":1.413,"5min":1.427,"15min":2.7450000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.90400000000000003,"15min":1.0549999999999999},"min":{"1min":0.64300000000000002,"5min":0.501,"15min":0.39200000000000002},"max":{"1min":1.212,"5min":1.3260000000000001,"15min":3.7349999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":0.96999999999999997,"15min":1.123},"min":{"1min":0.78700000000000003,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.385,"5min":1.589,"15min":3.5640000000000001},"last":1.3109999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":0.98899999999999999,"15min":1.1180000000000001},"min":{"1min":0.72699999999999998,"5min":0.52100000000000002,"15min":0.47199999999999998},"max":{"1min":1.7689999999999999,"5min":2.0670000000000002,"15min":4.093},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.137,"15min":1.3149999999999999},"min":{"1min":0.85799999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.637,"5min":2.3650000000000002,"15min":4.7439999999999998},"last":1.2709999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.238,"15min":1.367},"min":{"1min":0.878,"5min":0.81000000000000005,"15min":0.745},"max":{"1min":1.4239999999999999,"5min":2.274,"15min":3.4060000000000001},"last":1.054},{"interface":"front","average":{"1min":1.252,"5min":1.196,"15min":1.363},"min":{"1min":0.82899999999999996,"5min":0.82299999999999995,"15min":0.82099999999999995},"max":{"1min":1.599,"5min":1.881,"15min":4.5449999999999999},"last":0.96799999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.4870000000000001},"min":{"1min":0.94599999999999995,"5min":0.85899999999999999,"15min":0.753},"max":{"1min":1.4319999999999999,"5min":2.0750000000000002,"15min":4.9390000000000001},"last":1.339},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2609999999999999,"15min":1.4359999999999999},"min":{"1min":1.0740000000000001,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5569999999999999,"5min":1.7290000000000001,"15min":3.2290000000000001},"last":1.399}]},{"osd":6,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2609999999999999,"15min":1.4410000000000001},"min":{"1min":0.95799999999999996,"5min":0.86199999999999999,"15min":0.83999999999999997},"max":{"1min":1.681,"5min":1.968,"15min":4.4569999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3080000000000001,"15min":1.5549999999999999},"min":{"1min":1.0109999999999999,"5min":0.94499999999999995,"15min":0.70399999999999996},"max":{"1min":1.7290000000000001,"5min":1.873,"15min":4.8570000000000002},"last":1.454}]},{"osd":7,"last update":"Fri Sep 13 18:56:17 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.335,"15min":1.498},"min":{"1min":1.103,"5min":0.89700000000000002,"15min":0.86099999999999999},"max":{"1min":1.5109999999999999,"5min":1.798,"15min":3.056},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.327,"15min":1.51},"min":{"1min":1.1659999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.869,"5min":2.149,"15min":4.5019999999999998},"last":1.357}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:56:20.537 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:56:20.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.691+0000 7f95dfe00700 1 Processor -- start 2024-09-13T18:56:20.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.691+0000 7f95dfe00700 1 -- start start 2024-09-13T18:56:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e00b5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dfe00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95e00afe10 0x7f95e006a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dfe00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e006f1a0 con 0x7f95e006f630 2024-09-13T18:56:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dfe00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e00b3920 con 0x7f95e00afe10 2024-09-13T18:56:20.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dfe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e00b3b00 con 0x7f95e015ca40 2024-09-13T18:56:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95de000700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f95e006f630 0x7f95e00af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46366/0 (socket says 172.21.15.81:46366) 2024-09-13T18:56:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95de000700 1 -- 172.21.15.81:0/3260016413 learned_addr learned my addr 172.21.15.81:0/3260016413 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:56:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95df400700 1 --2- 172.21.15.81:0/3260016413 >> v2:172.21.15.81:3300/0 conn(0x7f95e00afe10 0x7f95e006a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dea00700 1 --2- 172.21.15.81:0/3260016413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e00b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95df400700 1 -- 172.21.15.81:0/3260016413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 msgr2=0x7f95e00b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:56:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95df400700 1 --2- 172.21.15.81:0/3260016413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e00b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95df400700 1 -- 172.21.15.81:0/3260016413 >> v1:172.21.15.81:6789/0 conn(0x7f95e006f630 legacy=0x7f95e00af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95df400700 1 -- 172.21.15.81:0/3260016413 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e00b3de0 con 0x7f95e00afe10 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95df400700 1 --2- 172.21.15.81:0/3260016413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e006a390 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009d90 tx=0x7f95d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c53dd96faa3a78a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dd600700 1 -- 172.21.15.81:0/3260016413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800e070 con 0x7f95e00afe10 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dd600700 1 -- 172.21.15.81:0/3260016413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800bbd0 con 0x7f95e00afe10 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.695+0000 7f95dd600700 1 -- 172.21.15.81:0/3260016413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8012430 con 0x7f95e00afe10 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 -- 172.21.15.81:0/3260016413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 msgr2=0x7f95e006a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3260016413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e006a390 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009d90 tx=0x7f95d800b330 comp rx=0 tx=0).stop 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 -- 172.21.15.81:0/3260016413 shutdown_connections 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3260016413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e006a390 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3260016413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e00b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 -- 172.21.15.81:0/3260016413 >> 172.21.15.81:0/3260016413 conn(0x7f95e00b2620 msgr2=0x7f95e00b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:20.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 -- 172.21.15.81:0/3260016413 shutdown_connections 2024-09-13T18:56:20.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.699+0000 7f95dfe00700 1 -- 172.21.15.81:0/3260016413 wait complete. 2024-09-13T18:56:20.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 Processor -- start 2024-09-13T18:56:20.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 -- start start 2024-09-13T18:56:20.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e006f630 0x7f95e015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e01558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e015ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01f67c0 con 0x7f95e00afe10 2024-09-13T18:56:20.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e01f58f0 con 0x7f95e006f630 2024-09-13T18:56:20.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dfe00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e0155de0 con 0x7f95e015ca40 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e01558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e01558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45362/0 (socket says 172.21.15.81:45362) 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 -- 172.21.15.81:0/3424701410 learned_addr learned my addr 172.21.15.81:0/3424701410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95df400700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e015ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95dea00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e006f630 0x7f95e015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 -- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 msgr2=0x7f95e015ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e015ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 -- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e006f630 msgr2=0x7f95e015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e006f630 0x7f95e015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.703+0000 7f95de000700 1 -- 172.21.15.81:0/3424701410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8009a70 con 0x7f95e00afe10 2024-09-13T18:56:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95de000700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e01558a0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c520 tx=0x7f95cc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc005d90 con 0x7f95e00afe10 2024-09-13T18:56:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0070d0 con 0x7f95e00afe10 2024-09-13T18:56:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc007440 con 0x7f95e00afe10 2024-09-13T18:56:20.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e01f5b40 con 0x7f95e00afe10 2024-09-13T18:56:20.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e01f6100 con 0x7f95e00afe10 2024-09-13T18:56:20.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.707+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e00704b0 con 0x7f95e00afe10 2024-09-13T18:56:20.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.711+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95cc0075a0 con 0x7f95e00afe10 2024-09-13T18:56:20.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.711+0000 7f95d6a00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95c0066730 0x7f95c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:20.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.711+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f95cc083340 con 0x7f95e00afe10 2024-09-13T18:56:20.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.711+0000 7f95dea00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95c0066730 0x7f95c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:20.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.711+0000 7f95dea00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95c0066730 0x7f95c0068bf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f95d0007a60 tx=0x7f95d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:20.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.715+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95cc0507d0 con 0x7f95e00afe10 2024-09-13T18:56:20.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.895+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f95e006b5d0 con 0x7f95e00afe10 2024-09-13T18:56:20.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.903+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f95cc001270 con 0x7f95e00afe10 2024-09-13T18:56:20.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.907+0000 7f95d6a00700 1 -- 172.21.15.81:0/3424701410 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f95cc053df0 con 0x7f95e00afe10 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95c0066730 msgr2=0x7f95c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95c0066730 0x7f95c0068bf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f95d0007a60 tx=0x7f95d0008040 comp rx=0 tx=0).stop 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 msgr2=0x7f95e01558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e01558a0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c520 tx=0x7f95cc00c830 comp rx=0 tx=0).stop 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 shutdown_connections 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f95c0066730 0x7f95c0068bf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95e015ca40 0x7f95e015ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e00afe10 0x7f95e01558a0 secure :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c520 tx=0x7f95cc00c830 comp rx=0 tx=0).stop 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 --2- 172.21.15.81:0/3424701410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95e006f630 0x7f95e015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 >> 172.21.15.81:0/3424701410 conn(0x7f95e00b2620 msgr2=0x7f95e0160de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:20.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 shutdown_connections 2024-09-13T18:56:20.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:20.911+0000 7f95dfe00700 1 -- 172.21.15.81:0/3424701410 wait complete. 2024-09-13T18:56:20.941 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:56:20.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:56:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.095+0000 7f14dcc00700 1 Processor -- start 2024-09-13T18:56:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.095+0000 7f14dcc00700 1 -- start start 2024-09-13T18:56:21.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14dcc00700 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14d80b19f0 0x7f14d806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:21.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14dcc00700 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80ce140 con 0x7f14d806a5d0 2024-09-13T18:56:21.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14dcc00700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80b1e40 con 0x7f14d8071d20 2024-09-13T18:56:21.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14dcc00700 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80cde60 con 0x7f14d80b19f0 2024-09-13T18:56:21.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d5e00700 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f14d806a5d0 0x7f14d806a9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46376/0 (socket says 172.21.15.81:46376) 2024-09-13T18:56:21.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d5e00700 1 -- 172.21.15.81:0/879858370 learned_addr learned my addr 172.21.15.81:0/879858370 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-13T18:56:21.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d6800700 1 --2- 172.21.15.81:0/879858370 >> v2:172.21.15.81:3300/0 conn(0x7f14d80b19f0 0x7f14d806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:21.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d4a00700 1 -- 172.21.15.81:0/879858370 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727592003 0 0) 0x7f14d80ce140 con 0x7f14d806a5d0 2024-09-13T18:56:21.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d4a00700 1 -- 172.21.15.81:0/879858370 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14bc0035d0 con 0x7f14d806a5d0 2024-09-13T18:56:21.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d6800700 1 -- 172.21.15.81:0/879858370 >> v1:172.21.15.178:6789/0 conn(0x7f14d8071d20 legacy=0x7f14d80cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d6800700 1 -- 172.21.15.81:0/879858370 >> v1:172.21.15.81:6789/0 conn(0x7f14d806a5d0 legacy=0x7f14d806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.099+0000 7f14d6800700 1 -- 172.21.15.81:0/879858370 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d806c3b0 con 0x7f14d80b19f0 2024-09-13T18:56:21.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14d6800700 1 --2- 172.21.15.81:0/879858370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d806ce90 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009850 tx=0x7f14d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b411fee242a45adf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:21.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14d4a00700 1 -- 172.21.15.81:0/879858370 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0011830 con 0x7f14d80b19f0 2024-09-13T18:56:21.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14d4a00700 1 -- 172.21.15.81:0/879858370 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f14d0011990 con 0x7f14d80b19f0 2024-09-13T18:56:21.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14d4a00700 1 -- 172.21.15.81:0/879858370 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0011d60 con 0x7f14d80b19f0 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 -- 172.21.15.81:0/879858370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 msgr2=0x7f14d806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 --2- 172.21.15.81:0/879858370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d806ce90 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009850 tx=0x7f14d0009b60 comp rx=0 tx=0).stop 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 -- 172.21.15.81:0/879858370 shutdown_connections 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 --2- 172.21.15.81:0/879858370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d806ce90 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 -- 172.21.15.81:0/879858370 >> 172.21.15.81:0/879858370 conn(0x7f14d80b08d0 msgr2=0x7f14d80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 -- 172.21.15.81:0/879858370 shutdown_connections 2024-09-13T18:56:21.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.103+0000 7f14dcc00700 1 -- 172.21.15.81:0/879858370 wait complete. 2024-09-13T18:56:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 Processor -- start 2024-09-13T18:56:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 -- start start 2024-09-13T18:56:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14d806a5d0 0x7f14d81430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:21.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14d8071d20 0x7f14d8160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d81f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d8161190 con 0x7f14d80b19f0 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d81f6ed0 con 0x7f14d806a5d0 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d81436d0 con 0x7f14d8071d20 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d81f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d81f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45380/0 (socket says 172.21.15.81:45380) 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 -- 172.21.15.81:0/2219080234 learned_addr learned my addr 172.21.15.81:0/2219080234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d5e00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14d806a5d0 0x7f14d81430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:21.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d5400700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14d8071d20 0x7f14d8160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 -- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14d8071d20 msgr2=0x7f14d8160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14d8071d20 0x7f14d8160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 -- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14d806a5d0 msgr2=0x7f14d81430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14d806a5d0 0x7f14d81430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 -- 172.21.15.81:0/2219080234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00094b0 con 0x7f14d80b19f0 2024-09-13T18:56:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14d6800700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d81f6990 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f14d0014040 tx=0x7f14d0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0019af0 con 0x7f14d80b19f0 2024-09-13T18:56:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f14d001e070 con 0x7f14d80b19f0 2024-09-13T18:56:21.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d8145d20 con 0x7f14d80b19f0 2024-09-13T18:56:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.107+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d001a420 con 0x7f14d80b19f0 2024-09-13T18:56:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.111+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d81462e0 con 0x7f14d80b19f0 2024-09-13T18:56:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.111+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d806d840 con 0x7f14d80b19f0 2024-09-13T18:56:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.111+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f14d001a580 con 0x7f14d80b19f0 2024-09-13T18:56:21.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.111+0000 7f14ce000700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f14b8066730 0x7f14b8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:56:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.111+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f14d00851f0 con 0x7f14d80b19f0 2024-09-13T18:56:21.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.115+0000 7f14d5e00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f14b8066730 0x7f14b8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:56:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.115+0000 7f14d5e00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f14b8066730 0x7f14b8068bf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f14c8001560 tx=0x7f14c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:56:21.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.119+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f14d00525d0 con 0x7f14d80b19f0 2024-09-13T18:56:21.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.351+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14d806d3a0 con 0x7f14d80b19f0 2024-09-13T18:56:21.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.355+0000 7f14ce000700 1 -- 172.21.15.81:0/2219080234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+3534 (secure 0 0 0) 0x7f14d0020de0 con 0x7f14d80b19f0 2024-09-13T18:56:21.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-13T18:56:21.364 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":117,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7547,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6834/970662444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":970662444},{"type":"v1","addr":"172.21.15.178:6834","nonce":970662444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9223,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2678648514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6833","nonce":2678648514},{"type":"v1","addr":"172.21.15.178:6835","nonce":2678648514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":9804,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/356735588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":356735588},{"type":"v1","addr":"172.21.15.81:6835","nonce":356735588}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":9807,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2719932998","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":2719932998},{"type":"v1","addr":"172.21.15.81:6837","nonce":2719932998}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[]} 2024-09-13T18:56:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f14b8066730 msgr2=0x7f14b8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f14b8066730 0x7f14b8068bf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f14c8001560 tx=0x7f14c8009040 comp rx=0 tx=0).stop 2024-09-13T18:56:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 msgr2=0x7f14d81f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:56:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d81f6990 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f14d0014040 tx=0x7f14d0004770 comp rx=0 tx=0).stop 2024-09-13T18:56:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 shutdown_connections 2024-09-13T18:56:21.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:6832/3385480382,v1:172.21.15.81:6833/3385480382] conn(0x7f14b8066730 0x7f14b8068bf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14d80b19f0 0x7f14d81f6990 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14d8071d20 0x7f14d8160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 --2- 172.21.15.81:0/2219080234 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14d806a5d0 0x7f14d81430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:56:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 >> 172.21.15.81:0/2219080234 conn(0x7f14d80b08d0 msgr2=0x7f14d81497b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:56:21.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 shutdown_connections 2024-09-13T18:56:21.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-13T18:56:21.359+0000 7f14dcc00700 1 -- 172.21.15.81:0/2219080234 wait complete. 2024-09-13T18:56:21.371 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 117 2024-09-13T18:56:21.391 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T18:56:21.392 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:56:21.392 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:56:21.392 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:21.416 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:56:21.416 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:56:21.416 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:21.486 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:56:21.486 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:56:21.486 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:21.514 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:56:21.515 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:56:21.515 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:21.580 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:56:21.581 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:56:21.581 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:56:21.581 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:21.666 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:56:21.666 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:56:21.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:27.769 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:56:27.769 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:56:27.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:27.854 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:56:27.854 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:56:27.854 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:28.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-13T18:56:33.956 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:56:33.957 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:56:33.957 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:34.026 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:56:34.027 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:56:34.027 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:34.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T18:56:34.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-13T18:56:40.129 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:56:40.129 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:56:40.129 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:40.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T18:56:40.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T18:56:40.212 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:56:40.213 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:56:40.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:44.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:44.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:45.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T18:56:45.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T18:56:46.315 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:56:46.315 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:56:46.315 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:56:46.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:46.389 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:56:46.389 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:56:46.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:46.452 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:56:46.452 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:56:46.452 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:56:46.452 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:46.482 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:56:46.482 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:56:46.482 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:46.516 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:56:46.516 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:56:46.517 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:56:46.590 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:56:46.591 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:56:46.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Scrub error on inode' | head -n 1 2024-09-13T18:56:46.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:56:46.642 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:56:46.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:56:46.911 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:56:47.183 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:56:47.183 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:56:47.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:56:47.405 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:56:47.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:56:47.688 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:56:47.943 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:56:47.943 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:56:48.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:56:48.198 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:56:48.450 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:56:48.451 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:56:48.661 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:56:48.662 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/data/mon.a.tgz 2024-09-13T18:56:48.663 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-13T18:56:48.680 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.Um4YI46e9W 2024-09-13T18:56:48.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Um4YI46e9W 2024-09-13T18:56:48.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.Um4YI46e9W 2024-09-13T18:56:48.944 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.Um4YI46e9W is 381KB 2024-09-13T18:56:48.978 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.Um4YI46e9W 2024-09-13T18:56:48.993 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/data/mon.b.tgz 2024-09-13T18:56:48.994 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-13T18:56:49.011 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.Izocfh0yGz 2024-09-13T18:56:49.012 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Izocfh0yGz 2024-09-13T18:56:49.176 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.Izocfh0yGz 2024-09-13T18:56:49.268 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.Izocfh0yGz is 382KB 2024-09-13T18:56:49.340 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.Izocfh0yGz 2024-09-13T18:56:49.358 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/data/mon.c.tgz 2024-09-13T18:56:49.359 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-13T18:56:49.417 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.ctfFVHUXJe 2024-09-13T18:56:49.417 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ctfFVHUXJe 2024-09-13T18:56:49.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.ctfFVHUXJe 2024-09-13T18:56:49.678 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.ctfFVHUXJe is 382KB 2024-09-13T18:56:49.752 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.ctfFVHUXJe 2024-09-13T18:56:49.769 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:56:49.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:56:49.775 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:56:49.846 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:56:49.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:56:49.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:56:49.940 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:56:49.942 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:56:49.956 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:56:49.958 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/remote/smithi081/crash 2024-09-13T18:56:49.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:56:49.992 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/remote/smithi178/crash 2024-09-13T18:56:49.993 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:56:50.028 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:56:50.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:50.047 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:50.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:50.175 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:56:50.212 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:56:50.212 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:56:50.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:56:50.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T18:56:56.635 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:56:56.636 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/remote/smithi081/log 2024-09-13T18:56:56.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:56:58.477 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/remote/smithi178/log 2024-09-13T18:56:58.479 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:56:59.242 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:56:59.252 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:56:59.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:56:59.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:56:59.365 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:56:59.375 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:56:59.375 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:56:59.381 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:56:59.416 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:56:59.416 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-13T18:56:59.416 INFO:teuthology.orchestra.run.smithi081.stdout:+hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.104 4.506 0.338 2024-09-13T18:56:59.416 INFO:teuthology.orchestra.run.smithi081.stdout:*hv02.front.sepi 96.245.170.99 3 u 4 64 377 0.084 0.596 0.326 2024-09-13T18:56:59.417 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.114 4.918 0.171 2024-09-13T18:56:59.417 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2024-09-13T18:56:59.424 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:56:59.424 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-09-13T18:56:59.424 INFO:teuthology.orchestra.run.smithi178.stdout:*hv01.front.sepi 67.205.162.81 3 u 63 64 377 0.117 3.105 1.270 2024-09-13T18:56:59.425 INFO:teuthology.orchestra.run.smithi178.stdout:+hv02.front.sepi 96.245.170.99 3 u 5 64 377 0.118 -3.005 1.186 2024-09-13T18:56:59.425 INFO:teuthology.orchestra.run.smithi178.stdout:+hv03.front.sepi 74.6.168.72 3 u 8 64 377 0.136 3.024 0.842 2024-09-13T18:56:59.425 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 0.000 0.000 2024-09-13T18:56:59.426 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:56:59.439 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:56:59.441 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:56:59.450 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:56:59.461 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:56:59.471 INFO:teuthology.task.internal:Duration was 1303.469198 seconds 2024-09-13T18:56:59.471 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:56:59.483 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:56:59.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:56:59.489 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:56:59.632 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:56:59.633 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-13T18:56:59.633 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:56:59.669 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-09-13T18:56:59.669 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:56:59.702 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:56:59.702 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:56:59.719 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:56:59.811 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:56:59.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:56:59.817 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:56:59.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:56:59.942 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:56:59.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:56:59.974 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:57:00.010 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:57:00.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:57:00.025 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:57:00.053 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-13T18:57:00.088 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-09-13T18:57:00.125 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:57:00.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:57:00.145 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:57:00.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:57:00.185 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:57:00.196 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:57:00.197 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/remote/smithi081 2024-09-13T18:57:00.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:57:00.242 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7904001/remote/smithi178 2024-09-13T18:57:00.243 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:57:00.284 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:57:00.284 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:57:00.290 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:57:00.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:57:00.362 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:57:00.362 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:57:00.379 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:57:00.379 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:57:00.385 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:57:00.399 INFO:teuthology.orchestra.run.smithi081.stdout: 1181012 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:57 /home/ubuntu/cephtest 2024-09-13T18:57:00.411 INFO:teuthology.orchestra.run.smithi178.stdout: 1181009 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:57 /home/ubuntu/cephtest 2024-09-13T18:57:00.417 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:57:00.428 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:57:00.455 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/multimds_misc} duration: 1303.4691977500916 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:57:00.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:57:00.559 INFO:teuthology.run:pass